JP2006255109A - Endoscope apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an endoscope which allows a user to store images easily and credibly. <P>SOLUTION: The endoscope apparatus comprises acquiring means 102 and 102' for acquiring an image taken by an endoscope, a digital image processing means 136 for subjecting the image acquired by the acquiring means to digital image processing, analog output means 222 and 235 for converting the digital image subjected to digital image processing into analog and for outputting it, an analog peripheral component connected to the analog output means, a coding means 237 for coding the digital image, a digital image output means 237 for outputting the coded digital image, a digital peripheral component connected to the digital output means, and a record directing means 114 capable of directing the analog peripheral component and the digital peripheral component to carry out recording which can select from the connected analog peripheral component and the digital peripheral component and direct recording. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an endoscope that includes an endoscope, a processor that processes an image captured by the endoscope, and peripheral devices connected to the processor.

  Conventionally, in an endoscope apparatus including an endoscope, a light source, a processor that processes an image captured by the endoscope, and peripheral devices connected to the processor, for example, Japanese Patent Application Laid-Open No. 2001-157665 Japanese Patent Laid-Open No. 10-286232 proposes output of a digital video signal.

  Japanese Patent Laid-Open No. 2001-157665 adjusts the timing of digital signal processing at a square pixel frequency corresponding to a square pixel (square pixel) when an image signal is converted into a digital output signal and output to the outside. Is.

Japanese Patent Laid-Open No. 10-286232 generates a digital video signal of a plurality of formats, selects one of the plurality of formats, and the digital video signal of the selected format is output from the signal output terminal. Is.
Japanese Patent Laid-Open No. 2001-157665 Japanese Patent Laid-Open No. 10-286232

However, JP 2001-157665 A does not propose the following.
• Only images with a size corresponding to the square pixel frequency can be output. (When the square pixel frequency = 12.2727 (MHz), only an image of VGA size (640 × 480) can be output.

-When multiple image sizes can be selected, it is not possible to select the optimum enhancement or enlargement process for the image size (the enhancement process and the enlargement process are simple because the optimum coefficient is set for each endoscope image size. Resize will not give you the best image).

Japanese Patent Laid-Open No. 10-286232 has not been proposed for the following.
-When multiple size images cannot be output and multiple image sizes can be selected, it is not possible to select enhancement processing or enlargement processing that is optimal for the image size.

・ Multiple formats cannot be selected with the same hardware using programmable ICs (FPGA, DSP, etc.). To output multiple formats, it is easy to add hardware. It is difficult to do at low cost and cannot be supported by version upgrade). Also, there was no means for easily selecting firmware. FPGA is an abbreviation for Field Programmable Gate Array, and DSP is an abbreviation for Digital Signal Processor.

In addition, in the above-mentioned JP-A-2001-157665 and JP-A-10-286232,
There was no means for selecting so that an original image without codec (encoding / compression / decompression) could be recorded. The user needed to record the original image in order to perform detailed diagnosis, examination, and image analysis.

・ Security was not provided for recorded images.

-When multiple analog I / O peripheral devices that the user has previously owned and digital I / O peripheral devices that are newly purchased are connected, there was no means to easily control recording instructions.

-There was no means for easily displaying recorded images.

  In view of the above problems, an object of the present invention is to provide an endoscope apparatus that allows a user to record an image easily and reliably.

  An endoscope apparatus according to the present invention includes an acquisition unit that acquires an image captured by an endoscope, a digital image processing unit that digitally processes the image acquired by the acquisition unit, and a digital image that has been subjected to the digital image processing. Analog output means for converting to analog and outputting, analog peripheral device connected to the analog output means, encoding means for encoding the digital image, and digital output means for outputting the encoded digital image A digital peripheral device connected to the digital output means; a recording instruction means for instructing recording to the analog peripheral device and the digital peripheral device, the recording instruction means being connected to the analog peripheral device And a recording instructing unit that can select and record from a peripheral device and the digital peripheral device.

  With the above configuration, the acquisition means is constituted by the CCDs 102 and 102 '. The digital image processing means is composed of a video processing unit 136, the analog output means is composed of D / A converters 235 and 222 of the video processing unit 136, and analog peripheral devices are shown in FIGS. 6 (a) and 6 (b). The encoding means and the digital output means are composed of the digital output section 237 of the video processing section 136, the digital peripheral device is composed of FIG. 6C, and the recording instruction means is the keyboard 114 (and the control processing section). 138).

  In the present invention, the encoded digital image can generate a plurality of sizes, and the digital image processing is changed according to the size.

  In the present invention, the encoding means is performed by a programmable IC, and has means for selecting firmware of the programmable IC.

  Here, the programmable IC is not only a fixed logic but also a hardware device (such as a DSP) whose operation can be controlled by a software program (a series of work instructions can be given by the software program), or an FPGA / reconfigurable processor. Say. Firmware is a software program or FPGA / reconfigurable processor configuration that is embedded in a hardware device to perform an operation determined by other information in a control device or computer. Say the data.

  In the present invention, the encoding means includes moving image processing or still image processing.

  In the present invention, it is also possible to output a digital image that is not subjected to processing by the encoding means.

  In the present invention, a digital image recorded on the digital peripheral device can be displayed.

  In the present invention, thumbnail images can also be displayed.

  In the present invention, a part of the digital peripheral device backs up the digital image.

According to the endoscope apparatus of the present invention,
A user can select a peripheral device to be recorded from a plurality of peripheral devices by selecting and assigning a recording instruction key of the peripheral device to be recorded to the operation device.

  -Encoded (compressed) digital images can generate multiple sizes of normal SDTV endoscope composite still images and square pixel SDTV endoscope composite still images, and support normal or square pixels from memory The controller 111 reads out the enlarged (reduced) coefficient, the enhancement coefficient, the image rotation parameter, and the like, and processes the endoscopic image, so that the endoscopic image optimal for each size can be processed. In addition, a recording peripheral device can be set for each size.

-The user can easily and reliably perform the following processing on the setting screen.
・ ・ By selecting the type of encoding in the item “Encode Type”, the user can select the encoding process he / she wants to set. In addition, when all (or part of) the image compression unit and the image decompression unit are composed of programmable ICs, configuration data and programs (firmware) automatically corresponding after selection by the item “Encode Type” Can be downloaded (reconfigured) again to change the encoding process. Therefore, a plurality of encoding processes can be performed with the same hardware.

.. Encoding type can encode moving images (WMV / H.264 / MPEG2 / MPEG4 / AVI) or still images (JPEG / JPEG2000 / TIFF / BMP).
.. By turning OFF the item “Encode Type”, it is possible to record / reproduce and display an unencoded (uncompressed) image.

-The user can easily and reliably display digital images recorded on peripheral devices. In addition, the processing of the image decompression unit can be automatically performed based on the setting on the setting screen and the attached information of the recorded image. In addition, it is possible to display a directory and a file name, and display a multi-image by thumbnail images so that a reproduction image can be easily searched. In addition, it is possible to select which peripheral device's recorded image is to be displayed.
As the order of transfer to the peripheral device, the image may be first stored in a peripheral device (for example, a PC card or a memory card) as an image backup, and then recorded in another peripheral device. As a result, even if the processor is turned off during recording to a peripheral device or when there is a communication error, the images and thumbnails stored in the peripheral device (PC card or memory card) backed up again when the power is turned on again automatically Can be transferred automatically. This makes it possible to record an image safely and reliably.

  As described above, according to the present invention, the user can easily and reliably record an image.

Embodiments of the invention will be described with reference to the drawings.

FIG. 1 is an overall configuration diagram showing Embodiment 1 of an endoscope apparatus according to the present invention.
In FIG. 1, an endoscope 101 includes a CCD (Carge Coupled Device) 102 as a solid-state imaging device provided at the distal end of an insertion portion to be inserted into a body cavity of a patient, and a light guide 107 that guides observation illumination light to the distal end of the insertion portion. An operation switch unit 103 provided in an operation unit for operating the endoscope, a connector 115 for connecting to the processor 113, a program and endoscope specific information data (type of CCD, scope type, scope Non-volatile memory 108 (EEPROM, FLASH) for storing a serial number, a plurality of white balance data, the number and channel diameter of forceps channels, the number of energizations to the CPU 109, the number of pressings of the operation switch unit 103, the bending characteristics of the insertion unit, etc. ROM, FRAM, FeRAM, MRAM, OUM, SRAM with battery, etc. CPU10 Interface may be either a parallel interface or a serial interface), data read / write control to the memory 108, and data stored in the memory 108 with the processor 113, signal line 111a, connector 115, cable 132, connector 131 , CPU 109 (serial interface, parallel interface, etc.) that performs transmission / reception via signal line 111b, and performs arithmetic processing (calculation of the number of times the scope is connected, calculation of the number of times the operation switch is pressed, calculation of the number of energizations to CPU 109, A watchdog timer, timer, SRAM, FLASH ROM for program, etc.) and reset processing that performs reset processing when the power supplied from the processor 113 fluctuates or by the watchdog timer of the CPU 9 Circuit (hereinafter, RESET circuit) configured with one (110).

  As a method for supplying power from the processor 113 to the CPU 109, the memory 108, and the RESET circuit 110, a driving power source for the CCD 102 sent from the driving circuit 139 via the 106a and 106b may be used, or a dedicated power source (not shown) is used. The power line may be used. A switch on / off signal (hereinafter referred to as an ON / OFF signal) (corresponding to a power supply level or a GND level supplied from the drive circuit 139) of the operation switch unit 103 is a signal line 104a, a connector 115, a cable 132, a connector 131, The signal is input to the selector 135 via the signal line 104b.

An endoscopic image captured by the CCD 102 is input to the selector 135 in the processor 113 via the signal line 105a, the connector 115, the cable 132, the connector 131, and the signal line 105b.
A signal for transmitting and receiving data from the CPU 109 is input to the selector 135 in the processor 113 via the signal line 111a, the connector 115, the cable 132, the connector 131, and the signal line 111b. (Note that the interface may be a parallel interface in addition to the serial interface as in the present embodiment).

The endoscope 101 (or CCD 102) detection signal mounted on the connector 115 is input to the selector 135 in the processor 13 via the cable 132, the connector 131, and the signal line 112b.
The processor 113 is also connected to an endoscope 101 ′ having the same function as the endoscope 101 (101 ′ to 115 ′, 131 ′, and 132 ′ have the same functions as 101 to 115, 131, and 132). It is possible to select which endoscope signal is input by the selector 135.

-Switch 104b or 104b 'and output to 104c.
-Switch 105b or 105b 'and output to 105c.
・ Switch 111b or 111b 'and output to 111c.
Switch 112b or 112b ′ and output to 112c.
Note that the endoscopes 101 and 101 ′ may be both or only one of them and may be a rigid endoscope.

Drive signals for driving the CCDs 102 and 102 'are sent from the drive circuit 139 in the processor 113 to the signal lines 106b and 106b', connectors 131 and 131 ', cables 132 and 132', connectors 115 and 115 ', and signal lines 106a and 106a'. To the CCDs 102 and 102 '.
The light source 117 cuts a specific wavelength of the observation light from the lamp 118 that emits white light that generates observation light, an RGB filter 119 for converting the observation light of the lamp 118 into RGB frame sequential light, and the lamp 118. A plurality of, for example, three special light filters 120a, 120b, 120c that generate special light, a throttle 116 that controls the amount of observation light from the lamp 118, and an RGB filter 119 and special light filters 120a, 120b, 120c. Filter switching + squeezing control 121 for controlling the aperture 116, an operation panel 125 for performing various settings such as light amount adjustment, power ON / OFF, lamp on / off, transmitted illumination, filter switching, a program, light amount adjustment data, Lamp life, light source serial number, filters 119, 120a, 120b, 1 Non-volatile memory 123 (EEPROM, FLASH ROM, FRAM, FeRAM, MRAM, OUM, SRAM with battery, etc., which can be either parallel interface or serial interface) that stores 0c type, maintenance information, etc., and data to memory 123 Read / write control and data stored in the memory 123 are transmitted / received to / from the processor 113 via the signal lines 128a and 128b, the CPU 124 controls the filter switching + squeeze control 121 and the operation panel 125, and the processor 113 It comprises a D / A converter 122 that controls the aperture 125 by changing the dimming signal to an analog signal and outputting it to the filter switching + aperture control 121.

  A signal for transmitting / receiving data from / to an SIO (serial input / output) in the CPU 124 passes through the signal line 128a, the connector 126, the cable 134, the connector 133, and the signal line 128b, and the control processing in the processor 13 is performed. It is input to the SIO (407) of the part 1 (138).

  A signal input to the D / A converter 122 indicates light amount information (photometric signal, dimming signal, etc.) of the endoscopic image captured by the CCDs 102 and 102 ′, and PIO (parallel input / output, parallel) of the processor 113. (Abbreviation of Input / Output) 408 is input via signal line 127b, connector 133, cable 134, connector 126, and signal line 127a (data format may be parallel, synchronous serial, or asynchronous). ).

  Reference numeral 129b denotes a signal for detecting the type of light source. In the case of the light source 117, the signal 129a connected to GND is input to the PIO 408 of the processor 113 in the processor 113 via the connector 126, the cable 134, and the connector 133. The In the processor 113, the CPU 1 (401) detects the LOW signal level via the PIO 408, whereby the type of the light source (light source 117) can be determined. There is also a light source (not shown) that does not have a serial interface circuit SIO in the CPU 124 and does not have a communication function with the processor 113, and the signal 129a is pulled up or opened (hereinafter referred to as OPEN). CPU 1 (401) can detect a high level (hereinafter referred to as HI) signal level.

  When the light source 117 is connected, the dimming signal adjusted on the operation panel 125 is transmitted / received through the SIO in the CPU 124.

  The processor 113 is connected to a keyboard 114 that performs control operations, a front panel 142, and a plurality of peripheral devices to be described later (details of the keyboard 114, cables between the plurality of peripheral devices and the processor 113, and connectors are omitted). Note that the cables between all the devices connected to the processor 113 may be detachable so that they can be freely detached, or the cables may be integrated so as not to be easily disconnected. The same applies to power cables and ground wires.

  The blocks of the video processing unit 1 (136), the control processing unit 1 (138), the control processing unit 2 (137), the image compression unit (140), and the image decompression unit (141) in the processor 113 Video processing and control of the processor 113 are performed (details will be described later).

  Each block may be configured for each substrate, and may be added / deleted as an optional substrate. (For example, the control processing unit 2 (137) + the image compression unit (140) + the image expansion unit (141) may be configured as an optional board, and the optional board may be mounted or deleted according to a user's request. Good).

FIG. 2 illustrates the video processing unit 1 (136) in the detailed diagram of the processor 113 described above.
The endoscope image picked up by the endoscope 101 or the endoscope 101 ′ is selected by the selector (SEL) 135 as to which of the endoscope 101 or the endoscope 101 ′ is input. The

  As the selection method, the front panel 142, the keyboard 114, the switches 103 and 103 ′ of the endoscopes 101 and 101 ′, and the switches assigned to the HID 326 (hereinafter collectively referred to as operation devices) may be toggled. You may make it selectable on a setting screen. Further, switching may be possible from a peripheral device by control using a serial interface or parallel interface (controlled by the CPU 1 (401)).

  When only one of the endoscopes 101 and 101 'is connected, the detection may be detected by the detection signals 112b and 112b', and the detected endoscope may be automatically switched.

The endoscope 101 (or CCD 102) detection signal 112C is output to the PIO 408 and a synchronization signal generation circuit (hereinafter referred to as SSG circuit) 242 via the insulation circuit 204. An endoscopic image 105 </ b> C captured by the CCD 102 is input to the CDS circuit 202. The switch ON / OFF signal 104C of the operation switch unit 103 is output to the PIO 408 via the insulation circuit. A signal 111C for transmitting / receiving data from the CPU 109 is input / output to / from the SIO 407 via an insulating circuit.

  After being input to the CDS circuit 202 and subjected to correlated double sampling (hereinafter CDS) processing, it is converted from analog to digital by an A / D converter 203 and a predetermined frequency (for example, 13) by a frequency converter (not shown). .5 MHz), and through an insulation circuit 204 such as a photocoupler, the image processing circuit 205 performs OB clamp processing, frequency conversion (for example, 27 MHz), white balance processing, and AGC processing.

  The AGC-processed endoscope image is input to a freeze circuit 206 that performs a freeze operation, and a freeze image or a pre-freeze image is stored in the memory 207 by a freeze switch assigned to the operation device. The freeze switch may be a toggle operation (freeze ON → OFF → ON... Each time the switch is pressed).

  After outputting the freeze circuit, the image processing circuit 208 performs enhancement processing such as IHb color enhancement, moving image color shift correction, R or B color tone adjustment, and γ correction. Note that IHb is a value that correlates with the amount of hemoglobin as the amount of pigment that is the amount of blood information.

  After the output of the image processing circuit 208, the processing is divided into an SDTV processing unit that is a standard image and an HDTV processing unit that is a high-quality image. This enables both SDTV output (NTSC = 720 x 480 equivalent, PAL = 720 x 576 equivalent output) and HDTV output (1920 x 1080 equivalent output), and supports both SDTV and HDTV peripheral devices. it can.

  In the SDTV processing unit, endoscopic image enlargement / reduction processing, enhancement processing such as contour emphasis / structure emphasis (209), image rotation circuit 210 that performs up / down / left / right reversal of the endoscopic image and 90 ° rotation, and RGB by a multiplexer A synchronization circuit (213) is performed by sequentially writing images for each R, G, B frame (operates at 27 MHz before the synchronization process and 13.5 MHz after the synchronization process).

The memory 212 stores an enlargement (reduction) coefficient, an enhancement coefficient, an image rotation parameter, and the like, and the controller 211 performs control according to the coefficient / parameter. The memory 212 may be a non-volatile memory such as a FLASH ROM, FRAM, FeRAM, MRAM, or OUM, and may be stored even when the processor is turned off, and a volatile memory such as an SRAM, SDRAM, EDORAM, DRAM, or RDRAM. The memory 1 may be used so that the CPU 1 (401) writes the coefficients and parameters in the memory 212 in the initial setting after turning on the processor. (The same applies to all memories in the processor hereinafter.)
The memory 214 stores R, G, and B frame images so that three colors of R, G, and B frames can be output simultaneously during the synchronization process.

  After the synchronization processing, an index image is created by the index circuit 215. An index image is created for each recording instruction by a recording instruction key (release key, capture key to a printer) assigned to the operation device. The index circuit 215 also has a memory for storing an index image. For details, refer to Japanese Patent Application Nos. 2004-202763 and 2004-176201.

  The graphic circuit 218 generates characters and graphic information (error display, menu display, HELP image, and other graphic images for GUI and CUI) indicating information related to the endoscope image (hereinafter referred to as endoscope related information). Say). A memory 219 is a working memory for creating characters and graphics.

(Please refer to Japanese Patent Application No. 2004-202763 and Japanese Patent Application No. 2004-176201 for details on endoscope related information and setting screens.)
The synthesizing / mask processing unit 216 performs mask processing on the endoscopic image after the synchronization processing, the index image created by the index circuit 215, characters and graphic information created by the graphic circuit 218, or a graphic circuit described later 501 output, image decompression unit 141 output, synchronization circuit 221, 725 output, and option circuit 502 output are combined and output (hereinafter, the combined image is referred to as an endoscope combined image). Mask data for performing mask processing may be created by the graphic circuit 218 or may be created inside the composition / mask processing unit 216.

The memory 217 stores the endoscope composite image created by the composition / mask processing unit 216. (Details will be described later) ◎
The endoscope composite image is digital-to-analog converted by the D / A converter 222, level-adjusted by the adjustment circuit 223, and then output to a plurality of peripheral devices.

The HDTV processing unit similarly performs the following processing.
First, frequency conversion is performed by a frequency converter (not shown) (for example, 74 MHz),
Endoscopic image enlargement / reduction processing, enhancement processing such as contour enhancement / structure enhancement (224), endoscopic image up-down / left-right reversal and 90-degree rotation image rotation processing (225), and the RGB image by the multiplexer , G and B frames are sequentially written to perform synchronization processing (228).

The memory 227 stores an enlargement (reduction) coefficient, an enhancement coefficient, an image rotation parameter, and the like, and the controller 226 performs control according to the coefficient / parameter.

  The memory 229 stores R, G, and B frame images so that three colors of R, G, and B can be output simultaneously during the synchronization process.

  After the synchronization processing, the index circuit 230 creates an index image. An index image is created for each recording instruction by a recording instruction key (release key, capture key to a printer) assigned to the operation device. The index circuit 230 also has a memory for storing index images. The graphic circuit 233 creates characters and graphic information indicating information related to the endoscope image (hereinafter referred to as endoscope related information). The memory 234 is a working memory for creating characters and graphics.

  The synthesizing / mask processing unit 231 performs mask processing on the endoscopic image after the synchronization processing, the index image created by the index circuit 230, characters and graphic information created by the graphic circuit 233, or a graphic circuit described later 501 output, image decompression unit 141 output, synchronization circuit 220 and 725 output, and option circuit 502 output are combined and output. Mask data for performing mask processing may be generated by the graphic circuit 233 or may be generated inside the composition / mask processing unit 231.

The memory 232 stores the endoscope composite image created by the composition / mask processing unit 231. (Details will be described later)
The endoscope composite image is digital-to-analog converted by the D / A converter 235, level-adjusted by the adjustment circuit 236, and then output to a plurality of peripheral devices.

  Reference numeral 237 denotes a digital output unit. The endoscope composite image created by the synthesis / mask processing units 216 and 231 is converted into an LVDS / SDI / H-SDI / DV (IEEE1394) / DVI / D1 / D2 / D3 / D4. Perform encoding (encoding) processing so that it can be output as a digital (or analog) image via an interface such as / D5 / D6 / D9 / HDMI, and output it to peripheral devices. Also, when a digital (or analog) image from a peripheral device is input through the above interface, it performs decoding (including decoding and digitization) processing and outputs it in RGB (or YcrCb). In 220, the synthesizing / masking processing unit 231 performs HDTV synchronization processing so that the synthesizing can be performed at the correct timing, and in the synchronizing circuit 221, the synthesizing / masking processing unit 216 performs synthesizing at the correct timing.

Reference numeral 238 selects which endoscopic image is to be output among the output images created by the synthesis / mask processing units 216 and 231. (In 238, the selector processing is related to the moving image of the endoscope composite image.)
Reference numeral 239 denotes a recording instruction by the recording instruction key (release key, capture key to the printer) assigned to the operation device for the SDTV and HDTV still images of the output image created by the composition / mask processing units 216 and 231. The SDTV and HDTV still images created for each time and stored in the memory 240 are transferred to the image compression unit 140 in synchronization with the timing that can be processed by the image compression unit 140.

  Further, an SSG circuit 242 is provided in the processor 113, and a plurality of vertical synchronization signals, horizontal synchronization signals, odd / even numbers (hereinafter referred to as “the vertical synchronization signals”) are determined by the endoscope 101 (or CCD 102) detection signal 112C according to the type of the endoscope 101. , ODD / EVEN) discrimination signal and clock are output.

  The vertical synchronization signal VD1 (for example, 60 Hz) and the horizontal synchronization signal HD1 (for example, 15.75 kHz) are used in the processing from 202 to 214 and 224 to 229, and another vertical synchronization signal VD2 (for example, 50 Hz) having a different pulse output timing. Or 60 Hz), VD3 (for example, 50 Hz or 60 Hz), ODD / EVEN discrimination signals ODD2, ODD3, horizontal synchronization signal HD2 (for example, 15.75 kHz or 15.625 kHz), HD3 (for example, 33.75 kHz or 28.125 kHz) 221, 228 to 234 and 237 to 240 are used.

  In addition, 13.5 MHz, 27 MHz, and 74 MHz CLK (clock) are output for image processing. (13.5 MHz is used as a standard clock for digital video signals of SDTV, 27 MHz is a clock having a frequency twice that of 74 MHz, and 74 MHz is used as a standard clock for HDTV digital video signals. This is 74.25 / 1.001MHz for the NTSC system and 74.25MHz for the PAL system).

  For example, a 13.5 MHz clock CLK is used in 203-205, 213-219, 221, 222, 237, 238, 239, a 27 MHz clock CLK is used in 205-213, 237, and a 74 MHz clock CLK is 220, 224 to 235, 237, 238, 239.

FIG. 3 shows a detailed example of the control processing unit 1 (138).
The CPU 1 (401) controls the following circuits via the system bus 402.
RAM (403, 409) (volatile memory for WORK processing such as SRAM, SDRAM, DRAM, RDRAM, etc. that can store program-related data, endoscope information data, endoscope image data, etc. and can be used as a cache, parallel interface Either serial interface may be used)
・ Real-time clock RTC (412) to manage such as clock
Program ROM (404, 410) for storing program data, program version, etc.
A BACKUP RAM (411 for storing endoscope related information that should be retained even when the power is turned off, such as program operation logs and maintenance information, front panel 69 and keyboard 14 setting information, various setting screen information, and white balance data. ) (EEPROM, FLASH ROM, FRAM, FeRAM, MRAM, OUM, SRAM with battery, etc.)
Address decoder (405) that transmits a chip select signal to each circuit (block / processing unit) in the processor
A bus driver buffer (hereinafter BUF) (413) for supplying a system bus to each circuit (block / processing unit) in the processor
・ Reset circuit with built-in watchdog timer, etc. that performs reset processing when the power is turned on or when the program hangs up (414)
・ Timer for time management (406)
Connected via each circuit (block / processing unit) in the processor 113, peripheral devices, SIO (511), option circuit (502), front panel (142), keyboard (114), insulation circuit 247 → 111C SIO (407) for communicating with the SIO in the CPU 124 connected via the CPUs 109 and 128b via a serial interface (asynchronous, clock synchronous, USB, CAN, I2C, etc.).

Connection via operation switches 103 and 112C connected via each circuit (block / processing unit) in the processor, peripheral device, PIO (512), option circuit (502), insulation circuit 247 → 104C Detection of the endoscope 101 (or CCD 102) to be detected, detection of the type of the light source connected via the selectors 135 and 129b, information on the amount of light of the endoscope image connected via the 127b, etc., in a parallel interface Communicating PIO (408)
Reference numerals 401 to 408 and 414 are configured (implemented) inside a programmable IC (FPGA, DSP, reconfigurable processor, etc.) in addition to using a dedicated IC so that each process can be easily customized. Also good. Note that FPGA is an abbreviation for Field Programmable Gate Array, and is a programmable gate array that can write logic designed by a dedicated writing tool. (The same applies to blocks in reference numerals 136, 137, 140, 141, 135)
The ROM (404) may store a VersrionUP processing operation program in a program flow (FIG. 9) described later, and the ROM (410) may store a normal operation program.

  Blocks (IP cores, soft cores) configured in programmable ICs (FPGAs, etc.) are becoming smaller year by year due to improvements in block design / development tools (logic synthesis, physical synthesis, placement and routing tools).・ Power saving and improved performance. Therefore, it is possible to add a high-performance and small-scale circuit in the FPGA by upgrading (VersionUP) as shown in FIG.

FIG. 4 shows an example (138 ′) in which a circuit is added to the control processing unit 1 (138).
The CPU 3 (801) controls the following circuits.

A RAM (803) that can store program-related data, endoscope information data, endoscope image data, etc., and can be used as a cache
-Program ROM for storing program data, program version, etc. (804)
・ Reset circuit with built-in watchdog timer, etc. that performs reset processing when the power is turned on or when the program hangs up (814)
・ Timer for time management (806)
For example, SIO (807) for communicating with an optional circuit (502), peripheral devices, and the like through a serial interface (asynchronous, clock synchronous, USB, CAN, I2C, etc.).

For example, PIO (808) that communicates with an optional circuit (502), peripheral devices, and the like through a parallel interface
-Arithmetic processing block 809 that can perform multiplication and division
A bus bridge 810 that performs bus control in order to exchange data between CPU1 and CPU3 (data may be transmitted and received between SIO807-SIO407 and PIO808-PIO408).

By adding the functions of reference numerals 801 to 810,
-For example, the control of the option circuit 502 is enhanced (corresponding to the function expansion of the option circuit 502 to be expanded in the future)
-Improvement of multiplication / division function by operation processing block 809 (image processing by software and image encoding / decoding are possible)
-Strengthening of SIO / PIO function (improvement of communication processing speed, part of control by SIO 807 or PIO 808 on the CPU 3 side, thereby reducing the load on the CPU 1 (401) and improving the performance of the entire processor).

  Note that a clock (30 MHz, 60 MHz) for the control processing unit 1 may be used by an SSG circuit (not shown), and the clock (13.5 MHz, 27 MHz, 74 MHz) of the SSG circuit 242 in the video processing unit 1 described above is used. The clock may be multiplied by a PLL circuit (not shown).

  Further, the CPU 1 (401) and the CPU 3 (801) may be interrupted by using a plurality of vertical synchronization signals, horizontal synchronization signals, and ODD / EVEN discrimination signals in the video processing unit 1 as triggers of interrupt signals.

FIG. 5 shows a detailed example of the control processing unit 2 (137).
The CPU 2 (503) controls the following circuits via the system bus 507.

RAM (508) (volatile memory for WORK processing such as SRAM, SDRAM, DRAM, RDRAM, etc., parallel interface, serial, which can store program related data, endoscope information data, endoscope image data, etc. and can be used as a cache Either interface may be used)
・ Real time clock RTC (510) to manage such as clock
Program ROM (509) for storing program data, program version, ETHERNET (registered trademark) MAC address, IP address, etc.
・ Program operation log, maintenance information, front panel 69 and keyboard 14 setting information, various setting screen information, white balance data, etc. Endoscope related information that should be retained even when the power is turned off, BACKUP for storing IP address RAM (515) (EEPROM, FLASH ROM, FRAM, FeRAM, MRAM, OUM, SRAM with battery, etc.)
Address decoder (514) that transmits a chip select signal to each circuit (block / processing unit) in the processor
・ Reset circuit (531) with built-in watchdog timer that performs reset processing when the power is turned on or when the program hangs up
・ Timer for time management (513)
・ Each circuit (block / processing unit) in the processor 113, peripheral devices, SIO (407), optional circuit (502), etc. and serial interface (start-stop synchronization, clock synchronization, USB, CAN, I2C, etc.) SIO to communicate (511).

PIO (512) for controlling each circuit (block / processing unit), peripheral device, PIO (408), and option circuit (502) in the processor 113 through a parallel interface
-ETHERNET (registered trademark) controller 516 and hub (hereinafter referred to as HUB) 517 having circuits and middleware such as ETHERNET (registered trademark) MAC layer and physical layer for transmission and reception by ETHERNET (registered trademark)
-Connected to CPU2 (503) via buses such as PCI, PCI-X, PCI EXPRESS, COMPACT PCI, ISA, etc., converted to another bus, exchanged bus cycles with each other, extended the bus Bus bridge 506 for increasing the number of connected devices
A USB controller 518 for performing a USB interface (both host and device are possible)
Memory card 521 (compact flash (registered trademark), smart media, SD card, miniSD card, PC card type memory card, flash drive, HDD, multi Media card, xDPicture card, memory stick) and card controller (hereinafter referred to as CARD Controller) 519 for controlling the PC card 520
・ Graphic circuit 2 (501) for graphic processing (moving images, still images, web display)
FIG. 6 shows an example of a peripheral device.
The monitor 1 (301), printer 1 (302), VTR1 (303), filing device 1 (304), photography device 1 (input / output, recording and display of analog signals of the SDTV in FIG. 305)
The monitor 2 (306) capable of inputting / outputting, recording and displaying HDTV analog signals in FIG. 6 (b), the printer 2 (307), the VTR 2 (308), the filing device 2 (309), and the photography device 2 ( 310)
6 (c) SDTV / HDTV digital (or analog) input / output, recording and display monitor 3 (311), printer 3 (312), VTR 3 (316), filing device 3 (313), Photography device 3 (317), image shape storage device (314), ultrasonic device (315)
・ Printer 4 (322) capable of input / output, recording and display via USB interface in FIG. 6 (d), optical recording device (MO, DVD, CD ± R / W, etc. (325)), filing device 4 (323) , Photography device 4 (324), HID (keyboard, mouse, wheel, etc. 326)
・ Printer 5 (327), optical recording device 2 (MO, DVD, CD ± R / W, etc. (330)) capable of input / output, recording and display by the ETHERNET (registered trademark) interface of FIG. 6 (e), filing Device 5 (328), Photography device 5 (329)
All or some of these can be connected.

FIG. 7 shows details of the image compression unit 140.
The thumbnail image creation unit 604 reduces the input image. For each image to be compressed, the CPU 1 or CPU 2 can perform a reduction setting of 1/2 to 1/16, for example. A selector 601/606 can select whether to create a thumbnail image.

The YUV conversion units 609 and 623 convert the RGB image input to the image compression unit into a YUV (YCrCb) image. The selector 620/611 can select whether or not to perform YUV conversion. The compression unit 614 performs image compression (encoding) processing (JPEG, JPEG2000, TIFF, BMP, etc.). Selector 621/616 can select whether or not to perform compression (non-compression) (transfer to the bus bridge without compression without performing compression processing)
The controller 618 converts the image into an interface that can be output to the bus bridge 506 and outputs the image after storing the image in the memory P (619).

  A size changing unit 622 reduces an image (moving image) to an arbitrary size.

  The encoding process (AVI, MPEG, H.264, WMV) is performed in the moving image encoding unit 624.

  In the controller 627, the image is temporarily stored in the memory Q (628).

Since each process of the still image compression unit 614 and the moving image encoding unit 624 is performed separately, the still image compression and the moving image compression may be performed simultaneously.

FIG. 8 shows details of the image decompression unit 141.
The controller 718 receives an image from the bus bridge 506, stores the image in the memory 719, and outputs the image to the selector 716.

  The decompression unit 714 performs image decompression (decoding) processing (JPEG, JPEG2000, TIFF, BMP, etc.). The selector 721/716 can select whether or not to perform decompression (when an uncompressed image is input).

  The RGB conversion unit 709 converts a YUV (YCrCb) image into an RGB image. The selector 720/711 can select whether or not to perform RGB conversion.

  The thumbnail / multi-image creation unit 704 reduces the input image and displays the multi-image. For example, the CPU 1 and the CPU 2 can set a reduction of 1/2 to 1/16. A selector 701/706 can select whether to perform thumbnail / multi-image creation.

  The size changing unit 722 reduces the image (moving image) to an arbitrary size.

  Decode processing (AVI, MPEG, H.264, WMV) is performed by the moving image decoding unit 724.

  Synchronization processing is performed by the synchronization circuit 725 so as to synchronize with the synthesis / mask processing units 216 and 231.

  Since each process of the still image expansion unit 714 and the moving image decoding unit 724 is performed separately, the still image expansion and the moving image expansion may be performed simultaneously.

FIG. 9 is a flowchart showing processing when the processor 113 is turned on.
After the processor 113 is turned on (AFLW1), the following initial settings are made (AFLW2).

-Initialization of software and OS stored in program ROMs 404, 410, 509, 804, etc.-Configuration of FPGA (configuration) data and DSP data (firmware) used in each block in the processor 113 is completed / not completed Confirm completion and initialization of FPGA and DSP after configuration is complete (initialization of internal registers, etc.).

  Note that FPGA is an abbreviation for Field Programmable Gate Array, and is a programmable gate array that can write logic designed by a dedicated writing tool. DSP is an abbreviation for Digital Signal Processor, and is a processor dedicated to digital signal processing, and is a device that speeds up specific data processing such as image data.

  The settings of the setting screen, the front panel 142 and the keyboard 114, and the magnification rate of the endoscope, which were set when the power was turned off immediately before AFLW1 of the processor 113, stored in the backup unit (hereinafter referred to as Backup unit) 515, 411 The setting of information (parameters) related to the endoscope such as the enhancement rate is reset (the setting of the parameters relating to the endoscope depends on the type of the endoscope (CCD) detected by the detection signal 112c, and the Backup unit 515 411, the program ROMs 404, 410, 509, and 804 and the parameters in the memories 227 and 212 may be read and set.

  After that, when there is an input of a dedicated key or one or more specific keys on the operation device (for example, the front panel 142 or the keyboard 114), the mode shifts to the Version UP mode (AFLW3), via 532 Then, it is detected whether the USB memory is connected or whether the PC card 520 or the memory card 521 is connected via the CARD Controller 519 (AFLW4).

  The detection method may be by mechanical contact (not shown) or signal level detection by pulling up / down the signal line between the signal lines 532, 519-520 and 519-521. It may be detected by checking whether VersionUP software program or FPGA (DSP) data is stored in the card 520 or the memory card 521, and security so that only a specific user (for example, a service person) can use it. The security code may be detected by storing the code in a USB memory, a PC card 520, or a memory card 521.

  In AFLW4, a password input message screen is displayed on the endoscope composite image (display example is shown in FIG. 10), and an instruction is given to input the password by the operation device. Only when the correct password is input, the Version UP mode is displayed. You may make it transfer to.

  If detected, the version of the software program or FPGA data currently installed in the processor 113 and the version UP stored in the USB memory, the PC card 520, or the memory card 521 are displayed on the endoscope composite image. Displays version messages for programs and FPGA (DSP) data (AFLW5, 6).

  A display example is shown in FIG. The software program and FPGA (DSP) data version currently installed in “Before VersionUP”, and the software program and FPGA (DSP) data version after VersionUP are displayed in “After VersionUP”. “CPU1” indicates the version of the software program stored in the program ROM 410, “CPU2” indicates the version of the software program stored in the program ROM 509, and “FPGA” indicates the version of the FPGA (DSP) data used in each block in the processor 113. If there is FPGA (DSP) data, display them side by side as in this example. The version information of the software program and FPGA (DSP) data may be stored in the program ROMs 410 and 509, or may be stored in the backup units 515 and 411 or a memory for storing FPGA (DSP) data (not shown). Good.

  After that, if the VersionUP program or FPGA (DSP) data version is newer than the installed software program or FPGA (DSP) data version, a confirmation message (“VersionUP OK” will be displayed on the endoscope composite image. ? ”) (Display example is shown in FIG. 12), and when the VersionUP confirmation key (for example, the character key“ y ”or Enter key) is input by the operation device, the program or FPGA (DSP) data for VersionUP The version information is stored again in the program ROMs 410 and 509, the backup units 515 and 411 in the processor 113, and the FPGA (DSP) data storage memory (not shown) (AFLW 7, 8, and 9). Then, a message indicating whether the storage has been normally performed is displayed on the endoscope composite image (FIG. 13) (AFLW10) (a transfer error occurred while storing the program for version UP, FPGA (DSP) data, and version information) In some cases, a result message of an error type such as NG or transfer error is displayed).

  In addition, like the endoscope composite image of FIGS. 10-13, an endoscope image or endoscope related information may be displayed on the background of a message, and a specific image (a white image or a color bar) is displayed. You may do it. Further, the message may be made translucent so that the endoscope image or endoscope related information can be seen in the background.

  AFLW8 processing is omitted, and if the version upgrade program or FPGA (DSP) data version is newer than the software program or FPGA (DSP) data version, the AFLW9 processing is automatically performed. Alternatively, the display processing of AFLW5, 6, 10 and the processing of AFLW7 may be omitted to speed up / simplify the upgrade process.

  On the other hand, if there is no key input for the operation device or one or more specific key inputs in AFLW8, the process proceeds to normal processing (AFLW11).

  As described above, security can be detected by detecting a security code or entering a password, so that only a specific person (such as a service person) can upgrade the version, so a program or FPGA for VersionUP It becomes difficult to tamper with (DSP) data, ensuring high safety.

  FIG. 14 shows another embodiment in the Version UP mode. Instead of the USB memory, the PC card 520, or the memory card 521, a contactless card 1504 (including a mobile phone having a contactless card function) with a built-in memory is used.

One of the following wireless control units is mounted on the processor 113 side.
A wireless control unit 1 (1501) connected directly to the bus bridge.
A wireless control unit 2 (1502) that can be inserted into a slot of the PC card 520 or the memory card 521.
A wireless control unit 3 (1503) that can be connected to the USB controller 518 instead of the USB memory.

  FIG. 15 shows a circuit configuration example of the wireless control unit. It includes a transmission / reception circuit 1001 that transmits / receives data to / from the non-contact card 1504 wirelessly, and a controller 100 2 that transmits / receives data to / from the bus bridge 506, CARD Controller 519, and USB controller 518.

  FIG. 16 shows a circuit configuration example of the contactless card 1504. It comprises an antenna 901 for wirelessly transmitting and receiving data to and from a wireless control unit, a chip 902 incorporating a transmission / reception circuit, a (non-volatile / volatile) memory, and an encryption circuit.

When sending and receiving wirelessly,
・ Read / write information on the recording medium in the contactless card with the induction wave of specific frequency (Ex.125KHz, 13.56MHz). (Infrared may be used)
-It may be compliant with the standards (ISO14443, 15693, 18092).

  -Felica, Mifare, I.CODE, NFC technology may be used / compliant.

  Instead of the USB memory, the PC card 520, or the memory card 521, the software program and FPGA (DSP) data for version upgrade are stored in the memory in the contactless card 1504, and the operations of AFLW4 to AFLW12 in FIG. 9 are performed. Is also possible.

  As a method for storing FPGA (DSP) data and version information in the memory of the contactless card 1504, a dedicated writer may be prepared in addition to the processor 113, and in the case of a mobile phone equipped with a contactless card function. May be stored by downloading from a dedicated site (in this case, security processing such as SSL is performed).

  As described above, by performing wirelessly, it is possible to upgrade the version easily and at high speed without connecting a cable or attaching a USB memory, a PC card 520, or a memory card 521.

  On the other hand, the contactless card 1504 can store setting information on each setting screen of the processor 113. By bringing the contactless card 1504 closer to the wireless control unit in the processor 113, it can be easily, instantaneously and safely. It is possible to read (hereinafter referred to as READ) and write (hereinafter referred to as WRITE) optimum setting information for the user.

An example of the setting information (setting screen, endoscope composite image, etc.) is shown in FIGS. (The settings of FIGS. 41 to 44 and 51 are also included.) FIGS. 17 to 26 show examples of setting information (system setting screen and user setting screen), and FIGS. 27 to 30 show examples of setting information (patient data setting screen). And explanation of an endoscope composite image). (For details, see Japanese Patent Application Nos. 2004-202763 and 2004-176201)
The description of reference numerals 1110 to 1122 in the endoscope composite image of FIG. 31 is shown in FIGS.

  FIG. 32 shows a flowchart of an operation of reading the setting information in the contactless card 1504 to the processor 113 in the normal processing (AFLW11).

  The processor 113 periodically transmits a detection command from the wireless control unit (DFLW2).

  When the non-contact card 1504 approaches the wireless control unit of the processor 113, it receives a detection command (DFLW19) and transmits a detection response command to the processor 113 (DFLW20).

  When receiving the detection response command (DFLW3), the wireless control unit of the processor 113 creates a secret key / public key data on the processor 113 side (DFLW4), and transmits the public key data on the processor 113 side (DFLW5) ).

  When the contactless card 1504 receives the public key data (DFLW21), the contactless card 1504 creates a secret key / public key data on the contactless card 1504 side (DFLW22), and transmits the public key data on the contactless card 1504 side ( DFLW24).

When the wireless controller of the processor 113 receives the public key data on the contactless card 1504 side (DFLW6), the wireless controller of the processor 113 sends a request command for patient data stored in the patient data setting screen out of the setting screen on the processor side. Encrypt using the public key data on the contact card 1504 side and transmit (DFLW8)
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. When it is determined that the decrypted command is a patient data request command (DFLW25), the patient data is encrypted using the public key data on the processor 113 side and transmitted (DFLW26).

  The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. When it is determined that the decrypted data is patient data (DFLW9), the received patient data is set on the patient data setting screen (DFLW35). There may be a plurality of patient data. Alternatively, patient data to be set directly on the endoscope composite image (FIG. 31) may be prepared separately, and the patient data may be automatically set and displayed on the endoscope composite image directly after receiving the DFLW 9.

After that, the wireless control unit of the processor 113 encrypts a request command for user setting data stored in the user setting screen among the setting screens on the processor side using the public key data on the contactless card 1504 side, Send (DFLW11)
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. When it is determined that the decrypted command is a user setting data request command (DFLW28), the user setting data is encrypted using the public key data on the processor 113 side and transmitted (DFLW29).

  The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. When it is determined that the decrypted data is user setting data (DFLW12), the received user setting data is set on the user setting screen (DFLW36). There may be a plurality of user setting data. Alternatively, user setting data to be set directly on the endoscope composite image may be prepared separately, and the user setting may be automatically performed on the endoscope composite image directly after receiving the DFLW 12.

After that, the wireless control unit of the processor 113 encrypts a request command for system setting data stored in the system setting screen among the setting screens on the processor side using the public key data on the contactless card 1504 side, Send (DFLW14)
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. When it is determined that the decrypted command is a system setting data request command (DFLW31), the system setting data is encrypted using the public key data on the processor 113 side and transmitted (DFLW32).

  The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. If it is determined that the decrypted data is system setting data (DFLW15), the received system setting data is set on the user setting screen (DFLW37).

  In addition, in DFLW25, DFLW28, and DFLW31, when an unexpected command other than the patient data request command, the user setting data request command, and the system setting data request command is received, a command error is transmitted (DFLW27, DFLW30, DFLW33). ). If the processor 113 receives a command error, the processor 113 may output the request command again.

• If data cannot be received within a certain period after the processor 113 sends a (request) command, a timeout occurs and the processing ends (DFLW7, DFLW10, DFLW13, DFLW16). (After the time-out, retry processing may be performed in which the request command is transmitted again.)
If the contactless card 1504 cannot receive data within a certain period after DFLW24, a timeout occurs and the process ends (DFLW34).

-In addition, when encrypting, the RSA method or the elliptical encryption method may be used, or SSL may be used. SSL stands for Secure Sockets Layer.
The secret key and encryption key may be recreated for each command.

  In the flow of FIG. 32, the same encryption process may be performed even when setting information is stored in the USB memory, the PC card 520, or the memory card 521 in addition to the contactless card 1504.

  FIG. 33 shows a flowchart of the operation of writing the setting information from the processor 113 to the memory in the contactless card 1504 in the normal processing (AFLW11).

  The processor 113 periodically transmits a detection command from the wireless control unit (EFLW2).

  When the non-contact card 1504 comes close to the wireless control unit of the processor 113, it receives a detection command (EFLW19) and transmits a detection response command to the processor 113 (EFLW20).

  When receiving the detection response command (EFLW3), the wireless control unit of the processor 113 creates a secret key / public key data on the processor 113 side (EFLW4), and transmits the public key data on the processor 113 side (EFLW5) ).

  When the contactless card 1504 receives the public key data (EFLW21), the contactless card 1504 creates a secret key / public key data on the contactless card 1504 side (EFLW22), and transmits the public key data on the contactless card 1504 side ( EFLW24).

When the wireless control unit of the processor 113 receives the public key data on the contactless card 1504 side (EFLW6), the patient data WRITE accompanied by the patient data stored in the patient data setting screen among the processor side setting screens The command is encrypted using the public key data on the contactless card 1504 side and transmitted (EFLW8).
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. If it is determined that the decrypted command is a patient data WRITE command (EFLW25), the patient data is written to the memory in the contactless card 1504 (EFLW26), and an OK command indicating that the WRITE has been completed normally is sent to the processor 113 side. Are encrypted and transmitted using the public key data (EFLW28).

The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. When it is determined that the decrypted data is an OK command (EFLW9), a user setting data WRITE command with user setting data stored in the user setting screen among the setting screens on the processor side is disclosed on the contactless card 1504 side. Encrypt using key data and send (EFLW11)
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. If the decrypted command is determined to be the user setting data WRITE command (EFLW29), the user setting data is written to the memory in the contactless card 1504 (EFLW31), and an OK command indicating that the WRITE has been completed normally is processed by the processor. It encrypts using the public key data of 113 side, and transmits (EFLW32).

The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. If it is determined that the decrypted data is an OK command (EFLW12), a system setting data WRITE command with system setting data stored in the system setting screen among the setting screens on the processor side is disclosed on the contactless card 1504 side. Encrypt using key data and send (EFLW14)
The contactless card 1504 decrypts the command using the secret key data on the contactless card 1504 side. If it is determined that the decrypted command is the system setting data WRITE command (EFLW33), the system setting data is written to the memory in the contactless card 1504 (EFLW35), and an OK command indicating that the WRITE has been completed normally is processed by the processor. It encrypts using the public key data of 113 side, and transmits (EFLW36). The wireless control unit of the processor 113 decrypts the data using the secret key data on the processor 113 side. When it is determined that the decrypted data is an OK command (EFLW15), the process is normally terminated (EFLW17).

Note that if data cannot be received within a certain period of time after the (WRITE) command is sent by the processor 113, a timeout occurs and the processing ends (EFLW7, EFLW10, EFLW13, EFLW16). (After timeout, retry processing may be performed to send the WRITE command again.)
In EFLW 25, EFLW 29, and EFLW 33, if an unexpected command other than the patient data WRITE command, user setting data WRITE command, and system setting data WRITE command is received, a command error is transmitted (EFLW 27, EFLW 30, EFLW 34). ). When the processor 113 receives a command error, the processor 113 may output the WRITE command again.

  If the contactless card 1504 cannot receive data within a certain period after DFLW24, a timeout occurs and the process ends (EFLW37).

  -In addition, when encrypting, the RSA method or the elliptical encryption method may be used, or SSL may be used.

  The secret key and encryption key may be recreated for each command.

  In the flow of FIG. 33, the same encryption processing may be performed even when the setting information is stored in the USB memory, the PC card 520, or the memory card 521 in addition to the contactless card 1504.

  The setting information READ and WRITE processing in FIGS. 32 and 33 may be switched as follows, and READ processing + WRITE processing may be performed collectively.

The non-contact card 1504 is dedicated to READ / WRITE, and an identification code dedicated to READ / WRITE is attached to the detection response command so that the processor 113 automatically determines and performs READ / WRITE processing.

-On the setting screen (not shown) of the processor 113, set READ / WRITE to switch.

Each switch for setting information READ / WRITE is provided on the operation device, and the processing of FIGS. 32 and 33 is performed only when the switch is input.

FIG. 34 shows a configuration example of the memory in the contactless card 1504. (The configurations in the USB memory, the PC card 520, and the memory card 521 may be the same, or may be combined with the configuration in FIG. 47.)
The memory may be configured by a file system (FAT16, FAT32).
-The directory name may be used for each setting screen or VersionUP, and the file name may be used as the data for each setting screen. (For example, when there are a plurality of patient data, a file name may be prepared for each patient data as shown in FIG. 34.)
A guard key (or password) may be attached to the root, each directory, and each file (the guard key (or password) is stored in the memory in the contactless card 1504), and password input (password input screen) Is the same as in FIG. 10) or access by an authentication device (not shown) (security card, biometrics (fingerprint, iris, authentication, retinal blood vessel pattern, handwriting, voiceprint, face shape, signature, vein pattern on back of hand), etc.) Restrictions (including display, deletion, modification) may be performed (for example, passwords entered in advance at the time of command transmission (DFLW8, DFLW11, DFLW14, EFLW8, EFLW11, EFLW14) and authentication information (guard key) by the authentication device) (The access check is performed at the time of decryption on the contactless card 1504 side.) The attribute of each file may be set to READ Only.

  The directory “version-up file” stores data related to VersionUP, version information displayed in FIG. 11 (eg, Version 1.01 in FIG. 34), software program (eg, program data 1.25 in FIG. 34), and FPGA (DSP) data (For example, FPGA data 1.30 in FIG. 34) may be used as files.

As mentioned above, by preparing encryption and guard key (or password) when sending and receiving commands,
・ Even if a command is intercepted when sending and receiving a command over the air, it is difficult to decipher because it is encrypted.
Only a specific user can access the memory on the contactless card 1504 side.
Therefore, security is strengthened and high safety can be secured. In addition, since it is wireless, setting can be performed easily and at high speed without connecting a cable or mounting a USB memory, a PC card 520, or a memory card 521.

FIG. 35 is a flowchart showing still image recording of an endoscope composite image in normal processing (AFLW11).
First, it is detected whether or not the recording instruction key assigned on the operation device is input (BFLW2) (when the user assigns to the operation device, the system setting screen 'item Foot Switch in FIG. 19; user setting screen FIG. 25 The assignment can be changed easily and reliably by selecting the type of the recording instruction key with the Scope Remote Switch item No. 2004-202763 and No. 2004-176201 regarding the assignment operation on the setting screen. (The same shall apply to the assignment of all recording instruction keys.)

The detection method may be all or any of the following methods. (The same applies to video recording described later.)
CPU 1 (401) detects from the operation device via SIO 407 and PIO 408.
CPU 2 (503) detects via HID (326) (keyboard, mouse, wheel) via 532, 518, 506. Alternatively, CPU 1 (401) detects from CPU 2 (503) via SIO (511) → SIO (407), PIO (512) → PIO (408).

Further, the recording instruction key on the operation device may be assigned separately according to the peripheral device to be recorded as follows.

Release key: filing device 1 (304), photography device 1 (305), filing device 2 (309), photography device 2 (310), filing device 3 (313), photography device 3 (317), filing Device 4 (323), photograph device 4 (324), filing device 5 (3 28), photograph device 5 (3 29), optical recording device (MO, DVD, CD ± R / W, etc. (3 25)), optical recording Device 2 (MO, DVD, CD ± R / W, etc. (330))
Capture key: Printer 1 (302), Printer 2 (307), Printer 3 (312), Printer 4 (322), Printer 5 (327)
(A recording instruction key may be provided independently for each peripheral device. Further, only a part of the peripheral device may be recorded when the release key is input (the same applies to the capture key).

  When the recording instruction key is input, the freeze circuit 206 freezes (or prefreezes) the endoscope image, and the image processing circuit 208 determines the IHb color enhancement and the average value of IHb (for details, see (See Japanese Patent Application Nos. 2002-070497 and 7-289507). Of the endoscope related information output from the graphic circuits 218 and 233 and the graphic circuit 2 (501), the average value 1113 of IHb is displayed and the time information 1106 is frozen (BFLW3). As a result, the SDTV endoscope composite image output from the composition / mask processing unit 216 and the HDTV endoscope composite image output from the composition / mask processing unit 231 are both frozen (still) images. .

  Thereafter, the SDTV endoscope composite still image output from the composition / mask processing unit 216 and the HDTV endoscope composite still image output from the composition / mask processing unit 231 are stored in the memory via the controller / selector 239. (240) is recorded (BFLW4).

FIG. 36 shows a detailed view of the controller / selector 239.
The memory control 1201 is controlled by the CPU 1 (401) or the CPU 2 (503) (via the SIO (511), SIO (407), PIO (512), PIO (408), or BUF 413).

  FIFOs 1202 and 1208 store one frame of the HDTV / SDTV endoscope composite still image, and a clock (37 MHz, which is half the cycle of 74 MHz in this example) input to the memory ☆ (240) to facilitate image processing. ) For frequency conversion to the same clock. Note that the clock input to the memory ☆ (240) is not limited to 37 MHz and may be any frequency. By setting the clock to 74 MHz or 13.5 MHz, the clock before any frequency conversion of the FIFOs 1202 and 1208 is performed. (In this case, a common FIFO is not necessary and may be omitted). The FIFOs 1202 and 1208 may be line memories in order to reduce the circuit scale.

The control operation by the memory control unit 1201 is as follows.
(1) The selector 1203 is set to input 1205 to output 1206.
(2) The memory control unit 1201 controls the synthesis / mask processing unit 216, FIFO (1 frame memory) 1208 to store one frame of the SDTV endoscope synthesized still image in the FIFO (1 frame memory) 1208, The frequency is converted (13.5 MHz → 37 MHz), and the SDTV endoscope synthesized still image is stored in the memory ☆ (240).

(3) The selector 1203 is set to input 1204 to output 1206.

(4) The memory control unit 1201 controls the synthesis / mask processing unit 231 and FIFO (1 frame memory) 1202 to store the HDTV endoscope synthesized still image in the FIFO (1 frame memory) 1202 for one frame, The frequency is converted (74 MHz → 37 MHz) and the HDTV endoscope synthesized still image is stored in the memory ☆ (240).

(The storage range of the endoscope composite image stored in the memory ☆ (240) is automatically determined by the SDTV / HDTV, the display mode, and the screen aspect ratio (for example, set by the CPU 1 (401)). 37 and 38. (For display modes, screen aspect ratios, and indexes, see FIG. 18, Japanese Patent Application Nos. 2004-202763 and 2004-176201)
After that, after the SDTV endoscope composite still image is stored in the memory * (217) (BFLW5), it is read out from the memory * (217) and read out from the D / A converter (235), selector (238), and digital output unit (237). ) To the peripheral device (BFLW6).

  Then, by recording instructions to the following peripheral devices among the peripheral devices assigned on the operation device (for example, the keyboard 114), an SDTV endoscope composite still image and an HDTV endoscope composite still image are recorded. (BFLW7).

Filing apparatus 1 (304), photography apparatus 1 (304), filing apparatus 2 (309), photography apparatus 2 (310), filing apparatus 3 (313), photography apparatus 3 (317), filing apparatus 4 ( 323)
Printer 1 (302), Printer 2 (307), Printer 3 (312)
Note that the recording instruction is issued by the CPU 1 through a serial interface or parallel interface command via SIO 407 → □ 1 and PIO408 → □ 2.

  Thereafter, an enlargement (reduction) coefficient, an enhancement coefficient, an image rotation parameter, and the like corresponding to the square pixel are read from the memory 212, and the controller 211 performs control according to the coefficient / parameter, and an endoscopic image corresponding to the square pixel. And a graphic is synthesized corresponding to the square pixel, and an endoscope synthesized image corresponding to the square pixel is created (BFLW8).

(Examples of a square pixel endoscope composite image are 640 x 480 (VGA size), 800 x 600 (SVGA size), and 1024 x 768 (XGA size). In addition, in a normal SDTV stored in BFLW4 (The endoscopic composite still image has a size of 720 x 480 in NTSC, and the size of HDTV is 1920 x 1080, which is a square pixel size at normal times.)
39 and 40 show examples of the address configuration of the enlargement coefficient and the enhancement coefficient stored in the memory 212. FIG. In association with the image size of the endoscopic image and the endoscopes 101 and 101 ′ (CCDs 102 and 102 ′), the expansion coefficient and the enhancement coefficient for normal / square pixels are efficiently stored. In the initial setting of the flow AFLW2, the normal enlargement factor / enhancement factor / image rotation parameter in FIGS. 39 and 40 are set, and the enlargement factor / enhancement factor at the time of square pixel processing in FIGS. An image rotation parameter is set (for example, set by the CPU 1 (401)).

In addition, processing corresponding to the square pixel of the graphic in flow BFLW8,
Graphics and characters may be created by the graphic circuits 218 and 233 and the graphic circuit 2 (501) so as to correspond to square pixels.
In the SDTV endoscope composite still image created by BFLW4, only graphic information may be complemented so as to correspond to square pixels. (For example, when changing from a 720 × 480 image to 640 × 480 (VGA size), processing is performed in the composition / mask processing unit 216 so that the dot width is 720 → 640 in the horizontal direction.)
The controller 211 is controlled by the CPU 1 (401) or the CPU 2 (503) (via the SIO (511), SIO (407), PIO (512), PIO (408), or BUF 413).

  Note that even if the enlargement factor, enhancement factor, and image rotation parameter during square pixel processing in FIGS. 39 and 40 are changed in the flow BFLW8, the SDTV endoscope composition read from the memory * (217) is changed. Since the still image is output via the D / A converter (235), the selector (238), and the digital output unit (237), the normal endoscope image still image is output to the peripheral device. Will be.

Further, the same operation is possible with respect to the control of the memory 227 and the controller 226.

  Thereafter, the SDTV endoscope synthesized still image output from the synthesis / mask processing unit 216 and corresponding to the square pixel is recorded in the memory ☆ (240) via the controller / selector 239 (BFLW9).

The control operation by the memory control unit 1201 is as follows.
(5) The selector 1203 is set to input 1205 to output 1206.

(6) The memory control unit 1201 controls the 216, FIFO (1 frame memory) 1208 to store the SDTV endoscope composite still image in the FIFO (1 frame memory) 1208 for one frame, and performs frequency conversion. Then, the endoscope synthesized still image of the SDTV is stored in the memory ☆ (240) (BFLW9).

  Next, the SDTV endoscope composite still image and HDTV endoscope composite image stored in the memory ☆ (240) are compressed by the image compression unit (140) and stored in the memory P (619) (BFLW10 ).

Whether to perform switching by the selectors 601/606, 620/611, and 621/616 of the image compression unit can be set on the setting screen. (Refer to Japanese Patent Application No. 2004-202763 and Japanese Patent Application No. 2004-176201 for the input on the setting screen and the movement of the cursor.)
FIG. 41 shows an example of the setting screen of the image compression unit. See FIG. 42, FIG. 43, and FIG. (The setting items in FIGS. 41 to 44 can also be set by communication from the peripheral device side. In this case, the setting screen of FIG. 41 is also displayed with the setting contents from the peripheral device. )
The case where thumbnail = ON, Encode Type = JPEG, Signal = YCrCb, Encode Num = SDTV1 + SDTV2 + HDTV, Format1 = 4: 2: 2 in the setting of FIG. 41 will be described.

(7) The selector 1203 is set to input 1206 to output 1207.

(8) A normal SDTV endoscope synthesized still image is compressed (BFLW10).

(i) Read the SDTV endoscope composite still image stored in the memory ☆ (240) and temporarily store it in the memory Q (628) by the controller 627.

(ii) Select the selector 601/606 so as to pass through the path 602 → 604 → 605, read the SDTV endoscope composite still image from the memory Q (628) by the controller 627, and create a thumbnail image at 604 After that, YCrCb conversion is performed as a thumbnail image by the YUV conversion unit 609, and after compression processing by the compression unit 614, it is stored in the memory P (619) by the controller 618.

(iii) The selector 601/606 is selected so as to pass through the path 603, the controller 627 reads the SDTV endoscope composite still image from the memory Q (628), and the YUV conversion unit 609 performs YCrCb conversion as the main image. After the compression processing at 614, the data is stored in the memory P (619) by the controller 618.

  In addition, when thumbnail = OFF on the setting screen (FIG. 41), the processes (8) and (ii) are omitted. In (8) and (ii), the setting of the thumbnail image may be the same as the setting of the main image. In FIG. 41, setting items dedicated to the thumbnail image may be provided, or only the thumbnail image may be fixed ( For example, the setting items in FIG. 41, Type = JPEG, Signal = YCrCb, and Format1 = 4: 2: 2 are fixed (the same applies to other setting items).

Also, when creating a thumbnail image in the thumbnail image creation unit 604,
The thumbnail size is fixed (for example, a thumbnail image of a normal SDTV endoscope composite still image = 180 × 120, a thumbnail image of a square pixel SDTV endoscope composite still image = 160 × 120, an HDTV endoscope composite still image The thumbnail image of the image = 240 × 135), and the main image may be reduced so as to have a fixed size.

  The reduction ratio is fixed (for example, a thumbnail image of a normal SDTV endoscope composite still image is 1/4 of the main image, a thumbnail image of a square pixel SDTV endoscope composite still image is 1/4 of the main image, The thumbnail of the HDTV endoscope composite still image is 1/8 of the main image). A thumbnail image may be created at the reduction ratio.

  The user may be able to arbitrarily set the thumbnail image size and reduction ratio on the setting screen.

  -A thumbnail image may be only an endoscopic image. In that case, not only the endoscope composite image but also the endoscope image of only the mask processing from which the graphic is deleted is stored in the memory ☆ (240), and the endoscope composite image and the mask are stored in (8) (i). The processing-only endoscope image is stored in the memory Q (628), and the thumbnail image is created by reading out the masking-only endoscope image from the memory Q (628) in (8) (ii). (That is, it is possible to obtain a thumbnail image in which the graphic does not overlap even if the graphic overlaps the endoscope image). An example is shown in FIGS. 45 shows an example of creating a thumbnail image from an endoscope composite image (or an endoscope image only with mask processing), and FIG. 46 is an example of a table showing a range to be read from the memory Q (628) of FIG. Show.

  46, regarding the display mode (screen aspect ratio), the number of indexes, the type of endoscope 101 (CCD102), and the image size (Midium, Semi-Full, Full), the CPU 1 (401 at the timing of BFLW3. ) Is set in the image compression unit 140 (set via the BUF413 or SIO407, PIO408), and at the timing of BFLW10, a normal SDTV endoscope synthesized still image / SDTV endoscope synthesized still image of square pixels / 45 may be created using the parameter a [] determined from the items set in the image compression unit 140 when each thumbnail image of the HDTV endoscope composite still image is created.

(9) The compression process of the square pixel SDTV endoscope composite still image and HDTV endoscope composite still image is performed in the same manner as in (8) (BFLW10).

  When Encode Type = OFF, the image can be stored without compression through the path 613. The compression time can be shortened by selecting the number of images to be compressed with Encode Num (for example, by setting Encode Num = SDTV1, (3), (4), BFLW8, BFLW9, (9) Can be omitted).

(10) A compressed normal SDTV endoscope composite still image and thumbnail, a square pixel SDTV endoscope composite still image and thumbnail, an HDTV endoscope composite image and thumbnail stored in the memory P (619), Is transferred to the following peripheral device via the bus bridge 506 by the controller 618 (BFLW11).

  The format is converted by the CPU 2 (503) (for example, DCF, EXIF, JFIF, etc.), the endoscope related information and security information are added and the printer 5 (327) via the Ethernet (registered trademark) controller 516, Recording is performed in the optical recording device 2 (MO, DVD, CD ± R / W, etc. (330)), filing device 5 (328), and photography device 5 (329). The transfer protocol may be TCP / IP, FTP, HTTP, XML, HL7, SGML, DICOM, or JAVA (registered trademark), COM, DCOM, CORBA, DBMS, RDBMS.

  The format is converted by the CPU 2 (503) (for example, DCF, EXIF, JFIF, etc.), endoscope related information and security information are added, the printer 4 (322) and the optical recording device (via the USB controller 518) MO, DVD, CD ± R / W, etc. (325)), filing device 4 (323), photography device 4 (324), HID (USB memory, etc. 326). The USB Class Driver may be compatible with HUB Class Driver, Human Interface Devices Class Driver, Communication Device Class Driver, Audio Class Driver, Mass Storage Class Driver, Still Image Capture Device Class Driver, Printer Class Driver, etc. , USB On-The-Go standard and PictBridge may be supported. The format may be converted by the controller 618 and directly transferred from the controller 618 to the USB controller 518 without going through the CPU 2 (503).

  The CPU 2 (503) converts the format (for example, DCF, EXIF, JFIF, etc.), adds endoscope related information and security information, and records them on the PC card 520 and the memory card 521 via the CARD Controller 519. The format may be converted by the controller 618 and directly transferred from the controller 618 to the CARD Controller 519 without going through the CPU 2 (503).

  Note that format conversion, endoscope related information and security information (described later), and addition (attachment) of thumbnails may be performed by the image compression unit 140 (the same applies to moving image recording described later).

  As an order of transfer to the peripheral device, the image is first stored in the PC card 520 and the memory card 521 as a backup of the image, and then recorded in the peripheral device via the Ethernet (registered trademark) controller 516 and the USB controller 518. May be. As a result, recording in the peripheral device via the Ethernet (registered trademark) controller 516 or USB controller 518, or Ethernet (registered trademark) (or including upper layer TCP / IP, HTTP, FTP, etc.) or USB communication Even when the processor 113 is turned off at the time of an error, the images and thumbnails stored in the PC card 520 or the memory card 521 are automatically transferred again when the power is turned on again (for example, at the beginning of the normal processing AFLW11). Is possible. In that case, it is possible to determine whether the CPU 1 or the CPU 2 is in the middle of recording by storing the information on the recording state to the peripheral device in the backup units 515 and 411.

  In addition to the settings in FIGS. 41 to 44, the following may be performed by selection on the system setting screens in FIGS.

  ..Selection items in the items “Remote Control” and “Printer” on the setting screen allow / prohibit recording of other peripheral devices even if the items “SDTV1,” “SDTV2,” and “HDTV” in FIG. 41 are not selected. It may be automatically determined (for example, when the filing device 5 is selected in the setting screen item “Remote Control” → DF, the PC card 520, the memory card 521 and the filing device 5 are automatically selected as recording devices, Recording to other peripheral devices may be automatically prohibited (at the time of recording (transfer) in accordance with the recording instruction, first the image is recorded on the PC card 520 as a backup of the image, and then the memory card 521 and the filing device 5 are recorded. Record (transfer) to)).

・ ・ Automatically select the type of image to be recorded (transferred) without selecting items “SDTV1,” “SDTV2,” and “HDTV” in FIG. 41 according to the items selected in “Remote Control” or “Printer” on the setting screen. It may be confirmed. (For example, when the filing device 5 is selected in the setting screen item “Remote Control” → DF, only the SDTV endoscope still image and HDTV endoscope still image of square pixels are recorded in the PC card 520 and the filing device 5. (Transfer), and record (transfer) only a normal SDTV endoscope composite still image to the memory card 521.)
FIG. 47 shows a configuration example in a recording medium for recording an image in a peripheral device such as a filing device, an optical recording device, a PC card 520, a memory card 521, and a USB memory (in FIG. 47, the file compression format is JPEG file). Therefore, the extension is automatically “.jpg”). The recording medium may be configured with a file system (FAT16, FAT32).

  -The directory name and file name are part or combination of endoscope related information (for example, IDNO., Name (patient name), Sex, DO.Birth, Age, date time, Physician, Comment in FIGS. 28 and 29). (In FIG. 47, “IDNO.” Is used for the directory name, and “date time (20040818) + patient name (yamada, last name) is used for the file name.) The directory name and file name have character restrictions. (If the patient name “Yamada Taro” is used, the surname “Yamada” may be used alone (the left side of “Space” “the last name is the last name”), and the character limit may be 8 characters, “Yamada T”. ) Or the user may be able to enter any directory name, and if multiple files are created with the same directory name and file name, they may be distinguished by adding a number at the beginning or end of the name. (Figure 47 shows numbers after 20040818yamada Has put).

  The thumbnail (XXXX_thum.jpg) and the main image (XXXX.jpg) may be separate files, or the thumbnail and the main image may be combined into one file.

  A guard key (or password) may be attached to the root, each directory, and each file (the guard key (or password) is stored in the peripheral device), and the password input (the password input screen is as shown in FIG. 10). The same), or (not shown) authentication devices (security cards, biometrics (fingerprints, irises, authentication, retinal blood vessel patterns, handwriting, voiceprints, facial shapes, signatures, vein patterns on the back of the hand), etc. (Including deletion and modification), and the attribute may be set to read only.

  In addition to transferred images and thumbnails, the following endoscope-related information may be attached to the file as attached information.

..Information displayed on the endoscope composite image (IDNO., Name (patient name), Sex, DO.Birth, Age, date time, Physician, Comment), connection status of the light source 117 (power status, communication status, etc. Light source status error), peripheral device connection information (recording number, recording state, presence / absence of connection, power supply state, communication state, printer division mode and number of prints, VTR operating state (playback, recording, stop, etc.) ), Endoscope image information (IHb average value, IHb pseudo color display area, contrast level, enhancement type (structure enhancement or outline enhancement or color enhancement) and level, electronic magnification, image size (Medium or Semi-) Full or Full), color tone setting, monochrome setting), functions assigned to the switches 103 and 103 ′ of the endoscopes 101 and 101 ′, the keyboard 114, and the front panel 142 (such as Caps Lock and Insert -Including character input settings), arrow pointer display status, stopwatch settings (in operation / pause), abbreviated display status of endoscope related information (1/2 / all erased), selected user list User items and user setting information on the screen, each message displayed in the endoscope composite image, display mode of the endoscope composite image (screen aspect ratio), number of index frames, and endoscope composite image of each information Display status (display / erase)
..Information stored in the memories 108 and 108 ′ in the endoscopes 101 and 101 ′ (product names of the endoscopes 101 and 101 ′, serial numbers, types of the CCD 102, the number of forceps channels, and the diameter of each channel) , Tip portion diameter value, insertion portion diameter value, enlarged scale, forceps position information on the endoscope composite image, inspection instruction information, first use date of the endoscopes 101 and 101 ′, energization count, inspection count, Service information, manufacturer comment, service comment, repair record, inspection record, comment information, program version of CPU 109, 109 ', rental information, direct / side view information, white balance data, etc. ON count, date and time at the time of recording processing, type of endoscope 101, 101 ′ (CCD 102, 102 ′), dimming (Iris) setting status, Ethernet ( Mac address of the recording trademark), IP address ... transferred image, size information of the thumbnail, reduction ratio, capacity, information of Figure 41, the color space (sRGB, etc.)
..Identification information of whether the image is a main image or a thumbnail image ..Identification of whether the image is a normal SDTV endoscope composite still image, a square pixel SDTV endoscope composite still image, or an HDTV endoscope composite still image Information ・ ・ Information on each setting screen (Refer also to Japanese Patent Application Nos. 2004-202763 and 2004-176201 for details of each information.)
..Header files and markers for each format (eg DCF, EXIF, JFIF format parameters, headers, quantization tables, Huffman tables, format versions, etc.)
..Serial numbers and product names of recorded peripheral devices, PC cards, memory cards, and USB memories.-Information of FIGS. 41 to 44 and FIGS. 17 to 31. FIG. 48 shows an example of the structure of the main image and thumbnail image files. Indicates.
Thereafter, when the time set in the release time (hereinafter, ReleaseTime) in FIG. 41 has elapsed (BFLW12),
-After the set time of HDTV of ReleaseTime has elapsed-> Freeze of the endoscopic image is canceled by the freeze circuit 206. A moving image is output from the synthesis / mask processing unit 231 (the graphic circuit 233 also displays the average value of IHb and cancels the freeze of the time information).
-After the set time of ReleaseTime SDTV elapses → READ processing from the memory * (217) is stopped, and an endoscopic composite image of a moving image including the output of the synchronization circuit 213 and the graphic circuit 218 is output (graphic The circuit 218 also displays the average value of IHb and cancels the freeze of the time information.)

(BFLW13)
Note that the time set by ReleaseTime in FIG. 41 may be operated only for recording instructions (for example, only when a release key is input) to some peripheral devices. (When inputting the capture key, the BFLW13 may be operated after a fixed time (for example, 0.3 s).)
-When the operation after BFLW1 is performed with the freeze key assigned to the operation device being frozen, the entire or part of the recording instruction (for example, only when the capture key is input) In the case of BFLW13, the endoscope image may be kept in a frozen state without releasing the freeze. (Note that the graphic display of the date and time is not frozen when the freeze key is frozen.)
The processing of BFLW10 and BFLW11 may be performed during or after the processing of BFLW12. In that case, the memory ☆ (240) may store an image according to the next recording instruction, and may identify the image with a number. The memory ☆ (240) may be a ring buffer.

  The image compression unit 140 including the compression unit 614 and the moving image encoding unit 624 (to be described later) may be a programmable IC (FPGA, DSP, dynamic reconfigurable processor) or the like. After setting the Encode Type in FIG. Download (reconfigure) the configuration data or program (firmware) of a part of the unit 140 (for example, the compression unit 614 or the video encoding unit 624 whose settings have been changed) or all the blocks, and then compress the compression unit 614 or the video The compression processing of the encoding unit 624 may be changed. (The CPU 2 may download the data via the bus bridge 506, or a FLASHROM or the like (not shown) may be prepared in the compression unit 614 and downloaded from the FLASHROM). In addition, the CPU 1 and CPU 2 monitor the operation state of the image compression unit 140 (the image compression unit 140 periodically sends a command to the CPU 1 and CPU 2 or transmits a pulse signal), and the image compression unit 140 does not intend. When the operation is performed, the image compression unit 140 may be initialized and downloaded again. (During initialization + re-downloading, an error message indicating that downloading is in progress may be displayed on the endoscope composite image, or a predetermined LED on the operation device may be lit / flashing. If the download is completed normally, a message indicating that the download has been completed may be displayed.) The same processing is performed in the image decompression unit 141 (including the decompression unit 714 and the moving image decoding unit 724).

  Further, the memory Q and the memory P may be different address areas in the same memory.

  In addition to the above example, the square pixel correspondence of SDTV in BLFW8 is obtained by interpolating a normal SDTV endoscope composite still image in the image compression unit 140 (for example, 720 × by the bilinear method / bicubic method). Interpolation processing from 480 to 640 × 480) may be supported for square pixels.

In the normal processing (AFLW11), the moving image recording of the endoscope composite image is performed as follows.
When the following recording instruction keys assigned on the operation device are input, each peripheral device records a moving image. (When the instruction key is input again, pause or stop operation is performed.)
VTR key: Records a moving image to VTR1 (303), VTR2 (308), VTR3 (316), and filing device 3 (313). (Note that the recording instruction is issued by the CPU 1 through commands of the serial interface or parallel interface via SIO 407 → □ 1 and PIO 408 → □ 2.)
M-REC key: optical recording device (MO, DVD, CD ± R / W, etc. (325)), filing device 4 (323), HID (USB mouse), optical recording device 2 (MO, DVD, CD ± R) / W etc. (330)), the moving image is recorded on the filing device 5 (328).

(A recording instruction key may be provided independently for each peripheral device. Further, only a part of the peripheral device may be recorded when the VTR key is input (the same applies to the M-REC key).)
Details of video recording with the M-REC key are as follows.
Based on the setting information set in the movie encoding (hereinafter referred to as MovieEncode) in FIG. 41, the selector 238, the selector 629, the size changing unit 622, the YUV converting unit 623, and the moving image encoding unit 624 are set.

  Transfer to the following peripheral devices via the bus bridge 506 under the control of the video encoding unit 624.

  .. Format conversion by CPU2 (503), adding endoscope related information and security information, and via Ethernet (registered trademark) controller 516, optical recording device 2 (MO, DVD, CD ± R / W) (330)) and the like are recorded in the filing device 5 (328). The transfer protocol may be TCP / IP, FTP, HTTP, XML, HL7, SGML, or JAVA (registered trademark), COM, DCOM, CORBA, DBMS, RDBMS.

  ..Format conversion by CPU2 (503), adding endoscope related information and security information, via USB controller 518, optical recording device (MO, DVD, CD ± R / W, etc. (325)) , Recorded in the filing device 4 (323), HID (USB memory, etc. 326). The USB class driver (hereinafter referred to as “Class Driver”) is supported by HUB Class Driver, Human Interface Devices Class Driver, Communication Device Class Driver, Audio Class Driver, Mass Storage Class Driver, Still Image Capture Device Class Driver, Printer Class Driver, etc. It may be possible and may correspond to the USB On-The-Go standard. The format may be converted by the moving image encoding unit 624 and directly transferred to the USB controller 518 without going through the CPU 2 (503).

  The format is converted by the CPU 2 (503), and endoscope related information and security information are added and recorded in the PC card 520 and the memory card 521 via the CARD Controller 519. The format may be converted by the moving image encoding unit 624 and transferred directly to the CARD Controller 519 without going through the CPU 2 (503).

  .. As the order of transfer to the peripheral device, the data may be first stored in the PC card 520 and the memory card 521, and then recorded in the peripheral device via the Ethernet (registered trademark) controller 516 and the USB controller 518. . As a result, even if the processor 113 is turned off during recording in the peripheral device via the Ethernet (registered trademark) controller 516 or the USB controller 518, when the power is turned on again (for example, the first of the normal processing AFLW 11). The image stored in the PC card 520 or the memory card 521 can be automatically transferred again. In that case, it is possible to determine whether the CPU 1 or the CPU 2 is in the middle of recording by storing the recording state information in the backup units 515 and 411 to the peripheral devices.

  A configuration in a recording medium for recording an image in a peripheral device such as a filing device, an optical recording device, a PC card 520, a memory card 521, or a USB memory may be the same as that in FIG. (If the file compression format is MPEG2 file, the extension will automatically be ".mpg" or "m2p".) If the directory name is ID.NO, the same folder if the same ID.NO A still image file (.jpg file) and a moving image file (.mpg) file may be recorded.

  In addition to the transferred image, the following endoscope-related information may be attached to the file as attached information.

..Information displayed on the endoscope composite image (IDNO., Name (patient name), Sex, DO.Birth, Age, date time, Physician, Comment, connection state of the light source 117 (power supply state, communication state, light source) Status information), peripheral device connection information (number of recordings, recording status, presence / absence of connection, power supply status, communication status, printer division mode, number of prints, VTR operating status (playback, recording, stop, etc.)) Endoscopic image information (IHb average value, IHb pseudo color display area, contrast level, enhancement type (structure enhancement or outline enhancement or color enhancement) and level, electronic magnification, image size (Medium or Semi-Full) Or Full), color tone setting, monochrome setting), functions assigned to the switches 103 and 103 ′ of the endoscopes 101 and 101 ′, the keyboard 114, and the front panel 142 (Caps Lock, Insert-like input and (Including setting the input character), arrow pointer display status, stopwatch setting (in operation / pause), abbreviated display status (1/2 / all erase), user items and users on the selected user list screen Setting information, each message displayed in the endoscope composite image, display mode of the endoscope composite image (screen aspect ratio), index frame display number), and display state of each information on the endoscope composite image ( (Display / Erase)
..Information stored in the memories 108 and 108 ′ in the endoscopes 101 and 101 ′ (product names of the endoscopes 101 and 101 ′, serial numbers, types of the CCD 102, the number of forceps channels, and the diameter of each channel) , Tip portion diameter value, insertion portion diameter value, enlarged scale, forceps position information on the endoscope composite image, inspection instruction information, first use date of the endoscopes 101 and 101 ′, energization count, inspection count, Service information, manufacturer comment, service comment, repair record, inspection record, comment information, program version of CPU 109, 109 ', rental information, direct / side view information, white balance data, etc. ON count, date and time at the time of recording processing, type of endoscope 101, 101 ′ (CCD 102, 102 ′), dimming (Iris) setting status, Ethernet ( Mac address of the recording trademark), size information of the IP address ... transferred image, reduction ratio, capacity, information of Figure 41, the color space (sRGB, etc.)
・ ・ Image identification information ・ ・ Information of each setting screen (Refer also to Japanese Patent Application Nos. 2004-202763 and 2004-176201 for details of each information.)
・ ・ Header file or marker of each format ・ ・ Serial number or product name of recorded peripheral device, PC card, memory card or USB memory ・ Information of FIGS. 41 to 44 and FIGS. 17 to 31 Each block of the compression unit 140 and the image decompression unit 141 (described later) may use a memory for work processing (not shown).

  In FIG. 36 and FIG. 7, when the 37 MHz clock is replaced with 74 MHz, it is possible to input a moving image to ◇ by selecting the selector 1203 to the input 1204 to the output 1207 or the input 1205 to the output 1207. is there.

  In this case, as shown in FIG. 49, the compression processing unit 2 (1601) is a programmable circuit (IC) such as an FPGA, DSP, or dynamic reconfigurable processor, and the compression processing unit 2 (1601), which is the same hardware, is used. ), It may be possible to switch between still image compression processing and moving image compression processing. (One of JPEG, JPEG2000, TIFF, BMP, AVI, MPEG, H.264, and WMV can be selected in Encode Type in FIG. 41, and still image compression processing and moving image compression processing are performed according to the selection result. The corresponding block (firmware) may be downloaded again by the CPU 2 via the bus bridge 506, or a FLASHROM (not shown) may be prepared and downloaded from the FLASHROM. During initialization + re-downloading, an error message indicating that the download is in progress may be displayed on the endoscope composite image, and a predetermined LED on the operation device may be lit / flashing. If the download is completed normally, a message indicating that the download has been completed may be displayed.)

  FIG. 50 is a flowchart showing display of a recorded endoscope composite still image in normal processing (AFLW11).

  First, it is detected whether a recorded image display instruction key assigned on the operation device is input (CFLW2).

The detection method may be all or any of the following methods. (The same applies to the moving image display described later.)
CPU 1 (401) detects from the operation device via SIO 407 and PIO 408.

  CPU 2 (503) detects via HID (326) (keyboard, mouse, wheel) via 532, 518, (506). Alternatively, CPU 1 (401) detects from CPU 2 (503) via SIO (511) → SIO (407), PIO (512) → PIO (408).

(A display instruction key may be provided independently for each peripheral device. In this case, the setting of the item “Device” in FIG. 51 may be omitted.)
Thereafter, the graphic circuit 218, 233 or the graphic circuit 2 (501) displays a Wait message (for example, “Please Wait”) indicating that the display is being prepared (CFLW3). The endoscope composite image may be filled with a specific color (for example, black or a color bar). (The same applies to CFLW6, CFLW9, CFLW13, and CFLW16)
Thereafter, the directory name and file name stored in the recording medium of the peripheral device are displayed (CFLW4).

  -Which peripheral device's recording medium is displayed is set by Decode → Device on the setting screen (FIG. 51) (refer to FIG. 52 for details).

A display example of directory names and file names is shown in FIG. When displaying, only the type of images and thumbnails set by Decode → DecodeType on the setting screen (FIG. 51) may be displayed. (Of the attached information of images and thumbnails, identification display is automatically performed based on identification information of a normal SDTV endoscope composite still image, a square pixel SDTV endoscope composite still image, or an HDTV endoscope composite still image. (Alternatively, it may be determined from the size information, the reduction rate, and the capacity of the image and thumbnail attached information.)
Note that the directory names and file names shown in FIG. 53 and the configuration between the directories and files are the same as those in FIG. The display of FIG. 53 may be only the directory name, or the file name stored in the directory may be displayed only when the directory name is selected and a specific key is input (for example, right click of the mouse). The selected directory name or file name can be changed by a specific key (for example, a character key of the keyboard 114 or a character key of the HID 326 (keyboard, mouse, or wheel)) on the operation device. When there are many directory names and file names and a plurality of pages are used, the same page switching as in CFLW8 to 10 may be performed.

  As shown in FIG. 54, in the display state of FIG. 53, by inputting a specific key of the operation device, a search message is displayed, and by inputting a directory name or file name, only the corresponding directory name or file name is displayed. You may make it display.

  A directory name is selected by a specific key of the operation device (for example, an arrow key of the keyboard 114, an arrow key of the HID 326 (keyboard, mouse, or wheel) or left click), and a confirmation key (for example, the ENTER key of the keyboard 114 or the HID 326 (keyboard or mouse). (CFLW5) When a Wait message is displayed (CFLW6), a multi-image is created and a multi-image is displayed (CFLW7).

Details of multi-image display are as follows.
The CPU 2 (503) stores the file stored in the directory from the peripheral device selected on the setting screen (item “Device”) in the memory 719 via the bus bridge 506 and the controller 718 (CPU 2 (503). You may store without going through). All files stored in the directory may be stored in the memory 719 in advance, or only thumbnail images may be stored in the memory 719 in advance.

  The selectors 716, 721, 711, and 720 are controlled from the attached information of the file, and processing of the decompression unit 714 and the RGB conversion unit 709 is performed (see FIG. 55 for details). The selectors 706 and 701 select to pass through 705 → 704 → 702.

・ If Decode → thumbnail on the setting screen (FIG. 51) is set to USE, a multi-image is created from the thumbnail file. The number of thumbnails displayed in the multi-image is determined by the size of the thumbnail file. (For example, if the thumbnail file is a normal SDTV composite still image type and the size is 180 × 120, the display range of the entire multi-image is 720 × 480, so the number of thumbnails is 16.)
・ If Decode → thumbnail on the setting screen (FIG. 51) is set to NO, thumbnails from the file of the main image are displayed according to the number of thumbnails set on Decode → Mult Num. On the setting screen (FIG. 51). Create and display. (For example, if the main image is a normal SDTV composite still image type and Mult Num. = 16, the thumbnail image is reduced to 1/4 from the main image of 720 × 480, and a 180 × 120 thumbnail image is created and displayed. .)
-After the multi-image creation by the thumbnail / multi-image creation unit 704, one frame of the multi-image is stored by the synchronization circuit 725, and the multi-image synchronized with the 74 MHz clock and the 13.5 MHz as the SDTV endoscope composite still image Multi-images synchronized with the clock are output to the synthesis / mask processing units 216 and 231. An example of the synchronization circuit 725 is shown in FIG. The memory control circuit 1301 controls the FIFOs 1302, 1308 and 216, 231 of the synchronization circuit 725 so that synchronized images can be output. (Only the synchronization process corresponding to the type set by Decode → DecodeType may be performed (for example, SDTV1 (ordinary SDTV endoscope composite still image) or SDTV2 (square pixel SDTV endoscope composite still image) is selected) If it is selected, only multi-image synchronization processing synchronized with the 13.5 MHz clock input to 216 is performed. If HDTV (HDTV endoscope composite still image) is selected, the 74 MHz input to 231 is performed. Only the multiple images synchronized with the clock may be synchronized)).

  -Only the type of multi-image set by Decode → DecodeType may be displayed. (For example, when SDTV1 (ordinary SDTV endoscope combined still image) or SDTV2 (square pixel SDTV endoscope combined still image) is selected, a multiplicity of SDTV images input to the combining / mask processing unit 216 is selected. Only the image 216 is output, and the composition / mask processing unit 231 may control to display a screen of a specific color (black, blue, etc.) without outputting a multi-image (a warning message is displayed). On the other hand, when HDTV (HDTV endoscope composite still image) is selected, only the multi-image of the HDTV image input to 231 is output 231, and 216 does not output the multi-image and the specific color It may be controlled to display a screen (black, blue, etc.) (a warning message may be displayed).

  Examples of multi-image display are shown in FIGS. The selection frame may be displayed together with the multi-image, and the selection frame can be moved by a specific key of the operation device (for example, an arrow key of the keyboard 114, an arrow key of the HID 326 (keyboard, mouse, or wheel) or left click). The selection frame is created by the graphic circuits 218 and 233 and the graphic circuit 2 (501) and is synthesized by the synthesis / mask processing units 216 and 231.

  When the thumbnail file is an endoscopic composite image with graphics (characters), it is displayed as shown in FIG. 57, and when only the endoscopic image subjected to mask processing is displayed as shown in FIG.

  When there is a multi-image page switching instruction (CFLW8) by a specific key of the operation device (for example, PageUP, PageDown key of keyboard 114 or PageUP, PageDown key of HID326 (keyboard, mouse or wheel) or mouse scroll) (CFLW8) A multi-image of the specified page is created during display (CFLW9), and the multi-image of the specified page is displayed (CFLW10). A display example is shown in FIG. As shown in FIG. 58, the next page instruction (eg, PageUp key input) displays the next page multi-image, and the previous page instruction (eg PageDown key input) displays the previous page multi-image. May be. Further, the selection frame may be always selected at the upper left when switching pages. When there is only one page, when switching the page, when there is no previous page, when the previous page is specified, or when there is no next page, when the next page is specified, the key input is invalidated. Moreover, warnings such as error sounds and error indications may be given. Further, the number of pages for indicating the number of pages may be displayed in the corner.

  If there is an instruction to return to the previous screen by a specific key of the operation device (for example, BS key or ESC key of the keyboard 114, BS key or ESC key of the HID 326 (keyboard, mouse, or wheel)) (CFLW11), the flow of CFLW3 Move and display directory name and file name (CFLW4).

  When a thumbnail is selected in the selection frame and confirmed by inputting a confirmation key of the operation device (for example, the ENTER key of the keyboard 114 or the ENTER key of the HID 326 (keyboard, mouse or wheel) or left double-click) (CFLW12), The main image of the thumbnail selected during the display of the Wait message is created (CFLW13) and displayed (CFLW14).

Details of creating and displaying this image are as follows.
The CPU 2 (503) stores the file corresponding to the main image of the thumbnail file selected in the selection frame from the peripheral device selected on the setting screen (item “Device”) in the memory 719 via the bus bridge 506 and the controller 718. (You may store without going through CPU2 (503)). When all the files including the main image are stored in the memory 719 in advance, there is no need to transfer them again from the peripheral device.

  The selectors 716, 721, 711, and 720 are controlled from the attached information of the main image file, and the decompression unit 714 and the RGB conversion unit 709 are processed (refer to FIG. 55 for details). The selectors 706 and 701 select to pass through the path 703.

  -The main image via the path 703 is synchronized with the synchronization circuit 725 in synchronism with the 74 MHz clock as the HDTV endoscope synthesized still image, or in synchronism with the 13.5 MHz clock as the SDTV endoscope synthesized still image. Output to mask processing units 216 and 231. (Only the synchronization process corresponding to the type set by Decode → DecodeType may be performed (for example, SDTV1 (ordinary SDTV endoscope synthesized still image) or SDTV2 (square pixel SDTV endoscope synthesized still image) is selected) If it is selected, only the synchronization processing of the SDTV endoscope composite still image input to 216 is performed. If HDTV (HDTV endoscope composite still image) is selected, the HDTV endoscope composite input to 231 is performed. Only the still image may be synchronized)).

-Only the main image of the type set by Decode → DecodeType may be displayed. (For example, when SDTV1 (ordinary SDTV endoscope composite still image) or SDTV2 (square pixel SDTV endoscope composite still image) is selected, the book of the SDTV image input to the composition / mask processing unit 216 Only the image 216 is output, and the composition / mask processing unit 231 may be controlled to display a screen of a specific color (black, blue, etc.) without outputting the main image (a warning message is displayed). On the other hand, when HDTV (HDTV endoscope composite still image) is selected, only the main image 231 of the HDTV image input to 231 is output, and 216 is specified without outputting the main image. It may be controlled to display a color (black, blue, etc.) screen (a warning message may be displayed).
A display example of this image is shown in FIG. When the main image is displayed, it may be clearly indicated that the recorded image is displayed by turning on a dedicated LED on the operation device or displaying a message. (The user can easily grasp that the recorded image is displayed.)

When there is an instruction to switch the page of this image by a specific key of the operation device (for example, Page UP, Page Down key of the keyboard 114, Page UP, Page Down key of the HID 326 (keyboard, mouse or wheel) or mouse scroll) (CFLW15), the Wait message A multi-image of the specified page is created while displaying (CFLW16), and the main image of the specified page is displayed (CFLW17). A display example is shown in FIG. As shown in FIG. 59, the next page instruction (eg, PageUp key input) displays the next page of the main image, and the previous page instruction (eg, PageDown key input) displays the previous page of the main image. May be. Also, if there is an instruction to switch pages when there is only one main image, if there is no previous page, if there is an instruction for the previous page, or if there is no next page, if there is an instruction for the next page, enter a key. It may be invalidated and a warning such as an error sound or an error display may be given. (As shown in FIG. 58, the number of pages for indicating the number of pages may be displayed in the corner.)
When there is an instruction to return to the previous screen by a specific key of the operation device (for example, BS key or ESC key of keyboard 114, BS key or ESC key of HID326 (keyboard, mouse or wheel)) (CFLW18), the flow of CFLW6 Move and display multiple images.

  A file name is selected by a specific key of the operation device (for example, an arrow key of the keyboard 114, an arrow key of the HID 326 (keyboard, mouse, or wheel) or left click), and a confirmation key (for example, the ENTER key of the keyboard 114 or the HID 326 (keyboard or mouse). When the ENTER key or left double-click) is entered (CFLW19), the main image is created while the Wait message is displayed (CFLW13), and the main image corresponding to the file is displayed (CFLW13). CFLW14).

  If there is an instruction to return to the previous screen while the directory name or file name is displayed (CFLW20), the recorded image display is terminated (CFLW21).

  In FIG. 50, when displaying the main image / thumbnail of the SDTV endoscope composite still image of square pixels, the size of the normal SDTV endoscope composite still image is changed and displayed by interpolation processing. May be. (For example, interpolation processing is performed from 640 × 480 to 720 × 480 by the bilinear method / bicubic method).

  In the normal process (AFLW11), the moving image display (reproduction) of the endoscope composite image is performed as follows.

When each of the following display instruction keys assigned on the operation device is input, each peripheral device plays a moving image. (When the instruction key is input again, pause or stop operation is performed.)
..VTR playback key: Plays a moving image from VTR1 (303), VTR2 (308), VTR3 (316), and filing device 3 (313). (Note that the reproduction instruction is issued by the serial interface or parallel interface command from the CPU 1 via the SIO 407 → □ 1 and the PIO 408 → □ 2.)
..M-PLY key: optical recording device (MO, DVD, CD ± R / W etc. (325)), filing device 4 (323), HID (USB mouse), optical recording device 2 (MO, DVD, CD ± R / W etc. (330)), the moving image is recorded on the filing device 5 (328).

(A display instruction key may be provided independently for each peripheral device. In this case, the setting of the item “Device” in FIG. 51 may be omitted.)
・ When M-PLY key is input, the following operations are performed.
.. Displays a Wait message (for example, “Please Wait” characters) indicating that the display is being prepared.
..Displays the directory name and file name stored in the recording medium of the peripheral device (same as CFLW4).

  ..Selecting a directory name by a specific key of the operation device (for example, an arrow key of the keyboard 114 or an arrow key of the HID 326 (keyboard, mouse, or wheel) or left click) and a confirmation key (for example, the ENTER key of the keyboard 114 or the HID 326 (keyboard) Or mouse and wheel) ENTER key or left double-click) to confirm and play the video after displaying the Wait message.

・ Details of video playback with M-PLY key are as follows.
The CPU 2 (503) performs processing of the video decoding unit 724 and the RGB conversion unit 723 via the bus bridges 506 and 726 from the peripheral device selected on the setting screen of the file stored in the directory (similar to FIG. 55) The corresponding decoding process and RGB conversion are automatically performed based on the attached information.

  ... At 722, the size is changed to the size set by Decode → SIZE on the setting screen (FIG. 51).

  ..Selecting the selector 729 according to the setting of Decode → Decode Type on the setting screen (FIG. 51). (When HDTV is selected, 74 MHz is selected and a moving image synchronized with the 74 MHz clock is output, and when SDTV 1 and 2 are selected, 13.5 MHz is selected and a moving image synchronized with the 13.5 MHz clock is output.

  ... Only the type of moving image set by Decode → DecodeType may be displayed. (For example, when SDTV 1 and 2 are selected, only the SDTV moving image 216 input to 216 is output, and when HDTV is selected, only the HDTV moving image 231 input to 231 is output. Good.

  .. When displaying a moving image, by setting ON in Decode → PinP (picture-in-picture) on the setting screen (FIG. 51), the captured images of the endoscopes 101 and 101 ′ (FIG. 60) The outputs of the synchronization circuits 228 and 213 may be combined with the endoscope circuit-related information created by the graphic circuits 218 and 233 and the graphic circuit 2 (501) for display (see FIG. In 60, when Decode → SIZE is 1/2 and Decode → Position is LR on the setting screen (FIG. 51).

  ..Trick play (fast forward, rewind, pause, stop, etc.) may be performed with a specific key of the operation device.

8 and 56, when the 37 MHz clock is replaced with 74 MHz, as shown in FIG. 61, the decompression processing unit 2 (1401) is replaced with a programmable circuit (IC such as an FPGA, DSP, or dynamic reconfigurable processor). ) And the expansion processing unit 2 (1401), which is the same hardware, may be capable of switching between still image expansion processing and moving image expansion processing. (Select one of JPEG, JPEG2000, TIFF, BMP, AVI, MPEG, H.264, WMV with Select in FIG. 51, and still image expansion processing, moving image expansion processing, etc. according to the selection result) The corresponding block (firmware) may be downloaded again, or may be downloaded by the CPU 2 via the bus bridge 506, or a FLASHROM (not shown) may be prepared and downloaded from the FLASHROM. Further, during initialization + re-downloading, an error message indicating that downloading is in progress may be displayed on the endoscope composite image, and a predetermined LED on the operation device may be lit / flashed. In addition, when the download is completed normally, a message indicating that the download has been completed may be displayed.
FIG. 62 shows image transfer between 239-627, 238-622, 725-701, 722-231 (216), and other arbitrary blocks in the processor 113 in FIGS. It is the figure which showed the example. R, G, and B represent red, green, and blue image data, respectively, and Y, Cr, and Cb represent luminance signal and color difference signal data, respectively. Data is transferred between blocks in synchronization with the clock. The relationship with dots on the image is shown in FIGS. FIG. 63 shows the relationship between dots on the image and R, G, B, and FIG. 64 shows the relationship between dots on the image and Y, Cr, Cb. Each data may be an arbitrary number of bits (for example, 8 bits or 10 bits).

62 (1) to (7) will be described.
FIG. 62 (1): R, G, and B data corresponding to one dot of an image are transferred in order for each clock in parallel.
FIG. 62 (2): Y, Cr, Cb data corresponding to one dot of the image is transferred in parallel in order for each clock (YcrCb → RGB conversion circuit (not shown) may be provided in each block in the block) .)

Fig. 62 (3): For one dot of the image, R and G data are transferred in parallel at the first clock, and B data is transferred at the next clock (the multiplexer circuit for transferring the data alternately is included in the block) In addition, when transferring alternately in this way, the clock may be transferred twice (for example, if processing is performed at 13.5 MHz in the block, output may be performed at 27 MHz). The same applies to the following processing))).

FIG. 62 (4): For one dot of the image, R and G data are transferred in parallel at the first clock, B data is transferred at the next clock, and R data of the dot of the next image is transferred in parallel. At the next clock, G and B data are transferred in parallel.

FIG. 62 (5): Y data is transferred at every clock, but Cr and Cb data are transferred at the first clock with Cb data and at the next clock with Cr data. As a result, data is transferred at a ratio of Y: Cr: Cb = 4: 2: 2.

FIG. 62 (6): R, G, and B data corresponding to one dot of the image are sequentially transferred every clock. (A multiplexer circuit for alternately transferring data may be provided in the block. In this case, the clock may be transferred by a factor of 3 (for example, 13.5 MHz in the block). ), You may make it output at 40.5MHz.))
Fig. 62 (7): Y, Cr, Cb data is transferred every clock, but since Cb0 → Y0 → Cr0 → Y1 is transferred, the data is in the ratio of Y: Cr: Cb = 4: 2: 2. Will be transferred. (A multiplexer circuit for alternately transferring data may be provided in the block. In this case, the clock may be doubled (for example, at 13.5 MHz in the block). When processing, you may make it output at 27.5MHz.))
In addition, image transfer is digital transmission standard ITU-R BT.656 / BT.601 / BT.709 / BT.799 / BT.1120 / BT1364 / BTA S-001 / BTA S-002 / BTA S-004 / BTA It may be based on S-005.

As described above, according to the endoscope apparatus of the present invention,
A user can select a peripheral device to be recorded from a plurality of peripheral devices by selecting and assigning a recording instruction key of the peripheral device to be recorded to the operation device. (See Fig. 25 etc.)
The encoded (compressed) digital image can generate a plurality of sizes of a normal SDTV endoscope composite still image and a square pixel SDTV endoscope composite still image, and from the memory 212 to a normal or square pixel. The corresponding enlargement (reduction) coefficient, enhancement coefficient, image rotation parameter, and the like are read out and the controller 111 performs control to process the endoscopic image, so that an endoscopic image optimal for each size can be processed. . In addition, a recording peripheral device can be set for each size.

The user can easily and reliably perform the following processing on the setting screens shown in FIGS.
・ ・ By selecting the type of encoding in the item “Encode Type”, the user can select the encoding process he / she wants to set. When all (or part of) the image compression unit 140 and the image decompression unit 141 are composed of programmable ICs, the configuration data or program (firmware) automatically corresponding to the item “Encode Type” is selected after the item “Encode Type” is selected. Software) can be downloaded (reconfigured) again to change the encoding process. Therefore, a plurality of encoding processes can be performed with the same hardware.

.. Encoding type can encode moving images (WMV / H.264 / MPEG2 / MPEG4 / AVI) or still images (JPEG / JPEG2000 / TIFF / BMP).
.. By turning OFF the item “Encode Type”, it is possible to record / reproduce and display an unencoded (uncompressed) image.

The user can easily and reliably display digital images recorded on the peripheral device (FIGS. 59 and 60). In addition, the processing of the image decompression unit 141 can be automatically performed based on the setting on the setting screen of FIG. 51 and the attached information of the recorded image (see FIG. 50 and the like). In order to facilitate the retrieval of the reproduced image, it is possible to display a directory and a file name (FIG. 53) and display a multi-image (FIGS. 57 and 58) using thumbnail images. In addition, it is possible to select which peripheral device's recorded image is to be displayed.
As the order of transfer to the peripheral device, the image data may first be stored in a peripheral device (for example, the PC card 520 and the memory card 521) as an image backup, and then recorded in another peripheral device. As a result, even if the processor 113 is turned off during recording or a communication error in the peripheral device, images and thumbnails stored in the peripheral device (PC card 520 or memory card 521) backed up when the power is turned on again. Can be automatically transferred again. This makes it possible to record an image safely and reliably.

Furthermore, according to the present invention,
As shown in Figure 4, by extending the function of the programmable IC,
・ Further power saving is possible.

-For example, it can easily cope with function expansion of optional circuits.

-The performance of the processor is improved by adding arithmetic circuits such as multiplication and division functions.

-Since there are many peripheral devices connected to the processor, when the performance of the CPU 401 that performs the control is severe, the SIO / PIO function can be enhanced, and the performance of the processor including the control of the peripheral device is improved. This makes it easier to use and improves testing and diagnosis.

As shown in FIGS. 32, 33, and 34,
-By strengthening security by detecting security codes and entering passwords, only specific people (such as service personnel) can upgrade the version, so programs for VersionUP and FPGA (DSP) data It becomes difficult to tamper with (firmware), ensuring high safety.

・ By preparing encryption and guard key (or password) when sending and receiving commands including information related to endoscope,
・ ・ Even if a command is intercepted when sending and receiving a command over the air, it is difficult to decipher because it is encrypted.

Only a specific user can access the memory on the contactless card 1504 side.

-By storing programs, information related to the endoscope (data of each setting screen), or firmware of the programmable IC in a directory or file, and preparing a guard key (or password) for each file or directory It becomes possible to perform access restriction for each file.

Therefore, security is strengthened and high safety can be secured. In the case of wireless communication, setting and upgrading can be performed easily and at high speed without connecting a cable or installing a USB memory, PC card 520, or memory card 521.

・ By applying security (guard key or password) to the main image / thumbnail file and directory of the endoscope composite still image (Fig. 47), only specific users can access it, security is enhanced, and safety is high. Can be secured.

  The present invention is useful for an endoscope apparatus, particularly an electronic endoscope apparatus.

1 is an overall configuration diagram showing a first embodiment of an endoscope apparatus according to the present invention. The block diagram which shows the video processing part 1 in the processor of FIG. The block diagram which shows the detail of the control process part 1 of FIG. The block diagram which shows the example which added the circuit to the control processing part 1 of FIG. The block diagram which shows the detail of the control process part 2 of FIG. FIG. 6 is a block diagram illustrating an example of a peripheral device connected to each of FIGS. 3 to 5. The block diagram which shows the detail of the image compression part of FIG. The block diagram which shows the detail of the image expansion | extension part of FIG. The flowchart which shows the process at the time of power-on of the processor of FIG. The figure which shows the example of a display of the password input message screen on an endoscope synthetic | combination image. The figure which shows the example of a display of the version upgrade program and the version message of FPGA data on an endoscope synthetic image. The figure which shows the example of a display of the confirmation message on an endoscope synthetic | combination image. The figure which shows the example of a display of the result message on an endoscope synthetic | combination image. The block diagram which shows another Example corresponding to FIG. 5 in version upgrade mode. FIG. 15 is a block diagram illustrating a circuit configuration example of a wireless control unit in FIG. 14. The block diagram which shows the circuit structural example of the non-contact card | curd of FIG. The figure which is an example of setting information and shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a system setting screen. The figure which shows the setting item of a user setting screen. The figure which shows the setting item of a user setting screen. The figure which shows the setting item of a patient data setting screen. Explanatory drawing of an endoscope synthetic image. Explanatory drawing of an endoscope synthetic image. Explanatory drawing of an endoscope synthetic image. Explanatory drawing of an endoscope synthetic image. The flowchart of the operation | movement which reads the setting information in a non-contact card in a processor in normal processing. The flowchart of the operation | movement which writes setting information in the memory in a non-contact card in a normal process from a processor. The figure which shows the structural example of the memory in a non-contact card. 6 is a flowchart showing still image recording of an endoscope composite image in normal processing. FIG. 3 is a block diagram showing a detailed view of a controller / selector 239 in FIG. 2. The figure which shows the example of a setting of the taking-in range at the time of storing in the memory from the endoscope synthetic | combination image output from the synthetic | combination and mask process part. The figure which shows the example of a table which showed the taking-in range of FIG. FIG. 3 is a diagram illustrating an example of an address configuration of enlargement (reduction) coefficients stored in a memory 212 in FIG. 2. FIG. 3 is a diagram showing an example of an address configuration of emphasis coefficients stored in a memory 212 in FIG. 2. The figure which shows an example of the setting screen of an image compression part. The figure which shows the item of ENCODE of FIG. The figure which shows the item of Release Time of FIG. The figure which shows the item of Movie Encode of FIG. The figure which shows the example which produces a thumbnail image from an endoscope synthetic | combination image (or endoscope image only of a mask process). The figure which shows the example of a table which showed the range read from the memory Q (628) of FIG. The figure which shows the structural example in the recording medium which records the image in peripheral devices, such as a filing apparatus, an optical recording device, a PC card, a memory card, and a USB memory. The figure which shows the structural example of the file of a main image and a thumbnail image. The block diagram which shows another Example using the memory for work processes for the image compression part. The flowchart which shows the display of the recorded endoscope synthetic | combination still image among normal processes. The figure which shows the example of a setting screen of a system. The figure which shows the item of DECODE of FIG. The figure which shows the example of a display of a directory name and a file name. The figure which shows the example which displays only a pertinent directory name and file name by displaying a search message by inputting the specific key of an operation device in the display state of FIG. 53, and inputting a directory name or a file name. The figure which shows the selector control of an image expansion part. The block diagram which shows an example of a synchronizing circuit. The figure which shows the example of a display in case a thumbnail file is an endoscope synthetic image with a graphic (character). The figure which shows the example of a display in case only the endoscopic image by which the mask process was carried out. The figure which shows the example of a display of this image. The figure which shows the state which displayed the recording moving image by PinP on the endoscopic image. The block diagram which shows another Example which enabled the image expansion part to switch between the expansion | extension process of a still image, or the expansion | extension process of a moving image. FIG. 9 is a diagram illustrating an example of image transfer between 239-627, 238-622, 725-701, 722-231 (216), and other arbitrary blocks in the processor in FIGS. The figure which shows the relationship between the dot on an image, and R, G, B. The figure which shows the relationship between the dot on an image, Y, Cr, and Cb.

Explanation of symbols

101, 101 '... Endoscope 102, 102' ... CCD (Acquisition means)
114 ... Keyboard (recording instruction means)
136 ... Video processing unit (digital image processing means)
137, 138 ... control processing unit 203 ... A / D converter 222, 235 ... D / A converter (analog output means)
237 ... Digital output unit (encoding means and digital output means)
Agent Patent Attorney Susumu Ito

Claims (9)

An acquisition means for acquiring an image taken by an endoscope;
Digital image processing means for digital image processing the image acquired by the acquisition means;
Analog output means for converting the digital image subjected to the digital image processing into an analog output and outputting the analog image;
Analog peripheral devices connected to the analog output means;
Encoding means for encoding the digital image;
Digital output means for outputting the encoded digital image;
A digital peripheral connected to the digital output means;
Recording instruction means for instructing recording to the analog peripheral device and the digital peripheral device, wherein the recording instruction means can select and record from the analog peripheral device and the digital peripheral device to be connected. A recording instruction means;
An endoscope apparatus characterized by comprising:   The endoscope apparatus according to claim 1, wherein the encoded digital image can generate a plurality of sizes, and the digital image processing is changed according to the sizes.   The endoscope apparatus according to claim 1, wherein the encoding means is performed by a programmable IC and includes means for selecting firmware of the programmable IC.   The endoscope apparatus according to claim 1, wherein the encoding unit includes moving image processing or still image processing.   The endoscope apparatus according to claim 1, wherein a digital image that is not processed by the encoding unit can also be output.   The endoscope apparatus according to claim 1, wherein a digital image recorded on the digital peripheral device can be displayed.   6. The endoscope apparatus according to claim 5, wherein thumbnail images can also be displayed.   The endoscope apparatus according to claim 1, wherein a part of the digital peripheral device backs up the digital image.   The endoscope according to claim 1, further comprising: a file for storing a digital image recorded in the digital peripheral device; and a directory for storing the file, wherein security is applied to the file or the directory. apparatus.

Images