JP6310598B2 - Endoscope apparatus, image processing apparatus, and operation method of endoscope apparatus - Google Patents

Description

  The present invention relates to an endoscope apparatus having an observation optical system and a solid-state image sensor, an image processing apparatus that performs image processing on an image obtained by the endoscope apparatus and outputs the processed image to a monitor, and operation of the endoscope apparatus Regarding the method.

  Conventionally, medical diagnosis using an electronic endoscope has been performed in the medical field. For example, an electronic endoscope called a scope is provided with an insertion portion that is inserted into a patient's body. An observation optical system and a solid-state imaging device that captures an optical image formed by the observation optical system are provided in the internal space of the insertion portion distal end, which is the distal end portion of the insertion portion.

  Since the solid-state imaging device is attached and fixed to the solid-state imaging device frame in the distal end portion of the insertion portion, or is fixed to the shield frame with a sealing resin, the mounting position accuracy of the solid-state imaging device may be lowered. . In addition, the mounting position accuracy of the observation optical system in the distal end portion of the insertion portion may be lowered as in the case of the solid-state imaging device. In such a case, as shown in FIG. 19, it is difficult to make the center of the effective pixel area 300 of the solid-state imaging device coincide with the center of the imaging area 302 of the observation optical system. Further, since a part of the effective pixel area 300 is used for image processing, the center of the effective pixel area 300 and the center of the display area 304 of the image displayed on the monitor do not always match as shown in FIG. . For this reason, defects such as declination occur in the image displayed on the monitor.

  Therefore, in the imaging apparatus described in Patent Document 1, a good image free from defects such as declination is obtained by matching the center of the observation optical system (imaging area) with the center of the display area. .

Japanese Patent No. 477826

  However, due to the recent miniaturization of observation optical systems and solid-state image sensors for electronic endoscopes, it is not possible to secure a margin for the effective pixel area for the imaging area of the observation optical system and a margin for the imaging area for the display area. There is. In such a case, if the mounting accuracy of the solid-state imaging device or the like is low, even if the center of the imaging area and the center of the display area coincide with each other as described in Patent Document 1, as shown in FIG. In addition, there is a possibility that a part of the area overlapping with the display area 304 in the imaging area 302 (a portion displayed by hatching in the drawing) is located outside the effective pixel area 300. As a result, a part of the optical image corresponding to the display area 304 is formed outside the effective pixel area, causing vignetting in the image displayed on the monitor.

  The present invention has been made in view of such circumstances, and is an endoscope apparatus, an image processing apparatus, and an internal apparatus capable of obtaining a good image without vignetting even when the mounting accuracy of a solid-state imaging device or an observation optical system is low. It is an object of the present invention to provide a method for operating an endoscope apparatus.

  An endoscope apparatus for achieving the object of the present invention is an observation optical system and a solid-state imaging device that is positioned and fixed relative to the observation optical system and forms an optical image by the observation optical system. In order to cut out a display image corresponding to a display area to be displayed on a monitor from a solid-state imaging device in which a plurality of photoelectric conversion elements for photoelectrically converting an optical image are arranged and an image generated based on an imaging signal of the solid-state imaging device A storage unit that stores image cutout information for specifying an image cutout area, and an image processing unit that cuts out a display image from the image based on the image cutout information stored in the storage unit. As the cutout information, the displayable pixel area of the solid-state image sensor and the image formation area of the optical image formed on the solid-state image sensor by the observation optical system, and the center of the image formation area Information for specifying an image cutout area for cutting out the display image corresponding to the overlap area when the display area is matched with the center of the display area is stored, and the image processing unit displays the cutout display image in the image size of the display area. Expand to.

  According to the present invention, since the mounting accuracy of the solid-state imaging device and the observation optical system is low, even when a part of the area overlapping the display area in the imaging area is located outside the displayable pixel area, the display area The display image enlarged to the image size can be displayed on the monitor.

  In the endoscope apparatus according to another aspect of the present invention, the storage unit further stores magnification information indicating a magnification for enlarging the display image to the image size of the display area, and the image processing unit is stored in the storage unit. The display image is enlarged according to the stored magnification information. The display image can be easily adjusted to the image size of the display area simply by enlarging the display image cut out in accordance with the magnification information stored in advance in the storage unit.

  In the endoscope apparatus according to another aspect of the present invention, image storage information and magnification information corresponding to each of the plurality of display areas are stored in the storage unit, and displayed on the monitor from the plurality of display areas. A selection unit that selects a display area to be acquired, and the image processing unit acquires image cutout information and magnification information corresponding to the display area selected by the selection unit from the storage unit, and displays the image cutout information and the image based on the image cutout information. A display image is cut out and the display image is enlarged according to the magnification information. Thereby, even when the display area is selected or switched, a good observation image without vignetting can be obtained.

  In the endoscope apparatus according to another aspect of the present invention, the image cutout information stored in the storage unit is information indicating an image cutout area having the same aspect ratio as the display area. Thereby, even when the display image is enlarged, an image without a sense of incongruity can be displayed on the monitor.

In the endoscope apparatus according to another aspect of the present invention, the number of pixels in the vertical and horizontal directions of the displayable pixel area is 2V and 2H, and the number of pixels in the vertical and horizontal directions of the display area is 2L _V and 2L _H. When the _V D and D _H represent the amount of deviation in the vertical and horizontal directions between the center of the displayable pixel area and the center of the imaging area in terms of the number of pixels, When the information indicates an image cutout region that satisfies at least one of 1) and Equation (2), the image for display is enlarged by the image processing unit. Thus, these processes are prevented from being executed until it is not necessary to perform the image cut-out process or the image enlargement process.

V−L _V ≦ D _V (1)
H−L _H ≦ D _H (2)
In the endoscope apparatus according to another aspect of the present invention, the image processing unit has magnifications represented by the following equations (3) and (4), where m is the magnification for enlarging the display image. The display image is enlarged at the higher magnification of m. Thereby, the image size of the clipped display image can be enlarged to the image size of the display area.

m = L _V / (V−D _V ) (3)
m = L _H / (H−D _H ) (4)
In the endoscope apparatus according to another aspect of the present invention, when the higher magnification is equal to or less than the allowable magnification, the image for display is enlarged by the image processing unit. Thereby, it is possible to prevent an observation image with poor image quality from being displayed.

  In the endoscope apparatus according to another aspect of the present invention, a mask process for masking the display image in the same shape as the display area is performed on the display image. Thereby, the display image having the same shape as the display area can be displayed on the monitor.

  An image processing apparatus for achieving the object of the present invention is a solid-state image sensor that is positioned and fixed relative to an observation optical system and forms an optical image by the observation optical system, and photoelectrically converts the optical image. In an image processing apparatus that generates a display image corresponding to a display area displayed on a monitor from an image generated based on an imaging signal of a solid-state imaging device in which a plurality of photoelectric conversion elements are arranged, Display from the image based on the information acquisition unit for acquiring the image cut-out information from the storage unit for storing the image cut-out information for specifying the image cut-out region for cutting out the display image from the image, and the image cut-out information acquired by the information acquisition unit An image processing unit that cuts out an image for image processing. To cut out a display image corresponding to the overlapping area when the center of the imaging area and the center of the display area coincide with the imaging area of the optical image formed on the image element. The information for specifying the image cutout area is acquired from the storage unit, and the image processing unit enlarges the cutout display image to the image size of the display area.

  An operation method of an endoscope apparatus for achieving the object of the present invention includes an observation optical system and a solid-state imaging device that is positioned and fixed relative to the observation optical system and forms an optical image by the observation optical system. An image for display corresponding to a display area displayed on a monitor from a solid-state imaging device in which a plurality of photoelectric conversion elements for photoelectrically converting an optical image are arranged and an image generated based on an imaging signal of the solid-state imaging device An endoscope comprising: a storage unit that stores image cutout information for specifying an image cutout region for cutting out an image; and an image processing unit that cuts out a display image from the image based on the image cutout information stored in the storage unit In the operation method of the apparatus, the storage unit includes, as image cutout information, a displayable pixel area of the solid-state imaging device and an imaging area of an optical image formed on the solid-state imaging device by the observation optical system. Information for specifying an image cut-out area for cutting out a display image corresponding to the overlap area when the center of the imaging area coincides with the center of the display area is stored in the image processing unit. However, the clipped display image is enlarged to the image size of the display area.

  In the operation method of the endoscope apparatus according to another aspect of the present invention, the storage unit further stores magnification information indicating a magnification for enlarging the display image to the image size of the display area, and the image processing unit includes: The display image is enlarged according to the magnification information stored in the storage unit.

  The endoscope apparatus, the image processing apparatus, and the operation method of the endoscope apparatus according to the present invention can obtain a good image without vignetting even when the mounting accuracy of the solid-state imaging device or the observation optical system is low.

1 is a perspective view of an endoscope apparatus according to the present invention. It is a block diagram which shows the electric constitution of an endoscope apparatus. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area in the ideal state in which the center of an effective pixel area and the center of an observation optical system correspond, an imaging area, and a display area. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area in the real state in which the shift | offset | difference has arisen with the center of an effective pixel area, and the center of an observation optical system, an imaging area, and a display area. It is explanatory drawing for demonstrating an image cut-out area | region and image cut-out information. It is explanatory drawing for demonstrating magnification information. FIG. 3 is a functional block diagram of an image processing unit illustrated in FIG. 2. It is explanatory drawing for demonstrating the mask process by a mask process part. It is a flowchart which is a part of manufacturing process of an electronic endoscope, and shows a flow of a storage process of image cutout information and magnification information. It is a flowchart which shows the flow of the display process of the observation image containing the image process which concerns on the image adjustment method of this invention. It is explanatory drawing for demonstrating the image processing which concerns on the image adjustment method of this invention. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area (displayable pixel area), image formation area, and display area in the endoscope apparatus of other Example 1. FIG. It is explanatory drawing for demonstrating the image process performed with the endoscope apparatus of the other Example 1. FIG. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area (displayable pixel area) in the endoscope apparatus of other Example 2, an imaging area, and a display area. It is explanatory drawing for demonstrating the image process performed with the endoscope apparatus of the other Example 2. FIG. It is a block diagram which shows the electric constitution of the principal part of the processor apparatus of the endoscope apparatus of other Example 3. It is the schematic of the capsule system used for the endoscope apparatus of this invention. It is the schematic of the capsule system of other embodiment. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area in the state in which the center of an effective pixel area and the center of an observation optical system correspond, an imaging area, and a display area. It is explanatory drawing for demonstrating the positional relationship of the effective pixel area (displayable pixel area), the image formation area, and the display area in the state which has shifted | deviated between the center of an effective pixel area and the center of an observation optical system. .

  Hereinafter, an endoscope apparatus according to the present invention will be described with reference to the accompanying drawings.

[Entire configuration of endoscope apparatus]
FIG. 1 is an external perspective view of an endoscope apparatus (also referred to as an endoscope system) 10 according to the present invention. The endoscope apparatus 10 is roughly divided and includes an electronic endoscope 11, a light source device 12, a processor device 13, a monitor 14, and the like as a scope (here, a flexible endoscope) that images an observation site in a patient. Yes.

  The light source device 12 supplies illumination light for illuminating the observation site to the electronic endoscope 11. The processor device 13 corresponds to an embodiment of the image processing device of the present invention, and image data (hereinafter referred to as a display image) of a display image to be displayed on the monitor 14 based on an imaging signal obtained by the electronic endoscope 11. Image data) and output to the monitor 14. The monitor 14 displays an observation image of the observation site based on the image data input from the processor device 13.

  The electronic endoscope 11 is connected to a flexible insertion portion 16 to be inserted into a patient's body and a proximal end portion of the insertion portion 16, and is used for gripping the electronic endoscope 11 and operating the insertion portion 16. An operation unit 17 and a universal cord 18 that connects the operation unit 17 to the light source device 12 and the processor device 13 are provided.

  The insertion portion distal end portion 16a, which is the distal end portion of the insertion portion 16, incorporates an observation optical system, a solid-state imaging device, and the like used for illumination of the observation portion and photographing. A bendable bending portion 16b is connected to the rear end of the insertion portion distal end portion 16a. A flexible tube portion 16c having flexibility is connected to the rear end of the curved portion 16b.

  The operation unit 17 is provided with an angle knob 21, an operation button 22, a forceps inlet 23, and the like. The angle knob 21 is rotated when adjusting the bending direction and the bending amount of the bending portion 16b. The operation button 22 is used for various operations such as air / water supply and suction. The forceps inlet 23 communicates with a forceps channel in the insertion portion 16.

  The universal cord 18 incorporates an air / water channel, a signal cable, a light guide, and the like. The distal end portion of the universal cord 18 is provided with a connector portion 25a connected to the light source device 12 and a connector portion 25b connected to the processor device 13. Thereby, illumination light is supplied from the light source device 12 to the electronic endoscope 11 via the connector portion 25a, and an imaging signal obtained by the electronic endoscope 11 via the connector portion 25b is processed by the processor device 13. Is input.

[Electric configuration of endoscope apparatus]
FIG. 2 is a block diagram showing an electrical configuration of the endoscope apparatus 10. As shown in FIG. 2, the light source device 12 includes a light source CPU 31, a light source 32, a light source driver 33, a diaphragm mechanism 34, and a condenser lens 35. The light source CPU 31 controls the light source driver 33 and the diaphragm mechanism 34. Further, the light source CPU 31 communicates with the processor CPU 61 of the processor device 13 to exchange various information.

  As the light source 32, a semiconductor light source such as an LED or an LD, a xenon lamp, or the like is used. The diaphragm mechanism 34 is disposed on the light emission side of the light source 32 and increases or decreases the amount of illumination light incident on the condenser lens 35 from the light source 32. The condensing lens 35 condenses the illumination light that has passed through the diaphragm mechanism 34 and guides it to the incident end of the light guide 40 in the connector portion 25 a connected to the light source device 12.

  The electronic endoscope 11 roughly includes a light guide 40, an illumination window 42, an observation window 43, an observation optical system 44, a solid-state imaging device 45, an endoscope CPU 47, a ROM 48, and an endoscope storage unit 49. Yes.

  For the light guide 40, a large-diameter optical fiber, a bundle fiber, or the like is used. The light guide 40 has an incident end inserted into the light source device 12 via the connector portion 25a, and an emission end opposed to an illumination window 42 provided in the insertion portion distal end portion 16a through the insertion portion 16. ing. The illumination light supplied from the light source device 12 to the light guide 40 is irradiated to the observation site through the illumination window 42. The illumination light reflected / scattered at the observation site enters the observation optical system 44 through the observation window 43.

  The observation optical system 44 is disposed on the back side of the observation window 43. The observation optical system 44 forms reflected light or scattered light of illumination light incident through the observation window 43, that is, an optical image of the observation site on the imaging surface of the solid-state imaging device 45.

  The solid-state imaging device 45 is a CMOS (complementary metal oxide semiconductor) type or CCD (charge coupled device) type imaging device, and is relatively positioned and fixed to the observation optical system 44 at a position farther from the observation optical system 44. ing. A plurality of pixels constituted by a plurality of photoelectric conversion elements PD (see FIG. 3) that photoelectrically convert an optical image are two-dimensionally arranged on the imaging surface of the solid-state imaging element 45. The solid-state imaging device 45 converts the optical image formed by the observation optical system 44 into an electrical imaging signal and outputs it to the processor device 13.

  When the solid-state image sensor 45 is a CMOS type, an A / D converter is built in, and a digital image signal is directly output from the solid-state image sensor 45 to the processor device 13. When the solid-state image sensor 45 is a CCD type, an image signal output from the solid-state image sensor 45 is converted into a digital image signal by an A / D converter (not shown) and then output to the processor device 13. Is done.

  The endoscope CPU 47 sequentially executes various programs and data read from the ROM 48 and the like, and mainly controls the driving of the solid-state image sensor 45. When the solid-state image sensor 45 is a CMOS type, the endoscope CPU 47 may be built in the solid-state image sensor 45.

  Further, the endoscope CPU 47 communicates with the processor CPU 61 of the processor device 13 to transmit information stored in the ROM 48 and the endoscope storage unit 49 to the processor device 13. The ROM 48 stores, for example, identification information for identifying the type of the electronic endoscope 11 as information transmitted to the processor device 13.

  The endoscope storage unit 49 corresponds to an embodiment of the storage unit of the present invention. In the endoscope storage unit 49, image cutout information 51 and magnification information 53, which will be described in detail later, are stored in advance as information transmitted to the processor device 13 when the electronic endoscope 11 is manufactured.

  The processor device 13 includes a processor CPU 61, a ROM 62, a digital signal processing circuit (DSP) 63, a processor storage unit 64, an image processing unit 65, and a display driver 66.

  The processor CPU 61 controls each unit of the processor device 13 by reading out necessary programs and data from the ROM 62 and sequentially processing them. The processor CPU 61 outputs the identification information transmitted from the endoscope CPU 47 to the DSP 63, and outputs the image cutout information 51 and the magnification information 53 to the image processing unit 65. Therefore, the processor CPU 61 corresponds to an embodiment of the information acquisition unit of the present invention.

  The DSP 63 performs various signal processing such as color interpolation, color separation, color balance adjustment, gamma correction, and image enhancement processing on the image signal for one frame input from the electronic endoscope 11 under the control of the processor CPU 61. Then, image data for one frame is generated. The DSP 63 performs various types of signal processing according to the type (model) of the electronic endoscope 11 based on the identification information input from the processor CPU 61. Then, the DSP 63 sequentially outputs the generated image data for each frame to the image processing unit 65.

  The processor storage unit 64 corresponds to an embodiment of the storage unit of the present invention. The processor storage unit 64 stores the image cutout information 51 and the magnification information 53 input from the processor CPU 61.

  The image processing unit 65 performs image clipping processing, image enlargement processing, masking on image data input from the DSP 63 based on the image clipping information 51 and the magnification information 53 acquired from the processor storage unit 64 under the control of the processor CPU 61. By performing the processing, display image data is generated. Then, the image processing unit 65 outputs the display image data to the display driver 66.

  The display driver 66 displays an observation image of the observation site on the monitor 14 based on the display image data input from the image processing unit 65.

[Image clipping information]
FIG. 3 shows an effective pixel area 150 (displayable pixel area 155) in an ideal state where the center of the effective pixel area 150 (displayable pixel area 155) of the solid-state imaging device 45 and the center of the observation optical system 44 coincide. ), The imaging area 160, and the display area 170 are explanatory diagrams for explaining the positional relationship. 4 shows the effective pixel area 150, the imaging area 160, and the display area 170 in a real state where the center of the effective pixel area 150 of the solid-state imaging device 45 and the center of the observation optical system 44 are shifted. It is explanatory drawing for demonstrating these positional relationships.

  As shown in FIG. 3, the effective pixel area 150 is a pixel area that is used as a signal obtained by actually imaging a pixel signal on the imaging surface of the solid-state imaging device 45, and is a rectangular pixel area in the present embodiment. .

  The effective pixel area 150 includes a displayable pixel area 155 that is an area used for image display on the monitor 14. Specifically, the displayable pixel area 155 is an area obtained by removing a portion used for image processing and the like from the effective pixel area 150 and a margin of several pixels. The displayable pixel area 155 of this embodiment is a rectangular pixel area, and the number of pixels in the vertical and horizontal directions is “2V” and “2H”. In the present embodiment, the position of the pixel area center CG, which is the center of the effective pixel area 150, and the position of the center of the displayable pixel area 155 are matched in order to prevent the drawing from becoming complicated. Therefore, the pixel area center CG corresponds to the center of the displayable pixel area 155. Note that the positions of the center of the effective pixel area 150 and the center of the displayable pixel area 155 may be shifted.

  The imaging area 160 is an area of an optical image formed on the imaging surface of the solid-state imaging device 45 by the observation optical system 44, and is a circular area in this embodiment.

The display area 170 is an observation site display area of an image displayed on the monitor 14 and subjected to mask processing described later. The display area 170 of this embodiment is a circular area, and the maximum number of pixels in the vertical and horizontal directions is “2L _V ” and “2L _H ” (2L _V = 2L _H ).

  In the present embodiment, the imaging area center CK, which is the center of the imaging area 160, and the display area center CH, which is the center of the display area 170, are made to coincide with each other as in Patent Document 1. For example, the image formation area center CK and the display area center CH can be matched by cutting out the display image data from the image data input from the DSP 63 with the image formation area center CK as a reference. Thereby, an observation image without a declination is obtained.

  The image cutout information 51 is information for specifying an image cutout region TR (see FIG. 5) for cutting out display image data corresponding to the display area 170 displayed on the monitor 14 from the image data output from the DSP 63. This image cutout information 51 is an overlapping area between the displayable pixel area 155 and the imaging area 160 and corresponds to the overlapping area when the imaging area center CK matches the display area center CH. This is information for specifying an image cutout region TR for cutting out image data.

  In the ideal state as shown in FIG. 3, the position of the pixel area center CG and the position of the imaging area center CK coincide with each other, so that the entire display area 170 is located within the displayable pixel area 155.

On the other hand, as shown in FIG. 4, since the mounting accuracy of the solid-state imaging device 45 and the observation optical system 44 is low in the actual state, a shift occurs between the pixel area center CG and the imaging area center CK. A symbol “D _V ” in the drawing indicates a vertical shift amount that is a vertical shift amount between the pixel area center CG and the imaging area center CK, and a symbol “D _H ” in the drawing indicates a pixel area center CG. The horizontal shift amount, which is the horizontal shift amount between the imaging area center CK and the horizontal axis, is shown.

  As the solid-state imaging device 45 and the observation optical system 44 of the electronic endoscope 11 are downsized, it is possible to secure a margin for the effective pixel area 150 with respect to the imaging area 160 and a margin for the imaging area 160 with respect to the display area 170. Can not. For this reason, in the actual state, even if the imaging area center CK and the display area center CH are matched, a part of the area overlapping the display area 170 in the imaging area 160 (displayed by hatching in the figure). Is located outside the displayable pixel area 155. As a result, a part of the optical image corresponding to the display area 170 is formed outside the displayable pixel area 155.

  FIG. 5 is an explanatory diagram for explaining the image cutout region TR and the image cutout information 51 in the real state. As shown in FIG. 5, the image cutout region TR is a maximum region having the same aspect ratio as the display area 170 with respect to the imaging area center CK in the image based on the image data 71 input from the DSP 63. Since the display area 170 of this embodiment is circular, the “area having the same aspect ratio” here is, for example, a square area.

  Here, the position corresponding to the center of the image cutout region TR, that is, the position corresponding to the imaging area center CK (the optical axis of the observation optical system 44) in the image based on the image data 71 is, for example, an electronic endoscope. 11, various test charts such as concentric patterns are imaged, and image data obtained by the imaging is analyzed. Further, the shape and size of the display area 170 are known. Therefore, the image cutout region TR can be determined based on the position of the imaging area center CK and the shape and size of the display area 170. Information indicating the position and size of the image cutout region TR is obtained in advance as image cutout information 51 when the electronic endoscope 11 is manufactured, and is stored in the endoscope storage unit 49. Accordingly, the display image data 73 corresponding to the image cutout region TR can be cut out from the image data 71 based on the image cutout information 51.

Further, as shown in FIG. 4, the image cutout information 51 of the present embodiment has a low mounting accuracy of the solid-state imaging device 45 and the like, and the display area when the imaging area center CK and the display area center CH are matched. This is information indicating the image cutout region TR when a part of 170 is located outside the displayable pixel area 155. That is, the image cutout information 51 is information indicating the image cutout region TR when at least one of the following formulas (1) and (2) is satisfied. Accordingly, the vertical and horizontal pixel numbers (image size) of the display image data 73 are smaller than the vertical and horizontal pixel numbers 2L _V and 2L _H of the display area 170.

[Magnification information]
FIG. 6 is an explanatory diagram for explaining the magnification information 53. As shown in FIG. 6, the magnification information 53 is information indicating the magnification m for enlarging the display image data 73 to the image size of the display area 170. As the magnification m, the higher magnification is selected from the magnifications m expressed by the following equations (3) and (4). Similarly to the image cutout information 51 described above, the magnification m is obtained in advance when the electronic endoscope 11 is manufactured, and is stored as the magnification information 53 in the endoscope storage unit 49. Thereby, display image data 73A obtained by enlarging the display image data 73 to the image size of the display area 170 based on the magnification information 53 is obtained.

  If neither of the above formulas (1) and (2) is satisfied, or if the magnification m is higher than 2 times the allowable magnification (when m> 2), the magnification m is m = 2. It is set to 1 and image enlargement is not performed. When neither of the above formulas (1) and (2) is satisfied, the entire display area 170 is located in the displayable pixel area 155 in a state where the imaging area center CK and the display area center CH are matched. This is because it is not necessary to enlarge the display image data 73 (see FIG. 3).

  Further, when the magnification m is higher than the allowable magnification “2 ×” (m> 2), the mounting accuracy of the solid-state imaging device 45 and the observation optical system 44 is remarkably lowered, and the pixel area center CG and the imaging area center are reduced. This is a case where the amount of deviation from CK becomes large. In this case, since the image size of the display image data 73 is reduced, in order to enlarge the display image data 73 to the image size of the display area 170, it is necessary to increase the magnification m. When the enlargement magnification of the image data 73 for use exceeds 2 times, the image quality deteriorates. Therefore, image magnification is performed when the magnification m is m ≦ 2, that is, when the magnification is less than the allowable magnification. Note that the allowable magnification is not limited to “2 ×”, and is appropriately determined according to the image size of the display area 170 and the like.

[Configuration of image processing unit]
FIG. 7 is a functional block diagram of the image processing unit 65. As illustrated in FIG. 7, the image processing unit 65 includes a frame memory 80, an image cutout unit 81, an image enlargement unit 82, and a mask processing unit 83.

  The frame memory 80 is a memory that temporarily stores image data 71 for each frame input from the DSP 63, and simultaneously stores image data 71 for a plurality of frames. The new image data 71 input from the DSP 63 is overwritten on the oldest image data 71 stored in the frame memory 80.

  The image cutout unit 81 reads out the newly recorded image data 71 from the frame memory 80, and based on the image cutout information 51 acquired from the processor storage unit 64 as shown in FIG. The image data 73 is cut out. The image cutout unit 81 outputs the cut display image data 73 to the image enlargement unit 82.

  As shown in FIG. 6, the image enlargement unit 82 electronically enlarges the display image data 73 input from the image cutout unit 81 at a magnification m based on the magnification information 53 acquired from the processor storage unit 64. Image data 73A is generated. The image enlargement unit 82 outputs the generated display image data 73A to the mask processing unit 83.

  FIG. 8 is an explanatory diagram for explaining the mask processing by the mask processing unit 83. As illustrated in FIG. 8, the mask processing unit 83 performs mask processing for masking the display image data 73 </ b> A in the same shape as the display area 170 based on the mask image data 86, and generates display image data 73 </ b> B. The mask image data 86 is a rectangular image having the same size as the display image data 73A. The mask image data 86 has an exposure part 86 a that exposes only the display area 170.

  In the mask process, while the display image data 73A is flowed pixel by pixel in the mask processing unit 83, the pixels corresponding to the display area 170 are output as they are based on the mask image data 86, and the pixels corresponding to the outside of the display area 170 are output. Is performed by discarding and outputting mask pixels instead. The mask pixel is a video signal corresponding to the color of the mask image. The mask processing unit 83 outputs the display image data 73B subjected to the mask process to the display driver 66. As a result, an observation image of the observation region based on the display image data 73B is displayed on the monitor 14 by the display driver 66.

[Image adjustment method of endoscope apparatus]
Next, an image adjustment method of the endoscope apparatus 10 having the above configuration will be described with reference to FIGS. 9 to 11. FIG. 9 is a flowchart showing a part of the manufacturing process of the electronic endoscope 11 and the flow of the storage process of the image cutout information 51 and the magnification information 53 used in the image processing according to the image adjustment method of the present invention. FIG. 10 is a flowchart showing a flow of display processing of an observation image including image processing according to the image adjustment method of the present invention. FIG. 11 is an explanatory diagram for explaining image processing according to the image adjustment method of the present invention.

<Storage process of image cutout information and magnification information>
As shown in FIG. 9, after the assembly of the imaging module including the observation optical system 44 and the solid-state imaging device 45 of the electronic endoscope 11 is completed (or after the assembly of the electronic endoscope 11 is completed), the test is performed with the imaging module. The chart is imaged (step S1). By analyzing the image data obtained by imaging the test chart, the position corresponding to the imaging area center CK in the image based on the image data 71, the vertical shift amount _DV and the horizontal shift amount _DH are obtained. (Step S2).

  Next, an image cutout region TR is determined based on the position corresponding to the imaging area center CK and the known shape and size of the display area 170, and image cutout information 51 indicating the image cutout region TR is stored in the endoscope storage unit. 49 (step S3).

Further, it is confirmed whether or not the vertical deviation amount _DV and the horizontal deviation amount _DH satisfy at least one of the above formulas (1) and (2) (step S4). The magnification m is determined as m = 1 (NO in step S4, step S5).

On the other hand, when the vertical direction deviation amount _DV and the horizontal direction deviation amount _DH satisfy at least one of the above formulas (1) and (2), the magnifications based on the above formulas (3) and (4), respectively. m is obtained (YES in step S4, step S6). Then, it is confirmed whether the higher magnification among the obtained magnifications m satisfies m ≦ 2 (step S7). If m ≦ 2 is satisfied, the higher magnification is determined as the magnification m (step S7). YES, step S8). Conversely, if m> 2, the magnification m is determined to be m = 1 (NO in step S7, step S5).

  Next, the determined magnification m is stored in the endoscope storage unit 49 as magnification information 53 (step S8). The storage process of the image cutout information 51 and the magnification information 53 corresponding to one aspect of the storage step of the present invention is thus completed.

<Display processing of observation image>
As shown in FIG. 10, the activation of the endoscope apparatus 10 is first started. Specifically, the connector portions 25a and 25b of the electronic endoscope 11 are connected to the light source device 12 and the processor device 13, respectively, and the power sources of the light source device 12 and the processor device 13 are turned on. As a result, the light source device 12 and the processor device 13 are activated, and the electronic endoscope 11 is activated by power supply from the light source device 12 or the like.

  When the electronic endoscope 11, the light source device 12, and the processor device 13 are activated, the endoscope CPU 47 sends the image cutout information 51 and the magnification information 53 stored in the endoscope storage unit 49 to the processor CPU 61. Send. Thereby, the processor CPU 61 can acquire the image cutout information 51 and the magnification information 53. The processor CPU 61 stores the acquired image cutout information 51 and magnification information 53 in the processor storage unit 64.

  Next, the image cutout unit 81 acquires the image cutout information 51 from the processor storage unit 64 (step S11), and the image enlargement unit 82 acquires the magnification information 53 from the processor storage unit 64 (step S12).

  Further, other necessary information is exchanged among the light source CPU 31, the endoscope CPU 47, and the processor CPU 61, and the activation of the endoscope apparatus 10 is completed.

  After the start-up of the endoscope apparatus 10 is completed, the insertion part 16 of the electronic endoscope 11 is inserted into the patient's body, and the observation site is imaged (step S13). The illumination light supplied from the light source device 12 is emitted from the illumination window 42 toward the observation site through the light guide 40. The illumination light reflected or scattered at the observation site is imaged on the imaging surface of the solid-state imaging device 45 as an optical image by the observation optical system 44 through the observation window 43. The solid-state imaging device 45 converts the optical image formed on the imaging surface into an imaging signal and outputs the imaging signal to the DSP 63 of the processor device 13.

  The DSP 63 performs various signal processing such as color interpolation, color separation, color balance adjustment, gamma correction, and image enhancement processing on the image signal for one frame input from the electronic endoscope 11, and the image for one frame. Data 71 is generated (step S14). The image data 71 is output from the DSP 63 to the image processing unit 65 and temporarily stored in the frame memory 80 of the image processing unit 65.

  Next, image processing corresponding to one form of the image processing step of the present invention is started by each unit of the image processing unit 65 on the image data 71 stored in the frame memory 80 (step S15). Specifically, an image cutout process (step S16), an image enlargement process (step S17), and a mask process (step S18) are sequentially performed on the image data 71.

  As shown in FIGS. 11A and 11B, the image cutout unit 81 reads the image data 71 from the frame memory 80, and based on the previously obtained image cutout information 51, the image cutout region TR from the image data 71 is obtained. An image cutout process for cutting out the display image data 73 corresponding to is performed. At this time, the image formation area center CK and the display area center CH can be matched by cutting out the display image data 73 from the image data 71 using the image formation area center CK as a reference. Thereby, an observation image without a declination is obtained. The display image data 73 is output from the image cutout unit 81 to the image enlargement unit 82.

  As shown in FIG. 11C, the image enlarging unit 82 performs an image enlarging process for electronically enlarging the display image data 73 input from the image clipping unit 81 at a magnification m based on the previously acquired magnification information 53. Do. Thereby, display image data 73A obtained by enlarging the display image data 73 to the image size of the display area 170 is obtained. The display image data 73A is output from the image enlargement unit 82 to the mask processing unit 83.

  As illustrated in FIG. 11D, the mask processing unit 83 performs mask processing on the display image data 73A to generate display image data 73B. The display image data 73B subjected to the mask processing is output from the mask processing unit 83 to the display driver 66.

  Returning to FIG. 10, the display driver 66 displays an observation image of the observation region on the monitor 14 based on the display image data 73 </ b> B input from the mask processing unit 83 (step S <b> 19). Thereafter, the above-described processing from step S13 to step S19 is repeatedly executed until imaging of the observation site is completed (step S20).

[Effect of the present invention]
In the endoscope apparatus 10 of the present invention, it corresponds to an overlapping area between the displayable pixel area 155 and the imaging area 160 and corresponds to an overlapping area when the imaging area center CK and the display area center CH are matched. Based on the image cutout area TR to be displayed, the display image data 73 is cut out from the image data 71, and the display image data 73 is enlarged to the image size of the display area 170 and displayed on the monitor 14. Accordingly, since the mounting accuracy of the solid-state imaging device 45 and the observation optical system 44 is low, even if a part of the portion corresponding to the display area 170 in the imaging area 160 is located outside the displayable pixel area 155, vignetting A good observed image is obtained.

  In the endoscope apparatus 10 of the present invention, the image cutout information 51 and the magnification information 53 are stored in advance in the endoscope storage unit 49 of the electronic endoscope 11. Accordingly, the display image data can be easily adjusted to the image size of the display area 170 simply by performing the image cutout process and the image enlargement process. In addition, the image processing unit 65 of the processor device 13 can execute image cutout processing and image enlargement processing corresponding to the mounting accuracy of the solid-state imaging device 45 and the like for each electronic endoscope 11.

  Further, in the endoscope apparatus 10 of the present invention, the image cutout region TR has the same aspect ratio as that of the display area 170. Therefore, even if the image data for display is enlarged, it is visually displayed on the monitor 14. The angle of view of the observed image is slightly narrowed, and an observation image without a sense of incongruity is obtained.

  Moreover, in the endoscope apparatus 10 of the present invention, when at least one of the above formulas (1) and (2) is satisfied, an image cutout process and an image enlargement process are performed. Thereby, when neither of the above formulas (1) and (2) is satisfied, that is, in a state where the imaging area center CK and the display area center CH are matched, the entire display area 170 can be displayed. These processes are prevented from being executed until there is no need to perform the image cut-out process and the image enlargement process that are located inside.

  Further, in the endoscope apparatus 10 of the present invention, image enlargement processing is performed when the higher magnification m among the magnifications m determined by the above formulas (3) and (4) satisfies m ≦ 2. As a result, when m> 2, that is, when the amount of deviation between the pixel area center CG and the imaging area center CK is large and the image size of the display image data 73 is small, the display image data 73 is displayed. Expansion to the image size of area 170 is prevented. Thereby, it is possible to prevent an observation image with poor image quality from being displayed.

[Other Embodiment 1 of Endoscopic Apparatus]
Next, another embodiment 1 of the endoscope apparatus of the present invention will be described with reference to FIGS. FIG. 12 is an explanatory diagram for explaining the positional relationship among the effective pixel area 150 (displayable pixel area 155), the imaging area 160, and the display area 170n in the endoscope apparatus according to another embodiment. FIG. 13 is an explanatory diagram for explaining image processing executed by the endoscope apparatus according to the first embodiment.

  In the endoscope apparatus 10 of the above embodiment, the display area 170 is formed in a circular shape, but the display area 170n is formed in a substantially rectangular shape as in the endoscope apparatus of another example shown in FIG. It may be. In addition, the endoscope apparatus of another Example is fundamentally the same structure as the endoscope apparatus 10 of the said embodiment except the point from which the shape of the display area 170n differs, Therefore The same components are denoted by the same reference numerals, and the description thereof is omitted.

  As shown in FIG. 13A, when the display area 170n has a substantially rectangular shape, the image cutout region TRn is displayed within the image based on the image data 71 described above with reference to the imaging area center CK. Is the largest rectangular area having the same aspect ratio. Then, image cutout information 51 indicating the image cutout region TRn is stored in the endoscope storage unit 49. Further, the magnification m is obtained in the same manner as in the above embodiment, and is stored in the endoscope storage unit 49 as magnification information 53.

  Thereafter, in the same manner as in the above embodiment, as shown in FIG. 13B, the image cutout unit 81 generates display image data 73n corresponding to the image cutout region TRn from the image data 71 based on the image cutout information 51. An image cutout process is performed. Then, as shown in FIG. 13C, the image enlargement unit 82 performs image enlargement processing for enlarging the display image data 73n at the magnification m based on the magnification information 53, and generates display image data 73An.

  Next, as shown in FIG. 13D, the mask processing unit 83 performs mask processing on the display image data 73An to generate display image data 73Bn, and outputs the display image data 73Bn to the display driver 66. As a result, an observation image of the observation region based on the display image data 73Bn is displayed on the monitor 14 by the display driver 66. Except for the point that the shape of the display area 170n is different, the configuration is basically the same as that of the endoscope apparatus 10 of the above-described embodiment, so that the same effect as that described in the above-described embodiment can be obtained.

[Other Embodiment 2 of Endoscopic Apparatus]
Next, another embodiment 2 of the endoscope apparatus of the present invention will be described with reference to FIGS. 14 and 15. FIG. 14 is an explanatory diagram for explaining the positional relationship among the effective pixel area 150 (displayable pixel area 155), the imaging area 160, and the display area 170p in the endoscope apparatus according to the second embodiment. FIG. 15 is an explanatory diagram for describing image processing executed by the endoscope apparatus according to the second embodiment.

  In the endoscope apparatus 10 of the above-described embodiment, the display area 170 is formed in a circular shape, but the display area 170p is formed in a substantially circular shape as in the endoscope apparatus of the second embodiment shown in FIG. May be. Note that the endoscope apparatus of the second embodiment is basically the same in configuration as the endoscope apparatus 10 of the above embodiment except that the display area 170p has a different shape. Components that are the same in function and configuration are denoted by the same reference numerals and description thereof is omitted.

  As shown in FIG. 15A, when the display area 170p has a substantially circular shape, the image cutout region TRp is displayed in the image based on the image data 71 described above with reference to the imaging area center CK. Is the largest rectangular area having the same aspect ratio. Then, image cutout information 51 indicating the image cutout region TRp is stored in the endoscope storage unit 49. Further, the magnification m is obtained in the same manner as in the above embodiment, and is stored in the endoscope storage unit 49 as magnification information 53.

  Thereafter, in the same manner as in the above embodiment, as shown in FIG. 15B, the image cutout unit 81 generates display image data 73p corresponding to the image cutout region TRp from the image data 71 based on the image cutout information 51. An image cutout process is performed. Then, as shown in FIG. 15C, the image enlargement unit 82 performs image enlargement processing for enlarging the display image data 73p at the magnification m based on the magnification information 53, and generates display image data 73Ap.

  Next, as shown in FIG. 15D, the mask processing unit 83 performs mask processing on the display image data 73Ap to generate display image data 73Bp, and outputs the display image data 73Bp to the display driver 66. As a result, an observation image of the observation region based on the display image data 73Bp is displayed on the monitor 14 by the display driver 66. Except for the point that the shape of the display area 170p is different, the configuration is basically the same as that of the endoscope apparatus 10 of the above-described embodiment, so that the same effect as that described in the above-described embodiment can be obtained.

  The shapes and sizes of the effective pixel area, the displayable pixel area, the imaging area, and the display area are not limited to the shapes and sizes shown in the above embodiments, and may be changed as appropriate. Also good.

[Other Embodiment 3 of Endoscopic Apparatus]
Next, another embodiment 3 of the endoscope apparatus of the present invention will be described with reference to FIG. FIG. 16 is a block diagram illustrating an electrical configuration of a main part of the processor device 13S of the endoscope apparatus according to the third embodiment. In the endoscope apparatus 10 of the above embodiment, the display area 170 has one type of pattern. However, in the endoscope apparatus of the other example 3, one display area can be selected from the display areas of a plurality of patterns. The display area can be switched.

  As illustrated in FIG. 16, the processor device 13S has basically the same configuration as the processor device 13 of the above embodiment except that a processor storage unit 64S, an image processing unit 65S, and a selection unit 200 are provided. The same functions and configurations as those of the above embodiment are denoted by the same reference numerals, and the description thereof is omitted.

  The processor storage unit 64S stores a plurality of patterns of display areas, image cutout information 51, magnification information 53, and mask image data 86 in association with each other. In other words, the image storage information 51, the magnification information 53, and the mask image data 86 corresponding to the display areas of a plurality of patterns are stored in the processor storage unit 64S. Note that these pieces of information may be stored in the endoscope storage unit 49 instead of being stored in the processor storage unit 64S, and the information may be acquired from the endoscope storage unit 49.

  The selection unit 200 is provided on the operation panel of the processor device 13S, for example, and is operated when the user selects or switches the display area. When the user performs a selection or switching operation of the display area using the selection unit 200, display area information indicating the selected display area is input from the processor CPU 61 to the image processing unit 65S.

  The image processing unit 65S includes a frame memory 80, an image cutout unit 81S, an image enlargement unit 82S, and a mask processing unit 83S.

  Based on the display area information input from the processor CPU 61, the image cutout unit 81S reads the image cutout information 51 corresponding to the display area selected by the selection unit 200 from the processor storage unit 64S. The image cutout unit 81S cuts out display image data from the image data 71 based on the image cutout information 51 acquired from the processor storage unit 64S, and outputs the display image data to the image enlargement unit 82S.

  Based on the display area information input from the processor CPU 61, the image enlargement unit 82S reads the magnification information 53 corresponding to the display area selected by the selection unit 200 from the processor storage unit 64S. Then, the image enlargement unit 82S electronically enlarges the display image data input from the image cutout unit 81S based on the magnification information 53 acquired from the processor storage unit 64S, and sends the display image data to the mask processing unit 83S. Output.

  Based on the display area information input from the processor CPU 61, the mask processing unit 83S reads mask image data 86 corresponding to the display area selected by the selection unit 200 from the processor storage unit 64S. Then, the mask processing unit 83S performs mask processing on the display image data input from the image enlargement unit 82S based on the mask image data 86 acquired from the processor storage unit 64S, and displays the display image data that has been subjected to mask processing. Is output to the display driver 66. As a result, an observation image of the observation region based on the display image data is displayed on the monitor 14.

  As described above, by storing the image cutout information 51 and the magnification information 53 corresponding to the display areas of a plurality of patterns in advance, even when the display area is selected or switched, a good observation image without vignetting is obtained. Is obtained. As a result, the same effects as those described in the above embodiment can be obtained.

[Example of application to capsule system]
Examples of the electronic endoscope constituting the endoscope apparatus of the present invention include a flexible endoscope, a rigid endoscope, an industrial endoscope, a capsule system (also referred to as a capsule endoscope), and the like. Hereinafter, a capsule system will be described as an example and will be described in detail with reference to the drawings.

  As shown in FIG. 17, the capsule system 501 includes an illumination system 512 and a camera including an optical system 514 and an image sensor 516. The image captured by the image sensor 516 is processed by the image processor 518. The image processor 518 is implemented by software executed by a digital signal processor (DSP) or a central processing unit (CPU), by hardware, or by a combination of both software and hardware. be able to. The processed image is compressed by an image compression subsystem 519 (in some embodiments, implemented in software executed by the DSP of the image processor 518). The compressed data is stored in the archive memory system 520. The capsule system 501 includes a battery power source 521 and an output port 526. The capsule system 501 can advance through the digestive tract (GI tract) 500 by peristalsis.

  The illumination system 512 can also be configured with LEDs. In FIG. 17, the LEDs are arranged close to the camera opening, but other arrangements are possible. A light source may be provided, for example, behind the opening. Other light sources such as laser diodes may be used. Alternatively, a white light source or a combination of two or more narrow wavelength band light sources may be used. It is also possible to use a white LED with a phosphorescent material that is excited by the light of the LED to emit long wavelength light. The white LED may include a blue LED or a purple LED. The predetermined portion of the capsule housing for allowing light to pass is made from a biologically compatible glass or polymer.

  The optical system 514 corresponds to an embodiment of the observation optical system of the present invention, and allows the image sensor 516 to read an image of the wall of the lumen of the GI tube 500 or the like, and includes a plurality of refractive lenses. It may include an element, a diffractive lens element, or a reflective lens element.

  The image sensor 516 converts the received light intensity into a corresponding electrical signal and can be provided by a charge coupled device (CCD) or complementary metal oxide semiconductor (CMOS) type device. The image sensor 516 may be monochromatic, or may include a color filter array that can capture a color image (eg, using RGB or CYM representations). This image sensor 516 corresponds to an embodiment of the solid-state imaging device of the present invention.

  The analog signal from the image sensor 516 is preferably converted to digital form so that it can be processed in digital form. Such a conversion is performed using an analog-to-digital (A / D) converter provided in the sensor (in this embodiment) or in another part of the capsule housing 510. An A / D unit can also be provided between the image sensor 516 and other parts of the system. The LEDs of the illumination system 512 are synchronized with the operation of the image sensor 516. One of the functions of the control module (not shown) of the capsule system 501 is to control the LED during an image capture operation.

  The endoscope storage unit 527 corresponds to one form of the storage unit of the present invention, and corresponds to the mounting accuracy of the optical system 514 and the image sensor 516, similarly to the endoscope storage unit 49 of the above embodiment. Image cutout information 51 and magnification information 53 are stored. The image cutout information 51 and the magnification information 53 stored in the endoscope storage unit 527 are transmitted to the processor device via the output port 526.

  FIG. 18 illustrates a swallowable capsule system 502 according to one embodiment of the present invention. The capsule system 502 can be configured substantially similar to the capsule system 501 of FIG. 17 except that the archive memory system 520 and the output port 526 are not required. The capsule system 502 also includes a communication protocol encoder 1320 and a transmitter 1326 used for wireless transmission. Of the elements of the capsule system 501 and the capsule system 502, substantially the same elements are given the same reference numerals. Therefore, their structure and function will not be described again here. The control module 522 performs overall control of the entire capsule system 502. The communication protocol encoder 1320 is implemented by software executed by a DSP or CPU, hardware, or a combination of software and hardware. The transmitter 1326 includes an antenna system for transmitting the captured digital image.

  A part of the ROM (not shown) of the control module 522 functions as the endoscope storage unit 528. The endoscope storage unit 528 corresponds to one form of the storage unit of the present invention, and corresponds to the mounting accuracy of the optical system 514 and the image sensor 516, similarly to the endoscope storage unit 49 of the above embodiment. Image cutout information 51 and magnification information 53 are stored. The image cutout information 51 and the magnification information 53 stored in the endoscope storage unit 528 are transmitted to the processor device via the transmitter 1326.

  The processor device corresponding to the capsule system 501 and the capsule system 502 has basically the same configuration as the processor device of the above embodiment except that the processor device corresponds to the capsule system. Cutout processing, image enlargement processing based on the magnification information 53, and the like are performed. Thereby, the effect similar to the effect demonstrated by the said embodiment is acquired.

[Others]
In the above embodiment, the processor CPU 61 corresponding to the information acquisition unit of the present invention acquires the image cutout information 51 and the magnification information 53 from the electronic endoscope 11, but is input by an operation unit (not shown) of the processor device 13. Alternatively, the image cutout information 51 and the magnification information 53 may be acquired, or the image cutout information 51 and the magnification information 53 may be acquired from a communication interface or a memory card.

  In addition, a plurality of types of image cutout information 51 and magnification information 53 corresponding to a plurality of types of electronic endoscope 11 are stored in advance in the processor storage unit 64, and electronic data input from the electronic endoscope 11 to the processor device 13 is stored. Based on the identification information of the endoscope 11 or the like, the image cutout information 51 and the magnification information 53 corresponding to the type of the electronic endoscope 11 may be selected.

  In the above embodiment, the light source device 12 and the processor device 13 are provided separately, but both may be provided integrally.

  It goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Endoscope apparatus, 11 ... Electronic endoscope, 13 ... Processor apparatus, 14 ... Monitor, 44 ... Observation optical system, 45 ... Solid-state image sensor, 47 ... Endoscope CPU, 49 ... Endoscope memory | storage part, 51 ... Image cutout information, 53 ... Magnification information, 61 ... Processor CPU, 64 ... Processor storage unit, 65 ... Image processing unit, 73 ... Display image data, 73A, 73B ... Display image data, 81 ... Image cutout unit, 82 ... Image enlargement unit, 83 ... Mask processing unit, 150 ... Effective pixel area, 155 ... Displayable pixel area, 160 ... Imaging area, 170 ... Display area

Claims (11)

An observation optical system;
A solid-state imaging device that is positioned and fixed relative to the observation optical system and forms an optical image by the observation optical system, and in which a plurality of photoelectric conversion elements that photoelectrically convert the optical image are arranged An image sensor;
A storage unit for storing image cutout information for specifying an image cutout region for cutting out a display image corresponding to a display area displayed on a monitor from an image generated based on an image pickup signal of the solid-state image pickup device;
An image processing unit that cuts out the display image from the image based on the image cutout information stored in the storage unit,
The storage unit is an overlapping region between the displayable pixel area of the solid-state imaging device and the imaging area of the optical image formed on the solid-state imaging device by the observation optical system as the image cut-out information. Storing information for specifying an image cut-out area for cutting out the display image corresponding to the overlap area when the center of the imaging area and the center of the display area are matched.
The endoscope apparatus that enlarges the cut-out display image to an image size of the display area. The storage unit further stores magnification information indicating a magnification for enlarging the display image to an image size of the display area,
The endoscope apparatus according to claim 1, wherein the image processing unit enlarges the display image according to the magnification information stored in the storage unit. In the storage unit, the image cutout information and the magnification information corresponding to each of the plurality of display areas are stored,
A selection unit for selecting the display area to be displayed on the monitor from a plurality of the display areas;
The image processing unit acquires the image cutout information and the magnification information corresponding to the display area selected by the selection unit from the storage unit, and based on the image cutout information, the image for display is obtained from the image. The endoscope apparatus according to claim 2, wherein the display image is enlarged in accordance with the magnification information.   The endoscope apparatus according to any one of claims 1 to 3, wherein the image cutout information stored in the storage unit is information indicating the image cutout area having the same aspect ratio as the display area. Vertical and horizontal 2V number of pixels of the displayable pixel area, and 2H, the number of pixels in the vertical direction and the horizontal direction of the display area and 2L _V, 2L _H, the binding and the center of the displayable pixel area When D _V and _DH represent the amount of deviation in the vertical and horizontal directions from the center of the image area in terms of the number of pixels,
The display image is enlarged by the image processing unit when the image cutout information is information indicating the image cutout region that satisfies at least one of the following formulas (1) and (2). The endoscope apparatus according to any one of 1 to 4.
V−L _V ≦ D _V (1)
H−L _H ≦ D _H (2) The image processing unit is configured to display the image with the higher magnification among the magnifications m respectively represented by the following formulas (3) and (4), where m is a magnification for enlarging the display image. The endoscope apparatus according to claim 5, wherein the image is enlarged.
m = L _V / (V−D _V ) (3)
m = L _H / (H−D _H ) (4)   The endoscope apparatus according to claim 6, wherein the display image is enlarged by the image processing unit when the higher magnification is equal to or less than an allowable magnification.   The endoscope apparatus according to any one of claims 1 to 7, wherein a mask process for masking the display image in the same shape as the display area is performed by the image processing unit. A solid-state imaging device that is positioned and fixed relative to an observation optical system and forms an optical image by the observation optical system, and in which a plurality of photoelectric conversion elements that photoelectrically convert the optical image are arranged In an image processing apparatus that generates a display image corresponding to a display area displayed on a monitor from an image generated based on an imaging signal of an element and outputs the display image to the monitor.
An information acquisition unit for acquiring the image cutout information from a storage unit for storing image cutout information for specifying an image cutout region for cutting out the display image from the image;
An image processing unit that cuts out the display image from the image based on the image cut-out information acquired by the information acquisition unit;
The information acquisition unit is an overlapping region between the displayable pixel area of the solid-state imaging device and the imaging area of the optical image formed on the solid-state imaging device by the observation optical system as the image cut-out information. Information for specifying an image cut-out area for cutting out the display image corresponding to the overlap area when the center of the imaging area and the center of the display area coincide with each other is acquired from the storage unit. ,
The image processing unit is an image processing device that enlarges the cut-out display image to an image size of the display area. An observation optical system and a solid-state imaging element that is positioned and fixed relative to the observation optical system and forms an optical image by the observation optical system, and a plurality of photoelectric conversion elements that photoelectrically convert the optical image And image cutout information for specifying an image cutout area for cutting out a display image corresponding to a display area displayed on a monitor from an image generated based on an image pickup signal of the solid state image pickup device and the solid state image pickup device. In an operating method of an endoscope apparatus comprising: a storage unit that stores data; and an image processing unit that extracts the display image from the image based on the image cutout information stored in the storage unit.
The storage unit is an overlapping area between a displayable pixel area of the solid-state imaging device and an imaging area of the optical image formed on the solid-state imaging device by the observation optical system as the image cut-out information. Storing information for specifying an image cut-out area for cutting out the display image corresponding to the overlap area when the center of the imaging area and the center of the display area are matched.
The operation method of the endoscope apparatus in which the image processing unit enlarges the cut-out display image to an image size of the display area. The storage unit further stores magnification information indicating a magnification for enlarging the display image to an image size of the display area,
The operation method of the endoscope apparatus according to claim 10, wherein the image processing unit enlarges the display image according to the magnification information stored in the storage unit.

Images