JP2012090785A - Electronic endoscope apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To freely set an area that is desired to be enlarged within a normal observation image according to an observing situation.SOLUTION: Using a processor having a touch panel, an operator designates a portion of the normal observation image which he/she desires to enlarge on a screen. More specifically, the operator designates the area N by performing a selecting operation and a dragging operation for two points (X1, Y1), (X2, Y2) along the diagonal of the area N that he/she desires to enlarge. An actual enlarged display area is set by setting the enlargement factor of either the length or width of the designated area N, and making the set enlargement factor coincide with the other enlargement factor. Based on the set enlarged display area, the enlarged image is displayed on a monitor.

Description

  The present invention relates to an electronic endoscope apparatus that captures an image of a subject such as an inner wall of an organ with a scope and displays an observation image on a monitor, and more particularly to an enlarged display process of an observation image.

  In the electronic endoscope apparatus, a part of an image obtained by photographing an inner wall of an organ or the like can be enlarged and displayed, and a specific partial region such as a lesioned part is enlarged and displayed as necessary. In particular, it is possible to display an area to be enlarged in the entire image with a frame, and to select and change the enlargement position using an input device such as a keyboard.

  For example, a method is known in which an entire image is displayed on an endoscope processor having a touch panel, and the enlargement position is easily changed by touch panel operation (see Patent Document 1). In this case, a frame defining an enlarged area is displayed on the touch panel screen together with the observation image displayed on the monitor, and the enlarged area is set and changed around the position where the operator touches the screen.

JP 2008-99874 A

  Since the position designated by the operator is set at the center of the enlarged display area and the enlargement ratio is constant, the display method is limited. In the enlarged display for diagnosing a lesion in detail, a work environment is required in which an operator can freely set a region desired to be enlarged.

  An electronic endoscope apparatus according to the present invention includes an image generation unit that generates an observation image based on an image signal read from an image sensor provided in a scope, and a display that displays the observation image on a screen provided in a processor. A processing means and an input means for designating a specific position in accordance with an operation of an operator (user) with respect to the observation image displayed on the screen. Then, the image generation means generates an enlarged image according to the set enlarged display area.

  In the present invention, an observation image is displayed on a screen provided in the processor separately from a display device such as a monitor that displays a normal observation image and an enlarged image captured by the scope, and the operator displays a screen related to the input means. An enlarged display area can be designated based on the image.

  And in this invention, the partial area | region expanded in a normal observation image is clearly and freely prescribed | regulated, when an operator designates two points | pieces required for area | region specification at the minimum. Since the enlarged image is displayed based on the area designated by the operator, the position and size of the area to be enlarged can be set in detail and freely. Further, by enlarging and reducing the size of the display area to be designated, it becomes possible to display an enlarged image at an enlargement rate preferred by the operator.

  As the input means, for example, a touch panel that can input an enlarged display area on the screen is preferably provided. By arranging the touch panel on the screen, the operator can specify the enlarged display area by touching a specific position on the screen where the observation image is displayed.

  On the other hand, if the enlarged display area specified by the operator is an area that is far away from the resolution and aspect ratio of the image sensor, variations in the enlargement ratio in the vertical and horizontal directions occur, and an enlarged image that does not undergo resolution conversion is generated. End up. In order to prevent this, the enlarged display area setting means determines the vertical and horizontal enlargement ratios of the input prescribed area defined by the operator's input operation as the enlargement ratio of the entire enlarged display area, and according to the resolution and aspect ratio of the image sensor. It is desirable to set an enlarged display area.

  Considering that the extreme resolution conversion affects the image quality, the enlarged display area setting means may determine the smaller one of the vertical and horizontal dimensions of the input defining area as the enlargement ratio of the entire enlarged display area.

  The resolution and aspect ratio of the image sensor differ depending on the scope. Therefore, it is preferable that the processor includes a detecting unit that detects the aspect ratio of the image sensor and detects the aspect ratio information according to the scope connection.

  The endoscope processor according to the present invention includes a screen capable of displaying an observation image generated based on an image signal read from an image sensor provided in a scope, and an observation image displayed on the screen according to an operator's operation. An input means for designating a specific position, an enlarged display area setting means for setting an enlarged display area in accordance with at least two designated positions, and an enlarged display process for generating an enlarged image according to the set enlarged display area Means.

  As described above, according to the present invention, it is possible to freely set a region to be enlarged in the normal observation image according to the observation state.

It is a block diagram of the electronic endoscope apparatus which is this embodiment. It is the figure which showed the screen displayed on a touchscreen screen at the time of an enlarged display. It is the figure which showed the screen displayed after an enlarged display area selection. It is the flowchart which showed the enlarged display input setting process and the enlarged display process. It is a subroutine of the enlarged display area setting process shown in FIG.

  Hereinafter, the electronic endoscope apparatus according to the present embodiment will be described with reference to the drawings.

  FIG. 1 is a block diagram of an electronic endoscope apparatus according to this embodiment.

  The electronic endoscope apparatus includes a video scope 10 whose insertion portion is inserted into the body, and a processor 30, and the video scope 10 is detachably connected to the processor 30. A monitor 20 and a keyboard 50 are connected to the processor 30.

  The processor 30 includes a lamp 32 that is turned on by a lamp power source 33. Illumination light emitted from the lamp 32 is incident on a light guide (not shown) provided in the video scope 10, and passes through the light guide. Irradiation from the distal end portion 10T toward the subject (observation target).

  The illumination light reflected by the subject passes through an objective lens (not shown) provided at the scope tip 10T, whereby a subject image is formed on the light receiving surface of a CCD (imaging device) 14. In the CCD 14, an image signal for one frame / field is read from the CCD 14 at a predetermined time interval (for example, 1/30, 1/60 second interval) and sent to the preceding signal processing circuit 12.

  The CCD 14 is provided with a complementary color filter in which color elements composed of Cy, Ye, G, and Mg are arranged in a mosaic pattern, and image signals for one frame / field are sequentially read according to a pixel mixture reading method. The pre-stage signal processing circuit 12 performs signal processing such as white balance processing and gamma correction processing on the image signal. As a result, R, G, and B image signals are generated and sent to the video signal processing circuit 38 via the enlargement processing circuit 36 of the processor 30.

  In the video signal processing circuit 38, edge enhancement processing, superimposition processing, and the like are performed on the image signal. The image signal subjected to the image processing is output to the monitor 20. Thereby, the observation image is displayed on the screen 20M of the monitor 20 as a real-time moving image.

  As the observation mode, a normal observation mode in which a normal observation image captured by the scope 10 is displayed as it is and an observation mode in which a part of the normal observation image is enlarged and an enlarged image is displayed are selectively switched. A touch panel 44 is provided on the side surface of the processor 30, and the normal observation image display / enlarged image display is switched by the operator performing an input operation on the screen 44 </ b> S of the touch panel 44.

  As will be described later, the operator can arbitrarily set an area to be enlarged in the observation image. When an area to be enlarged is designated on the screen 44S, an enlarged image obtained by enlarging the designated area is displayed on the monitor. Is done. In the case of enlargement display, the enlargement processing circuit 36 performs enlargement image signal processing on the R, G, B image signals output from the scope 10 using interpolation processing or the like.

  The system control circuit 40 including the CPU 40A, the RAM 40B, the ROM 40C, etc. controls the operation of the processor 30 and outputs control signals to the lamp control unit 33, the enlargement processing circuit 36, the video signal processing circuit 38, etc. that drive the lamp 32. The system control circuit 40 detects an input operation on the touch panel 44 and controls screen display. A program related to the operation control of the processor is stored in the RAM 40B in advance.

  The timing control circuit 42 outputs a clock pulse signal to each circuit such as the video signal processing circuit 38 and adjusts the signal processing timing. The diaphragm 34 adjusts the amount of illumination light incident on the light guide, and the opening / closing control of the diaphragm 34 is performed at predetermined time intervals so that the brightness of the subject image is constant. A control signal to the diaphragm 34 is output from the system control circuit 40 via the peripheral control circuit 35.

  The scope CPU 13 provided in the scope 10 controls the operation of the scope 10 and communicates with the system control circuit 40 of the processor 30. The EEPROM 15 of the scope 10 stores data related to the scope 10 including the resolution and aspect ratio of the CCD 14. When the scope 10 is connected to the processor 30, the data is transmitted to the processor 30.

  FIG. 2 is a diagram showing a screen displayed on the touch panel screen in the enlarged display. FIG. 3 is a diagram showing a screen displayed after the enlarged display area is selected. The setting of the enlarged display area will be described with reference to FIGS.

  At the time of enlarged display, the screen 44S switches to a display state in which an operator designates an enlarged display area. As shown in FIG. 2, the image IM of the monitor 20 is displayed on the left side of the screen 44 </ b> S, and the observation image IS is displayed inside the screen frame IG similarly to the monitor 20. The size and aspect ratio of the observation image IS follow the resolution and aspect ratio of the CCD 14 of the scope 10. A series of icons A1 to A4 representing operation buttons are displayed on the right side of the screen 44S.

  The operator designates an area (for example, an area including a lesion) to be enlarged and displayed in the observation image IS on the screen 44S. Here, as the designation method, a two-point click method and a drag method can be selected, and the operator touches the icons A1 and A2 to select one of them.

  In the case of the two-point method, the position of two points on the diagonal line of the region desired to be enlarged is designated by the operator. When the operator determines a region N (horizontal width MX, vertical width MY, hereinafter referred to as a designated region) to be enlarged in the normal image, the operator is positioned at the positions of the first point X1 and the second point X2 on the diagonal line. Touch your finger. On the other hand, in the case of the drag method, the operator traces the diagonal line with his / her finger when determining an area to be enlarged.

  The touch panel 44 detects the designated first and second points, or the positions of the start point and end point, thereby confirming the designated area N that the operator desires to enlarge. The X and Y coordinates are defined in the horizontal and vertical directions with the right corner of the screen frame IG as the origin, and the coordinates of the designated position are calculated in units of one pixel in the screen frame IG.

  Then, the enlarged image region P is determined based on the region N designated by the operator (see FIG. 3). Here, the enlarged image region P is determined in accordance with the resolution and aspect ratio of the normal observation image IS. The image portion MG of the enlarged image region P is displayed on the screen 44S. However, the partial image may be displayed at the center position of the screen.

  When the icon A3 is pressed, an enlarged image obtained by enlarging the image portion MG of the enlarged image region P is displayed on the entire monitor 20. When changing the enlarged image area P, the operator presses the icon A4 and performs an input operation for designating a new enlarged area on the screen 44S.

  FIG. 4 is a flowchart showing an enlarged display input setting process and an enlarged display process. FIG. 5 is a subroutine of the enlarged display area setting process shown in FIG. Starts when the enlarged display mode is set.

  When the icon A3 is pressed for changing the enlarged display area (S101), the display area can be set (S102). When the drag method is selected, when the operator performs a drag operation, the position coordinates of the start point and end point are detected (S102 to S104). On the other hand, when the two-point method is selected, the position coordinates of the first and second points are detected according to the input operation (S102, S106 to S109). Then, an enlarged display area is set based on the designated area in accordance with the input operation of the operator (S110).

  The enlarged display area setting will be described with reference to FIG. 5. First, the resolution and aspect ratio data of the CCD 14 provided in the scope 10 is read from the RAM 40B stored when the scope is connected (S201). Then, based on the position coordinates (X1, X2) and (Y1, Y2) of the first and second points, or the start and end points, the horizontal width (| X1-X2 |) of the area N designated by the operator is vertical. It is determined whether or not it is longer than the direction width (| Y1-Y2 |) (S202).

  When the horizontal width is larger than the vertical width, first, the horizontal enlargement ratio is calculated (S203). The enlargement ratio is obtained based on the ratio between the horizontal length of the normal observation image and the horizontal width of the designated region N. The horizontal length of the observation image is calculated based on the CCD resolution and the aspect ratio.

  When the horizontal enlargement factor is obtained, the vertical enlargement factor is made to coincide with the horizontal enlargement factor (S204). An enlarged display area is set based on the determined enlargement ratio (S207). The size and aspect ratio of the enlarged display area coincide with the size and aspect ratio of the normal observation image.

  On the other hand, if the vertical width is long in S202, the vertical enlargement ratio is calculated (S205). Then, the horizontal enlargement factor is set to the vertical enlargement factor (S206). Thereby, an enlarged display area having the same aspect ratio as that of the normal observation image is set (S207). When the enlarged display area is set, as shown in FIG. 3, a partial image P corresponding to the enlarged display area is displayed on the monitor image IM of the screen 44S (S111).

  When the operator touches the icon A3, an enlarged display process is executed (S113). That is, an enlarged image obtained by enlarging the image portion of the enlarged display area N is displayed on the monitor 20. The enlargement processing circuit 36 extracts an image portion of the image display region N based on the position information of the enlargement display region, and performs an interpolation process on the image signal of the image portion.

  Further, when the operator operates the icon A4 to change the position of the enlarged display area, the screen is switched again to the enlarged display area setting screen shown in FIG. 2, and a new enlarged display area is set according to the input operation of the operator. S101 to S113 are executed until the enlarged display mode is changed (S114).

  As described above, according to the present embodiment, in the processor including the touch panel 44, it is possible to designate a portion to be enlarged in the normal observation image on the screen 44S, and two points along the diagonal line of the region N. The region N is designated by selecting (X1, Y1), (X2, Y2) or by dragging along two points on the diagonal line.

  Then, one enlargement factor of the designated area N is set, and the set enlargement factor is made to coincide with the other enlargement factor. Thereby, the actual enlarged display area P is set. A partial image MG based on the set enlarged display area P is displayed on the screen 44S, and an enlarged image obtained by enlarging the partial image MG according to the operation of the operator is displayed on the monitor 20.

  Since the operator can arbitrarily set a region to be enlarged in the normal observation image, the position and magnification rate of the enlarged region can be freely adjusted and changed, and an enlarged image effective for diagnosis can be displayed. In particular, since the portion to be enlarged on the screen of the processor can be arbitrarily set, a necessary portion in the observation image can be enlarged and displayed according to work and observation conditions such as a change in the position of a lesion.

  On the other hand, the enlargement ratio is set by making the aspect ratio of the designated area correspond to the aspect ratio of the CCD and the enlarged display area is determined, so that an enlarged image subjected to appropriate resolution conversion is displayed. Although the resolution and aspect ratio of the CCD differ depending on the connected scope, it is possible to set an appropriate enlarged display area by actually detecting the resolution and aspect ratio of the CCD.

  In addition, since the enlarged display area is set based on the width with a small enlargement ratio for the specified area, the image does not protrude from the screen during enlarged display, and an enlarged image is displayed in accordance with the monitor screen size and normal observation image. Can be displayed.

  For the input operation of the designated area, other designation methods such as designating the four corners of the area instead of the two points on the diagonal line can be applied. Further, an input device other than the touch panel and a pointing device may be applied. The enlarged display area does not need to be completely coincident with the normal observation image, and may be determined so as to satisfy both the CCD resolution, the aspect ratio, and the area designated by the operator.

10 Video scope 14 CCD
20 monitor 30 processor 36 enlargement processing circuit 40 system control circuit 44 touch panel

Claims (6)

Image generating means for generating an observation image based on an image signal read from an image sensor provided in the scope;
Display processing means for displaying the observation image on a screen provided in the processor;
Input means for designating a specific position according to an operator's operation for the observation image displayed on the screen;
An enlarged display area setting means for setting an enlarged display area according to at least two designated positions;
An endoscope apparatus, wherein the image generation means generates an enlarged image according to a set enlarged display area.   2. The enlarged display area setting means sets an enlarged display area by setting an enlargement ratio of one of the vertical and horizontal directions of an input defining area defined by an input operation by an operator as an enlargement ratio of the entire enlarged display area. The endoscope apparatus described in 1.   The endoscope apparatus according to any one of claims 1 to 2, wherein the enlarged display area setting means determines the smaller one of the vertical and horizontal directions of the input defining area as the enlargement ratio of the entire enlarged display area. .   The endoscope apparatus according to any one of claims 2 to 3, wherein the enlarged display area setting unit sets the enlarged display area based on the detected aspect ratio of the imaging element.   The endoscope apparatus according to claim 1, wherein the input unit includes a touch panel. A screen capable of displaying an observation image generated based on an image signal read from an image sensor provided in the scope;
Input means for designating a specific position according to an operator's operation for the observation image displayed on the screen;
An enlarged display area setting means for setting an enlarged display area according to at least two designated positions;
An endoscope processor comprising: enlarged display processing means for generating an enlarged image according to a set enlarged display area.

Images