JPWO2012033200A1 - Imaging device - Google Patents

Abstract

The endoscope system according to the present invention includes a CMOS image sensor 80 capable of outputting, as pixel information, an electrical signal after photoelectric conversion from a pixel arbitrarily designated as a readout target among a plurality of pixels for imaging, and CMOS imaging. A read address setting unit 53 that can arbitrarily set a pixel to be read in the element 80, a timing generator 34 that reads out pixel information from a pixel designated as a read target in the CMOS image sensor 80, and An AFE unit 36, an image processing unit 42, and a display unit 71 for displaying an image are provided.

Description

  Conventionally, in the medical field, an endoscope system has been used when observing the inside of an organ of a subject. In an endoscope system, generally, a flexible insertion part having an elongated shape is inserted into a body cavity of a subject such as a patient, and white light is irradiated to a living tissue in the body cavity through the insertion part. Then, the reflected light is received by the imaging unit at the distal end of the insertion unit, and an in-vivo image is captured. The living body image thus captured is displayed on the monitor of the endoscope system. A user such as a doctor observes the body cavity of a subject through an in-vivo image displayed on a monitor of an endoscope system.

  In such an endoscope system, an image pickup device is built in the distal end of the insertion portion, and the image pickup device transmits an electric signal after photoelectric conversion to a signal processing device as an image signal, and the transmission signal is processed in the signal processing device. By doing so, the image picked up by the image pickup device is displayed on the monitor to observe inside the body. The image pickup device at the tip of the insertion portion and the signal processing device are connected by a collective cable in which a plurality of signal lines are bundled for image signal transmission, clock signal transmission, drive power supply to the image pickup device, and the like. (For example, see Patent Document 1).

Japanese Patent No. 3863583

  Here, in order to increase the definition of the in-vivo image, a CMOS sensor capable of increasing the number of pixels is employed as an image sensor built in the distal end of the insertion portion. However, when high-definition images are advanced by adopting a CMOS sensor, there is a problem that the amount of image data increases and smooth processing cannot be performed.

  The present invention has been made in view of the above, and it is an object of the present invention to provide an imaging apparatus capable of performing efficient processing while accommodating high pixels when a CMOS sensor is employed as an imaging element. And

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention uses, as pixel information, an electrical signal after photoelectric conversion from a pixel arbitrarily designated as a reading target among a plurality of pixels for imaging. Pixel information is obtained from an imaging unit that can output, a setting unit that can arbitrarily set a pixel to be read in the imaging unit, and a pixel that is designated as a reading target in the imaging unit according to the setting of the setting unit A reading unit that reads out pixel information by outputting, an image processing unit that generates an image from the pixel information read out by the reading unit, and a display unit that displays an image generated by the image processing unit It is characterized by.

  The imaging apparatus according to the present invention further includes a control unit that changes a pixel to be read set by the setting unit.

  In the imaging apparatus according to the present invention, the control unit changes a pixel to be read set by the setting unit according to an optical system in the imaging unit.

  The imaging apparatus according to the present invention further includes a detection unit that detects an imaging region having a luminance of a predetermined value or more based on pixel information of pixels of the predetermined line read by the reading unit, and the control unit includes: The pixel to be read set by the setting unit is changed based on a detection result by the detection unit.

  Further, in the imaging apparatus according to the present invention, the control unit sets the next line of the predetermined line read by the reading unit or the same line corresponding to the next frame based on the detection result by the detection unit. On the other hand, the pixel to be read set by the setting unit is changed.

  In the imaging apparatus according to the present invention, the display unit displays an image in a predetermined shape obtained by cutting a predetermined part from the image, and the control unit displays the pixel to be read set by the setting unit as the display The pixel is changed to a pixel located in a pixel region corresponding to a predetermined shape of an image displayed by the unit.

  In the imaging apparatus according to the present invention, a plurality of the predetermined shapes are set, and the control unit includes display shape information indicating a predetermined shape of an image displayed by the display unit among the plurality of predetermined shapes. The readout unit has in advance position information of a plurality of pixel regions respectively corresponding to the plurality of predetermined shapes, and the pixel region corresponding to the predetermined shape indicated by the display shape information output from the control unit The pixel information of the pixel located is read out.

  The imaging apparatus according to the present invention further includes a reading speed changing unit that changes a reading speed of the pixel information by the reading unit, and the control unit changes the speed changing pixel to be read by the setting unit. The section is changed according to the read speed changed.

  In addition, the imaging apparatus according to the present invention further includes a transmission unit that wire-transmits the electrical signal output from the imaging unit in a predetermined signal format, and the control unit includes pixel information per unit time in the transmission unit. The pixel to be read set by the setting unit is changed so that the transmission amount does not exceed a predetermined standard transmission amount.

  In the imaging device according to the present invention, when the control unit changes the reading speed from the first reading speed to the second reading speed higher than the first reading speed by the speed changing unit, The readout target pixel set by the setting unit is changed to a remaining pixel obtained by thinning out all the pixels of the imaging unit.

  In addition, the imaging apparatus according to the present invention further includes a motion amount detection unit that detects a relative motion amount of the imaging unit with respect to a subject image, and the speed changing unit determines the motion amount detected by the motion amount detection unit. The reading speed is changed accordingly.

  In addition, an imaging apparatus according to the present invention includes: a functional unit that can be freely moved forward and backward in an imaging region in the imaging unit; and a functional unit detection unit that detects whether the functional unit is located in the imaging region. In addition, the speed changing unit may change the reading speed according to a detection result of the function unit detecting unit.

  The imaging apparatus according to the present invention further includes a mode setting unit capable of setting an enlargement mode in which an image displayed on the display unit is partially enlarged and displayed, and the speed changing unit includes the mode setting. The reading speed is changed in accordance with the setting of the enlargement mode by the unit.

  Further, in the imaging apparatus according to the present invention, the control unit causes the setting unit to set the remaining pixels obtained by thinning out the pixels at a predetermined interval among all the pixels of the imaging unit as a first readout target pixel, Pixels located in a partial region of the entire pixel region of the imaging unit are set as second readout target pixels, and the readout unit includes pixel information of the first readout target pixel and the second readout Alternately reading out pixel information of the target pixel, and the image processing unit includes an image corresponding to the pixel information of the first target pixel read out before and after the pixel information read out by the reading unit, and One image is generated by combining the image corresponding to the pixel information of the second pixel to be read out.

  In addition, the imaging apparatus according to the present invention further includes a detection unit that detects an imaging region having a luminance equal to or higher than a predetermined value in the image based on pixel information corresponding to the one image read by the reading unit. The control unit causes the setting unit to set a pixel located in a bright region detected by the detection unit as the second readout target pixel.

  The imaging apparatus according to the present invention sets a pixel to be read by the imaging unit, reads pixel information from only the set pixel, and transmits the pixel information. Therefore, the pixel to be read is changed according to various conditions, and the image data By adjusting the data amount, it is possible to perform efficient processing corresponding to the increase in the number of pixels.

FIG. 1 is a diagram illustrating a schematic configuration of an endoscope system according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration of the endoscope system according to the first embodiment. FIG. 3 is a diagram showing an example of an imaging circle that forms an image on the CMOS sensor shown in FIG. FIG. 4 is a flowchart showing a processing procedure of in-vivo image display processing of the endoscope system shown in FIG. FIG. 5 is a timing chart for explaining the brightness detection process and the read address setting process. FIG. 6 is a timing chart for explaining another example of the read address setting process. FIG. 7 is a diagram illustrating a schematic configuration of the endoscope main body according to the first modification of the first embodiment. FIG. 8 is a cross-sectional view for explaining the outline of the internal configuration of the distal end portion of the endoscope main body shown in FIG. FIG. 9 is a block diagram illustrating a configuration of the endoscope system 100 according to the first modification of the first embodiment. FIG. 10 is a diagram illustrating an example of a display screen of the display unit illustrated in FIG. FIG. 11 is a block diagram illustrating an example of the configuration of the endoscope system according to the first modification of the first embodiment. FIG. 12 is a block diagram of a configuration of the endoscope system according to the second embodiment. FIG. 13 is a diagram for explaining the setting of pixels to be read by the read address setting unit shown in FIG. FIG. 14 is a timing chart for explaining an image signal transmitted in the endoscope system shown in FIG. FIG. 15 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system shown in FIG. FIG. 16 is a diagram for explaining the thinning readout setting process shown in FIG. FIG. 17 is a diagram for explaining another example of the thinning readout setting process shown in FIG. FIG. 18 is a block diagram illustrating a configuration of an endoscope system according to the first modification of the second embodiment. FIG. 19 is a diagram illustrating the detection process of the motion detection unit illustrated in FIG. FIG. 20 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system shown in FIG. FIG. 21 is a block diagram illustrating a configuration of an endoscope system according to the second modification of the second embodiment. FIG. 22 is a view for explaining the treatment tool expression from the distal end of the endoscope. FIG. 23 is a diagram showing an example of a display screen of the display unit shown in FIG. FIG. 24 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system shown in FIG. FIG. 25 is a block diagram illustrating a configuration of an endoscope system according to the third modification of the second embodiment. FIG. 26 is a diagram illustrating the treatment instrument insertion detection unit illustrated in FIG. FIG. 27 is a flowchart showing a processing procedure of in-vivo image display processing of the endoscope system shown in FIG. FIG. 28 is a block diagram of a configuration of the endoscope system according to the third embodiment. FIG. 29 is a diagram for explaining the setting process of the read address setting unit shown in FIG. FIG. 30 is a diagram illustrating an image generated by the image processing unit illustrated in FIG. FIG. 31 is a diagram illustrating an image generated by the image processing unit illustrated in FIG. FIG. 32 is a timing chart for explaining an image signal transmitted in the endoscope system shown in FIG. FIG. 33 is a flowchart showing a processing procedure of in-vivo image display processing of the endoscope system shown in FIG. FIG. 34 is a block diagram of a configuration of the endoscope system according to the fourth embodiment. FIG. 35 is a diagram for explaining setting processing by the read address setting unit shown in FIG. FIG. 36 is a diagram for explaining image composition processing by the composition unit shown in FIG. 34. FIG. 37 is a flowchart showing a processing procedure of in-vivo image display processing of the endoscope system shown in FIG. FIG. 38 is a view for explaining image composition processing by the composition unit shown in FIG. FIG. 39 is a block diagram illustrating a configuration of an endoscope system according to the first modification of the fourth embodiment. FIG. 40 is a diagram illustrating a surgical procedure. 41 is a diagram showing an example of the display screen of the display unit shown in FIG. FIG. 42 is a diagram showing an example of the display screen of the display unit shown in FIG. FIG. 43 is a diagram for explaining the brightness detection processing of the brightness detection unit shown in FIG. FIG. 44 is a diagram for explaining setting processing by the read address setting unit shown in FIG. FIG. 45 is a diagram for explaining another example of setting processing by the read address setting unit shown in FIG. FIG. 46 is a block diagram showing another configuration of the endoscope system according to the embodiment of the present invention. FIG. 47 is a block diagram showing another configuration of the endoscope system according to the embodiment of the present invention. FIG. 48 is a block diagram showing another configuration of the endoscope system according to the embodiment of the present invention.

  Hereinafter, as an embodiment according to the present invention, a medical endoscope system that includes an imaging element at the distal end of an insertion portion and captures and displays an image of a body cavity of a subject such as a patient will be described. Note that the present invention is not limited to the embodiments. In the description of the drawings, the same parts are denoted by the same reference numerals. The drawings are schematic, and it is necessary to note that the relationship between the thickness and width of each member, the ratio of each member, and the like are different from the actual ones. Also in the drawings, there are included portions having different dimensional relationships and ratios.

(Embodiment 1)
First, the endoscope system according to Embodiment 1 will be described. FIG. 1 is a diagram illustrating a schematic configuration of the endoscope system according to the first embodiment. As shown in FIG. 1, an endoscope system 101 according to the present embodiment is an elongated insertion having an objective lens (not shown) on which a subject image obtained by insertion into a body cavity or a duct is formed. Unit 102, light source device 60 that supplies irradiation light to insertion unit 102, and camera head unit that detachably attaches to the base end of insertion unit 102 and images a subject image formed on the objective lens of insertion unit 102 105, a control device 40 that processes an electrical signal output by imaging of the camera head unit 105 into an image signal so that it can be displayed on a monitor, and a display unit that is a peripheral device on which a video signal converted by the control device 40 is displayed 71.

  The camera head part 105 is detachably attached to the eyepiece part 111 at the base end part of the insertion part 102. The camera head unit 105 is connected to the control device 40 by a collective cable 131 having a plurality of signal lines. A connector 123 detachably attached to the control device 40 is provided at the end of the collective cable 131.

  Inside the camera head unit 105, a CMOS image sensor 80 that captures a subject image formed on an objective lens (not shown) of the insertion unit 102 is provided. The CMOS image sensor 80 outputs an electrical signal of the subject image subjected to photoelectric conversion to the control device 40 via the signal line of the collective cable 131.

  The control device 40 is a device that supplies power to the image sensor and receives an electrical signal photoelectrically converted from the image sensor. The controller 40 processes the electrical signal imaged by the CMOS image sensor 80 and connects it via the connection line 132. In addition to displaying an image on the connected display unit 71, a drive signal for controlling and driving the gain adjustment of the image sensor and the like is output. The light source device 60 includes a white light source, a special light source, and the like, and is connected with light from the white light source or the special light source via a light guide connector under the control of the control device 40 connected via the signal line 133. It is supplied to the camera head unit 105 as illumination light.

  Next, the configuration of the endoscope system according to the first embodiment will be described. FIG. 2 is a block diagram illustrating a configuration of the endoscope system according to the first embodiment. As shown in FIG. 2, the endoscope system 101 according to the first embodiment is connected to a CMOS image sensor 80 provided in the camera head unit 105 via a collective cable 131 having a plurality of signal lines. A light source device 60 for supplying white light or special light, a display unit 71 for displaying an in-vivo image captured by the CMOS image sensor 80, an output unit 73 for outputting information relating to in-vivo observation, and various instruction information required for in-vivo observation Input unit 72 and a storage unit 74 for storing in-vivo images and the like.

  The camera head unit 105 is provided with a CMOS image sensor 80. The CMOS image sensor 80 includes an AFE (Analog Front End) unit 36 including a light receiving unit 28, a control circuit 35, a timing generator 34, a noise removing unit 37, and an A / D conversion unit 38, and an input digital signal. The P / S converter 39 converts the parallel form to the serial form. The light receiving unit 28 and the CMOS sensor peripheral circuit constituting the CMOS image sensor 80 are formed on a single chip, for example.

  The light receiving unit 28 outputs an electrical signal after photoelectric conversion as pixel information from a pixel arbitrarily designated as a reading target among a plurality of pixels for imaging arranged two-dimensionally in a matrix. In accordance with the setting data output from the control device 40, the control circuit 35 performs an imaging process on the light receiving unit 28, an imaging speed of the light receiving unit 28, a readout process of pixel information from the pixels of the light receiving unit 28, and transmission of the read pixel information. Control processing.

  The timing generator 34 is driven according to the timing signal output from the control device 40, and outputs the electrical signal after photoelectric conversion from the pixel at the position (address) designated as the reading target in the plurality of pixels constituting the light receiving unit 28. Output as information.

  The noise removing unit 37 removes noise from a pixel information signal output from a predetermined pixel of the light receiving unit 28. The A / D conversion unit 38 converts the pixel information signal from which noise has been removed from an analog signal into a digital signal, and outputs the signal to the P / S conversion unit 39. The pixel information read from the light receiving unit 28 by the timing generator 34 and the AFE unit 36 is converted into a serial image signal converted by the P / S conversion unit 39 via a predetermined signal line of the collective cable 131. 40.

  The control device 40 processes the image signal to display the in-vivo image on the display unit 71 and controls each component of the endoscope system 101. The control device 40 includes an S / P converter 41, an image processor 42, a brightness detector 51, a dimmer 52, a read address setting unit 53, a CMOS drive signal generator 54, a controller 55, and a reference clock generator 56. Have

  The S / P converter 41 converts an image signal, which is a digital signal received from the camera head unit 105, from a serial form to a parallel form.

  The image processing unit 42 reads the parallel image signal output from the S / P conversion unit 41, that is, the pixel information of the pixel read by the timing generator 34 and the AFE unit 36, and the timing generator 34 and the AFE unit 36 read it out. An in-vivo image displayed on the display unit 71 is generated based on the pixel address of the light receiving unit 28.

  The image processing unit 42 includes a synchronization unit 43, a WB adjustment unit 44, a gain adjustment unit 45, a γ correction unit 46, a D / A conversion unit 47, a format change unit 48, a sample memory 49, and a still image memory 50. .

  The synchronization unit 43 inputs the input image signals of the R, G, and B pixels to a memory (not shown) provided for each pixel, and the pixels of the light receiving unit 28 read by the timing generator 34 and the AFE unit 36. The values of the memories are held while being sequentially updated with the input image signals, and the image signals of the three memories are synchronized as RGB image signals. The synchronized RGB image signals are sequentially output to the WB adjustment unit 44, and some of the synchronized RGB image signals are also output to the sample memory 49 for image analysis such as brightness detection. , Retained.

  The WB adjustment unit 44 adjusts the white balance of the RGB image signal. The gain adjusting unit 45 adjusts the gain of the RGB image signal. The γ correction unit 46 performs gradation conversion of the RGB image signal corresponding to the display unit 71.

  The D / A converter 47 converts the RGB image signal after gradation conversion from a digital signal to an analog signal. The format changing unit 48 changes the image signal converted into the analog signal into a format such as a high-definition method and outputs the same to the display unit 71. As a result, one in-vivo image is displayed on the display unit 71. A part of the RGB image signal gain-adjusted by the gain adjusting unit 45 is also held in the still image memory 50 for still image display, enlarged image display, or emphasized image display.

  The brightness detection unit 51 detects a brightness level corresponding to each pixel from the RGB image signals held in the sample memory 49, and the detected brightness level is stored in a memory provided in the brightness detection unit 51. Remember. Further, the brightness detection unit 51 calculates a gain adjustment value and a light irradiation amount based on the detected brightness level. The calculated gain adjustment value is output to the gain adjustment unit 45, and the calculated light irradiation amount is output to the dimming unit 52. Further, the detection result by the brightness detection unit 51 is also output to the control unit 55.

  The dimmer 52 sets the amount of current supplied to each light source and the driving condition of the neutral density filter based on the light irradiation amount output from the brightness detector 51, and generates a light source synchronization signal including the setting condition. Output to the light source device 60. The dimmer 52 sets the type, amount of light, and light emission timing of the light emitted from the light source device 60.

  The read address setting unit 53 can arbitrarily set the pixel to be read in the light receiving unit 28 based on the brightness level of each pixel of the RGB image signal detected by the brightness detection unit 51. That is, the read address setting unit 53 can arbitrarily set the pixel address of the light receiving unit 28 read by the timing generator 34 and the AFE unit 36. Further, the read address setting unit 53 outputs the set address of the pixel to be read to the synchronization unit 43.

  The CMOS drive signal generation unit 54 generates a driving timing signal for driving the light receiving unit 28 and the CMOS sensor peripheral circuit, and outputs the timing signal to the timing generator 34 via a predetermined signal line in the collective cable 131. This timing signal includes the address of the pixel to be read out.

  The control unit 55 is constituted by a CPU or the like, reads various programs stored in a memory (not shown), and executes each processing procedure indicated in the program, thereby controlling each drive of each component, and each of these components Information input / output control and information processing for inputting / outputting various types of information to / from these components. The control device 40 outputs setting data for imaging control to the control circuit 35 of the camera head unit 105 via a predetermined signal line in the collective cable 131. The setting data includes an imaging speed of the light receiving unit 28, instruction information for instructing a reading speed of pixel information from an arbitrary pixel of the light receiving unit 28, transmission control information of the read pixel information, and the like. The control unit 55 changes the pixel to be read set by the read address setting unit 53.

  The reference clock generation unit 56 generates a reference clock signal that is an operation reference for each component of the endoscope system 101 and supplies the generated reference clock signal to each component of the endoscope system 101.

  The light source device 60 operates under the control of the control unit 55. The light source device 60 includes a white light source 61 composed of LEDs and the like, a special light source 62 that emits each color light of RGB narrowed by a narrow-band bandpass filter, and a white light source according to a light source synchronization signal transmitted from the dimming unit 52. A predetermined amount of current is supplied to the white light source 61 or the special light source 62 under the control of the light source drive circuit 63, and the amount of current supplied to the light source 61 or the special light source 62 and the light source drive circuit 63 for controlling the driving of the neutral density filter. LED driver 64 is provided. The light emitted from the white light source 61 or the special light source 62 is supplied to the insertion unit 102 via the light guide 21 and is emitted to the outside from the distal end of the insertion unit 102.

  In the endoscope system 101 according to the first embodiment, the image signals corresponding to all the pixels of the light receiving unit 28 are not always transmitted, but only the pixels having addresses arbitrarily set by the read address setting unit 53 are supported. The image signal to be transmitted is transmitted to the control device 40 by the collective cable 131. For this reason, the endoscope system 101 can adjust the amount of signal to be transmitted by changing the pixel to be read out for each reading process according to various conditions. As a result, the endoscope system 101 can perform transmission processing suitable for increasing the number of pixels or the frame rate even when the transmission amount of the signal line is limited.

  Here, the setting process of the pixel to be read in the endoscope system 101 will be described in detail. In the endoscope system 101, the control unit 55 changes the pixel to be read set by the read address setting unit 53 in accordance with the optical system of the CMOS image sensor 80. For example, in the endoscope system 101, when the thin insertion portion 102 is set in the camera head portion 105 when observing the inside of a thin body cavity, the light incident area in the thin insertion portion 102 is the standard diameter insertion portion. It becomes smaller than the case where 102 is set. FIG. 3A is a diagram showing an imaging circle when the small-diameter insertion portion 102 is set. FIG. 3B is a diagram showing an imaging circle when the standard-diameter insertion portion 102 is set. 3 (1) and 3 (2) are shown at the same scale.

  As shown in these drawings, the circle C1 (see FIG. 3 (1)) in which light is actually incident on the light receiving unit 28 when the small-diameter insertion unit 102 is set has the standard-diameter insertion unit 102. When set, it is smaller than the circle C2 (see FIG. 3B) on which light is incident, and fits in the sensor region Si including all the pixels of the light receiving unit. When the small-diameter insertion portion 102 is set, no light is incident on the pixels outside the circle C1, and therefore pixel information on the pixels outside the circle C1 is not particularly necessary.

  Therefore, when the small-diameter insertion unit 102 is set, the control unit 55 in the control device 40 corresponds to the pixel to be read set by the read address setting unit 53 corresponding to the small-diameter insertion unit 102. The pixel is changed to the pixel in the region S1 in the same range as the actual light incident region (circle C1), and the timing generator 34 and the AFE unit 36 read out the pixels in the region S1. On the other hand, when the insertion portion 102 having the standard diameter is set, the light incident area (circle C2) is larger than the sensor area Si, and therefore the control unit 55 determines the pixel to be read set by the read address setting unit 53. , All pixels in the sensor region Si are changed.

  Next, the in-vivo image display process of the endoscope system 101 shown in FIG. 2 will be described. FIG. 4 is a flowchart showing a processing procedure of in-vivo image display processing of the endoscope system 101 shown in FIG.

  As shown in the flowchart of FIG. 4, first, the control unit 55 of the control device 40 determines whether there is an instruction to start displaying the in-vivo image based on the instruction information input from the input unit 72 or the like. (Step S1). The control unit 55 repeats the determination process in step S1 until determining that there is an instruction to start displaying the in-vivo image.

  When the control unit 55 determines that there is an instruction to start displaying the in-vivo image (step S1: Yes), the readout address setting unit 53, the dimming unit 52, and the control circuit 35 are controlled to perform an imaging process. First, in the first imaging process, the pixel information of all the pixels in the sensor area Si of the light receiving unit 28 is set to be read, and the read address setting unit 53 is controlled by the control unit 55. All 28 pixels are set as pixels to be read. In the camera head unit 105, after the light receiving unit 28 performs the imaging process in accordance with the light irradiation timing from the light source device 60 (step S <b> 2), the control unit 55 determines whether or not it is the first imaging process ( Step S3-1). When the control unit 55 determines that it is the first imaging process (step S3-1: Yes), the timing generator 34 and the AFE unit 36 obtain pixel information from all the pixels of the light receiving unit 28 according to a predetermined timing signal. Reading is performed (step S3-2). Then, the image processing unit 42 performs image processing for processing an image signal from all the pixels of the light receiving unit 28 to generate a single in-vivo image (step S4). The display unit 71 displays the image generated by the image processing unit 42 (step S5).

  Next, the control unit 55 determines whether the end of image display is instructed based on the instruction information input from the input unit 72 or the like (step S6). When it is determined that the end of image display has been instructed (step S6: Yes), the control unit 55 ends the image display process. On the other hand, when determining that the end of image display is not instructed (step S6: No), the control unit 55 determines whether it is the read address setting timing (step S7). For example, when information indicating that the small-diameter insertion unit 102 is set is input from the input unit 72, the control unit 55 determines that it is the read address setting timing. The control unit 55 periodically determines that it is the read address setting timing.

  When it is determined that it is not the read address setting timing (step S7: No), the control unit 55 does not change the read address of the read address setting unit 53, and directly returns to the imaging process of step S2. Then, after the next imaging process (step S2) is performed, the timing generator 34 and the AFE unit 36 perform the reading process on all the pixels of the light receiving unit 28 (step S3), similarly to the previous reading process. .

  On the other hand, when the control unit 55 determines that it is the read address setting timing (step S7: Yes), the brightness detection unit 51 is based on the luminance information of the RGB image signal held in the sample memory 49. Then, brightness detection processing is performed to detect an imaging region (bright region) in which pixels having luminances greater than or equal to a predetermined value are distributed (step S8). When the small-diameter insertion portion 102 is set, light does not enter pixels located outside the circle C1 (see FIG. 3 (1)), so the bright region is a region where light is actually incident. This corresponds to the circle C1. Therefore, the control unit 55 performs a read address setting process (step S9) in which the pixel to be read set by the read address setting unit 53 is changed to a pixel located in the bright area detected by the brightness detection unit 51. Thereafter, the read address setting unit 53 causes the timing generator 34 to output a timing signal including the address of the pixel to be read from the CMOS drive signal generation unit 54 (step S10), and returns to step S2.

  Next, after the next imaging process (step S2) is performed, the control unit 55 determines whether or not it is the first imaging process (step S3-1). When the control unit 55 determines that it is not the first imaging process (step S3-1: No), the timing generator 34 and the AFE unit 36 among the pixels of the light receiving unit 28, the bright area set by the read address setting unit 53. The image processing unit 42 processes the image signal from the pixels in the bright region of the light receiving unit 28 and corresponds to the actual image formation region. Image processing for generating a single in-vivo image is performed (step S4).

  In the endoscope system 101, since the collective cable 131 between the camera head unit 105 and the control device 40 is long and has a limited thickness, the thickness and number of signal lines that can be built into the collective cable 131 are limited. May be. For this reason, there is a limit to the amount of signal per unit time that can be stably transmitted via the signal line. In addition, when a CMOS image sensor is employed, image distortion of a moving image, that is, a so-called rolling shutter is likely to occur, so that the frame rate needs to be increased. In the endoscope system 101 according to the first embodiment, only the pixels in the bright area involved in the image configuration are read out and transmitted to the control device 40, so that the transmission amount of the image signal in the collective cable 131 can be reduced. For this reason, according to the first embodiment, it is possible to cope with a high frame rate and to appropriately display the in-vivo image in correspondence with the actual imaging region, which is efficient while accommodating a high pixel count. Can be processed.

  Next, brightness detection processing and read address setting processing will be described. The brightness detection unit 51 detects a bright area for each line of the RGB image signal for brightness detection. For example, in the example shown in the timing chart of FIG. 5 (1), the brightness detection unit 51 decreases the brightness with the pixel at the time Pa when the brightness rises, based on the line data on the m lines of the n frames as a sample. A pixel at time Pb is detected. Then, the brightness detection unit 51 detects that the region corresponding to the period from the time Pa to the time Pb is a bright region, and the address of the pixel located corresponding to the period from the time Pa to the time Pb is controlled by the control unit 55. Output to.

  The control unit 55 causes the readout address setting unit 53 to display the pixels located corresponding to the period between the time Pa and the time Pb detected in FIG. 5 (1) as shown in FIG. 5 (2). The pixel is changed as a pixel to be read on the same line, that is, the m line of the image of the n + 1 frame, and the timing generator 34 and the AFE unit 36 are caused to perform the reading process. In other words, the brightness detection unit 51 detects a bright area in the predetermined line based on the pixel information of the pixels in the predetermined line read by the timing generator 34 and the AFE unit 36. Then, the setting unit 55 changes the pixel to be read on the same line as the predetermined line of the image of the next frame to a pixel located in the bright area detected by the brightness detection unit 51.

  In addition, since the region where light enters does not change significantly between adjacent lines, the control unit 55 can also reflect the read address on the next line of the same frame in steps S9 and S10. is there.

  For example, as shown in the timing chart of FIG. 6 (1), when the brightness detection unit 51 detects that the area between time Pa and time Pb in the m line of n frames is a bright region, the control unit 55 In the read address setting unit 53, the pixels positioned corresponding to the period from the time Pa to the time Pb are set to the next line of the same frame, that is, the m + 1 line of the image of the n frame, as shown in FIG. Is set as a pixel to be read, and the timing generator 34 and the AFE unit 36 are caused to perform read processing. That is, the brightness detection unit 51 detects a bright area in the predetermined line based on the pixel information of the pixels in the predetermined line read by the timing generator 34 and the AFE unit 36. Then, the control unit 55 changes the pixel to be read in the line next to the predetermined line to a pixel located in the bright area detected by the brightness detection unit 51. In this way, when the read address is reflected on the next line of the same frame, a large memory is not necessary, and the configuration can be simplified.

(Modification 1 of Embodiment 1)
Next, Modification 1 of Embodiment 1 will be described. In the modification of the first embodiment, a case will be described in which the pixel to be read is set in correspondence with the display shape of the image actually displayed on the display unit 71.

  First, the endoscope main body part of the endoscope system according to the first modification of the first embodiment will be described. FIG. 7 is a diagram showing a schematic configuration of the endoscope main body portion in Modification 1 of Embodiment 1. As shown in FIG. As shown in FIG. 7, the endoscope 1 according to the first modification of the first embodiment includes an elongated insertion portion 2 and a proximal end side of the insertion portion 2 that is held by an endoscope apparatus operator. An operation unit 3 and a flexible universal cord 4 extending from the side of the operation unit 3 are provided. The universal cord 4 includes a light guide cable, an electric cable, and the like.

  The insertion portion 2 is a distal end portion 5 incorporating a CMOS sensor as an image sensor, a bending portion 6 that is configured by a plurality of bending pieces, and is provided on the proximal end side of the bending portion 6. And a long flexible tube portion 7 having flexibility.

  A connector portion 8 is provided at the end of the universal cord 4. The connector portion 8 includes a light guide connector 9 that is detachably connected to the light source device, and an electrical contact that is connected to the control device to transmit an electrical signal of the subject image photoelectrically converted by the CMOS sensor to the signal processing control device. An air supply base 11 for sending air to the nozzles of the part 10 and the tip part 5 is provided. Here, the light source device includes a white light source, a special light source, and the like, and supplies light from the white light source or the special light source as illumination light to the endoscope 1 connected via the light guide connector 9. The control device is a device that supplies power to the image sensor and receives an electrical signal photoelectrically converted from the image sensor, and processes the electrical signal imaged by the image sensor to display an image on a display unit that is connected. In addition to displaying, a drive signal for controlling and driving the gain adjustment of the image sensor is output.

  The operation section 3 includes a bending knob 12 that bends the bending section 6 in the vertical direction and the left-right direction, a treatment instrument insertion section 13 that inserts a treatment instrument 16 such as a biopsy forceps and a laser probe into the body cavity, a control device, and a light source device. Alternatively, a plurality of switches 14 for operating peripheral devices such as air supply, water supply, and gas supply means are provided. The treatment tool 16 inserted from the treatment tool insertion portion 13 is exposed from the opening 15 at the distal end of the insertion portion 2 through a treatment tool channel provided inside. For example, when the treatment tool 16 is a biopsy forceps, a biopsy is performed in which the affected tissue is collected with the biopsy forceps.

  Next, the structure in the front-end | tip part 5 of the insertion part 2 is demonstrated. FIG. 8 is a cross-sectional view for explaining the outline of the internal configuration of the distal end portion 5 of the endoscope 1 shown in FIG. As shown in FIG. 8, at the distal end of the insertion portion 5 of the endoscope 1, an illumination lens 22, an observation window 23, a treatment instrument exposing opening 15 communicating with the treatment instrument channel 33, and air / water supply A nozzle (not shown) is provided.

  White light or special light supplied from the light source device is emitted from the illumination lens 22 via a light guide 21 formed of a glass fiber bundle or the like. In the observation window 23, a light receiving unit 28 having a plurality of pixels for imaging arranged two-dimensionally in a matrix at the imaging position of the optical system composed of the lenses 24a and 24b is arranged. The light receiving unit 28 receives light incident through the optical system including the lenses 24a and 24b and images the inside of the body cavity. A cover glass 25 is provided on the light receiving surface side of the light receiving unit 28. An on-chip filter 27 in which R, G, or B filters are arranged corresponding to the arrangement of the pixels of the light receiving unit 28 is provided between the cover glass 25 and the light receiving unit 28. The light receiving unit 28 is mounted on the circuit board 26 together with an IC 29, a chip capacitor 30, and the like that instruct the light receiving unit 28 at the imaging timing and read an image signal from the light receiving unit 28 and convert it into an electrical signal. An electrode 32 is provided on the circuit board 26. The electrode 32 is connected to the collective cable 31 that transmits an electric signal to the control device via, for example, an anisotropic conductive resin film. The collective cable 31 includes a plurality of signal lines such as a signal line for transmitting an image signal which is an electric signal output from the light receiving unit 28 or a signal line for transmitting a control signal from a control device.

  FIG. 9 is a block diagram illustrating a configuration of the endoscope system 100 according to the first modification of the first embodiment. As shown in FIG. 9, the endoscope system 100 differs from the endoscope system 101 shown in FIG. 2 in that a CMOS image sensor 80 is provided at the distal end portion 5, and the CMOS image sensor 80 and the control device 40 are different from each other. The connection is made via the collective cable 31 in the insertion portion 2. Further, the light emitted from the light source device 60 is emitted to the outside from the tip of the tip 5 via the light guide 21.

  Here, as shown in FIG. 10A, the entire in-vivo image generated by the image processing unit 42 is not displayed as it is in the menu M1 displayed on the display unit 71. An octagonal image G1 is displayed in which a square part including the above is taken out and the vertex part is cut out in a triangular shape. As described above, the display unit 71 displays an image in a predetermined shape by cutting out a predetermined part from one in-vivo image generated by the image processing unit 42 according to the type of the display menu.

  When an image is displayed in an octagonal shape as shown in FIG. 10 (1), the read address setting unit 53 includes a sensor area Si including all pixels of the light receiving unit 28, as shown in FIG. 10 (2). A pixel located in the octagonal pixel region S3 corresponding to the shape of the image displayed on the display unit 71 is set as a pixel to be read. The setting unit 55 changes the pixel to be read set by the read address setting unit 53 in accordance with the display shape of the actually displayed image among the plurality of display shapes.

  Here, in the case of the endoscope system 100 of the form shown in FIG. 7, since the thickness of the insertion portion 2 is limited to be introduced into the body, the thickness and number of signal lines that can be built in the insertion portion 2 are also limited. Limited. For this reason, it is difficult to significantly increase the amount of signal transmitted per unit time via the signal line. In addition, when a CMOS image sensor is employed, image distortion of a moving image, that is, a so-called rolling shutter is likely to occur, so that the frame rate needs to be increased. In the first modification of the first embodiment, even in an endoscope system having such a configuration, pixel information is read out only from pixels corresponding to the shape of an actually displayed image, as in the first embodiment. Since the transmission amount of the image signal in the collective cable 31 can be reduced, the in-vivo image having a predetermined display shape can be efficiently displayed while supporting a higher pixel and a higher frame rate. be able to. The following embodiments will be described with an endoscope having the same form as the endoscope system 100 shown in FIG.

  Further, the timing generator 34 at the front end portion is previously provided with positional information of each pixel area corresponding to each predetermined shape of the image displayed on the display unit 71, and the timing generator 34 and the AFE side are subject to reading. The pixel area may be switched in hardware.

  In this case, as shown in the endoscope system 100a in FIG. 11, the timing generator 34a provided at the distal end portion 5a has a pixel region corresponding to each predetermined shape of the image displayed on the display unit 71. A mask group 34b to be masked is provided in advance. Each mask in the mask group 34b corresponds to position information of a plurality of pixel regions respectively corresponding to a plurality of predetermined shapes. Then, under the control of the control unit 55, the read address setting unit 53a of the control device 40a outputs display shape information indicating the display shape of an image to be displayed next among the plurality of predetermined display shapes as a timing signal. And output to the timing generator 34a. The timing generator 34a and the AFE unit 36a switch to a mask corresponding to the display shape indicated by the received display shape information, and change the pixel information of the pixels in the switched mask, that is, the display shape of the image actually displayed by the display unit 71. Pixel information is read out only from pixels located in the corresponding pixel region. Further, the read address setting unit 53a may instruct the switching of the mask and may further set the pixel to be read out of the pixels in the mask based on the brightness detection result of the brightness detection unit 51. In this case, since the data for designating the pixel to be read by the light receiving unit 28 is reduced, the efficiency can be further increased.

(Embodiment 2)
Next, a second embodiment will be described. In the second embodiment, a case will be described in which a pixel to be read is set corresponding to a frame rate. FIG. 12 is a block diagram of a configuration of the endoscope system according to the second embodiment.

  As illustrated in FIG. 12, the control device 240 of the endoscope system 200 according to the second embodiment includes a control unit 255 having the same function as the control unit 55 instead of the control unit 55 in the control device 40. Instead of the read address setting unit 53, a read address setting unit 253 is provided. The control device 240 further includes a frame rate switching unit 254 as compared with the control device 40.

  The frame rate switching unit 254 changes the frame rate. The frame rate switching unit 254 also changes the imaging timing in the light receiving unit 28 and the readout speed in the timing generator 34 in accordance with the changed frame rate. In other words, in response to the frame rate changed by the frame rate switching unit 254, the imaging timing in the light receiving unit 28 of the tip 5 and the readout timing of the timing generator 34 are also controlled. Note that the light emission processing in the light source device 60 is also controlled in accordance with the frame rate changed by the frame rate switching unit 254.

  The control unit 255 changes the pixel to be read set by the read address setting unit 253 according to the read speed changed by the frame rate switching unit 254. With reference to FIG. 13 and FIG. 14, the setting of the pixel to be read by the read address setting unit 253 will be described. For example, a case where a standard frame rate and a high-speed frame rate faster than the standard frame rate are provided as frame rates will be described as an example.

  When the standard frame rate is set as the frame rate, the control unit 255 causes the reading address setting unit 253 to set all pixels of the light receiving unit 28 as reading targets as shown in FIG. A fine image can be generated. On the other hand, when the high-speed frame rate is set, the control unit 255 causes the read address setting unit 253 to set the pixels at a predetermined interval among all the pixels of the light receiving unit 28 as illustrated in FIG. The remaining pixels obtained by thinning out are set as readout target pixels.

  For example, as shown in FIG. 14, a case where the standard frame rate is 30 f / sec and the high-speed frame rate is 60 f / sec which is twice the standard frame rate will be described as an example. When the transmission amount per unit time of the signal lines for transmitting the image signals of the collective cable 31 is set to the same amount as the predetermined standard transmission amount at the standard frame rate, the control unit 255 has the light receiving unit 28 at the high frame rate. Only half of the pixels are read out by the timing generator 34 and the AFE unit 36.

  As a result, the data amount Db of the image signal corresponding to one image at the high frame rate (see FIG. 14B) is the data amount Da of the image signal corresponding to one image of the standard frame rate (see FIG. 14). 14 (1))). As described above, the control unit 255 reads the address setting unit so that the transmission amount per unit time of the signal lines for transmitting the image signals of the aggregate cable 31 is the same as the predetermined standard transmission amount at the standard frame rate. The pixel to be read set by H.253 is changed.

  Thereby, in the second embodiment, the transmission amount of the signal line can be stabilized regardless of the frame rate. Therefore, in the second embodiment, a moving image with a high resolution can be displayed at a standard frame rate when there is little motion. Further, in the second embodiment, when the motion is fast, the motion can be observed smoothly without any transmission trouble even when the frame rate is increased to improve the moving image, and the image distortion of the moving image, so-called rolling shutter can be prevented. . Of course, the control unit 255 sends the collective cable to the read address setting unit 253 so that the transmission amount per unit time of the signal line for transmitting the image signal of the collective cable 31 does not exceed a predetermined standard transmission at the standard frame rate. The pixel to be read may be set so that the transmission amount per unit time of the signal line for transmitting 31 image signals is lower than a predetermined standard transmission amount at the standard frame rate.

  Next, the in-vivo image display process of the endoscope system 200 will be described. FIG. 15 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 200 shown in FIG.

  As shown in the flowchart of FIG. 15, the control unit 255 determines whether there is an instruction to start displaying the in-vivo image, similarly to step S1 shown in FIG. 4 (step S11). The control unit 255 repeats the determination process in step S11 until determining that there is an instruction to start displaying the in-vivo image.

  When the control unit 255 determines that there is an instruction to start displaying the in-vivo image (step S11: Yes), the frame rate switching unit 254 sets the frame rate to the default standard frame rate because the first imaging process is performed. (Step S12). Since this is the first imaging process, the control unit 255 causes the read address setting unit 253 to set all pixels of the light receiving unit 28 as pixels to be read (step S13). As a result, after the light receiving unit 28 performs the imaging process at the timing corresponding to the standard frame rate set by the frame rate switching unit 254 (step S14), the timing generator 34 and the AFE unit 36 receive the light reception. Pixel information is read from all the pixels of the unit 28 (step S15). Then, the image processing unit 42 performs image processing for processing an image signal from all the pixels of the light receiving unit 28 to generate one high-definition in-vivo image (step S16). The display unit 71 displays the image generated by the image processing unit 42 (step S17).

  Next, the control unit 255 determines whether or not the end of image display is instructed as in step S6 of FIG. 4 (step S18). When it is determined that the end of image display has been instructed (step S18: Yes), the control unit 255 ends the image display process. On the other hand, when it is determined that the end of image display has not been instructed (step S18: No), the control unit 255 has an instruction to increase the frame rate based on the instruction information input from the input unit 72. Whether or not (step S19). When the control unit 255 determines that there is no instruction to increase the frame rate (step S19: No), the standard frame rate remains unchanged, so that the process returns to step S13 and the readout processing is set for all pixels before the next imaging. After the process (step S14) is performed, the timing generator 34 and the AFE unit 36 perform the readout process on all the pixels of the light receiving unit 28 in the same manner as the previous readout process (step S15).

  On the other hand, when the control unit 255 determines that there is an instruction to increase the frame rate (step S19: Yes), the frame rate switching unit 254 sets the frame rate to the high frame rate (step S20).

  In this case, the control unit 255 thins out the pixels to be read set by the read address setting unit 253 to only half the pixels of the light receiving unit 28 in which all pixels of the light receiving unit 28 are thinned out at predetermined intervals. Read setting processing is performed (step S21).

  For example, as shown in FIG. 16, the control unit 255 causes the read address setting unit 253 to set the pixels of the lines R1 and R2 and the lines R5 and R6 among the lines R1 to R7 so as to read the pixel information every two lines. It is set as a pixel to be read out. In addition to this, the control unit 255 may cause the read address setting unit 253 to set to read two pixels of R, G or G, B alternately. Specifically, as shown in FIG. 17, for the R, G, G, and B pixels constituting the block B1, the two pixels P1 and P2 of R and G are set as readout objects, and the remaining pixel P3. , P4 are not subject to reading. For the block B2 adjacent to the block B1, the two pixels P7 and P8 of B and G are set as reading targets, and the remaining pixels P5 and P6 are excluded from reading targets. Of course, the control unit 255 may cause the read address setting unit 253 to set the pixel to be read so that it is read every two lines in the vertical direction. May be divided into blocks, and pixels to be read out may be set in units of blocks.

  At the tip 5, the light receiving unit 28 performs an imaging process at a timing corresponding to the high-speed frame rate set by the frame rate switching unit 254 (step S <b> 22), and the timing generator 34 and the AFE unit 36 are connected to the light receiving unit 28. A thinning-out reading process for reading out pixel information from only half of the pixels thinned out from all pixels is performed (step S23). The image processing unit 42 processes the image signal by the half-thinned pixels and performs image processing to generate one in-vivo image (step S24), and the display unit 71 is generated by the image processing unit 42. The displayed image is displayed (step S25). In this case, the image displayed on the display unit 71 is rewritten at a high rate and the movement is smoothly displayed. Therefore, even if the image has a lower resolution than the image at the standard frame rate, the observation is hindered. There is no.

  Next, the control unit 255 determines whether there is an instruction to standardize the frame rate based on the instruction information input from the input unit 72 (step S26). When the control unit 255 determines that there is no instruction to standardize the frame rate (step S26: No), the high-speed frame rate remains unchanged, so the process returns to step S21 to perform the thinning readout setting process in which half of the pixels are to be read out. After that, the next imaging process (step S22) is performed, and the timing generator 34 and the AFE unit 36 perform thinning-out reading similarly to the previous reading process (step S23).

  On the other hand, when the control unit 255 determines that there is an instruction to standardize the frame rate (step S26: Yes), the process returns to step S12, and the frame rate switching unit 254 sets the frame rate to the standard frame rate (step S12). . In the next step S13, the control unit 255 causes the read address setting unit 253 to set all pixels of the light receiving unit 28 as pixels to be read, so that the next imaging process ( Step S14) is performed, and the timing generator 34 and the AFE unit 36 perform a reading process on all the pixels of the light receiving unit 28 (step S15).

  As described above, in the second embodiment, since the transmission amount of the signal line can be stabilized regardless of the frame rate, it is possible to appropriately cope with either a high pixel count or a high frame rate.

  In the second embodiment, the case where the standard frame rate and the high-speed frame rate are provided as the frame rate has been described as an example, but the present invention can also be applied to the case where two or more frame rates can be set. In this case, the read address setting unit 253 refers to a correspondence table between each frame rate stored in advance and each address distribution of the pixel to be read, and the like, for example, the signal line for transmitting the image signal of the collective cable 31. The pixel to be read may be set at a thinning rate corresponding to each frame rate so that the transmission amount per unit time does not exceed a predetermined standard transmission amount at the standard frame rate.

(Modification 1 of Embodiment 2)
Next, Modification 1 of Embodiment 2 will be described. In the first modification of the second embodiment, a case will be described in which image analysis is performed and the frame rate is automatically changed according to the amount of movement of the distal end portion 5. FIG. 18 is a block diagram illustrating a configuration of an endoscope system according to the first modification of the second embodiment.

  As illustrated in FIG. 18, a control device 240a of the endoscope system 200a according to the first modification of the second embodiment is a control unit having the same function as the control unit 255 instead of the control unit 255 in the control device 240. And a motion detection unit 251a that detects a relative motion amount of the CMOS image sensor 80 with respect to the subject image as compared with the control device 240.

  The motion detector 251a uses a plurality of back and forth RGB image signals held in the sample memory 49, and uses a predetermined pixel region (for example, a pixel region corresponding to a bleeding part) set on each RGB image. The amount of motion from the previous image is detected, and the detected amount of motion is output to the control unit 255a. For example, as shown in FIG. 19, the motion detection unit 251a compares the image of the nth frame with the image of the (n + 1) th frame that is the next frame, and a plurality of pixel regions set on each image. Correlation value, for example, a normalized cross-correlation value, is calculated, and a motion vector of each pixel region between adjacent images of this series of images is calculated as a motion amount. This pixel area is an area constituted by one or more pixel blocks on the image.

  The frame rate switching unit 254 changes the frame rate from the standard frame rate to the high-speed frame rate when the motion amount detected by the motion detection unit 251a exceeds a predetermined amount, and accordingly, the timing generator 34 and the AFE unit 36 Is changed to a speed corresponding to a high-speed frame rate faster than a predetermined standard speed.

  Next, the in-vivo image display process of the endoscope system 200a will be described. FIG. 20 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 200a shown in FIG.

  As shown in the flowchart of FIG. 20, the control unit 255a determines whether or not there is an instruction to start displaying the in-vivo image, similarly to step S11 shown in FIG. 15 (step S11-1).

  Control unit 255a repeats the determination process of step S11-1 until it is determined that there is an instruction to start displaying the in-vivo image (step S11-1: Yes), similarly to step S11 shown in FIG. When the control unit 255 determines that there is an instruction to start displaying the in-vivo image (step S11-1: Yes), the frame rate switching unit 254 sets the standard frame rate in the same manner as in steps S12 to S17 shown in FIG. The read address setting unit 253 sets all the pixels of the light receiving unit 28 as pixels to be read (step S13-1), and the light receiving unit 28 captures images at a timing corresponding to the standard frame rate. After performing the processing (step S14-1), the timing generator 34 and the AFE unit 36 read pixel information from all the pixels of the light receiving unit 28 (step S15-1), and the image processing unit 42 is based on all the pixels of the light receiving unit 28. Image processing for generating an in-vivo image based on the image signal is performed (step S16-1), and the display unit 71 displays the in-vivo image. Step S17-1).

  Next, as in step S18 of FIG. 15, the control unit 255a determines whether or not an instruction to end image display has been instructed (step S18-1), and determines that an instruction to end image display has been instructed (step S18). -1: Yes), the image display process is terminated.

  On the other hand, when the control unit 255a determines that the end of image display is not instructed (step S18-1: No), the motion detection unit 251a detects a relative motion amount of the CMOS image sensor 80 with respect to the subject image. A quantity detection process is performed (step S19-1). The control unit 255a determines whether or not the motion detected by the motion detection unit 251a has increased beyond a predetermined amount (step S19-2).

  When the control unit 255a determines that the amount of motion has not increased (step S19-2: No), since there is no problem in observation even with the standard frame rate, the process returns to step S13-1, and readout processing is performed for all pixels. Is set.

  On the other hand, when the control unit 255a determines that the motion detected by the motion detection unit 251a has increased beyond a predetermined amount (step S19-2: Yes), the frame rate switching unit 254 responds to the fast motion. In order to display a smooth moving image, the frame rate is set to a high frame rate (step S20-1). Then, similarly to steps S21 to S24 in FIG. 15, the control unit 255a causes the read address setting unit 253 to perform a thinning read setting process (step S21-1), and at the timing corresponding to the high-speed frame rate. 28 performs imaging processing (step S22-1), the timing generator 34 and the AFE unit 36 perform thinning-out reading (step S23-1), and the image processing unit 42 generates an image signal based on the half-thinned pixels. Then, image processing for generating an in-vivo image is performed (step S24-1), and the display unit 71 displays the in-vivo image (step S25-1).

  Next, the motion detection unit 251a performs a motion amount detection process (step S26-1), and the control unit 255a determines whether or not the motion detected by the motion detection unit 251a is lower than a predetermined amount (step S26). -2).

  When the control unit 255a determines that the amount of motion has not decreased (step S26-2: No), the thinned-out readout setting process is performed by returning to step S21-1 while maintaining the high-speed frame rate in order to cope with the fast motion. Each process including the thinning-out reading process is performed at a timing corresponding to the high-speed frame rate.

  On the other hand, when the control unit 255a determines that the amount of movement has decreased (step S26-2: Yes), there is no problem even if the frame rate is lowered, and the process returns to step S12-1. Then, after the frame rate is set to the standard frame rate (step S12-1) and the all pixel readout setting process (step S13-1) is performed, the all pixel readout process is included at a timing corresponding to the standard frame rate. Each process is performed.

  In this way, even when the frame rate is automatically changed according to the amount of motion of the image, the pixel to be read is set in accordance with the changed frame rate, so that the transmission amount of the signal line is stabilized and appropriate. In-vivo observation can be realized.

(Modification 2 of Embodiment 2)
Next, a second modification of the second embodiment will be described. In the second modification of the second embodiment, when the surgical instrument 16 is used, a case in which the frame rate is automatically increased in order to appropriately display the fast movement for the treatment will be described. To do.

  FIG. 21 is a block diagram illustrating a configuration of an endoscope system according to the second modification of the second embodiment. As illustrated in FIG. 21, the control device 240 b of the endoscope system 200 b according to the second modification of the second embodiment is a control unit having the same function as the control unit 255 instead of the control unit 255 in the control device 240. And a treatment instrument detection unit 251b as compared with the control device 240.

  For example, as shown in FIG. 22, when surgical treatment is performed by exposing the treatment tool 16 from the opening 15 a at the distal end of the insertion portion 2 of the endoscope 1, the treatment tool is included in the imaging region of the light receiving unit 28. Since the 16 tips are also positioned, the tip of the treatment instrument 16 is also displayed in the image G2 as shown in the menu M1 in FIG. Note that the treatment tool 16 corresponds to a functional unit that can be operated to freely move back and forth in the imaging region of the CMOS image sensor 80 in the claims. Therefore, the treatment instrument detection unit 251b processes the image signal held in the sample memory 49, detects whether or not the in-vivo image includes an image corresponding to the treatment instrument, and the treatment instrument 16 is within the imaging region. It is detected whether it is located in. The distal end of the treatment tool 16 is colored with a color that does not normally exist in the body cavity of the endoscope observation target, for example, a blue marker, and the treatment tool detection unit 251b distributes G pixels having a luminance of a predetermined value or more over a predetermined region. In the case, it is detected that the treatment tool 16 is in the imaging field. In addition, 223 of FIG. 22 is an air / water supply nozzle.

  When the treatment instrument detection unit 251b detects that the image corresponding to the treatment instrument is included, the frame rate switching unit 254 changes the frame rate from the standard frame rate in order to appropriately display the fast movement for the treatment. The high-speed frame rate is changed, and accordingly, the reading speed by the timing generator 34 is changed to a speed corresponding to a high-speed frame rate faster than a predetermined standard speed.

  Next, the in-vivo image display process of the endoscope system 200b will be described. FIG. 24 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 200b shown in FIG.

  As shown in the flowchart of FIG. 24, the control unit 255b determines whether there is an instruction to start displaying the in-vivo image, similarly to step S11 shown in FIG. 15 (step S11-3).

  The control unit 255b repeats the determination process of step S11-3 until it is determined that there is an instruction to start displaying the in-vivo image (step S11-3: Yes), similarly to step S11 illustrated in FIG. When the control unit 255b determines that there is an instruction to start displaying the in-vivo image (step S11-3: Yes), the frame rate switching unit 254 sets the standard frame rate in the same manner as in steps S12 to S17 shown in FIG. In step S12-3, the control unit 255b causes the read address setting unit 253 to set all pixels of the light receiving unit 28 as pixels to be read (step S13-3), and receives light at a timing corresponding to the standard frame rate. The unit 28 performs an imaging process (step S14-3), the timing generator 34 and the AFE unit 36 read out pixel information from all the pixels of the light receiving unit 28 (step S15-3), and the image processing unit 42 outputs all of the light receiving unit 28. Image processing for generating an in-vivo image based on the image signal from the pixel is performed (step S16-3), and the display unit 71 displays the body image. Displaying an image (step S17-3).

  Next, as in step S18 of FIG. 15, the control unit 255b determines whether or not an instruction to end image display has been instructed (step S18-3), and determines that an instruction to end image display has been instructed (step S18). -3: Yes), the image display process is terminated.

  On the other hand, when the control unit 255b determines that the end of image display is not instructed (step S18-3: No), the treatment instrument detection unit 251b determines whether the in-vivo image includes an image corresponding to the treatment instrument. A treatment instrument detection process to be detected is performed (step S19-3). The control unit 255b determines whether there is an image corresponding to the treatment tool in the in-vivo image from the detection result of the treatment tool detection unit 251b (step S19-4).

  When the control unit 255b determines that there is no image corresponding to the treatment tool in the in-vivo image (step S19-4: No), since it is before the surgical treatment and there is no hindrance to observation even at the standard frame rate, step S13 Returning to -3, readout processing is set for all pixels.

  On the other hand, when the control unit 255b determines that there is an image corresponding to the treatment tool in the in-vivo image (step S19-4: Yes), the frame rate switching unit 254 is smooth in response to the fast movement of the surgical treatment. In order to display a moving image, the frame rate is set to a high frame rate (step S20-3). Then, similarly to steps S21 to S24 in FIG. 15, the control unit 255b causes the read address setting unit 253 to perform a thinning read setting process (step S21-3), and at the timing corresponding to the high-speed frame rate, 28 performs imaging processing (step S22-3), the timing generator 34 performs thinning-out reading (step S23-3), and the image processing unit 42 generates an in-vivo image based on the image signal of the half-thinned pixels. The generated image processing is performed (step S24-3), and the display unit 71 displays the in-vivo image (step S25-3).

  Next, the treatment instrument detection unit 251b performs treatment instrument detection processing (step S26-3), and the control unit 255b determines whether there is an image corresponding to the treatment instrument in the in-vivo image based on the detection result of the treatment instrument detection unit 251b. Is determined (step S26-4). When the control unit 255b determines that there is an image corresponding to the treatment tool in the in-vivo image (step S26-4: Yes), the process proceeds to step S21-3 while maintaining the high frame rate to cope with the fast movement of the surgical procedure. Return decimation readout setting processing is performed, and each processing including decimation readout processing is performed at a timing corresponding to the high-speed frame rate.

  On the other hand, when the control unit 255b determines that there is no image corresponding to the treatment tool in the in-vivo image (step S26-4: No), the frame rate is used to deal with the case where the surgical treatment is finished and the treatment tool is taken out. Since there is no problem even if the value is lowered, the process returns to step S12-3. Then, after the frame rate is set to the standard frame rate (step S12-3) and the all pixel readout setting process (step S13-3) is performed, the all pixel readout process is included at a timing corresponding to the standard frame rate. Each process is performed.

  As described above, even when the frame rate is automatically changed in accordance with the presence or absence of the treatment tool, the readout target pixel is set in accordance with the changed frame rate, so that the transmission amount of the signal line is stabilized and appropriately In-vivo observation can be realized.

(Modification 3 of Embodiment 2)
Next, Modification 3 of Embodiment 2 will be described. FIG. 25 is a block diagram illustrating a configuration of an endoscope system according to the third modification of the second embodiment. As shown in FIG. 25, the endoscope system 200c according to the third modification of the second embodiment includes a treatment instrument insertion detection unit 275 that detects insertion of a treatment instrument into the endoscope 1. The frame rate switching unit 254 of the control device 240c switches the frame rate from the standard frame rate to the high frame rate when the treatment instrument insertion detection unit 275 detects the insertion of the treatment instrument 16 into the endoscope 1.

  As illustrated in FIG. 26, the treatment instrument insertion detection unit 275 includes a switch 214 provided in the middle of the insertion path 213, a detection circuit 215, and a signal line 216 connected to the control unit 255c. When the treatment instrument 16 is inserted from the treatment instrument insertion portion 13 as indicated by the arrow Y1, the switch 214 provided in the middle of the insertion path is depressed as indicated by the arrow Y2, and a signal indicating the switch depression is received from the detection circuit 215. The signal is output to the control unit 255c via the signal line 216. When the control unit 255c receives this signal, the control unit 255c determines that the treatment tool 16 is used. In other words, it is considered that the treatment instrument 16 is in a state of being positioned in the imaging field of view of the CMOS image sensor 80. Next, the frame rate switching unit 254 changes the frame rate from the standard frame rate to the high frame rate in order to appropriately display the fast movement for treatment, and accordingly, the reading speed by the timing generator 34 and the AFE unit 36 is changed. Is changed to a speed corresponding to a high-speed frame rate faster than a predetermined standard speed.

  When the surgical procedure is completed and the treatment instrument 16 is extracted, the pressing of the switch 214 is also released, and a signal indicating release of the pressing of the switch is output from the detection circuit 215 to the control unit 255c via the signal line 216. Is done. When the control unit 255c receives this signal, the control unit 255c determines that the use of the treatment instrument 16 is finished, and the frame rate switching unit 254 changes the frame rate from the high-speed frame rate to the standard frame rate.

  Next, the in-vivo image display process of the endoscope system 200c will be described. FIG. 27 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 200c shown in FIG.

  As shown in the flowchart of FIG. 27, the control unit 255c determines whether or not there is an instruction to start displaying the in-vivo image, similarly to step S11 shown in FIG. 15 (step S11-5).

  The control unit 255c repeats the determination process of step S11-5 until it is determined that there is an instruction to start displaying the in-vivo image (step S11-5: Yes), similarly to step S11 illustrated in FIG. When the control unit 255c determines that there is an instruction to start displaying the in-vivo image (step S11-5: Yes), the frame rate switching unit 254 sets the standard frame rate in the same manner as in steps S12 to S17 shown in FIG. (Step S12-5), the control unit 255c causes the read address setting unit 253 to set all pixels of the light receiving unit 28 as pixels to be read (step S13-5), and at a timing corresponding to the standard frame rate, The light receiving unit 28 performs an imaging process (step S14-5), the timing generator 34 and the AFE unit 36 read out pixel information from all the pixels of the light receiving unit 28 (step S15-5), and the image processing unit 42 is connected to the light receiving unit 28. Image processing for generating an in-vivo image based on image signals from all pixels is performed (step S16-5), and the display unit 71 Show internal image (step S17-5).

  Next, as in step S18 of FIG. 15, the control unit 255c determines whether or not an instruction to end image display has been instructed (step S18-5), and determines that an instruction to end image display has been instructed (step S18). −5: Yes), and the image display process ends.

  On the other hand, when the control unit 255c determines that the end of image display is not instructed (step S18-5: No), the treatment instrument insertion detection is performed based on the presence / absence of a signal input from the treatment instrument insertion detection unit 275. It is determined whether the part 275 detects insertion of the treatment tool (step S19-5).

  When the control unit 255c determines that the treatment tool insertion detection unit 275 does not detect the insertion of the treatment tool (step S19-5: No), since it is before surgical treatment and there is no hindrance to observation even at the standard frame rate, Returning to step S13-5, readout processing is set for all pixels.

  On the other hand, when the control unit 255c determines that the treatment instrument insertion detection unit 275 has detected the insertion of the treatment instrument (step S19-5: Yes), the frame rate switching unit 254 responds to the quick movement of the surgical procedure. In order to display a smooth moving image, the frame rate is set to a high frame rate (step S20-5). Then, similarly to steps S21 to S24 in FIG. 15, the control unit 255c causes the read address setting unit 253 to perform a thinning read setting process (step S21-5), and at the timing corresponding to the high-speed frame rate. 28 performs imaging processing (step S22-5), the timing generator 34 and the AFE unit 36 perform thinning-out reading (step S23-5), and the image processing unit 42 generates an image signal based on the half-thinned pixels. Then, image processing for generating an in-vivo image is performed (step S24-5), and the display unit 71 displays the in-vivo image (step S25-5).

  Next, as in step S19-5, the control unit 255c determines whether or not the treatment instrument insertion detection unit 275 has detected removal of the treatment instrument (step S26-5). If the control unit 255c determines that the treatment instrument insertion detection unit 275 does not detect removal of the treatment instrument (step S26-5: No), the control unit 255c maintains the high-speed frame rate to cope with the fast movement of the surgical procedure. Returning to 5, the thinning readout setting process is performed, and each process including the thinning readout process is performed at a timing corresponding to the high-speed frame rate.

  On the other hand, when the control unit 255c determines that the treatment instrument insertion detection unit 275 has detected removal of the treatment tool (step S26-5: Yes), in order to cope with the case where the surgical treatment is completed and the treatment tool is removed, Since there is no problem even if the frame rate is lowered, the process returns to step S12-5. Then, after the frame rate is set to the standard frame rate (step S12-5) and the all pixel readout setting process (step S13-5) is performed, the all pixel readout process is included at a timing corresponding to the standard frame rate. Each process is performed.

(Embodiment 3)
Next, Embodiment 3 will be described. In the third embodiment, when the enlarged display of a part of the in-vivo image is set, the frame rate is automatically changed, and the pixels in the pixel area corresponding to the part of the in-vivo image to be enlarged are read out. The case of using the pixel will be described.

  FIG. 28 is a block diagram of a configuration of the endoscope system according to the third embodiment. As shown in FIG. 28, the endoscope system 300 according to the third embodiment is an enlargement in which the in-vivo image displayed on the display unit 71 is partially enlarged instead of the input unit 72 shown in FIG. An input unit 372 further includes an enlargement mode setting unit 375 that sets a mode and outputs enlargement mode setting information. The control device 340 includes a control unit 355 having the same function as that of the control unit 255 instead of the control unit 255 of FIG. 12, and includes a read address setting unit 353 instead of the read address setting unit 253. A frame rate switching unit 354 is provided instead of the rate switching unit 254.

  When a part of the image is enlarged and displayed, the image blurring with respect to the movement is also enlarged and displayed. For this reason, when the enlargement mode is set, it is desirable to increase the frame rate in order to realize a smooth moving image with no image blur. Therefore, when the enlargement mode setting unit 375 sets the enlargement mode, the frame rate switching unit 354 changes the frame rate from the standard frame rate to the high-speed frame rate and changes the reading speed by the timing generator 34 and the AFE unit 36. The speed is changed to a speed corresponding to a high-speed frame rate higher than a predetermined standard speed. As described above, the frame rate switching unit 354 changes the frame rate according to the setting of the enlargement mode setting unit 375.

  Further, when the enlargement mode is set, as shown in FIG. 29, what is actually displayed on the display unit 71 is a partial region S4 of the sensor region Si including all the pixels of the light receiving unit 28. Is an image corresponding to. Therefore, when the enlargement mode setting unit 375 sets the enlargement mode, the control unit 355 does not display all the pixels of the light receiving unit 28 on the readout address setting unit 353 but the in-vivo image actually enlarged in the enlargement mode. Only the pixels in the pixel area corresponding to a part of the pixel are set as pixels to be read.

  That is, in the case of the standard magnification mode in which the enlargement mode is not set, the frame rate switching unit 354 sets the frame rate to the standard frame rate, and the read address setting unit 353 has the light receiving unit as shown in FIG. A sensor region Si including all 28 pixels is set as a reading target so that a high-definition image Gc can be generated.

  On the other hand, when the enlargement mode is set, the frame rate switching unit 354 sets the frame rate to a high frame rate and the read address setting unit 353 is configured as shown in FIG. As shown in FIG. 4, a pixel in a region S4 that is actually enlarged and displayed on the display unit 71 in the sensor region of the light receiving unit 28 is set as a reading target, and an image Gd corresponding to the region S4 is set to a high-speed frame rate. It can be generated corresponding to. 30 and 31 are shown at the same scale.

  For example, as shown in FIG. 32, the case where the standard frame rate at the standard magnification is 30 f / sec and the high-speed frame rate in the enlargement mode is 60 f / sec that is twice the standard frame rate will be described as an example. In this case, the control unit 355 reads the read address when the transmission amount per unit time of the signal lines for transmitting the image signals of the aggregate cable 31 is the same as the predetermined standard transmission amount at the standard frame rate at the high speed rate. The setting unit 353 is caused to set, as a reading target, a central region where half of all the pixels are located as the region S4 of the light receiving unit 28, and the pixel signals of the half pixels of the light receiving unit 28 are set to the timing generator 34 and the AFE. The unit 36 reads the data.

  As a result, the data amount Dd of the image signal corresponding to one image in the enlargement mode (see FIG. 32 (2)) is the data amount Dc of the image signal corresponding to one image at the standard magnification (FIG. 32). (See (1)), and the transmission amount of the signal line can be made substantially constant. Of course, the control unit 355 reads the readout address setting unit 353 so that the transmission amount per unit time of the signal lines for transmitting the image signals of the collective cable 31 is lower than the predetermined standard transmission amount at the standard frame rate. A target pixel may be set.

  Next, the in-vivo image display process of the endoscope system 300 will be described. FIG. 33 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 300 shown in FIG.

  As shown in the flowchart of FIG. 33, the control unit 355 determines whether or not there is an instruction to start displaying the in-vivo image, similarly to step S11 shown in FIG. 15 (step S31). Control unit 355 repeats the determination process of step S31 until it is determined that there is an instruction to start displaying the in-vivo image (step S31: Yes), similarly to step S11 shown in FIG. When the control unit 355 determines that there is an instruction to start displaying the in-vivo image (step S31: Yes), the frame rate switching unit 354 sets the standard frame rate in the same manner as in steps S12 to S17 shown in FIG. (Step S32), the control unit 355 causes the read address setting unit 353 to set all the pixels of the light receiving unit 28 as pixels to be read (step S33), and the light receiving unit 28 performs an imaging process at a timing corresponding to the standard frame rate. (Step S34), the timing generator 34 and the AFE unit 36 read out the pixel information from all the pixels of the light receiving unit 28 (Step S35), and the image processing unit 42 performs the in-vivo image based on the image signal from all the pixels of the light receiving unit 28. Is processed (step S36), and the display unit 71 displays the in-vivo image (step S). 7).

  Next, as in step S18 of FIG. 15, the control unit 355 determines whether or not an instruction to end image display has been instructed (step S38), and determines that an instruction to end image display has been instructed (step S38: Yes). ), The image display process is terminated.

  On the other hand, when the control unit 355 determines that the end of image display is not instructed (step S38: No), the enlargement mode is set based on the input of the enlargement mode setting information input from the enlargement mode setting unit 375. It is determined whether it has been set (step S39).

  When the control unit 355 determines that the enlargement mode is not set (step S39: No), there is no hindrance to the observation even if the standard frame rate is maintained, so the process returns to step S33 and the reading process is set for all the pixels.

  On the other hand, when the control unit 355 determines that the enlargement mode is set (step S39: Yes), the frame rate switching unit 354 sets the frame rate to a high-speed frame rate in order to reduce image blur during enlargement display ( Step S40). Then, the control unit 355 causes the readout address setting unit 353 to use a region S4 that is a pixel region corresponding to a part of the in-vivo image that is actually displayed in an enlarged manner and that is a part of the sensor region Ci of the light receiving unit 28 for the enlargement mode. Is set as a reading area (step S41). Then, the light receiving unit 28 performs an imaging process at a timing corresponding to the high-speed frame rate (step S42), and the timing generator 34 and the AFE unit 36 are for an enlarged mode for reading out pixel information of pixels in the set region S4. Read processing is performed (step S43). Next, the image processing unit 42 performs image processing for generating an in-vivo image based on the image signal from the pixel in the region S4 (step S44), and the display unit 71 displays the generated image (step S45).

  Next, based on the input of instruction information from the input unit 372, the control unit 355 determines whether or not the enlargement mode has been changed to the standard magnification mode (step S46). When the control unit 355 determines that the mode has not been changed to the standard magnification mode (step S46: No), since the enlargement mode is continued, the process returns to step S41 and the enlargement mode read setting process is performed because the enlargement mode is continued. Each process including an expansion mode read process for reading pixel information of the pixels in the region S4 is performed at a timing corresponding to the high-speed frame rate.

  On the other hand, when the control unit 355 determines that the mode has been changed to the standard magnification mode (step S46: Yes), it is necessary to lower the frame rate in order to target the sensor region Si including all pixels of the light receiving unit 28 as a reading target. The process returns to step S32. After the frame rate is set to the standard frame rate (step S32) and the all pixel readout setting process (step S33) is performed, each process including the all pixel readout process is performed at a timing corresponding to the standard frame rate. Is called.

  As described above, in the third embodiment, in the enlargement mode, only the pixels located within the pixel region corresponding to a part of the in-vivo image that is actually enlarged and displayed are set as the pixels to be read and the frame rate is increased. In this way, it is possible to perform an enlarged display without image blur due to movement while stabilizing the transmission amount of the signal line.

(Embodiment 4)
Next, a fourth embodiment will be described. In the fourth embodiment, in accordance with the resolution distribution of the optical system of the distal end portion 5, two reading conditions having different reading area sizes for the light receiving unit 28 and different thinning rates at the time of reading processing are set, and reading is performed under each reading condition. The two images corresponding to the obtained image information are combined to generate one image.

  FIG. 34 is a block diagram of a configuration of the endoscope system according to the fourth embodiment. As shown in FIG. 34, the control device 440 of the endoscope system 400 according to the fourth embodiment is replaced with a control unit 455 having the same function as the control unit 55 in place of the control unit 55 in the control device 40 of FIG. And a read address setting unit 453 instead of the read address setting unit 53.

  As shown in FIG. 35 (1), the control unit 455 sets the remaining pixels obtained by thinning out the pixels at a predetermined interval among all the pixels in the sensor region Si of the light receiving unit 28, as shown in FIG. It is set as a pixel. Then, the control unit 455 sets all the pixels located in the region S5 in the center of the sensor region Si of the light receiving unit 28 as second readout target pixels in the readout address setting unit 453, as shown in FIG. 35 (2). Let Note that FIG. 35 (1) and FIG. 35 (2) are shown at the same scale.

  The timing generator 34 and the AFE unit 36 alternately read out the pixel information of the first readout target pixel and the pixel information of the second readout target pixel set by the readout address setting unit 453 from the light receiving unit 28, in the order of readout. The image signal is output to the control device 440.

  Compared with the image processing unit 42 shown in FIG. 2, the image processing unit 442 includes an image corresponding to the pixel information of the first pixel to be read read before and after the pixel information read by the timing generator 34. The image forming apparatus further includes a combining unit 446 that combines the image corresponding to the pixel information of the second readout target pixel to generate one in-vivo image. Note that the synthesis unit 446 has a memory that temporarily stores an image to be synthesized (not shown), and the image in the memory is rewritten for each synthesis process.

  In the image processing unit 442, the synchronization unit 43 includes an RGB image based on the pixel information of the first readout target pixel output from the readout address setting unit 453, and the pixel information of the second readout target pixel. The RGB image based on the image is synchronized.

  Specifically, as shown in FIG. 36 (1), the synchronization unit 43 thins out the pixels in the sensor region Si of the light receiving unit 28 in the reading order of the timing generator 34 and the AFE unit 36, and receives the received light. A small-sized image G52, a thinned image G61, a small-sized image G62, a thinned-out image G71, and a small-sized image G72 corresponding to all the pixels in the partial region S5 in the center of the sensor region Si of the unit 28 are output. . Each image is processed by the WB adjustment unit 44, the gain adjustment unit 45, and the γ correction unit 46, and then the two images before and after are synthesized into one image by the synthesis unit 446. Specifically, as shown in FIG. 36 (2), the combining unit 446 combines the thinned image G51 and the image G52 having a smaller size read next to the thinned image G51, thereby generating a single combined image. G5 is generated. The synthesizing unit 446 generates a composite image G6 by combining the thinned image G61 and the small image G62, and generates a composite image G7 by combining the thinned image G71 and the small image G72. . The combined images G5, G6, and G7 combined by the combining unit 446 are displayed by the display unit 71 in the combining order.

  Therefore, the display unit 71 combines the thinned image obtained by thinning and reading out the pixels in the sensor region Si of the light receiving unit 28 and an image having a small size corresponding to all the pixels in the partial region S5 of the sensor region Si of the light receiving unit 28. The image is displayed as a single in-vivo image.

  As described above, in the fourth embodiment, the pixel information of all the pixels in the central portion is synthesized by combining the images before and after reading by changing the thinning rate at the time of the reading process in accordance with the size of the reading area with respect to the light receiving unit 28. A single in-vivo image is displayed, which is a high-definition image based on the above and is a low-resolution image obtained by thinning and reading the peripheral portion. Normally, the optical system of the endoscope 1 can form an image with a high resolution in the central portion of the imaging region, but forms an image with a low resolution in the peripheral portion of the imaging region. In most cases, the central portion of the image is the region of interest of the user. For this reason, in the endoscope system, it is not always necessary to read out all the pixels of the light receiving unit 28 and make the entire image uniformly high-definition. As in the fourth embodiment, the central portion is high-definition and the peripheral portion is Even if a low-resolution image is displayed, there is no problem in in-vivo observation.

  Next, the in-vivo image display process of the endoscope system 400 will be described. FIG. 37 is a flowchart showing the processing procedure of the in-vivo image display processing of the endoscope system 400 shown in FIG.

  As shown in the flowchart of FIG. 37, the control unit 455 determines whether there is an instruction to start displaying the in-vivo image, similarly to step S1 shown in FIG. 4 (step S51). The control unit 455 repeats the determination process in step S51 until determining that there is an instruction to start displaying the in-vivo image.

  If the control unit 455 determines that there is an instruction to start displaying the in-vivo image (step S51: Yes), the control unit 455 initializes the frame number n to 1 (step S52). Next, the control unit 455 determines whether the frame number n is an odd number or an even number (step S53).

  When the control unit 455 determines that the frame number n is an odd number (step S53: odd number), the read address setting unit 453 leaves the remaining pixels after thinning out the pixels at a predetermined interval among all the pixels in the sensor region Si of the light receiving unit 28. The low-resolution readout setting process for setting the pixel No. 1 as the first readout target pixel is performed (step S54). In the front end portion 5, after the light receiving unit 28 performs the imaging process (step S 55), the timing generator 34 and the AFE unit 36 obtain pixel information of the remaining pixels obtained by thinning out the pixels at a predetermined interval from all the pixels of the light receiving unit 28. A low resolution reading process for reading is performed (step S56). Then, the image processing unit 442 performs the first image generation process for processing the image signal read out by thinning out in the low resolution reading process and generating a low resolution thinned image (step S57). The control unit 455 adds 1 to the frame number n (step S58). Note that the image generated in the first image generation process is subjected to WB adjustment, gain adjustment, and γ correction, and then held in a memory in the synthesis unit 446.

  When the control unit 455 determines that the frame number n is an even number (step S53: even number), the control unit 455 proceeds to step S59, and sets the read address setting unit 453 to a partial region S5 in the center of the sensor region Si of the light receiving unit 28. A high-definition readout setting process for setting all the pixels located as the second readout target pixels is performed (step S59). As a result, at the distal end portion 5, the light receiving unit 28 performs an imaging process (step S60), and the timing generator 34 and the AFE unit 36 read out pixel information of all the pixels in a partial region S5 at the center of the light receiving unit 28. A high-definition reading process is performed (step S61). Then, the image processing unit 442 performs a second image generation process for processing the image signal read in the high-definition reading process to generate an image with a high definition and a small size (step S62), and the control unit In 455, 1 is added to the frame number n (step S63). It should be noted that the image generated in the second image generation process is held in the memory in the synthesis unit 446 after being subjected to WB adjustment, gain adjustment, and γ correction.

  Next, the control unit 455 determines whether the frame number n is an odd number or an even number (step S64). When the control unit 455 determines that the frame number n is an even number (step S64: even number), the process proceeds to step S59, and causes the read address setting unit 453 to perform a high-definition read setting process for acquiring a high-definition image.

  When the control unit 455 determines that the frame number n is an odd number (step S64: odd number), the synthesizing unit 446 uses the thinned image generated in the first image generation process and the second image generation process. A synthesis process for synthesizing the generated high-definition image with a small size is performed (step S65). When the part of the partial region S6 of the image G5 in FIG. 36 (2) is taken as an example, the synthesizing unit 446 adjoins the lines R12, R14, and R16 (see FIG. 38 (1)) thinned out in the thinned image, respectively. After complementing the pixel information of the lines R11, R13, and R15 as shown in FIG. 38 (2), the image information De (see FIG. 38 (3)) of the high-definition small image is overwritten on the complemented image. By doing this, a single in-vivo image is synthesized.

  Next, the display unit 71 displays the in-vivo image synthesized by the synthesizing unit 446 (step S66). Then, similarly to step S6 of FIG. 4, the control unit 455 determines whether or not the end of image display has been instructed (step S67). If the control unit 455 determines that the end of image display is not instructed (step S67: No), step S53 determines whether the frame number n is an odd number or an even number in order to generate an image of the next frame. Judging. On the other hand, when the control unit 455 determines that the end of image display is instructed (step S67: Yes), the image display process ends.

  As described above, in the fourth embodiment, the size of the reading area for the light receiving unit 28 is set in accordance with the resolution of the optical system of the endoscope 1, and further, the reading area is set in accordance with the size of the reading area. By changing the pull rate, the amount of transmission transmitted to the signal line in one transmission process can be reduced and smooth in-vivo observation can be achieved compared to reading out pixel information of all pixels of the light receiving unit 28 each time. to enable.

  In the first to fourth embodiments, it is not limited to the case where the pixel to be read out of the light receiving unit 28 is automatically changed. Of course, the switch 14 of the operation unit 3 by the operator of the endoscope system, the camera head The pixel to be read out of the light receiving unit 28 may be changed in accordance with instruction information input to the control device 40 by operating a switch (not shown) of the unit 105 and the input units 72 and 372. In the first to fourth embodiments, the operator of the endoscope system inputs to the control device 40 by operating the switch 14 of the operation unit 3, the switch (not shown) of the camera head unit 105, and the input units 72 and 372. When the imaging mode (normal observation, special light observation) of the endoscope is switched in accordance with the instruction information, the pixel to be read out of the light receiving unit 28 corresponding to each imaging mode in conjunction with this switching. May be changed.

(Modification 1 of Embodiment 4)
Next, Modification 1 of Embodiment 4 will be described. In the first modification of the fourth embodiment, image analysis is performed to detect a bright area on the image, all pixels are read out so that the bright area is high definition, and other dark areas are thinned out. A case where pixel information is read will be described.

  FIG. 39 is a block diagram illustrating a configuration of an endoscope system according to the first modification of the fourth embodiment. As shown in FIG. 39, the control device 440a of the endoscope system 400a according to the first modification of the fourth embodiment has the same function as the control unit 455 instead of the control unit 455 in the control device 440 of FIG. A control unit 455a, a brightness detection unit 451a instead of the brightness detection unit 51, and a read address setting unit 453a instead of the read address setting unit 453. Further, the image processing unit 442a includes a synthesis unit 446a instead of the synthesis unit 446 illustrated in FIG.

  The brightness detection unit 451a detects an imaging region having a luminance equal to or higher than a predetermined value in the image, that is, a bright region, based on pixel information corresponding to one in-vivo image read by the timing generator 34 and the AFE unit 36. The detection result is output to the read address setting unit 453a. The bright area is an area in which pixels having luminances greater than or equal to a predetermined value are distributed.

  Here, when the surgical instrument is exposed from the opening 15 at the distal end of the endoscope 1 to perform a surgical process, or as shown in FIG. 40, the surgical instrument 16a is introduced from the outside of the abdominal wall Ws into the abdominal cavity Hs, There is a case where a surgical treatment is performed by operating the treatment tool 16a while confirming an image photographed by the endoscope 1a. In such a case, since the position of the endoscope distal end is adjusted so that the distal end of the treatment tool 16a is positioned in the visual field F1, as shown in the image G8 in FIG. 41 and the image G9 in FIG. Alternatively, light is applied to the tips of the treatment tools 16 and 16a in the vicinity of the blood vessel B, and the lower region of the image where the tips of the treatment tools 16 and 16a to be operated are positioned is displayed brighter than the upper region of the image.

  Therefore, the brightness detection unit 451a detects the brightness of the upper region At and the lower region Au as shown in an image G10 in FIG. Then, the control unit 455a determines that the pixel located in the bright region detected by the brightness detection unit 451a is the surgical treatment target region where the treatment tool 16a is located, and causes the read address setting unit 453a to transmit this bright region. Is set as the second readout target pixel to be read out.

  When the area Au is brighter than the area At and the brightness ratio between the area Au and the area At is higher than a predetermined ratio, the control unit 455a sends the read address setting unit 453a to the brighter area Au. A pixel located in the lower region Su (see FIG. 44) of the sensor region Si of the corresponding light receiving unit 28 is set as a second readout target pixel (step S59 in FIG. 37). That is, the control unit 455a causes the read address setting unit 453a to set so as to read all the pixels in the lower region Su of the sensor region Si of the light receiving unit 28. In addition, for the upper region St of the sensor region Si of the light receiving unit 28 corresponding to the region At darker than the region Au, the control unit 455a sets the remaining pixels obtained by thinning out the pixels at a predetermined interval as the first readout target pixels. The read address setting unit 453a is set (step S54 in FIG. 37).

  Then, the timing generator 34 and the AFE unit 36 perform thinning-out reading, that is, low-resolution reading processing for the upper region St in the sensor region Si of the light receiving unit 28 (step S56 in FIG. 37). In addition, the timing generator 34 and the AFE unit 36 perform high-definition reading processing (step S61 in FIG. 37) for reading all pixels in the lower region Su in the sensor region Si of the light receiving unit 28. Then, the timing generator 34 and the AFE unit 36 alternately transmit the read image information of each region to the control device 440a. Therefore, also in the first modification of the fourth embodiment, as in the fourth embodiment, the pixel information of all the pixels of the light receiving unit 28 is transmitted to the signal line in one transmission process as compared with the case where the pixel information is read each time. Transmission amount can be reduced.

  Next, the combining unit 446 combines the thinned image of the upper region St of the sensor region Si of the light receiving unit 28 and the high-definition image of the lower region Su of the sensor region Si of the light receiving unit 28 (step S65 in FIG. 37). A single in-vivo image is generated. As a result, since the in-vivo image is displayed in a high-definition state in the region to be treated where the distal ends of the treatment tools 16 and 16a are located (step S66 in FIG. 37), smooth in-vivo observation and surgical treatment are possible.

  The control units 455 and 455a correspond to the read address setting units 453 and 453a in a region S6 obtained by cutting out a partial region at the center from the sensor region Si of the light receiving unit 28 in FIG. The thinning-out rate of readout pixels may be changed with the central region S7 of 45 (2). 45 (1) and 45 (2) are shown at the same scale. Of course, the pixel located in the region S6 corresponding to the peripheral region may be set as the second readout target pixel that is a high-definition readout target, and the pixel located in the central region S7 is the first readout target. It may be set as a pixel to be read. As described above, the control unit 455a associates the region where the first readout target pixel is located with the region where the second readout target pixel is located in correspondence with the in-vivo observation conditions of the endoscope system. The read address setting units 453 and 453a may be set.

(Other embodiments)
As another embodiment of the present invention, a configuration in which a reference clock generation unit 56a is provided at the distal end portion 5b of the endoscope as in the endoscope system 100b of FIG. In this case, the reference clock signal transmitted from the reference clock generation unit 56 a to the control device 40 b via the signal line of the collective cable 31 may be a signal having a longer interval than the drive signal for the light receiving unit 28. For this reason, in the endoscope system 100b, an accurate reference clock signal with little deterioration can be output to the control device 40b even through a long signal line, and the signal line compared to the endoscope system 100 can be output. It is also possible to reduce the influence of the reference clock signal on the image signal transmitted via. The control device 40b is provided with a synchronization signal generator 56b that generates a predetermined synchronization signal for each component based on the reference clock output from the reference clock generator 56a.

  Further, as another embodiment of the present invention, as in the endoscope system 100c of FIG. 47, the distal end portion 5c of the endoscope and the control device 40c are connected by a collective cable 31C formed of an optical fiber 31c. The image signal can be converted into an optical signal and transmitted, so that a large-capacity signal can be transmitted. In this case, as shown in FIG. 47, the CMOS image pickup device 80c at the distal end portion 5c of the endoscope is further added with an E / O conversion portion 39c that converts an electrical signal into an optical signal in the CMOS image pickup device 80 described above. The configuration. And what is necessary is just to provide the O / E conversion part 41c which converts an optical signal into an electric signal in the control apparatus 40c.

  As another embodiment of the present invention, as in the endoscope system 100d of FIG. 48, a white light source 61, a special light source 62, and an LED driver 64d are provided at the distal end portion 5d of the endoscope, and a light guide is provided. It is also possible to emit light directly from the tip 5d without going through the light and irradiate the light from the light source to the outside without waste. In this case, the LED driver 64d uses the light source driving signal output at a predetermined timing from the illumination timing generation unit 65d of the control device 40d via the predetermined signal line 31d in the collective cable 31D, and the white light source 61, The special light source 62 is driven.

  Further, the present embodiment is not limited to an endoscope system, and can be improved in efficiency even when applied to a photographing apparatus such as a digital camera, a digital single lens reflex camera, a digital video camera, or a camera-equipped mobile phone.

DESCRIPTION OF SYMBOLS 1 Endoscope 2,102 Insertion part 3 Operation part 4 Universal code 5, 5a-5d Tip part 6 Bending part 7 Flexible pipe part 8 Connector part 9 Light guide connector 10 Electric contact part 11 Air supply mouthpiece 12 Bending knob 13 Treatment Tool insertion part 14 Switch 15, 15a Opening part 16, 16a Treatment tool 21 Light guide 22 Illumination lens 23 Observation window 24a, 24b Lens 25 Cover glass 26 Circuit board 27 On-chip filter 28 Light receiving part 30 Chip capacitor 31c Optical fiber 31, 31C , 31D, 131 Collective cable 31d Signal line 32 Electrode 33 Treatment device channel 34, 34a Timing generator 34b Mask group 35 Control circuit 36, 36a AFE unit 37 Noise removal unit 38 A / D conversion unit 39 P / S conversion unit 39c E / O converter 40, 40a to 40d, 240, 240a to 240c, 340, 440, 440a Control device 41 S / P conversion unit 41c O / E conversion unit 42, 442, 442a Image processing unit 43 Synchronization unit 44 WB adjustment unit 45 Gain adjustment unit 46 γ correction unit 47 D / A conversion unit 48 Format change unit 49 Sample memory 50 Still image memory 51, 451a Brightness detection unit 52 Dimming unit 53, 53a, 253, 353, 453, 453a Read address setting unit 54 CMOS Drive signal generator 55, 255, 255a, 255b, 255c, 355, 455, 455a Controller 56, 56a Reference clock generator 56b Sync signal generator 60 Light source device 61 White light source 62 Special light source 63 Light source drive circuit 64, 64d LED driver 65d illumination timing generation unit 71 Display unit 72,372 Input unit 73 Output unit 74 Storage unit 80, 80c CMOS image sensor 100, 100a to 100d, 101, 200, 200a to 200c, 300, 400, 400a Endoscope system 105 Camera head unit 111 Eyepiece unit 123 Connector 132 Connection line 133 Signal line 213 Insertion path 214 Switch 215 Detection circuit 216 Signal line 251a Motion detection unit 251b Treatment instrument detection unit 254,354 Frame rate switching unit 275 Treatment instrument insertion detection unit 375 Expansion mode setting unit 446, 446a Composition Part

Claims (15)

An imaging unit capable of outputting, as pixel information, an electrical signal after photoelectric conversion from a pixel arbitrarily designated as a readout target among a plurality of pixels for imaging;
A setting unit capable of arbitrarily setting a pixel to be read in the imaging unit;
A readout unit that reads out pixel information by outputting pixel information from a pixel designated as a readout target in the imaging unit according to the setting of the setting unit;
An image processing unit for generating an image from the pixel information read by the reading unit;
A display unit for displaying an image generated by the image processing unit;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, further comprising a control unit that changes a pixel to be read set by the setting unit.   The imaging apparatus according to claim 2, wherein the control unit changes a pixel to be read set by the setting unit according to an optical system in the imaging unit. A detection unit for detecting an imaging region having a luminance of a predetermined value or more based on pixel information of pixels of the predetermined line read by the reading unit;
The imaging device according to claim 2, wherein the control unit changes a pixel to be read set by the setting unit based on a detection result by the detection unit.   The control unit reads out the setting unit sets the next line of the predetermined line read by the reading unit or the same line corresponding to the next frame based on the detection result of the detection unit. The imaging device according to claim 4, wherein a target pixel is changed. The display unit displays an image in a predetermined shape by cutting a predetermined part from the image,
The control unit changes the pixel to be read set by the setting unit to a pixel located in a pixel region corresponding to a predetermined shape of an image displayed by the display unit. Imaging device. A plurality of the predetermined shapes are set,
The control unit outputs display shape information indicating a predetermined shape of an image displayed by the display unit among the plurality of predetermined shapes to the reading unit,
The reading unit has in advance position information of a plurality of pixel regions respectively corresponding to the plurality of predetermined shapes, and pixels of pixels located in the pixel region corresponding to the predetermined shape indicated by the display shape information output from the control unit The imaging apparatus according to claim 6, wherein pixel information is read out. A reading speed changing unit for changing the reading speed of the pixel information by the reading unit;
The imaging apparatus according to claim 2, wherein the control unit changes a pixel to be read set by the setting unit according to a reading speed changed by the speed changing unit. A transmission unit that transmits the electrical signal output by the imaging unit in a predetermined signal format in a wired manner;
The control unit changes a pixel to be read set by the setting unit so that a transmission amount of pixel information per unit time in the transmission unit does not exceed a predetermined standard transmission amount. The imaging device described in 1.   When the reading speed is changed from the first reading speed to the second reading speed higher than the first reading speed by the speed changing section, the control section determines the pixel to be read set by the setting section. The image pickup apparatus according to claim 8, wherein all the pixels of the image pickup unit are changed to remaining pixels obtained by thinning. A movement amount detection unit that detects a relative movement amount of the imaging unit with respect to a subject image;
The imaging apparatus according to claim 8, wherein the speed changing unit changes the reading speed according to a motion amount detected by the motion amount detection unit. A functional unit operable to move forward and backward in an imaging area in the imaging unit;
A functional unit detection unit for detecting whether or not the functional unit is located in the imaging region;
Further comprising
The imaging apparatus according to claim 8, wherein the speed changing unit changes the reading speed according to a detection result of the functional unit detection unit. A mode setting unit capable of setting an enlargement mode for partially enlarging and displaying the image displayed on the display unit;
The imaging apparatus according to claim 8, wherein the speed changing unit changes the reading speed according to the setting of the enlargement mode by the mode setting unit. The control unit causes the setting unit to set, as a first readout target pixel, the remaining pixels obtained by thinning out the pixels at a predetermined interval among all the pixels of the imaging unit, and a part of the entire pixel region of the imaging unit A pixel located in the area of is set as a second readout target pixel,
The reading unit alternately reads pixel information of the first pixel to be read and pixel information of the second pixel to be read,
The image processing unit includes an image corresponding to the pixel information of the first pixel to be read and the pixel information of the second pixel to be read out before and after the pixel information read by the reading unit. The imaging apparatus according to claim 2, wherein a single image is generated by combining the corresponding images. A detection unit for detecting an imaging region having a luminance equal to or higher than a predetermined value in the image based on pixel information corresponding to the one image read by the reading unit;
15. The imaging apparatus according to claim 14, wherein the control unit causes the setting unit to set a pixel located in a bright region detected by the detection unit as the second readout target pixel.

Images