JP2016178965A - Scanning endoscope system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a scanning endoscope system capable of acquiring a high definition image by executing efficient processing.SOLUTION: An image creation part 25c includes a data storage part 55 for image creation in which a plurality of storage regions for storing light intensity information for composing one pixel are provided for each pixel on a two-dimensional image, a coordinate conversion table 57 for associating a detection order n of the light intensity information detected sequentially in a detection unit 23 with the storage regions of a plurality of pixels on the two-dimensional image, and a processing part 52 for sequentially associating the light intensity information corresponding to the detection order n respectively with the storage regions of the plurality of pixels on the two-dimensional image with the detection order n of the light intensity information as a main key based on the coordinate conversion table 57.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a scanning endoscope system that acquires an image by scanning a subject.

  Conventionally, in endoscopes used in the medical field and the like, various techniques for reducing the diameter of an insertion portion inserted into the body cavity of the subject have been proposed in order to reduce the burden on the subject. Has been. As an example of such a technique, a scanning endoscope that does not have a solid-state imaging device in an insertion portion, and a scanning endoscope system that includes the scanning endoscope are known. Yes.

  Specifically, in the scanning endoscope system, for example, a subject is two-dimensionally scanned along a predetermined scanning path by swinging the tip of an optical fiber for illumination that guides light emitted from a light source unit. Then, return light from the subject is received by a light receiving optical fiber, and an image of the subject is generated based on the return light received by the light receiving optical fiber.

  As a technique for generating such an image, for example, Patent Document 1 discloses a correspondence between a position (sampling point) of excitation light sequentially sampled by calibration and a pixel position (raster coordinate) of an endoscopic image. A technique is disclosed in which each digital detection signal obtained at each sampling point is assigned as corresponding pixel address data with reference to a remapping table created by obtaining the relationship.

JP2013-121455A

  However, in particular, sample points of each sampling data acquired by spiral scanning have a gap between a coarse portion and a dense portion, and each sample point has a one-to-one correspondence with each pixel position on the image. Since it does not correspond, it may be difficult to obtain a sufficiently high-definition image over the entire area.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a scanning endoscope system capable of obtaining a high-definition image by efficient processing.

  A scanning endoscope system according to an aspect of the present invention provides light intensity information of return light from the subject according to an irradiation position of illumination light scanned on the subject by the scanning endoscope. A detection unit that sequentially detects each irradiation position, a storage unit in which a plurality of storage areas for storing light intensity information for constituting one pixel are provided for each pixel on a two-dimensional image, and the detection unit The detection unit sequentially detects, based on the coordinate conversion table for associating the detection order of the light intensity information sequentially detected in Step 2 and the storage areas of the plurality of pixels on the two-dimensional image, and the coordinate conversion table. A processing unit that sequentially associates the light intensity information corresponding to each of the detection orders with the storage areas of the plurality of pixels on the two-dimensional image, using the detection order of the light intensity information as a main key. , And it has a.

  According to the scanning endoscope system of the present invention, high-definition images can be obtained by efficient processing.

The figure which shows the structure of the principal part of a scanning endoscope system. Sectional drawing for demonstrating the structure of an actuator part The figure which shows an example of the signal waveform of the drive signal supplied to an actuator part The figure which shows an example of the spiral scanning path | route from the center point A to the outermost point B The figure which shows an example of the spiral scanning path | route from the outermost point B to the center point A Functional block diagram showing the main part of the image generator The figure which shows an example of each information recorded on the data storage part for image generation The figure which shows an example of the produced | generated frame image data The figure which shows an example of the coordinate conversion table which specifies a raster address by using a spiral address as a primary key The figure which shows an example of the coefficient table for weighting coefficient search The figure for demonstrating the write-in process of the light intensity information with respect to the data storage part for image generation Flowchart showing a frame image generation routine

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The drawings relate to an embodiment of the present invention, FIG. 1 is a diagram showing a configuration of a main part of a scanning endoscope system, FIG. 2 is a cross-sectional view for explaining the configuration of an actuator unit, and FIG. FIG. 4 is a diagram showing an example of the signal waveform of the supplied drive signal, FIG. 4 is a diagram showing an example of a spiral scanning path from the center point A to the outermost point B, and FIG. FIG. 6 is a functional block diagram showing the main part of the image generation unit, FIG. 7 is a diagram showing an example of each information recorded in the image generation data storage unit, and FIG. Is a diagram showing an example of generated frame image data, FIG. 9 is a diagram showing an example of a coordinate conversion table for specifying a raster address using a spiral address as a primary key, and FIG. 10 is a diagram showing an example of a coefficient table for weighting factor search. FIG. 11 shows the image generation data storage unit. Diagram for explaining the process of writing light intensity information, FIG. 12 is a flowchart showing a frame image generation routine.

  As shown in FIG. 1, a scanning endoscope system 1 includes, for example, a scanning endoscope 2 inserted into a body cavity of a subject, a main body device 3 to which the endoscope 2 can be connected, And a display device 4 connected to the main body device 3.

  The endoscope 2 includes an insertion portion 11 having an elongated shape that can be inserted into a body cavity of a subject.

  A connector portion 61 for detachably connecting the endoscope 2 to the connector receiving portion 62 of the main body device 3 is provided at the proximal end portion of the insertion portion 11.

  Although not shown in the drawings, an electrical connector device for electrically connecting the endoscope 2 and the main body device 3 is provided inside the connector portion 61 and the connector receiving portion 62. Although not shown, an optical connector device for optically connecting the endoscope 2 and the main body device 3 is provided inside the connector portion 61 and the connector receiving portion 62.

  An illumination fiber 12 that is an optical fiber that guides the illumination light supplied from the light source unit 21 of the main body device 3 to the illumination optical system 14 in a portion from the proximal end portion to the distal end portion inside the insertion portion 11, and A light receiving fiber 13 including one or more optical fibers for receiving return light from the subject and guiding it to the detection unit 23 of the main body device 3 is inserted therethrough.

  The incident end including the light incident surface of the illumination fiber 12 is disposed in a multiplexer 32 provided inside the main body device 3. Further, the emission end portion including the light emission surface of the illumination fiber 12 is disposed in the vicinity of the light incident surface of the lens 14 a provided at the distal end portion of the insertion portion 11.

  The incident end including the light incident surface of the light receiving fiber 13 is fixedly disposed around the light emitting surface of the lens 14 b at the distal end surface of the distal end portion of the insertion portion 11. Further, the emission end portion including the light emission surface of the light receiving fiber 13 is arranged in a duplexer 36 provided inside the main body device 3.

  The illumination optical system 14 includes a lens 14a on which illumination light having passed through the light emission surface of the illumination fiber 12 is incident, and a lens 14b that emits illumination light having passed through the lens 14a to a subject.

  An actuator unit 15 that is driven based on a drive signal supplied from the driver unit 22 of the main unit 3 is provided in the middle of the illumination fiber 12 on the distal end side of the insertion unit 11.

  The illumination fiber 12 and the actuator unit 15 are arranged so as to have the positional relationship shown in FIG. 2, for example, in a cross section perpendicular to the longitudinal axis direction of the insertion unit 11. FIG. 2 is a cross-sectional view for explaining the configuration of the actuator unit.

  As shown in FIG. 2, a ferrule 41 as a joining member is disposed between the illumination fiber 12 and the actuator unit 15. Specifically, the ferrule 41 is made of, for example, zirconia (ceramic) or nickel.

  As shown in FIG. 2, the ferrule 41 is formed in a quadrangular prism shape, and side surfaces 42 a and 42 c that are perpendicular to the X-axis direction, which is a first axial direction orthogonal to the longitudinal axis direction of the insertion portion 11, Side surfaces 42b and 42d perpendicular to the Y-axis direction, which is the second axial direction perpendicular to the longitudinal axis direction of the insertion portion 11, are included. The illumination fiber 12 is fixedly arranged at the center of the ferrule 41. The ferrule 41 may be formed as a shape other than the quadrangular column as long as it has a column shape.

  As shown in FIG. 2, the actuator section 15 includes a piezoelectric element 15a disposed along the side surface 42a, a piezoelectric element 15b disposed along the side surface 42b, and a piezoelectric element 15c disposed along the side surface 42c. , And a piezoelectric element 15d disposed along the side surface 42d.

  The piezoelectric elements 15 a to 15 d are configured to be polarized in a polarization direction set individually in advance and expand and contract in accordance with a drive signal supplied from the main body device 3.

  That is, the endoscope 2 is configured to scan the subject with illumination light emitted from the light source unit 21 of the main body device 3 and to receive the return light from the subject through the light receiving fiber 13.

  The main unit 3 includes a light source unit 21, a driver unit 22, a detection unit 23, a nonvolatile memory 24, and a controller 25.

  The light source unit 21 includes light sources 31a, 31b, and 31c and a multiplexer 32.

  The light source 31a includes a laser light source, for example, and is configured to emit red wavelength band light (hereinafter also referred to as R light) to the multiplexer 32 when light is emitted under the control of the controller 25. Yes.

  The light source 31b includes, for example, a laser light source, and is configured to emit green wavelength band light (hereinafter also referred to as G light) to the multiplexer 32 when light is emitted under the control of the controller 25. Yes.

  The light source 31c includes, for example, a laser light source, and is configured to emit light in a blue wavelength band (hereinafter also referred to as B light) to the multiplexer 32 when light is emitted under the control of the controller 25. Yes.

  The multiplexer 32 multiplexes the R light emitted from the light source 31a, the G light emitted from the light source 31b, and the B light emitted from the light source 31c onto the light incident surface of the illumination fiber 12. It is configured to supply.

  The driver unit 22 includes a signal generator 33, D / A converters 34a and 34b, and an amplifier 35.

  Based on the control of the controller 25, the signal generator 33 is a predetermined drive signal as shown by a broken line in FIG. 3, for example, as a first drive signal for swinging the emission end of the illumination fiber 12 in the X-axis direction. A signal having a signal waveform obtained by performing the above modulation on a sine wave is generated and output to the D / A converter 34a. Further, the signal generator 33 is, for example, indicated by a one-dot chain line in FIG. 3 as a second drive signal for swinging the emission end of the illumination fiber 12 in the Y-axis direction based on the control of the controller 25. A signal having a signal waveform in which the phase of the first drive signal is shifted by 90 ° is generated and output to the D / A converter 34b. FIG. 3 is a diagram illustrating an example of a signal waveform of a drive signal supplied to the actuator unit.

  The D / A converter 34 a is configured to convert the digital first drive signal output from the signal generator 33 into an analog first drive signal and output the analog first drive signal to the amplifier 35.

  The D / A converter 34 b is configured to convert the digital second drive signal output from the signal generator 33 into an analog second drive signal and output the analog second drive signal to the amplifier 35.

  The amplifier 35 is configured to amplify the first and second drive signals output from the D / A converters 34 a and 34 b and output the amplified signals to the actuator unit 15.

  Here, for example, a first drive signal having a signal waveform as shown by a broken line in FIG. 3 is supplied to the piezoelectric elements 15a and 15c of the actuator unit 15, and a signal waveform as shown by a one-dot chain line in FIG. Is supplied to the piezoelectric elements 15b and 15d of the actuator unit 15, the emission end of the illumination fiber 12 is swung in a spiral shape, and the subject is responsive to such a swing. Are scanned by a spiral scanning path as shown in FIGS. FIG. 4 is a diagram illustrating an example of a spiral scanning path from the center point A to the outermost point B. FIG. FIG. 5 is a diagram illustrating an example of a spiral scanning path from the outermost point B to the center point A. FIG.

  Specifically, at time T1, illumination light is irradiated to a position corresponding to the center point A of the irradiation position of the illumination light on the surface of the subject. Thereafter, as the amplitudes of the first and second drive signals increase from time T1 to time T2, the irradiation position of the illumination light on the surface of the subject starts from the center point A and starts to the first spiral scanning path. When the time T2 is reached, the illumination light is irradiated to the outermost point B of the illumination light irradiation position on the surface of the subject. Then, as the amplitudes of the first and second drive signals decrease from time T2 to time T3, the irradiation position of the illumination light on the surface of the subject is scanned in the second spiral shape from the outermost point B to the inside. When it is displaced so as to draw a route and further reaches time T3, illumination light is applied to the center point A on the surface of the subject.

  That is, the actuator unit 15 is emitted to the subject through the emission end by swinging the emission end of the illumination fiber 12 based on the first and second drive signals supplied from the driver unit 22. The illumination light irradiation position can be displaced along the spiral scanning path shown in FIGS. 4 and 5.

  The detection unit 23 includes a duplexer 36, detectors 37a, 37b, and 37c, and A / D converters 38a, 38b, and 38c.

  The demultiplexer 36 includes a dichroic mirror and the like, and separates the return light emitted from the light emitting surface of the light receiving fiber 13 into light for each of R (red), G (green), and B (blue) color components. And it is comprised so that it may radiate | emit to the detectors 37a, 37b, and 37c.

  The detector 37a includes, for example, an avalanche photodiode, and sequentially detects the intensity of the R light output from the branching filter 36 at every predetermined detection timing, and an analog signal corresponding to the detected intensity of the R light. An R signal is generated and output to the A / D converter 38a.

  The detector 37b includes, for example, an avalanche photodiode, and sequentially detects the intensity of the G light output from the branching filter 36 at every predetermined detection timing, and an analog signal corresponding to the detected intensity of the G light. A G signal is generated and output to the A / D converter 38b.

  The detector 37c includes, for example, an avalanche photodiode, and sequentially detects the intensity of the B light output from the branching filter 36 at every predetermined detection timing, and an analog signal corresponding to the detected intensity of the B light. A B signal is generated and output to the A / D converter 38c.

  The A / D converter 38a converts the analog R signal output from the detector 37a into a digital R signal, and converts the converted R signal into return light (return light in the red wavelength band) from the subject. The light intensity information is output to the controller 25.

  The A / D converter 38b converts the analog G signal output from the detector 37b into a digital G signal, and converts the converted G signal into return light (return light in the green wavelength band) from the subject. The light intensity information is output to the controller 25.

  The A / D converter 38c converts the analog B signal output from the detector 37c into a digital B signal, and converts the converted B signal into return light (return light in the blue wavelength band) from the subject. The light intensity information is output to the controller 25.

  As described above, in the present embodiment, the detection unit 23 realizes a function as a detection unit for sequentially detecting the light intensity information of the return light from the subject at each irradiation position.

  The memory 24 stores various control information used when the main device 3 is controlled. That is, the memory 24 stores in advance information including parameters such as signal level, frequency, and phase difference for specifying the signal waveform of FIG. 3 as control information. The memory 24 stores in advance scanning position data indicating the position (irradiation position) of the illumination light when the subject is scanned along the spiral scanning path.

  For example, the scanning position data is stored in the memory 24 as coordinate position data indicating the irradiation position of the illumination light in the spiral scanning path (first and second spiral scanning paths) as shown in FIGS. Stored in advance. That is, in the memory 24, coordinate position data indicating the irradiation position at each timing when the driver unit 22 drives the actuator unit 15 by the first and second drive signals is stored as scanning position data. Thereby, when the light intensity information is sequentially detected at each predetermined detection timing in the detection unit 23, the detection order n of the light intensity information and the irradiation position of the illumination light scanned on the subject are uniquely defined. It is possible to associate with.

  The controller 25 includes, for example, an integrated circuit such as a field programmable gate array (FPGA), and includes a light source control unit 25a, a scan control unit 25b, and an image generation unit 25c. .

  Based on the control information read from the memory 24, the light source control unit 25a is configured to, for example, control the light source unit 21 to cause the light sources 31a to 31c to emit light simultaneously.

  Based on the control information read from the memory 24, the scanning control unit 25b is configured to control the driver unit 22 to generate a drive signal having a signal waveform as shown in FIG. Yes.

  The image generation unit 25c generates an observation image for one frame using the digital signal (light intensity information) output from the detection unit 23, and sequentially outputs the generated observation image for one frame to the display device 4. It is configured as follows. In the present embodiment, specifically, the image generation unit 25c, for example, performs raster scan observation based on light intensity information sequentially detected along a spiral irradiation locus (spiral scanning locus) illustrated in FIG. An image can be generated.

  The display device 4 includes, for example, a monitor and is configured to display an observation image output from the main body device 3.

  Next, an observation image (raster image) generation process performed in the image generation unit 25c will be described with reference to FIGS. Note that the image generation unit 25c actually applies R, G to each pixel on the raster image based on the light intensity information of the R light, G light, and B light detected by demultiplexing in the detection unit 23. , B are performed in parallel or sequentially in order to set the luminance information of each color, etc., but in the following description, in order to simplify the description, they will be described in one process without distinguishing them.

  Light intensity information is sequentially input from the detection unit 23 as sampling data detected at each irradiation position by spiral scanning to the image generation unit 25c. Here, for example, the light intensity information is accompanied by a detection order n (= 0 to N) counted for each sampling point (irradiation position) from the center point A to the outermost point B (see FIG. 4). Based on this detection order n, the sampling point of each light intensity information is uniquely determined. In other words, in the present embodiment, the detection order n functions as a spiral address n indicating the detection position of each light intensity information sequentially detected by spiral scanning.

  When such light intensity information is input, the image generation unit 25c calculates a position on the two-dimensional image corresponding to the irradiation position of the illumination light in the real space and each pixel position on the two-dimensional image. Based on the relationship, the light intensity information sequentially detected for each irradiation position is associated with each pixel on the raster coordinates. Then, the image generation unit 25c calculates pixel values (for example, luminance information) of each pixel based on the associated light intensity information, thereby obtaining two-dimensional image information (for displaying an observation image of one frame) ( Frame image data).

  In this case, the image generation unit 25c first generates a data group in which each pixel is associated with a plurality of light detection information in order to calculate each pixel value of the two-dimensional image by complementing the plurality of light intensity information. . Then, for example, the image generation unit 25c performs weighted average processing of each light detection information for each pixel, and calculates each pixel value of the two-dimensional image based on each weighted average value of the calculated light intensity information.

  In order to realize such processing, the image generation unit 25c of the present embodiment functionally includes, for example, an image memory 50, a table holding unit 51, and a processing unit 52 as shown in FIG. It is configured.

  The image memory 50 of the image generation unit 25c is, for example, for image generation as a storage unit in which a plurality of storage areas for storing light intensity information for constituting one pixel are provided for each pixel on the two-dimensional image. A data storage unit 55 and a frame image data storage unit 56 for storing frame image data generated based on the image generation data stored in the image generation data storage unit 55 are configured. .

  Specifically, for example, as shown in FIG. 7, the image generation data storage unit 55 is configured to configure one pixel for each raster address (y, x) indicating the pixel position on the two-dimensional image. A storage area for storing a plurality of (for example, eight) pieces of light intensity information is set as an element. Further, the image generation data storage unit 55 is attached with index information for searching for a weight coefficient corresponding to the light intensity information stored in each storage area.

  For example, as shown in FIG. 8, the frame image data storage unit 56 stores pixel values (Image Data) including luminance information for each raster address (y, x) indicating the pixel position on the two-dimensional image. A storage area is set for storing.

  The table holding unit 51 of the image generation unit 25c includes, as a lookup table, a spiral address (detection order) n of light intensity information sequentially detected by the detection unit 23 and a storage area for a plurality of pixels on the two-dimensional image. A coordinate conversion table 57 for associating and a coefficient table 58 for searching for a weight coefficient to be multiplied by each light intensity information in the weighted average processing for each pixel are set and held in advance. The table holding unit 51 reads out unique data for each endoscope corresponding to the coordinate conversion table 57 and the coefficient table 58 held in the endoscope 2 when the endoscope 2 is connected, It is also possible to appropriately correct the coordinate conversion table 57 and the coefficient table 58 based on the unique data.

  Specifically, for example, as shown in FIG. 9, the coordinate conversion table 57 uses a spiral address (detection order) n of light intensity information sequentially detected by the detection unit 23 as a main key to store one light intensity information. It is possible to associate with a storage area of up to seven pixels.

  For example, as shown in FIG. 10, the coefficient table 58 can associate index information attached to each storage area of the image generation data storage unit 55 with a weighting coefficient. These weighting factors are, for example, the position on the two-dimensional image corresponding to the irradiation position of the illumination light by spiral scanning and the position on the two-dimensional image of the pixel corresponding to the storage area in which the light intensity information is stored. It is set according to the distance. In this case, in order to reduce the data amount of the coefficient table 58 while securing the number of digits of the weighting coefficient to a sufficient number, the weighting coefficient is preliminarily patterned into a predetermined number (in the illustrated example, the pattern is 61 patterns). It is desirable that

  The coordinate conversion table 57 and the coefficient table 58 are desirably set or corrected individually for each endoscope 2 by calibration or the like.

  Next, frame image generation processing executed by the processing unit 52 of the image generation unit 25c will be described according to the flowchart of the frame image generation routine shown in FIG.

  This routine is executed for each frame. When the routine starts, the processing unit 52 first initializes the spiral address n to “0” in step S101 (n ← 0).

  In step S <b> 102, the processing unit 52 acquires n-th light intensity information corresponding to the current spiral address n from the detection unit 23.

  In subsequent step S103, the processing unit 52 refers to the coordinate conversion table 57 held in the table holding unit 51, and searches for a raster address group corresponding to the currently acquired light intensity information using the spiral address n as a main key.

  Then, when proceeding to step S104, the processing unit 52 determines the corresponding raster address (y, x) in the image generation data storage unit 55 of the image memory 50 based on the raster address group obtained by the search in step S103. Each light intensity information is written in the storage area. That is, for example, as shown in FIGS. 9 and 11, as a search result of the raster address corresponding to the current spiral address n, (0, 1), (0, 2), (1, 0), (1, 1 ), (1,2), (1,3), and (2,1) are extracted, the processing unit 52 writes the light intensity information in the storage area of each raster address.

  In step S105 from step S104, the processing unit 52 checks whether or not the current spiral address n has reached the maximum value N.

  If the spiral address n has not yet reached the maximum value N in step S105, the processing unit 52 proceeds to step S106, updates the spiral address n to the next address (n ← n + 1), and then proceeds to step S102. Return to.

  On the other hand, when the spiral address n has reached the maximum value N in step S105, the processing unit 52 proceeds to step S107.

  When the processing proceeds from step S105 to step S107, the processing unit 52 initializes the raster address (y, x) to (0, 0) ((y, x) ← (0, 0)).

  In step S <b> 108, the processing unit 52 transmits a data group of light intensity information corresponding to the current raster address (y, x) from the image generation data storage unit 55 of the image memory 50 to the image generation data storage unit 55. Read from each storage area. Further, the processing unit 52 reads the weighting coefficient corresponding to each light intensity information from the coefficient table 58 of the table holding unit 51 using the index information attached to the storage area of each read light intensity information.

  In subsequent step S109, for example, the processing unit 52 performs a weighted average process using the light intensity information and the weighting coefficient read in step S108, and based on the calculated weighted average value of the light intensity information, the raster address (y, The pixel value of the pixel corresponding to x) is calculated.

  In step S110, the processing unit 52 writes the pixel value obtained by the calculation in step S109 into the storage area of the corresponding raster address (y, x) in the frame image data storage unit 56 of the image memory 50. Thereafter, the process proceeds to step S111.

  When the process proceeds from step S110 to step S111, the processing unit 52 checks whether or not the current raster address (y, x) has reached the maximum value. That is, for example, when generating a pixel value of 400 × 400 pixels as frame image data, the processing unit 52 checks whether or not the current raster address (y, x) has reached (399, 399).

  In step S111, when the raster address (y, x) has not yet reached the maximum value, the processing unit 52 proceeds to step S112, and after updating the raster address (y, x) to the next address, The process returns to step S108. In the present embodiment, the raster address (y, x) is updated sequentially for each scanning line. That is, in this update process, the processing unit 52 sequentially updates only the value of x in the raster address (y, x) until the maximum value is reached ((y, x) ← (y, x + 1)), and When the value reaches the maximum value, it is updated to the head address on the next scanning line ((y, x) ← (y + 1, 0)). Then, on the same investigation line, only the value of x is sequentially updated until it reaches the maximum value ((y, x) ← (y, x + 1)), and when the value of x reaches the maximum value, Update to the first address (((y, x) ← (y + 1, 0)).

  On the other hand, if the raster address (y, x) has reached the maximum value in step S111, the processing unit 52 exits the routine to end the processing of this frame.

  According to such an embodiment, the image generation data storage unit 55 in which a plurality of storage areas for storing light intensity information for constituting one pixel are provided for each pixel on the two-dimensional image, and detection Based on the coordinate conversion table 57 for associating the detection order n of the light intensity information sequentially detected by the unit 23 with the storage areas of the plurality of pixels on the two-dimensional image, and sequentially detecting the detection unit 23 A processing unit 52 that sequentially associates the light intensity information corresponding to each detection order n with a storage area of a plurality of pixels on the two-dimensional image using the detection order n of the detected light intensity information as a main key. By configuring the unit 25c, a high-definition image can be obtained by efficient processing.

  That is, a plurality of storage areas for storing light intensity information for constituting one pixel are provided for each pixel on the two-dimensional image to constitute the image generation data storage unit 55, and the light intensity detected by spiral scanning. By associating information with storage areas of a plurality of pixels, pixel values of each pixel can be calculated by complementing the plurality of light intensity information, and a high-definition image can be obtained.

  At that time, efficient complement processing can be realized by sequentially associating the light intensity information detected sequentially with the detection order n as a main key and the light intensity information corresponding to the storage areas of a plurality of pixels. That is, for example, when trying to associate light intensity information with each pixel using the raster address of each pixel as the main key, the association should be performed only after all light intensity information is detected by spiral scanning. However, if the detection order (spiral address) n is the primary key as in this embodiment, the light intensity information can be associated with each pixel in parallel with the detection of the light intensity information by spiral scanning. it can. As a result, a processing time for associating light intensity information can be sufficiently ensured within a limited processing time for one frame, and a large amount of light intensity information can be associated with each pixel.

  In addition, in the complementing process, a coefficient corresponding to the distance between the position on the two-dimensional image corresponding to the irradiation position of the illumination light and the position on the two-dimensional image of the pixel corresponding to the storage area in which the light intensity information is stored And multiplying the light intensity information by the coefficient, it is possible to realize a highly accurate complementary process.

  In addition, by patterning such coefficients into a plurality of preset coefficients, the memory capacity required to store the coefficients can be efficiently reduced even when a large amount of light intensity information is associated with each pixel. be able to.

  In addition, this invention is not limited to each embodiment described above, A various deformation | transformation and change are possible, and they are also in the technical scope of this invention. For example, in the above-described embodiment, an example in which light intensity information detected by spiral scanning is associated with each pixel of an observation image in a raster scan format has been described, but the present invention is not limited to this. Of course.

DESCRIPTION OF SYMBOLS 1 ... Scanning endoscope system 2 ... Endoscope 3 ... Main body apparatus 4 ... Display apparatus 11 ... Insertion part 12 ... Illumination fiber 13 ... Light receiving fiber 14 ... Illumination optical system 14a ... Lens 14b ... Lens 15 ... Actuator part DESCRIPTION OF SYMBOLS 21 ... Light source unit 22 ... Driver unit 23 ... Detection unit 24 ... Memory 25 ... Controller 25a ... Light source control part 25b ... Scan control part 25c ... Image generation part 31a-31c ... Light source 32 ... Multiplexer 33 ... Signal generator 34a, 34b ... Converter 35 ... Amplifier 36 ... Demultiplexer 37a-37c ... Detector 38a-38c ... A / D converter 41 ... Ferrule 50 ... Image memory 51 ... Table holding unit 52 ... Processing unit 55 ... Data storage for image generation 56: Frame image data storage 57: Coordinate conversion Buru 58 ... coefficient table

Claims (4)

A detection unit that sequentially detects the light intensity information of the return light from the subject according to the irradiation position of the illumination light scanned on the subject by the scanning endoscope for each irradiation position of the irradiation light;
A storage unit in which a plurality of storage areas for storing light intensity information for constituting one pixel are provided for each pixel on the two-dimensional image;
A coordinate conversion table for associating the detection order of the light intensity information sequentially detected by the detection unit with the storage areas of the plurality of pixels on the two-dimensional image;
Based on the coordinate conversion table, the detection order of the light intensity information sequentially detected by the detection unit is used as a main key, and the light intensity information respectively corresponding to the detection order is a plurality of the pixels on the two-dimensional image A processing unit sequentially corresponding to the storage areas of
A scanning endoscope system comprising:   A coefficient table in which coefficients to be multiplied by the light intensity information are set to generate pixel values on the two-dimensional image from the light intensity information stored in the plurality of storage areas. The scanning endoscope system according to claim 1.   The coefficient is a distance between a position on the two-dimensional image corresponding to the irradiation position of the illumination light and a position on the two-dimensional image of the pixel corresponding to the storage area in which the light intensity information is stored. The scanning endoscope system according to claim 2, wherein the scanning endoscope system has a value corresponding to In the coefficient table, a plurality of pre-patterned coefficients are set,
4. The scanning according to claim 2, wherein each coefficient is associated with the light intensity information stored in each storage area based on index information attached to each storage area. 5. Type endoscope system.

Images