KR101057703B1 - Multifaceted Video Variable Display System of Multifaceted Endoscope - Google Patents

Abstract

According to the present invention, a plurality of cameras are arranged in multiple planes to have different shooting angles in an endoscope module inserted into an organ of a patient, and the shooting range of the multiple cameras arranged in multiple planes can be varied, whereby the captured image is displayed on one monitor screen. According to the present invention, there is provided a multi-faceted variable image display system of a multi-faceted endoscope that allows a variable display range to be displayed.

To this end, the present invention provides a plurality of endoscope cameras for capturing images by varying the photographing range in front and specific side directions along the inclination direction of each inclined plane according to the adjustment operation of the photographing range, and the photographing range of the plurality of endoscope cameras. Shooting range adjusting unit which adjusts each individually, camera driving unit which is driven individually to change the shooting range for each endoscope camera according to the adjustment operation from the shooting range adjusting unit, and shooting by varying the shooting range individually in different directions from each endoscope camera An image processing unit for processing individual image signals to compensate for the image cross region between the plurality of image signals, a multiplexer for multiplexing and outputting the captured image signal processed by the individual image signals, and the multiplexer To capture video signals in different directions And an image monitor configured to simultaneously display on one screen in a state of following the image variation according to the change in the shooting range.

Description

System for Variably Dispalying Polyhedral Medical Image of Polyhedral Endoscope}

The present invention relates to a multi-faceted image display system of a multi-faceted endoscope to widen the viewing angle of the affected area by varying the imaging range of the multi-faceted endoscope to take different directions with respect to the affected part of the patient.

In general, an endoscope apparatus for observing a device equipped with a camera is used for organs in which the lesion is not directly seen through surgery or autopsy such as the esophagus, stomach, colon, rectum, etc. of a patient.

Such endoscopy devices are generally used, such as bronchoscope, esophagus, stomach, duodenum, rectal, bladder, Specialized endoscopes have been developed for different organ parts of the human body, such as laparoscopy, thoracoscopic, mediastinum, and heart.

The endoscope device has been developed from a method in which the organs can be directly seen through the straight tube of a single cylinder and a method of observing the affected area using a lens system. The method of inserting directly into an organ is mainly used.

In the case of an endoscope device in which a small camera is directly inserted into an organ, a small camera is inserted into the organ to directly photograph and record various mucous membranes and inner walls of the organ to detect and diagnose microscopic lesions at an early stage. .

However, in the endoscope device using such a small camera, since only one camera is mounted in front of the endoscope, lesion observation is possible only for lesions within the maximum viewing angle range that the small camera can provide. There is a problem that minute observation is difficult with respect to the affected part around the front face.

In addition, in order to evenly observe the entire area of a particular organ, the endoscopy device must be changed from time to time and photographed with a single small camera, so that the observation time of the lesion through the endoscope is not only long, but also the patient suffers a great pain. There is a problem that you have to feel.

Accordingly, the present invention has been made to solve the above-mentioned conventional problems, and an object thereof is to arrange a plurality of cameras in multiple faces to have different shooting angles in an endoscope module inserted into an organ of a patient, and By varying the shooting range, it is possible to provide a variable image display system of a multi-scope endoscope so that the captured image can be displayed by varying the display range through a single monitor screen.

In order to achieve the above object, according to the present invention, in the image display system of the endoscope for observing the lesion by inserting the endoscope module in the organ of the patient, the front end of the endoscope module in common to the front and the common A plurality of endoscope cameras arranged to be inclined in the lateral direction at different angles at the same time, and for capturing an image by varying the shooting range in front and specific side directions along the inclined direction of each inclined plane according to the adjustment operation of the shooting range; A shooting range adjusting unit for individually adjusting a shooting range of the plurality of endoscope cameras, a camera driving unit individually driven to vary a shooting range for each of the plurality of endoscope cameras according to an adjustment operation from the shooting range adjusting unit, and the plurality of endoscopes Shooting range in different directions from the camera An image processor which processes individual image signals so as to compensate for an image crossing area between respective image signals with respect to a plurality of image signals that are individually variable and photographed, and photographed image signals of different directions processed by respective image signals from the image processor. A multiplexer for multiplexing and outputting a video signal and a video monitor for simultaneously displaying captured video signals in different directions through the multiplexer on a single screen in a state of following image variations due to a change in a shooting range. A multi-faceted variable image display system of a multi-faceted endoscope is provided.

As described above, according to the present invention, a plurality of small cameras are disposed on the endoscope module for observing the organs of the human body to have multiple angles in consideration of the photographing focus and the wide angle so as to have multiple angles so that multi-sided imaging of the front and side of the affected part is possible. However, by allowing the user to individually adjust the shooting range of each small camera, it is possible to simultaneously output each of the multiple images taken on one monitor screen, but the endoscope images that are individually variable adjusted to shoot the monitor screen As the image display area of the display is variable, the lesions of the organs can be observed much more finely than the conventional unidirectional endoscope, and the user can freely adjust the photographing range of the plurality of small cameras so that the organs are affected. Simultaneous imaging and observation of the entire surface allows for complete endoscopic procedures This has the effect that the time required can be significantly reduced.

Hereinafter, the present invention configured as described above will be described in detail with reference to the accompanying drawings.

That is, FIG. 1 is a view showing the overall appearance of the multi-faceted variable display system of the multi-faceted endoscope according to the present invention.

As shown in FIG. 1, the multi-faceted variable image display system of the multi-faceted endoscope according to the present invention is directly inserted into the human body through a signal transmission line 14 to an endoscope image display device 10 having an image monitor 12. The endoscope module 16 is connected, and the endoscope module 16 has a plurality of endoscope cameras 18, 20, and 22 capable of photographing in multiple directions, respectively, in a form in which a photographing range can be adjusted.

As shown in FIGS. 2A and 2B, the front center portion of the endoscope module 16 is irradiated with light of a predetermined illuminance so as to secure a field of view for photographing affected areas of the cameras 18, 20, and 22 ( 24) is installed.

In addition, the front end of the endoscope module 16 has a first inclined direction toward the center of the center portion, which is the installation position of the light source 24, all in common in the forward direction, respectively formed along the lateral direction of different angles A first endoscope camera having a second inclined portion 21 and a third inclined portion 23, and arranged on the inclined portions 19, 21, and 23 along the inclined direction of each inclined surface. 18), the second endoscope camera 20 and the third endoscope camera 22 are provided.

Each endoscope camera (18, 20, 22) is to be able to shoot the front and each side in charge along the inclination direction of each of the inclined portion (19, 21, 23) within the limits of the camera focusing and the angle of shooting possible However, when the first inclined portion 19 is directed upward in the left direction according to the insertion form of the endoscope module 16, the first endoscope camera 18 may photograph the front part and the upper left part. When the second inclined portion 21 faces the upper right direction by the insertion form of the endoscope module 16, the second endoscope camera 20 may photograph the front part and the upper right part. When the 3rd inclination part 23 faces a downward direction, the said 3rd endoscope camera 22 is able to image the remaining part of a front part, and a lower part.

Here, in the present invention, the three endoscope cameras (18, 20, 22) is described as an example, but not limited to this, at least two or at least four, depending on the type of organ to be examined, organ location, etc. It is of course possible to mount more than one endoscope camera to the endoscope module.

In addition, as shown in FIG. 3, the endoscope module 16 allows the first to third endoscope cameras 18, 20, and 22 to individually change a shooting range according to a user's operation. The endoscope cameras 18, 20, and 22 respectively move the camera lens in the up, down, left, and right directions within the photographing area to take a picture of the inspection site.

Here, in order to move the camera lens of each endoscope camera (18, 20, 22) to drive the lens precisely the driving motor consisting of a stepping motor (Stepping Motor) and the camera lens in accordance with the driving force from the driving motor A lens driving mechanism for moving operation must be provided in the endoscope module 16, and the driving motor and lens driving mechanism are included in the camera driving units 30, 32, and 34 (see Fig. 4), respectively.

In the present invention, the configuration and operation state of the lens driving mechanism is not described in detail, but is not limited to a specific driving mechanism, and any driving mechanism for moving a normal camera photographing position may be applied.

Next, FIG. 4 is a block diagram of a multi-faceted variable display system of a multi-faceted endoscope according to the present invention.

As shown in FIG. 4, the multi-faceted image display apparatus of the multi-dimensional endoscope according to the present invention includes first to third endoscope cameras 18, 20, and 22 and first to third camera drivers 30, 32, and the like. Endoscope module 16 with 34 and light source 24, user input unit 36, light source control unit 38, drive control unit 40, input port 42, first to third image encoders 44; And 46, 48, first to third video decoders 50, 52, and 54, a multiplexer 56, and a video monitor 12.

The first to third camera drivers 30, 32, and 34 have a stepping motor, a lens driving mechanism, and the like, and drive control from the drive controller 40 according to a user's input operation by the user input unit 36. Thus, the camera lenses of the first to third endoscope cameras 18, 20, and 22 in charge are driven in the up, down, left, and right directions, respectively.

The user input unit 36 performs a key button for user setting the amount of light of the light source 24 provided in the endoscope module 16 and a variable recording range of each endoscope camera 18, 20, 22 for each camera. It includes a key button and a joystick for proceeding user input.

The light source control unit 38 is for performing on / off control and light amount control of the light source 24 according to a user's input operation through the user input unit 36.

The driving control unit 40 drives and controls the first to third camera driving units 30, 32, and 34 individually according to a user input from the user input unit 36. According to the individual driving of 34, the first to third endoscope cameras 18, 20, and 22 respectively change the photographing range so as to photograph the inspection site.

Here, the user input unit 36 and the drive control unit 40 may be configured as a shooting range adjustment unit that can adjust the shooting range of each endoscope camera (18, 20, 22) according to the user input.

The input port 42 is connected to each of the endoscope cameras 18, 20, and 22 of the endoscope module 16 through the signal transmission line 14, so that the first to third endoscope cameras 18, 20, 22) receives a video signal photographed.

The first image encoder 44 synthesizes a first image signal photographed by varying a photographing range from the first endoscope camera 18 with an image region intersecting with a photographed image from another endoscope camera 20, 22. By encoding, the digital image data stream is output, and the second image encoder 46 receives the second image signal captured by varying the shooting range from the second endoscope camera 20 to another endoscope camera 18, 22. Synthesized with the image area intersected with the captured image from the encoded image and output in the form of a digital image data stream. The three video signals are synthesized with the video region intersected with the captured video images from the other endoscope cameras 18 and 20, and are then encoded and output in the form of a digital video data stream.

The first video decoder 50 decodes the digital video data stream of the first video signal from the first video encoder 30 and outputs the video signal in the form of a video signal, and the second video decoder 52 The digital video data stream of the second video signal from the second video encoder 32 is decoded and output as a video signal capable of outputting the video. The third video decoder 54 is provided from the third video encoder 34. Decodes the digital video data stream of the third video signal of the third video signal and outputs it in the form of a video signal.

The multiplexer 42 multiplexes the first to third video signals decoded through the first to third video decoders 36, 38, and 40, respectively, and reproduces the same as an endoscope video screen on the video monitor 12. Be sure to

Next, FIG. 5 is a diagram showing the detailed configuration of the video encoder shown in FIG.

As illustrated in FIG. 5, the first to third image encoders 44, 46, and 48 may include a subtractor 60, a discrete cosine transform 62, a quantization unit 64, and a VLC unit ( Variable Length Coding) 66, Buffer Memory 68, Inverse Quantizer 70, IDCT Unit (Inverse DCT) 72, Frame Memory 74, Image Shift Estimator 76, Image Shift Compensator ( 78), respectively.

The subtractor 60 is an image from an endoscope camera corresponding to the corresponding image encoder, that is, the first camera image in FIG. 5. In FIG. 5, the image difference compensation value is subtracted through the second and third camera images, and the difference image considering the image regions of the second and third cameras intersecting the first and second camera images (ie, the first and second camera images). ).

The DCT unit 62 performs DCT conversion of the difference image of the corresponding camera image from the subtractor, and the quantization unit 64 converts the DCT converted image signal from the DCT unit 62 into the buffer memory 68. The quantization coefficient is changed and quantized according to the bit rate control signal provided from the.

The VLC unit 66 performs variable-length coding on the output signal quantized by the quantization unit 64 according to a predetermined VLC table and outputs the image data in the form of a data stream. In operation 68, the VLC unit 66 buffers, stores, and outputs a data stream of a variable-length coded camera image, and generates a bit rate control signal so that the image signal has a reference bit rate. .

The inverse quantization unit 70 inverse quantizes the output signal quantized from the quantization unit 64, and the IDCT unit 72 performs IDCT conversion of the inverse quantized image signal.

The frame memory 74 stores IDCT-converted image signals from the IDCT unit 72 in image frame units and outputs the image signals to the image shift estimator 76 and the image shift compensator 78.

The image shift estimator 76 is configured to display other images based on a corresponding camera image from the frame memory 74 (ie, an image of an endoscope camera corresponding to the corresponding image encoder, and a first camera image in FIG. 5). An image disparity estimation is performed on other camera images provided from the encoder (that is, second and third camera images in FIG. 5) to generate the disparity estimation value.

The image shift compensator 78 applies a shift estimation value provided from the image shift estimator 76 with reference to a corresponding camera image from the frame memory 74 to intersect each image according to a change in a shooting range of the camera. By performing image disparity compensation on the region, the resultant disparity compensation value is provided to the subtractor 60.

Meanwhile, in FIG. 5, only the configuration in which the image encoding is performed by applying the shift compensation value for the image intersection area with other second and third camera images to the first camera image by using the first image encoder 44 is illustrated. Although described, the configuration and operation of FIG. 5 may be similarly applied to the second image encoder 46 encoding the second camera image and the third image encoder 48 encoding the third camera image.

6 is a diagram showing the detailed configuration of the video decoder shown in FIG.

As shown in FIG. 6, the first to third image decoders 50, 52, and 54 may include a variable length decoder 80, an inverse quantizer 82, an IDCT unit 84, and an image. The shift compensator 86, the adder 88, and the frame memory 90 are configured.

The VLD unit 80 is a camera video data stream from the video encoder (corresponding to the first video decoder 50 in FIG. 6) (the first camera video from the first video encoder 44 in FIG. 6). Data stream) is subjected to variable length decoding based on a VLD table.

The inverse quantization unit 82 inverse quantizes the variable length decoded video signal from the VLD unit 80, and the IDCT unit 84 performs IDCT conversion of the inverse quantized video signal.

The image shift compensator 86 adds an image shift compensation value through the adder 88 to store an image signal of a frame unit (ie, first camera image data in FIG. 6) stored in the frame memory 90. The shift compensation for the image intersection area with the image data from other cameras (ie, the second and third camera image data in FIG. 6) is compensated for, and the shift compensation value is provided to the adder 88.

The frame memory 90 stores the image signal to which the image shift value is added through the adder 88 in units of image frames, and provides the image signal to the image shift compensator 86.

The adder 88 adds a disparity compensation value for an image intersection area with other camera image data provided from the image shift compensator 86 to the multiplexer 56 by adding the image signal from the IDCT unit 84. Output to.

Meanwhile, in FIG. 6, the first image decoder 50 is illustrated to perform image decoding on the first camera image data by applying a disparity compensation value for an image intersection area with the second and third camera image data. Although only described, the configuration and operation of FIG. 6 are equally applied to the second image decoder 52 that decodes the second camera image data and the third image decoder 54 that decodes the third camera image data. Can be.

In the present invention made as described above, when the endoscope module 16 having the first to third endoscope cameras (18, 20, 22) is inserted into the internal organs of the patient to examine the lesion, the user input unit ( 36 to narrow the shooting range of at least one endoscope camera among the first to third endoscope cameras 18, 20 and 22 with respect to the front direction of the endoscope module 16, At least one of the first to third camera drivers 30, 32, and 34 may drive the lens of the endoscope camera corresponding to the driving control of the drive controller 40 to narrow the shooting range. Will be hit.

Accordingly, at least one video encoder among the first to third video encoders 44, 46, and 48 receives a camera video signal photographed from a corresponding endoscope camera according to the variation of an image intersection area with the video signal from other cameras. Disparity estimation and disparity compensation are performed to perform image encoding in real time on the image capturing region crossing each other, thereby outputting a camera image in the form of an image data stream.

In addition, at least one of the first to third video decoders 50, 52, and 54 may receive a camera video data stream from a corresponding video encoder, and may determine an area of an image intersection with the video data stream captured by another camera. Image decoding is performed by applying the shift compensation value due to the variable.

Accordingly, as shown in FIG. 7A, the first camera image 100, the second camera image 102, and the third camera are multiplexed through the multiplexer 56 and displayed on the image monitor 12. The camera image 104 may be displayed on the screen in such a way that an image crossing area overlapping each other is gradually increased.

On the other hand, in the case where it is desired to widen the image capturing range of at least one endoscope camera among the first to third endoscope cameras 18, 20, and 22 with respect to the front direction of the endoscope module 16, The first to third image encoders 44, 46, and 48 follow a variable shooting range of the endoscope cameras 18, 20, and 22 in real time, and change according to the variation of the image intersection area between the camera image signals. Image encoding is performed through estimation and disparity compensation.

In addition, the first to third video decoders 50, 52, and 54 receive the first to third video data streams encoded from the respective video encoders 44, 46, and 48 to intersect the video intersections. Image decoding is performed by compensating an image variation value according to a variable.

Accordingly, as shown in FIG. 7B, the first camera image 100, the second camera image 102, and the third camera image 104 displayed on the image monitor 12 overlap each other. This can be displayed on the screen in a progressively reduced form.

While specific embodiments of the present invention have been described and illustrated above, it will be apparent that the present invention may be embodied in various modifications by those skilled in the art. Such modified embodiments should not be understood individually from the technical spirit or the prospect of the present invention, but should fall within the claims appended to the present invention.

1 is a view showing the overall appearance of the multi-sided variable image display system of the multi-faceted endoscope according to the present invention,

2a and 2b is a view showing the arrangement of the multi-sided endoscope camera applied to the present invention,

3 is a view showing a variable adjustment state of the shooting range for a plurality of small cameras arranged in a multi-faceted endoscope applied to the present invention,

4 is a block diagram of a multi-faceted image variable display system of a multi-faceted endoscope according to the present invention;

FIG. 5 is a diagram illustrating a detailed configuration of an image encoder illustrated in FIG. 4;

6 is a diagram illustrating a detailed configuration of an image decoder illustrated in FIG. 4;

7A and 7B are diagrams illustrating a variable display state of a screen display area as the camera photographing range of a multi-scope endoscope is variably adjusted according to a preferred embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

16: endoscope module, 18: first endoscope camera,

20: second endoscope camera, 22: third endoscope camera,

24: light source, 30, 32, 34: camera drive unit,

36: user input unit, 38: light source control unit,

40: drive control unit, 42: input port,

44,46,48: video encoder, 50,52, 54: video decoder,

56: multiplexer.

Claims (4)

In the image display system of the endoscope for observing the lesion by inserting the endoscope module in the organ of the patient, Disposed on a plurality of inclined surfaces disposed radially with respect to the light source installed in the front center portion of the endoscope module and disposed on the front side surface portion of the endoscope module and inclined at the same angle toward the light source, respectively, according to the adjustment operation of the shooting range A plurality of endoscope cameras in which a photographing range is varied so as to photograph side directions along the inclination direction of the inclined surface together with the front direction of the endoscope module; A shooting range adjusting unit which individually adjusts shooting ranges of the plurality of endoscope cameras; A camera driver separately driven to vary a shooting range for each of the plurality of endoscope cameras according to an adjustment operation from the shooting range adjusting unit; An image processor configured to process an individual image signal so as to compensate an image crossing area between the image signals with respect to the plurality of image signals photographed by varying a photographing range individually in different directions from the plurality of endoscope cameras; A multiplexer for multiplexing and outputting captured image signals of different directions processed by respective image signals from the image processor; And And a video monitor configured to simultaneously display captured video signals of different directions through the multiplexer on a single screen in a state of following image variations according to a change in a shooting range. Display system. The method of claim 1, The image processor includes a plurality of image encoders for separately encoding and variably compensating an image variation according to a variation in a shooting range between a plurality of image signals photographed by the plurality of endoscope cameras, and encoding each from the plurality of image encoders. And a plurality of image decoders for receiving the decoded image signals and individually decoding them to compensate for image variation values according to the change in the shooting range between the respective image signals and transmitting them to the multiplexer. . The method of claim 2, The plurality of image encoders include a subtractor for generating a difference image by subtracting an image shift compensation value from an image from a corresponding endoscope camera; Discrete Cosine Transform (DCT) for DCT transform the difference image from the subtractor, A quantization unit for quantizing the video signal DCT-converted from the DCT unit by changing a quantization coefficient according to a bit rate control signal; Variable Length Coding (VLC) for variable length coding the quantized video signal according to a predetermined VLC table and outputting the quantized video signal as image data in the form of a data stream, A buffer memory which buffers and stores a data stream of the camera image and outputs the bit stream control signal to the subtractor to generate a bit rate control signal such that the video signal has a bit rate as a reference; An inverse quantization unit for inverse quantization of the output signal quantized from the quantization unit 64; An IDCT unit for converting the inverse quantized video signal by IDCT (Inverse DCT) conversion; A frame memory for storing the IDCT-converted image signal in image frame units and outputting the image signal in an image shift estimator and an image shift compensator; An image shift estimator for estimating an image shift for an image of another endoscope camera based on an image of a corresponding endoscope camera from the frame memory and generating a shift estimation value; The shift compensation value for compensating the shift of the image for the cross-sectional area of each image according to the variation of the shooting range of the endoscope camera is applied by applying the shift estimation value of the image shift estimator with reference to the image of the corresponding endoscope camera from the frame memory. And a video shift compensation unit provided to the subtractor. The method of claim 2, The plurality of image decoders include a variable length decoder (VLD) for variable length decoding a camera image data stream from a corresponding image encoder based on a variable length decoding table; An inverse quantization unit for inversely quantizing a variable-length decoded video signal from the VLD unit; An IDCT unit for performing IDCT conversion of the dequantized video signal; An image shift compensator for compensating for a shift in an image intersection region between corresponding image data obtained by adding an image shift compensation value through an adder and image data of another endoscope camera, and providing the shift compensation value to the adder; A frame memory storing an image signal added with an image shift value through an adder in units of image frames and providing the image shift unit to the image shift compensator; And an adder configured to add and output a disparity compensation value from the image shift compensator with respect to the video signal from the IDCT unit.

Images