KR101786840B1 - Apparatus for transfering image data and endoscopy system including the same - Google Patents

Abstract

An endoscope system according to an embodiment of the present invention includes an image sensor including a first image terminal and a second image terminal for generating image data and transmitting at least a part of the image data, An image data transmission device including a first optical fiber module and a second optical fiber module each connected to an image terminal; An image data input unit connected to the image data transmission apparatus and transmitting the image data output through the image data transmission apparatus to a set path; And an image processing unit for performing image processing on the image data transmitted from the image data input unit under the control of the CPU.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an image data transmission apparatus and an endoscopic system including the same,

The present invention relates to an image data transmission apparatus and an endoscope system including the same.

The endoscopic system provides an image of the inside of the human body to the doctor during surgery or inspection, and the doctor can confirm the image so that the operation or the inspection process can be stably and accurately performed.

Recently, endoscopic systems are increasingly demanding not only for providing images but also for providing various functions.

Accordingly, studies are being made on an endoscope system capable of providing various functions at a high speed of image processing.

Patent Document 1: Japanese Patent Application Laid-Open No. 10-2007-0071556 (Published on July 04, 2007)

The image data transmission device and the endoscope system including the same according to the embodiment of the present invention are intended to overcome the bandwidth limitation in the transmission of image data.

The task of the present application is not limited to the above-mentioned problems, and another task which is not mentioned can be clearly understood by a person skilled in the art from the following description.

According to an aspect of the present invention, there is provided an image processing apparatus comprising: an image sensor including a first image terminal and a second image terminal for generating image data and transmitting at least a part of the image data; And a first optical fiber module and a second optical fiber module respectively connected to the first image terminal and the second image terminal.

Wherein the first optical fiber module is connected to a third image terminal together with the first image terminal and the second optical fiber module is connected to a fourth image terminal together with the second image terminal, And the second optical fiber module can transmit the image data in the differential mode.

The first optical fiber module and the second optical fiber module may transmit the image data in a single-ended mode.

At least a portion of the image data may be transmitted through the first optical fiber module and the second optical fiber module without serialization of the image data.

The first optical fiber module and the second optical fiber module may be directly connected to the first image terminal and the second image terminal or may be connected to the first image terminal and the second image terminal through a connector .

An additional image sensor including a first additional image terminal for transmitting at least a part of the additional image data and a second additional image terminal for sensing additional light different from a wavelength of light sensed by the image sensor, And a first additional optical fiber module and a second additional optical fiber module connected to the first additional image terminal and the second additional image terminal, respectively.

Wherein the first additional optical fiber module is connected to the third additional image terminal in addition to the first additional image terminal and the second additional optical fiber module is connected to the fourth additional image terminal in addition to the second additional image terminal, The first additional optical fiber module and the second additional optical fiber module can transmit the additional image data in the differential mode.

The first additional optical fiber module and the second additional optical fiber module may transmit the additional image data in a single-ended mode.

And at least a portion of the additional image data may be transmitted through the first additional optical fiber module and the second additional optical fiber module without serialization of the additional image data.

According to another aspect of the present invention, there is provided an image sensor comprising: an image sensor including a first image terminal and a second image terminal for generating image data and transmitting at least a part of the image data; An image data transmission device including a first optical fiber module and a second optical fiber module respectively connected to the first optical fiber module and the second optical fiber module; An image data input unit connected to the image data transmission apparatus and transmitting the image data output through the image data transmission apparatus to a set path; And an image processing unit for performing image processing on the image data transmitted from the image data input unit under the control of the CPU.

The CPU may process a user interface for the image data, and the image processing unit may overlap the user interface and the image data.

The first optical fiber module and the second optical fiber module may transmit the image data in a differential mode or a single-ended mode.

At least a portion of the image data may be transmitted through the first optical fiber module and the second optical fiber module without serialization of the image data.

The first optical fiber module and the second optical fiber module may be directly connected to the first image terminal and the second image terminal or may be connected to the first image terminal and the second image terminal through a connector .

According to another aspect of the present invention, there is provided an endoscope system including: a first additional image terminal for transmitting additional image data by sensing additional light other than a wavelength of light sensed by the image sensor, A first additional optical fiber module connected to the first additional image terminal and the second additional image terminal to transmit the additional image data in a differential mode or a single-ended mode, And the second additional optical fiber module.

Wherein the image data input unit receives the additional image data together with the image data, transmits the additional image data to the CPU, and transmits the image data to the image processing unit, and the image processing unit receives additional image data And may overlap the image data.

Wherein the image sensor further comprises a terminal for a first clock and the image data transmission device further comprises a clock optical fiber module connected to the first clock terminal, The clock signal can be transmitted in the end mode.

The transmission direction of the image data transmitted by the first optical fiber module and the second optical fiber module may be the same as the transmission direction of the clock signal transmitted by the optical fiber module for clock.

The image data transmission apparatus may further include a dummy optical fiber module capable of transmitting a signal in a direction opposite to a transmission direction of the image data and the clock signal.

Wherein the additional image sensor further comprises a terminal for a first additional clock and the image data transmission apparatus further comprises a clock additional optical fiber module connected to the terminal for the first additional clock, Can transmit a clock signal in differential or single ended mode.

The transmission direction of the clock signal and the additional image data of the first additional optical fiber module, the second additional optical fiber module, and the additional optical fiber module for clock may be the same.

The endoscope system according to another aspect of the present invention may further include an additional dummy optical fiber module capable of transmitting signals in the direction opposite to the transmission direction of the additional image data and the clock signal.

The image data transmission apparatus may further include an optical fiber module for synchronization confirmation, and the optical fiber module for synchronization confirmation may transmit a synchronization confirmation signal in a differential mode or a single-ended mode.

The transmission direction of the image data of the first optical fiber module and the second optical fiber module may be opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module.

The endoscope system according to another aspect of the present invention may further include a dummy optical fiber module for transmitting a signal in the same direction as the transmission direction of the image data.

When the first optical fiber module and the second optical fiber module are abnormal optical fiber modules that can not transmit the image data, the dummy optical fiber module can replace the abnormal optical fiber module to transmit the image data have.

The image data transmission apparatus may further include a synchronization confirmation additional optical fiber module, and the synchronization confirmation additional optical fiber module may transmit a synchronization confirmation signal in a differential mode or a single-ended mode.

The transmission direction of the additional image data of the first additional optical fiber module and the second additional optical fiber module may be opposite to the transmission direction of the synchronization confirmation signal of the additional optical fiber module for synchronization confirmation.

The endoscope system according to another aspect of the present invention may further include an additional dummy optical fiber module for transmitting signals in the same direction as the transmission direction of the additional image data.

Wherein when the first additional optical fiber module or the second additional optical fiber module is an abnormal optical fiber module in which image data can not be transmitted, the additional optical fiber module replaces the abnormal optical fiber module, Data can be transmitted.

According to another aspect of the present invention, there is provided an endoscope system including an input unit operable by a user, an MCU encoding an input signal of the input unit, and a third optical fiber module connected to the MCU and transmitting an input signal encoded from the MCU And the number of the third optical fiber modules transmitting the encoded input signal may be smaller than the number of input pins of the MCU receiving the input signal from the input unit.

According to another aspect of the present invention, there is provided an endoscope system including an image sensor for generating additional image data by sensing light having a wavelength different from a wavelength of light sensed by the image sensor, a control signal for the image sensor and the additional image sensor, And a third optical fiber module connected to the MCU for transmitting and receiving the control signal and the operation information to the CPU, wherein the number of the third optical fiber modules is smaller than the number of the control signals and the operation information And may be equal to or less than the number of the MCU pins for input / output.

The image data transmission apparatus may further include a protection unit for protecting optical fibers of the first optical fiber module and the second optical fiber module, respectively, and the protection unit may be made of a material capable of withstanding the autoclave for disinfecting medical devices have.

The endoscope system according to another aspect of the present invention further includes a monitoring unit that monitors at least one of the image data input unit, the CPU, and the image processing unit in real time and performs the at least one reset according to the at least one status value .

The image sensor and the CPU communicate through a communication bus, and the communication bus includes a transmission bus line and a reception bus line, and the transmission bus line and the reception bus line can be connected to the control optical fiber module, respectively.

The image data transmission apparatus and the endoscope system including the same according to the embodiment of the present invention can overcome the bandwidth limitation by including the optical fiber module.

The effects of the present application are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 to 6 show an image data transmission apparatus according to an embodiment of the present invention.
Fig. 7 shows an example of the outline of the endoscope system according to the embodiment of the present invention.
8 and 14 show block diagrams of an endoscopic system according to an embodiment of the present invention.
9 to 12 show various modifications of the image data transmission device of the endoscope system according to the embodiment of the present invention.
13 shows an example of a communication chip and a control optical fiber module of an endoscope system according to an embodiment of the present invention.
15 shows an example of an MCU and a third optical fiber module of an endoscope system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It is to be understood, however, that the appended drawings illustrate the present invention in order to more easily explain the present invention, and the scope of the present invention is not limited thereto. You will know.

Also, the terms used in the present application are used only to describe certain embodiments and are not intended to limit the present invention. The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Next, a data transmitting apparatus and an endoscope system according to one embodiment of the present invention will be described with reference to the drawings.

1 and 2 show an image data transmission apparatus according to an embodiment of the present invention. 1 and 2, an image data transmission apparatus according to an embodiment of the present invention includes an image sensor 100, a first optical fiber module 200, and a second optical fiber module 300 .

The image sensor 100 generates image data and includes a first image terminal T1 and a second image terminal T2 for transmitting image data. The image sensor 100 can generate image data generated according to a standard processable by an AP (Application Processor) which is a CPU for a mobile device.

For example, the image sensor 100 may generate image data such as a Mobile Industry Processor Interface (MIPI) standard, a Low-Voltage Differential Signaling (LVDS) standard, and a parallel interface standard, but the present invention is not limited thereto. The MIPI specification can be used to transfer image data at high speed on a mobile device such as a smart phone.

Each of the first optical fiber module 200 and the second optical fiber module 300 is connected to the first image terminal T1 and the second image terminal T2, respectively. The number of the first image terminal T1 and the first image terminal T2 in FIGS. 1 and 2 and FIGS. 3 to 6 to be described later may be changed according to the transmission standard of the image data.

1 and 2, the first optical fiber module 200 and the second optical fiber module 300 may include a light emitting portion LT, an optical fiber OF, and a light receiving portion LR have. The light emitting unit LT converts the electrical signal into an optical signal, the optical fiber OF transmits the converted optical signal, and the light receiving unit LR converts the optical signal transmitted through the optical fiber OF back into an electrical signal Can be converted.

The various optical fiber modules described below in addition to the first optical fiber module 200 and the second optical fiber module 200 may also include a light emitting portion LT, an optical fiber OF and a light receiving portion LR.

As shown in FIGS. 1 and 2, one optical fiber module can be connected to one image terminal of the image sensor 100. Accordingly, the image data transmission apparatus according to the embodiment of the present invention has various advantages over the method of transmitting image data through the coaxial cable.

A serializer and a deserializer may be required when all the image terminals of the image sensor 100 are connected to one coaxial cable so that image data is transmitted unlike the embodiment of the present invention.

The serializer serializes the image data output from the plurality of image terminals through switching and transmits the serialized image data through one coaxial cable, and the deserializer can restore the serialized image data transmitted through the coaxial cable to the original state through switching .

Thus, the bandwidth of the serializer and deserializer must be greater than the bandwidth of the image terminal multiplied by the number of image terminals. In this case, the serializer and deserializer may be overloaded.

That is, since the bandwidth of the serializer and the deserializer is high, the clock speed is increased, and the power consumption is increased, thereby causing a lot of heat to the serializer and the deserializer. The more heat generated, the shorter the life of serializers and deserializers and the less reliable their operation.

Also, since the serializer and deserializer take time to process the image data, the transfer time of the image data may increase. For example, when a doctor performs surgery while grasping the inside of a patient's body through an endoscopic system, an image containing a doctor's operation should be displayed in real time.

If the transmission time of the image data through the serializer and the deserializer increases, the display of the image is delayed, so that the surgeon can confirm the operation of the surgeon after a predetermined time, so that unintentional medical accidents may occur.

In particular, if image data to be processed is large, such as a full HD (FHD) or ultra HD (UHD) image, the operation load of the serializer and the deserializer may increase.

On the other hand, since the coaxial cable is connected to the serializer and the deserializer, the bandwidth of the coaxial cable must also be large. The bandwidth of the coaxial cable is up to 10Gbps. To transmit UHD-quality video at 60 frames per second, the bandwidth of the transmission line is required to be 12.5Gbps. Accordingly, there is a limit to transmitting a high resolution image through a coaxial cable.

Accordingly, when high-resolution image data is transmitted through the coaxial cable, the image data is compressed through an encoder and then transmitted to a serializer, and the decoder compresses the compressed image data passed through the deserializer back to its original state .

Accordingly, transmission delay of image data, generation of heat, and complexity of the configuration depending on the encoder and the decoder may occur. In addition, electromagnetic waves can be increased due to super high-speed image data transmitted through a coaxial cable, thereby possibly causing image data distortion and noise.

Alternatively, when one image terminal and one optical fiber module are connected as in the embodiment of the present invention, the image data can be transmitted through the optical fiber module without the serializer and the deserializer described above. As a result, it is possible to solve heat generation, complicated configuration, degradation of operation reliability, and the like due to a serializer, a deserializer, an encoder and a decoder.

Since one image terminal and one optical fiber module are connected as described above, it is possible to overcome the limitation of the bandwidth of the coaxial cable generated when transmitting FHD image data or UHD image data.

That is, the image data transmission apparatus according to the embodiment of the present invention can transmit at least a part of the image data through the first optical fiber module and the second optical fiber module without serialization of the image data.

1, the first optical fiber module 200 is connected to the third image terminal T3 in addition to the first image terminal T1 and the second optical fiber module 300 is connected to the second image terminal T3, And may be connected to the fourth image terminal T4 together with the image terminal T2. At this time, the first optical fiber module 200 and the second optical fiber module 300 can transmit image data in the differential mode.

That is, the first optical fiber module 200 transmits image data according to the voltage difference between the first image terminal T1 and the third image terminal T3, and the second optical fiber module 300 also transmits image data according to the second image The image data can be transmitted according to the voltage difference between the terminal T2 and the fourth image terminal T4.

For example, when the light emitting portion LT includes a vertical cavity surface emitting laser (VCSEL), the input portion of the VCSEL may include two terminals (P terminal and N terminal). At this time, the VCSEL can perform the differential mode. That is, light is emitted when a voltage difference is generated between two terminals, and light may not be emitted without a voltage difference.

The light receiving unit LR may include an optical transistor, and when a phototransistor receives light, a voltage may be generated between a source and a drain. The light receiving unit LR can amplify such a voltage to form a desired differential voltage.

Also, as shown in FIG. 2, the first optical fiber module and the second optical fiber module can transmit image data in a single-ended mode. For example, the P terminal of each VCSEL may be connected to the first image terminal T1 or the second image terminal T2, and the N terminals of each VCSEL may be connected to the ground.

The VCSEL emits light when a voltage difference occurs between the N terminal and the P terminal, so that the image data input through the P terminal can be converted into an optical signal even if the N terminal is connected to the ground.

1 and 2, the first optical fiber module 200 and the second optical fiber module 300 are directly connected to the first image terminal T1 and the second image terminal T2, . The first optical fiber module 200 and the second optical fiber module 300 are connected to the first image terminal T1 and the second image terminal T2 via the connector CON, ).

The image data transmission apparatus according to the embodiment of the present invention may further include an additional image sensor 150, a first additional optical fiber module 250, and a second additional optical fiber module 350. The additional image sensor 150 senses light different from the wavelength of the light sensed by the image sensor 100 to generate additional image data and includes a first additional image terminal AT1 for transmitting at least a part of the additional image data, And the second additional image terminal AT2.

At this time, the first additional optical fiber module 250 and the second additional optical fiber module 350 may be connected to the first additional image terminal AT1 and the second additional image terminal AT2, respectively.

For example, the image sensor 100 may sense visible light and the additional image sensor 150 may sense infrared or ultraviolet light, but the present invention is not limited thereto. The additional image sensor 150 will be described later in more detail.

Meanwhile, as shown in FIG. 5, the first additional optical fiber module 250 may be connected to the third additional image terminal AT3 in addition to the first additional image terminal AT1.

The second additional optical fiber module 350 may be connected to the fourth additional image terminal AT4 in addition to the second additional image terminal AT2.

At this time, the first additional optical fiber module 250 and the second additional optical fiber module 350 can transmit the additional image data in the differential mode.

Thus, the first additional optical fiber module can transmit the additional image data according to the voltage difference between the first additional image terminal AT1 and the third additional image terminal AT3. Also, the second additional optical fiber module can transmit additional image data according to the voltage difference between the second additional image terminal AT2 and the fourth additional image terminal AT4.

Meanwhile, as shown in FIG. 6, the first additional optical fiber module 250 and the second additional optical fiber module 350 can transmit additional image data through the single-ended mode. That is, the light emitting unit LT of the first additional optical fiber module 250 and the second additional optical fiber module 350 has two terminals, and one of the two terminals may be connected to the ground. Accordingly, when a voltage difference occurs between the two terminals, the light emitting portion LT can emit light according to the voltage difference.

As described above, at least a portion of the additional image data can be transmitted through the first additional optical fiber module 250 and the second additional optical fiber module 350 without the serialization process for the additional image data.

Next, an endoscope system according to an embodiment of the present invention will be described with reference to the drawings.

7 and 8 show an endoscope system according to an embodiment of the present invention. 7, there is shown an example of the outline of the endoscope system according to the embodiment of the present invention.

The endoscope system according to an embodiment of the present invention may include an image generator 20 connected to one side of the image data transmission device 10. The image generating unit 20 may include at least one of the image sensor 100 and the additional image sensor 150. At this time, the image data transmission device 10 may include a protection part (OFP) covering the plurality of optical fibers OF. The protection part (OFP) will be described later in detail with reference to FIG.

The image generating unit 20 may be connected to a telescope having a lens array therein. The main body 30 may be connected to the other side of the image data transmission apparatus 10 and may include at least one of hardware components or software components for processing image data or additional image data.

The endoscope system shown in Fig. 7 is an example of the outline of the endoscope system according to the embodiment of the present invention, but is not limited thereto.

8, an endoscope system according to an embodiment of the present invention includes an image data transmission apparatus 10, an image data input unit 500, and an image processing unit 510. [ A dotted arrow in FIG. 8 indicates a signal for the CPU 520 to control the image data input unit 500 and the image processing unit 510 and the monitoring unit 570 to be described later.

The image data transmission apparatus 10 includes an image sensor 100 including a first image terminal T1 and a second image terminal T2 for generating image data and transmitting at least a part of the image data, And a first optical fiber module 200 and a second optical fiber module 300 connected to the terminal T1 and the second image terminal T2, respectively.

Since the image data transmitting apparatus 10 has been described in detail in the foregoing, description thereof will be omitted.

The image data input unit 500 is connected to the image data transmission apparatus 10 and transmits the image data output through the image data transmission apparatus 10 to the set path. For example, the image data input unit 500 may transmit the image data to the image processing unit 510.

Also, the image data input unit 500 can perform simple processing (e.g., contrast adjustment, zoom-in, zoom-out, etc.) on the image data, and such simple processing is controlled by the CPU 520 .

The image processing unit 510 performs image processing on the image data transmitted from the image data input unit 500 under the control of the CPU 520. [

As described above, the image sensor 100 can generate image data generated according to a standard that can be processed by an application processor (AP) which is a CPU 520 for a mobile device.

When the image data conforms to the signal standard used in the mobile device, the CPU 520 may also include a mobile chip such as an ARM core.

Accordingly, the CPU 520 can support a mobile OS such as an Android operating system or iOS, and various functions provided by the mobile OS can be applied to an endoscope system according to an embodiment of the present invention.

For example, an endoscopic system according to an embodiment of the present invention can provide a rich user interface and easily upgrade functions desired by a user such as a doctor.

In the present invention, the CPU 520 is not limited to a CPU for a mobile device. Accordingly, the CPU 150 may operate in a general OS such as a Windows-based OS or OS X. [

At this time, the CPU 520 may output an operation control signal according to the processing of the user interface on the image data and the operation of the user interface of the user. The user interface may include a menu and may be for controlling the operation of the endoscope system and manipulating the image displayed on the display DIS, but the present invention is not limited thereto.

The manipulation of the image data through the user interface may be for enlargement or reduction of the image, sharpness or brightness change, but is not limited thereto.

Although not shown in the drawing, the CPU 520 may include a memory (not shown) for storing data and information about the user interface.

The image processing unit 510 may overlap the user interface with the image data output from the image data input unit 500 and process the image data according to the operation control signal.

At this time, at least one of the image data input unit 500 and the image processing unit 510 may be implemented as a field-programmable gate array (FPGA), but is not limited thereto.

FPGAs are a type of non-memory semiconductors that can be programmed. Unlike ordinary semiconductors , which can not be changed by a circuit, FPGAs can be reconfigured for their applications. An FPGA can implement a desired circuit through the operation of a switching element, which is a hardware element, so that image data can be transmitted or processed at a higher speed than that transmitted or processed by software.

The image processing unit 510 may transmit the overlapped image data and the user interface to the display unit DIS through a video port VP. The video port VP may be a video graphics array ( VGA ), a digital visual interface ( DVI ), a high definition multimedia interface (HDMI), a low voltage differential signaling ( LVDS ), or a serial digital interface no.

In the endoscope system according to the embodiment of the present invention, the processing path of the user interface and the processing path of the image data may be different. That is, in the case of the endoscope system according to the embodiment of the present invention, the CPU 520 processes the user interface, and the image data input unit 500 and the image processing unit 510 process the image data.

The doctor can operate the patient while viewing the image generated by the endoscope system. The physician must be able to see the inside of the human body in the immediate image so that the patient can perform the correct operation.

If the doctor can not immediately see the inside of the human body in the surgical procedure, the doctor may not be aware of the mistake immediately, even if the doctor made an unintended mistake. Therefore, the endoscope system must be capable of processing image data of the inside of the human body at a high speed and displaying it on a display (DIS) such as a monitor.

On the other hand, the processing of the user interface may be slower than the processing of the image data in the human body, but may not have a significant effect on the operation process.

Unlike the endoscope system according to the embodiment of the present invention, when the image data and the user interface are processed by one image processing path, the processing of the image data due to the processing of the user interface is also slowed, which may adversely affect the operation.

In the case of the endoscope system according to the embodiment of the present invention, the image data input unit 500 and the image processing unit 510 process image data at a high speed, and the CPU 520 processes the user interface at a relatively low speed, The user interface 510 may overlap the image data with the user interface.

Accordingly, the surgeon can view the overlapped image data and the user interface through the display unit (DIS). Therefore, the surgeon feels little or no time delay due to the process of the image data, and can perform various functions of the endoscope system Can be used.

In addition, since the endoscope system according to the embodiment of the present invention includes the image data transmission apparatus 10 described above, image data of high resolution or super high resolution can be transmitted while overcoming the bandwidth limitation.

In addition, since the endoscope system according to the embodiment of the present invention can transmit image data without an encoder, a serializer, a deserializer, or a decoder, it is possible to provide a simple structure that can reduce a transmission time delay of image data.

That is, the endoscope system according to the embodiment of the present invention can transmit at least a part of the image data through the first optical fiber module and the second optical fiber module without serialization process on the image data.

Although not shown in FIG. 8, a memory may be provided between the CPU 520 and the image processing unit 510 to process data on the user interface.

The first optical fiber module 200 is connected to the third image terminal T3 together with the first image terminal T1 and the second optical fiber module 300 is connected to the second image terminal T2 4 image terminal T4. The first optical fiber module 200 and the second optical fiber module 300 can transmit image data in the differential mode. Since this has been described in detail above, a description thereof will be omitted.

Alternatively, one of the light emitting units LT terminals of the image data transmission apparatus 10 is connected to the ground, so that the image data transmission apparatus 10 can transmit image data in the single-ended mode. Since this has been described in detail above, a description thereof will be omitted.

The first optical fiber module 200 and the second optical fiber module 300 may be directly connected to the first image terminal T1 and the second image terminal T2, And may be connected to the image terminal T1 and the second image terminal T2. Since this has been described in detail above, a description thereof will be omitted.

The image data transmission device 10 of the endoscope system according to the embodiment of the present invention may further include an additional image sensor 150, a first additional optical fiber module 250, and a second additional optical fiber module 350 .

The additional image sensor 150 includes a first additional image terminal AT1 for sensing additional light other than the wavelength of the light sensed by the image sensor 100 to generate additional image data and transmitting at least a part of the additional image data, And two additional image terminals AT2.

The first additional optical fiber module 250 and the second additional optical fiber module 350 are connected to the first additional image terminal AT1 and the second additional image terminal AT2, respectively, so that the additional image in the differential mode or the single- Data can be transmitted. Since this has been described in detail above, a description thereof will be omitted.

The image data input unit 500 may receive the additional image data in addition to the image data, transmit the additional image data to the CPU 520, and transmit the image data to the image processing unit 510. At this time, the image processing unit 510 receives the additional image data from the CPU 520 and overlaps the image data.

The image sensor 100 generates image data for the inside of the human body which is n frames per second and the additional image sensor 150 can generate additional image data that is m frames per second.

As noted above, the additional image data is for an image for a wavelength band (e.g., near-infrared, infrared, ultraviolet, etc.) except for visible light, or for a fluorescent material used in a fluoroscopy or fluoroscopic surgery It may be an image for a specific target such as finding a lesion.

The image data input unit 500 may transmit the image data and the additional image data according to the set path. That is, the image data input unit 500 may transmit the image data to the image processing unit 510 through the first transmission path, and may transmit the additional image data to the CPU 520 through the second transmission path.

At this time, the image data input unit 500 can also transmit the image data to the CPU 520 through the second transmission path. The CPU 520 may transmit the additional image data at a slower rate than the transmission speed of the image data in the first transmission path.

The image processing unit 510 may overlap the image data transmitted through the first transmission path and the additional image data output from the CPU 520. [ Accordingly, the image data may be a background image, and the display unit DIS may display additional image data superimposed on the background image.

As described above, image data can be processed at a higher speed than the additional image data. Since the image data represents the inside of the human body, the shorter the time delay until the image data is generated and displayed on the DIS, the more accurate information can be provided to the doctor.

Since the additional image data is an image for the fluorescent material or an image for each wavelength band, the generation of the additional image data itself may be slower than the image data. For example, since the amount of light of the fluorescent material or the amount of light of each wavelength band other than the visible light is small, in order to obtain a perfect image of the additional image data, the additional image sensor 150 may emit light of a relatively long- Lt; / RTI >

Unlike the endoscope system according to the embodiment of the present invention, if the image data and the additional image data are processed through the same path, the processing of the image data may be affected and the image data may not be displayed quickly and accurately through the DIS.

The endoscope system according to the embodiment of the present invention can quickly and accurately display the image inside the human body by processing the image data and the additional image data through different paths and processing the image data at a higher speed than the additional image data.

An endoscope system according to an embodiment of the present invention includes an image data input unit 500 and a memory (not shown) connected to the CPU 520, a memory (not shown) connected to the image processing unit 510 and the CPU 520 Each of the image data input unit 500 and the image processing unit 510 includes standard input and output port logic such as DMA (Direct Memory Access) logic, High Definition Multimedia Interface (HDMI) logic, DVI logic, Can be accessed.

These standard input / output port logic may dump the image data and the additional image data to the memory, and the DMA logic of the image processing unit 510 may add additional image data or face and additional image data, which are overlapping users, You can read it. At this time, these memories can exchange information on whether data is read or written via a sync communication line.

As described above, the image processing unit 510 may overlap at least one of the image data, the additional image data, and the user interface.

On the other hand, as shown in FIG. 9, the image sensor 100 may further include a first clock terminal CT1. The image data transmission apparatus 10 may further include a clock optical fiber module 610 connected to the first clock terminal. At this time, the clock optical fiber module 610 can transmit the clock signal in the differential mode or the single-ended mode. For example, the image data transmission device 10 may include two first optical fiber modules 200, two second optical fiber modules 300, and one clock optical fiber module 610.

When the clock optical fiber module 610 operates in the differential mode, the clock optical fiber module 610 may be connected to the first clock terminal CT1 and the second clock terminal CT2. 9, when the clock optical fiber module 610 operates in the single-ended mode, one terminal of the light emitting portion of the clock optical fiber module 610 is connected to the first clock terminal CT1 The other terminal can be connected to ground.

The image sensor 100 and the additional image sensor 150 may support the MIPI camera signal interface protocol II and the MIPI camera signal interface protocol III. At this time, MIPI CSI Ⅱ and MIPI CSI Ⅲ may be for transmission of image data of high resolution (FHD class or UHD class) or additional image data.

First, the pin specifications of the MIPI CSI II will be described with reference to FIG.

In the case of MIPI CSI II, the image sensor 100 and the CPU 520 are connected to four optical fiber modules (two first optical fiber modules 200, two first optical fiber modules 200, 2 optical fiber module 300) and one clock optical fiber module 610 corresponding to a clock line. The clock line may transmit a clock signal used in transmission or processing of image data.

In this case, the first optical fiber module 200 and the second optical fiber module 300 can operate in a differential mode or a single-ended mode. Since the differential mode and the single-ended mode have been described in detail above, .

When the four data lines and the one clock line operate in the differential mode, the first optical fiber module 200, the second optical fiber module 300, and the clock optical fiber module 610, respectively, (Not shown).

Also, when all four data lines and one clock line operate in the single-ended mode, the first optical fiber module 200, the second optical fiber module 300, and the light emitting portion of the optical fiber module for clock 610 LT may be connected to one terminal of the image sensor 100 and the N terminal may be connected to the ground.

The transmission direction of the image data transmitted by the first optical fiber module 200 and the second optical fiber module 300 may be the same as the transmission direction of the clock signal transmitted by the clock optical fiber module 610 . 9, the image data and the clock signal may be transmitted from the image sensor 100 to the CPU 520. In this case,

Meanwhile, the additional image sensor 150 may be connected to the first additional optical fiber module 250, the second additional optical fiber module 350, and the additional optical fiber module 615 for clock according to the pin specification of the MIPI CSI II . The first additional optical fiber module 250, the second additional optical fiber module 350 and the clock additional optical fiber module 615 may also operate in a differential mode (see FIG. 9) or a single-ended mode (not shown) .

That is, when the endoscope system according to the embodiment of the present invention includes the additional image sensor 150, the additional image sensor may further include a terminal for the first additional clock ACT1. The image data transmission apparatus 10 may further include a clock additional optical fiber module 615 connected to the first additional clock terminal ACT1. At this time, the additional optical fiber module 615 for clock can transmit the clock signal in the differential mode or the single-ended mode.

For example, an endoscopic system according to an embodiment of the present invention may include two first additional optical fiber modules 250, two second additional optical fiber modules 350 for transmitting additional image data, And an optical fiber module 615.

9, in the differential mode, the light emitting portion LT of the clock-use additional optical fiber module 615 can be connected to the first additional clock terminal ACT1 and the second additional clock terminal ACT2 have. Although not shown in the drawing, one terminal of the light emitting portion LT of the clock-use additional optical fiber module 615 is connected to the first additional clock terminal ACT1 in the single- The other terminal can be connected to ground.

Since this has been described with reference to the first optical fiber module 200, the second optical fiber module 300, and the clock optical fiber module 610, a description thereof will be omitted.

Further, the additional image data of the first additional optical fiber module 250, the second additional optical fiber module 350, and the additional optical fiber module for clock 615 may have the same transmission direction as the clock signal. Since this is similar to the description of the first optical fiber module 200, the second optical fiber module 300 and the optical fiber module 610 for clock, the description thereof will be omitted.

Next, referring to FIG. 10, the pin specification of MIPI CSI Ⅲ and the pin specification of MIPI CSI Ⅲ are described.

In the case of MIPI CSI III, the image sensor 100 and the CPU 520 are connected to four optical fiber modules (two first optical fiber modules 200, two second optical fiber modules 200, The optical fiber module 300) and one synchronization confirmation optical fiber module 620 corresponding to the synchronization confirmation line.

The synchronization confirmation line may be a synchronization confirmation signal for confirming whether the image data is synchronized in transmission and processing of the image data or a command of the CPU 520 to the image sensor 100. In the case of MIPI CSI III, since an embedded clock is used, a separate clock optical fiber module 610 used in MIPI CSI II may not be needed. At this time, the synchronization confirmation line can also transmit the synchronization confirmation signal in the differential mode or the single-ended mode.

Since the four data lines and one synchronization check line can operate in the differential mode, each of the first optical fiber module 200 and the second optical fiber module 300 can be connected to two terminals of the image sensor 100 And the light receiving unit LR of the optical fiber module 620 for synchronization confirmation can be connected to the synchronization confirmation terminal ST of the image sensor 100. [

10, when all four data lines and one synchronization check line operate in the single-ended mode, the first optical fiber module 200, the light emitting portion LT of the second optical fiber module 300 May be connected to one terminal of the image sensor 100 and the other terminal may be connected to the ground. One of the two terminals of the light emitting portion LT of the synchronization confirmation optical fiber module 620 may be connected to the ground and the light receiving portion LR of the synchronization confirmation optical fiber module 620 may be connected to the image sensor 100 And may be connected to the synchronization checking terminal ST.

As described above, the image data transmission apparatus 10 may further include an optical fiber module 620 for synchronization confirmation. The synchronization confirmation optical fiber module 620 can transmit the synchronization confirmation signal in the differential mode or the single-ended mode. For example, the image data transmission device 10 may include two first optical fiber modules 200, two second optical fiber modules 300, and one synchronization confirmation optical fiber module 620 .

At this time, the synchronization confirmation signal is input to the image sensor 100, and the image data can be output from the image sensor 100. Therefore, the transmission direction of the image data of the first optical fiber module 200 and the second optical fiber module 300 may be opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module 620.

When the endoscope system according to the embodiment of the present invention includes the additional image sensor 150, the image data transmission apparatus 10 may include a synchronization confirmation additional optical fiber for transmitting a synchronization confirmation signal in a differential mode or a single- Module 625, as shown in FIG.

For example, two first additional optical fiber modules 250, two second additional optical fiber modules 350, and one synchronization confirmation additional optical fiber module 625 for transmitting additional image data are included can do. At this time, the synchronization confirmation additional optical fiber module 625 may be connected to the additional synchronization check terminal AST of the additional image sensor 150.

The relationship between the additional image sensor 150, the first additional optical fiber module 250, the second additional optical fiber module 350 and the synchronization confirmation additional optical fiber module 625 is the same as that of the image sensor 100, 1 optical fiber module 200, the second optical fiber module 300, and the synchronization confirmation optical fiber module 620, a description thereof will be omitted.

The transmission direction of the additional image data of the first additional optical fiber module 250 and the second additional optical fiber module 350 may be opposite to the transmission direction of the synchronization confirmation signal of the additional synchronization optical fiber module 625 . This is similar to the relationship between the image data and the transmission direction of the synchronization confirmation signal of the optical fiber module 620 for synchronization check, and therefore, a description thereof will be omitted.

Meanwhile, the endoscope system according to the embodiment of the present invention may include an image data transmission device 10 capable of implementing both MIPI CSI II and MIPI CSI III.

To this end, the image data transmission apparatus 10 includes a first optical fiber module 200, a second optical fiber module 300, a first transmission optical fiber module OF_D1, and a second transmission optical fiber module OF_D2 .

At this time, the signal transmission direction of the first transmission direction optical fiber module OF_D1 may be opposite to the signal transmission direction of the second transmission direction optical fiber module OF_D2, and the signal transmission direction of the first optical fiber module 200 and the second optical fiber And may be the same as the image data transfer direction of the module 300.

11 and 12, the image data transmission apparatus 10 includes two first optical fiber modules 200, two second optical fiber modules 300, one first transmission Direction optical fiber module OF_D1 and one second transmission direction optical fiber module OF_D2.

11, if the image data transmission apparatus 10 satisfies the MIPI CSI II, the image data transmission apparatus 10 can transmit the image data and the signal in the direction opposite to the transmission direction of the clock signal And may further include a dummy optical fiber module 630.

That is, the first transmission direction optical fiber module OF_D1 may be an optical fiber module 610 for clock, and the second transmission direction optical fiber module OF_D2 may be a dummy optical fiber module 630. [ The dummy optical fiber module 630 may be used as an extra optical fiber module for transmitting various signals or data transmitted from the CPU 520 to the image sensor 100.

Further, when the image data transmission apparatus 10 further includes the additional image sensor 150, it further includes an additional dummy optical fiber module 635 capable of transmitting signals in the direction opposite to the transmission direction of the additional image data and the clock signal .

12, if the image data transmission apparatus 10 satisfies the MIPI CSI III, the image data transmission apparatus 10 includes the first optical fiber module 200, the second optical fiber module 300, And a dummy optical fiber module 630 in addition to the synchronization confirmation optical fiber module 620.

At this time, the dummy optical fiber module 630 can transmit signals in the same direction as the transmission direction of the image data. That is, the first transmission direction optical fiber module OF_D1 may be a dummy optical fiber module 630 and the second transmission direction optical fiber module OF_D2 may be an optical fiber module 620 for synchronization confirmation.

When one of the first optical fiber module 200 and the second optical fiber module 300 is an abnormal optical fiber module that can not transmit image data, the dummy optical fiber module 630, which is the first transmission optical fiber module OF_D1, ) Can replace the unsteady optical fiber module and transmit image data. Thus, the operation stability of the endoscope system can be improved.

If the image data transmission apparatus 10 includes the additional image sensor 150 and the additional image sensor 150 satisfies the MIPI CSI III, the additional dummy light for transmitting the signal in the same direction as the transmission direction of the additional image data And may further include a fiber module 635.

Similarly, when the first additional optical fiber module 250 or the second additional optical fiber module 350 is an abnormal optical fiber module in which image data can not be transmitted, the additional dummy optical fiber module 635 may be connected to the abnormal portion The image data can be transmitted by replacing the optical fiber module.

The MIPI CSI II standard and the MIPI CSI III standard described above are only examples, and the embodiment of the present invention is not limited to these standards.

8, the endoscope system according to the embodiment of the present invention may further include a control optical fiber module 640 and an input optical fiber module 650. [ First, the control optical fiber module 640 will be described.

The control optical fiber module 640 can be used for communication between the CPU 520 and the focusing unit 530, the image sensor 100 and the additional image sensor 150, The image sensor 100, and the additional image sensor 150 may be controlled.

The focusing unit 530 may implement focusing of the image sensor 100 or the additional image sensor 150 by driving the focusing lens under the control of the CPU 520. [ The image sensor 100 and the additional image sensor 150 may be initialized according to a control signal of the CPU 520. [ The autofocusing and initialization are only examples of the control by the CPU 520, and various controls for the image sensor 100, the additional image sensor 150, and the focusing unit 530 can be performed by the CPU 520. [

The endoscopic system according to the embodiment of the present invention includes a communication between the CPU 520 and the focusing unit 530, a communication between the CPU 520 and the image sensor 100, And a communication chip 540 for performing communication between the base station 150 and the base station. Communication chip (540) may support a particular communication standard, such as I ² C, but is not limited to the I ² C communications standards.

At this time, the communication chip 540 may be embedded in the focusing unit 530, the image sensor 100, and the additional image sensor 150. The control optical fiber module 640 may be connected to each of the communication chips 540 used in the communication process with the CPU 520.

In FIG. 8, one control optical fiber module 640 is shown connected to each communication chip 540, but this is not limitative.

For example, as shown in FIG. 13, the plurality of communication chips 540 can communicate with the CPU 520 via a communication bus. One control optical fiber module 640 can be connected per communication bus line. The two communication bus lines may be for transmission and reception with the CPU 520. That is, one communication bus line may be for receiving the control signal output from the CPU 520, and the other communication bus line may be for transmitting operation information to the CPU 520.

The operation information may be information that the CPU 520 receives from the focusing unit 530, the image sensor 100, and the additional image sensor 150 for control. For example, the operation information may be information on the current state of the focusing unit 530, the image sensor 100, and the additional image sensor 150, but is not limited thereto.

Although not shown in FIG. 13, a clock bus line for transmitting a clock signal from the CPU 520 to the focusing unit 530, the image sensor 100, and the additional image sensor 150 may be added, Can also be connected to the control optical fiber module.

When the bus communication is performed as described above, the number of the control optical fiber modules 640 can be reduced. 13, when a communication bus is used, two control optical fiber modules 640 may be required for a plurality of communication chips 540. On the other hand, when the communication bus is not used, the number of the control optical fiber modules 640 may increase because each communication chip 540 and the control optical fiber module 640 are connected.

That is, the image sensor 100 and the CPU 520 communicate through a communication bus, and the communication bus may include a transmission bus line and a reception bus line. In this case, each of the transmission bus line and the reception bus line may be connected to the control optical fiber module 640.

The additional image sensor 150 and the focusing unit 150 can also communicate with the CPU 520 via the communication bus.

Next, the input optical fiber module 650 will be described.

As shown in FIG. 8, the endoscope system according to the embodiment of the present invention may include an input unit 550. The input unit 550 generates an input signal for upward, downward, leftward and rightward movement of the image generating unit 20, white balance for image data or additional image data, and menu selection according to the user's operation can do. The CPU 520 can control the endoscope system according to the input signal.

For convenience of explanation, a driving unit for moving the image generator 20 in the up, down, left, and right directions is not shown in FIG.

Such an input signal may be transmitted to the CPU 520 through the input optical fiber module 650 connected to the input unit 550 and may be transmitted to the image generating unit 20 in the order of up, A white balance adjustment for the image data, and six input optical fiber modules 650 for each menu selection, but the number of input optical fiber modules 650 can be increased or decreased. The input unit 550 may include a GPIO (general purpose input / output) port, but is not limited thereto.

8, the optical fiber module and the control optical fiber module 640 connected to the input unit 550 and the communication chip 540 are connected to the image data input unit 500, so that the number of the optical fiber modules can be increased .

For example, as described above, the input unit 550 is connected to the six input optical fiber modules 650, and the communication bus for the plurality of communication chips 540 is connected to the two control optical fiber modules 640 , Eight optical fiber modules may be required in addition to the optical fiber module connected to the image sensor 100 or the additional image sensor 150.

In this case, the number of optical fibers surrounded by the protection part (OFP) also increases, and the thickness of the image data transmission device 10 may excessively increase.

As shown in FIG. 14, the endoscope system according to the embodiment of the present invention further includes a micro control unit (MCU) 560 to reduce the number of optical fiber modules.

An endoscope system according to an embodiment of the present invention includes an input unit 550 that can be operated by a user, an MCU 560 that encodes an input signal of the input unit 550, and an MCU 560 that is connected to the MCU 560, And a third optical fiber module 660 for transmitting an input signal. In this case, the number of the third optical fiber modules 660 transmitting the encoded input signal may be smaller than the number of input pins of the MCU 560 receiving the input signal from the input unit 550.

For example, as shown in FIG. 15, the input unit 550 generates input signals for up / down / left / right, white balance, and menu selection so that the MCU 560 outputs six inputs Pin may be provided.

The MCU 560 can input and encode the input signals in parallel and output them to the output terminal, and the third optical fiber module 660 can be connected to the output terminal. The third optical fiber module 660 may communicate with the CPU 520 through the image data input unit 500 or may be directly connected to the CPU 520.

Unlike the embodiment of the present invention, in the absence of the MCU 560, the input unit 550 must be connected to the six input optical fiber modules 650 as described above. In the embodiment of the present invention, the MCU 560, The number of the third optical fiber modules 660 transmitting the encoded input signal may be smaller than that of the six input optical fiber modules 650. [

14 and 15, the endoscope system according to the embodiment of the present invention may further include an additional image sensor 150, an MCU 560, and a third optical fiber module 660.

The additional image sensor 150 may generate additional image data by sensing light different from the wavelength of the light sensed by the image sensor 100. [

The MCU 560 can input and output control signals and operation information for the image sensor 100 and the additional image sensor 150. That is, the MCU 560 outputs control signals to the image sensor 100 and the additional image sensor 150, and receives the operation information from the image sensor 100 and the additional image sensor 150.

The third optical fiber module 660 may be connected to the MCU 560 to transmit and receive control signals and operation information to the CPU 520. That is, the MCU 560 can receive the control signal from the CPU 520 through one optical fiber module 660 and transmit the operation information to the CPU 520 through the other optical fiber module .

In this case, the number of the third optical fiber modules 660 may be equal to or less than the number of pins of the MCU 560 for inputting / outputting control signals and operation information.

The control signal and operation information have been described in detail in the foregoing, and a description thereof will be omitted.

The MCU 560 is connected to one third optical fiber module 660, decodes the control signal from the CPU 520, and transmits the decoded control signal to the communication bus. The MCU 560 transmits the operation information of at least one of the image sensor 100, the additional image sensor 150 and the focusing unit 530 to the third optical fiber module 660 after encoding, To the CPU 520 via the network.

The encoding and decoding of the MCU 560 is only an example occurring during the communication process between the MCU 560 and the CPU 520, but the operation of the MCU 560 is not limited thereto.

As described above, when the image sensor 100 and the additional image sensor 150 communicate with the CPU 520 via the communication bus, the MCU 560 has two terminals for transmitting and receiving control signals and operation information And the two terminals can be connected to a communication bus.

Also, the MCU 560 can transmit and receive the control signal and the operation information through the two third optical fiber modules 660. The number of the third optical fiber modules 660 may be equal to the number of pins of the MCU 560 that inputs and outputs control signals and operation information of the image sensor 100 and the additional image sensor 150.

The MCU 560 needs to have two terminals for each communication chip 540 for transmission and reception so that the number of the third optical fiber modules 660 is limited by the number of the communication chips, May be smaller than the number of pins of the MCU 560 outputting control signals of the image sensor 100 and the additional image sensor 150. [

Meanwhile, as shown in FIGS. 8 and 14, the OFP of the image data transmission device 10 may be made of a material that can withstand an auto clave for disinfection of medical devices. Since the endoscope system of the present invention is also a medical device, an autoclave can be realized. The autoclave is operated for 20 minutes under a steam atmosphere of 120 at 20 atm. The optical fiber can be melted at a temperature lower than 120 degrees.

The protection part (OFP) covers the optical fiber to protect the optical fiber during the autoclave process. Since the temperature of steam is high but the heat capacity is small due to sterilization using an autoclave system, the OFP in the embodiment of the present invention can protect the optical fiber by including the thermally rubbed rubber.

As described above, the OFP includes the first to third optical fiber modules 660, the first and second additional optical fiber modules 350, the control optical fiber module 640, the input optical fiber module 640, 650) of the optical fiber module.

As shown in FIGS. 8 and 14, the endoscope system according to the embodiment of the present invention may further include a monitoring unit 570. The monitoring unit 570 monitors at least one of the image data input unit 500, the CPU 520, and the image processing unit 510 in real time to perform at least one reset according to the at least one status value.

Since the endoscope system is used for medical purposes, the processing of image data and additional image data must always be performed stably. For example, if the physician does not see an image of the inside of the human body during the surgical procedure, the surgical procedure may not be performed smoothly.

Accordingly, the monitoring unit 570 can perform real-time monitoring of at least one of the image data input unit 500, the image processing unit 510, and the CPU 520 that performs processing of image data, additional image data, and a user interface have.

For example, the monitoring unit 570 may receive the status value of at least one of the image data input unit 500, the image processing unit 510, and the CPU 520 every 1 ms. 1 ms or less.

The monitoring unit 570 can reduce or minimize the abnormal image processing or the user interface processing time by resetting the corresponding component of the state value indicating an abnormality or an error.

Since the monitoring unit 570 performs a simple function in comparison with the CPU 520, the monitoring unit 570 may be implemented in the form of a Micro Control Unit or a firmware, but is not limited thereto.

As described above, the image data transmission device 10 and the endoscope system according to the embodiment of the present invention include the optical fiber module instead of the coaxial cable, thereby providing the image data transmission device 10 of smaller diameter than the coaxial cable can do.

Accordingly, the image data transmission apparatus 10 and the endoscope system according to the embodiment of the present invention can transmit image data or additional image data of high resolution or super high resolution by overcoming the bandwidth limitation of the coaxial cable.

In addition, since the encoding, serializing, deserializing, and decoding are not performed through the optical fiber module, transmission of image data and additional image data can be performed more quickly.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or scope of the invention as defined in the appended claims. It is to be understood that the above-described embodiments are to be considered illustrative and not restrictive, and the invention is not to be limited to the details given above, but may be modified within the scope of the appended claims and equivalents thereof .

The image data transfer device (10)
The image-
In the main body 30,
The image sensor 100,
The first optical fiber module 200,
The second optical fiber module 300,
The additional image sensor 150,
The first additional optical fiber module 250,
The second additional optical fiber module 350,
The image data input unit 500,
The image processing unit 510,
The CPU 520,
The focusing unit 530
The communication chip (540)
The input unit 550,
MCU 560
The monitoring unit 570

Claims (35)

An image sensor including a first image terminal and a second image terminal for generating image data, and for transmitting at least a part of the image data;
A first optical fiber module and a second optical fiber module respectively connected to the first image terminal and the second image terminal;
An additional image sensor including a first additional image terminal for transmitting at least a part of the additional image data and a second additional image terminal for sensing additional light different from a wavelength of light sensed by the image sensor, ; And
The first additional optical fiber module and the second additional optical fiber module being connected to the first additional image terminal and the second additional image terminal, respectively.
The method according to claim 1,
The first optical fiber module is connected to the third image terminal together with the first image terminal,
The second optical fiber module is connected to the fourth image terminal together with the second image terminal,
Wherein the first optical fiber module and the second optical fiber module transmit the image data in a differential mode.
The method according to claim 1,
Wherein the first optical fiber module and the second optical fiber module transmit the image data in a single-ended mode.
The method according to claim 1,
Wherein at least a part of the image data is transmitted through the first optical fiber module and the second optical fiber module without serialization of the image data.
The method according to claim 1,
Wherein the first optical fiber module and the second optical fiber module comprise:
A second image terminal connected directly to the first image terminal and the second image terminal,
And the second image terminal is connected to the first image terminal and the second image terminal through a connector.
delete The method according to claim 1,
The first additional optical fiber module is connected to the third additional image terminal in addition to the first additional image terminal,
The second additional optical fiber module is connected to the fourth additional image terminal in addition to the second additional image terminal,
Wherein the first additional optical fiber module and the second additional optical fiber module transmit the additional image data in a differential mode.
The method according to claim 1,
Wherein the first additional optical fiber module and the second additional optical fiber module transmit the additional image data in a single-ended mode.
The method according to claim 1,
Wherein at least a part of the additional image data is transmitted through the first additional optical fiber module and the second additional optical fiber module without a serialization process on the additional image data.
An image sensor comprising a first image terminal and a second image terminal for generating image data and for transmitting at least a portion of the image data; and a second optical fiber, connected to the first image terminal and the second image terminal, A first additional image terminal for transmitting at least a part of the additional image data and a second additional image terminal for transmitting at least a part of the additional image data, An additional image sensor including an image terminal and a first additional optical fiber module and a second additional optical fiber module connected to the first additional image terminal and the second additional image terminal to transmit the additional image data, An image data transmission device;
An image data input unit connected to the image data transmission apparatus and transmitting the image data output through the image data transmission apparatus to a set path; And
And an image processing unit for performing image processing on the image data transmitted from the image data input unit under the control of the CPU.
11. The method of claim 10,
The CPU processes the user interface for the image data,
Wherein the image processing unit overlaps the image data with the user interface.
11. The method of claim 10,
Wherein the first optical fiber module and the second optical fiber module transmit the image data in a differential mode or a single-ended mode.
11. The method of claim 10,
Wherein at least a part of the image data is transmitted through the first optical fiber module and the second optical fiber module without a serialization process on the image data.

11. The method of claim 10,
Wherein the first optical fiber module and the second optical fiber module comprise:
A second image terminal connected directly to the first image terminal and the second image terminal,
And the second image terminal is connected to the first image terminal and the second image terminal through a connector.
delete 11. The method of claim 10,
Wherein the image data input unit comprises:
Wherein the image processing apparatus further comprises a control unit that receives the additional image data together with the image data, transmits the additional image data to the CPU, transmits the image data to the image processing unit,
Wherein the image processing unit receives additional image data from the CPU and overlaps the image data.
11. The method of claim 10,
Wherein the image sensor further comprises a terminal for a first clock,
Wherein the image data transmission device further comprises a clock optical fiber module connected to the first clock terminal,
Wherein the clock optical fiber module transmits a clock signal in a differential mode or a single-ended mode.
18. The method of claim 17,
Wherein the transmission direction of the image data transmitted by the first optical fiber module and the second optical fiber module is the same as the transmission direction of the clock signal transmitted by the optical fiber module for clock.
19. The method of claim 18,
Wherein the image data transmission device comprises:
Further comprising a dummy optical fiber module capable of transmitting a signal in a direction opposite to a transmission direction of the image data and the clock signal.
11. The method of claim 10,
Wherein the additional image sensor further comprises a terminal for a first additional clock,
Wherein the image data transmission apparatus further comprises a clock additional optical fiber module connected to the terminal for the first additional clock,
Wherein the clock-use additional optical fiber module transmits a clock signal in a differential mode or a single-ended mode.
21. The method of claim 20,
Wherein the additional image data of the first additional optical fiber module, the second additional optical fiber module, and the additional optical fiber module for clock and the clock signal are transmitted in the same direction.
22. The method of claim 21,
Further comprising an additional dummy optical fiber module capable of transmitting a signal in a direction opposite to a transmission direction of the additional image data and the clock signal.
13. The method of claim 12,
Wherein the image data transmission apparatus further comprises an optical fiber module for synchronization confirmation,
Wherein the synchronization confirmation optical fiber module transmits a synchronization confirmation signal in a differential mode or a single-ended mode.
24. The method of claim 23,
Wherein the transmission direction of the image data of the first optical fiber module and the second optical fiber module is opposite to the transmission direction of the synchronization confirmation signal of the synchronization confirmation optical fiber module.
25. The method of claim 24,
Further comprising a dummy optical fiber module for transmitting signals in the same direction as the transmission direction of the image data.
26. The method of claim 25,
When one of the first optical fiber module and the second optical fiber module is an abnormal optical fiber module in which the image data can not be transmitted, the dummy optical fiber module replaces the abnormal optical fiber module and transmits the image data And the endoscope system.
11. The method of claim 10,
Wherein the image data transmission apparatus further comprises an additional optical fiber module for synchronization confirmation,
Wherein the synchronization confirmation additional optical fiber module transmits a synchronization confirmation signal in a differential mode or a single-ended mode.
28. The method of claim 27,
The transmission direction of the additional image data of the first additional optical fiber module and the second additional optical fiber module is opposite to the transmission direction of the synchronization confirmation signal of the additional optical fiber module for synchronization confirmation. .
29. The method of claim 28,
Further comprising an additional dummy optical fiber module for transmitting signals in the same direction as the transmission direction of the additional image data.
30. The method of claim 29,
Wherein when the first additional optical fiber module or the second additional optical fiber module is an abnormal optical fiber module in which image data can not be transmitted, the additional optical fiber module replaces the abnormal optical fiber module, And transmits the data to the endoscope system.
11. The method of claim 10,
Further comprising an input unit operable by a user, an MCU encoding an input signal of the input unit, and a third optical fiber module connected to the MCU and transmitting an encoded signal encoded from the MCU,
Wherein the number of third optical fiber modules transmitting the encoded input signal is smaller than the number of input pins of the MCU receiving the input signal from the input unit.
11. The method of claim 10,
An MCU for inputting and outputting control signals and operation information for the image sensor and the additional image sensor,
And a third optical fiber module connected to the MCU to transmit and receive the control signal and the operation information to the CPU,
Wherein the number of the third optical fiber modules is equal to or smaller than the number of the MCU pins for inputting and outputting the control signal and the operation information.
11. The method of claim 10,
Wherein the image data transmission device further comprises a protection unit for protecting optical fibers of the first optical fiber module and the second optical fiber module,
Wherein the protection unit is made of a material capable of withstanding an autoclave for sterilizing a medical instrument.
34. A method according to any one of claims 10 to 14 and 16 to 33,
Further comprising a monitoring unit configured to monitor at least one of the image data input unit, the CPU, and the image processing unit in real time to perform the at least one reset according to the at least one status value.
11. The method of claim 10,
Wherein the image sensor and the CPU communicate via a communication bus,
Wherein the communication bus includes a transmission bus line and a reception bus line,
Wherein the transmission bus line and the reception bus line are connected to a control optical fiber module, respectively.

Images