CN106937036A - Image data transmission equipment and the endoscopic system including image data transmission equipment - Google Patents

Image data transmission equipment and the endoscopic system including image data transmission equipment Download PDF

Info

Publication number
CN106937036A
CN106937036A CN201610574692.XA CN201610574692A CN106937036A CN 106937036 A CN106937036 A CN 106937036A CN 201610574692 A CN201610574692 A CN 201610574692A CN 106937036 A CN106937036 A CN 106937036A
Authority
CN
China
Prior art keywords
image data
additional
module
optical fiber
optic module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610574692.XA
Other languages
Chinese (zh)
Other versions
CN106937036B (en
Inventor
姜旭
申亨
申一亨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ind Smart Co Ltd
Original Assignee
Ind Smart Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ind Smart Co Ltd filed Critical Ind Smart Co Ltd
Publication of CN106937036A publication Critical patent/CN106937036A/en
Application granted granted Critical
Publication of CN106937036B publication Critical patent/CN106937036B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/555Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/22Adaptations for optical transmission

Landscapes

  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Physics & Mathematics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Endoscopes (AREA)

Abstract

The invention discloses a kind of image data transmission equipment and the endoscopic system including image data transmission equipment, endoscopic system includes:Image sensor, generates image data and is used to transmit at least one of image data including the first video port and the second video port, first video port and second video port;Image data transmission equipment includes:First optic module and the second optic module, first optic module and second optic module are connected to first video port and second video port;Image data input unit, is connected to the image data transmission equipment and the image data exported by the image data transmission equipment is sent to the path of setting;And image processing department, according to the image processing for controlling the image data of the execution to being transmitted by the image data input unit of CPU.The system can overcome the bandwidth restrictions problem in image data transmission.

Description

Image data transmission equipment and the endoscopic system including image data transmission equipment
Technical field
The present invention relates to a kind of image data transmission equipment and the endoscope system including image data transmission equipment System.
Background technology
The image of inside of human body is supplied to doctor, Yi Shengke by endoscopic system in operation or checking process Checking process is correctly performed the operation or is carried out to confirm that therefore image can be stablized.
Nearest endoscopic system does not require nothing more than simple offer image and provides various function to endoscope Requirement increase.
Therefore, to can high speed processing image and provide various function endoscopic system research Carry out in.
Prior art literature
Patent document
No. 10-2007-0071556 (publication date of KR published patent:On July 4th, 2007)
The content of the invention
Technical problem
According to the invention ,the aim of the invention is to provide a kind of image data transmission equipment and set including image data transmission Standby endoscopic system, the system can overcome the bandwidth restrictions problem in image data transmission.
Problem of the invention is not limited to problem as mentioned above, the technical field of the invention it is common Technical staff can be clearly understood that NM other problemses from following record.
The means of solve problem
The image data transmission equipment of one embodiment of the invention, including:Image sensor, generates image Data and including the first video port and the second video port, first video port and second shadow As port is used to transmit at least one of image data;And first optic module and the second optic module, First optic module and second optic module are connected to first video port and described Second video port.
First optic module is connected to the 3rd image end while being connected to first video port Mouthful, second optic module is connected to the 4th video port while being connected to second video port, First optic module and second optic module transmit the image data under differential mode.
First optic module and second optic module transmit the image number in a single ended mode According to.
Under without the serialization process to the image data, by least one of image data Transmitted by first optic module and second optic module.
First optic module and second optic module be directly connected in first video port and Second video port is connected to first video port and the second image end by connector Mouthful.
And image data transmission equipment of the invention, also includes:Additional image sensor and first attached Plus optic module and the second additional optical fiber module;The additional image sensor is perceived and the image sensing The different light of optical wavelength that device is perceived simultaneously generates additional image data, and including the first additional video port and Second additional video port, the first additional video port and the second additional video port are used to pass Deliver at least part of additional image data;The first additional optical fiber module and it is described second add Optic module, is connected to the described first additional video port and the second additional video port.
The first additional optical fiber module is connected to the 3rd while being connected to the first additional video port Additional video port, while the second additional optical fiber module is connected to the second additional video port It is connected to the 4th additional video port, the first additional optical fiber module and the second additional optical fiber module The additional image data is transmitted under differential mode.
The first additional optical fiber module and the second additional optical fiber module transmit described in a single ended mode Additional image data.
Also, under without the serialization process to the additional image data, will be at least one of The additional image data is carried out by the first additional optical fiber module and the second additional optical fiber module Transmission.
The endoscopic system of one embodiment of the invention, including:Image data transmission equipment, including image Sensor and the first optic module and the second optic module, the image sensor generation image data are simultaneously wrapped The first video port and the second video port are included, first video port and second video port are used In at least one of image data, first optic module and second optic module is transmitted, divide First video port and second video port are not connected to;Image data input unit, is connected to The image data transmission equipment and the image data that will be exported by the image data transmission equipment Transmitted in path according to setting;And image processing department, the control according to CPU is to the image number The image data transmitted according to input unit carries out image processing.
The CPU carries out user interface process to the image data, and the image processing department is by the use Family interface and the image data are overlapped.
First optic module and second optic module are under differential mode or in a single ended mode Transmit the image data.
Also, under without the serialization process to the image data, will be at least one of described Image data is transmitted by first optic module and second optic module.
First optical fiber is touched and second optic module, be directly connected in first video port and Second video port is connected to first video port and second image by connector Port.
The endoscopic system of one embodiment of the invention, also including additional image sensor and the first additional optical Fiber module and the second additional optical fiber module, the additional image sensor are perceived and the image sensor sense The different light of the optical wavelength known simultaneously generates additional image data, and including the first additional video port and second Additional video port, the first additional video port and the second additional video port are used to be sent to At least part of additional image data;The first additional optical fiber module and second additional optical fiber Module, is connected to the described first additional video port and the second additional video port, differential The additional image data is transmitted under pattern or in a single ended mode.
The image data input unit, additional image data is received while receiving the image data, will The additional image data is sent to the CPU, and the image data is sent into the image processing department, The image processing department receives the additional image data of the CPU transmission and overlaps onto the image data On.
The image sensor also includes the first clock port;The image data transmission equipment also includes It is connected to the clock optic module of the first clock port;The clock optic module is differential Clock signal is transmitted under pattern or in a single ended mode.
The direction of transfer of first optic module and the image data of second optic module transmission It is identical with the direction of transfer that optic module transmits the clock signal with the clock.
The image data transmission equipment also includes emulation optic module;The emulation optic module can be to Sender with the image data and the clock signal transmits signal in the opposite direction.
The additional image sensor also includes the first additional clock port;The image data transmission sets For also including clock additional optical fiber module;It is attached that the clock additional optical fiber module is connected to described first Added-time clock port;The clock additional optical fiber module is passed under differential mode or in a single ended mode Send clock signal.
The first additional optical fiber module, the second additional optical fiber module and the clock additional optical The described additional image data of fiber module and the direction of transfer of the clock signal are mutually the same.
The endoscopic system of one embodiment of the invention, also including additional emulation optic module;It is described additional Emulation optic module can be to opposite with the direction of transfer of the additional image data and the clock signal Transmit signal in direction.
The image data transmission equipment is also including confirmation of synchronization optic module;The confirmation of synchronization is used up Fiber module transmits confirmation of synchronization signal under differential mode or in a single ended mode.
The image data direction of transfer of first optic module and second optic module with it is described The direction of transfer of the confirmation of synchronization signal of confirmation of synchronization optic module is opposite.
The endoscopic system of one embodiment of the invention, also including emulation optic module;The emulation optical fiber Module transmits signal to the direction of transfer identical direction with the image data.
When in first optic module and second optic module is that cannot transmit the image During the improper optic module of data, the emulation optic module substitutes the improper optic module transmission The image data.
The image data transmission equipment is also including confirmation of synchronization additional optical fiber module;The confirmation of synchronization Confirmation of synchronization signal is transmitted under differential mode or in a single ended mode with additional optical fiber module.
The described additional image data of the first additional optical fiber module and the second additional optical fiber module is passed Send the direction of transfer of direction and the confirmation of synchronization signal of the confirmation of synchronization additional optical fiber module each other Conversely.
The endoscopic system of one embodiment of the invention, also including additional emulation optic module;It is described additional Emulation optic module transmits signal to the direction of transfer identical direction with the additional image data.
One in the first additional optical fiber module and the second additional optical fiber module cannot to transmit institute When stating the improper additional optical fiber module of image data, the additional emulation optic module substitutes the anon-normal Normal additional optical fiber module transmits the image data.
The endoscopic system of one embodiment of the invention, also including input unit, MCU and the 3rd optical fiber mode Block;The input unit, can be operated by user;The MCU is believed the data of the input unit Number encoded;3rd optic module is connected to the MCU and transmits the input encoded by MCU Signal;The quantity that the 3rd optic module of input signal is coded of described in transmission is less than from the input unit Receive the quantity of the input pin of the MCU of the input signal.
The endoscopic system of one embodiment of the invention, also including additional image sensor, MCU and Three optic modules;The additional image sensor perceives different from the optical wavelength that the image sensor is perceived Light and generate additional image data, MCU output and be input into the image sensor and described attached Plus the control signal of image sensor is connected to the MCU simultaneously with information, the 3rd optic module is acted The control signal and the action information are received and dispatched to the CPU;Quantity of 3rd optic module etc. In or less than for being input into and export the control signal and the pin of the MCU of the action information Quantity.
The image data transmission equipment also includes protection portion;The protection portion protects first optical fiber mode Block and the respective optical fiber of the second optic module;The protection portion is disappeared by that can bear for medicine equipment Poison and the material of high steam processs that carries out and constitute.
The endoscopic system of one embodiment of the invention, also including monitoring unit;The monitoring unit is to the shadow As at least one carries out monitor in real time in data input part, the CPU and the image processing department, according to Described at least one state value resets to described at least one.
The image sensor and the CPU are communicated by communication bus, and the communication bus includes Output bus and input bus, the output bus and the input bus are respectively connected on control optical fiber mode Block.
The effect of invention
Image data transmission equipment of the invention and the endoscopic system bag including image data transmission equipment Optic module is included, therefore with the beneficial effect of the limitation that can overcome bandwidth.
Effect of the invention is not limited to above-described effect, the technical field of the invention it is common Technical staff can be clearly understood that NM other effects from the record of protection scope of the present invention.
Brief description of the drawings
Fig. 1 to Fig. 6 is the image data transmission equipment for representing embodiments of the invention.
Fig. 7 is the exemplary graph of the outward appearance of the endoscopic system for representing embodiments of the invention.
Fig. 8 and Figure 14 are the block diagram of the endoscope for representing embodiments of the invention.
Fig. 9 to Figure 12 is various changes of the image data transmission equipment for representing endoscopic system of the invention Shape.
Figure 13 is the citing of the communication chip and control optic module of the endoscopic system of embodiments of the invention Figure.
Figure 15 is the MCU and the exemplary graph of the 3rd optic module of the endoscopic system of embodiments of the invention.
Specific embodiment
Referring to the drawings to a preferred embodiment of the present invention will be described in detail.But accompanying drawing is only used for simply The present invention will be described, and general technical staff of the technical field of the invention is expressly understood that the present invention Scope be not limited to the scope of drawing.
And the word that the present invention is used is only used for the explanation of specific embodiment, but does not limit this hair Bright intention.For odd number explanation in explanation if including other implications without clear and definite its, it is also possible to Explanation including plural number.
In the present invention " including " or the word such as " having " be for specify specification to record specific numeral, Stage, action, inscape, accessory are combined by these, do not exclude in advance to one or The characteristics of above or numeral, stage, action, inscape, accessory or the presence combined by these Or additional possibility.
The data transfer equipment and endoscopic system of one embodiment of the invention are carried out with reference next to accompanying drawing Explanation.
Fig. 1 and Fig. 2 represent the image data transmission equipment of embodiments of the invention.Such as Fig. 1 and Fig. 2, this The image data transmission equipment of inventive embodiment include image sensor 100, the first optic module 200 with And second optic module 300.
Image sensor 100 generates image data and including the first video port T1 and the second video port T2.Image sensor 100 can be generated according to the AP (Application as mobile device CPU Processor) the generation of treatable specification image data.
For example, image sensor 100 can generate MIPI (Mobile Industry Processor Interface) Specification, LVDS (Low-Voltage Differential Signaling) specification, Parallel Interface specifications Image data, but it is not limited to this.MIPI specifications can be mobile for smart mobile phone (smart phone) etc. Equipment High Speed Transfer image data and use.
First optic module 200 and the second optic module 300 are connected to the first video port T1 and Two video port T2.First video port T1 and in Fig. 1 and Fig. 2 and Fig. 3 to Fig. 6 described later The quantity of two video port T2 can change according to the transmission specification of image data.
As shown in Figures 1 and 2, the first optic module 200 and the second optic module 300 include illuminating part LT, optical fiber OF and light absorbing part LR.Electronic signal is transformed to optical signal, optical fiber OF by illuminating part LT Transmit the optical signal of conversion, light absorbing part LR will pass through the optical signals that be transmitted of optical fiber OF and become again to turn to electricity Subsignal.
Various optic modules described later equally may be used beyond first optic module 200 and the second optic module 300 With including illuminating part LT, optical fiber OF and light absorbing part LR.
As shown in Figures 1 and 2, optic module is connected to an image end of image sensor 100 Mouthful.Therefore, the image data transmission equipment of embodiments of the invention transmits image with respect to coaxial line The mode of data will have various strong point.
Different from embodiments of the invention, when all video ports of image sensor 100 are connected to one Coaxial line (coaxial cable) and when transmitting image data, it is necessary to serialiser (serializer) is conciliate Serialiser (deserializer).
The image data that serialiser will be exported by multiple video ports carries out sequence by exchanging (switching) Rowization are simultaneously transmitted by a coaxial line, the serializing that de-serializer will be transmitted by coaxial line Image data is swapped and reverts to original state.
Thus, the bandwidth of serialiser and de-serializer is multiplied by video port than the bandwidth of video port Quantity result it is big.In this case serialiser and de-serializer can be loaded excessive load.
That is, because the band of serialiser and de-serializer is roomy, clock (clock) accelerates, electric power disappears Consumption becomes big, therefore serialiser and de-serializer can produce excessive heat.It is how serial that heat is produced Change the life-span of device and de-serializer and will shorten, act confidence level and can also reduce.
Also, serialiser and de-serializer need the time to carry out process image data, and therefore image data is passed Sending the time can increase.For example, when doctor grasps patient body inside and performed the operation by endoscopic system, Image comprising surgical behavior needs to be shown in real time.
When increasing the time that image data is transmitted by serialiser and de-serializer, above-mentioned image Display will postpone doctor and confirm the operation behavior of oneself after some period of time, it is thus possible to occur Unexpected malpractice.
Especially, such as full HD grades (below, FHD grades) or ultra HD grades of (below, UHD Level) image etc. need image data to be processed big in the case of serialiser and de-serializer action Burden can equally increase.
In addition, coaxial line is connected to serialiser and de-serializer, therefore coaxial line is also required to big band It is wide.The maximum bandwidth of coaxial line is 10Gbps, but if by UHD grades of image with 60 data per second The bandwidth of transmission line needs 12.5Gbps when frame is to be transmitted.Therefore, high-resolution is transmitted by coaxial line The image of rate is limited.
Therefore, when high-resolution image data is transmitted by coaxial line, image data is needed by compiling Code device (encoder) is sent to serialiser after being compressed, and will be logical by decoder (decoder) Cross the compressing image data recovery of de-serializer into original state.
So as to image data propagation delay due to encoder and decoder, the generation of heat and knot occurs The problems such as structure is complicated.Moreover, due to the ultrahigh speed image data electromagnetic wave meeting transmitted by coaxial line Increase, therefore the possibility of image data distortion or generation noise can equally increase.
In contrast, when being connected with an optic module such as one video port of embodiments of the invention, Not needing above-mentioned serialiser and de-serializer can also be carried out image data by optic module Transmission.Therefore can solve due to the heat of serialiser, de-serializer, encoder and decoder etc. The problems such as generation of amount, complicated structure, decline of action confidence level.
In this way, because a video port is connected with an optic module, therefore can overcome in transmission The bandwidth limitation of the coaxial line produced when FHD grades of image data or UHD grades of image data.
That is, the image data transmission equipment of embodiments of the invention need not be to the serializing of image data Journey, at least one of image data is transmitted by the first optic module and the second optic module.
In addition, as shown in figure 1, the first optic module 200 connects while being connected to the first video port T1 The 3rd video port T3 is connected to, the second optic module 300 connects while being connected to the second video port T2 It is connected to the 4th video port T4.Now, the first optic module 200 and the second optic module 300 can be with Image data is transmitted under differential mode.
That is, the first optic module 200 passes through between the first video port T1 and the 3rd video port T3 Voltage difference transmits image data, and the second optic module 300 is again by the second video port T2 and the 4th shadow As the voltage difference transmission image data between the T4 of port.
For example, when illuminating part LT includes VCSEL (Vertical Cavity Surface Emitting Laser), The input unit of VCSEL includes two ports (P ports and N-port).Now, VCSEL implements differential Pattern.That is, when producing the voltage difference time to be released between two ports, when without voltage difference is produced Light will not be released.
Light absorbing part LR includes optotransistor (Optical Transistor), the source electrode when optotransistor receives light (source) voltage can be produced and drain electrode (drain) between.This voltage is carried out amplification product by light absorbing part LR The differential voltage (differential voltage) of the size needed for raw.
Also, as shown in Fig. 2 the first optic module and second optic module are in single-ended mode Image data is transmitted under (Single-Ended mode).For example, the P ports of each VCSEL are connected to The N-port of one video port T1 or the second video port T2, each VCSEL is mutually grounded (ground).
VCSEL releases light when voltage difference is produced between N-port and P ports, even if therefore N-port The image data of input can also be transformed into optical signal by ground connection by P ports.
In addition, as shown in Figures 1 and 2, the first optic module 200 and the second optic module 300 can be straight The first video port T1 and the second video port T2 is connected in succession.Or as shown in Figures 3 and 4, the One optic module 200 and the second optic module 300 are connected to the first image end by connector (CON) Mouth T1 and the second video port T2.
As shown in Figure 5, Figure 6, the image data transmission equipment of embodiments of the invention also includes additional image Sensor 150, the first additional optical fiber module 250 and the second additional optical fiber module 350.Additional image sensing Device 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and generates additional image data, And including for transmitting the first of at least one of additional image data the additional video port AT1 and second Additional video port AT2.
Now, the first additional optical fiber module 250 and the second additional optical fiber module 350 are respectively connected on first Additional video port AT1 and the second additional video port AT2.
For example, image sensor 100 can perceive visible rays, additional image sensor 150 can be felt Know infrared ray or ultraviolet, but be not limited to this, additional image sensor 150 is carried out in detail afterwards Describe in detail bright.
In addition, as shown in figure 5, the first additional optical fiber module 250 is connected to the first additional video port AT1 While be connected to the 3rd additional video port AT3.
Also, the second additional optical fiber module 350 is connected while being connected to the second additional video port AT2 In the 4th additional video port AT4.
Now, the first additional optical fiber module 250 and the second additional optical fiber module 350 are passed under differential mode Send image data.
Thus, the first additional optical fiber module passes through the first additional video port AT1 and the 3rd additional image end Voltage difference between mouth AT3 transmits additional image data.Also, the second additional optical fiber module again by Voltage difference transmission image data between second additional video port AT2 and the 4th video port AT4.
In addition, as shown in fig. 6, the first additional optical fiber module 250 and the second additional optical fiber module 350 are led to Cross single-ended mode transmission image data.That is, the first additional optical fiber module 250 and the second additional optical fiber module 350 illuminating part LT has two ports, a ground connection in two ports.Therefore, when two ports it Between when producing voltage difference illuminating part LT light can be released according to voltage difference.
As described above, under without the serialization process to additional image data, will be at least one of Additional image data is transmitted by the first additional optical fiber module 250 and the second additional optical fiber module 350.
The endoscopic system of embodiments of the invention is illustrated with reference next to accompanying drawing.
The endoscopic system of the invention that Fig. 7 and Fig. 8 are represented.Embodiments of the invention shown in Fig. 7 it is interior One example of the outward appearance of endoscope system.
The endoscopic system of embodiments of the invention can include being connected to the one of image data transmission equipment 10 The video generation portion 20 at end.Video generation portion 20 can include image sensor 100 and additional image sensing At least one of device 150.Now, image data transmission equipment 10 can include the multiple optical fiber of covering The protection portion OFP of OF.Very thin explanation will be carried out for protection portion OFP with reference to Fig. 8 afterwards.
Video generation portion 20 possesses extending arm (telescope) phase of lens group (lens array) with inside Connection.Body 30 can include the other end for being connected to image data transmission equipment 10 to process image number According to or additional image data at least one of hardware (hardware) or software (software) structure Into key element.
Shown in Fig. 7 be only embodiments of the invention endoscopic system outward appearance an example but simultaneously not only It is limited to this.
As shown in figure 8, the endoscopic system of embodiments of the invention include image data transmission equipment 10, Image data input unit 500 and image processing department 510.Dotted arrow in Fig. 8 represents that CPU520 is The signal of control image data input unit 500, image processing department 510 and monitoring unit described later 570.
Image data transmission equipment 10 generates image data and including the optical fiber mode of image sensor 100 and first The optic module 300 of block 200 and second, image sensor 100 is included for transmitting at least one of image First video port T1 of data and the second video port T2, the first optic module 200 and the second optical fiber Module 300 is connected to the first video port T1 and the second video port T2.
For image data transmission equipment 10 describe in detail and therefore omitted its description.
Image data input unit 500 is connected to image data transmission equipment 10 and will be transmitted by image data The image data of the output of equipment 10 is sent to the path of setting.For example, image data input unit 500 is by shadow As data are sent to image processing department 510.
Also, image data input unit 500 can perform to the simple treatment of image data (for example, Contrast is adjusted, and is amplified (zoom-in), is reduced (zoom-out) etc.), this simple treatment can be by CPU520 is controlled.
The image that image processing department 510 is transmitted by the control of CPU520 to image data input unit 500 Data carry out image processing.
As described above, image sensor 100 can be generated according to for mobile device CPU's AP (Application Processor) the image data that is generated of treatable specification.
Thus, when the signal specification that image data is used in accordance with mobile device, CPU520 is equally included such as The moving chip (mobile chip) of ARM core.
Thus, CPU520 can support such as Android OS (Android operating system) or such as iOS Mobile OS, can the various functions that be provided of mobile OS be applied in embodiments of the invention and peep Mirror system.
For example, the endoscopic system of embodiments of the invention can provide various (rich) user interfaces, and And the convenient function to the users such as such as doctor proposition is updated.
CPU520 of the invention is not limited to mobile device CPU.Thus CPU520 can be Acted under the OS or the OS as OS X of windows series.
Now, CPU520 can export the treatment to the user interface (user interface) of image data And according to user to the action control signal of the operation of user interface.User interface can include catalogue, Catalogue can be the operation of the image shown to the action control of endoscopic system and to display part DIS, but It is not limited to this.
Operation by user interface to image data can be that image is zoomed in or out, acutance (sharpness) or luminance variations etc. operation, but be not limited to this.
Although now drawing is not shown, CPU520 can include for store user interface data or The holder (not shown) of information.
Image processing department 510 overlaps (overlap) to the output of image data input unit 500 user interface On image data, and according to action control signal transacting image data.
Now, in image data input unit 500 and image processing department 510 at least one by FPGA (field-programmable gate array) embodies, it is not limited to this.
FPGA is one kind of programmable non-storage semiconductor, with the general semiconductor that cannot change loop Difference, can again change loop according to purposes.FPGA can be by the switch as hardware elements (switching) loop desired by the action realization of part, thus image data can be than being entered by software Being transmitted or processed for high speed is wanted when row transmission or treatment.
Superimposed image data and user interface are passed through video port VP (video by image processing department 510 Port) it is sent to display part DIS.Video port VP can be VGA (Video Graphics Array), DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface) or LVDS (Low Voltage Differential Signaling), SDI (Serial Digital Interface), but not It is defined in this.
In this way, the processing path and image data of the user interface of the endoscopic system of embodiments of the invention Processing path can be with difference.That is, for the endoscopic system of embodiments of the invention, at CPU520 Reason user interface, image data input unit 500 and image processing department 510 can be with process image datas.
Doctor is performed the operation by the image that endoscopic system is generated by viewing to patient, therefore doctor needs The situation of the inside of human body to being performed the operation is watched by timely image implements operation so as to correct.
If doctor cannot watch the timely image to the situation of inside of human body in surgical procedure, doctor Even if occurring in that error also cannot its error cognitive in time.Therefore, endoscopic system needs high speed processing pair The image data of inside of human body is simultaneously shown by display part DIS (for example, display screen).
Opposite, even if slow to the processing speed of the image data of the treatment comparison inside of human body of user interface Also there will not be big influence to surgical procedure.
It is different from the endoscopic system of embodiments of the invention by an image processing path process image data During with user interface, due to the treatment of user interface, the treatment of image data can also postpone therefore can opponent Art has deleterious effect.
For the endoscopic system of embodiments of the invention, image data input unit 500 and image are processed Portion 510 can be with high speed processing image data and CPU520 low-speed processings user interface so that image is processed Portion 510 is overlapped image data and user interface.
Therefore, doctor can watch superimposed image data and user interface by display part DIS, so that The less time delay for feeling to occur with image data processing procedure simultaneously can be by the operation to user interface Use various functions of endoscopic system.
At the same time, because the endoscopic system of embodiments of the invention includes that above-mentioned image data is transmitted Equipment 10, therefore high-resolution or ultrahigh resolution can also be transmitted while the limitation of bandwidth is overcome Image data.
Moreover, the endoscopic system of embodiments of the invention can no encoder, serialiser, Transmit image data under conditions of de-serializer or decoder, therefore simple structure can be provided and subtract The delivery time of few image data postpones.
That is, the endoscopic system of embodiments of the invention, need not be to the sequence number process of image data Under, at least one of image data can be transmitted by the first optic module and the second optic module.
Although not shown in Fig. 8, be data processing is carried out to user interface can be in CPU520 and image Possesses holder between processing department 510.
In addition, the first optic module 200 is connected to the 3rd image while being connected to the first video port T1 Port T3, the second optic module 300 is connected to the 4th image while being connected to the second video port T2 Port T4.First optic module 200 and the second optic module 300 transmit image data under differential mode. This was carried out to describe in detail and had therefore omitted its description.
It is different in this, there is a ground connection in the port of the illuminating part LT of image data transmission equipment 10, because This image data transmission equipment 10 can in a single ended mode transmit image data.This was carried out detailed Describe bright therefore omission its description in detail.
In addition, the first optic module 200 and the second optic module 300 are directly connected in the first video port T1 and the second video port T2 are connected to the first video port T1 and the second shadow by connector CON As port T2.This was carried out to describe in detail and had therefore omitted its description.
The image data transmission equipment 10 of the endoscopic system of embodiments of the invention is also passed including additional image Sensor 150, the first additional optical fiber module 250 and the second additional optical fiber module 350.
Additional image sensor 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and life Into additional image data, and including the first additional shadow for transmitting at least one of additional image data As port AT1 and the second additional video port AT2.
First additional optical fiber module 250 and the second additional optical fiber module 350 are connected to the first additional shadow Transmit additional as port AT1 and the second additional video port AT2 and under differential mode or single-ended mode Image data.This was carried out to describe in detail and had therefore omitted its description.
Also, image data input unit 500 receives additional image data and incites somebody to action while receiving image data Additional image data is sent to CPU520 and image data is sent into image processing department 510.Now, image Processing department 510 receives additional image data and is overlapped onto on image data from CPU520.
Image sensor 100 generates the image data of the inside of human body of n data frames per second, and additional image is passed Sensor 150 generates the additional image data of m data frames per second.
As described above, additional image data is not (for example, near to the wavelength bandwidth in addition to visible rays Infrared ray, infrared ray, ultraviolet etc.) image or fluorescence endoscopic spectroscopy or fluorescence endoscopic videoendoscopic surgery institute The data of the image of the fluorescent material for using, can be the images of the specific objective in addition to affected part.
Image data input unit 500 can transmit image data and additional image number according to the path for having set According to.That is, image data is sent to image and processed by image data input unit 500 by the first transmitting path Portion 510, CPU520 is sent to by additional image data by the second transmitting path.
Now, by the second transmitting path can also be sent to image data by image data input unit 500 CPU520.CPU520 can be than the transfer rate of the image data of the first transmitting path at a slow speed transmission it is attached Plus image data.
Image processing department 510 will pass through the image data and defeated by CPU520 that the first transmitting path is transmitted The additional image data for going out is overlapped.Thus image data can turn into background image (background Image), display part DIS can show the additional image data Chong Die with background image.
Can be by high speed processing as discussed previously with respect to additional image data image data.Image data shows Show the situation of inside of human body, therefore image data by being generated to the time delay shown by display part DIS It is more short more provide correct information can to doctor.
Additional image data is the other image of image or wavelength bandwidth to fluorescent material, therefore additional shadow As the generation of data can be slower than image data.For example, due to fluorescent material light quantity or visible rays with The other light quantity of outer wavelength bandwidth is few, therefore to obtain the complete image to additional image data, adds Image sensor 150 will be relative time exposure in the other light of light or wavelength bandwidth of fluorescent material.
If image datas different from the endoscopic system of embodiments of the invention and additional image data pass through When same path is processed, the place of image data comprehends and is affected, therefore image data cannot lead to Cross display part DIS quickly and be accurately shown.
Image data and additional image data are passed through different roads by the endoscopic system of embodiments of the invention Footpath is processed, and can be by high speed processing relative to additional image data image data, therefore can be by The image of inside of human body is quick and is accurately shown.
The endoscopic system of embodiments of the invention can include, be connected to the He of image data input unit 500 The holder (not shown) of CPU520 and it is connected to the holder of image processing department 510 and CPU520 (not Diagram).It is such as DMA (Direct that image data input unit 500 and image processing department 510 include respectively Memory Access) logic, HDMI (High Definition Multimedia Interface) logic, DVI The standard output inbound port logic of logic etc. and by itself and image data input unit 500 and image processing department 510 Holder at a high speed connect.
The standard output inbound port logic of image data input unit 500 and image processing department 510 is by image number According to and additional image data backup (dump) in holder, the dma logic of image processing department 510 The user interface and additional image data of additional image data or overlap can be read from holder.Now, The holder of image data input unit 500 and image processing department 510 can be by synchronization (sync) order wire The information of data is read and write in transmitting-receiving mutually.
As described above, image processing department 510 by image data and additional image data and user interface extremely Few one is overlapped.
In addition, as shown in figure 9, image sensor 100 also includes the first clock port CT1.Image Data transfer equipment 10 also includes being connected to the clock optic module 610 of the first clock port.Now, Clock optic module 610 transmits clock signal under differential mode or single-ended mode.For example, image number Include 2 the first optic modules, 200,2 the second optic modules, 300,1 clock according to transmission equipment 10 With optic module 610.
When clock optic module 610 is acted under differential mode, clock optic module 610 can be even It is connected to the first clock port CT1 and second clock port CT2.And, although it is not shown in Fig. 9, When clock optic module 610 is acted in a single ended mode, the clock illuminating part of optic module 610 One side ports are connected to the first clock port CT1, and another side ports can then be grounded.
Image sensor 100 and additional image sensor 150 can support (the MIPI of MIPI CSI II Camera signal interface protocol II) and (the MIPI camera signal interface of MIPI CSI III protocolⅢ).Now, MIPI CSI II and MIPI CSI III can transmit (FHD grades of high-resolution Or UHD grades) image data or additional image data.
First pin (pin) specification of MIPI CSI II is illustrated with reference first to Fig. 9.
For MIPI CSI II, image sensor 100 and CPU520 can include as shown in Figure 9 Equivalent to 4 optic modules (2 first optic modules 200,2 second of data wire (data line) Optic module 300) and equivalent to 1 clock optic module 610 of clock line (clock line).When Clock line can transmit the clock signal used when image data or transmission treatment.
Now, the first optic module 200 and the second optic module 300 can be in differential mode or single-ended moulds Acted under formula, be described in detail for differential mode and single-ended mode and therefore omitted its description.
In this way, when 4 data wires and a clock line are all acted under differential mode, the first optic module 200th, the second optic module 300 and clock light fiber module 610 are connected to image sensor 100 2 ports.
Also, when 4 data wires and a clock line are all acted in a single ended mode, the first optic module 200th, the second optic module 300 and clock are connected with the respective P ports of illuminating part LT of light fiber module 610 The a port of image sensor 100 is connected to, N-port can then be grounded.
In addition, transmission when the first optic module 200 and the image data of the transmission of the second optic module 300 The direction of transfer during clock signal of direction and the transmission of clock optic module 610 can be with identical.I.e., such as Shown in Fig. 9, image data and clock signal can be transmitted from image sensor 100 toward CPU520.
In addition, additional image sensor 150 connects also according to pin (pin) specification of MIPI CSI II It is connected to the first additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber module 615.First additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber module The 615 same actions under differential mode (referring to Fig. 9) or single-ended mode (not shown).
That is, when the endoscopic system of embodiments of the invention includes additional image sensor 150, add Image sensor also includes the first additional clock port ACT1.Image data transmission equipment 10 also includes It is connected to the clock additional optical fiber module 615 of the first additional clock port ACT1.Now, clock is used Additional optical fiber module 615 transmits clock signal under differential mode or single-ended mode.
For example, the endoscopic system of embodiments of the invention includes 2 first of the additional image data of transmission 250,2 the second additional optical fiber modules 350 of additional optical fiber module and a clock additional optical fiber module 615。
As shown in figure 9, the illuminating part LT of clock additional optical fiber module 615 is connected under differential mode One additional clock port ACT1 and the second additional clock port ACT2.And, although in accompanying drawing not One side ports of the diagram illuminating part LT of clock additional optical fiber module 615 in a single ended mode are connected to the Another side ports of one additional clock port ACT1, illuminating part LT can then be grounded.
The first optic module 200, the second optic module 300 and clock light fiber module 610 are passed through to this Explanation was carried out, therefore their description is omitted.
Also, the first additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber The additional image data of module 615 and the direction of transfer of clock signal can be with identical.To this and the first optical fiber The explanation that module 200, the second optic module 300 and clock are carried out with light fiber module 610 is similar to, therefore saves Slightly it is illustrated.
With reference next to inserting for Figure 10 couples of MIPI CSI III different from the pin specification of MIPI CSI II The specification of pin is illustrated.
For MIPI CSI III, image sensor 100 and CPU520 such as Figure 10 can be included quite In 4 optic modules (2 the first optic modules, 200,2 the second optical fiber of data wire (data line) Module 300) and equivalent to 1 confirmation of synchronization optic module 620 of confirmation of synchronization line.
Confirmation of synchronization line be used to transmit image data transmission and processing procedure in for confirming synchronous synchronization Confirmation signal or for the order (command) of CPU520 to be sent in image sensor 100.By In MIPI CSI III use embedded clock (embeded clock) therefore do not need MIPI CSI II The clock for using in addition optic module 610.Now, confirmation of synchronization line is same in differential mode or single-ended Confirmation of synchronization signal is transmitted under pattern.
In this way, 4 data wires and 1 confirmation of synchronization line may all be acted under differential mode, therefore first The optic module 300 of optic module 200 and second is connected to 2 ports of image sensor 100, The light absorbing part LR of confirmation of synchronization optic module 620 is connected to the confirmation of synchronization end of image sensor 100 Mouth ST.
Although not shown in Figure 10,4 data wires and 1 confirmation of synchronization line are all acted in a single ended mode When, the first optic module 200, a side ports of the illuminating part LT of the second optic module 300 are connected respectively In 1 port of image sensor 100, another side ports can then be grounded.Also, confirmation of synchronization is used A ground connection in two ports of the illuminating part LT of optic module 620, the synchronous receipts with optic module 620 Light portion LR is connected to the confirmation of synchronization port ST of image sensor 100.
As described above, image data transmission equipment 10 also includes confirmation of synchronization optic module 620.It is synchronous Confirmation optic module 620 can transmit confirmation of synchronization signal under differential mode or single-ended mode.Example Such as, image data transmission equipment 10 can include 2 the first optic modules, 200,2 the second optical fiber modes Block 300 and a confirmation of synchronization optic module 620.
Now, confirmation of synchronization signal is imported into image sensor 100, and image data by image sensing Device 100 is exported.Therefore the transmission of the image data of the first optic module 200 and the second optic module 300 Direction can be opposite each other with the direction of transfer of the confirmation of synchronization signal of confirmation of synchronization optic module 620.
In addition, when the endoscopic system of embodiments of the invention includes additional image sensor 150, shadow The synchronization of confirmation of synchronization signal is transmitted under being additionally included in differential mode or single-ended mode as data transfer equipment 10 Confirm with additional optical fiber module 625.
For example, thus including 2 first additional optical fiber modules 250,2 the of the additional image data of transmission Two additional optical fiber modules 350 and a confirmation of synchronization additional optical fiber module 625.Now, confirmation of synchronization is used Additional optical fiber module 625 can be connected to the appended synchronization confirmation port of additional image sensor 150 AST。
For additional image sensor 150, the first additional optical fiber module 250, the second additional optical fiber module 350, The confirmation of synchronization relation and above-mentioned image sensor 100, the first optic module of additional optical fiber module 625 200th, the second optic module 300 and confirmation of synchronization are similar to the relation of optic module 620, therefore omit right Its explanation.
The transmission of the additional image data of the first additional optical fiber module 250 and the second additional optical fiber module 350 Direction can be with the direction of transfer of the confirmation of synchronization signal of confirmation of synchronization additional optical fiber module 625 phase each other Instead.In this regard, because with the transmission of the confirmation of synchronization signal of optic module 620 of image data and confirmation of synchronization The relation in direction is similar to, therefore their description is omitted.
In addition, the endoscopic system of embodiments of the invention includes simultaneously realizing the Hes of MIPI CSI II The image data transmission equipment 10 of MIPI CSI III.
Therefore, image data transmission equipment 10 include the first optic module 200, the second optic module 300, First direction of transfer optic module OF_D1 and the second direction of transfer optic module OF_D2.
Now, the signal transmission direction of the first direction of transfer optic module OF_D1 and the second direction of transfer light The signal transmission direction of fiber module OF_D2 can be with conversely, the first optic module 200 and the second optic module 300 image data direction of transfer can be with identical.
For example, shown in Figure 11 and Figure 12, image data transmission equipment 10 includes 2 the first optic modules 200th, 2 the second optic modules, 300,1 the first direction of transfer optic module OF_D1 and 1 second Direction of transfer optic module OF_D2.
Now, as shown in figure 11, if image data transmission equipment meets MIPI CSI II, image number According to transmission equipment 10 also include emulation optic module 630, emulation optic module 630 can to image number Signal is transmitted in the opposite direction according to the sender with clock signal.
That is, the first direction of transfer optic module OF_D1 can be clock optic module 610, and second passes It can be emulation optic module 630 to send direction optic module OF_D2.This emulation optic module 630 can It is sent to various letters of image sensor 100 from CPU520 for transmitting for use as backup optic module Number or data.
Also, when image data transmission equipment 10 also includes additional image sensor 150, also including attached Plus emulation optic module 635, it is described it is additional emulation optic module 635 can to additional image data and when The sender of clock signal transmits signal in the opposite direction.
In addition, as shown in figure 12, if image data transmission equipment 10 meets MIPI CSI III, image Data transfer equipment 10 includes that the first optic module 200, the second optic module 300, confirmation of synchronization are used up Fiber module 620 additionally includes emulation optic module 630.
Now, emulation optic module 630 transmits signal to the direction of transfer identical direction with image data. That is, the first direction of transfer optic module OF_D1 can be emulation optic module 630, the second direction of transfer Optic module OF_D2 can be confirmation of synchronization optic module 620.
When at least one is that cannot transmit image number in the first optic module 200 and the second optic module 300 According to improper optic module when, as the emulation optic module of the first direction of transfer optic module OF_D1 630 substitute improper optic module transmission image data.Thus, it is possible to the action for improving endoscopic system is steady It is qualitative.
Image data transmission equipment 10 includes additional image sensor 150, the additional image sensor 150 Also include additional emulation optic module 635 when meeting MIPI CSI III, additional emulation optic module 635 can Signal is transmitted with to the direction of transfer identical direction with additional image data.
It is similar with the above, one in the first additional optical fiber module 250 and the second additional optical fiber module 350 During individual improper additional optical fiber module for that cannot transmit image data, additional emulation optic module 635 is replaced Image data is transmitted for improper additional optical fiber module.
The specification of above-described MIPI CSI II and the specification of MIPI CSI III are only an example, this Inventive embodiment is not limited to this specification.
In addition, as shown in figure 8, the endoscopic system of embodiments of the invention also includes control optic module 640 and input optical fibre module 650.Control optic module 640 is illustrated first.
Control optic module 640 can be used for CPU520, focus portion 530, image sensor 100 and attached Plus the communication between image sensor 150, therefore, it can be passed by CPU520 control focuses portion, image Sensor 100 and additional image sensor 150.
Focus portion 530 driven under the control of CPU520 focus lens realize to image sensor 100 or The automatic focusing (auto focusing) of additional image sensor 150.Also, the He of image sensor 100 Additional image sensor 150 is initialized according to the control signal of CPU520.This automatic focusing and Initialization be only CPU520 control an example, by CPU520 can realize to image sensor 100, Additional image sensor 150 and the various control in focus portion 530.
Therefore, the endoscopic system of embodiments of the invention includes communication chip 540, the communication chip 540 communications being used to perform between CPU520 and focus portion 530, CPU520 and image sensor 100 Between communication and the communication between CPU520 and additional image sensor 150.Communication chip 540 can To support such as I2The specific communications specification of C, but it is not limited to I2C telecommunications metrics.
Now, communication chip 540 can be passed with built-in focus portion 530, image sensor 100 and additional image Sensor 150.The communication chip 540 being used in the communication process with CPU520 is connected to control light Fiber module 640.
Although each communication chip 540 is illustrated in Fig. 8 is respectively connected on a control optic module 640, But this is not limited to this merely for convenience of description.
For example, as shown in figure 13, multiple communication chips 540 can be by communication bus (bus) and CPU520 Communicated.Each communication bus is connected to a control optic module 640.Two communication bus be for Transmitting-receiving with CPU520 is believed.That is, one communication bus is used to receive the control from CPU520 outputs Signal, another communication bus is used to export action information to CPU520.
Action information can be CPU520 to control from focus portion 530, image sensor 100 and adding Image sensor 150 and receive report information.For example, action information can be focusing portion 530, shadow As sensor 100 and the information of the current state of additional image sensor 150, but it is not limited to this.
And, although it is not shown in Figure 13 to increase for clock signal to be sent into Jiao from CPU520 Point portion 530, image sensor 100 and the clock bus of additional image sensor 150, clock bus are same It is connected to control optic module.
When so carrying out bus communication, it is possible to reduce the quantity of control optic module 640.That is, such as Figure 13 It is shown, in order to multiple communication chips 540 need two control optic modules 640 during using communication bus.Phase Anti- when not using communication bus, each communication chip 540 will be connected therefore need with control optic module 640 Increase the quantity of control optic module 640.
That is, image sensor 100 and CPU520 are communicated by communication bus, and communication bus includes Bus of delivering letters and collection of letters bus.Now, bus of delivering letters and collection of letters bus are connected to control optic module 640。
Also, additional image sensor 150 and focus portion 530 again by the communication bus with CPU520 is communicated.
Next input optical fibre module 650 is illustrated.
As shown in figure 8, the endoscopic system of embodiments of the invention includes input unit 550.Input unit 550 Can be according to the moving up and down of the operation generation video generation portion 20 of user, image data or additional The white balance (white balance) of image data and the input signal of selection catalogue.In this way, CPU520 Can be by input signal control endoscopic system.
The driving of Fig. 8 movements up and down for video generation portion 20 not shown for convenience of explanation Portion.
Such input signal is sent to by being connected to the input optical fibre module 650 of input unit 550 CPU520, and be respectively used to including 6 input optical fibre modules, 650,6 input optical fibre modules 650 Video generation portion 20 moves up and down, to the white balance and selection of image data or additional image data Catalogue, but the quantity of input optical fibre module 650 can increase or decrease.Input unit 550 can include GPIO (General Purpose Input/Output) but it is not limited to this.
When Fig. 8 is endoscopic system, be connected to input unit 550 and communication chip 540 optic module and Control optic module 640 is connected to image data input unit 500 therefore the quantity of optic module can be increased.
For example, input unit 550 is connected to 6 input optical fibre modules 650 as described above, it is logical when used for multiple When believing that the communication bus of chip 540 is connected to 2 control optic modules 640, passed except being connected to image The optic module of sensor 100 or additional image sensor 150 also needs to 8 extra optic modules.
Therefore, by protection portion OFP around optical fiber quantity need also exist for increase, image data transmission set Standby 10 thickness can excessively increase.
As shown in figure 14, the endoscopic system of embodiments of the invention also includes MCU (micro control Unit) 560, therefore the quantity of optic module can be reduced.
The endoscopic system of embodiments of the invention also includes the input unit 550, right that can be operated by user MCU560 that the input signal of input unit 550 is encoded and be connected to MCU560 transmission by 3rd optic module 660 of the input signal that MCU560 is encoded.Now, the input letter of transmission coding Number the 3rd optic module 660 quantity can than from input unit 550 receive input signal MCU560 Input pin quantity it is few.
For example, shown in Figure 15, input unit 550 is generated for moving up and down, white balance and catalogue are selected The input signal selected, therefore MCU560 can possess 6 input pins for these input signals.
MCU560 receives these input signals and is exported to output port after being encoded, the 3rd light side by side Fiber module 660 is connected to output port.In this way, the 3rd optic module 660 passes through image data input unit 500 are communicated with CPU520 or can be directly connected to CPU520.
It is different from embodiments of the invention when not possessing MCU560, input unit as described above 550 needs 6 input optical fibre modules 650 are connected to, but for embodiments of the invention, for transmitting by MCU560 The quantity of the 3rd optic module 660 of the input signal for being encoded can be than 6 input optical fibre modules 650 It is few.
In addition, as shown in Figure 14 and Figure 15, the endoscopic system of embodiments of the invention also includes adding Image sensor 150, MCU560 and the 3rd optic module 660.
Additional image sensor 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and life Into additional image data.
CMU560 is received and dispatched to the control signal of image sensor 100 and additional image sensor 150 and dynamic Make information.That is, MCU560 exports to image sensor 100 and additional image sensor control signal 150, and act information from image sensor 100 and the reception of additional image sensor 150.
3rd optic module 660 is connected to MCU560 and CPU520 and receives and dispatches control signal and action information. That is, CMU560 receives control signal by an optic module 660 from CPU520, by another Optic module is exported information is acted to CPU520.
Now, the quantity of the 3rd optic module 660 can be with transmitting-receiving control signal and action information The quantity of the pin of MCU560 is identical or less than quantity of pin of MCU560.
Explanation, therefore detailed had been carried out for control signal and action information.
MCU560 is connected to the 3rd optic module 660 and is decoded the control signal of CPU520 And transmitted by communication bus.Also, MCU560 by communication bus receive image sensor 100, At least one action information and pass through after being encoded in additional image sensor 150 and focus portion 530 Another the 3rd optic module 660 is exported to CPU520.
The encoding and decoding of MCU560 is only of the communication process between MCU560 and CPU520 Example, the action of MCU560 is not limited to this.
As described above, image sensor 100 and additional image sensor 150 by communication bus with When CPU520 is communicated, MCU560 has 2 of the transmitting-receiving letter for control signal and action information Port, 2 ports are connected to communication bus.
Also, MCU560 control signals and action information are received by 2 the 3rd optic modules 660 Transmit.Thus, the quantity of the 3rd optic module 660 with for receiving and dispatching image sensor 100 and additional shadow As the quantity of the pin of the MCU560 of the control signal and action information of sensor 150 is identical.
If do not communicated with multiple communication chips 540 by communication bus, MCU560 is in order to receive Transmit each communication chip 540 and need to have 2 ports, therefore the quantity of the 3rd optic module 660 can With inserting for the MCU560 than image output sensor 100 and the control signal of additional image sensor 150 The quantity of pin is few.
In addition, as shown in Fig. 8 and Figure 14, the protection portion OFP of image data transmission equipment 10 is by can be with Bear the material of high steam processs (auto clave) that is carried out for medical apparatus sterilizing and constitute.This The endoscopic system of invention is similarly medicine equipment, therefore can carry out high steam processs.High steam Treatment is carried out 20 minutes in 20 steam spray devices of 120 degree of air pressure, and optical fiber is lower than 120 degree At a temperature of dissolve.
Because protection portion OFP covers optical fiber, therefore optical fiber can be protected during high steam processs. Although during high steam processs using steam carry out disinfection steam temperature it is high but thermal capacity is small, due to this hair The protection portion OFP of bright embodiment includes that therefore the rubber of shielding heat can protect optical fiber.
As described above, protection portion OFP can protect the first to the 3rd optic module 660, first and second Various optic modules such as additional optical fiber module 350, control optic module 640, input optical fibre module 650 Optical fiber.
As shown in Fig. 8 and Figure 14, the endoscopic system of embodiments of the invention also includes monitoring unit 570. Monitoring unit 570 is entered in image data input unit 500, CPU520 and image processing department 510 at least one Row monitor in real time, and according at least one state value at least one implement reset (reset).
Due to endoscopic system for medical purpose, thus image data and additional image data treatment need The carrying out to stablize always.If doctor cannot watch the image of inside of human body in surgical procedure, performed the operation Journey will be unable to be smoothed out.
Thus, monitoring unit 570 can perform to image data input unit 500, image processing department 510 and At least one monitor in real time in CPU520, image data input unit 500, image processing department 510 and CPU520 is used for the treatment of image data, additional image data and user interface.
For example, monitoring unit 570 per 1ms receive image data input unit 500, image processing department 510 and At least one state value in CPU520, the cycle of reception state value can be bigger or small than 1ms.
The inscape of 570 pairs of state values for improper or wrong (error) occur of monitoring unit resets, The process time of improper image processing or user interface is set to shorten or minimize it.
This monitoring unit 570 performs simple function relative to CPU520, therefore can be by Micro Control Unit forms or firmware forms embody, but are not limited to this.
As described above, the image data transmission equipment 10 of embodiments of the invention and endoscopic system are substituted together Axis includes optic module, therefore can provide the image data transmission equipment 10 smaller than the diameter of coaxial line.
Thus, the image data transmission equipment 10 and endoscopic system of embodiments of the invention can overcome together The limitation of the bandwidth of axis, and the image data or additional image of high-resolution or ultrahigh resolution can be transmitted Data.
Moreover, it is not necessary to encoded by optic module, serialized, de-serialized and decoded, Therefore image data and additional image data can faster be transmitted.
As described above, a preferred embodiment of the present invention is observed, and for skill belonging to the present invention For the those of ordinary skill in art field, in addition to embodiment described above, the present invention can be not In the case of departing from its objective or category, realize that materialization is obvious with other specific modalities.Cause This, the above embodiments be not construed as it is restricted, but be construed as it is exemplary, thus, this Invention is not limited to above-mentioned explanation, and can be appended claims category and Changed in its equivalency range.

Claims (35)

1. a kind of image data transmission equipment, it is characterised in that including:
Image sensor, generates image data and including the first video port and the second video port, described First video port and second video port are used to transmit at least one of image data;And
First optic module and the second optic module, first optic module and second optic module It is connected to first video port and second video port.
2. image data transmission equipment according to claim 1, it is characterised in that first light Fiber module is connected to the 3rd video port, second optical fiber while being connected to first video port Module is connected to the 4th video port, first optical fiber mode while being connected to second video port Block and second optic module transmit the image data under differential mode.
3. image data transmission equipment according to claim 1, it is characterised in that first light Fiber module and second optic module transmit the image data in a single ended mode.
4. image data transmission equipment according to claim 1, it is characterised in that without right Under the serialization process of the image data, at least one of image data is passed through described first Optic module and second optic module are transmitted.
5. image data transmission equipment according to claim 1, it is characterised in that first light Fiber module and second optic module are directly connected in first video port and the second image end Mouth is connected to first video port and second video port by connector.
6. image data transmission equipment according to claim 1, it is characterised in that including:
Additional image sensor, perceives the light different from the optical wavelength that the image sensor is perceived and generates Additional image data, and including the first additional video port and the second additional video port, described first is attached Plus video port and the second additional video port are used to transmit at least one of additional image number According to;And
First additional optical fiber module and the second additional optical fiber module, the first additional optical fiber module and described Second additional optical fiber module is connected to the described first additional video port and the second additional image end Mouthful.
7. image data transmission equipment according to claim 6, it is characterised in that described first is attached Plus optic module is connected to the 3rd additional video port while be connected to the first additional video port, The second additional optical fiber module is connected to the 4th and adds while being connected to the second additional video port Video port, the first additional optical fiber module and the second additional optical fiber module are passed under differential mode Send the additional image data.
8. image data transmission equipment according to claim 6, it is characterised in that described first is attached Plus optic module and the second additional optical fiber module transmit the additional image data in a single ended mode.
9. image data transmission equipment according to claim 6, it is characterised in that without right Under the serialization process of the additional image data, at least one of additional image data is passed through The first additional optical fiber module and the second additional optical fiber module are transmitted.
10. a kind of endoscopic system, it is characterised in that including:
Image data transmission equipment, including:Image sensor and the first optic module and the second optic module, Image sensor generation image data and including the first video port and the second video port, described the One video port and second video port are used to transmit at least one of image data, described first Optic module and second optic module, are connected to first video port and second shadow As port;
Image data input unit, is connected to the image data transmission equipment and will be by the image data The image data of transmission equipment output is transmitted according to the path of setting;And
Image processing department, the image transmitted to the image data input unit by the control of CPU Data carry out image processing.
11. endoscopic systems according to claim 10, it is characterised in that the CPU is to institute Stating image data carries out user interface process, and the image processing department is by the user interface and the image Data are overlapped.
12. endoscopic systems according to claim 10, it is characterised in that first optical fiber mode Block and second optic module transmit the image data under differential mode or in a single ended mode.
13. endoscopic systems according to claim 10, it is characterised in that without to described Under the serialization process of image data, at least one of image data is passed through into first optical fiber Module and second optic module are transmitted.
14. endoscopic systems according to claim 10, it is characterised in that first optical fiber is touched And second optic module is directly connected in first video port and second video port or logical Cross connector and be connected to first video port and second video port.
15. endoscopic systems according to claim 10, it is characterised in that the endoscopic system Also include:Additional image sensor and the first additional optical fiber module and the second additional optical fiber module, it is described attached Plus image sensor perceives the light different from the optical wavelength of image sensor perception and generates additional image Data, and including the first additional video port and the second additional video port, the first additional image end Mouth and the second additional video port are used to transmit at least one of additional image data;
The first additional optical fiber module and the second additional optical fiber module, are connected to described first Additional video port and the second additional video port, and passed under differential mode or under single-ended mode Send the additional image data.
16. endoscopic systems according to claim 15, it is characterised in that the image data is defeated Enter while portion receives the image data and receive additional image data, the additional image data is transmitted To the CPU, the image data is sent to the image processing department;
The image processing department receives the additional image data of the CPU transmission and overlaps onto the image number According to upper.
17. endoscopic systems according to claim 10, it is characterised in that the image sensor Also include the first clock port;The image data transmission equipment also includes being connected to first clock With the clock optic module of port;The clock optic module is under differential mode or in single-ended mould Clock signal is transmitted under formula.
18. endoscopic systems according to claim 17, it is characterised in that first optical fiber mode The direction of transfer and the clock optical fiber mode of block and the image data of second optic module transmission The direction of transfer that block transmits the clock signal is identical.
19. endoscopic systems according to claim 18, it is characterised in that the image data is passed Sending equipment also includes emulation optic module;It is described emulation optic module can to the image data and institute The sender for stating clock signal transmits signal in the opposite direction.
20. endoscopic systems according to claim 15, it is characterised in that the additional image is passed Sensor also includes the first additional clock port;It is additional that the image data transmission equipment also includes that clock is used Optic module;The clock additional optical fiber module is connected to the described first additional clock port;It is described Clock additional optical fiber module transmits clock signal under differential mode or in a single ended mode.
21. endoscopic systems according to claim 20, it is characterised in that first additional optical Fiber module, the second additional optical fiber module and the clock described additional shadow of additional optical fiber module As the direction of transfer of data and the clock signal is mutually the same.
22. endoscopic systems according to claim 21, it is characterised in that also including additional emulation Optic module;The additional emulation optic module can be believed to the additional image data and the clock Number sender transmit signal in the opposite direction.
23. endoscopic systems according to claim 12, it is characterised in that the image data is passed Send equipment also including confirmation of synchronization optic module;The confirmation of synchronization optic module is under differential mode Or confirmation of synchronization signal is transmitted in a single ended mode.
24. endoscopic systems according to claim 23, it is characterised in that first optical fiber mode The image data direction of transfer of block and second optic module and the confirmation of synchronization optic module The confirmation of synchronization signal direction of transfer it is opposite.
25. endoscopic systems according to claim 24, it is characterised in that also including emulation optical fiber Module;The emulation optic module transmits signal to the direction of transfer identical direction with the image data.
26. endoscopic systems according to claim 25, it is characterised in that when first optical fiber An improper optical fiber mode for being to transmit the image data in module and second optic module During block, the emulation optic module substitutes the improper optic module and transmits the image data.
27. endoscopic systems according to claim 15, it is characterised in that the image data is passed Sending equipment also includes confirmation of synchronization additional optical fiber module;Confirmation of synchronization additional optical fiber module is in difference Confirmation of synchronization signal is transmitted under dynamic model formula or in a single ended mode.
28. endoscopic systems according to claim 27, it is characterised in that first additional optical The described additional image data direction of transfer of fiber module and the second additional optical fiber module is synchronous true with described Recognize opposite each other with the direction of transfer of the confirmation of synchronization signal of additional optical fiber module.
29. endoscopic systems according to claim 28, it is characterised in that also including additional emulation Optic module;The additional emulation optic module is to the direction of transfer identical with the additional image data Transmit signal in direction.
30. endoscopic systems according to claim 29, it is characterised in that first additional optical One in fiber module and the second additional optical fiber module is that cannot transmit the improper of the image data During additional optical fiber module, the additional emulation optic module substitutes the improper additional optical fiber module transmission The image data.
31. endoscopic systems according to claim 10, it is characterised in that also including input unit, MCU and the 3rd optic module;The input unit, can be operated by user;The MCU Data-signal to the input unit is encoded;3rd optic module is connected to the MCU and passes Send the input signal encoded by MCU;The number of the 3rd optic module of input signal is coded of described in transmission Quantity of the amount less than the input pin of the MCU that the input signal is received from the input unit.
32. endoscopic systems according to claim 10, it is characterised in that also including additional image Sensor, MCU and the 3rd optic module;The additional image sensor is perceived and the image sensing The different light of optical wavelength that device is perceived simultaneously generates additional image data;The MCU outputs and input are to described The control signal and action information of image sensor and the additional image sensor;3rd optical fiber mode Block is connected to the MCU and receives and dispatches the control signal and the action information to the CPU;It is described The quantity of the 3rd optic module is equal to or less than for being input into and exporting the control signal and the action feelings The quantity of the pin of the MCU of report.
33. endoscopic systems according to claim 10, it is characterised in that the image data is passed Sending equipment also includes protection portion;The protection portion protects first optic module and second optical fiber mode The respective optical fiber of block;The protection portion is by the high steam that can bear to be carried out for medical apparatus sterilizing The material for the treatment of and constitute.
34. endoscopic system according to any one of claim 10 to 33, it is characterised in that Also include monitoring unit;The monitoring unit adds to the image data input unit, the CPU and the image At least one carries out monitor in real time in the Ministry of worker, according to described at least one state value to described at least one Reset.
35. endoscopic systems according to claim 10, it is characterised in that the image sensor Communicated by communication bus with the CPU, the communication bus includes output bus and input bus, The output bus and the input bus are respectively connected on control optic module.
CN201610574692.XA 2015-12-29 2016-07-19 Image data transmission apparatus and endoscope system including the same Active CN106937036B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR20150188070 2015-12-29
KR10-2015-0188070 2015-12-29
KR1020160030050A KR101786840B1 (en) 2015-12-29 2016-03-14 Apparatus for transfering image data and endoscopy system including the same
KR10-2016-0030050 2016-03-14

Publications (2)

Publication Number Publication Date
CN106937036A true CN106937036A (en) 2017-07-07
CN106937036B CN106937036B (en) 2020-10-30

Family

ID=59353699

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610574692.XA Active CN106937036B (en) 2015-12-29 2016-07-19 Image data transmission apparatus and endoscope system including the same

Country Status (2)

Country Link
KR (1) KR101786840B1 (en)
CN (1) CN106937036B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102007656B1 (en) 2017-10-25 2019-08-06 재단법인 아산사회복지재단 Method for measuring length using motion sensor and apparatus for the same
KR102526734B1 (en) 2019-12-31 2023-04-27 (주)엠아이원 Image output apparatus and endoscope apparatus using the same and image output method using the same
CN116546915A (en) * 2020-10-27 2023-08-04 深圳迈瑞生物医疗电子股份有限公司 Endoscope image pickup system and image data transmission device thereof
KR20230024529A (en) 2021-08-12 2023-02-21 (주) 엠아이원 Image output apparatus capable of outputting a plurality of images with a plurality of sensors and endoscope apparatus using the same
CN113810505A (en) * 2021-10-21 2021-12-17 上海德林威信息科技有限公司 System for cloud synchronization of face recognition camera data and use method thereof

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2551172Y (en) * 2002-06-14 2003-05-21 台群科技股份有限公司 Endoscope with infrared ray
EP2245980A2 (en) * 2009-04-28 2010-11-03 FUJIFILM Corporation Endoscope system, encoscope, and driving method
CN102258359A (en) * 2010-05-31 2011-11-30 奥林巴斯株式会社 Endoscope system
US20120016202A1 (en) * 2010-07-15 2012-01-19 Eckart Baum Endoscopic Instrument
CN102440753A (en) * 2010-09-30 2012-05-09 奥林巴斯株式会社 Endoscope system
CN103300812A (en) * 2013-06-27 2013-09-18 中国科学院自动化研究所 Endoscope-based multispectral video navigation system and method
CN103705201A (en) * 2014-01-16 2014-04-09 福建师范大学 Multimode spectrum analysis system suitable for detecting alimentary canal pathologic changes
CN205864558U (en) * 2015-12-29 2017-01-04 因德斯马特有限公司 Image data transmits equipment and includes that image data transmits the endoscopic system of equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101021891B1 (en) * 2010-12-22 2011-03-17 주식회사 엠투엘 Optical signal transmitting apparatus for long-distance graphic signal and touch-input signal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN2551172Y (en) * 2002-06-14 2003-05-21 台群科技股份有限公司 Endoscope with infrared ray
EP2245980A2 (en) * 2009-04-28 2010-11-03 FUJIFILM Corporation Endoscope system, encoscope, and driving method
CN102258359A (en) * 2010-05-31 2011-11-30 奥林巴斯株式会社 Endoscope system
US20120016202A1 (en) * 2010-07-15 2012-01-19 Eckart Baum Endoscopic Instrument
CN102440753A (en) * 2010-09-30 2012-05-09 奥林巴斯株式会社 Endoscope system
CN103300812A (en) * 2013-06-27 2013-09-18 中国科学院自动化研究所 Endoscope-based multispectral video navigation system and method
CN103705201A (en) * 2014-01-16 2014-04-09 福建师范大学 Multimode spectrum analysis system suitable for detecting alimentary canal pathologic changes
CN205864558U (en) * 2015-12-29 2017-01-04 因德斯马特有限公司 Image data transmits equipment and includes that image data transmits the endoscopic system of equipment

Also Published As

Publication number Publication date
CN106937036B (en) 2020-10-30
KR101786840B1 (en) 2017-10-18
KR20170078489A (en) 2017-07-07

Similar Documents

Publication Publication Date Title
CN205864558U (en) Image data transmits equipment and includes that image data transmits the endoscopic system of equipment
CN106937036A (en) Image data transmission equipment and the endoscopic system including image data transmission equipment
TWI325698B (en)
CN101727873B (en) Signal conversion apparatuses and display system
CN109036262B (en) Display characteristic curve correction method and control system of medical LED display screen
CN205758502U (en) Endoscopic apparatus
KR20150059085A (en) Head-Mounted Display Apparatus
US11500804B2 (en) Method for transmitting control instruction, transmitting device, and receiving device
CN106264429B (en) Endoscopic apparatus
CN109994281A (en) A kind of AOC cable of the compatible multiplex roles of energy
WO2009099606A2 (en) System for combining high-definition video control signals for transmission over an optical fiber
CN205356560U (en) Oral cavity image system
CN204795430U (en) HDMI audio and video signal transmission device with mirror image switch function
CN217116260U (en) Optical fiber transmission system
CN108881877B (en) Display processing device, display processing method thereof and display device
CN103391406B (en) A kind of video switch circuit and changing method thereof
CN217116261U (en) Optical fiber matrix device
CN217116262U (en) Optical fiber transmission system
TW202011888A (en) Integrated endoscope and visualization system
CN215383848U (en) Image sensor data transmission device of 3D endoscope and 3D endoscope
US20230053020A1 (en) Optical transmission system and optical matrix
CN204863064U (en) A signaling conversion circuit for medical endoscope
CN114071030A (en) Double-channel combined system of endoscope
WO2022087823A1 (en) Endoscope photographing system and image data transmission apparatus therefor
KR100522606B1 (en) Digital AV system having a structure for performing an additional function easily

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant