CN106937036A - Image data transmission equipment and the endoscopic system including image data transmission equipment - Google Patents
Image data transmission equipment and the endoscopic system including image data transmission equipment Download PDFInfo
- Publication number
- CN106937036A CN106937036A CN201610574692.XA CN201610574692A CN106937036A CN 106937036 A CN106937036 A CN 106937036A CN 201610574692 A CN201610574692 A CN 201610574692A CN 106937036 A CN106937036 A CN 106937036A
- Authority
- CN
- China
- Prior art keywords
- image data
- additional
- module
- optical fiber
- optic module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/22—Adaptations for optical transmission
Landscapes
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Surgery (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Optics & Photonics (AREA)
- Physics & Mathematics (AREA)
- Radiology & Medical Imaging (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Endoscopes (AREA)
Abstract
The invention discloses a kind of image data transmission equipment and the endoscopic system including image data transmission equipment, endoscopic system includes:Image sensor, generates image data and is used to transmit at least one of image data including the first video port and the second video port, first video port and second video port;Image data transmission equipment includes:First optic module and the second optic module, first optic module and second optic module are connected to first video port and second video port;Image data input unit, is connected to the image data transmission equipment and the image data exported by the image data transmission equipment is sent to the path of setting;And image processing department, according to the image processing for controlling the image data of the execution to being transmitted by the image data input unit of CPU.The system can overcome the bandwidth restrictions problem in image data transmission.
Description
Technical field
The present invention relates to a kind of image data transmission equipment and the endoscope system including image data transmission equipment
System.
Background technology
The image of inside of human body is supplied to doctor, Yi Shengke by endoscopic system in operation or checking process
Checking process is correctly performed the operation or is carried out to confirm that therefore image can be stablized.
Nearest endoscopic system does not require nothing more than simple offer image and provides various function to endoscope
Requirement increase.
Therefore, to can high speed processing image and provide various function endoscopic system research
Carry out in.
Prior art literature
Patent document
No. 10-2007-0071556 (publication date of KR published patent:On July 4th, 2007)
The content of the invention
Technical problem
According to the invention ,the aim of the invention is to provide a kind of image data transmission equipment and set including image data transmission
Standby endoscopic system, the system can overcome the bandwidth restrictions problem in image data transmission.
Problem of the invention is not limited to problem as mentioned above, the technical field of the invention it is common
Technical staff can be clearly understood that NM other problemses from following record.
The means of solve problem
The image data transmission equipment of one embodiment of the invention, including:Image sensor, generates image
Data and including the first video port and the second video port, first video port and second shadow
As port is used to transmit at least one of image data;And first optic module and the second optic module,
First optic module and second optic module are connected to first video port and described
Second video port.
First optic module is connected to the 3rd image end while being connected to first video port
Mouthful, second optic module is connected to the 4th video port while being connected to second video port,
First optic module and second optic module transmit the image data under differential mode.
First optic module and second optic module transmit the image number in a single ended mode
According to.
Under without the serialization process to the image data, by least one of image data
Transmitted by first optic module and second optic module.
First optic module and second optic module be directly connected in first video port and
Second video port is connected to first video port and the second image end by connector
Mouthful.
And image data transmission equipment of the invention, also includes:Additional image sensor and first attached
Plus optic module and the second additional optical fiber module;The additional image sensor is perceived and the image sensing
The different light of optical wavelength that device is perceived simultaneously generates additional image data, and including the first additional video port and
Second additional video port, the first additional video port and the second additional video port are used to pass
Deliver at least part of additional image data;The first additional optical fiber module and it is described second add
Optic module, is connected to the described first additional video port and the second additional video port.
The first additional optical fiber module is connected to the 3rd while being connected to the first additional video port
Additional video port, while the second additional optical fiber module is connected to the second additional video port
It is connected to the 4th additional video port, the first additional optical fiber module and the second additional optical fiber module
The additional image data is transmitted under differential mode.
The first additional optical fiber module and the second additional optical fiber module transmit described in a single ended mode
Additional image data.
Also, under without the serialization process to the additional image data, will be at least one of
The additional image data is carried out by the first additional optical fiber module and the second additional optical fiber module
Transmission.
The endoscopic system of one embodiment of the invention, including:Image data transmission equipment, including image
Sensor and the first optic module and the second optic module, the image sensor generation image data are simultaneously wrapped
The first video port and the second video port are included, first video port and second video port are used
In at least one of image data, first optic module and second optic module is transmitted, divide
First video port and second video port are not connected to;Image data input unit, is connected to
The image data transmission equipment and the image data that will be exported by the image data transmission equipment
Transmitted in path according to setting;And image processing department, the control according to CPU is to the image number
The image data transmitted according to input unit carries out image processing.
The CPU carries out user interface process to the image data, and the image processing department is by the use
Family interface and the image data are overlapped.
First optic module and second optic module are under differential mode or in a single ended mode
Transmit the image data.
Also, under without the serialization process to the image data, will be at least one of described
Image data is transmitted by first optic module and second optic module.
First optical fiber is touched and second optic module, be directly connected in first video port and
Second video port is connected to first video port and second image by connector
Port.
The endoscopic system of one embodiment of the invention, also including additional image sensor and the first additional optical
Fiber module and the second additional optical fiber module, the additional image sensor are perceived and the image sensor sense
The different light of the optical wavelength known simultaneously generates additional image data, and including the first additional video port and second
Additional video port, the first additional video port and the second additional video port are used to be sent to
At least part of additional image data;The first additional optical fiber module and second additional optical fiber
Module, is connected to the described first additional video port and the second additional video port, differential
The additional image data is transmitted under pattern or in a single ended mode.
The image data input unit, additional image data is received while receiving the image data, will
The additional image data is sent to the CPU, and the image data is sent into the image processing department,
The image processing department receives the additional image data of the CPU transmission and overlaps onto the image data
On.
The image sensor also includes the first clock port;The image data transmission equipment also includes
It is connected to the clock optic module of the first clock port;The clock optic module is differential
Clock signal is transmitted under pattern or in a single ended mode.
The direction of transfer of first optic module and the image data of second optic module transmission
It is identical with the direction of transfer that optic module transmits the clock signal with the clock.
The image data transmission equipment also includes emulation optic module;The emulation optic module can be to
Sender with the image data and the clock signal transmits signal in the opposite direction.
The additional image sensor also includes the first additional clock port;The image data transmission sets
For also including clock additional optical fiber module;It is attached that the clock additional optical fiber module is connected to described first
Added-time clock port;The clock additional optical fiber module is passed under differential mode or in a single ended mode
Send clock signal.
The first additional optical fiber module, the second additional optical fiber module and the clock additional optical
The described additional image data of fiber module and the direction of transfer of the clock signal are mutually the same.
The endoscopic system of one embodiment of the invention, also including additional emulation optic module;It is described additional
Emulation optic module can be to opposite with the direction of transfer of the additional image data and the clock signal
Transmit signal in direction.
The image data transmission equipment is also including confirmation of synchronization optic module;The confirmation of synchronization is used up
Fiber module transmits confirmation of synchronization signal under differential mode or in a single ended mode.
The image data direction of transfer of first optic module and second optic module with it is described
The direction of transfer of the confirmation of synchronization signal of confirmation of synchronization optic module is opposite.
The endoscopic system of one embodiment of the invention, also including emulation optic module;The emulation optical fiber
Module transmits signal to the direction of transfer identical direction with the image data.
When in first optic module and second optic module is that cannot transmit the image
During the improper optic module of data, the emulation optic module substitutes the improper optic module transmission
The image data.
The image data transmission equipment is also including confirmation of synchronization additional optical fiber module;The confirmation of synchronization
Confirmation of synchronization signal is transmitted under differential mode or in a single ended mode with additional optical fiber module.
The described additional image data of the first additional optical fiber module and the second additional optical fiber module is passed
Send the direction of transfer of direction and the confirmation of synchronization signal of the confirmation of synchronization additional optical fiber module each other
Conversely.
The endoscopic system of one embodiment of the invention, also including additional emulation optic module;It is described additional
Emulation optic module transmits signal to the direction of transfer identical direction with the additional image data.
One in the first additional optical fiber module and the second additional optical fiber module cannot to transmit institute
When stating the improper additional optical fiber module of image data, the additional emulation optic module substitutes the anon-normal
Normal additional optical fiber module transmits the image data.
The endoscopic system of one embodiment of the invention, also including input unit, MCU and the 3rd optical fiber mode
Block;The input unit, can be operated by user;The MCU is believed the data of the input unit
Number encoded;3rd optic module is connected to the MCU and transmits the input encoded by MCU
Signal;The quantity that the 3rd optic module of input signal is coded of described in transmission is less than from the input unit
Receive the quantity of the input pin of the MCU of the input signal.
The endoscopic system of one embodiment of the invention, also including additional image sensor, MCU and
Three optic modules;The additional image sensor perceives different from the optical wavelength that the image sensor is perceived
Light and generate additional image data, MCU output and be input into the image sensor and described attached
Plus the control signal of image sensor is connected to the MCU simultaneously with information, the 3rd optic module is acted
The control signal and the action information are received and dispatched to the CPU;Quantity of 3rd optic module etc.
In or less than for being input into and export the control signal and the pin of the MCU of the action information
Quantity.
The image data transmission equipment also includes protection portion;The protection portion protects first optical fiber mode
Block and the respective optical fiber of the second optic module;The protection portion is disappeared by that can bear for medicine equipment
Poison and the material of high steam processs that carries out and constitute.
The endoscopic system of one embodiment of the invention, also including monitoring unit;The monitoring unit is to the shadow
As at least one carries out monitor in real time in data input part, the CPU and the image processing department, according to
Described at least one state value resets to described at least one.
The image sensor and the CPU are communicated by communication bus, and the communication bus includes
Output bus and input bus, the output bus and the input bus are respectively connected on control optical fiber mode
Block.
The effect of invention
Image data transmission equipment of the invention and the endoscopic system bag including image data transmission equipment
Optic module is included, therefore with the beneficial effect of the limitation that can overcome bandwidth.
Effect of the invention is not limited to above-described effect, the technical field of the invention it is common
Technical staff can be clearly understood that NM other effects from the record of protection scope of the present invention.
Brief description of the drawings
Fig. 1 to Fig. 6 is the image data transmission equipment for representing embodiments of the invention.
Fig. 7 is the exemplary graph of the outward appearance of the endoscopic system for representing embodiments of the invention.
Fig. 8 and Figure 14 are the block diagram of the endoscope for representing embodiments of the invention.
Fig. 9 to Figure 12 is various changes of the image data transmission equipment for representing endoscopic system of the invention
Shape.
Figure 13 is the citing of the communication chip and control optic module of the endoscopic system of embodiments of the invention
Figure.
Figure 15 is the MCU and the exemplary graph of the 3rd optic module of the endoscopic system of embodiments of the invention.
Specific embodiment
Referring to the drawings to a preferred embodiment of the present invention will be described in detail.But accompanying drawing is only used for simply
The present invention will be described, and general technical staff of the technical field of the invention is expressly understood that the present invention
Scope be not limited to the scope of drawing.
And the word that the present invention is used is only used for the explanation of specific embodiment, but does not limit this hair
Bright intention.For odd number explanation in explanation if including other implications without clear and definite its, it is also possible to
Explanation including plural number.
In the present invention " including " or the word such as " having " be for specify specification to record specific numeral,
Stage, action, inscape, accessory are combined by these, do not exclude in advance to one or
The characteristics of above or numeral, stage, action, inscape, accessory or the presence combined by these
Or additional possibility.
The data transfer equipment and endoscopic system of one embodiment of the invention are carried out with reference next to accompanying drawing
Explanation.
Fig. 1 and Fig. 2 represent the image data transmission equipment of embodiments of the invention.Such as Fig. 1 and Fig. 2, this
The image data transmission equipment of inventive embodiment include image sensor 100, the first optic module 200 with
And second optic module 300.
Image sensor 100 generates image data and including the first video port T1 and the second video port
T2.Image sensor 100 can be generated according to the AP (Application as mobile device CPU
Processor) the generation of treatable specification image data.
For example, image sensor 100 can generate MIPI (Mobile Industry Processor Interface)
Specification, LVDS (Low-Voltage Differential Signaling) specification, Parallel Interface specifications
Image data, but it is not limited to this.MIPI specifications can be mobile for smart mobile phone (smart phone) etc.
Equipment High Speed Transfer image data and use.
First optic module 200 and the second optic module 300 are connected to the first video port T1 and
Two video port T2.First video port T1 and in Fig. 1 and Fig. 2 and Fig. 3 to Fig. 6 described later
The quantity of two video port T2 can change according to the transmission specification of image data.
As shown in Figures 1 and 2, the first optic module 200 and the second optic module 300 include illuminating part
LT, optical fiber OF and light absorbing part LR.Electronic signal is transformed to optical signal, optical fiber OF by illuminating part LT
Transmit the optical signal of conversion, light absorbing part LR will pass through the optical signals that be transmitted of optical fiber OF and become again to turn to electricity
Subsignal.
Various optic modules described later equally may be used beyond first optic module 200 and the second optic module 300
With including illuminating part LT, optical fiber OF and light absorbing part LR.
As shown in Figures 1 and 2, optic module is connected to an image end of image sensor 100
Mouthful.Therefore, the image data transmission equipment of embodiments of the invention transmits image with respect to coaxial line
The mode of data will have various strong point.
Different from embodiments of the invention, when all video ports of image sensor 100 are connected to one
Coaxial line (coaxial cable) and when transmitting image data, it is necessary to serialiser (serializer) is conciliate
Serialiser (deserializer).
The image data that serialiser will be exported by multiple video ports carries out sequence by exchanging (switching)
Rowization are simultaneously transmitted by a coaxial line, the serializing that de-serializer will be transmitted by coaxial line
Image data is swapped and reverts to original state.
Thus, the bandwidth of serialiser and de-serializer is multiplied by video port than the bandwidth of video port
Quantity result it is big.In this case serialiser and de-serializer can be loaded excessive load.
That is, because the band of serialiser and de-serializer is roomy, clock (clock) accelerates, electric power disappears
Consumption becomes big, therefore serialiser and de-serializer can produce excessive heat.It is how serial that heat is produced
Change the life-span of device and de-serializer and will shorten, act confidence level and can also reduce.
Also, serialiser and de-serializer need the time to carry out process image data, and therefore image data is passed
Sending the time can increase.For example, when doctor grasps patient body inside and performed the operation by endoscopic system,
Image comprising surgical behavior needs to be shown in real time.
When increasing the time that image data is transmitted by serialiser and de-serializer, above-mentioned image
Display will postpone doctor and confirm the operation behavior of oneself after some period of time, it is thus possible to occur
Unexpected malpractice.
Especially, such as full HD grades (below, FHD grades) or ultra HD grades of (below, UHD
Level) image etc. need image data to be processed big in the case of serialiser and de-serializer action
Burden can equally increase.
In addition, coaxial line is connected to serialiser and de-serializer, therefore coaxial line is also required to big band
It is wide.The maximum bandwidth of coaxial line is 10Gbps, but if by UHD grades of image with 60 data per second
The bandwidth of transmission line needs 12.5Gbps when frame is to be transmitted.Therefore, high-resolution is transmitted by coaxial line
The image of rate is limited.
Therefore, when high-resolution image data is transmitted by coaxial line, image data is needed by compiling
Code device (encoder) is sent to serialiser after being compressed, and will be logical by decoder (decoder)
Cross the compressing image data recovery of de-serializer into original state.
So as to image data propagation delay due to encoder and decoder, the generation of heat and knot occurs
The problems such as structure is complicated.Moreover, due to the ultrahigh speed image data electromagnetic wave meeting transmitted by coaxial line
Increase, therefore the possibility of image data distortion or generation noise can equally increase.
In contrast, when being connected with an optic module such as one video port of embodiments of the invention,
Not needing above-mentioned serialiser and de-serializer can also be carried out image data by optic module
Transmission.Therefore can solve due to the heat of serialiser, de-serializer, encoder and decoder etc.
The problems such as generation of amount, complicated structure, decline of action confidence level.
In this way, because a video port is connected with an optic module, therefore can overcome in transmission
The bandwidth limitation of the coaxial line produced when FHD grades of image data or UHD grades of image data.
That is, the image data transmission equipment of embodiments of the invention need not be to the serializing of image data
Journey, at least one of image data is transmitted by the first optic module and the second optic module.
In addition, as shown in figure 1, the first optic module 200 connects while being connected to the first video port T1
The 3rd video port T3 is connected to, the second optic module 300 connects while being connected to the second video port T2
It is connected to the 4th video port T4.Now, the first optic module 200 and the second optic module 300 can be with
Image data is transmitted under differential mode.
That is, the first optic module 200 passes through between the first video port T1 and the 3rd video port T3
Voltage difference transmits image data, and the second optic module 300 is again by the second video port T2 and the 4th shadow
As the voltage difference transmission image data between the T4 of port.
For example, when illuminating part LT includes VCSEL (Vertical Cavity Surface Emitting Laser),
The input unit of VCSEL includes two ports (P ports and N-port).Now, VCSEL implements differential
Pattern.That is, when producing the voltage difference time to be released between two ports, when without voltage difference is produced
Light will not be released.
Light absorbing part LR includes optotransistor (Optical Transistor), the source electrode when optotransistor receives light
(source) voltage can be produced and drain electrode (drain) between.This voltage is carried out amplification product by light absorbing part LR
The differential voltage (differential voltage) of the size needed for raw.
Also, as shown in Fig. 2 the first optic module and second optic module are in single-ended mode
Image data is transmitted under (Single-Ended mode).For example, the P ports of each VCSEL are connected to
The N-port of one video port T1 or the second video port T2, each VCSEL is mutually grounded (ground).
VCSEL releases light when voltage difference is produced between N-port and P ports, even if therefore N-port
The image data of input can also be transformed into optical signal by ground connection by P ports.
In addition, as shown in Figures 1 and 2, the first optic module 200 and the second optic module 300 can be straight
The first video port T1 and the second video port T2 is connected in succession.Or as shown in Figures 3 and 4, the
One optic module 200 and the second optic module 300 are connected to the first image end by connector (CON)
Mouth T1 and the second video port T2.
As shown in Figure 5, Figure 6, the image data transmission equipment of embodiments of the invention also includes additional image
Sensor 150, the first additional optical fiber module 250 and the second additional optical fiber module 350.Additional image sensing
Device 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and generates additional image data,
And including for transmitting the first of at least one of additional image data the additional video port AT1 and second
Additional video port AT2.
Now, the first additional optical fiber module 250 and the second additional optical fiber module 350 are respectively connected on first
Additional video port AT1 and the second additional video port AT2.
For example, image sensor 100 can perceive visible rays, additional image sensor 150 can be felt
Know infrared ray or ultraviolet, but be not limited to this, additional image sensor 150 is carried out in detail afterwards
Describe in detail bright.
In addition, as shown in figure 5, the first additional optical fiber module 250 is connected to the first additional video port AT1
While be connected to the 3rd additional video port AT3.
Also, the second additional optical fiber module 350 is connected while being connected to the second additional video port AT2
In the 4th additional video port AT4.
Now, the first additional optical fiber module 250 and the second additional optical fiber module 350 are passed under differential mode
Send image data.
Thus, the first additional optical fiber module passes through the first additional video port AT1 and the 3rd additional image end
Voltage difference between mouth AT3 transmits additional image data.Also, the second additional optical fiber module again by
Voltage difference transmission image data between second additional video port AT2 and the 4th video port AT4.
In addition, as shown in fig. 6, the first additional optical fiber module 250 and the second additional optical fiber module 350 are led to
Cross single-ended mode transmission image data.That is, the first additional optical fiber module 250 and the second additional optical fiber module
350 illuminating part LT has two ports, a ground connection in two ports.Therefore, when two ports it
Between when producing voltage difference illuminating part LT light can be released according to voltage difference.
As described above, under without the serialization process to additional image data, will be at least one of
Additional image data is transmitted by the first additional optical fiber module 250 and the second additional optical fiber module 350.
The endoscopic system of embodiments of the invention is illustrated with reference next to accompanying drawing.
The endoscopic system of the invention that Fig. 7 and Fig. 8 are represented.Embodiments of the invention shown in Fig. 7 it is interior
One example of the outward appearance of endoscope system.
The endoscopic system of embodiments of the invention can include being connected to the one of image data transmission equipment 10
The video generation portion 20 at end.Video generation portion 20 can include image sensor 100 and additional image sensing
At least one of device 150.Now, image data transmission equipment 10 can include the multiple optical fiber of covering
The protection portion OFP of OF.Very thin explanation will be carried out for protection portion OFP with reference to Fig. 8 afterwards.
Video generation portion 20 possesses extending arm (telescope) phase of lens group (lens array) with inside
Connection.Body 30 can include the other end for being connected to image data transmission equipment 10 to process image number
According to or additional image data at least one of hardware (hardware) or software (software) structure
Into key element.
Shown in Fig. 7 be only embodiments of the invention endoscopic system outward appearance an example but simultaneously not only
It is limited to this.
As shown in figure 8, the endoscopic system of embodiments of the invention include image data transmission equipment 10,
Image data input unit 500 and image processing department 510.Dotted arrow in Fig. 8 represents that CPU520 is
The signal of control image data input unit 500, image processing department 510 and monitoring unit described later 570.
Image data transmission equipment 10 generates image data and including the optical fiber mode of image sensor 100 and first
The optic module 300 of block 200 and second, image sensor 100 is included for transmitting at least one of image
First video port T1 of data and the second video port T2, the first optic module 200 and the second optical fiber
Module 300 is connected to the first video port T1 and the second video port T2.
For image data transmission equipment 10 describe in detail and therefore omitted its description.
Image data input unit 500 is connected to image data transmission equipment 10 and will be transmitted by image data
The image data of the output of equipment 10 is sent to the path of setting.For example, image data input unit 500 is by shadow
As data are sent to image processing department 510.
Also, image data input unit 500 can perform to the simple treatment of image data (for example,
Contrast is adjusted, and is amplified (zoom-in), is reduced (zoom-out) etc.), this simple treatment can be by
CPU520 is controlled.
The image that image processing department 510 is transmitted by the control of CPU520 to image data input unit 500
Data carry out image processing.
As described above, image sensor 100 can be generated according to for mobile device CPU's
AP (Application Processor) the image data that is generated of treatable specification.
Thus, when the signal specification that image data is used in accordance with mobile device, CPU520 is equally included such as
The moving chip (mobile chip) of ARM core.
Thus, CPU520 can support such as Android OS (Android operating system) or such as iOS
Mobile OS, can the various functions that be provided of mobile OS be applied in embodiments of the invention and peep
Mirror system.
For example, the endoscopic system of embodiments of the invention can provide various (rich) user interfaces, and
And the convenient function to the users such as such as doctor proposition is updated.
CPU520 of the invention is not limited to mobile device CPU.Thus CPU520 can be
Acted under the OS or the OS as OS X of windows series.
Now, CPU520 can export the treatment to the user interface (user interface) of image data
And according to user to the action control signal of the operation of user interface.User interface can include catalogue,
Catalogue can be the operation of the image shown to the action control of endoscopic system and to display part DIS, but
It is not limited to this.
Operation by user interface to image data can be that image is zoomed in or out, acutance
(sharpness) or luminance variations etc. operation, but be not limited to this.
Although now drawing is not shown, CPU520 can include for store user interface data or
The holder (not shown) of information.
Image processing department 510 overlaps (overlap) to the output of image data input unit 500 user interface
On image data, and according to action control signal transacting image data.
Now, in image data input unit 500 and image processing department 510 at least one by
FPGA (field-programmable gate array) embodies, it is not limited to this.
FPGA is one kind of programmable non-storage semiconductor, with the general semiconductor that cannot change loop
Difference, can again change loop according to purposes.FPGA can be by the switch as hardware elements
(switching) loop desired by the action realization of part, thus image data can be than being entered by software
Being transmitted or processed for high speed is wanted when row transmission or treatment.
Superimposed image data and user interface are passed through video port VP (video by image processing department 510
Port) it is sent to display part DIS.Video port VP can be VGA (Video Graphics Array),
DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface) or
LVDS (Low Voltage Differential Signaling), SDI (Serial Digital Interface), but not
It is defined in this.
In this way, the processing path and image data of the user interface of the endoscopic system of embodiments of the invention
Processing path can be with difference.That is, for the endoscopic system of embodiments of the invention, at CPU520
Reason user interface, image data input unit 500 and image processing department 510 can be with process image datas.
Doctor is performed the operation by the image that endoscopic system is generated by viewing to patient, therefore doctor needs
The situation of the inside of human body to being performed the operation is watched by timely image implements operation so as to correct.
If doctor cannot watch the timely image to the situation of inside of human body in surgical procedure, doctor
Even if occurring in that error also cannot its error cognitive in time.Therefore, endoscopic system needs high speed processing pair
The image data of inside of human body is simultaneously shown by display part DIS (for example, display screen).
Opposite, even if slow to the processing speed of the image data of the treatment comparison inside of human body of user interface
Also there will not be big influence to surgical procedure.
It is different from the endoscopic system of embodiments of the invention by an image processing path process image data
During with user interface, due to the treatment of user interface, the treatment of image data can also postpone therefore can opponent
Art has deleterious effect.
For the endoscopic system of embodiments of the invention, image data input unit 500 and image are processed
Portion 510 can be with high speed processing image data and CPU520 low-speed processings user interface so that image is processed
Portion 510 is overlapped image data and user interface.
Therefore, doctor can watch superimposed image data and user interface by display part DIS, so that
The less time delay for feeling to occur with image data processing procedure simultaneously can be by the operation to user interface
Use various functions of endoscopic system.
At the same time, because the endoscopic system of embodiments of the invention includes that above-mentioned image data is transmitted
Equipment 10, therefore high-resolution or ultrahigh resolution can also be transmitted while the limitation of bandwidth is overcome
Image data.
Moreover, the endoscopic system of embodiments of the invention can no encoder, serialiser,
Transmit image data under conditions of de-serializer or decoder, therefore simple structure can be provided and subtract
The delivery time of few image data postpones.
That is, the endoscopic system of embodiments of the invention, need not be to the sequence number process of image data
Under, at least one of image data can be transmitted by the first optic module and the second optic module.
Although not shown in Fig. 8, be data processing is carried out to user interface can be in CPU520 and image
Possesses holder between processing department 510.
In addition, the first optic module 200 is connected to the 3rd image while being connected to the first video port T1
Port T3, the second optic module 300 is connected to the 4th image while being connected to the second video port T2
Port T4.First optic module 200 and the second optic module 300 transmit image data under differential mode.
This was carried out to describe in detail and had therefore omitted its description.
It is different in this, there is a ground connection in the port of the illuminating part LT of image data transmission equipment 10, because
This image data transmission equipment 10 can in a single ended mode transmit image data.This was carried out detailed
Describe bright therefore omission its description in detail.
In addition, the first optic module 200 and the second optic module 300 are directly connected in the first video port
T1 and the second video port T2 are connected to the first video port T1 and the second shadow by connector CON
As port T2.This was carried out to describe in detail and had therefore omitted its description.
The image data transmission equipment 10 of the endoscopic system of embodiments of the invention is also passed including additional image
Sensor 150, the first additional optical fiber module 250 and the second additional optical fiber module 350.
Additional image sensor 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and life
Into additional image data, and including the first additional shadow for transmitting at least one of additional image data
As port AT1 and the second additional video port AT2.
First additional optical fiber module 250 and the second additional optical fiber module 350 are connected to the first additional shadow
Transmit additional as port AT1 and the second additional video port AT2 and under differential mode or single-ended mode
Image data.This was carried out to describe in detail and had therefore omitted its description.
Also, image data input unit 500 receives additional image data and incites somebody to action while receiving image data
Additional image data is sent to CPU520 and image data is sent into image processing department 510.Now, image
Processing department 510 receives additional image data and is overlapped onto on image data from CPU520.
Image sensor 100 generates the image data of the inside of human body of n data frames per second, and additional image is passed
Sensor 150 generates the additional image data of m data frames per second.
As described above, additional image data is not (for example, near to the wavelength bandwidth in addition to visible rays
Infrared ray, infrared ray, ultraviolet etc.) image or fluorescence endoscopic spectroscopy or fluorescence endoscopic videoendoscopic surgery institute
The data of the image of the fluorescent material for using, can be the images of the specific objective in addition to affected part.
Image data input unit 500 can transmit image data and additional image number according to the path for having set
According to.That is, image data is sent to image and processed by image data input unit 500 by the first transmitting path
Portion 510, CPU520 is sent to by additional image data by the second transmitting path.
Now, by the second transmitting path can also be sent to image data by image data input unit 500
CPU520.CPU520 can be than the transfer rate of the image data of the first transmitting path at a slow speed transmission it is attached
Plus image data.
Image processing department 510 will pass through the image data and defeated by CPU520 that the first transmitting path is transmitted
The additional image data for going out is overlapped.Thus image data can turn into background image (background
Image), display part DIS can show the additional image data Chong Die with background image.
Can be by high speed processing as discussed previously with respect to additional image data image data.Image data shows
Show the situation of inside of human body, therefore image data by being generated to the time delay shown by display part DIS
It is more short more provide correct information can to doctor.
Additional image data is the other image of image or wavelength bandwidth to fluorescent material, therefore additional shadow
As the generation of data can be slower than image data.For example, due to fluorescent material light quantity or visible rays with
The other light quantity of outer wavelength bandwidth is few, therefore to obtain the complete image to additional image data, adds
Image sensor 150 will be relative time exposure in the other light of light or wavelength bandwidth of fluorescent material.
If image datas different from the endoscopic system of embodiments of the invention and additional image data pass through
When same path is processed, the place of image data comprehends and is affected, therefore image data cannot lead to
Cross display part DIS quickly and be accurately shown.
Image data and additional image data are passed through different roads by the endoscopic system of embodiments of the invention
Footpath is processed, and can be by high speed processing relative to additional image data image data, therefore can be by
The image of inside of human body is quick and is accurately shown.
The endoscopic system of embodiments of the invention can include, be connected to the He of image data input unit 500
The holder (not shown) of CPU520 and it is connected to the holder of image processing department 510 and CPU520 (not
Diagram).It is such as DMA (Direct that image data input unit 500 and image processing department 510 include respectively
Memory Access) logic, HDMI (High Definition Multimedia Interface) logic, DVI
The standard output inbound port logic of logic etc. and by itself and image data input unit 500 and image processing department 510
Holder at a high speed connect.
The standard output inbound port logic of image data input unit 500 and image processing department 510 is by image number
According to and additional image data backup (dump) in holder, the dma logic of image processing department 510
The user interface and additional image data of additional image data or overlap can be read from holder.Now,
The holder of image data input unit 500 and image processing department 510 can be by synchronization (sync) order wire
The information of data is read and write in transmitting-receiving mutually.
As described above, image processing department 510 by image data and additional image data and user interface extremely
Few one is overlapped.
In addition, as shown in figure 9, image sensor 100 also includes the first clock port CT1.Image
Data transfer equipment 10 also includes being connected to the clock optic module 610 of the first clock port.Now,
Clock optic module 610 transmits clock signal under differential mode or single-ended mode.For example, image number
Include 2 the first optic modules, 200,2 the second optic modules, 300,1 clock according to transmission equipment 10
With optic module 610.
When clock optic module 610 is acted under differential mode, clock optic module 610 can be even
It is connected to the first clock port CT1 and second clock port CT2.And, although it is not shown in Fig. 9,
When clock optic module 610 is acted in a single ended mode, the clock illuminating part of optic module 610
One side ports are connected to the first clock port CT1, and another side ports can then be grounded.
Image sensor 100 and additional image sensor 150 can support (the MIPI of MIPI CSI II
Camera signal interface protocol II) and (the MIPI camera signal interface of MIPI CSI III
protocolⅢ).Now, MIPI CSI II and MIPI CSI III can transmit (FHD grades of high-resolution
Or UHD grades) image data or additional image data.
First pin (pin) specification of MIPI CSI II is illustrated with reference first to Fig. 9.
For MIPI CSI II, image sensor 100 and CPU520 can include as shown in Figure 9
Equivalent to 4 optic modules (2 first optic modules 200,2 second of data wire (data line)
Optic module 300) and equivalent to 1 clock optic module 610 of clock line (clock line).When
Clock line can transmit the clock signal used when image data or transmission treatment.
Now, the first optic module 200 and the second optic module 300 can be in differential mode or single-ended moulds
Acted under formula, be described in detail for differential mode and single-ended mode and therefore omitted its description.
In this way, when 4 data wires and a clock line are all acted under differential mode, the first optic module
200th, the second optic module 300 and clock light fiber module 610 are connected to image sensor 100
2 ports.
Also, when 4 data wires and a clock line are all acted in a single ended mode, the first optic module
200th, the second optic module 300 and clock are connected with the respective P ports of illuminating part LT of light fiber module 610
The a port of image sensor 100 is connected to, N-port can then be grounded.
In addition, transmission when the first optic module 200 and the image data of the transmission of the second optic module 300
The direction of transfer during clock signal of direction and the transmission of clock optic module 610 can be with identical.I.e., such as
Shown in Fig. 9, image data and clock signal can be transmitted from image sensor 100 toward CPU520.
In addition, additional image sensor 150 connects also according to pin (pin) specification of MIPI CSI II
It is connected to the first additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber module
615.First additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber module
The 615 same actions under differential mode (referring to Fig. 9) or single-ended mode (not shown).
That is, when the endoscopic system of embodiments of the invention includes additional image sensor 150, add
Image sensor also includes the first additional clock port ACT1.Image data transmission equipment 10 also includes
It is connected to the clock additional optical fiber module 615 of the first additional clock port ACT1.Now, clock is used
Additional optical fiber module 615 transmits clock signal under differential mode or single-ended mode.
For example, the endoscopic system of embodiments of the invention includes 2 first of the additional image data of transmission
250,2 the second additional optical fiber modules 350 of additional optical fiber module and a clock additional optical fiber module
615。
As shown in figure 9, the illuminating part LT of clock additional optical fiber module 615 is connected under differential mode
One additional clock port ACT1 and the second additional clock port ACT2.And, although in accompanying drawing not
One side ports of the diagram illuminating part LT of clock additional optical fiber module 615 in a single ended mode are connected to the
Another side ports of one additional clock port ACT1, illuminating part LT can then be grounded.
The first optic module 200, the second optic module 300 and clock light fiber module 610 are passed through to this
Explanation was carried out, therefore their description is omitted.
Also, the first additional optical fiber module 250, the second additional optical fiber module 350 and clock additional optical fiber
The additional image data of module 615 and the direction of transfer of clock signal can be with identical.To this and the first optical fiber
The explanation that module 200, the second optic module 300 and clock are carried out with light fiber module 610 is similar to, therefore saves
Slightly it is illustrated.
With reference next to inserting for Figure 10 couples of MIPI CSI III different from the pin specification of MIPI CSI II
The specification of pin is illustrated.
For MIPI CSI III, image sensor 100 and CPU520 such as Figure 10 can be included quite
In 4 optic modules (2 the first optic modules, 200,2 the second optical fiber of data wire (data line)
Module 300) and equivalent to 1 confirmation of synchronization optic module 620 of confirmation of synchronization line.
Confirmation of synchronization line be used to transmit image data transmission and processing procedure in for confirming synchronous synchronization
Confirmation signal or for the order (command) of CPU520 to be sent in image sensor 100.By
In MIPI CSI III use embedded clock (embeded clock) therefore do not need MIPI CSI II
The clock for using in addition optic module 610.Now, confirmation of synchronization line is same in differential mode or single-ended
Confirmation of synchronization signal is transmitted under pattern.
In this way, 4 data wires and 1 confirmation of synchronization line may all be acted under differential mode, therefore first
The optic module 300 of optic module 200 and second is connected to 2 ports of image sensor 100,
The light absorbing part LR of confirmation of synchronization optic module 620 is connected to the confirmation of synchronization end of image sensor 100
Mouth ST.
Although not shown in Figure 10,4 data wires and 1 confirmation of synchronization line are all acted in a single ended mode
When, the first optic module 200, a side ports of the illuminating part LT of the second optic module 300 are connected respectively
In 1 port of image sensor 100, another side ports can then be grounded.Also, confirmation of synchronization is used
A ground connection in two ports of the illuminating part LT of optic module 620, the synchronous receipts with optic module 620
Light portion LR is connected to the confirmation of synchronization port ST of image sensor 100.
As described above, image data transmission equipment 10 also includes confirmation of synchronization optic module 620.It is synchronous
Confirmation optic module 620 can transmit confirmation of synchronization signal under differential mode or single-ended mode.Example
Such as, image data transmission equipment 10 can include 2 the first optic modules, 200,2 the second optical fiber modes
Block 300 and a confirmation of synchronization optic module 620.
Now, confirmation of synchronization signal is imported into image sensor 100, and image data by image sensing
Device 100 is exported.Therefore the transmission of the image data of the first optic module 200 and the second optic module 300
Direction can be opposite each other with the direction of transfer of the confirmation of synchronization signal of confirmation of synchronization optic module 620.
In addition, when the endoscopic system of embodiments of the invention includes additional image sensor 150, shadow
The synchronization of confirmation of synchronization signal is transmitted under being additionally included in differential mode or single-ended mode as data transfer equipment 10
Confirm with additional optical fiber module 625.
For example, thus including 2 first additional optical fiber modules 250,2 the of the additional image data of transmission
Two additional optical fiber modules 350 and a confirmation of synchronization additional optical fiber module 625.Now, confirmation of synchronization is used
Additional optical fiber module 625 can be connected to the appended synchronization confirmation port of additional image sensor 150
AST。
For additional image sensor 150, the first additional optical fiber module 250, the second additional optical fiber module 350,
The confirmation of synchronization relation and above-mentioned image sensor 100, the first optic module of additional optical fiber module 625
200th, the second optic module 300 and confirmation of synchronization are similar to the relation of optic module 620, therefore omit right
Its explanation.
The transmission of the additional image data of the first additional optical fiber module 250 and the second additional optical fiber module 350
Direction can be with the direction of transfer of the confirmation of synchronization signal of confirmation of synchronization additional optical fiber module 625 phase each other
Instead.In this regard, because with the transmission of the confirmation of synchronization signal of optic module 620 of image data and confirmation of synchronization
The relation in direction is similar to, therefore their description is omitted.
In addition, the endoscopic system of embodiments of the invention includes simultaneously realizing the Hes of MIPI CSI II
The image data transmission equipment 10 of MIPI CSI III.
Therefore, image data transmission equipment 10 include the first optic module 200, the second optic module 300,
First direction of transfer optic module OF_D1 and the second direction of transfer optic module OF_D2.
Now, the signal transmission direction of the first direction of transfer optic module OF_D1 and the second direction of transfer light
The signal transmission direction of fiber module OF_D2 can be with conversely, the first optic module 200 and the second optic module
300 image data direction of transfer can be with identical.
For example, shown in Figure 11 and Figure 12, image data transmission equipment 10 includes 2 the first optic modules
200th, 2 the second optic modules, 300,1 the first direction of transfer optic module OF_D1 and 1 second
Direction of transfer optic module OF_D2.
Now, as shown in figure 11, if image data transmission equipment meets MIPI CSI II, image number
According to transmission equipment 10 also include emulation optic module 630, emulation optic module 630 can to image number
Signal is transmitted in the opposite direction according to the sender with clock signal.
That is, the first direction of transfer optic module OF_D1 can be clock optic module 610, and second passes
It can be emulation optic module 630 to send direction optic module OF_D2.This emulation optic module 630 can
It is sent to various letters of image sensor 100 from CPU520 for transmitting for use as backup optic module
Number or data.
Also, when image data transmission equipment 10 also includes additional image sensor 150, also including attached
Plus emulation optic module 635, it is described it is additional emulation optic module 635 can to additional image data and when
The sender of clock signal transmits signal in the opposite direction.
In addition, as shown in figure 12, if image data transmission equipment 10 meets MIPI CSI III, image
Data transfer equipment 10 includes that the first optic module 200, the second optic module 300, confirmation of synchronization are used up
Fiber module 620 additionally includes emulation optic module 630.
Now, emulation optic module 630 transmits signal to the direction of transfer identical direction with image data.
That is, the first direction of transfer optic module OF_D1 can be emulation optic module 630, the second direction of transfer
Optic module OF_D2 can be confirmation of synchronization optic module 620.
When at least one is that cannot transmit image number in the first optic module 200 and the second optic module 300
According to improper optic module when, as the emulation optic module of the first direction of transfer optic module OF_D1
630 substitute improper optic module transmission image data.Thus, it is possible to the action for improving endoscopic system is steady
It is qualitative.
Image data transmission equipment 10 includes additional image sensor 150, the additional image sensor 150
Also include additional emulation optic module 635 when meeting MIPI CSI III, additional emulation optic module 635 can
Signal is transmitted with to the direction of transfer identical direction with additional image data.
It is similar with the above, one in the first additional optical fiber module 250 and the second additional optical fiber module 350
During individual improper additional optical fiber module for that cannot transmit image data, additional emulation optic module 635 is replaced
Image data is transmitted for improper additional optical fiber module.
The specification of above-described MIPI CSI II and the specification of MIPI CSI III are only an example, this
Inventive embodiment is not limited to this specification.
In addition, as shown in figure 8, the endoscopic system of embodiments of the invention also includes control optic module
640 and input optical fibre module 650.Control optic module 640 is illustrated first.
Control optic module 640 can be used for CPU520, focus portion 530, image sensor 100 and attached
Plus the communication between image sensor 150, therefore, it can be passed by CPU520 control focuses portion, image
Sensor 100 and additional image sensor 150.
Focus portion 530 driven under the control of CPU520 focus lens realize to image sensor 100 or
The automatic focusing (auto focusing) of additional image sensor 150.Also, the He of image sensor 100
Additional image sensor 150 is initialized according to the control signal of CPU520.This automatic focusing and
Initialization be only CPU520 control an example, by CPU520 can realize to image sensor 100,
Additional image sensor 150 and the various control in focus portion 530.
Therefore, the endoscopic system of embodiments of the invention includes communication chip 540, the communication chip
540 communications being used to perform between CPU520 and focus portion 530, CPU520 and image sensor 100
Between communication and the communication between CPU520 and additional image sensor 150.Communication chip 540 can
To support such as I2The specific communications specification of C, but it is not limited to I2C telecommunications metrics.
Now, communication chip 540 can be passed with built-in focus portion 530, image sensor 100 and additional image
Sensor 150.The communication chip 540 being used in the communication process with CPU520 is connected to control light
Fiber module 640.
Although each communication chip 540 is illustrated in Fig. 8 is respectively connected on a control optic module 640,
But this is not limited to this merely for convenience of description.
For example, as shown in figure 13, multiple communication chips 540 can be by communication bus (bus) and CPU520
Communicated.Each communication bus is connected to a control optic module 640.Two communication bus be for
Transmitting-receiving with CPU520 is believed.That is, one communication bus is used to receive the control from CPU520 outputs
Signal, another communication bus is used to export action information to CPU520.
Action information can be CPU520 to control from focus portion 530, image sensor 100 and adding
Image sensor 150 and receive report information.For example, action information can be focusing portion 530, shadow
As sensor 100 and the information of the current state of additional image sensor 150, but it is not limited to this.
And, although it is not shown in Figure 13 to increase for clock signal to be sent into Jiao from CPU520
Point portion 530, image sensor 100 and the clock bus of additional image sensor 150, clock bus are same
It is connected to control optic module.
When so carrying out bus communication, it is possible to reduce the quantity of control optic module 640.That is, such as Figure 13
It is shown, in order to multiple communication chips 540 need two control optic modules 640 during using communication bus.Phase
Anti- when not using communication bus, each communication chip 540 will be connected therefore need with control optic module 640
Increase the quantity of control optic module 640.
That is, image sensor 100 and CPU520 are communicated by communication bus, and communication bus includes
Bus of delivering letters and collection of letters bus.Now, bus of delivering letters and collection of letters bus are connected to control optic module
640。
Also, additional image sensor 150 and focus portion 530 again by the communication bus with
CPU520 is communicated.
Next input optical fibre module 650 is illustrated.
As shown in figure 8, the endoscopic system of embodiments of the invention includes input unit 550.Input unit 550
Can be according to the moving up and down of the operation generation video generation portion 20 of user, image data or additional
The white balance (white balance) of image data and the input signal of selection catalogue.In this way, CPU520
Can be by input signal control endoscopic system.
The driving of Fig. 8 movements up and down for video generation portion 20 not shown for convenience of explanation
Portion.
Such input signal is sent to by being connected to the input optical fibre module 650 of input unit 550
CPU520, and be respectively used to including 6 input optical fibre modules, 650,6 input optical fibre modules 650
Video generation portion 20 moves up and down, to the white balance and selection of image data or additional image data
Catalogue, but the quantity of input optical fibre module 650 can increase or decrease.Input unit 550 can include GPIO
(General Purpose Input/Output) but it is not limited to this.
When Fig. 8 is endoscopic system, be connected to input unit 550 and communication chip 540 optic module and
Control optic module 640 is connected to image data input unit 500 therefore the quantity of optic module can be increased.
For example, input unit 550 is connected to 6 input optical fibre modules 650 as described above, it is logical when used for multiple
When believing that the communication bus of chip 540 is connected to 2 control optic modules 640, passed except being connected to image
The optic module of sensor 100 or additional image sensor 150 also needs to 8 extra optic modules.
Therefore, by protection portion OFP around optical fiber quantity need also exist for increase, image data transmission set
Standby 10 thickness can excessively increase.
As shown in figure 14, the endoscopic system of embodiments of the invention also includes MCU (micro control
Unit) 560, therefore the quantity of optic module can be reduced.
The endoscopic system of embodiments of the invention also includes the input unit 550, right that can be operated by user
MCU560 that the input signal of input unit 550 is encoded and be connected to MCU560 transmission by
3rd optic module 660 of the input signal that MCU560 is encoded.Now, the input letter of transmission coding
Number the 3rd optic module 660 quantity can than from input unit 550 receive input signal MCU560
Input pin quantity it is few.
For example, shown in Figure 15, input unit 550 is generated for moving up and down, white balance and catalogue are selected
The input signal selected, therefore MCU560 can possess 6 input pins for these input signals.
MCU560 receives these input signals and is exported to output port after being encoded, the 3rd light side by side
Fiber module 660 is connected to output port.In this way, the 3rd optic module 660 passes through image data input unit
500 are communicated with CPU520 or can be directly connected to CPU520.
It is different from embodiments of the invention when not possessing MCU560, input unit as described above 550 needs
6 input optical fibre modules 650 are connected to, but for embodiments of the invention, for transmitting by MCU560
The quantity of the 3rd optic module 660 of the input signal for being encoded can be than 6 input optical fibre modules 650
It is few.
In addition, as shown in Figure 14 and Figure 15, the endoscopic system of embodiments of the invention also includes adding
Image sensor 150, MCU560 and the 3rd optic module 660.
Additional image sensor 150 perceives the light different from the optical wavelength of the perception of image sensor 100 and life
Into additional image data.
CMU560 is received and dispatched to the control signal of image sensor 100 and additional image sensor 150 and dynamic
Make information.That is, MCU560 exports to image sensor 100 and additional image sensor control signal
150, and act information from image sensor 100 and the reception of additional image sensor 150.
3rd optic module 660 is connected to MCU560 and CPU520 and receives and dispatches control signal and action information.
That is, CMU560 receives control signal by an optic module 660 from CPU520, by another
Optic module is exported information is acted to CPU520.
Now, the quantity of the 3rd optic module 660 can be with transmitting-receiving control signal and action information
The quantity of the pin of MCU560 is identical or less than quantity of pin of MCU560.
Explanation, therefore detailed had been carried out for control signal and action information.
MCU560 is connected to the 3rd optic module 660 and is decoded the control signal of CPU520
And transmitted by communication bus.Also, MCU560 by communication bus receive image sensor 100,
At least one action information and pass through after being encoded in additional image sensor 150 and focus portion 530
Another the 3rd optic module 660 is exported to CPU520.
The encoding and decoding of MCU560 is only of the communication process between MCU560 and CPU520
Example, the action of MCU560 is not limited to this.
As described above, image sensor 100 and additional image sensor 150 by communication bus with
When CPU520 is communicated, MCU560 has 2 of the transmitting-receiving letter for control signal and action information
Port, 2 ports are connected to communication bus.
Also, MCU560 control signals and action information are received by 2 the 3rd optic modules 660
Transmit.Thus, the quantity of the 3rd optic module 660 with for receiving and dispatching image sensor 100 and additional shadow
As the quantity of the pin of the MCU560 of the control signal and action information of sensor 150 is identical.
If do not communicated with multiple communication chips 540 by communication bus, MCU560 is in order to receive
Transmit each communication chip 540 and need to have 2 ports, therefore the quantity of the 3rd optic module 660 can
With inserting for the MCU560 than image output sensor 100 and the control signal of additional image sensor 150
The quantity of pin is few.
In addition, as shown in Fig. 8 and Figure 14, the protection portion OFP of image data transmission equipment 10 is by can be with
Bear the material of high steam processs (auto clave) that is carried out for medical apparatus sterilizing and constitute.This
The endoscopic system of invention is similarly medicine equipment, therefore can carry out high steam processs.High steam
Treatment is carried out 20 minutes in 20 steam spray devices of 120 degree of air pressure, and optical fiber is lower than 120 degree
At a temperature of dissolve.
Because protection portion OFP covers optical fiber, therefore optical fiber can be protected during high steam processs.
Although during high steam processs using steam carry out disinfection steam temperature it is high but thermal capacity is small, due to this hair
The protection portion OFP of bright embodiment includes that therefore the rubber of shielding heat can protect optical fiber.
As described above, protection portion OFP can protect the first to the 3rd optic module 660, first and second
Various optic modules such as additional optical fiber module 350, control optic module 640, input optical fibre module 650
Optical fiber.
As shown in Fig. 8 and Figure 14, the endoscopic system of embodiments of the invention also includes monitoring unit 570.
Monitoring unit 570 is entered in image data input unit 500, CPU520 and image processing department 510 at least one
Row monitor in real time, and according at least one state value at least one implement reset (reset).
Due to endoscopic system for medical purpose, thus image data and additional image data treatment need
The carrying out to stablize always.If doctor cannot watch the image of inside of human body in surgical procedure, performed the operation
Journey will be unable to be smoothed out.
Thus, monitoring unit 570 can perform to image data input unit 500, image processing department 510 and
At least one monitor in real time in CPU520, image data input unit 500, image processing department 510 and
CPU520 is used for the treatment of image data, additional image data and user interface.
For example, monitoring unit 570 per 1ms receive image data input unit 500, image processing department 510 and
At least one state value in CPU520, the cycle of reception state value can be bigger or small than 1ms.
The inscape of 570 pairs of state values for improper or wrong (error) occur of monitoring unit resets,
The process time of improper image processing or user interface is set to shorten or minimize it.
This monitoring unit 570 performs simple function relative to CPU520, therefore can be by Micro
Control Unit forms or firmware forms embody, but are not limited to this.
As described above, the image data transmission equipment 10 of embodiments of the invention and endoscopic system are substituted together
Axis includes optic module, therefore can provide the image data transmission equipment 10 smaller than the diameter of coaxial line.
Thus, the image data transmission equipment 10 and endoscopic system of embodiments of the invention can overcome together
The limitation of the bandwidth of axis, and the image data or additional image of high-resolution or ultrahigh resolution can be transmitted
Data.
Moreover, it is not necessary to encoded by optic module, serialized, de-serialized and decoded,
Therefore image data and additional image data can faster be transmitted.
As described above, a preferred embodiment of the present invention is observed, and for skill belonging to the present invention
For the those of ordinary skill in art field, in addition to embodiment described above, the present invention can be not
In the case of departing from its objective or category, realize that materialization is obvious with other specific modalities.Cause
This, the above embodiments be not construed as it is restricted, but be construed as it is exemplary, thus, this
Invention is not limited to above-mentioned explanation, and can be appended claims category and
Changed in its equivalency range.
Claims (35)
1. a kind of image data transmission equipment, it is characterised in that including:
Image sensor, generates image data and including the first video port and the second video port, described
First video port and second video port are used to transmit at least one of image data;And
First optic module and the second optic module, first optic module and second optic module
It is connected to first video port and second video port.
2. image data transmission equipment according to claim 1, it is characterised in that first light
Fiber module is connected to the 3rd video port, second optical fiber while being connected to first video port
Module is connected to the 4th video port, first optical fiber mode while being connected to second video port
Block and second optic module transmit the image data under differential mode.
3. image data transmission equipment according to claim 1, it is characterised in that first light
Fiber module and second optic module transmit the image data in a single ended mode.
4. image data transmission equipment according to claim 1, it is characterised in that without right
Under the serialization process of the image data, at least one of image data is passed through described first
Optic module and second optic module are transmitted.
5. image data transmission equipment according to claim 1, it is characterised in that first light
Fiber module and second optic module are directly connected in first video port and the second image end
Mouth is connected to first video port and second video port by connector.
6. image data transmission equipment according to claim 1, it is characterised in that including:
Additional image sensor, perceives the light different from the optical wavelength that the image sensor is perceived and generates
Additional image data, and including the first additional video port and the second additional video port, described first is attached
Plus video port and the second additional video port are used to transmit at least one of additional image number
According to;And
First additional optical fiber module and the second additional optical fiber module, the first additional optical fiber module and described
Second additional optical fiber module is connected to the described first additional video port and the second additional image end
Mouthful.
7. image data transmission equipment according to claim 6, it is characterised in that described first is attached
Plus optic module is connected to the 3rd additional video port while be connected to the first additional video port,
The second additional optical fiber module is connected to the 4th and adds while being connected to the second additional video port
Video port, the first additional optical fiber module and the second additional optical fiber module are passed under differential mode
Send the additional image data.
8. image data transmission equipment according to claim 6, it is characterised in that described first is attached
Plus optic module and the second additional optical fiber module transmit the additional image data in a single ended mode.
9. image data transmission equipment according to claim 6, it is characterised in that without right
Under the serialization process of the additional image data, at least one of additional image data is passed through
The first additional optical fiber module and the second additional optical fiber module are transmitted.
10. a kind of endoscopic system, it is characterised in that including:
Image data transmission equipment, including:Image sensor and the first optic module and the second optic module,
Image sensor generation image data and including the first video port and the second video port, described the
One video port and second video port are used to transmit at least one of image data, described first
Optic module and second optic module, are connected to first video port and second shadow
As port;
Image data input unit, is connected to the image data transmission equipment and will be by the image data
The image data of transmission equipment output is transmitted according to the path of setting;And
Image processing department, the image transmitted to the image data input unit by the control of CPU
Data carry out image processing.
11. endoscopic systems according to claim 10, it is characterised in that the CPU is to institute
Stating image data carries out user interface process, and the image processing department is by the user interface and the image
Data are overlapped.
12. endoscopic systems according to claim 10, it is characterised in that first optical fiber mode
Block and second optic module transmit the image data under differential mode or in a single ended mode.
13. endoscopic systems according to claim 10, it is characterised in that without to described
Under the serialization process of image data, at least one of image data is passed through into first optical fiber
Module and second optic module are transmitted.
14. endoscopic systems according to claim 10, it is characterised in that first optical fiber is touched
And second optic module is directly connected in first video port and second video port or logical
Cross connector and be connected to first video port and second video port.
15. endoscopic systems according to claim 10, it is characterised in that the endoscopic system
Also include:Additional image sensor and the first additional optical fiber module and the second additional optical fiber module, it is described attached
Plus image sensor perceives the light different from the optical wavelength of image sensor perception and generates additional image
Data, and including the first additional video port and the second additional video port, the first additional image end
Mouth and the second additional video port are used to transmit at least one of additional image data;
The first additional optical fiber module and the second additional optical fiber module, are connected to described first
Additional video port and the second additional video port, and passed under differential mode or under single-ended mode
Send the additional image data.
16. endoscopic systems according to claim 15, it is characterised in that the image data is defeated
Enter while portion receives the image data and receive additional image data, the additional image data is transmitted
To the CPU, the image data is sent to the image processing department;
The image processing department receives the additional image data of the CPU transmission and overlaps onto the image number
According to upper.
17. endoscopic systems according to claim 10, it is characterised in that the image sensor
Also include the first clock port;The image data transmission equipment also includes being connected to first clock
With the clock optic module of port;The clock optic module is under differential mode or in single-ended mould
Clock signal is transmitted under formula.
18. endoscopic systems according to claim 17, it is characterised in that first optical fiber mode
The direction of transfer and the clock optical fiber mode of block and the image data of second optic module transmission
The direction of transfer that block transmits the clock signal is identical.
19. endoscopic systems according to claim 18, it is characterised in that the image data is passed
Sending equipment also includes emulation optic module;It is described emulation optic module can to the image data and institute
The sender for stating clock signal transmits signal in the opposite direction.
20. endoscopic systems according to claim 15, it is characterised in that the additional image is passed
Sensor also includes the first additional clock port;It is additional that the image data transmission equipment also includes that clock is used
Optic module;The clock additional optical fiber module is connected to the described first additional clock port;It is described
Clock additional optical fiber module transmits clock signal under differential mode or in a single ended mode.
21. endoscopic systems according to claim 20, it is characterised in that first additional optical
Fiber module, the second additional optical fiber module and the clock described additional shadow of additional optical fiber module
As the direction of transfer of data and the clock signal is mutually the same.
22. endoscopic systems according to claim 21, it is characterised in that also including additional emulation
Optic module;The additional emulation optic module can be believed to the additional image data and the clock
Number sender transmit signal in the opposite direction.
23. endoscopic systems according to claim 12, it is characterised in that the image data is passed
Send equipment also including confirmation of synchronization optic module;The confirmation of synchronization optic module is under differential mode
Or confirmation of synchronization signal is transmitted in a single ended mode.
24. endoscopic systems according to claim 23, it is characterised in that first optical fiber mode
The image data direction of transfer of block and second optic module and the confirmation of synchronization optic module
The confirmation of synchronization signal direction of transfer it is opposite.
25. endoscopic systems according to claim 24, it is characterised in that also including emulation optical fiber
Module;The emulation optic module transmits signal to the direction of transfer identical direction with the image data.
26. endoscopic systems according to claim 25, it is characterised in that when first optical fiber
An improper optical fiber mode for being to transmit the image data in module and second optic module
During block, the emulation optic module substitutes the improper optic module and transmits the image data.
27. endoscopic systems according to claim 15, it is characterised in that the image data is passed
Sending equipment also includes confirmation of synchronization additional optical fiber module;Confirmation of synchronization additional optical fiber module is in difference
Confirmation of synchronization signal is transmitted under dynamic model formula or in a single ended mode.
28. endoscopic systems according to claim 27, it is characterised in that first additional optical
The described additional image data direction of transfer of fiber module and the second additional optical fiber module is synchronous true with described
Recognize opposite each other with the direction of transfer of the confirmation of synchronization signal of additional optical fiber module.
29. endoscopic systems according to claim 28, it is characterised in that also including additional emulation
Optic module;The additional emulation optic module is to the direction of transfer identical with the additional image data
Transmit signal in direction.
30. endoscopic systems according to claim 29, it is characterised in that first additional optical
One in fiber module and the second additional optical fiber module is that cannot transmit the improper of the image data
During additional optical fiber module, the additional emulation optic module substitutes the improper additional optical fiber module transmission
The image data.
31. endoscopic systems according to claim 10, it is characterised in that also including input unit,
MCU and the 3rd optic module;The input unit, can be operated by user;The MCU
Data-signal to the input unit is encoded;3rd optic module is connected to the MCU and passes
Send the input signal encoded by MCU;The number of the 3rd optic module of input signal is coded of described in transmission
Quantity of the amount less than the input pin of the MCU that the input signal is received from the input unit.
32. endoscopic systems according to claim 10, it is characterised in that also including additional image
Sensor, MCU and the 3rd optic module;The additional image sensor is perceived and the image sensing
The different light of optical wavelength that device is perceived simultaneously generates additional image data;The MCU outputs and input are to described
The control signal and action information of image sensor and the additional image sensor;3rd optical fiber mode
Block is connected to the MCU and receives and dispatches the control signal and the action information to the CPU;It is described
The quantity of the 3rd optic module is equal to or less than for being input into and exporting the control signal and the action feelings
The quantity of the pin of the MCU of report.
33. endoscopic systems according to claim 10, it is characterised in that the image data is passed
Sending equipment also includes protection portion;The protection portion protects first optic module and second optical fiber mode
The respective optical fiber of block;The protection portion is by the high steam that can bear to be carried out for medical apparatus sterilizing
The material for the treatment of and constitute.
34. endoscopic system according to any one of claim 10 to 33, it is characterised in that
Also include monitoring unit;The monitoring unit adds to the image data input unit, the CPU and the image
At least one carries out monitor in real time in the Ministry of worker, according to described at least one state value to described at least one
Reset.
35. endoscopic systems according to claim 10, it is characterised in that the image sensor
Communicated by communication bus with the CPU, the communication bus includes output bus and input bus,
The output bus and the input bus are respectively connected on control optic module.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR20150188070 | 2015-12-29 | ||
KR10-2015-0188070 | 2015-12-29 | ||
KR1020160030050A KR101786840B1 (en) | 2015-12-29 | 2016-03-14 | Apparatus for transfering image data and endoscopy system including the same |
KR10-2016-0030050 | 2016-03-14 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106937036A true CN106937036A (en) | 2017-07-07 |
CN106937036B CN106937036B (en) | 2020-10-30 |
Family
ID=59353699
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610574692.XA Active CN106937036B (en) | 2015-12-29 | 2016-07-19 | Image data transmission apparatus and endoscope system including the same |
Country Status (2)
Country | Link |
---|---|
KR (1) | KR101786840B1 (en) |
CN (1) | CN106937036B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102007656B1 (en) | 2017-10-25 | 2019-08-06 | 재단법인 아산사회복지재단 | Method for measuring length using motion sensor and apparatus for the same |
KR102526734B1 (en) | 2019-12-31 | 2023-04-27 | (주)엠아이원 | Image output apparatus and endoscope apparatus using the same and image output method using the same |
CN116546915A (en) * | 2020-10-27 | 2023-08-04 | 深圳迈瑞生物医疗电子股份有限公司 | Endoscope image pickup system and image data transmission device thereof |
KR20230024529A (en) | 2021-08-12 | 2023-02-21 | (주) 엠아이원 | Image output apparatus capable of outputting a plurality of images with a plurality of sensors and endoscope apparatus using the same |
CN113810505A (en) * | 2021-10-21 | 2021-12-17 | 上海德林威信息科技有限公司 | System for cloud synchronization of face recognition camera data and use method thereof |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2551172Y (en) * | 2002-06-14 | 2003-05-21 | 台群科技股份有限公司 | Endoscope with infrared ray |
EP2245980A2 (en) * | 2009-04-28 | 2010-11-03 | FUJIFILM Corporation | Endoscope system, encoscope, and driving method |
CN102258359A (en) * | 2010-05-31 | 2011-11-30 | 奥林巴斯株式会社 | Endoscope system |
US20120016202A1 (en) * | 2010-07-15 | 2012-01-19 | Eckart Baum | Endoscopic Instrument |
CN102440753A (en) * | 2010-09-30 | 2012-05-09 | 奥林巴斯株式会社 | Endoscope system |
CN103300812A (en) * | 2013-06-27 | 2013-09-18 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
CN103705201A (en) * | 2014-01-16 | 2014-04-09 | 福建师范大学 | Multimode spectrum analysis system suitable for detecting alimentary canal pathologic changes |
CN205864558U (en) * | 2015-12-29 | 2017-01-04 | 因德斯马特有限公司 | Image data transmits equipment and includes that image data transmits the endoscopic system of equipment |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101021891B1 (en) * | 2010-12-22 | 2011-03-17 | 주식회사 엠투엘 | Optical signal transmitting apparatus for long-distance graphic signal and touch-input signal |
-
2016
- 2016-03-14 KR KR1020160030050A patent/KR101786840B1/en active IP Right Grant
- 2016-07-19 CN CN201610574692.XA patent/CN106937036B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2551172Y (en) * | 2002-06-14 | 2003-05-21 | 台群科技股份有限公司 | Endoscope with infrared ray |
EP2245980A2 (en) * | 2009-04-28 | 2010-11-03 | FUJIFILM Corporation | Endoscope system, encoscope, and driving method |
CN102258359A (en) * | 2010-05-31 | 2011-11-30 | 奥林巴斯株式会社 | Endoscope system |
US20120016202A1 (en) * | 2010-07-15 | 2012-01-19 | Eckart Baum | Endoscopic Instrument |
CN102440753A (en) * | 2010-09-30 | 2012-05-09 | 奥林巴斯株式会社 | Endoscope system |
CN103300812A (en) * | 2013-06-27 | 2013-09-18 | 中国科学院自动化研究所 | Endoscope-based multispectral video navigation system and method |
CN103705201A (en) * | 2014-01-16 | 2014-04-09 | 福建师范大学 | Multimode spectrum analysis system suitable for detecting alimentary canal pathologic changes |
CN205864558U (en) * | 2015-12-29 | 2017-01-04 | 因德斯马特有限公司 | Image data transmits equipment and includes that image data transmits the endoscopic system of equipment |
Also Published As
Publication number | Publication date |
---|---|
CN106937036B (en) | 2020-10-30 |
KR101786840B1 (en) | 2017-10-18 |
KR20170078489A (en) | 2017-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN205864558U (en) | Image data transmits equipment and includes that image data transmits the endoscopic system of equipment | |
CN106937036A (en) | Image data transmission equipment and the endoscopic system including image data transmission equipment | |
TWI325698B (en) | ||
CN101727873B (en) | Signal conversion apparatuses and display system | |
CN109036262B (en) | Display characteristic curve correction method and control system of medical LED display screen | |
CN205758502U (en) | Endoscopic apparatus | |
KR20150059085A (en) | Head-Mounted Display Apparatus | |
US11500804B2 (en) | Method for transmitting control instruction, transmitting device, and receiving device | |
CN106264429B (en) | Endoscopic apparatus | |
CN109994281A (en) | A kind of AOC cable of the compatible multiplex roles of energy | |
WO2009099606A2 (en) | System for combining high-definition video control signals for transmission over an optical fiber | |
CN205356560U (en) | Oral cavity image system | |
CN204795430U (en) | HDMI audio and video signal transmission device with mirror image switch function | |
CN217116260U (en) | Optical fiber transmission system | |
CN108881877B (en) | Display processing device, display processing method thereof and display device | |
CN103391406B (en) | A kind of video switch circuit and changing method thereof | |
CN217116261U (en) | Optical fiber matrix device | |
CN217116262U (en) | Optical fiber transmission system | |
TW202011888A (en) | Integrated endoscope and visualization system | |
CN215383848U (en) | Image sensor data transmission device of 3D endoscope and 3D endoscope | |
US20230053020A1 (en) | Optical transmission system and optical matrix | |
CN204863064U (en) | A signaling conversion circuit for medical endoscope | |
CN114071030A (en) | Double-channel combined system of endoscope | |
WO2022087823A1 (en) | Endoscope photographing system and image data transmission apparatus therefor | |
KR100522606B1 (en) | Digital AV system having a structure for performing an additional function easily |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |