CN108175522A - A kind of wear-type three-dimensional electronic operating microscope system - Google Patents
A kind of wear-type three-dimensional electronic operating microscope system Download PDFInfo
- Publication number
- CN108175522A CN108175522A CN201711396574.5A CN201711396574A CN108175522A CN 108175522 A CN108175522 A CN 108175522A CN 201711396574 A CN201711396574 A CN 201711396574A CN 108175522 A CN108175522 A CN 108175522A
- Authority
- CN
- China
- Prior art keywords
- image processing
- fpga
- way
- video
- cmos sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/20—Surgical microscopes characterised by non-optical aspects
Abstract
A kind of wear-type three-dimensional electronic operating microscope system, including FPGA image processing boards, FPGA image processing board input terminals have two-way input, the one routing left camera lens of Stereo microscope is connect by the cmos sensor A built in it with FPGA image processing board input terminals A, and cmos sensor B of the another way as built in the right camera lens of Stereo microscope by it is connect with FPGA image processing board input terminals B；FPGA image processing board output terminals divide two-way to export, and are connect all the way by HDMI with 3D display device, and another way is connect by multichannel HDMI with VR displays.The present invention allows one to clearly indicate three-dimensional image by helmet-type display system, imaging effect clearly, and shows that speed can reach real-time effect by software and hardware combining and optical mode.
Description
Technical field
The invention belongs to technical field of medical equipment, more particularly to a kind of wear-type three-dimensional electronic operating microscope system.
Background technology
Microscope be it is a kind of formed optical instrument is combined by lens or poly-lens, for being zoomed into small items
As.For plane stereomicroscope through years development, many technologies are highly developed, but be observation sample can only be Vertical Squares
To, it is impossible to from multi-angle observation sample.Microsurgery is the important component of modern surgery operation, and microsurgery is (including ear
Section, ophthalmology, neurosurgery and plastic surgery etc.) key equipment be surgical operation microscope, patient has to pass through professional training, it is desirable that
Long-time gland position is closely aligned and stares eyepiece progress micromanipulation, this not only makes operator easily tired, also often makes
It strains into cervical vertebra.
Traditional 3D surgical operation microscopes function is single, is only suitable for human eye and directly observes object by microscopical optical eyepiece, exists
Following technological deficiency：The microscopical flexibility ratio is relatively low, and for doctor during performing an operation for a long time, posture cannot do big tune
It is whole, it is elongated to do primary operation and need to spend two or three hours, it is unfavorable for very much the health of doctor in this way.
Traditional operation microscope is typically only capable to a people or two people watch simultaneously, and there are following technological deficiencies：It is required that
The doctor to perform an operation will have rich experience, and for incoming doctor, it is not within the foreseeable future to observe true case；In information
Today of generation rapid development, information propagates particularly important, carrier of the internet as maximum, will be doctor if be not used
Treat a big loss on boundary.
Invention content
The purpose of the present invention will solve above-mentioned technical problem.
The object of the present invention is achieved like this：A kind of wear-type three-dimensional electronic operating microscope system is schemed including FPGA
As processing board, it is characterised in that：The FPGA image processing board input terminals have two-way input, a routing left mirror of Stereo microscope
Head is connect by the cmos sensor A built in it with FPGA image processing board input terminals A, and another way is by the right camera lens of Stereo microscope
It is connect by the cmos sensor B built in it with FPGA image processing board input terminals B；
FPGA image processing board output terminals divide two-way to export, and are connect all the way by HDMI with 3D display device, another way passes through multichannel
HDMI is connect with VR displays.
Cmos sensor A, the cmos sensor B is adopted using the high definition CMOS chip of 2,000,000 pixel of two-way and
With the configuration protocol of SCCB, and built-in PLL phaselocked loops, the control clock of stringent precisely phase, acquisition operation can be generated
Achieve the purpose that high-speed, high precision during image in microscope ocular.
Cmos sensor A, the cmos sensor B by LVDS signals by video signal transmission to FPGA images at
Manage the processing module of plate；First to CMOS, collected BAYER format-patterns carry out image to the fpga chip of FPGA image processing boards
Early period is handled, while processing is synchronized to the clock control signal of two-path video, ensures that two-path video exports video simultaneously.
Image synthesis central processing unit is provided on the FPGA image processing boards, image synthesizes central processing unit by regarding
3 frequency decoder module, video processing module, data transmission module module compositions, wherein, Video decoding module is used to implement to double
The synchronous acquisition of video camera forms stereo pairs；Video processing module then using FPGA concurrency counting system structure and
Its rational the pipeline design realizes the parallel algorithm of stereoscopic vision；Data transmission module then linearly happens suddenly by pci bus
The characteristics of transmission, to realize the high-speed transfer of data.
The present invention solves that traditional display area is small, and doctor is easily tired, it is impossible to the problem of more people learn simultaneously；Pass through
VR display systems or 3D display device project large screen, facilitate doctor and staff's viewing, alleviate doctor and perform an operation
When fatigue, doctor can preferably observe the wound of patient, improve the success rate of operation；Recording function of taking pictures is added, side
Just doctor analyzes and researches the deficiency in operation after surgery, draws on the experience for later surgical work, which can also do adult education
Case is learned, strengthens the propagation learning and exchange of medical knowledge；The real-time display of video streams of energy, solves traditional DSP algorithm and leads
The video effect of the high delay of cause, the Experience Degree of client is good, and promoting and applying has good economic and social benefit.
Description of the drawings
Fig. 1 is the structure diagram of the present invention.
Fig. 2 is the 3D image-forming principle schematic diagrames of the present invention.
Specific embodiment
The invention will be further described below in conjunction with the accompanying drawings, but not as limitation of the present invention：
A kind of wear-type three-dimensional electronic operating microscope system, including FPGA image processing boards, it is characterised in that：The FPGA
Image processing board input terminal has a two-way input, a routing left camera lens of Stereo microscope by the cmos sensor A built in it with
FPGA image processing board input terminal A connections, cmos sensor B of the another way as built in the right camera lens of Stereo microscope by it with
FPGA image processing board input terminal B connections；FPGA image processing board output terminals divide two-way to export, and pass through HDMI and 3D display all the way
Device connects, and another way is connect by multichannel HDMI with VR displays；Cmos sensor A, the cmos sensor B uses two
The high definition CMOS chip of 2,000,000 pixel of road and the configuration protocol for using SCCB, and built-in PLL phaselocked loops, can generate
The control clock of stringent precisely phase, achievees the purpose that high-speed, high precision when acquiring the image in surgical operation microscope eyepiece；It is described
Cmos sensor A, cmos sensor B by LVDS signals by video signal transmission to the processing mould of FPGA image processing boards
Block；First to CMOS, collected BAYER format-patterns carry out image processing early period to the fpga chip of FPGA image processing boards, simultaneously
Processing is synchronized to the clock control signal of two-path video, ensures that two-path video exports video simultaneously；The FPGA images
Image synthesis central processing unit is provided in processing board, image synthesizes central processing unit and handles mould by Video decoding module, video
3 block, data transmission module module compositions, wherein, Video decoding module is used to implement the synchronous acquisition to twin camera, is formed
Stereo pairs；Video processing module is then using the concurrency counting system structure of FPGA and its rational the pipeline design come real
The parallel algorithm of existing stereoscopic vision；Data transmission module then by pci bus linear burst transfer the characteristics of, to realize data
High-speed transfer.
The present invention uses following technical scheme：1）Using the high definition CMOS chip of 2,000,000 pixel of two-way（OV companies
OV7620 cmos image sensors）, which uses the configuration protocol of SCCB, and built-in PLL phaselocked loops can generate
The control clock of stringent precisely phase, achievees the purpose that high-speed, high precision when acquiring the image in surgical operation microscope eyepiece；
2）CMOS chip gives video signal transmission to FPGA image processing modules by LVDS signals；Fpga chip uses Xilinx
The Spartan-6 LX45 of company, first to CMOS, collected BAYER format-patterns carry out image processing early period, including putting down in vain
The processing such as weighing apparatus, automatic exposure, gamma adjustment, noise reduction, sharpening, LSC.In addition, since there are two-way videos, it is therefore necessary to right
The clock control signal of two-path video synchronizes processing, ensures that two-path video exports video simultaneously；
3）Incoming image synthesis central processing unit, after carrying out 3D synthesis processing to two-way image, to figure in image processing process
The size of picture has done further amplification, facilitates observation, specifically can be divided into Video decoding module by function, video handles mould
3 block, data transmission module modules；Wherein, Video decoding module is used to implement the synchronous acquisition to twin camera, is formed three-dimensional
Image pair；Video processing module is then vertical to realize using the concurrency counting system structure of FPGA and its rational the pipeline design
The parallel algorithm of body vision；Data transmission module then by pci bus linear burst transfer the characteristics of, to realize the high speed of data
Transmission；
4）Throwing is shown in 3D high-clear displays or the 3D display helmet, what clarity was seen no less than traditional operation microscope.
When it is implemented, the present invention has several technical essentials：
1）, ensure 2 CMOS cameras acquisition image synchronizations, when the present invention is the PCLK by fpga chip synchronization dual camera
Clock so as to ensure that camera image output synchronizes, is simplified through SDRAM come the method for synchronization video stream；
2）, image correction process, will not be again on same horizontal plane, then must since camera is due to installing and assemble
Image that object is imaged on 2 CMOS chips can so be led to not in one plane, then will go out on synthesis 3D rendering
Existing deviation, how to handle is a problem；The present invention is to handle this skill by the method for affine projection and Feature Points Matching
Art problem, the parameter demarcated by this method has good robustness；
3）, the real-time 3D rendering of synthesis and be shown to 3D display device, the present invention is also polarization type 3D skills using general polarization type 3D technology
Art, the 3D display device from the point of view of being passive type polaroid glasses being used cooperatively；The image effect colorimetric differential of general polarization type 3D technology is good, eye
Mirror cost is also not very high；It is such technology that more cinema, which uses, at present；Polarization type 3D is that have that " direction of vibration shakes using light
The principle in dynamic direction " decomposes beginning image, first divides the image into two a series of paintings face of orthogonal polarized light and horizontal polarization light, then 3D
The polarized lenses that the polarized lenses direction of different directions is respectively adopted in mirror or so are received, and the right and left eyes of such people can just receive
Two a series of paintings faces synthesize 3D rendering, the 3D videos of the invention using left-right format using brain；
4）, project in the 3D display helmet, using new display methods, in FPGA image processing modules, left and right two-way is rectified
Video just is divided into 2 tunnel HDMI video streams, is separately input in LCOS display, forms stereoscopic vision, and stereoscopic vision is formed
The rectification effect of effect and FPGA image processing modules has a certain impact.
The present invention is on the basis of traditional operation is microscopical, adds two-way CMOS chip, increases cmos image sensing
Device and 3D display device carry out photoelectricity acquisition, then by FPGA to acquisition by CMOS chip to the image in microscope ocular
Image carry out synthesis processing, later will be in the image projection of synthesis to 3D display screen.
The present invention solves that traditional display area is small, and doctor is easily tired, it is impossible to the problem of more people learn simultaneously；Pass through
VR display systems or 3D display device project large screen, and doctor and staff is facilitated to watch, and mitigate when doctor performs an operation
Fatigue, doctor can preferably observe the wound of patient, improve the success rate of operation；The present invention increases recording function of taking pictures, side
Just doctor analyzes and researches the deficiency in operation after surgery, draws on the experience for later surgical work, which can also do adult education
Case is learned, strengthens the propagation learning and exchange of medical knowledge.
The present invention is handled using dedicated FPGA image processing systems plus image software, reduces 3D effect well,
Image can not only be shown on 3D TVs or display, moreover it is possible to show image on VR displays；Simultaneously as using FPGA
High-speed parallel image processing algorithm, can real-time display of video streams, image delay is effectively controlled 100ms or so, solves
The video effect of high delay caused by traditional DSP algorithm.
The above embodiment of the present invention is only to clearly demonstrate examples of the invention, but be not limited to this hair
Bright protection domain, all equivalent technical solutions also belong to scope of the invention, and scope of patent protection of the invention should be by each
Item claim limits.
Claims (4)
1. a kind of wear-type three-dimensional electronic operating microscope system, including FPGA image processing boards, it is characterised in that：Described
FPGA image processing board input terminals have two-way input, and a routing left camera lens of Stereo microscope passes through the cmos sensor A built in it
Connect with FPGA image processing board input terminals A, cmos sensor B of the another way as built in the right camera lens of Stereo microscope by it with
FPGA image processing board input terminal B connections；
FPGA image processing board output terminals divide two-way to export, and are connect all the way by HDMI with 3D display device, another way passes through multichannel
HDMI is connect with VR displays.
2. a kind of wear-type three-dimensional electronic operating microscope system according to claim 1, it is characterised in that：Described
Cmos sensor A, cmos sensor B are using the high definition CMOS chip of 2,000,000 pixel of two-way and are assisted using the configuration of SCCB
View, and built-in PLL phaselocked loops, can generate the control clock of stringent precisely phase, acquire in surgical operation microscope eyepiece
Achieve the purpose that high-speed, high precision during image.
3. a kind of wear-type three-dimensional electronic operating microscope system according to claim 1, it is characterised in that：Described
Cmos sensor A, cmos sensor B are by LVDS signals by video signal transmission to the processing mould of FPGA image processing boards
Block；First to CMOS, collected BAYER format-patterns carry out image processing early period to the fpga chip of FPGA image processing boards, simultaneously
Processing is synchronized to the clock control signal of two-path video, ensures that two-path video exports video simultaneously.
4. a kind of wear-type three-dimensional electronic operating microscope system according to claim 3, it is characterised in that：Described
Be provided on FPGA image processing boards image synthesis central processing unit, image synthesize central processing unit by Video decoding module, regard
3 frequency processing module, data transmission module module compositions, wherein, Video decoding module is used to implement the synchronization to twin camera
Acquisition forms stereo pairs；Video processing module then utilizes the concurrency counting system structure of FPGA and its rational flowing water
Line designs the parallel algorithm to realize stereoscopic vision；Data transmission module then by pci bus linear burst transfer the characteristics of, with
Realize the high-speed transfer of data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711396574.5A CN108175522A (en) | 2017-12-21 | 2017-12-21 | A kind of wear-type three-dimensional electronic operating microscope system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711396574.5A CN108175522A (en) | 2017-12-21 | 2017-12-21 | A kind of wear-type three-dimensional electronic operating microscope system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108175522A true CN108175522A (en) | 2018-06-19 |
Family
ID=62546945
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711396574.5A Withdrawn CN108175522A (en) | 2017-12-21 | 2017-12-21 | A kind of wear-type three-dimensional electronic operating microscope system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108175522A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109285413A (en) * | 2018-12-10 | 2019-01-29 | 福州大学 | A kind of biomicroscope three-dimensional emulation method based on VR |
| CN109521556A (en) * | 2018-12-07 | 2019-03-26 | 歌尔科技有限公司 | A kind of electron microscopic wearable device |
| CN110687669A (en) * | 2019-11-13 | 2020-01-14 | 深圳市新致维科技有限公司 | Tracking type naked eye 3D display system and method based on body type microscope |
| WO2022170928A1 (en) * | 2021-02-10 | 2022-08-18 | 苏州速迈医学科技股份有限公司 | Dental microscopic diagnosis and treatment system |
-
2017
- 2017-12-21 CN CN201711396574.5A patent/CN108175522A/en not_active Withdrawn
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109521556A (en) * | 2018-12-07 | 2019-03-26 | 歌尔科技有限公司 | A kind of electron microscopic wearable device |
| CN109285413A (en) * | 2018-12-10 | 2019-01-29 | 福州大学 | A kind of biomicroscope three-dimensional emulation method based on VR |
| CN110687669A (en) * | 2019-11-13 | 2020-01-14 | 深圳市新致维科技有限公司 | Tracking type naked eye 3D display system and method based on body type microscope |
| WO2022170928A1 (en) * | 2021-02-10 | 2022-08-18 | 苏州速迈医学科技股份有限公司 | Dental microscopic diagnosis and treatment system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2177051C (en) | Synthesized stereoscopic imaging system and method | |
| CN108175522A (en) | A kind of wear-type three-dimensional electronic operating microscope system | |
| US9389409B2 (en) | Imaging system for digital stereo microscope | |
| US9699438B2 (en) | 3D graphic insertion for live action stereoscopic video | |
| WO2017173735A1 (en) | Video see-through-based smart eyeglasses system and see-through method thereof | |
| CN201804154U (en) | Three-dimensional viewing device of stereoscopic microscope | |
| CN101518438A (en) | Binocular endoscope operation visual system | |
| WO2016045425A1 (en) | Two-viewpoint stereoscopic image synthesizing method and system | |
| CN106406016A (en) | Three-dimensional imaging device, three-dimensional imaging system and three-dimensional imaging method | |
| US20110254918A1 (en) | Stereoscopic system, and image processing apparatus and method for enhancing perceived depth in stereoscopic images | |
| CN109428987A (en) | A kind of 360 degree of stereo photographic devices of wear-type panorama and image pickup processing method | |
| Gilson et al. | High fidelity immersive virtual reality | |
| Kwon et al. | High-definition 3D stereoscopic microscope display system for biomedical applications | |
| CN102525396A (en) | Three-dimensional laparoscope | |
| Kim et al. | See-through type 3D head-mounted display–based surgical microscope system for microsurgery: a feasibility study | |
| US10330945B2 (en) | Medical image display apparatus, medical information processing system, and medical image display control method | |
| US10855980B2 (en) | Medical-image display control device, medical image display device, medical-information processing system, and medical-image display control method | |
| CN202891888U (en) | Stereoplasm multichannel three dimensional (3D) arthroscope system | |
| CN103767667A (en) | Hard multichannel three-dimensional gallbladder endoscope system | |
| WO2021090335A1 (en) | An apparatus for a real time 3d view of an operating site | |
| CN202891884U (en) | Stereoplasm multichannel three dimensional (3D) anorectum mirror system | |
| JP3913076B2 (en) | Image composition processing device | |
| Baier et al. | Interactive stereo vision telepresence for correct communication of spatial geometry | |
| Song et al. | Design of the computerized 3D endoscopic imaging system for delicate endoscopic surgery | |
| WO2023137808A1 (en) | Visual enhancement intelligent wearable device and method for realizing three-dimensional visual transposition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180619 |
|
| WW01 | Invention patent application withdrawn after publication |