CN211979318U - Augmented reality module for microscope and microscope comprising same - Google Patents

Augmented reality module for microscope and microscope comprising same Download PDF

Info

Publication number
CN211979318U
CN211979318U CN201922261856.5U CN201922261856U CN211979318U CN 211979318 U CN211979318 U CN 211979318U CN 201922261856 U CN201922261856 U CN 201922261856U CN 211979318 U CN211979318 U CN 211979318U
Authority
CN
China
Prior art keywords
unit
image
augmented reality
microscope
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201922261856.5U
Other languages
Chinese (zh)
Inventor
余江胜
刘秀丽
刘晓翔
李宁
谢峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huaiguang Intelligent Technology Wuhan Co ltd
Original Assignee
Huaiguang Intelligent Technology Wuhan Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huaiguang Intelligent Technology Wuhan Co ltd filed Critical Huaiguang Intelligent Technology Wuhan Co ltd
Priority to CN201922261856.5U priority Critical patent/CN211979318U/en
Application granted granted Critical
Publication of CN211979318U publication Critical patent/CN211979318U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The utility model discloses an augmented reality module for a microscope and a microscope comprising the same, which relate to the technical field of microscope imaging and provide a scheme aiming at the problem of low definition of the existing microscope without auxiliary film reading, wherein the augmented reality module comprises an image acquisition unit, an image analysis unit and an augmented reality unit which are electrically connected in sequence; the image acquisition unit is used for acquiring image information amplified in the microscope in real time and transmitting the acquired image information to the image analysis unit; the image analysis unit is used for receiving the image information acquired by the image acquisition unit in real time, analyzing and calculating the image information and transmitting an image result obtained by analyzing and calculating to the augmented reality unit; and the augmented reality unit is used for adding one path of display light path and introducing the display light path into the microscope. The utility model discloses observe the sample through the eyepiece and can acquire high definition in the microscope that contains above-mentioned augmented reality module.

Description

Augmented reality module for microscope and microscope comprising same
Technical Field
The utility model relates to a microscope imaging technology field especially relates to a microscope that is used for microscopical augmented reality module and contains this module.
Background
Most pathological analysis equipment on the market at present digitizes pathological sample data into a local storage or a cloud disk in a scanning imaging mode, and medical staff directly views digitized pathological sample images through a screen. However, most pathological sample images are acquired by image acquisition equipment such as a CCD, a CMOS and the like, and the sampling rate is far lower than that of human eyes. Generally, the image sharpness observed directly through the eyepiece is much higher than the digitized image obtained using scanning imaging. Therefore, direct observation of pathological samples using an eyepiece can increase accuracy.
Many pathological analysis scanning imaging devices on the market currently have not only the function of digitally storing images, but also the function of automatically analyzing digitized images, such as the frame selection and discrimination of cancer cells, and although the devices can well assist medical staff in reading and diagnosing, the results must be displayed on the digitized images, but cannot be displayed under the direct observation of an eyepiece. As such, medical personnel using the eyepiece to directly view the sample and using an auxiliary digital film reading system create a conflict.
In addition, most hospitals and all scientific research units do not have the scanning auxiliary analysis function, if a scanner with auxiliary film reading is purchased, the use habits of the existing medical staff and researchers are not met, the high definition can not be obtained by directly observing a sample through an ocular lens instead of human eyes, and the price is high.
SUMMERY OF THE UTILITY MODEL
In order to achieve the above purpose, the utility model adopts the following technical scheme:
an augmented reality module for a microscope comprises an image acquisition unit, an image analysis unit and an augmented reality unit, wherein the image acquisition unit, the image analysis unit and the augmented reality unit are electrically connected in sequence;
the image acquisition unit is used for acquiring image information amplified in the microscope in real time and transmitting the acquired image information to the image analysis unit;
the image analysis unit is used for receiving the image information acquired by the image acquisition unit in real time, analyzing and calculating the image information and transmitting the image result of the analysis and calculation to the augmented reality unit;
the augmented reality unit is used for adding a display light path and introducing the display light path into the microscope, wherein the display light path comprises an image result obtained by analyzing and calculating through the image analysis unit and displaying and marking information.
Preferably, the augmented reality unit includes second lens, first spectroscope, display element, the second lens sets up between first spectroscope and display element, the display element for the image result that the analysis of display image analysis unit was calculated to will contain and show and mark information passes through the display light path of the image result that the analysis of image analysis unit was calculated and projects the second lens, first spectroscope, be used for will project the second lens show the light path introduce the microscope in, finally project on human retina.
Preferably, the image analysis unit is one of an artificial intelligence computer, an embedded device with a calculation function, or a programmable logic controller, the image acquisition unit is a CCD camera or a CMOS camera, the display unit is a projector or an LCD, LED display, and the image analysis unit is electrically connected to the image acquisition unit through a first interface and electrically connected to the display unit through a second interface.
Preferably, the augmented reality unit still includes light path switching pull rod, eyepiece sleeve link, microscope link, the light path switching pull rod sets up in one side of augmented reality unit for the direction of control display light path, the eyepiece sleeve link sets up in the top of augmented reality unit, the microscope link sets up in the bottom of augmented reality unit.
A second object of the utility model is to provide a contain above-mentioned microscope that is used for microscopical augmented reality module, be in including first lens, eyepiece, setting the eyepiece with augmented reality unit, image acquisition unit and image analysis unit between the first lens, image acquisition unit set up in the top of augmented reality unit, the augmented reality unit includes first spectroscope and second lens and display element, the display element is located the top of first lens.
The image acquisition unit acquires image information amplified by a first lens of the microscope in real time and transmits the acquired image information to the image analysis unit, the image analysis unit receives the image information acquired by the image acquisition unit and analyzes and calculates the image information, and transmits an image result analyzed and calculated to the augmented reality unit, a display unit in the augmented reality unit displays an image result obtained by analyzing and calculating the image analysis unit, a display light path containing display and mark information and obtained by analyzing and calculating the image result by the image analysis unit is projected to the second lens, and the display light path is introduced to an eyepiece of the microscope through the first spectroscope and finally projected to a retina of a human body.
Preferably, the microscope comprising the augmented reality module for a microscope described above obtains two optical paths: the first lens, the first spectroscope and the eyepiece form a visual observation light path; the first lens, the image acquisition unit, the display unit, the second lens, the first spectroscope and the eyepiece constitute a display light path.
The utility model has the advantages that:
the utility model relates to an augmented reality module that can adorn on general microscope and contain the microscope of this module, when medical staff satisfies the microscope of general area eyepiece barrel and can observe the sample through the eyepiece, increase and show the light path all the way, make medical staff can not only see the beneath sample content of first lens, can see the mark light path simultaneously, both combine to constitute an augmented reality microscope, need not to change the scanner that has supplementary reading piece with current microscope, both accord with current medical staff and researcher's use custom, can acquire the high definition through eyepiece direct observation sample again.
Drawings
FIG. 1 is a bottom view of an augmented reality unit in an augmented reality module for a microscope;
FIG. 2 is a perspective block diagram of an augmented reality unit for use in an augmented reality module of a microscope;
FIG. 3 is a schematic flow diagram of an augmented reality module for a microscope;
FIG. 4 is a schematic optical path diagram of a microscope including an augmented reality module for the microscope;
fig. 5 is a schematic diagram of a microscope including an augmented reality module for the microscope.
Reference numbers in the figures: 1. a microscope; 2. an image acquisition unit; 3. an image analysis unit; 4. an augmented reality unit; 11. a first lens (objective lens); 12. a second lens; 13. a third lens; 14. an eyepiece; 15. a first beam splitter; 16. a second spectroscope; 17. a first interface; 18. A second interface; 40. a display unit; 51. an optical path switching pull rod; 52. a lens cone connecting frame; 53. microscope link.
Detailed Description
The technical solutions in the embodiments of the present invention will be described clearly and completely with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments.
Referring to fig. 1-5, the present invention provides an augmented reality module for a microscope, comprising: the microscope comprises an image acquisition unit 2, an image analysis unit 3 and an augmented reality unit 4, wherein the image acquisition unit 2, the image analysis unit 3 and the augmented reality unit 4 are sequentially and electrically connected, the image acquisition unit 2 is used for acquiring image information amplified in the microscope 1 in real time and transmitting the acquired image information to the image analysis unit 3, and the image analysis unit 3 is used for receiving the image information acquired by the image acquisition unit 2 in real time, analyzing and calculating the image information and transmitting an image result of the analysis and calculation to the augmented reality unit 4; and the augmented reality unit 4 is used for adding a display light path and introducing the display light path into the microscope 1, wherein the display light path comprises an image result obtained by analyzing and calculating through the image analysis unit 3 and displaying and marking information.
The image acquisition unit 2 acquires image information amplified in the microscope 1 and transmits the acquired image information to the image analysis unit 3, the image analysis unit 3 receives the image information acquired by the image acquisition unit 2, analyzes and calculates the image information, and transmits an image result obtained by analyzing and calculating the image information to the augmented reality unit 4, the augmented reality unit 4 displays the image result obtained by analyzing and calculating the image analysis unit 3, and projects a display light path containing display and mark information and the image result obtained by analyzing and calculating the image analysis unit 3 into the microscope 1 and finally onto the retina of a human body.
The augmented reality unit 4 comprises a display unit 40, a second lens 12, a first spectroscope 15, the display unit 40 is used for displaying the image result obtained by the analysis and calculation of the image analysis unit 3, projecting the display light path of the image result obtained by the analysis and calculation of the image analysis unit 3 and containing display and mark to the second lens 12, then leading the display light path projected to the second lens 12 to the third lens 13 of the microscope 1 by the first spectroscope 15, then leading the second spectroscope 16 to the ocular lens 14, and finally projecting the display light path to the retina of a human body, the augmented reality unit 4 further comprises a light path switching pull rod 51, a eyepiece sleeve connecting frame 52 and a microscope connecting frame 53, the light path switching pull rod 51 is arranged at one side of the augmented reality unit 4 and used for controlling the direction of the display light path, the eyepiece sleeve connecting frame 52 is arranged at the top of the augmented reality unit 4, the microscope connecting frame 53 is used for fixedly connecting the augmented reality unit 4 with the trinocular lens barrel, is arranged at the bottom of the augmented reality unit 4, and is used for fixedly connecting the augmented reality unit 4 on the microscope 1.
According to an embodiment of the present invention, the above augmented reality module for a microscope is installed and applied to a microscope having a three-eye lens barrel through a microscope connecting frame 53, and the three-eye lens barrel is fixedly connected through a three-eye lens barrel connecting frame 52, the whole microscope 1 includes a first lens 11, an eyepiece 14, a third lens 13, a second spectroscope 16, an image collecting unit 2, an image analyzing unit 3, a display unit 40, a second lens 12, and a first spectroscope 15, the first spectroscope 15 is disposed above the first lens 11 for separating a light beam passing through the first lens 11 and introducing a display light path into a main light path of the microscope, the third lens 13 is disposed between the first spectroscope 15 and the first spectroscope 16 for projecting the light beam passing through the first lens 11 and separated by the first spectroscope 15 onto the first spectroscope 16, the first spectroscope 15 and the first spectroscope 16 are both disposed between the first lens 11 and the eyepiece 14, the device comprises an image acquisition unit 2, an image analysis unit 3, a display unit 40, a CCD camera or a CMOS camera, a first spectroscope 16, a CCD imaging unit 2, an image analysis unit 3, a projector or an LCD, wherein the image acquisition unit 2 is arranged above the first spectroscope 16 and used for acquiring a split beam generated by an enlarged image of an observed object through a split path generated by the first spectroscope 15 and the first spectroscope 16, the image analysis unit 3 is one of a computer adopting artificial intelligence, an embedded device with a calculation function or a programmable logic controller and used for analyzing and calculating the image information transmitted by the image acquisition unit 2, the image analysis unit 3 obtains an image result and display and marking information after the image result is identified through analysis and calculation, the image analysis unit 3 transmits the result to the display unit 40, and the display unit 40 is a projector or an LCD, And the LED display is used for displaying the image result and the display and mark information which are obtained after the calculation and analysis of the image analysis unit 3, projecting the display optical path containing the image result obtained by the analysis and calculation of the image analysis unit 3 and the display and mark information to the main optical path of the microscope through the first spectroscope 15, then sequentially passing through the third lens 13, the second spectroscope 16 and the eyepiece 14, and finally projecting the display optical path to the retina of the human body.
The augmented reality module for the microscope is applied to a microscope with a three-eye lens cone to obtain two optical paths which are respectively visual observation optical paths sequentially formed by a first lens 11, a first spectroscope 15, a third lens 13, a second spectroscope 16 and an eyepiece 14; the display optical path is composed of a first lens 11, a third lens 13, a second spectroscope 16, an image acquisition unit 2, an image analysis unit 3, a display unit 4, a second lens 12, a first spectroscope 15, a third lens 13, a second spectroscope 16 and an eyepiece 14 in sequence.
In one embodiment of the present invention, the image analysis unit 3 is electrically connected to the image acquisition unit 2 through the first interface 17, and is electrically connected to the display unit 40 through the second interface 18, so as to separate and project part of the light beam imaged by the first lens 11 from the visual observation light path to the image acquisition unit 2, then the acquired image information is transmitted to the image analysis unit 3 through the first interface 17 (including but not limited to USB, ISANet, Mipi, etc.) for analysis and processing, and the image result and the display and mark information after artificial intelligence identification are obtained, these image result and display and mark information are outputted to the display unit 40 in the augmented reality unit 4 through the second interface 18 for display, then the display unit 40 projects the display light path containing the image result obtained by analysis and calculation of the display and mark information and image analysis unit 3 to the second lens 12, then the image is led into a second spectroscope 16 through a first spectroscope 15 and then projected to an ocular 14, the projected image and the image directly imaged by the microscope (the image generated by a visual observation optical path) are completely overlapped on the focal plane of the ocular 14, and the size and the position of the two images are completely consistent.
The above, only be the concrete implementation of the preferred embodiment of the present invention, but the protection scope of the present invention is not limited thereto, and any person skilled in the art is in the technical scope of the present invention, according to the technical solution of the present invention and the utility model, the concept of which is equivalent to replace or change, should be covered within the protection scope of the present invention.

Claims (6)

1. The augmented reality module for the microscope is characterized by comprising an image acquisition unit (2), an image analysis unit (3) and an augmented reality unit (4), wherein the image acquisition unit (2), the image analysis unit (3) and the augmented reality unit (4) are electrically connected in sequence;
the image acquisition unit (2) is used for acquiring image information in the microscope (1) in real time and transmitting the acquired image information to the image analysis unit (3);
the image analysis unit (3) is used for receiving the image information acquired by the image acquisition unit (2) in real time, analyzing and calculating the image information, and transmitting the image result of the analysis and calculation to the augmented reality unit (4);
the augmented reality unit (4) is used for adding a path of display light path and introducing the display light path into the microscope (1), and the display light path comprises an image result obtained by analyzing and calculating through the image analysis unit (3) and displaying and marking information.
2. Augmented reality module for a microscope according to claim 1, wherein the augmented reality unit (4) comprises a second lens (12), a first beam splitter (15), and a display unit (40), the second lens (12) is arranged between the first beam splitter (15) and the display unit (40), the display unit (40) is configured to display the image result analyzed and calculated by the image analysis unit (3), and project a display optical path of the image result analyzed and calculated by the image analysis unit (3) and including display and mark information to the second lens (12), the first beam splitter (15) and the second lens (12) for introducing the display optical path projected to the second lens (12) into the microscope (1) and finally projecting to the retina of a human body.
3. Augmented reality module for a microscope according to claim 2, wherein the image analysis unit (3) is one of a computer using artificial intelligence, an embedded device with computing functionality or a programmable logic controller, the image acquisition unit (2) is a CCD camera or a CMOS camera, the display unit (40) is a projector or an LCD, LED display, the image analysis unit (3) is electrically interconnected with the image acquisition unit (2) through a first interface (17) and with the display unit (40) through a second interface (18).
4. The augmented reality module of claim 1, wherein the augmented reality unit (4) further comprises a light path switching pull rod (51), a eyepiece barrel connecting frame (52) and a microscope connecting frame (53), the light path switching pull rod (51) is arranged at one side of the augmented reality unit (4) and used for controlling the direction of the display light path, the eyepiece barrel connecting frame (52) is arranged at the top of the augmented reality unit (4), and the microscope connecting frame (53) is arranged at the bottom of the augmented reality unit (4).
5. A microscope comprising an augmented reality module for a microscope according to any one of claims 1 to 4, wherein the microscope (1) comprises a first lens (11), an eyepiece (14), an augmented reality unit (4) arranged between the eyepiece (14) and the first lens (11), an image acquisition unit (2) and an image analysis unit (3), the image acquisition unit (2) being arranged above the augmented reality unit (4), the augmented reality unit (4) comprising a first spectroscope (15) and a second lens (12) and a display unit (40), the display unit (40) being located above the first lens (11);
the image acquisition unit (2) acquires image information amplified by a first lens (11) of the microscope (1) in real time and transmits the acquired image information to the image analysis unit (3), the image analysis unit (3) receives the image information acquired by the image acquisition unit (2), analyzes and calculates the image information, and transmits an image result of analysis and calculation to the augmented reality unit (4), a display unit (40) in the augmented reality unit (4) displays the image result obtained by analysis and calculation of the image analysis unit (3), projects a display light path containing the image result obtained by analysis and calculation of the image analysis unit (3) and display and mark information to a second lens (12), and the display light path is introduced to an eyepiece (14) of the microscope (1) through a first spectroscope (15) and finally projects to a human retina.
6. A microscope including an augmented reality module for a microscope according to claim 5 wherein the first lens (11), the first beam splitter (15) and the eyepiece (14) form a visual observation optical path; the first lens (11), the image acquisition unit (2), the display unit (40), the second lens (12), the first spectroscope (15) and the eyepiece (14) form a display light path.
CN201922261856.5U 2019-12-17 2019-12-17 Augmented reality module for microscope and microscope comprising same Expired - Fee Related CN211979318U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201922261856.5U CN211979318U (en) 2019-12-17 2019-12-17 Augmented reality module for microscope and microscope comprising same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201922261856.5U CN211979318U (en) 2019-12-17 2019-12-17 Augmented reality module for microscope and microscope comprising same

Publications (1)

Publication Number Publication Date
CN211979318U true CN211979318U (en) 2020-11-20

Family

ID=73378163

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201922261856.5U Expired - Fee Related CN211979318U (en) 2019-12-17 2019-12-17 Augmented reality module for microscope and microscope comprising same

Country Status (1)

Country Link
CN (1) CN211979318U (en)

Similar Documents

Publication Publication Date Title
US11800980B2 (en) Augmented reality surgical microscope and microscopy method
US11636627B2 (en) System for histological examination of tissue specimens
WO2021135557A1 (en) Artificial intelligence multi-mode imaging analysis apparatus
JP2012511361A5 (en) Apparatus and image processing unit for improved infrared image processing and functional analysis of blood vessel structures such as blood vessels
US5270924A (en) Ophthalmological image processor
CN102028477B (en) Device and method for measuring blood oxygen saturation of fundus retina
CN109978015B (en) Image processing method and device and endoscope system
Wisotzky et al. Interactive and multimodal-based augmented reality for remote assistance using a digital surgical microscope
JP6893896B2 (en) Medicine-How to activate an optical display system
WO2021026948A1 (en) Optical microscope system and method capable of tracking gaze position in real time
CN103815972A (en) Automatic tracking system for operative region of laparothoracoscope and method
CN109031643A (en) A kind of augmented reality microscope
JP7253273B2 (en) Reproductive medical support system
JPWO2017043539A1 (en) Image processing system, image processing apparatus, projection apparatus, and projection method
EP3530191A1 (en) Ultrasound head combining ultrasound and optics
CN208888473U (en) A kind of augmented reality microscope
CN211979318U (en) Augmented reality module for microscope and microscope comprising same
CN109414168A (en) Optics and digital visual in surgical operation microscope
CN211484971U (en) Intelligent auxiliary system for comprehensive vision of operation
CN103479327A (en) Visual slit-lamp microscope correction device
CN207755384U (en) Can beam splitting type surgery microscope and its operation microscopic system, can remote guide and tutoring system
CN209676326U (en) A kind of gross specimen imaging device of projection image information
US20190090753A1 (en) Method, system, software, and device for remote, miiaturized, and three-dimensional imaging and analysis of human lesions research and clinical applications thereof
US11200713B2 (en) Systems and methods for enhancing vision
JP2007097635A (en) Image analysis system and image analysis program

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20201120

Termination date: 20211217

CF01 Termination of patent right due to non-payment of annual fee