WO2022097104A1

WO2022097104A1 - Digitization module for microscopes to enable sample viewing on a smart device

Info

Publication number: WO2022097104A1
Application number: PCT/IB2021/060294
Authority: WO
Inventors: Samrat SINGH; Sathyamoorthy G; Dipendra Singh BHADAURIYA; Mahesh Kumar RATHOR; Greeshma UNNIKRISHNAN; Binil JACOB
Original assignee: Singh Samrat; Sathyamoorthy G; Bhadauriya Dipendra Singh; Rathor Mahesh Kumar; Unnikrishnan Greeshma; Jacob Binil
Priority date: 2020-11-07
Filing date: 2021-11-06
Publication date: 2022-05-12

Abstract

The present invention relates to an attachment that allows smart devices to be used for digitization of trinocular microscopes. It allows the simultaneous viewing of a microscopic sample through the binocular eyepieces as well as on the display screen of a mobile phone or tablet. The area of the sample displayed on the screen will be the same as that seen thorough the eyepieces, without any reduction in the area. The attachment will also allow the screen to be rotated 360 degrees along the vertical axis. The invention comprises of an optical system comprising of prisms to bend the light rays, mechanical assembly to host the optics, support the display holder, enable rotation of the screen and adjust the focus and a display holder assembly to align the smart device camera with the optical system for focused and stable imaging.

Description

DIGITIZATION MODULE FOR MICROSCOPES TO ENABLE SAMPLE VIEWING ON A SMART DEVICE

FIELD OF THE INVENTION:

The present invention is related to microscopes and the methods or modes of digitization of the same, without reduction in field of view.

BACKGROUND OF THE INVENTION:

Developments in medical technology has led to the digitization and automation of most medical equipment. However, the advancements in field of clinical microscopes has been few and insignificant. Microscopes are commonly used in educational, medical and research sectors. In diagnostics, microscopy is considered the gold standard due to its high sensitivity and specificity as well as affordability. Conventional microscopes are provided with monocular (single eyepiece) or binocular heads (two eyepieces) for viewing of the sample. These microscopes facilitate only viewing of the sample, but not image capture or video recording of any sort. This causes many limitations. For instance, in the diagnostic sector, it is not possible to save images of the sample based on which a particular diagnosis was made. In cases where second opinions or consultations are required, the physical sample needs to be transported, causing delay in diagnosis, and hence, treatment. Lack of digital images limits the use of analytical software which could greatly increase the accuracy and speed of diagnosis. Even in educational settings, binocular microscopes are not convenient, since only one individual can use it at a time. Hence students have to wait for their turn to look at a sample, and it is difficult for professors to point out areas of interest without looking at the sample simultaneously.

With the advent of trinocular microscopes, which are provided with an additional port to insert a camera, digitization of microscopy began. However, drawbacks in existing technology of digital microscopy cameras have prevented them from being widely used for routine diagnosis. The disadvantage in such digital microscopy cameras available in the market are that they not capable of capturing the entire field as would be seen through the binoculars. The images viewed on the screen are cropped to center, eliminating a significant area of the field, which can otherwise be viewed through the binocular. As a result, it slows down users who have to scan a large area of the sample. Another drawback often found in these cameras is that very often, especially in the case of high-resolution cameras, there is a significant lag while viewing the sample on the screen. In terms of infrastructure as well, these cameras require a computer to view, capture, edit and share the sample.

Presently, there are two types of digital microscopes available in market, i.e., USB camera over trinocular opening using C mount and Camera with integrated Display over trinocular using C mount. In the USB camera over trinocular opening using C mount, a microscope head with trinocular has a compatibility to mount reduction lens and camera. Reduction lens is mounted between trinocular opening and camera sensor. Reduction lens is used to increase the field of view of the image. The USB camera is in turn connected to a computer or a monitor. After full reduction image obtained on screen is up to 50% of the image obtained through binocular lenses.

In the Camera with integrated Display over trinocular using C mount, all components are similar to the above-mentioned setup only difference is that display, and camera sensor are integrated together and mounted over trinocular opening as shown in figure. In this type also field of view obtained is up to 50% of FOV obtained through eyepiece.

US20130100271A1 discloses A universal adapter system having a video camera mount and a digital camera mount for attaching a video camera and a digital camera to a single port of an optical observation device, such as a standard microscope, that allows for simultaneous video and digital camera imaging. An example digital camera mount includes a C-clamp attachment for attaching a standard, off-the-shelf digital camera and a sleeve attached to the adapter housing that allows use of an extendable zoom lens of the digital camera. The adapter may provide increased capabilities by use of a rotatable portion to allow positioning of the digital camera relative to the optical observation device, a parfocal zoom lens for simultaneous zoom adjustment of video and digital cameras, an auxiliary zoom lens, a fine focus adjustment for adjusting the video image independent of the digital image, a smartphone adapter, a Tone reticule and a light filter.

US20200028995A1 discloses an adapter system for mounting an image and video capturing device to an optical viewing device includes a video adapter tube, an adapter tube, a support plate and a cover. An image and video capturing device is connected to the adapter tube through a support plate affixed on the cover where the adapter tube is then connected to the video adapter tube which is further connected to an optical viewing device through an image divider beam splitter. Also, there are image rotation features which makes the adapter assembly unique and more convenient. A method is also disclosed of observing the images and videos with an optical viewing device, by using an adapter system.

US 8,842,981 B2 discloses an adapter for holding a camera lens of a smartphone, digital mobile device or other camera-bearing device in alignment with an optical instrument has an optical instrument coupler with a pair of spaced-apart clamp members, one of which is used to clamp onto an eyepiece of the optical instrument, and a camera-bearing device coupler having a device clamp member which is used to clamp the camera-bearing device so that its camera lens is in optical alignment with the clamped eyepiece of the optical instrument. A mounting plate with a camera lens slot and a linearly movable locking bracket for the optical instrument coupler enables the position of the camera lens to be adjusted in alignment with the eyepiece of the optical instrument.

In existing digital microscopes, at the trinocular opening reduction lens is used to increase the field of view. After using the most optimised reduction lens to increase field of view, the image obtained on screen is approximately 30 to 50% of the image view through binocular lenses, which prevents pathologists or experts to use this setup for routine pathology application rather it is used as only capturing device.

Reduction in FOV in both these types means that the area of the sample seen on the digital screen is much lesser than what is seen through the binocular eyepieces. Therefore, it may not be very effective in practical application. Most of the pathologists use binocular system for the routine pathology since larger field of view is necessary for them to diagnose the samples accurately and efficiently. Due to reduced FOV, digital viewing is only used for image capture, teaching, discussions, etc.

Currently to convert conventional trinocular microscopes into digital, basic components such as USB camera, C mount reduction lens, screen, computer and software are required. Consequently, the picture quality of digital image arising out of such digital microscopes depend on the camera quality. To get good image quality, it is inevitable that higher resolution cameras have to be procured, the cost of which runs into lakhs.

The present invention seeks to overcome the existing disadvantages in the prior art. By enabling digital FoV same as through the binocular, the present invention enables this microscope to be used for routine pathology as well. This is being achieved by the specially designed optical system and use of mobile phone camera which prevents reduction in the field of view. Further, the solution offered by the present invention is cost effective, as the entire cost of the digitization module is less than 50% of the cost incurred in digitization equipment and accessories available in the market.

OBJECT OF THE INVENTION:

It is an object of the present invention to provide for a digitization module for microscopes.

It is another object of the present invention to enable viewing of samples through a digitization module on a smart device.

It is yet another object of the present invention to enable real time viewing of samples on a smart device without reduction in field of view.

It is yet another object of the present invention to create an optical alignment between the optical path and the smart device, without the usage of any wired component. It is yet another object of the present invention to enable simultaneous viewing of a sample through microscope eyepieces and through the smart device screen.

SUMMARY OF THE INVENTION:

According to this invention, it provides for a digitization module (100, 100A) for a microscope, comprising a reflection unit consisting of components having reflecting surfaces; a holder unit which enables attachment of a smart device to the reflection unit; a Mechanical means to enable attachment of the digitization module to a microscope having an opening wherein any beam axis is vertical and wherein optical path of the microscope opening and the digitization module are in alignment; wherein the reflection unit together with a smart device screen is placed at the distal end of the microscope opening through the mechanical means; wherein the beam emitted from beam splitter of the microscope undergoes bending at an angle of 90 or 270 degrees at the reflection unit and is projected horizontally onto the smart device camera; and wherein field of view is same for image visualisation via the microscope eyepiece and through the digitization module.

BRIEF DESCRIPTION OF THE ACCOMPANYING DRAWINGS:

Figure 1 illustrates the schematic representation of the present invention.

Figures 2 A & B illustrates the digitization module (100) for a trinocular microscope with tablet.

Figure 2 C illustrates the digitization module (100 A) with mobile phone.

Figures 3 A & B illustrates the mechanical components.

Figures 4 A & B illustrate the exploded view of optical components.

Figures 5 A illustrates the optics path with 2 prisms.

Figure 5B illustrates the optics path with 3 prisms. DETAILED DESCRIPTION:

The working of the present invention and its embodiments are described herein with reference to the drawings referred to above. However, the drawings are only for the purpose of illustration and do not in any manner limit the scope of the invention. While describing the preferred embodiment, several terminologies will be used to describe the apparatus and its working. Nevertheless, the same should not be construed as a limitation, and should be understood to facilitate the understanding of the present invention and not as a limitation.

Further, the reference numerals are used only as an aid to explain the invention and they do not in any matter restrict the scope of the invention.

It is to be understood that the invention is not limited in its application to the details of the construction and arrangement of parts illustrated in the above-mentioned drawings. The invention is capable of other embodiments, as the apparatus can be modified according to user requirements and implemented in a variety of ways. Well known functional components are not disclosed in detail, as a person skilled in the art is presumed to be aware of the same.

The present invention discloses an attachment or a digitization module that allows smart devices, such as mobile, tablet etc., to be used for digitization of microscopes. It allows the simultaneous viewing of a microscopic sample through the binocular eyepieces as well as through the display screen of a smart device. The area of the sample displayed on the screen of the smart device will be the same as that seen through the eyepieces, without any reduction in the area. The sample will simultaneously be in focus when viewed through the eyepieces as well on the screen of the smart device. The digitization module can be used as a fixed setup or be rotated about 360 degrees along the vertical axis.

In a preferred embodiment, the digitization module is designed to be attached to a trinocular microscope, wherein sample viewing is simultaneous through eyepieces and through the smart device. In an alternate embodiment, the digitization module is designed to be attached to any microscope, where a beam splitter emits rays vertically.

In the present invention, the optical setup designed in such a way that light rays from a beam splitter which is part of trinocular head are emitted vertically, passes through optical system and directly falls on a smart device camera. Image obtained on the screen of the said device is equal to the area of image viewed through microscope eyepieces. In the present invention, real time image is obtained on the smart device by creating optical alignment between the optical path and the camera of the smart device, without the usage of any wired connection.

In a preferred embodiment, the present invention is used to convert existing trinocular microscopes to digital ones. It has both options of ocular and digital image simultaneously. In existing prior arts, in a USB camera based digital microscope there is time lag for the digital image to reflect on the screen due to the USB connection.

In a preferred embodiment, a digitization module for trinocular microscope comprises of optical components, display holder for a smart device, a smart device, and mechanical components; the said mechanical components enable alignment of the optical path between the trinocular opening of the microscope and the digitization module. The components utilised in the said digitization module are explained hereinbelow with reference to the afore-mentioned drawings.

Figure 1 identifies the conventional microscope components and digital trinocular head components. It explains the working mechanism of the trinocular head components within the digitization module. The rays emitted from the beam splitter pass through a series beam reflectors, wherein a certain degree of reflection is achieved by bending the rays and passed onto the camera of the smart device for displaying the final image is displayed on the screen of the smart device.

Figures 2A, 2B and 2C identify the display unit (101) fitted on display holder (102). The Display holder (102) is stabilised using a connecting rod (104) and C type flange (105) in case of larger display. The connecting rod (104) and C type flange (105) can be avoided if display size is less than 7 inch. A casing (103) is provided to cover the optical components.

Figures 3 A & B identify the mechanical components, which enable alignment of the optical path of digitization module with rays which are coming vertically from beam splitter through the trinocular opening.

In a preferred embodiment, two components, i.e., Fixed part (201) and coupling nut

(202) are mounted on the trinocular opening in the microscope, to connect the digitization module with the trinocular microscope. However, the mode or means of connecting the digitization module with the trinocular microscope or any other microscope is customisable according to the requirement of microscope manufacturers. Therefore, the use of fixed part (201) and coupling nut (202) are not a limitation to the scope of the present invention.

Fixed part (201): It is a part with or without threading which allows the attachment to be fixed to trinocular opening of the microscope head. The threading is as shown in figures 3 A & B by which it is tightened onto the trinocular opening. In some brands of trinocular microscopes, threading is not provided in the opening, in that case dovetail structure is used to fixed the attachment onto the trinocular opening. A groove (201 A) is provided in fixed part to hold the C type flange (105). C type flange relates to Connecting rod (104) which stabilises the display holder (102) in case of display size is more than 7 inch else these two components can be avoided.

The digitization module (100, 100 A) can be mounted on any trinocular microscope. Based on the diameter of the trinocular opening, size of the fixed part (201) can vary depending on the brand of the trinocular microscope.

Coupling nut (202): This allows to attach the fixed part (201) to the rotating shaft

(203). It is to be tightened onto the fixed part (201) through a thread. The thread also allows fine focussing of the final image on the digital display so that both the eyepiece view and digital image are in perfect focus. It has four grub screws (202A) at right angles with each other. Using the grub screws (202A) rotating shaft (203) can be attached to the fixed part (201). Rotation of the digitization module (100, 100A) is achieved by a rotating shaft (203) on a bearing (205); the said bearing is fixed on a bearing holder (204) using a bearing fixing nut (206).

Rotating shaft (203): it is mounted on bearing holder (204) as shown in figure 3 A. Bearing holder is fixed onto base plate (301). Bearing (205) allows to rotate the display screen with reference to the rotating shaft, since the rotating shaft is fixed with the coupling nut.

In an alternate embodiment, rotating shaft (203) can be directly attached to the base plate (301) at fixed position without providing rotational feature.

In an alternate embodiment, the rotational feature can be provided by any other suitable mode.

Bearing holder (204): It encases a bearing (205) as shown in figure 3 A and 4B. It is fixed on optical base plate (301) using screws (204A).

Figure 4 A shows the exploded view of optical components. Optical components such as prism 1(302), prism 2 (304), Prism 3 (305) and a Camera lens (308) are seen. Prism holder 1(303) holds prism 1 (302) and prism holder 2 (306) holds the prism 2 (304) and prism 3 (305) at a specified position. Camera lens (308) is fixed in a Camera lens holder (309). To support the display holder (102) a component namely display holder support (310) is used, which is fixed on Camera lens holder

(309) with the help of screws putting inside the hole (310B). The camera lens lower part(3O8A) is fixed inside camera lens holder (309) by putting grub screws in the hole (309B). In other embodiments camera holder (309) and display holder support

(310) can be a single component.

Base plate (301): Optical components are mounted on base plate as shown in figure 4A and 5 A & B. Prism 1 (302) is directly mounted on base plate (301) but prism 2 (304) and prism 3 (305) are mounted using C type block (307). The present invention works on the principle of beam reflection and for the said purpose, beam reflectors are used, which achieve beam reflection at 3 points of intersection.

In a preferred embodiment, the digitization module is designed with beam reflectors consisting of 3 prisms, encased in the casing (103), as disclosed in Figure 5B.

In an alternate embodiment, the digitization module has 2 prisms (302 & 311), which achieve the requisite beam reflection to produce simultaneous viewing without reduction field of view.

In an alternate embodiment, the digitization module has a single prism, designed or configured to achieve the requisite beam reflection to produce simultaneous viewing without reduction field of view.

In an alternate embodiment, the digitization module can be designed or configured with first surface coated mirrors as beam reflectors to achieve the requisite beam reflection to produce simultaneous viewing without reduction in field of view.

However, it is not a limitation to use beam reflectors which achieve a single point of intersection or two points of intersection. The Applicant tested the present invention with single and two points of intersection. While the resultant invention was functional in all aspects, the usability of the invention remained moot owing to the fact that there was problem of image flipping or image rotation. In order to correct the distortion, it required further support in the form of software enablement to the digitization module, which will further increase the requirement of processing power in smart device and increase the cost of the total equipment.

Prism 1 (302): Light rays which comes from Beam splitter of trinocular head opening vertically falls on prism 1 which bend rays at right angle as shown in figure 5 A & B.

Prism 2 (304): Light rays coming from prisml (302) falls horizontally on prism2 and it bends at right angle again as shown in figure 5 A, B . Prism 3 (305): Light rays falls vertically on prism 3 and it bends at right angle again and propagates in positive horizontal direction as shown in figure 5 A, B. Both prism 2 and prism 3 are enclosed in a casing (103) which is fixed on camera lens holder (309).

Camera lens (308): Light rays coming from prism 3 (305) horizontally falls on Camera lens where it gets magnified. This is a second level of magnification of the sample, which has already been magnified once by the objective lenses of the microscope. This lens allows the final image to form on the focal plane of smartphone or tablet camera

Camera lens holder (309): It is provided to hold the Camera lens (308) as shown in figure 4 A. It is provided with a grub screw to tighten the Camera lens and a mechanism by which Camera lens can move in horizontal direction to adjust the focus depending on the focal length of different display units. It is fixed on C type block (307) as shown in figure 4 A.

Display holder support (310): It is used to hold display holder (102); it is directly fixed on the Camera lens holder (309) as shown in figure 4 A.

Display Holder (102): It is used to hold the display unit which can be a smartphone or tablet and helps to align its camera with the camera lens. It is mounted on display holder support (310) as shown in figure 2 A.

Figure 4B shows the bottom view of base plate (301).

Connecting rod (104): A rod is used to increase the stability of optical unit in case the display unit is a tablet. One end of the rod is connected to the display holder (102) and the other is connected to a C clamp (105) which is inserted on fixed part groove (201A) as shown in figure 1 A.

As shown in figure 5 B, the emitted light rays from specimen pass through objective lens, where it gets magnified. The magnified rays pass through beam splitter and fall vertically on prism 1 (302) or a reflector surface where it gets bent by 90 degrees. Further light rays fall on prism 2 (304) or a reflector surface horizontally and gets bent by another 90 degree and emerges vertically. Now vertical light rays fall on prism 3 (305) or a reflector surface and gets bent again by 90 degree and emerges horizontally. After emerging from prism 3 (305) light rays pass through Camera lens (308) where second magnification happens. Now magnified light rays falls on camera of display unit (smartphone/tablet) and the image of the specimen is obtained on the display screen.

As shown in figure 5A, prism 2 (304) and prism 3 (305) can be replaced by one right angle prism (311) which bends light rays at 180 degrees.

In Figure 5A rays coming from beam splitter falls on right angle surface of prism (302) and exits from right angle surface. Now emitted light ray falls on diagonal surface of prism (311) and reflected by right angle surface and exits through diagonal surface as shown in figure 5 A. now emitted light from prism (311) falls on camera lens (308). In this configuration two prisms are used. But in second configuration as shown in figure 5B, 3 right angle prisms are being used. Light rays coming from beam splitter falls on right angle surface of prism (302) and exits from right angle surface and falls on right angle surface of prism (304) and emits from right angle surface only. Now light falls on right angle surface of prism (305) and emits from right angle surface only. Now emitted light falls on camera lens (308).

Image obtained on display screen unit (101) can be captured, shared via any social networking app like email, WhatsApp, telegram etc.

If the microscope is to be used for teaching/discussions with multiple individuals, the digitization module (100) can be rotated along the vertical axis by 360 degrees. The sample will be in focus on the digital display and through the binocular eyepiece simultaneously. The focus on the display screen can be adjusted using the coupling nut (202) in order to match that through the eyepieces.

The attachment will assist doctors and professionals in their routine reporting should the need to obtain a second opinion arise. Images and videos can be captured using the phone/tablet and shared instantly for consultation. It will increase efficiency in medical education and training as multiple individuals will be able to see the sample on the screen.

The above-mentioned description illustrates and depicts the preferred embodiments of the present invention. However, it will be appreciated that numerous changes and modifications are likely to occur as per user requirements, and it is intended in the appended claims to cover all these changes and modifications which fall within the true spirit and scope of the present invention.

Claims

CLAIMS WE CLAIM:

1. A digitization module (100, 100 A) for a microscope, comprising:

A reflection unit consisting of components having reflecting surfaces;

A holder unit which enables attachment of a smart device to the reflection unit;

A Mechanical means to enable attachment of the digitization module to a microscope having an opening wherein any beam axis is vertical and wherein optical path of the microscope opening and the digitization module are in alignment;

Wherein the reflection unit together with a smart device screen is placed at the distal end of the microscope opening through the mechanical means;

Wherein the beam emitted from beam splitter of the microscope undergoes bending at an angle of 90 or 270 degrees at the reflection unit and is projected horizontally onto the smart device camera; and

Wherein field of view is same for image visualisation via the microscope eyepiece and through the digitization module.

2. The module as claimed in claim 1, wherein the reflection unit comprises of beam reflectors with reflecting surfaces such as prism or first surface coated mirror.

3. The module as claimed in claims 1 and 2, wherein the reflection unit may consist of n number of prisms or mirrors, wherein n is an integer from 1 to 3.

4. The module as claimed in claim 1 , wherein the bending of the rays is achieved by 3 points of intersection. The module as claimed in claim 1, wherein the reflection unit consisting of beam reflectors is mounted on a base at the distal end of the microscope opening. The module as claimed in claim 1, wherein the beam reflectors are arranged relative to each other, with respect to the beam axis of the microscope. The module as claimed in claim 1, wherein the reflection unit is encased in a casing (103). The module as claimed in claim 1, wherein the module can be rotated about 360 degrees on the vertical axis.