WO2015178867A1

WO2015178867A1 - A mobile microscopy device being able to take images in different wavelengths (multispectral)

Info

Publication number: WO2015178867A1
Application number: PCT/TR2015/000223
Authority: WO
Inventors: Eski OSMAN
Original assignee: Gri̇med Sağlik Hi̇zmetleri̇ Ve Bi̇lgi̇sayar Ürünleri̇ Sanayi̇ Ti̇caret Li̇mi̇ted
Priority date: 2014-05-20
Filing date: 2015-05-20
Publication date: 2015-11-26
Also published as: CN106415239A; TR201405617A2

Abstract

This invention concerns a multipurpose imaging device (10) that can take images in different wavelengths (multispectral), that can be integrated into cell phones and portable imaging systems, that permits collecting, saving and sharing data and images especially for diagnostics in health domain (eye, gynecology, dermatology, otorhinolaryngology, forensics etc.) and all fields where macroscopic and microscopic examination is needed (gemology, electronics, mineralogy etc.).

Description

A MOBILE MICROSCOPY DEVICE BEING A8t£ TO TAKE IMAGES IN DIFFERENT WAVELENGTHS

(MULTISPECTRAL).

Technical Field

This invention concerns a multipurpose imaging device that can take images in different wavelengths (multispectrai), thai can be integrated into cell phones and portable imaging systems, that permits collecting, saving and sharing data and images especially for diagnostics in health domain (eye, gynecology, dermatology, otorhinolaryngology, forensics etc.) and ail fields where macroscopic and microscopic examination is needed (gemoiogy, electronics, mineralogy etc.).

More specifically this invention concerns the integration of the imaging I a way to distinguish the contents of different materials by way of filtering the light in different wavelengths to obtain the desired image and its integration to existing imaging systems and making easy to carry and to apply the imaging process.

Known State of the Technique

Multispectrai imaging is defined as imaging in a way to distinguish the contents of different materials by way of sending light in certain wavelengths and filtering that light with filters of certain wavelengths Multispectrai imaging systems thus defined enables the examination of many materials though their properties such as fluorescence, luminescence, phosphorescence etc. in many fields.

These fields include medicai fields like forensics, dermatology, ophthalmology and gynecology as well as other fields such as gemoiogy, geology and botanic; its area of usage will continue to grow with new technology and research.

The technique called traditional multispectrai imaging is a technique that can provide imaging in many fields (forensic medicine, forensic sciences, dermatology, gynecology, ophthalmology, engineering etc.) but the systems used in conjunction are hard to carry, limited capacity and impossible to use for a long time without a source of energy. For these reasons some examination objects have to be taken to the laboratory for examination.

Additionally, the imaging intervals are limited to the filters at hand. Some applications require a dark room. In these situations, the object to be examined is taken from its place and carried to a dark room are one tries to establish a dark room around it. Again, some applications require polarized or horizontal lighting. In this case, further equipment may be needed.

A filter and/or filters are added in front of the CCDs or CMOSs (image detection sensors) in front of the existing cameras. These filters are positioned in front of the existing camera sensor. In front of these filters, a one-piece or multi-piece lens is positioned. With this method, limited Imaging capabilities have been acquired and because of limited focusing and zooming properties, a system that can meet the requirements of many fields has not been achieved.

Also, lenses, filters and LEDs emitting light in different wavelengths permitting usage in many fields and collection of data in desired definition need to be used together and positioned suitably with respect to one another. Existing techniques cannot provide this. With the existing techniques, devices have a limited area usage and a mobilized multispectral imaging system has not been achieved.

Figuring in the patent applications no US2012157160A1 and no. WO2012/088351 A2 concerning the existing technique, the "imaging cap"s only purpose is microscopic fluorescent examination. Three LEDs positioned 90 degrees apart from each other is a system developed to examine the sample/object under the light. For this reason, multispectral imaging cannot be realized for skin surface, macro-imaging, eye, otorhinolaryngology and forensics, and it's not possible to use it in these fields. Light in different wavelengths attached to our Imaging cap" is oriented directly towards the object and emits light in the exact opposite direction of the sensor. In examinations, fluorescent imaging Is only a part of multispectral imaging. That is, objects outside the cap are being examined. Figuring in our application, "imaging cap" does not require disassembly or assembly of any pieces to change the lens and filtering system to suit the needs. The "imaging cap" figuring in our application capable of lighting in different wavelengths that has tens ring and filter ring has no functional or formal similarities with the "Imaging cap" figuring in the patent application no. US2012157160A1

The two light systems m the "imaging caps" figuring in patent application no. WO2009088930A2 and no. US201 1009163A1 cannot be replaced as can be seen in Fig. 2, Fig. 3 and Fig, 4; first, It is placed right behind the examined sample/object in exact opposite direction of the senso and 90 degrees horizontally to the object. In our system, light in different wavelengths are sent directly to the examined object and emit light in the exact opposite direction of the sensor. The said imaging cap, as can be seen in Fig. 1 , can examine samples/objects placed in the cap for microscopic examinations. Our system, on the other hand, examines objects outside the cap. The said imaging cap, two single purpose non-replaceable filters are used; one placed in front of the eyepiece and the other in front of the LED. It has two non-replaceable lenses of which one is placed in front of the emission filter and the other in front of the collector lens before the LED or the excitation filter, and one objective. The "imaging cap" with replaceable lens ring, filter ring and that can emit light in different wavelengths figuring in our application has no functional or formal similarities with the one figuring in patent application no. WO2009088930A2

The "imaging cap" figuring in patent applications no. WO2006127840A2 and no. US2006/279732A , are not extemai to the mobile device but are internal to it. The parts cannot be replaced without suitable equipment and disassembly. As shown in Fig. 2b of the patent application, a iense with constant zoom and focus distance is placed in front of the sensor. The said imaging technique does not emit light by sending light in different wavelengths to the objects outside. As detailed in Fig. 3, a lens with a zoom and single focus distance is positioned in front of the sensor. Even though the outside filtering system of this one is replaceable, because of the lack of a replaceable lens ring and a lighting system, it is single purpose and not positioned in a portable system. The said imaging cap, unlike our method, does not emit light in different wavelengths to outside objects and does not provide different zoom options necessary for different needs.

As detailed in Fig. 4, replaceable filter ring systems are placed in front of the sensor, inside the portable device. A non-replaceable lens with a single zoom and focus distance is placed in front of the filter and inside the portable device. The said imaging cap does not provide lighting by emitting light in different wavelengths to outside objects. For this reason, it cannot be used for multispectral imaging in skin surface, macro-imaging, otodilnoiaryngology, forensic examination or incident scene examination.

The "imaging cap" that we^'re applying for a patent for has no functional or formal similarities with the similar patent appiications in that it has no external system with all the imaging sensors , filters and tens systems being inside the portable device, with its lens ring, filter ring and in that it can provide lighting in different wavelengths and it requires all of this at the same time.

Again, the "imaging caps" figuring in the patent application no. WO 2006083081A1 titled high-zoom imaging device for cell phones is placed in front of the portable devices sensor. As can be seen in Fig, 1 , Fig.2, Fig.5, Fig.8, Fig.9, Fig.10, Fig.1 1 , Fig.12, Fig.13, and Fig 14, In front of a modified mobile device's sensor, a light source, a non-replaceabie lens group with standard zoom and a non-replaceable polarization filter are mounted in the said patent application, as can be seen in Fig.1 , Fig.2, Fig.3, Fig.4, Fig .5, Fig.8, Fig 9, Fig.10, Fig.1 1 , Fig.12, Fig.13, and Fig.14; the LED, the lens and the filter are integrated on a single body and no parts, except the light group, can be replaced without disassembly. In the lens system figuring in Fig. 5 and mounted in front of the sensor, there is a single polarization filter that can be circularly rotated to achieve different polarizations. In our application, the polarization filter with standardized angles inside the filter ring is only one of the circles in the filter ring. In other circles, lenses with different zooming coefficients cannot be used for other purposes without disassembly as can be seen in Fig. 9 and Fig. 10. The said patent application is just a miniaturized version of pre-existing microscopic video imaging systems. None of the parts have a ring filter or ring lens system with the property to be replaced without disassembly. For instance, the system in this patent can provide high zoom on skin but cannot provide macro-imaging without changing parts after disassembly. Also, in this system, light in different wavelengths cannot be filtered through filters in different wavelengths after reflecting from the skin to be captured by the sensor. Here, the returning light can only pass through a single filter. This hinders its usage for multlspectral imaging.

The "imaging cap" that we're applying for a patent for is an external system positioned outside the sensor, filter and lens systems. The "imaging cap" that we're applying for a patent for has no functional or formal similarities with this patent application with its lens ring, filter ring and ability to emit light in different wavelengths and that it requires all of these at once.

US2011/009163A1 figures 1 ,3,4 No known previous technique in use possesses a system that can be integrated into cell phones or portable imaging systems, large area of usage thanks to the ability to emit light in different nanometers of wavelengths, adaptable to all portable imaging systems.

The system that is the subject of this invention provides all specified needs under a single roof. The system where all parts are replaceable enables usage in every position.

Thanks to the system integrating these properties into mobile devices, it is built in a way to ease moving data and with forward-compatibility for new models of mobile devices.

The Purpose of the Invention

One of the purposes of the invention is, in order to eliminate the disadvantages of the known state of the technique, is to obtain a system that can provide different definitions required for macroscopic and microscopic imaging thanks to its configurability, that can be integrated into mobile devices with cameras for multispectral (in different nanometers) by uniting the necessary elements.

Another purpose of the invention is the usage of suitable lenses, suitable filters and LEDs that can emit light In different wavelengths and their suitable positioning with respect to each other in obtin an imaging system that can meet the needs of macroscopic and microscopic examinations in different fields.

Another purpose of the invention is ease of usage.

Another purpose of the invention is the practicality of its application and usage. Another purpose of the invention is a wide area of usage.

In order to provide the above mentioned advantages, the invention concerns an imaging device integrated to mobile devices, inside the imaging cap that can be mounted or unmounted on the unit that permits the fastening to mobile devices and meet the extra energy needs; a LED cap replaceable without dedicated equipment, a replaceable and rotatabie filter disk and lens disk, a polarization feature that can be turned on or off without changing the optional lighting system and an optional light spreader and a glass in contact with the spreader, a sliding system that permits the alignment of the mobile device and the imaging cap that can obtain imaging in different wavelengths.

Description of Figures

Figure 1 is the genera! perspective view of the imaging device figuring in the invention

Figure 2 is the genera! perspective view of the imaging device figuring in the invention,

Figure 3 is the general side view of the imaging device figuring in the invention Figure 4 is the genera; front view of the imaging device figuring in the invention Figure 5 is the assembly view of the imaging cap of the imaging device figuring in the invention

Figure 6 is the front view of the filter disk

Figure 7 is the front view of the Sens disk

Figure 8 is the side view of the macro-imaging apparatus.

Description of Reference Mumbers

10 Imaging device

20 Main chassis

30 Imaging cap

40 LED module

40.1 LED

50 Light spreader

60 Light intensity adjustment bu

70 Separation button

80 Fixation flanks

90 Light intensity adjustment bu

100 Filter disk

100.1 Empty filter disk chamber

100.2 Filter

110 Lens disk

110.1 Empty lens disk chamber

110.2 Lens

120 Camera space

120.1 Slide 130 Filter information

140 Lens information

150 Contact lens

160 Tripod connection point

170 Rotating cylinder

230 Front protection

230.1 Socket

240 Disk interconnection piece

250 Disk back protection

260 Connection space

270 Polarization filter in front of the LED

280 Macro-imaging apparatus

Detailed Description of the invention

Different zooming coefficients are needed for microscopic examination according to the area of usage. This can only be achieved by using different lenses (110.2). In the previous technique, it is achieved by a non-portable apparatus or by using dedicated equipment to disassemble and assemble different lenses.

Multispectral imaging is defined as imaging in a way to distinguish the contents of different materials by way of sending light in certain wavelengths and filtering that light with color filters (100.2) of certain wavelengths. Multispectral imaging systems thus defined enables the examination of many materials though their properties such as fluorescence, luminescence, phosphorescence etc. in many fields.

These fields include medical fields i?ke forensics, dermatology, ophthalmology and gynecology as well as other fields such as gemology, geology and botanic; its area of usage will continue to grow with new technology and research.

Traditional multispectral imaging systems are non-portable and difficult to use, and cannot be used ever/where.

The imaging intervals are limited to the existing filters (100.2). Some applications require a dark room. In these situations, the object to be examined is taken from its place and carried to a dark room are one tries to establish a dark room around it. Some applications require polarized or horizontal lighting. In this case, a different lens or filter might be required only for this application.

The imaging system figuring in this invention (10) is built in a way to meet all these requirements at once. AH parts are replaceable and the system is usable in all circumstances.

The imaging system figuring in this invention (10) provides different lighting, filtering and zooming features in a single package due to its LED module (40) and filters (1o0.2) and lenses (1 10.2) replaceable without disassembly.

This way, one coan obtain high-definition images of the field to be imaged. It has an internal battery inside to chassis for longtime use.

The socket (230.1) adapted to the imaging cap (30) and the main chassis (20) can be used as power sources

This way, when Integrating with different mobile devices, the design of the imaging cap (30) need not be changed and adaptability is obtained by changing the design of the main chassis (20).

In multispectral imaging, lighting is selected according to the purpose for visible wavelengths. In this context, very high band lighting may weaken or destroy the fluorescence of certain materials.

For this purpose, narrow band LEDs (40.1 ) are used. To be able to observe the multispectral effect, the light reflecting from the material must be filtered in the desired wavelength hand. The image thus obtained is transferred to the phone memory through the device s CCD or CMOS sensor. Data can be transferred through internet, hence enabling fast data transfer.

The imaging device figuring in the invention (10) is compatible with three dimensional imaging cameras. Separate lenses (1 10.2) and filters (100.2) have been developed for this purpose. The system's structure permits the usage of image processiong or analysis programs.

In this regard, it provides features like panoramic imaging, image filtered through image processing, changing contrast, auto-focus, grain removal, angle and distance measurements on the image, drawing shapes on the image, color spectrum and digital zoom. Also, advanced functions like edge detection, automatic surface calculation, automatic color detection and finger print analysis can be integrated into the system. This enables a large area of usage

The imaging cap (30) is suitable for mounting different apparatuses in order to realize multispectral imaging. Due to the integrated tripod connection point (160), fixed imaging is possible. The system can also be used for hyperspectral imaging. No additional apparatus is necessary.

The system can be integrated in Cloud or Secure Cloud systems depending on the area of usage. This way, instantaneous data transfer and saving is possible. These data can be processed on the mobile device or on the server and transferred back to the mobile device.

The imaging device figuring in this invention (10), thanks to the camera of the cell phones and/or imaging systems, lenses (1 10.2) and filters (100.2) positioned inside the imaging cap (30), and different combinations of LEDs (40.1 ) depending on the The lenses (1 10.2) m existing mobile devices can only provide macro-imaging. Macro-imaging is not sufficient for the desired result and medical and forensic microscopic examinations.

In Figure 1 and 2, the general perspective view of the imaging device (10) is provided.

The main chassis (20) integrated to the mobile device with camera is fixed with the fixation flanks (80) and the alignment of the camera of the mobile device with the imaging cap (30) is done using the sliding system (120.1 ) specifically produced for each mobile device model.

The main chassis (20) has a built-in battery used for lighting for durability without wasting the mobile device s battery and providing power for the imaging device (10) its own power. Also the imaging device (10) can be connected to the phones internal or external power source.

The imaging cap (30) has a LED module (40), a filter disk, a lens disk (1 10), an optional light spreader (50) and an optional contact glass cover for the light spreader (150) that can all be replaced without disassembly and without requiring any tool. The imaging cap (30) can be disconnected from the main chassis (20). The connection to the main chassis (20) Is provided through the socket (230.1 ) and thee needed power is transferred through the chassis (230.1 ) to the imaging cap (30). This way, the main chassis (20) can be used as an integrated power source for the mobile device.

Also, due to this mounting feature, low cost adaptation for different telephone models is achieved by changing the main chassis (20).

The imaging cap (30) holding the main working elements of the system is unchanged and this way, production and marketing costs are minimized.

The light intensity can be set using the light intensity adjustment button (90) on the main chassis (20). The necessary power transmission is carried out through the socket (230.1). The light intensity of the LED module (40) can be changed or turned off through the adjustment button (70). The LED module (40) can be disassembled and replaced using the separation button (70). A light spreader (50) can optionally be put in front of the LED module (40).

The filter disk (100) and the lens disk (1 10) in the imaging cap (30) can be rotated to achieve desired multispectra! imaging properties without necessitating any tools. The filter disk (100) enables detection of the light emitted from the LED module (40) reflecting from the material (flurescence, iuminescence etc.) by the camera sensor through the filter (100.2) combination it possesses. The lens disk (1 10) provides the necessary zooming for the imaged area through the lens (1 10.2) positioned on it. An empty lens disk chamber (1 10.1) is provided for the lens disk (110) for macro- imaging.

The camera space (120) on the main chassis (20) enables the connection of the camera to the imaging cap (30). The filter information space (130) on the imaging cap (30) shows which filter (100.2) is currently selected. This way, the required filter (100.2) can be adjusted In case the rotating operation is carried out fully automatically with a mini-rotor or similar parts, these spaces are unnecessary.

The filter disk (100) can hold any numbe of filters (100.2) up to three. The filter disk (100) is itself easily replaceable without the need of any tools. The empty filter disk chamber (100.1) is provided for macro-imaging.

In the lens disk (1 10), there are two lenses ( 10.2) and an empty lens chamber (110.2) for macro-imaging through the camera. For this purpose, the LED module (40) is illuminated by the LEDs (40.1 ) positione on it. The LED module (40) provides light in at least one specific wavelength.

The illumination of the area desired to be multispectrally imaged is a priority. This illumination done using LEDs (40.1 ) positioned on the LED module (40). The LED module (40) provides light in at least one specific wavelength.

The reason for emitting light in a specific wavelength is to use materials absorbtion and reflection characteristics for an image with the best definition.

Different lighting options of the same LED module (40) are activated using the light intensity adjustment button (90). The light intensity can be increased or decreased in steps using the adjustment button (40). Optionally, polarized imaging is possible using the polarization filter (270) thanks to the LEDs in standardized angles without changing the LED module (40)

This way, the underside of some surfaces can be imaged up to a certain distance. The light emitted from the LED module (40) has to pass through a color filter (100.2) specific to the usage after reflecting from the surface and before going to the camera. These filters (100.2) are positioned in the filter disk (100) in the imaging cap (30) and can be in different numbers and adjusted depending on the area of usage by the rotation feature of the filter disk (100)

When unfiltered macro-imaging is desired, the empty filter disk chamber (100.1) can be used.

During the imaging, different lenses (1 10.2) depending on the distance in different numbers are positioned In the lens disk and can be selected through the rotation feature. When macro-Imaging is desired, the empty lens disk chamber (1 10.1) can be used on the lens disk (110).

The front protection (230) unites and holds together the LED module (40), the filter disk (100) and the lens disk (1 10). It also contains the connection of the imaging cap with the main chassis (20) and the rotating cylinder (170) that holds the rotating parts in place when connected.

The connection between the lens disk (1 10) and the filter disk (100) is provided by the interconnection piece (240).

The disk back protection (250) protects the imaging cap from dust and impact from the back and holds the interconnection piece (240) and the rotating cylinder (170) that holds the rotating parts in place when connected. When desired, a light spreader (50) that can be changed according to the purpose may be used. The light spreader (50) can stop the outside light and also ensures a homogenous spreading of the light.

When desired, the contact glass cover (150) can be mounted on the light spreader (50) for contact imaging.

When desired, in order to carry out horizontally and vertically lighted imaging, the macro-imaging apparatus (280) with its own LED lighting can be used and LED module (40) can be removed. This way, surfaces that cause flare with vertical lighting can be imaged with horizontal lighting.

In forensics, fast imaging of finger prints on the scene is important. For this, special lighting and filtering is necessary depending on the surface. Otherwise imaging is not possible or is low quality.

For instance, on a surface where Ardrox is used as a reagent, the light's wavelengths has to be 380 nm and the reflected light has to be filtered through a 500 nm filter (100.2). In this case, the two systems necessary to provide these two specific values are a special lighting system and a special filtering system. The imaging device figuring in this invention (10) this type of imaging is possible without necessitating any heavy equipment and the images can be transmitted to the center instantaneously.

As another example, on the scene, some unnoticeable gunpowder residue can be seen on the black zone. For this operation the light's wavelengths has to be 430-470 nm and it has to be filtered by a filter (100.2) blocking under 550 nm. The imaging device figuring in this invention (10), thanks to its advanced lens disk (1 10) can provide micro-imaging without a dark room and the images can be transmitted to the center instantaneously

In yet another application area, the imaging device figuring in this invention (10) permits the imaging of fungi and similar findings in dermatology without the need for a Woods (UV-A) lamp. This way, different skin tissues on the area of dermatological examination can be recorded for further examination in patient records.

For three dimensional cameras, two filters (100.2) and lenses (1 10.2) of the same type needs to be placed in the filter disk (100) and lens disk (1 10) in a way to be in front of both of the cameras.

Claims

1- The invention is characterized by a multispectral (that can take images in different nanometers) imaging device (10) to be used in areas where macroscopic and microscopic examination is needed, having different lenses (110.2) for desired definition and zooming coefficients, and different filters (100.2) to filter the Sight in different wavelengths before the image sensors for portable imaging systems, with LEDs (40.1) that can emit light in different wavelengths and having all the other necessary elements in a suitable configuration to be used together, to be integrated on a mobile device with camera through the main chassis (20), a rotating lens disk holding at least one empty lens disk chamber (110.1) enabling macro- imaging or lens/lenses (110.2) in different zoom coefficients; a rotating filter disk holding at least one empty filter disk chamber (100.1) enabling macro- imaging or filter/filters (100 2) with different wavelengths; an LED module (40) holding L.EO(s) (40.1) emitting light in different wavelengths, a main chassis (20) connected through a socket (230.1) to the imaging cap (30) holding the filter disk (100), lens disk (110) and the LED module (40).

2- The property of the imaging cap (30) in Demand 1 , is that it can be connected to the main chassis through a socket (230.1) providing energy transmission, and the existence of the front protection (230) holding the lens disk (110), filter disk (100).

3- The imaging cap (30) according to the Demand 1 , contains the disk interconnection piece (240) that facilitates the positioning and rotation of the lens disk (110) and filter disk (100).

4- The imaging cap (30) according to the Demand 1 , its property is that it contains the LED module (40), lens disk (110), filter disk (100) with circular plugging/unplugging feature and that desired number of LEDs (40.1), lenses (110.2) and filters (100.2) are found together.

5- The imaging cap (30) according to the Demand 1 , contains a pre-LED polarization filter (270) that permits imaging with different polarizations without changing the LED module (40) holding the LED emitting white light (40.1) without rotating the filter itself but only the ring. 6- Lens disk (1 10) according to the Demand 1 has the property that it is in circular form to enable many lenses (110.2) with different zooming coefficients to be positioned, replaced, changed or rotated.

7- Filter disk (100) according to the Demand 1 has the property that it is in circular form to enable multiple filters (100.2) to be positioned, changed and rotated.

8- Main chassis (20) according to the Demand 1 has the property that the imaging cap's (30) light changing and turning it on and off can be achieved through the socket (230.1 ) directly on the main chassis (20).

Main chassis (20) according to the Demand 1 has the property of being able to be fixed on a mobile imaging device (10) with the fixation flanks (80) and camera space (120) and a slide system (120.1 ) enabling the alignment of the camera with the imaging cap (30).