WO2021250537A1

WO2021250537A1 - Multipurpose spectroscopic, hyperspectral and digital imaging device

Info

Publication number: WO2021250537A1
Application number: PCT/IB2021/054963
Authority: WO
Inventors: Cihan KILIÇ; Yakup GÜLMEZ; Turgay ÖZKAN; Faruk TAKAOĞLU; Merve ATAY; Oğuz KAYILLIOĞLU; Bilal ATAY; Emre DALKILIÇ; Yücel Çeti̇n; Emre ARDIÇ
Original assignee: Tübi̇tak
Priority date: 2020-06-09
Filing date: 2021-06-07
Publication date: 2021-12-16
Also published as: TR202008917A2

Abstract

The invention can use different types of illumination sources to obtain radiation in the 250-1100nm wavelength range that includes a part of the visible, ultraviolet and infrared region of the electromagnetic spectrum, without the need for any external intervention, as a result of the moving illumination panels, the open frame stage, and the moving imaging system, It is related to a spectroscopic, hyperspectral and digital imaging device that provides the measurement of the energy of the light reflected from the surface of the object at different wavelengths by being homogeneously and strongly illuminated from all possible aspect and directions of the object subject to examination. The device in question basically includes; a movable floor table on which the object to be examined is placed and can be easily disassembled and installed thanks to the socketed structure of the vacuum module, which functions to fix the object to the floor and smooth its surface depending on the need, movable illumination panels that enable the use of different types of illumination sources for different wavelengths in the desired combination and number, and to adjust the angle of incidence of the light to the object to be examined at the time of examination with its mobility in horizontal and vertical axis; spectroscopic measurement module which contains the spectrometer optical fiber tips arranged in the probe tip are brought closer to the object surface to a distance of 1 mm to the surface of the object to be examined and positioned accurately to the target point to be measured by endoscopic cameras, thus enabling measurement with high accuracy and precision, free from interference effects and noise-free; colorful and monochrome camera modules, a lens system with high optical zooming capacity, a linear optical filter and a moving imaging system with motion mechanisms that ensure their alignment with each other. Spectral information of each pixel in images obtained using many narrow wavelength bands is processed using hyperspectral image analysis methods, pattern recognition algorithms, machine learning, and deep learning algorithms in a computer to which the device is connected, and extracting the desired information from the images, identifying and classifying the object and anomaly (contradiction) can be detected.

Description

DESCRIPTION

MULTIPURPOSE SPECTROSCOPIC, HYPERSPECTRAL AND DIGITAL IMAGING

DEVICE

Technical Field of the Invention

It is about multipurpose spectroscopic, hyperspectral, and digital imaging device using techniques based on physics, photonics and optics and hyperspectral analysis, machine learning, and deep learning methods and algorithms in many fields such as forensic science, defense, analytical chemistry, petrochemistry, molecular biology, food, agriculture, hydrology, medicine, environment, medicine and medical, the electromagnetic waves emitted and absorbed by objects or materials as a result of their interaction with light are in narrow and adjacent multiple wavelength bands and with the spectral signatures obtained by displaying in a wide range of the electromagnetic spectrum, enabling the identification, classification of these objects or materials or the detection of the elements that can be considered as an anomaly.

Prior Art

The multipurpose spectroscopic, hyperspectral and digital imaging device is used in investigations to prove the accuracy of any suspicious document, certificate, or record that has the quality of evidence used to verify an event or to establish a right and to investigate it. This investigation covers the determination of whether some falsification, erasure, scraping, correction, modification, additions, and removals have been made on the document or document related to forgery, revealing the erased or hidden texts by painting over them, visualizing the embossed elements such as text marks and cold stamp on the document, the identification of different types of paint, ink or pen written on documents that the naked eye cannot distinguish, the determination of the chemical composition of the inks on which the writings on the papers are written and the verification of whether the suspicious documents are prepared with the same ink, determining the belonging of handwriting and signatures and the detection of various falsifications and forgeries made on valuable paper, stamps, banknotes, and similar documents, and determination of whether seals, emblems, stamps, prints and the like are original or counterfeit. In addition to its use in the field of forensic document and valuable paper examination, other benefits of the device include; determination of the freshness, quality, originality, geographical source, composition and humidity of food and agricultural products, detection of pathogenic microorganisms and fungi in food products and identification of microbial contamination (spoilage), studying the growth of microbial colonies, display of the composition and morphology of the target sample, quality control and determination of the chemical composition of products in pharmaceutical, petrochemical and chemical industries, determination of drinking water quality of groundwater, spring and mineral waters, wastewater analysis, solid waste, sludge, and soil analysis, nuclear waste analysis, tissue, organ, blood, hair, and other body fluid analysis and detection of weapons by examining firearm residues, bullet cores, and casings.

The device of the invention has been designed by taking advantage of the characteristic that different substances react differently to light and for the 250-1100 nm wavelength range of the electromagnetic spectrum, visible band, ultraviolet (UV) and infrared (IR) fluorescence, LED and spotlight sources create a homogeneous and strong illumination on the object to be examined. The spectral signature that reveals the reflection, transmittance, and fluorescence properties of the object and expresses the optical characteristics specific to the object is obtained as a result of measuring the response of the object to its interaction with light, such as emitting, reflecting, absorbing light, by dropping light sources of different wavelengths on the object under examination. The spectral signature patterns created by the spectral information possessed by the objects at each wavelength are used to detect, identify, classify, and anomaly detection of objects.

A series of images, each representing a wavelength band, obtained in narrow wavelength ranges for a broad spectrum with the device according to the invention, is called a hyperspectral data cube. While the first two dimensions of the three-dimensional data cube show spatial information regarding the image, the third dimension shows spectrum information depending on the wavelength for each pixel in the image. It is determined which pixels in the hyperspectral image show or do not show the spectral properties of the target object, or whether the image contains the target sought, and features such as location, quantity, anomaly related to the target object can be determined by analyzing the material spectra of the wavelengths obtained by sampling the pixels of the images in narrow and adjacent band gaps by using spectral signatures kept in spectral libraries and by using appropriate target detection algorithms. For example; whether a document or document is original or fake, or if it has been tampered with, erased, scraped, corrected, whether a food product contains or is contaminated with pathogenic microorganisms or microbial toxins, whether there is a substance in a product that should or should not be seen may be subject to detection. It is ensured that the examiner can make the right decisions by using the reflectance-absorbance luminescence databases and software using an optical spectrometer, hyperspectral analysis, machine learning and deep learning methods and algorithms in the computer to which the device subject to the invention is connected, it is possible to make automatic detection, inference or predictions about the object by using the spectral properties of the object subject to examination.

US Patent No. 6,640,132 B1 , portable hyperspectral imaging devices used for forensic and other analyses are mentioned in state of the art. The patented devices provide spectral data sets obtained in many different spectra for each pixel sample in the image. Pattern features and anomalies are determined by processing spectral data collected from many adjacent narrow spectral band gaps. A portable device that enables the detection of a target; target detection using an optical acquisition system that allows obtaining broadband, visible, ultraviolet (UV), infrared (IR), and hyperspectral data and their combinations from the target and image processing and pattern recognition software from this dataset, it includes a diagnostic processor that enables it to be performed. Optical receiver system; It consists of first-stage imaging optics, Liquid Crystal Tunable Filter (LCTF), second-stage optical, and an image sensor. The first stage, imaging optics, collects the light reflected from the surface of the forensic sample and transmits it to the Liquid Crystal Adjustable Filter (LCTF). The LCTF is a programmable filter that allows only the optical signal of specific wavelengths to pass through the light collected from the sample surface. In the second stage optics, receives the light passing through the LCTF and transmits it to the image sensor. This preferably consists of a charge-coupled device (CCD) array and transmits the image signal it has received to the diagnostic processor. The diagnostic processor includes an image acquisition interface that receives input from the user via an input device in response to the image signal received from the image sensor and provides output to the general- purpose operating module to which the input device is connected. The general-purpose working module includes routines that perform the image processing and control and operate the various parts in the system; it interacts with diagnostic protocol modules (including image processing protocols) and provides an output to the imaging terminal of the device. The mobile device in operation is positioned near the target object to be examined, and the user selects a diagnostic protocol module using the input device. Each diagnostic protocol module within the diagnostic processor is adapted to detect specific forensic characteristics of the target. The diagnostic processor obtains an image processing protocol and a series of transfer functions from the diagnostic protocol module selected by the user, and transmits the filtering transfer functions to the LCTF through the filter control interface and consequently ensures that the filtered image formed in the image sensor is stored in the image acquisition interface. The general- purpose operating module can perform filtering and storage of the filtered image one or more times depending on the number of filtering transfer functions included in the selected definition protocol module. Filtering transfer functions; can be a bandpass filter, a multi-band pass filter, or other filters. The image acquisition interface stores images in the entire spectral plane determined by the diagnostic protocol chosen by the user and processes them based on the image processing protocol in the selected diagnostic protocol module. The image obtained after image processing is displayed on the imaging terminal.

In the state of the art US patent document numbered US 10,222,260 B2; It is mentioned a spectral imaging system that includes a spectral filter array and an imaging array that can obtain information about the object, such as whether or not the target object to be distinguished in an image, its location, and/or amount, by remote sensing without touching that object. The spectral filter array is selected to be sensitive to the wavelengths applied to detect the target object, whose spectral signature is previously known, within the displayed area. The system also includes a spectral filter library consisting of several spectral filter arrays, each sensitive to one or more target objects, and that can be modified by electronic control or mechanical linkage mechanisms to align optically with the imaging array. Thus, a wide variety of target objects in solid, liquid, gas, or plasma can be detected thanks to the system, which can be easily configured by selecting and applying the spectral filter array suitable for the object to be detected. The wavelength range in which the optical filter is transparent is determined in direct connection with the spectral properties of the target object to be detected, and the spectral response of the target object in this wavelength range is previously known. An array of spectral filters is used to obtain wavelength-dependent spectral information from the spectral image, each predetermined bandgap portion of the electromagnetic spectrum (one or more specific wavelengths or a narrow range of wavelengths) to facilitate detection or identification of the target object, and it consists of a large number of selectively passing optical filters. The imaging array includes a plurality of cameras aligned with the appropriate optical filter to save filtered images. Each of these cameras is sensitive to a certain wavelength range of the electromagnetic spectrum according to the optical filter that they are aligned with and can generate images in the relevant bandgap. A series of filtered images recorded by the cameras are analyzed to obtain information showing the presence, location, and/or amount of the target object to be detected. Image analysis is performed by running the target detection algorithm selected by the user through a system's interface on a computer. The pixels in the image are considered individually or as a group, and the spectral data collected from each pixel as a result of measurement are compared with the previously known spectral signature of the target object on a pixel basis, and it is determined whether or not which parts of the image match the target object in terms of spectral features. If a match is found, the target object is detected, and the position information of the relevant matching pixels in the image is used to determine the location of the target object in the displayed area. The system in question can calculate information about the presence, location, and/or amount of the target object and display this information on the image. For example, pixels showing the spectral properties of the target object are colored with coded colors in such a way that the position information of the target object and the mathematically calculated amount of information can be understood within the colored image area. Devices used for similar purposes in the state of the art generally include a spectrometer, light sources at different wavelengths, a camera module that provides imaging, an imaging screen that reflects the image, an optical filter, and a sample tray. In these devices, optical fiber tips that enable the measurement of the energies of light reflected from the object at different wavelengths to obtain spectral reflectance values, or in other words, the reflectance spectrum, are positioned away from the object under examination or behind a reflective mirror. For this reason, the signal detected by measuring the light reflected from the surface of the object contains a lot of noise due to unwanted parasitic effects originating from a long distance. Additionally, in measurements made with optical fiber tips from a long distance, the measurement values of the points adjacent to the target point whose reflectance spectrum is desired to be measured can interfere with the reflectance value of the target point, and it is not possible to ensure the accuracy and precision of the measurement. The reason why the optical spectrometer fiber ends are positioned away from the object in the state of the art devices is that the optical spectrometer is used in a stationary system in these devices, and the spectrometer needs to be positioned close to the imaging mechanism due to the imaging process from a single fixed source. If this requirement is ignored and the spectrometer is positioned close to the ground where the object to be examined is placed, the object under investigation cannot be fully illuminated and/or imaged since the spectrometer will enter the field of view of the illumination and/or imaging mechanism. In the spectroscopic measurement module within the device subject to this invention, optical fiber tips are arranged in a probe tip, and illumination sources and endoscopic cameras are placed around it. The linear rail connection provides the movement of this module with the rack and pinion gear to which it is integrated. Without the need for manual intervention of the user, the optical fiber tips are brought closer to the point target on the object surface up to 1 mm distance to the target point to be measured and positioned accurately on the target, and the imaging is performed clearly from the areas close to the object surface, thanks to the focusing of the endoscopic cameras in the spectroscopic measurement module from the maximum proximity to the surface of the object to be examined. Thus, only the point target value to be measured is obtained, and the measurement is taken by positioning the optical fiber ends close to the object, ensuring noiseless, high accuracy, and precision measurement without observing parasitic effects. Additionally, with the infrared illumination sources in the spectroscopic measurement module, the area to be examined is continuously illuminated and imaged with filtered endoscopic camera modules; thus, continuous "anti-Stokes" examination can be made on the analyzed sample. Since the anti-Stokes analysis is performed by obtaining image signals with low energy, high-voltage flash illumination sources are used in the devices in state of the art to visualize the relevant region, and considering the low IR emission energy, and the image sensor must be close to the fluorescent pigment. According to the invention, endoscopic camera modules that can get a clear view by approaching a distance of 1 mm from the surface are used to solve this. Thus, it is easy to detect low-energy signals.

In devices that are similar to the present invention in state of the art, forensic documents, and/or valuable paper and document examination devices, magnetic or heavy fixing glass, metal, etc. to fix the document to be examined on the floor to prevent deviation in its position relative to the floor during the examination and to remove any wrinkles and curls on it. These fixing objects can cause problems during the measurement by entering the field of view or preventing the light's reflection on the product under examination. A vacuum module has been developed to solve this problem that can be easily attached to the movable floor table in the device subject to the invention, to be used when needed, thanks to its socket structure. Thanks to the air holes on the vacuum module attached to the movable floor table, it ensures that the object to be examined is kept fixed on the floor if any wrinkles or curved areas are removed, and thus, the examination can be carried out without any problems. When there is a need to fix the object to be examined on the ground and/or smooth the surface of the object, the user can easily disassemble the lower illumination module of the movable floor table, which can be easily disassembled and installed with its plug-in structure and can install the vacuum module in its place in a practical way.

The positions and directions of the illumination sources used in the devices in state of the art, similar to the subject invention, are fixed or adjusted manually. In the case of illumination with a stationary system from a fixed position, sufficient lighting area and homogeneity cannot be achieved, while the positions or angles of the illumination sources with respect to the object are mechanically adjusted, since the problems of incorrect adjustment of the angles and inclinations by the user and the inability to ensure repeatability decrease the reliability of the determinations as a result of the examination. Since the angle of incidence of the illumination sources on the examined object is a critical element for determining the optical characteristics or spectral properties precisely and accurately, to accomplish this, changing the positions of the panels without any error, illumination panels which have 250-1100nm wavelength range illumination sources located, designed to oscillate between 0-90 degrees on the horizontal axis and 115mm on the vertical axis without any manual intervention. Thus, strong and homogeneous illumination can be provided on the whole of the moving examination table on which the object to be examined is placed, and the horizontal and vertical positions of the illumination sources and their angle of incidence on the object can be adjusted with high precision without error. In addition, the repeatability or reproducibility of the measurements is also ensured by the use of the same and/or different examiners at different times to ensure that the lighting conditions can be provided in the same way to the finest detail in the examination processes on the same object.

Purpose of the Invention

This invention aims to develop a spectroscopic, hyperspectral, and digital imaging device that provides a noise-free measurement without interfering with unwanted parasitic signals, thanks to the exact and accurate positioning of the spectrometer fiber ends to any point on the surface of the object to be examined, without the need for manual intervention.

Another aim of this invention is to develop a spectroscopic, hyperspectral, and digital imaging device to examine the spectral properties of the object under investigation from all directions and without manual intervention of the user, it provides powerful and homogeneous illumination, high-precision automatic positioning, and alignment processes, and thus high accuracy, precision, precision, and repeatability thanks to its open frame stage, movable illumination system, and spectroscopic measurement module integrated into a rail system. Another aim of this invention is to develop a spectroscopic, hyperspectral, and digital imaging device that includes the imaging system, which has high resolution and high optical zoom capacity, can reduce the minimum focusing distance of 2 meters to the object to be examined under normal conditions to be able to focus, and an imaging area of 240x180mm can be obtained without any additional operation.

Another aim of the present invention is to develop a spectroscopic, hyperspectral, and digital imaging device that provides the prevention of changes that may occur in the position of the object relative to the ground during the examination and fixing the object on the floor to be examined using the air holes on it so that the surface of the object remains smooth during the examination with the help of the socketed structure of the vacuum module and a vacuum movable floor table that can be easily attached and detached depending on the need.

Descriptions of the Figures

Figure 1 : Isometric perspective drawing of the device

Figure 2: Sectional illustration of the interior of the device without covers

Figure 3: Sectional illustration of the device in which the illumination panel module in the device is moved horizontally using the telescopic rail movement system for maintenance and repair

Figure 4: Isometric perspective drawing of the open frame stage tray

Figure 5: Exploded perspective drawing of the open frame stage tray

Figure 6: Exploded perspective drawing of the subsystem that enables the open frame stage to make linear movement

Figure 7: Sectional drawing of the open frame stage mounted on the motorized rotary base plate that enables clockwise and counterclockwise rotation

Figure 8: Sectional drawing of the transitive illumination module in the open frame stage

Figure 9: Open frame stage with vacuum module Figure 10: Sectional drawing of the moving illumination system

Figure 11 : illumination panel module in moving illumination system

Figure 12: Sectional illustration showing the position of the spectroscopic measurement module and the movement mechanism in the moving illumination system

Figure 13: Cross-section drawing of the motion mechanism that provides the vertical movement of the spectroscopic measurement module

Figure 14: Cross-section drawing of the spectroscopic measurement module

Figure 15: Section drawing showing the placement of the spectroscopic measurement module in the protective cover

Figure 16: Cross-section drawing of the probe tip in the spectroscopic measurement module

Figure 17: Cross-section drawing of the probe tip in the spectroscopic measurement module used in the examination of biological samples

Figure 18: Isometric perspective drawing of the motion imaging system

Figure 19: Sectional illustration of camera modules and linear optical filter

Figure 20: Sectional illustration of the lens system and coaxial module

Figure 21 : Section drawing showing the position of the ultrasonic sensor and ultrasonic sensor in the moving illumination system

Descriptions of the References in the Figures

The reference signs are used for which part/feature in the figures is listed below:

11 : Device side covers

12: Aluminum covers

13: Movable side covers : Movable side covers handles : Side handles : On-Off button : RFID smart card reader : UV filtered viewing window : Movable Open Frame Stage : Aluminium leveling feet : Movable illumination system : Motorized belt and pulley system : Coaxial Module : Switchable - Moving imaging module. : Illumination Panel Module : Aluminum open frame stage surface : Diffuser glass : Stepper Motor : The linear guide rail system : Open frame stage transitive illumination. : The subsystem that provides a linear movement of the open frame stages : Aluminum plate : Linear guide rail : Linear guide block : Guide car : Proximity sensor : Spacer : Mechanic switch : The motorized rotary base plate : Vacuum Module : Perforated plate : Fan propeller tray : Fan blades 1 : Illumination panels 2: Halogen spotlight illumination sources 3: Aluminum heatsink plates 4: Telescopic rail system 5: Bevel gears connected to the gearmotor 6: Encoder motor 7: Belt and pulley mechanism 8: Trapezoidal ball screw and nuts design with toothed rollers on each side9: Fluorescent illumination sources 0: Aluminum plate 1 : Reducer motor 1 : Spectroscopic measuring module : Rack and pinion : Motor with brake : Linear slide rail : Steel installation part : Probe tip : Endoscopic camera module : Infrared led illumination sources : Protective Cover : Optic fiber measuring tip : Optic fiber illumination tip : Protective insulating outer membrane : Protective insulating inner membrane : Front lens module : Motorized zoom lens module : Linear optic filter : Rack and pinion : Colorful camera module : Colorful camera module fine-tuning screw mechanism : Monochrome camera module : Monochrome camera module fine-tuning screw mechanism : Rail motion module with linear actuators 192: Zoom lens

201 : Aluminum sheet 202: Coaxial illumination system 203: Coaxial Mirror 211 : Ultrasonic Sensor Disclosure of the invention

Figure 1 shows the isometric perspective drawing of the device described. The sides of the device, which has an enclosed design, are made of heat and light-proof PA66 material, while the side covers (11), the front, back, and bottom parts are covered with aluminum covers (12). Thus, during the use of the device for forensic, biological, chemical, and environmental examination purposes, it is completely isolated from external environment conditions, ensuring only the measurement targeted situation, preventing external factors from affecting the measurement results, and ensuring measurement reliability. The movable side covers (13) located on the front and sides of the device are made of an opaque material, and the movable side cover is opened by the user using its handles (14) and allows the sample to be examined into the device. There is a viewing window (18) with an ultraviolet (UV) filter over which the user can observe inside of the device on the movable side cover (13) located at the front. This viewing window has a UV filter that prevents the leakage of these rays from the window to protect the user from the harmful effects of ultraviolet radiation emitted from the internal illumination sources during the operation of the device. The side handles (15) on the sides of the device are used during the displacement of the device. There is an on- off button (16) and an RFID smart card reader (17) on the device's front.

Figure 2 shows the sectional drawing of the interior of the device without covers. The basic parts of the device that can be seen in the figure 2 and their functions are as follows: the movable open frame stage (21), on which the object to be examined is placed, permits the user to align process without the need for manual intervention and has the ability to perform clockwise and counterclockwise circular motion with linear movement in the two-dimensional plane (xy-plane) in order to achieve the examination process from all possible aspect and directions; ability to oscillate between 0-90 degrees in the horizontal axis thanks to the bevel gears (105) connected to the gearmotor, on which illumination sources of desired number, type and different wavelength can be used in order to provide a powerful and homogeneous illumination on the entire mobile floor table on the device floor a movable illumintion system (23) comprising movable illumination panels (101 ), which has stroke of 115 mm in the vertical axis by virtue of the motorized belt and pulley mechanism (24) and can be positioned accurately by the user with the computer interface software and the mechanisms that enable the movement of these panels; a coaxial module (25) comprising illumination sources together with the mirror positioned at a 45 degree angle to enable the image of the object located in the vertical plane to be dropped onto the display system in the horizontal plane; colorful and monochrome camera modules, lens system, linear optical filter and linear motorized motion mechanisms that allow them to be controlled, moved or aligned automatically using software interface, a moving imaging module (26) that provides high resolution and high optical zooming capacity.

Figure 3 shows the view of the illumination panel module (31 ), which contains the illumination panels (101 ) in the movable illumination system (23), pulled out of the device via the linear movement of the telescopic rail system (104). By moving the illumination panel module out of the device, it is ensured that the maintenance and repair operations of the illumination panels can be easily carried out. When the maintenance and/or repair process is completed, the module is moved into the device via the telescopic rail movement system and placed back into place.

In Figure 4, the object to be examined is placed on the movable open frame stage (21), at which linear movement and circular movement on the two-dimensional plane (xy plane) can be controlled with computer interface software without the need for manual intervention of the examiner, thus allowing the object to be examined precisely from all possible aspect and directions. Diffuser glass (42) surrounded by the upper open frame stage surface floor (41) is used to ensure that the light emitted from the open frame stage transitive illumination module (51 ) inside the movable open frame stage (21) is distributed homogeneously on the floor tray. By transferring the motion provided by the stepper motors (43) to the linear guide rail system (44), a movable open frame stage (21) can make a linear movement in a two-dimensional plane, and the object placed on the stage for the examination is aligned according to the illumination and imaging systems and spectroscopic measurement module.

Figure 5 shows an exploded perspective drawing of the movable open frame stage. In order to determine the photoluminescence (fluorescence, phosphorescence) properties of the objects under investigation, an open frame stage transitive illumination module

(51) containing LED and halogen lighting sources radiating in the ultraviolet (UV), infrared (IR), and visible (VIS) wavelengths is located just below the diffuser glass (42) ). Under the open frame stage surface (41 ), a subsystem provides the linear movement

(52) of the movable open frame stage (21).

In Figure 6, an exploded perspective drawing of the subsystem (52) that provides linear movement of the movable open frame stage (21 ) in a two-dimensional plane (xy plane) is shown. Subsystem (52) basically; consists of the aluminum plate (61) on which the moving parts are mounted, the linear guide rail (62) forming the linear guide rail system (44), the linear guide block (63), and the car (64), proximity sensors (65), aluminum plates (61) spacers (66), mechanical switches (67) and stepper motors (43) used to drive them.

In Figure 7, the view of the movable open frame stage (21) is mounted on the motorized rotary base plate (71) that enables clockwise and counterclockwise circular movements.

In Figure 8, the section drawing of the open frame stage transitive illumination module (51) is located inside the movable open frame stage (21).

Figure 9 shows the exploded perspective drawing of the vacuum module (91 ), which can be easily assembled by removing the open frame stage transitive illumination module (51) in the movable open frame stage (21), thanks to its socketed structure. In cases where the object placed on the movable open frame stage for examination is in a structure that can easily move from its place during the examination and/or there are factors such as wrinkles and curls that may negatively affect the measurement on the surface of the object, it is necessary to fix the object to be examined on the stage and to make the surface smooth and smooth by eliminating the wrinkles and folds on the surface. The vacuum module (91) is installed in its place by removing the open frame stage transitive illumination module (51) in the movable open frame stage when necessary. Thanks to the socket structure of the modules, they can be disassembled and installed practically. Vacuum module (91); It consists of a perforated plate (92) through which the airflow flows into the module passes, fan blades (94) creating airflow, and a fan propeller tray (93) in which the fan blades are placed, to fix the object placed on the floor and smooth its surface. The movable open frame on which the vacuum module (91) is mounted has the ability to perform linear movement and circular motion in the twodimensional plane (xy-plane), as mentioned earlier.

In Figure 10, the sectional drawing of the movable illumination system (23) is shown. There are four illumination panels (101) whose movements can be controlled with computer interface software on the device subject to the present invention so that the object to be examined can be illuminated strongly and homogeneously from all directions and the horizontal and vertical positions of the illumination sources, and the angle of incidence of the light on the object can be precisely adjusted without manual intervention at the time of examination. On these illumination panels (101), different types of lighting sources such as halogen, festoon, flash, fluorescent, and LED in the wavelength range of 250 nm - 1100 nm, which includes a part of the ultraviolet (ultraviolet - UV), visible (VIS) and infrared (IR) region of the electromagnetic spectrum, can be used in any number and combination. There are also ultraviolet fluorescent illumination sources (109) placed parallel to each other outside the illumination panel module (31) but within the movable illumination system. The user can choose the number and combination of the same or different types of illumination sources that emit the same or different wavelengths through the computer interface software, which are determined according to the type of object and examination type to be made of the study. A total of four halogen spotlight illumination sources (102), one between each adjacent illumination panels (101) in the illumination panel module (31), formed by positioning four illumination panels (101 ) side by side to create a square box is positioned at an angle of 45 degrees concerning the ground to provide homogeneous lighting on the floor. The use of halogen spotlight illumination sources (102) is preferred because they can provide optical data transmission over the entire visible band of the electromagnetic spectrum. The printed circuit boards (PCT) on which the circuit elements belonging to the illumination sources included in the illumination panels (101) are placed are mounted on a cooling panel consisting of finned aluminum heatsink plates (103). Aluminum heatsink plates (103) take the heat generated by the illumination sources on the electronic circuits by means of conduction and emit this heat to the environment through convection. The fins at the backside of the coolers provide a wide contact surface with air, allowing more heat to be released into the air by convection. Thus, by preventing excessive heat accumulation on electronic circuits, burning electronic circuits are prevented, and illumination sources are maintained at a specific temperature to ensure a longer life. The illumination panel module (31), which includes the illumination panels (101), is assembled with a telescopic rail system (104) consisting of interlocking rail mechanisms to make sure to ease maintenance and/or repair operations, and with using this system, the entire illumination panel module can be moved out of the device, and maintenance and/or repair when the process is completed, it can be placed again by moving it to its place in the device. The bevel gears connected to the reducer motor (111), which enables the illumination panels (101) to oscillate between 0 and 90 degrees in the horizontal axis, transmit the angular motion produced in the reducer motor to the illumination panels (101 ) illumination panels (101 ), gearmotor system, and bevel gears (105) connected to the gearmotor are mounted on an aluminum plate (110) from the top. The moment produced by the encoder motor (106) in the movable illumination system is transmitted to the belt-pulley mechanism (107) and then to the toothed rollers (108) with trapezoidal screws and nuts to which this mechanism is connected. The toothed rollers (108), on the other hand, apply the movement from the belt-pulley mechanism (107) to the aluminum plate (110) on which they are mounted and move the illumination panel module (31), on which the aluminum plate is attached, vertically up and down. Three-dimensional surface and shape estimation of the object can be made using the stereo photometric (photometric stereo) method from the multiple images obtained under different lighting conditions of the studied object by moving the illumination panels in horizontal and vertical directions. In Figure 11 , the illumination panel module (31) in the moving illumination system is shown. The illumination panel module; Illumination panels (101) with the ability of movement and including different types of illumination sources such as halogen, festoon, flash, fluorescent and LED that emit light in the wavelength range of 250 nm - 1100 nm, halogen spotlight illumination sources (102) positioned to see the floor at an angle of 45 degrees between the illumination panels, aluminum heatsink plates (103) mounted on the back of the illumination panels, geared reducer motor (111 ) that produces torque to ensure the movement of the illumination panels in the horizontal axis, bevel gears connected to the gearmotor (105) that transfer the torque and rotation movement created by the gear motor to the illumination panels, The device consists of a telescopic rail system (104) that allows it to be moved outside during maintenance and repair operations, and an aluminum plate (110) on which the illumination panels and motor system are mounted.

Figure 12 shows the spectroscopic measurement module (121) in the moving illumination system and the movement mechanism that includes the rack and pinion gear (122) and motor with brake (123) that enable this module to move in the vertical axis. Although the spectroscopic measurement module (121) is located in the moving illumination system, it does not enter the viewing area and the illumination angle, and it does not create a shadow on the object to be examined placed on the moving floor table. The object to be examined can be aligned according to the spectroscopic measurement module (121) by using the movable open frame stage (21 ) without any manual intervention of the user, and thanks to the movement mechanism of the spectroscopic measurement module (121), vertical movement can be achieved, and accurate positioning of the target point on the object up to 1 mm close can be made.

Figure 13 shows the cross-section drawing of the motion mechanism that provides vertical movement of the spectroscopic measurement module. The spectroscopic measurement module (121) is mounted to the rack gear from the rack and pinion gear (122) pair that makes up the movement mechanism. The vertical movement of the spectroscopic measuring module (121) is a linear gear (rack) that cooperates to convert the rotary motion generated in the brake motor (123) to linear motion, and this is provided by a pair of rack and pinion (122) gears, a type of linear actuator housing a circular gear (pinion) engaging the linear gear. The rotation of the pinion by the motor with brake 123 to which it is connected causes the rack to be driven linearly. The rack gear moves vertically up and down on the linear slide rail (131) to which it is connected, and thus, the proximity of the spectroscopic measurement module (121) mounted on the lower part of the rack to the object to be examined on the movable open frame stage (21) can be adjusted. The motor with brake (123) and the pinion is fixed to each other and the plate in the moving illumination system using a steel connection part (132), which generates the rotational moment for the rotation of the pinion.

Figure 14 shows the cross-sectional drawing of the spectroscopic measurement module (121 ). The spectroscopic measurement module includes probe tip (141), endoscopic camera modules (142), and infrared LED illumination sources (143). Inside the probe tip (141 ), there are optical fiber illumination tips (162) that can emit radiation in different wavelengths toward the surface of the object to be examined, and optical fiber measurement tip/tips (161) that allow obtaining reflectance values from the object surface for different wavelengths. Optical fiber tips arranged in the probe tip (141) are positioned in such a way to make accurate measurement precisely on the point targets on the object surface by using endoscopic camera modules (142) without the need for manual intervention of the user. As a result of the endoscopic camera modules (142) positioned on both sides of the probe tip (141 ) in a horizontal axis, the images obtained from different angles of the same object are processed using the "stereo vision" algorithm, and the depth and 3-dimensional structure of the object can be detected.

In order to detect visible region (VIS) fluorescence in luminescent materials and dyes with anti-Stokes fluorescence, where the wavelength of the emitted radiation is smaller than the wavelength of the absorbed radiation, infrared (IR) LED illumination sources (143) are used in the spectroscopic measurement module. If an anti-Stokes examination is desired, to obtain the emission spectrum in the visible region, a visible pass/infrared block filter is placed in front of the endoscopic cameras, which transmit visible light but prevents the transmission of infrared light, enabling imaging at emission wavelengths. With the infrared LED illumination sources (143) in the spectroscopic measurement module (121), the area to be examined is continuously illuminated and viewed live with filtered endoscopic camera modules (142), so continuous anti-Stokes examination can be performed on the examined object.

Figure 15 shows the protective cover (151 ) in which the spectroscopic measurement module (121) is placed. The protective cover consisting of two parts is resistant to the heat generated by the endoscopic camera modules (142) and infrared LED illumination sources (143).

Figure 16 shows the probe tip's (141) side and front sectional views housed within the spectroscopic measurement module (121). Inside the probe tip (141), 19 optical fiber tips are arranged in a circular pattern surrounded by a protective outer membrane (163). The middle end of these is the optical fiber measuring tip (161) that makes spectral reflectance measurement from the target point on the object's surface under investigation. The optical fiber measuring tip (161) is surrounded by optical fiber illumination tips (162) arranged in two rows and tangentially to each other, one containing six and the other 12. In order to obtain spectral signatures belonging to the object under investigation, reflectance measurements of the light of different wavelengths transmitted from the optical fiber illumination tips (162) to the surface of the examined object are made by the optical fiber measurement tip (161 ) and the collected data is transmitted to the spectrometer sensor to be converted into numerical values. When the measurement process is completed, the reflectance values obtained are displayed numerically and visually through the computer interface software.

Figure 17 shows the side and front section view of the probe tip (141) used in the spectroscopic measurement module (121) to examine biological samples. In order to make more precise and detailed measurements in the probe tip (141 ), seven optical fiber measurement tips (161) are arranged tangentially to each other and surrounded by an inner membrane (171) and separated from the optical fiber illumination tips (162). Optical fiber illumination tips (162) are arranged in two circular rows and tangent to each other so that they are between the inner membrane (171) and the outer membrane (163). The difference between the probe tip shown in Figure 17 and the probe tip shown in Figure 16 is a more accurate measurement because it contains more measurement and illumination fibers and the inner membrane (171) separating the measurement fibers, and illumination fibers create a distance between these two fiber groups thus the depth value can be adjusted depending on the thickness of the inner membrane (171). Therefore, with the thickness of the inner membrane (171), it is possible to obtain data under the surfaces of biological samples to be examined.

Figure 18 shows an isometric perspective drawing of the moving imaging system. The coaxial module (25), the cross-sectional view of which is shown in Figure 20; consists of a coaxial mirror (203) positioned at an angle of 45 degrees with the module floor to ensure that the image of the vertically positioned object is dropped on the camera sensor along the horizontal axis, and a coaxial illumination system (202) containing white LED illumination sources placed on the module ceiling to illuminate this mirror from above. The coaxial illumination system is used in cases where it is crucial to determine the characteristic properties of the textural structures of the objects to be examined. For this purpose, the reflectivity and contrast difference of the thin but deep and/or textural objects placed on the open frame stage is increased by white LED illumination sources that illuminate the coaxial mirror from above. The motorized zoom lens module (182) contains many different types of lenses, and these lenses can be moved in the desired direction, thanks to the movement mechanism and are compatible with the color and monochrome cameras (185,187) located at the rear of the lens module (182). The motorized zoom lens module (182) transfers the image onto the imaging sensor by enabling the cameras to focus on the object under examination at close distances up to 40 cm, thanks to the front lens module (181) attached to its front part. The linear optical filter (183) is able to filter for each wavelength band in narrow ranges of 1 nanometer in the visible and near-infrared (VNIR) part of the electromagnetic spectrum with a wavelength between approximately 400 nm and 1000 nm, and It prevents the passage of light of other wavelengths while providing the transmission. Using systems consisting of filters that pass different wavelengths, the measurement of the energy reflected from the object surface from the infrared and visible regions in a large number of narrow and adjacent wavelength bands, and the detection of a one-dimensional spectral sign of many image points called pixels in the image and the detection of this spectral information of the target object and a linear optical filter (183) is used in the device as mentioned earlier for the analysis of hyperspectral data where it is used for classification. The linear optical filter (183) is connected to the rack and pinion (184) gear at its bottom to be moved with nanometric precision. The color camera module fine- tuning focusing mechanism (186), which is used to precisely focus the high-resolution industrial camera in the color camera module (185), enables the image to be sharpened on the display screen by moving the camera closer to the lens system, thanks to the screw mechanism that moves the guide rail on which the camera is mounted. Color cameras have the ability to obtain high-resolution images in the visible region (VIS) with wavelengths in the 400-700nm range, while the quantum efficiency in the near-infrared (NIR) region with wavelengths in the range of 700-1 OOOnm is insufficient in terms of resolution. Therefore, in the device as mentioned earlier, a monochrome camera module (187) with high quantum efficiency is used in the near-infrared region where color cameras are insufficient. The monochrome camera module's fine-tuning focusing mechanism (188) enables the monochrome camera to zoom in and out towards the lens system to precisely focus and has the same features as the color camera fine-tuning focusing mechanism and performs the same function. With the moving imaging system, which has high resolution and high optical zoom capability, an area of 240 x 180 millimeters (mm) can be displayed, and thanks to the moving floor table and image processing methods, it is possible to increase this imaging area up to 300 x 300 mm.

Figure 19 shows the sectional drawing of the module consisting of camera modules (185,187) and linear optical filter (183) in the moving imaging system and the mechanisms that move them (191 , 184). The linear actuator rail motion module (191) provides instant displacement of color and monochrome camera modules according to the user's needs and alignment with the lens system using computer interface software. The nanometric precision movement of the linear optical filter (183) is provided by a pair of rack and pinion (184) gears, which convert the rotational motion produced by a motor to linear motion and transmit this motion to the linear optical filter. The zoom lens (192), located adjacent to the linear optical filter (183), is positioned between the camera modules and the motorized zoom lens module (182) to zoom the images obtained further. Figure 20 shows the lens system's sectional drawing, including the front lens module, and motorized zoom lens module (181 and 182), and coaxial module (25) mounted together. The motorized zoom lens module (182) and coaxial module (25) are mounted on an aluminum sheet (201) above them. A partially translucent coaxial mirror (203), defined as a "partially transmitting mirror" with high optical homogeneity in the coaxial module (25) and low losses due to light absorption and scattering, is positioned at an angle of 45 degrees with the floor of the module. It is assured that the image of the object to be examined in a vertical position is transferred to the imaging system horizontally. On the ceiling of the coaxial module (25), there is a coaxial illumination system (202) that illuminates the coaxial mirror (203) from above with white LED illumination sources and increases the reflectivity and contrast difference of the object under examination, and provides textural features.

In Figure 21 , the location of the ultrasonic sensor (211) in the movable illumination system (23) and a separate view of the ultrasonic sensor (211) from the system is shown. Using sound waves, the ultrasonic sensor (211) can measure the object's thickness placed on the floor plate for inspection without any contact with the object. Another function of the ultrasonic sensor (211) in the device is that the moving modules of the movable illumination system (23) measure the distances between the movable open frame stage (21) and the examined objects on the floor table using sound waves, thus preventing the moving modules from hitting the floor table and the object on it.

Although the display device of the invention is not shown in the figures, it is associated with the computer. Through the computer interface software, the user can determine, the type and number of illumination sources in the wavelength range determined in accordance with the type of object to be examined, their use in combination, their horizontal and vertical positions at the time of examination, their angle of arrival on the object and the electronic card positions on them; can control the open frame stage to make linear movement and rotation in the two-dimensional xy-plane, so that the object placed on the table can be easily examined from every angle; can adjust the vacuum intensity if the vacuum module is mounted on the open frame stage; can position the optical spectrometer fiber tips, which are arranged in a probe tip within the spectroscopic measurement module, and provide measurement, right on the target points on the surface of the object under examination by using the images obtained from the endoscopic cameras in the same module; can use the color and monochrome within the motion imaging system by instantly changing them as needed, can align the cameras according to the lens system, can move the linear optical filter with nanometric precision for hyperspectral analysis, make imaging at the desired wavelength and change the focal lengths of the lenses in the motorized zoom lens system. In order for the device to perform the necessary operations in line with the user's input, the computer interface software communicates with the motherboard in the device, and the central processor (CPU) in the motherboard sends signals to the relevant system parts via electronic circuits to fulfill the commands it receives from the computer.

As a result of using the spectroscopic measurement module, the spectral reflectance measurement data obtained regarding the object under investigation are displayed numerically and visually to the user via computer interface software. Each image in the image set called hyperspectral data cube, obtained in narrow and adjacent multiple wavelength bands of the object under investigation, represents a narrow wavelength range of the electromagnetic spectrum. For the analysis of the values collected as a spectral signature from each pixel in a hyperspectral image, using computer hyperspectral image analysis methods, pattern recognition algorithms, machine learning, and deep learning algorithms, it is possible to reveal the desired information in the images, identify the object, classify and detect anomalies.

Industrial Application of the Invention

The device of the invention reveals the desired information about the object as a result of analyzing the spectral information obtained about the object by measuring the amount of energy reflected and emitted from objects in different wavelength bands in many areas such as forensic science (forensic informatics and digital evidence, forensic chemistry, forensic toxicology, forensic molecular biology, forensic genetics, crime scene and criminalistics, crime analysis, etc.), defense industry, medicine, pharmacology, toxicology, medical, analytical chemistry, petrochemistry, molecular biology, microbiology, food, agriculture, hydrology and can perform target detection and recognition, classification and anomaly detection. The applications areas of mentioned device areas are as follows: determination of the authenticity, originality, fraud (modification, alteration, distortion, removal, addition, signature and text imitation etc.) and falsification (wipe, scraping, etc.) of the precious paper and official documents (banknote, stock, check, bond, stamp, identity card, passport, driver's license, diploma etc.) or papers whose accuracy is suspected; d etermination of whether seals, stamps, stamps, imprints and the like are original or fake, detection and diagnosis of fingerprints as evidence of crime, detection of signature and handwriting forgery, determining who owns the writings and/or signatures in the documents or whether they belong to the same person, determining whether known and suspicious documents are prepared by the same pen by examining the chemical composition of the inks on the documents, quality and originality analysis of food and agricultural products, detection and identification of microorganisms that cause food spoilage; quality control analysis and determination of chemical composition of products in pharmaceutical, petrochemical and chemical industries; determination of drinking water quality of groundwater, spring and mineral waters; detecting heavy metal pollution in soil and water; detection of toxic industrial products, chemical and biological agents; soil, sludge, water and waste water analysis; detecting impurities in final products or from raw materials; gaining diagnostic information about tissue physiology, morphology and composition; analysis of chemical and biological samples; identification of cancer cells; detection and identification of pathogenic microorganisms in body fluids such as blood, urine, saliva and sweat.

Claims

1. A spectroscopic, hyperspectral, and digital imaging device comprising; at least one frame stage on the floor ontowhich the object to be examined is placed, illumination sources providing homogeneous illumination throughout the open frame stage floor, an imaging system that includes at least one camera that enables the image to be obtained from the surface of the object under investigation, at least one optical filter that selectively transmits or rejects a wavelength or wavelength range, and at least one lens that focuses from a distance between the camera and the frame stage,

- at least one spectrometer optical fiber measuring tip (161) that makes spectral measurements on the object under investigation, at least one optical fiber illumination tip (162) that provides illumination of the object surface, and at least one probe tip (141 ) containing a protective insulating outer membrane (163) surrounding the optical fiber measuring and illumination tips (161 ,162) and on the target point on the object surface, and a spectroscopic measurement module (121) with at least one endoscopic camera (142) that allows images to be taken at close proximity to the object surface to precisely position the probe tip

- a CPU (Central Processing Unit) that manages the operation of the device.

2. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a linear guide rail system (44) connected with at least one motor, which enables the floor of the device to make a linear movement on the two- dimensional xy-plane.

3. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a motorized rotary base plate (71) mounted on the bottom to enable the floor table to make circular movements.

4. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein the floor table comprises an open frame stage transitive illumination (51) module in which light sources emitting ultraviolet, infrared or visible light are placed.

5. The spectroscopic, hyperspectral, and digital imaging device according to claim 4 wherein the open frame stage transitive illumination (51) module has a socket structure that allows it to be easily attached disassembled on the floor table when desired.

6. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a vacuum module (91) that can be mounted inside the floor tray to fix the object under investigation and smooth its surface.

7. The spectroscopic, hyperspectral, and digital imaging device according to claim 6 wherein the vacuum module (91) has a socketed structure that allows it to be easily attached and detached from the floor table when desired.

8. The spectroscopic, hyperspectral, and digital imaging device according to claim 6 wherein the vacuum module (91 ) contains fan blades (94) covered with a perforated plate (92).

9. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein illumination sources are halogen, festoon, flash, fluorescent and LED lamps that emit light in the wavelength range of 250-1100nm.

10. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising illumination panels (101) on which illumination sources are positioned.

11. The spectroscopic, hyperspectral, and digital imaging device according to claim 10 comprising bevel gears connected to the gearmotor (105) that enables the illumination panels (101 ) to oscillate between 0 and 90 degrees on the horizontal axis.

12. The spectroscopic, hyperspectral, and digital imaging device according to claim 10 comprising a belt-pulley mechanism (107) connected to the encoder motor (106) to ensure the movement of the illumination panels (101) on the vertical axis and toothed rollers with trapezoidal screws and nuts (108) to which this mechanism is connected.

13. The spectroscopic, hyperspectral, and digital imaging device according to claim 10 comprising a telescopic rail system (104) connected with the illumination panels (101) to enable the illumination panels (101) to be moved out of the device during maintenance-repair processes.

14. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein at least one camera in the imaging system is preferably a colorful camera (185) or a monochrome camera (187).

15. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a rail motion with a linear actuator module (191) that aligns at least one camera with respect to at least one lens.

16. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a rack and pinion (184) gear connected to a motor to move at least one optical filter with nanometric precision.

17. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein at least one lens has a motorized zoom feature that allows the focal length to be changed by an internal motor.

18. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein the imaging system further comprises a partially transmitting mirror positioned to make a 45-degree angle with the ground, and a coaxial module (25) containing white LED illumination sources illuminating this mirror from above.

19. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 comprising a rack and pinion (122) gear associated with the linear slide rail (131) to enable the spectroscopic measurement module (121) to be moved along the vertical axis.

20. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein the spectroscopic measurement module (121 ) further comprises infrared LED illumination sources (143) for anti-Stokes inspection.

21. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein there is preferably a protective insulating inner membrane (171) inside the probe tip (141), surrounding at least one optical fiber measuring tip (161) and separating it from at least one optical fiber illumination tip (162), for obtaining data from under their surface during the examination of biological samples.

22. The spectroscopic, hyperspectral, and digital imaging device according to claim 1 wherein the device is connected with a computer where spectral and hyperspectral image analysis methods, pattern recognition algorithms, machine learning, and deep learning algorithms can be used.

23. The spectroscopic, hyperspectral, and digital imaging device according to claim 22 wherein the device is controlled with a computer interface software.