OA19485A - Gemological object recognition. - Google Patents
Gemological object recognition. Download PDFInfo
- Publication number
- OA19485A OA19485A OA1201900387 OA19485A OA 19485 A OA19485 A OA 19485A OA 1201900387 OA1201900387 OA 1201900387 OA 19485 A OA19485 A OA 19485A
- Authority
- OA
- OAPI
- Prior art keywords
- caméra
- imaging
- recognized
- gemstone
- location
- Prior art date
Links
- 239000010437 gem Substances 0.000 claims abstract description 139
- 229910001751 gemstone Inorganic materials 0.000 claims abstract description 139
- 238000003384 imaging method Methods 0.000 claims abstract description 123
- 238000005286 illumination Methods 0.000 claims abstract description 60
- 230000000875 corresponding Effects 0.000 claims description 24
- 230000001131 transforming Effects 0.000 claims description 16
- 230000003287 optical Effects 0.000 claims description 12
- 238000007689 inspection Methods 0.000 claims description 11
- 239000010432 diamond Substances 0.000 claims description 6
- 229910003460 diamond Inorganic materials 0.000 claims description 6
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 230000000694 effects Effects 0.000 claims description 4
- 230000002708 enhancing Effects 0.000 claims description 4
- 238000005755 formation reaction Methods 0.000 claims 3
- 230000005284 excitation Effects 0.000 claims 1
- 239000004575 stone Substances 0.000 claims 1
- 230000000007 visual effect Effects 0.000 abstract description 15
- 238000004891 communication Methods 0.000 description 18
- 238000010586 diagram Methods 0.000 description 17
- 230000015654 memory Effects 0.000 description 16
- 239000000203 mixture Substances 0.000 description 16
- 238000003860 storage Methods 0.000 description 13
- 238000000844 transformation Methods 0.000 description 12
- 238000005259 measurement Methods 0.000 description 10
- 230000005291 magnetic Effects 0.000 description 7
- 238000000034 method Methods 0.000 description 7
- 239000003550 marker Substances 0.000 description 5
- 230000001413 cellular Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000005520 electrodynamics Effects 0.000 description 4
- 230000001276 controlling effect Effects 0.000 description 3
- 230000005684 electric field Effects 0.000 description 3
- 230000001629 suppression Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000001186 cumulative Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000004313 glare Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000006011 modification reaction Methods 0.000 description 2
- 230000035939 shock Effects 0.000 description 2
- 230000001360 synchronised Effects 0.000 description 2
- 229910052582 BN Inorganic materials 0.000 description 1
- BJQHLKABXJIVAM-UHFFFAOYSA-N Bis(2-ethylhexyl) phthalate Chemical compound CCCCC(CC)COC(=O)C1=CC=CC=C1C(=O)OCC(CC)CCCC BJQHLKABXJIVAM-UHFFFAOYSA-N 0.000 description 1
- 229920002574 CR-39 Polymers 0.000 description 1
- 241000579895 Chlorostilbon Species 0.000 description 1
- PZNSFCLAULLKQX-UHFFFAOYSA-N N#B Chemical compound N#B PZNSFCLAULLKQX-UHFFFAOYSA-N 0.000 description 1
- 238000003302 UV-light treatment Methods 0.000 description 1
- 240000008042 Zea mays Species 0.000 description 1
- 235000002017 Zea mays subsp mays Nutrition 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 125000004432 carbon atoms Chemical group C* 0.000 description 1
- 235000005822 corn Nutrition 0.000 description 1
- 235000005824 corn Nutrition 0.000 description 1
- 230000001808 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000010192 crystallographic characterization Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 229920005994 diacetyl cellulose Polymers 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000010976 emerald Substances 0.000 description 1
- 229910052876 emerald Inorganic materials 0.000 description 1
- 230000004907 flux Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000002452 interceptive Effects 0.000 description 1
- 230000016507 interphase Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 108010083077 roundabout protein Proteins 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static Effects 0.000 description 1
- 230000001052 transient Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Abstract
This disclosure describes a system, method, and devices as system elements to recognize an object by an object recognizing system comprising an imaging device and a moving assembly to move said imaging device around said object, to form a certified visual model of the object to be recognized. Especially the disclosure relates to gemstone imaging by an imaging method comprising photographing a target, in an illumination, by a camera, to obtain at least one image of the targeted object to be recognized.
Description
[0025] The following description and the drawings sufficiently illustrate spécifie embodiments to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. Portions and features of some embodiments may be included in, or substituted for, those of other embodiments. Embodiments set forth in the claims encompass ail available équivalents of those claims. Example embodiments of the présent disclosure relate to Systems, methods, and devices for recording frames of an object to be recognized.
[0026] In one embodiment, the object of being recognized, is imaged by making a visual model about it by photographing the object by a caméra, from positions corresponding around the object an imaginary sphere corresponding locations, so that the taken frames (by caméra) form the visual model of the object to recognized in such a manner that the ensemble of the frames allow a user to observe, inspect and/or retrieve the object on-line and rotate and/or magnify the object and/or its measures of character and/or authenticity, in a manner to allow to give an e-certificate about the object to be recognized to a user at the user site.
[0027] Certain embodiments may be implemented in one or a combination of hardware, firmware, and software. Other embodiments may also be implemented as instructions stored on a computer-readable storage device, which may be read and executed by at least one processor to perform the operations described herein. A computer-readable storage device may include any non-transitory memory mechanism for storing information in a form readable by a machine (e.g., a computer). For example, a computer-readable storage device may include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, and other storage devices and media. In some embodiments, the communication unit may include one or more processors and may be configured with instructions stored on a computer-readable storage device memory.
[0028] Examples, as described herein, may include or may operate on logic or a number of components, modules, or mechanisms. Modules are tangible entities (e.g., hardware) capable of performing specified operations when operating. A module can include hardware. In an example, the hardware may be specifically configured to carry out a spécifie operation (e.g., hardwired). In another example, the hardware may include configurable execution units (e.g., transistors, circuits, etc.) and a computer readable medium containing instructions where the instructions configure the execution units such as a rnicroprocessor for example, to carry out a spécifie operation when in operation. The configuring may occur under the direction of the executions units or a loading mechanism. Accordingly, the execution units are communicatively coupled to the computer-readable medium when the device is operating. Although the Figs are showing some examples on embodiments, it is not intended to limit the dimensions, géométrie ratios and/or their mutual relations only to the shown examples used in the Figs. A skilled person in the field can scale dimensions based on the embodiments for further variants without leaving the scope of the claimed embodiments. Embodiments of the invention are combinable in suitable part.
[0029] FIG. IA depicts a schematic illustrating an example of a system parts as piece of hardware using a caméra as an imaging device to take images and/or video frames from the object to be recognized on a base. The caméra can rotate along an exemplified path in the Φ-direction with incrémental (ΔΦ) position movements. Fig 9 gives a further example of an embodied implémentation example. The object to be recognized has been embodied as a diamond-shaped gemstone with the crown (height hc), pavilion (height hp), culet and mesa, the mesa part of the object being drawn as on the base, illustrated by the line. The object being enabled to get rotated in the ©-directions in a plane incrementally (ΔΘ) as illustrated in FIG IB. The rotation and the caméra movement can be implemented so that the images and/or video frames would form such an effect that the images and video frames would hâve been taken from an imaginary sphere or dôme surface around the object.
[0030] FIG IC depicts a schematic illustrating tilting of the base in an embodiment, so that the caméra path could be also embodied as in FIG 1 A, but by constant path, but in an enabling manner to produce paths in inclined planes in the object-centered coordinate system for the dôme.
[0031] FIG ID depicts an illustrative manner coordinate Systems such as Spherical (Sph), Cylindrical (Cyl) and Cartesian (Car) coordinate Systems. The arrows Tri, Tr2 and Tr3 illustrate coordinate transformations from one coordinate system to another. The opposite direction pointing near-arrows illustrate the respective inverse transformations (TrF1, Tr2-1, Tr3'’). In addition to the coordinate Systems, the FIG ID illustrâtes also respective optional illumination geometries to illuminate accordingly the object to be recognized. This is also used in the FIG IG, to show the geometries for diffuse illumination through the opaque screens respectively following the geometry in the FIG IG indicated by the dashed Unes. According to an embodiment, Tri and TrF \ with reference to FIG ID, are considered between a cylindrical and a spherical coordinate of an arbitrary point P transformations: Tri: P(©,r,h) => Ρ(Θ,Φ,γ) and inversely the Tri'1 Ρ(Θ,Φ,γ) => P(©,r,h). According to an embodiment transformations Tr2 and Tr2’’ are considered between a Cartesian and a cylindrical coordinate of the point P transformations: Tr2: P(x,y,z) => P(©,r,h) and Tr2-1: P(©,r,h) => P(x,y,z). According to an embodiment transformations Tr3 and Tr3-1 are between a Cartesian and a spherical coordinate of the point P transformations: Tr3: P(x,y,z) => Ρ(Θ,Φ,γ) and Tr3-1: Ρ(Θ,Φ,γ) => P(x,y,z). The symbols r dénotés to radius and h to height coordinate. Particularly in spherical or a dôme or part thereof, the r can be considered as the caméra distance from the object to be recognized. Transformations can be used in image corrections where applicable in suitable part, even so that image distortions, origo mismatch, translatory discrepancies etc.can be corrected inside a same coordinate system, (i.e. from Spherical to Spherical or from Spherical to Cartesian, for example), when needed. The transformation can be made by a computer, in a microprocessor belonging in to the system, as well as the incrément calculations and/or transformations relating to such where needed.
[0032] FIG 1E depicts an illustrative manner an object holder, the object to be held in the illumination chamber as in FIG IG with an embodied geometry. The object is positioned between the plates, plate 1 and plate2 so that the inclined plate 1 holds the object in the position. The plates can be made of transparent material, and could be coated in suitable part against scratches. Examples of suitable materials can be boron nitride and/or DLC with over 90% of sp3 orbital structured bonds between the carbon atoms. In an embodiment example, the base has means for damping vibrations, passively by shock absorption means, in another variant a transducer for active damping in counter phase, in suitable part in addition or alternative, to produce counterphased vibrations. The base can be also tilted in suitable part in respect ofthe châssis (FIG IG), and/or the base can be rotated. The base can be in an embodied system. The system can tilt and/or rotate the base and/or the object in suitable part for different kind of paths of the caméra in respect to the object, in the control of the control unit.
[0033] In FIG 1F an object to be recognized is illustrated as such on a base. In this optional embodiment the object can be in a different starting position than in the FIG IE. The base can be in an embodied system. The system can tilt and/or rotate the base and/or the object in suitable part.
[0034] In FIG IG the imaging device is embodied with the caméra that is illustrated to be schematically connected to an arm (as seen above, illustrated by a black dot), to facilitate the movement along the path (cf. FIG IA for example, and FIG 9 alternatives) around the object. The caméra is positioned so that it illustrâtes taking frames, images and/or video, so that there can be also the background Bgrnd in suitable part. The background can be chosen to dark, gray, colored otherwise or white, to enhance the contrast of the object’s visual appearance, and/or to distinguish the measures of character of the object. The object and the background can be embodied to tilt together in an embodiment variant. The object can be on a base according to the disclosure (i.e. as in FIG IE, 1F, 1H, for example, also as in FIG 9), positioned on châssis holding the whole system with the base. The caméra can be connected to the measurement device MD as illustrated by the line between the rectangle surrounding the embodied parts therein and the caméra. The rectangle can be functionally connected to the châssis, caméra and to the arm for the Controls thereof in an example of an embodiment. According to an embodiment, the measurement device MD can comprise control unit Contr arranged to control the operations of the measurement device, for example, in the control of the microprocessor μΡ, which also can be used to collect the images and/or video frames into the memory Mem that can comprise in suitable part volatile and/or permanent memory. Microprocessor also is responsible to authenticate the frames by using authentication means AuthG to generate authentication tag to the suitably predefined frames to form an authentication code for the virtual model of the object to be recognized. The pictorial data formed from the frames is embodied being stored into the database DB that is exemplified as an internai database to the system. However, in suitable part the pictorial data of the virtual model can be also communicated to extemal databases Ext DB in suitable part by the communication means Corn, arranged to communicate with the user via a user interphase and/or to communicate between suitable system éléments, such as the control unit. The other system parts such as motor drivers (Serve) and sensing éléments (Sense) can provide data to the microprocessor for the frames, i.e. position etc. The data so exemplified can be in suitable part stored to the memory, to the local database, and/or to the remote, extemal database, Ext DB. According to an embodiment at least one of the databases, (Ext DB for example and/or Memory Mem can be embodied by a cloud. The ADC DAC element in the system is used in digital conversions between analog and digital signais, in measurements and/or in control cornmands. Robo is illustrative of a control means to control an industrial robot to be used as a manipulator to handle object to the chamber, on to the base and back to the depository of the objects, gemstones according to an embodiment, etc mechanical operations and/or position changes.
[0035] The authentication generator AuthG as such can provide authentication tags to the frames in the control of the microprocessor and an algorithm to control the measurement and/or the object récognition in the embodiments in suitable part. The authentication generator can produce tags according to a known algorithm as such to produce a number queues as such, from a suitable starting number to suitable ending number for the tag trames, for example. The so formed code, authentication code (Auth code) can be communicated via the communication means also in suitable part to the external database for example, so that a similar generator can dismantle the code from the meant frames and recognize the Virtual model to be an authentic from the communicated authentication code, or its preselected parts for the récognition. The coding can vary according to a predefined scheme as such as used in the network protocols in the communications used. The number queues for the tags can be cumulative built so that the next number in queue is a sum of the previous two formers, for example, and/or cumulative in such a manner that ail the numbers are summed for the next number. A skilled person knows based on the embodiments, when read and understood many ways to implement the tags. According to an embodiment, the AuthG can calculate also the location of the frames that are to be provided with the tag, according to the same queue for an embodiment variant, but according to another variant from a different number queue. The number queues can be communicated between the producing site and reading site in a coded and/or secrete form, over the used media, i.e. an information network, so that the authentication can be proven when exists. Authentication code can be communicated via secure channel between the communications sites.
[0036] Servo illustrâtes hardware (and software built in suitable part) to drive the arm and the caméra along the path around the object, but also to drive the tilting and/or rotation of the base, so that the incréments ΔΘ and ΔΦ can map the imaginary sphere locations to provide the view to the object to be recognized as viewed from the caméra distance, corresponding the imaginary sphere, in an object récognition event, in recordings and/or retrievals.
[0037] Sense illustrâtes sensors means (and software built in suitable part), to measure the ambient conditions of température, pressure, humidity, lighting, but also in suitable part pressure of grasp of the robot and/or weight of the object, as well as to take part in measuring electric fields, with respective measuring means for, magnetic fluxes, gas flows, acoustic frequencies, and/or gas pressures, in a maintaining loop and/or adjustment of the conditions in an object récognition event, in recordings and/or retrievals.
[0038] MV illustrâtes Mechanical Vibration damping system controller to control the damping system embodied that can be based in suitable part in passive layers in the base to absorb shocks in an embodiment, but in another embodiment in suitable part active transducers in the base to produce counter-phased vibrations to cancel the mechanical vibrations.
[0039] The FIG 1H illustrâtes such a base that holds the object in a levitated position, as based on a force field F to cancel the weight of the object G. In an embodiment the force field F can be based on electric field, to combine static and/or dynamic fields to counter-balance the gravity. The force field component F can be produced by the transducer Tf, as being connected to a suitable source, such as a voltage source for example to produce the force field component. The same Tf symbol also illustrâtes magnetic field based transducer to produce a magnetic field to contribute to the lévitation effect. According to an embodiment the transducer can in addition or alternative being used to produce flow to utilize Bernoulli-principle to hold the object in the flow. According to an embodiment variant, the transducer Tf can comprise also in suitable extent an acoustic means to make the object levitate in an acoustic ultrasound filed.
[0040] In FIG 1H the force field components RI, R2, R3 and R4 illustrate radial force components in the cross sectional scheme of FIG 1H. The radial components can be produced by the ring-type transducer T to center the object to the ring center, that is in such an embodiment also the center of the imaginary sphere of the caméra path, so being to minimize needs for the corrections in the imaging, so saving processor time in the image processing.
[0041] FIG. 2A illustrâtes the visual model of the object to be recognized as a composition of images and/or video frames. Images and frames are illustrated by Fr, being taken from a position defined by the incrémental positions of the path on the imaginary sphere (Θη, Φη) locations, so that each location n, a stack (Sti, St2 - - - Stn) of frames (Fr) has been recorded by the caméra, so that there is at least one frame Fr in each stack Stn corresponding the location so that they surround the object to be recognized by the frames. The dashed line rectangles tagl, tag2 and tagn illustrate tags on such frames that hâve been provided with the corresponding authentication tag. The tags form an authentication code, being formed in the control of the microprocessor in FIG IG, by the authentication generator AuthG, and the related algorithm to produce authentication code. Although the example in FIG 2A is indicative that the authentication code for the virtual model can be formed from the composition ofthe tags (1, 2, ...n for the position in the stacks) (indicated by the sigma-character), also pre-determined parts of the ensemble of the tags can be used to form the authentication code as such. If needed, the exemplified transformations of Fig ID can be used between transformations of various coordinate Systems.
[0042] FIG 2B illustrâtes example about information of a visual model in a file about the object to be recognized as collected and/or as read for retrieval by a user. According to an embodiment the information can comprise such measures of character as cracks Cr, Color Anomalies CoA, shadows Sh, inclusions I, bubles Bbl, and/or other features that can be observable from the frames taken around the object to be recognized from the positions to correspond the imaginary sphere. The measures of characters can be used in suitable part as measures of authentication in suitable part, if not ali are so considered. The measures of character (and/or as used as measures of authentication of inbound origin) can be shown with their location and measured size, and/or where applicable also with composition.
[0043] According to an embodiment, an authentication code can be shown in such a mode that a remote user can also recognize the authentication status, although the authentication code as such in an explicit mode and/or the tagged frames as such were not used to be shown to the user. The authentication code as such also confïrms with the measures of authentication of inbound origin that a gemstone as such as an object to be recognized is an authentic object. According to an embodiment, measures of authenticity can include also the authentication code. According to an embodiment, authentication code and/or other measures of authenticity can be partly, in suitable part, communicated to a remote user, so that the remaining measures not yet being communicated can be reserved for purposes of further vérification of the user and/or site in the communication loop between the parties involved in the retrieval. Also géométrie measures, for a gemstone as such, as Crown (diameter, height), Crown (mesa, dia), Pavilion (height), Refraction index, Weight, Found (place, who, when), Honed (place, who, when), Owned, and/or repository location can be recorded and/or shown to a user. The object record (FIG 2B) can form an electric Certificate in suitable part of the shown information.
[0044] According to an embodiment a user can graphically make a sélection as based on the measures of authentication on a certain range on the object to be recognized, in the example of FIG 2B a diamond, the sélection being indicated by the circular dashed line. According to an embodiment the user has found from the data bases such a diamond that has in the selected area/volume four inclusions (black dots) and two bubles (hollow circles). The diamond has also outside the area a shadowed volume Sh, and a crack Cr extending to the selected area, and another crack outside the sélection. There is also a color anomaly CoA outside the sélection and some inclusions, and a bubble outside the sélection. According to an embodiment the size of the measures of authentication can be user selectable for the size to be included into the retrieval, if not ail those that which hâve been recognized in the frames were not wanted to be considered in the retrieval and/or for the certificate.
[0045] FIG 3 illustrâtes a scheme of an example of a caméra comprising three caméra units (caméra unit 1, caméra unit 2, and caméra unit 3). The caméra unit 3 is a double caméra unit having in this example two imaging surfaces (imaging surface 3 and imaging surface 4). The caméra unit 1 and caméra unit 2 hâve respective imaging surfaces 1 and 2, to be used in recording the frames into the corresponding frame-stacks Stl, St2, St3 and St4. Each of the caméra units can be focused to its own focal plane in the object to be recognized. The additional focal planes are indicated with a lens-shaped symbol with the corresponding focus reference Focl, Foc2 and Foc3 referring to the respective caméra unit and the focal plane according to the indicated number. According to an embodiment variant, the caméra units can hâve each a filter (optionahty indicated by the dashed lines), so that the caméra unit can pick certain ranges of the illumination wave lengths to the images at the focal plane of the caméra unit. The filters can be passive units in suitable part, but according to an embodiment, can comprise for example an etalon-based structure to pass a certain wavelength range of the illumination to the imaging surface, according to a further variant in a controllable manner by the control unit (FIG IG). The SPL(%%)-objects are indicative of splitting the incoming illumination with the number indicated percentage. For example, SPL(25) mirrors 25 % of the illumination to the imaging surface 1, via the filter 1, at the focus Focl focused to the corresponding focal plane in the object to be recognized. SPL(33) mirrors 33 % of the illumination to the imaging surface 2, via the filter 2, at the focus Foc2 focused to the corresponding focal plane in the object to be recognized. SPL(50) mirrors 50 % of the illumination to the imaging surface 3 via the filter 3 at the focus Foc3 focused to the corresponding focal plane in the object to be recognized. The rest of the illumination coming to the caméra is received by the imaging surface 4. Although any further filter not shown, a skilled person in the art understands that the illumination can be also filtered m suitable part in an embodiment variant.
[0046] According to a further embodiment variant, the focus of the caméra to produce focal depth in the object can be varied so that a single caméra unit can be used to produce an ensemble of corresponding frame stacks with varying focal point with the corresponding focal plane in the object to be recognized at a caméra location (Θη, Φη)·
[0047] Fig 4 illustrâtes récognition of authenticity of an object at a remote site via a user given certificate. The certificate has been given about an object to be recognized at a recognizing site, as based on the information in the database DB, the visual model being formed from the object with an associated authentication code Σ tagn(0n/Dn). The remote site, being able to recognize the code and the tag locations and the tag values, can then acknowledge (Ackn) the récognition site via a communications network, such as an Internet, for example, that the visual model was received and stated to be authenticated correctly so that an e-certificate could hâve been formed. According to an embodiment, the authentication code can be communicated between the sites in a secure channel, and/or as encrypted.
[0048] In the examples referring to the Fig 5 to 8, they are using a Cartesian coordinate type of notation when referring to the planes of caméra path in the recordings of the frames, with a solution based on an embodied System, non-secured gemstones can be photographed thoroughly without any visible attachments. According to an embodiment, it is based on predefmed X-Y axes of the gemstone, predefined gemstone x-y imaging angles based on these axes and/or calculating needed caméra angle to position the caméra on a gemstone imaging angle. The coordinates can be transformed as illustrated by the Fig ID.
[0049] According to an embodiment, the gemstone’s X-Y axes are defined
[0050] a. X-axis is perpendicular to the gemstone’s tablet, a mesa, (as illustrated for an example in Fig 1)
[0051] b. according to an embodiment, Y-axis is perpendicular to the X-axis and in alignment with a marker. According to an embodiment the marker can be at least one of the following: a character of authenticity, a chosen edge of the gemstone, which position is controlled throughout the photography process, some visible feature of the gemstone and external marker, e.g. UV-pen which is then detected in UV-light.
[0052] According to an embodiment, also a temporary thermal hot point can be used as a marker, being made and/or maintained by a suitable laser for example to be used for making such, that is about to cool down by its own, without any trace or damage after the process of imaging. However, for repeatability such a marker can be made in respect to a feature ofthe gemstone for a re-imaging.
[0053] Fig 6 embodies an example according to which there are shown by the numbers angles in degrees for planes of caméra paths (imaging paths) in combination to base positions, according to which an imaging is made for example. The shown degree values between 0 and 360 are not limiting the imaging used planes only to the shown values (0, 45, 90, 135, 180, 225, 279, 315). Gemstone 506 as an object to be imaged and also recognized (in the middle) x 360 imaging angles are based on X axis. 0 point is on the Y axis. The X-axis is common in the example to the planes. Also other angles can be used in the incrément formations according to the coordinate system in use.
[0054] Fig 7 embodies an example according to which there are shown by the numbers angles in degrees for planes of caméra paths (imaging paths) in combination to base positions, according to which an imaging can be made. The shown degree values between 0 and 360 are not limiting the imaging used planes only to the shown values (0, 45, 90, 135, 180, 225, 279, 315). Gemstone 506 as an object to be imaged and also recognized (in the middle) x 360 imaging angles are based on Y axis. 0 point is on the X axis. The Y-axis is common in the example to the planes.
[0055] In Fig 8 example, gemstone x-y imaging angles of x=35/y=250; x=90/y=250; x=90/y=340; x=35/y=340 and x=315/y=45 were used to define the planes of caméra paths (imaging paths) in combination to base positions. According to an embodiment, for example only five different gemstones imaging angles were presented in Fig 8. In practice, the imaging angles are defined in an embodiment in 2 or 4-degree incréments (ΔΘ, ΔΦ, cf FIG la and 1b) to capture gemstone movement accurately enough in respect to the imaging caméra. This results in 4096 or 16 200 total images per single gemstone.
[0056] In Fig 9, an embodied imaging system 500 device example in terms of hardware of moving assembly has been illustrated as an example. The system device is supported by a support 501 to the ground surface or the châssis of the system. Although a two-beam four-leg support is embodied in the example, it is not intended to limit the support only to the shown example. To the support 501 there is connected a beam 508 by a joint 504 that is such a joint that facilitâtes rotation of a second beam, a caméra supporting beam 507 to pivot in a plane defined by the movement path ofthe pivoting. Examples in suitable part for illustration are shown in Figs 6 to 8. The caméra 503 is attached to the caméra boom 502 acting as an arm, between the beams 507, so that the position of the caméra can be moved. According to an embodiment the parts part 505, part
508, part 504, part 507 and the caméra 503 dimensions set an example of a value to the distance r from the gemstone 506 for the imaginary sphere. Although a straight caméra boom 502 has been given as an example, it is also possible to use curved geometry, for the caméra beam 502 but also for the beams 507 so that the caméra position can be moved according to the curved path along the caméra boom 502, thus providing accordingly an alternating distance to the gemstone 506. The caméra 503 can be embodied so that it has 3D-rotation facilities at the attachment assembly to the caméra boom 502, to point to the target 506, which in this example is embodied as a gemstone 506, for example an emerald, but is not limited only to the named type of gemstone. The gemstone 506 is positioned on the base 505, which is arranged to rotate to any position of a circular path as illustrated by the arrow in the plane, as explained also in accordance of Fig IB.
[0057] The base 505 is shown as to be positioned on the beam 508 so that the pivotable joint 504 and the beam 508 facilitate the caméra 503 to point to the middle of the base 505 positioned gemstone 506 for imaging for taking frames. According to an embodiment, the movements can be made by suitable electromechanical actuators, such as for example motors and/or sprocket wheels to be used in the positioning. These means for the positioning can be controlled by a computer by electrical control signais in a control of a control unit. The system can also comprise necessary switches and/or position detectors to facilitate monitoring of the path when recording/taking the frames, in accordance of the control signais, but also for making a log on the imaging of the gemstone 506 individual, to be recorded for the visual model of such an object to be recognized.
[0058] A robot that can be used in the embodiments as a manipulator for the feeding the base and/or exiting the gemstone as such, but is not shown in the Fig 9. According to an embodiment example a mechanical hand with few fingers can be used for the purpose. According to an embodiment the imaging, the gemstone set and take-outs are synchronized with the caméra movement start and/or stop by the computer controlling the system. According to an embodiment illumination being used and/or controlled, can be implemented via the base 505 in suitable part, to hold the gemstone as the object to be recognized, but also other options to provide an embodied radiation for the illumination can be used in accordance of the examples.
[0059] In Fig 10 there is illustrated a gemstone 506 on the base 505. The Fig illustrâtes by the non-limiting examples ΔΧ and ΔΥ (according to the Cartesian notation, which can be transformed to other coordinate system with the coordinate system compatible incréments) the imaging system axis in such a case that they differ from the corresponding axis of the gemstone 506, that is tilted in respect to the Cartesian axis. According to an embodiment the method can comprise a transformation step in which the tilt is straightened. However, the same symbols also illustrate in a schematic way such embodiments that make the imaging in a stepwise manner to incrément the photographing angles by the As. Although A- symbol used for both X and Y-axis, the incréments need not to be necessarily the same for the incrementing of the imaging positions ofthe predefined angles.
[0060] According to an embodiment, before taking image frames, the tilt of gemstone is measured as illustrated in Fig 10. In an embodied method (Fig 11) according to an optional imaging method, the imaging system checks 701 for the further operations embodied according to the method 1300 (Fig 13) for example:
- if the predefined gemstone-imaging angle is possible in terms of limitation to the caméra boom 502 (Fig 10):
if not, then this gemstone-imaging angle is saved for next gemstone position, if possible, the caméra boom 502 and/or the base 505 are rotated 702 in respect to each other, according to an embodiment variant, by moving at least one of the following: the caméra, gemstone holder, gemstone, and a mirror (according to an embodiment variant a pivotable mirror for optical path provision for the caméra) in the system provided for dead-angle-inspection, the caméra holder mechanics in suitable part, according to set the caméra 503 on that gemstoneimaging angle, for each image (Fr) taken the amount of rotation is also calculated 703 for image post processing (708): with the rotation, the gemstone is “straightened” so that it looks like the gemstone has been in straight position during the photography, when ail the possible predefined imaging angles, in respect to the predefined scheme of imaging, hâve been completed as predefined, the holding mechanisms of the gemstone and/or caméra holding mechanism with the boom, the gemstone position is changed 704 in respect to the caméra and its ΔΧ and ΔΥ are measured again, (the X-Y notation referring to Cartesian coordinate embodiment as such). According to an embodiment, the gemstone can be rotated (ΔΘ) and/or allowed to rotate in a continuous manner for video recording by the caméra, from which video file of the recording the gemstone images can be extracted according to an extraction algorithm. According to an embodiment variant the video recording is time stamped and/or an ensemble of frames (Fr) provided with a predefined authentication code Auth code (Σ tagn(©n,On)), and in alternative or supplément embodiment variant, according to a gemstone feature paired with an ID, for the gemstone récognition and/or classification.
gemstone position in respect to the caméra can be changed n times 705 for completing ail the predefined (according to the microprocessor control) gemstone imaging angles, with the appropriate base positions (ΔΘ) for the imaginary sphere locations, according to the predefined scheme of imaging. According to an embodiment variant the value of n can be considered in approximation as a continuous quantity for image extraction from video recording, positioning 706 the gemstone on the base, positon changes and ΔΧ and ΔΥ measurements are done automatically by the imaging system, a single gemstone is photographed 707 in both bright field and dark field illuminations.
Figs 13, 14 and 15 illustrate embodiments of a method (1300) to recognize an object by an object recognizing system (500) comprising an imaging device such as caméra and a moving assembly to move said imaging device around said object. According to the embodiment the method comprises at least one of the following: predefining (1301) an imaginary sphere to comprise at least one path to the imaging locations of said imaging device such as caméra, predefining (1302) an Φ-direction incrément (ΔΦ) on said sphere surface for the movement path of the imaging device to follow the sphere surface in a first imaging plane, predefining (1303) an Θ-direction incrément (ΔΘ) on said sphere surface for the movement of the imaging device to provide an effect as to follow a second path of the sphere surface in a second imaging plane, setting (1304) at least one starting position to said imaging device to start the imaging, collecting (1305) image and/or video data (Fr) (5ίη(Θη,Φη)) about the object from an imaging location (η, (Θη,Φη)) into at least one image stack (5ΐη(Θη,Φη)) by an imaging device from an imaging location defined by the incréments (ΔΘ), (ΔΦ) in Θ-direction and Φ-direction to follow at least one path ofthe imaginary sphere, storing (1306) images (Fr) of at least one of said image stack (Stn(0n,On)) corresponding the imaging location of the imaging device (η, (0η,Φη)), for a Virtual model of the object to be recognized, selecting (1307) a next imaging location (n+1, (0η+Δ0,Φη+ΔΦ)) for the imaging device to collect a next at least one image stack (5ΐη+1(0η+1,Φη+1)) corresponding an incrémental change of at least one of the Θ-direction incrément (Δ0) and the Φ-direction incrément (ΔΦ), combing (1308) images (Fr) from said at least one image stack with other images from said at least one image stack (5ΐ1(0ι,Φι)) and/or from another similar at least one image stack for the virtual model (Σ5ΐη(0η,Φη)) of the object to be recognized, recognizing and recording (1309) measures of character (Cr, CoA, Sh, 1, Bbl, Auth code) of said object to be recognized from at least one of said images (Fr) of an image stack (Stn), repeating (1310) image collection and selecting a next imaging location for the imaging device to collect a next at least one image stack (Stl(02,®2)) corresponding an incrémental change of at least one of the Θ-direction incrément (Δ0) and the Φdirection incrément (ΔΦ) until ail the predefined (μΡ) imaging locations ofthe moving assembly (500) around said object to be recognized has been dealt, comparing (1311) the measures of character (Cr, CoA, Sh, 1, Bbl, Auth code) to those in a database, and giving (1312) an identity (ID) to said object to be recognized and to said virtual model of it (ID), if no similarity of compared measures of character found from said database in an inspection (1315). The index n+1 refers to a next position according to the predefined scheme of imaging, with an incrément in use in the scheme, according to the used coordinate system. Thus, n has been used as an arbitrary index in illustrating.
According to an embodiment the method comprises as a predefinition (1301, 1302, 1303) at least one of defining a coordinate transformation between the object centric and imaginary sphere centric coordinates (Tri, Tr2, Tr3), defining a correction between said coordinates if no match observed, correcting the location of the object to be recognized to the center of said imaginary sphere, and adjusting the focus (Focl, Foc2, Foc3) of said imaging device such as Caméra (503) according to the correction to the focus of the caméra unit.
According to an embodiment, the method comprises retrieving (1313) said database (DB) by a user given identity, to search a Virtual model corresponding said identity of a gemstone. According to a variant the method comprises defming (1314) an area or volume of an object to be recognized with a sélection (Sélection) of measures of characters in said area or volume, to be used as a search criteria in a search from a database (DB) comprising data about similar objects as the one to be recognized with their measures of characters in the inspection (1315). According to an embodiment database retrieving can be made optionally or in addition in the post analysis phase 708, in suitable part.
[0061] According to an embodiment, in the imaging, by the photographing/taking video frames that can be made also repeatedly. According to an embodiment, the illumination can be made also with an illumination that is outside of the wavelength range of visible light. According to an embodiment, the illuminations outside visible range can be made simultaneously, but m another embodiment in sériés.
[0062] According to an embodiment the location of the gemstone under inspection is provided with géographie co-ordinates, to be used as a measure of authenticity for the identity of the gemstone, user and/or the location of the user and/or the gemstone. In an embodiment, the géographie co-ordinates are compared to the co-ordinates of the photographing service provider's location, to provide a source of authenticity signal, made with help of at least one ofthe following: géographie coordinates, imaging device serial number, imaging device's co-ordinates, signal to noise level, signal quality of a broad band connection used in the connections in the image and/or video data transference and information network bound location of the imaging service provider and/or the device ID in operation. According to an embodiment, several kinds of illuminations can be varied for getting a better contrast about the features of the gemstone to the photographs. According to an embodiment a sélection of wavelength ranges are selected for optimization for a spécifie gemstone feature to be revealed. According to an embodiment at least one of the following can be adjusted in the imaging a gemstone: polarization of a source providing the illumination to the background, polarization of a source providing the illumination to the gemstone, polarization of a caméra providing image of the gemstone.
[0063] Images are post-processed 708 according to an embodiment as method steps of the embodied method. According to an embodiment, post-processing comprises at least one of the following being completed (Fig 12):
- background removal 708a: everything else except the gemstone is removed from the image, however, gemstone features that belong to the gemstone are not removed,
- rotation 708b: gemstone is “straightened”, if experienced necessary because of the ambient conditions, for example
- centering 708c: gemstone is set in the middle of the image canvas, in suitable extent
- shadowing 708d: for enhancing 3D expérience adding a shadow to an image and
- new background 708e: a background with required color is added.
According to an embodiment variant, the gemstone features found from the images are marked and/or listed 708f. According to an embodiment the identification to the list is relative in respect a location of a feature or an ensemble of such features in the gemstone. According to an embodiment variant, also the illumination properties are listed with observed features 708g, and in alternative or in supplément, the authentication signal is saved 708h with the feature, for postanalysis purposes to check the authenticity of the observed feature, and/or to add the feature to the feature list of the features of the gemstone under inspection. The operations and processes described and shown above may be carried out or performed in any suitable order as desired in various implémentations. Additionally, in certain implémentations, at least a portion of the operations may be carried out in parallel, according to an embodiment in parallel in suitable part during applicable method steps of the imaging method 1300. Furthermore, in certain implémentations, less than or more than the operations described may be performed..
[0064] The coordinate Systems can be matched so that imaging can be performed smoothly and quickly. These can be also made in a measuring geometry coordinate system, or in an object’s own coordinate system or in suitable part afterwards, so that each frame need not to be matched individually between the coordinates and thus saving time for the imaging. However, the ID in the database may use the a coordinate system with its origo fixed to a position in respect of a selected characteristic measure of the object when describing the characteristic features, although in the measurement the coordinates used by the system were using differently defined origo m the measurement system. Where applicable coordinate transformations can be made according to embodiments.
[0065] The optical solution in accordance of an embodiment gives the facility for a depth of field of 10 mm or more is accomplished with a single image using macro magnification.
[0066] According to an embodiment, for each gemstone, the photographs taken are processed to form at least one ofthe following: a 3D applet and predefimed video.
[0067] According to an embodiment, a gemstone imaging angle has been stored to every image/frame and they can be lined up with many ways for a 3D applet or video processing. According to an embodiment variant this kind of processing can be added to the authenticity signal at the appropriate moment of occurrence. This makes possible to show gemstone movement in the visual model much more ways than just a normal rotation, and respective embodiments to provide a checking facility to examine, what has happened to the gemstone under the inspection, i.e. add to a history log details about the gemstone and its characteristic features. According to an embodiment, the examination can be done via an ordinary normal web browser as such. According to an embodiment of the invention the examination can be thus made at the same location as the photographing according to an embodiment, but alternatively or in addition also in a remote location via a communications network, such as Internet even in a different country, or according to an embodiment in various countries according to the sélection of the desired parties to participate to the examination. In such embodiments the authenticity signal can be used for an indication of authenticity ofthe event, in which the signal is sent and/or for the authenticity ofthe target under the inspection.
[0068] According to an embodiment, the observed features of an examined gemstone are identified, and the gemstone is classified according to the standards available on the classification according to the features représentative of the class. If artifacts found, they are also considered in the classification if applicable in the classification. The artifacts are also reported to the gemstone history log, and according to an embodiment such artifacts are marked to the images and/or video, according to a variant embodiment to be used as measures of authenticity.
[0069] According to a further embodiment the post processing algorithm has an evaluator machine, as programmatically implemented in communication with other system éléments, to evaluate the gemstone volume in respect to the revealed features and/or such features that are held as artifacts, to evaluate a recommendation for cutting and/or honing further the gemstone. According to an embodiment the algorithm in the system attaches that estimate to the gemstone log, for an individual identifiable gemstone, or, for a class suitable limits to characterize the class via the statistical information previously attached to the class.
The scope of the invention is determined by the attached claims together with the équivalents thereof. The skilled persons will again appreciate the fact that the explicitly disclosed embodiments were constructed for illustrative purposes only, and the scope will cover further embodiments, embodiment combinations and équivalents that better suit each particular use case of the invention.
Example 1
[0070] In an embodiment, the radiation source for the illumination provisions comprises a bright field source and/or a dark field source. In an embodiment, the radiation source is adjustable. In an embodiment, the adjusting is implemented in step-wise lighting filed levels, but according to a further embodiment on continuous basis. In an embodiment, there are at least two or more radiation sources, from which to select to at least one with a bright source illumination level or at least one with a dark field source illumination level. In an embodiment, also more than one illumination geometries can be use in accordance of Fig IG. In an embodiment, the illumination is provided by an opaque screen in an embodied geometry. In an embodiment, variant polarization of at least one of said illumination sources was adjusted to enhance the visibility of features of the gemstone under inspection. In an embodiment, the bright source had a different polarization than the dark field source. In an embodiment, at least one of the source had polarization selected from the following, elliptical polarization, circulât polarization, linear polarization, the chirahty being selected for the elliptical and/or circular polarization from left-handed and right-handed chirahty. In an embodiment, at least one of the mentioned illumination sources has a polarization feature provided to the transmitted radiation and the caméra has a polarizer arranged to an analyzer to identify the polarization of the incoming illumination, at least from the gemstone under inspection by the image/video recording.
[0071] In an embodiment, the quality ofthe radiation is diffuse, i.e. indirect illumination from a radiation source embodied, with an embodied geometry. In an embodiment, in addition or alternative, a radiation source can be embodied by such embodied source that has a spotted source to the target. According to a further variant, there can be a combination of various radiation sources to be used in illumination in an embodiment. In an embodiment variant, the base of the imaging System was used for directing illumination to the target gemstone. In an embodiment, the directing was made as diffuse illumination, to be brought to the object to be imaged via an opaque screen. In an embodiment variant, illumination is embodied as spotted illumination to the whole object.
[0072] In an embodiment of the invention, the radiation source is a source of light in optical range. In an embodiment variant, the radiation source comprises at least one ofthe following: an X-ray source, ultraviolet source, infrared source for providing illumination according to the illumination type just mentioned. According to a further embodiment variant, the radiation source is a single source or an ensemble of such as selected for the wavelength range of caméra, but can comprise also another radiation source.
[0073] In an embodiment, in the ensemble of illumination sources, there is at least one source that has a polarization feature to émit polarized light. In an embodiment the light is referring to Ultra Violet (UV) and/or InfraRed (IR) radiation. In an embodiment, the radiation to be used for the illumination is monochromatic and/or cohérent. In an embodiment, the illumination is a composition of selected monochromatic and/or cohérent radiations as such, to provide illumination from several monochromatic illumination sources as a sparse wavelength illumination.
[0074] In an embodiment, the illumination is white light, so comprising the wavelength range of the light in the visible optical range between the ultraviolet and infrared. However, similar way for the other type of illuminations the white light can be used as broad wavelength range illumination. In an embodiment, it is possible also to select such an illumination source that is monochromatic to provide where necessary, monochromatic illumination taken photographs. In an embodiment several monochromatic illumination sources can be used together to provide a sparse wavelength comprising illumination, which can be used to highlight certain features of the gemstone. Polarization of at least a source of illumination as embodied and/or caméra with analyzer ofthe polarization State can be used, for the gemstone feature enhancement and/or identification and/or to focus different focal planes inside the gemstone as the object to be recognized.
Example 2.
[0075] An imaging system was used for photographing a gemstone thoroughly, without any visible attachments to interfère the optical ray passage between the targeted gemstone and the caméra. An optical solution according to the embodied system for achieving at least 10mm depth of field with single image using macro magnification was achieved with an embodied caméra. The system was used for observing the photographed gemstone as the target in a three-dimensional manner. In an embodiment, the images of the gemstone were processed to form a 3D applet, and to form a video from the frames to be used in retrieval of the visual model from the gemstone. In an embodiment, at least some of the images were filtered to exclude glare from a phase of the gemstone. In an embodiment, a polarizer for polarization of the illumination was used in the glare removal. In an embodiment, the gemstone was also treated by a sharpener algorithm, and/or the features were marked to the image. In an embodiment, the algorithm estimated the volume ofthe gemstone, according to a further variant, estimated such a volume that would be left if found features were eut and/or honed away. In an embodiment, the algorithm also estimated the work to be made for such a procedure. In an embodiment, the gemstone was a raw diamond or alike precious stone.
Example 3.
[0076] In an embodiment, the gemstone was classified and/or it was identified with the features, and the gemstone was given an identity as based on the observed features, to be used in a later identification of the gemstone for retrieval of the images and/or the video for a later examination and/or remote examination. If the features of the gemstone are not sufficiently distinct for an individual characterization of the gemstone, it is classified to a larger ensemble of similar gemstone with similar features. In an embodiment, also raw gemstones can be examined. In an embodiment, the classification was re-estimated after a cut/honing as a processing being made at least partly completed, in comparison to the situation before the made cut/honing with the related estimate.
Example 4.
[0077] In an embodiment, the system comprises an automated feeder and/or removal unit so that the imaging system can be fully automated to be operative without a human operator, except if errors or mal-function situation occur, such as electricity eut off for example. In an embodiment, the feeder can feed a pre-classified targeted gemstones to the base for the imaging. In an embodiment feeder can be used to pivot or turn the targeted gemstone for another part of imaging sphere to be completed. In an embodiment the removal unit, which can be in an embodiment be the same as the feeder, to be operated inversely, is arranged to remove the targeted gemstone to the location of evaluated/imaged gemstones. If the examination resuit is available on line in the embodiment in use, the removal function can also comprise a classification action according to the examination resuit to the corresponding class.
Example 4B.
[0078] The gemstone holder can be also embodied in the system as such by an electrodynamic holder to capture (Fig 1H, the components RI to R4 being electrodynamic field originating and/or F) the gemstone into an electric closure as such. The gemstone can be launched by an electric needle top or tube by an electric field towards an electrodynamic holder comprising a two ringelectrode structure to capture the gemstone, or just simply drop as charged. Such a holder can make the gemstone photographing to be implemented touchlessly. According to an embodiment, the gemstone can be sucked when ready the imaging, and removed from the filter arranged to pick the gemstone into an airflow, the airflow being synchronized to suck the gemstone when the electrodynamic fields are switched off.
[0079] According to an embodiment, the light source comprises at least such a light source that is arranged to émit light at the visible range of light with the corresponding wave length. According to an embodiment the wave length range can comprise also such light that has at least partly such wave lengths that belong to the ultraviolet and/or infrared, according to a variant of an embodiment especially near-ultraviolet and/or infrared range of the optical radiation. In an embodiment, the light source is an ambient light being guided via an opaque screen to the object.
[0080] According to an embodiment, the gemstone holder as the base (considered also as a sample holder within the embodiments) comprises a vibration suppression arrangement, which is arranged to damp the vibrations that may be interfering the gemstone photographing, especially in such embodiments, in which small sized details are to be detected via the photographing. Small size refers to the détection limit of an eye on average basis. Anyhow, vibrations can make the photographs fuzzy and blur, also in a larger scale and thus a damping mechanism in a base improve the gemstone imagining. According to an embodiment, the vibration suppression comprises a transient damping part, which may suppress also continuously occurring vibrations too, irrespective are they harmonie or not. According to an embodiment variant, the gemstone holder can be situated on a piezo-element or similarly vibrating actuator under control, so that the vibration damping is made in an active way, i.e. by counter vibrations, to be produced and/or sensed by a suitable actuator for the purpose, to sense acoustically or similar way connecting vibrations to the gemstone holder base.
[0081] According to an embodiment, the suppression is achieved by an obtained microphone (or similar transducer originating) signal being amplified and phased to be lead to the actuator so that the acoustically coupling noise or similar vibrations are damped in the control of the microprocessor by produced counter phased vibrations to the obtained signal. According to an embodiment, such a damping system can comprise also a vibration sensitive diffractometer that is arranged to be responsive to a scattering of laser light interférence patterns détection, the change responsive signal to be used in the counter-vibration production by the suitable actuator in the control of the measurement device (MD). According to an embodiment, the vibration data can be sensed by a sensor and stored into memory, so that the vibration data is available for a later processing of the photographs, for improvement of the photograph quality, especially the sharpness by a software algorithm, in suitable part, in use in an embodied system.
[0082] According to an embodiment, the light source can comprises at least one fixed light source that is fixed in at least one of its respects as its position in respect to the gemstone holder, wavelength, illumination brightness and power. Even if in such embodiment further variants fixed or adjustable wavelength light sources were used. According to an embodiment variant, the light source comprises such an additional light source that is positioned to an angle in respect of the detector device. According to an embodiment, the additional light source is arranged into backscattering geometry with the detector comprising device. According to an embodiment variant, the additional light source is arranged into forward-scattering geometry with the detector comprising device. According to an embodiment variant the additional light source is arranged into specular-reflection geometry with the detector comprising device, i.e. into an angle that corresponds an angle between the back-scattering geometry and forward-scattering geometry, i.e. in the range of 45° to 135° from a horizontal plane, as considered being measured to the direction towards the normal of the horizontal plane. According to an embodiment of the invention variant at least some of the light for the gemstone illumination is brought to the target via the sample holder, or in addition or alternative, via an structural part supporting the detector carrying mechanical part. According to an embodiment variant at least part of the illumination is diffuse, and/or indirectly addressed to the gemstone under study. According to an embodiment, the illumination in the imaging mainly used is diffuse, as introduced to the gemstone via an opaque vessel and/or screen.
Example 5
[0083] At a remote site, a user, as an examiner, being observing a gemstone being imaged with images processed in a computer, according to the embodied method, to comprise a visual model, cited also as Virtual model, by the embodied system. In an embodiment, the images are user retrievable to be observed as a stream of image frames as a video, for a rotation of the object for example. In to an embodiment, visual model comprises also images taken with the embodied system in another illumination. In an embodiment, an examiner is a machine vision provided robot. In an embodiment, the examiner is making a list of the characteristic features at for a classification and/or for a fingerprint of the gemstone to be used as measures of character (1315) and/or measures of authentication in the inspection. In an embodiment, the gemstone with the ID as identified with the fingerprints is added to a gemstone database, with the appropriate classification. In an embodiment the visual model comprises an authentication code/signal for the authentication of the gemstone identification event so that the parties involved the gemstone and/or the devices présent in the performance can State the authentic ID of said entities. In an embodiment the remote site connection is provided by a network connection between computers or similar terminal devices, with help of a suitable software.
Example 6
[0084] Various embodiments may be implemented at least partially with help of software and/or firmware. This software and/or firmware may take the form of instructions contained in or on a non-transitory computer-readable storage medium. Those instructions may then be read and executed by one or more processors to enable performance of the operations described in the embodiments. The instructions may be in any suitable form for computer execution. Such a computer-readable medium may include any tangible non-transitory medium for storing information in a form readable by one or more computers, such as but not limited to read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; a flash memory, etc.
[0085] The term “machine-readable medium” may include any medium that is capable of storing, encoding, or carrying instructions for execution by the machine comprising a microprocessor μΡ and that cause the machine with the μ P to perform any one or more of the techniques of the présent disclosure, or that is capable of storing, encoding, or carrying data structures used by or associated with such instructions. Non-limiting machine-readable medium examples may include solid-state memories and optical and magnetic media. Spécifie examples of massed machine-readable media may include non-volatile memory, such as semiconductor memory devices (e.g., electrically programmable read-only memory (EPROM), or electrically erasable programmable read-only memory (EEPROM)) and flash memory devices; magnetic disks, such as internai hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD- ROM disks.
[0086] The instructions, for example to how to provide certain frames with authentication code tag, may further be transmitted or received over a communications network using a transmission medium via the network interface device/transceiver utilizing any one of a number of transfer protocols (e.g., frame relay, internet protocol (IP), transmission control protocol (TCP), user datagram protocol (UDP), hypertext transfer protocol (HTTP), etc.).
[0087] Example communications networks may include, in suitable part, a local area network (LAN), a wide area network (WAN), a packet data network (e.g., the Internet), mobile téléphoné networks (e.g., cellular networks), plain old téléphoné (POTS) networks, wireless data networks (e.g., Institute of Electrical and Electronics Engineers (IEEE) 802.11 family of standards known as Wi-Fi®, IEEE 802.16 family of standards known as WiMax®), IEEE 802.15.4 family of standards, and peer-to-peer (P2P) networks, among others. Recognizing site, database and a remote site can use a communications network according to the disclosure, for example via Internet in suitable part for the communication, but also for secure channel for dedicated information exchange such as for the authentication code key, according to an embodiment encrypted form, for example.
[0088] The terms “computing device,” “computer”, “terminal device” “user device,” “communication station,” “station,” “handheld device,” “mobile device,” “wireless device” and “user equipment” (UE) as used herein refers to a wireless communication device such as a cellular téléphoné, a smartphone, a tablet, a netbook, a wireless terminal, a laptop computer, a femtocell, a high data rate (HDR) subscriber station, an access point, a printer, a point of sale device, an access terminal, or other personal communication system (PCS) device, in an applicable part. The device may be either mobile or stationary. According to an embodiment, the remote site can be a mobile site (Fig 4). Although described as wireless, also wired can be used in suitable part for functional a connection.
[0089] Some embodiments may be used in conjunction with various devices and Systems for connections to communications network, such as Internet, for example, a personal computer (PC), a desktop computer, a mobile computer, a laptop computer, a notebook computer, a tablet computer, a server computer, a handheld computer, a handheld device, a personal digital assistant (PDA) device, a handheld PDA device, , a mobile or portable device, an audio-video (A/V) device, a wired or wireless network, a wireless area network, a wireless video area network (WVAN), a local area network (LAN), a wireless LAN (WLAN), a personal area network (PAN), a wireless PAN (WPAN), and the like.
[0090] Some embodiments may be used in conjunction with one way and/or two-way radio communication Systems, cellular radio-telephone communication Systems, a mobile phone, a cellular téléphoné, a wireless téléphoné, a personal communication system (PCS) device, a PDA device which incorporâtes a wireless communication device, a mobile or portable global positioning system (GPS) device, a device which incorporâtes a GPS receiver or transceiver or chip, digital video broadcast (DVB) devices or Systems, multi-standard radio devices or Systems, a wired or wireless handheld device, e.g., a smartphone, a wireless application protocol (WAP) device, or the like.
[0091] Some embodiments may be used in suitable part in conjunction with one or more types of wired and/or wireless communication signais and/or Systems for embodied récognition system communications, following one or more wired and/or wireless communication protocols in suitable part, for example, radio frequency (RF), infrared (IR), global positioning system (GPS), Wi-Fi, Wi-Max, ultra-wideband (UWB), global system for mobile communications (GSM), 2G, 2.5G, 3G, 3.5G, 4G, fifth génération (5G) mobile networks, 3GPP, long term évolution (LTE), LTE advanced, enhanced data rates for GSM Evolution (EDGE), or the like. Other embodiments may be used in various other devices, Systems, and/or networks.
[0092] As used herein, unless otherwise specified, the use of the ordinal adjectives “first,” “second,” “third,” etc., to describe a common object, merely indicates that different instances of like objects are being referred to and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
[0093] As used within this document, the term “communicate” is intended to include transmitting, or receiving, or both transmitting and receiving. The term “communicating” as used herein with respect to a wired and/or wireless communication signal includes transmitting the communication signal and/or receiving the communication signal, for embodying the communications between the sites involved in the visual model retrieval event. Some embodiments may relate to wireless networks that operate in accordance with one of the IEEE 802.11 standards.
[0094] Aspects of the disclosure are described above with reference to block and flow diagrams of Systems, methods, an ensemble of apparatus, and/or computer program products according to various implémentations. It will be understood that one or more blocks of the block diagrams and flow diagrams, and combinations of blocks in the block diagrams and the flow diagrams, respectively, may be implemented by computer-executable program instructions. According to some implémentations, some blocks of the block diagrams and flow diagrams may not necessarily need to be performed in the order presented, or may not necessarily need to be performed at ail.
[0095] These computer-executable program instructions may be loaded onto a special-purpose computer or other particular machine, a processor, or other programmable data processing apparatus to produce a particular machine, such that the instructions that execute on the computer, processor, or other programmable data processing apparatus create means for implementing one or more functions specified in the flow diagram block or blocks. In an embodiment an algorithm can be considered as computer exécutable program, also in embodiments that are used in controlling an embodied system operations, taking frames for images, making authentication code, controlling caméra etc. These computer program instructions may also be stored in a computer-readable storage media or memory that may direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computerreadable storage media produce an article of manufacture including instruction means that implement one or more functions specified in the flow diagram block or blocks. As an example, certain implémentations may provide for a computer program product, comprising a computerreadable storage medium having a computer-readable program code or program instructions implemented therein, said computer-readable program code adapted to be executed to implement one or more functions specified in the flow diagram block or blocks. The computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a sériés of operational éléments or steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions that execute on the computer or other programmable apparatus provide éléments or steps for implementing the functions specified in the flow diagram block or blocks for the operations of the embodied system.
[0096] According to an embodiment, imaginary sphere defined location in the imaging can be completed in applicable part by an ensemble of dômes, if necessary for the imaging of a complété gemstone ail around for its identification. According to an embodiment variant, imaginary sphere comprises at least one sphere half of the imaginary sphere for the ID-recognition ofthe gemstone. According to an embodiment, then the path of the imaging device around the gemstone to being imaged, follows accordingly at least one dôme in such an ensemble of dômes. According to an embodiment the gemstone can be re-positioned, i.e. tumed or pivoted for another imaginary sphere dôme for the imaging such parts that hâve not been already imaged, in such cases in which such would be required for the imaging, in the identification via the imaginary sphere parts of dômes for the récognition. The frames, can be obtained from the gemstone positions, obtained with the help ofthe measurement device and/or imaging device.
[0097] Accordingly, blocks of the block diagrams and flow diagrams support combinations of means for performing the specified functions, combinations of éléments or steps for performing the specified functions and program instruction means for performing the specified functions for an embodied system and/or system éléments, operations to be made alone and/or in combination 5 with other system éléments. It will also be understood that each block of the block diagrams and flow diagrams, and combinations of blocks in the block diagrams and flow diagrams, may be implemented by special-purpose, hardware-based system éléments that perform the specified functions, éléments or steps, or combinations of special-purpose hardware and computer instructions.
[0098] Many modifications and other implémentations of the disclosure set forth herein will be apparent having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the disclosure is not to be limited to the spécifie implémentations disclosed and that modifications and other implémentations are intended to be included within the scope of the appended claims. Although spécifie terms are employed 15 herein, they are used in a generic and descriptive sense only and not for purposes of limitation.
Claims (28)
1. Method (1300) to recognize an object by an object recognizing system (500) comprising an imaging device such as caméra and a moving assembly to move said imaging device of an imaging system and/or the object in respect to each other, to form a path around said object on an imaginary sphere, the method comprising at least one of the following:
predefining (1301) an imaginary sphere to comprise at least one path to the imaging locations of said imaging device such as caméra, predefining (1302) an Φ-direction incrément (ΔΦ) on said sphere surface for the movement path of the imaging device to follow the sphere surface in a first imaging plane, predefining (1303) an ©-direction incrément (ΔΘ) on said sphere surface for the movement of the imaging device to provide an effect as to follow a second path of the sphere surface in a second imaging plane, setting (1304) at least one starting position to said imaging device to start the imaging, collecting (1305) image and/or video data (Fr) (51η(©η,Φη)) about the object from an imaging location (η, (Θη,Φη)) into at least one image stack (5ΐη(©η,Φη)) by an imaging device from an imaging location defined by the incréments (Δ©), (ΔΦ) in Odirection and Φ-direction to follow at least one path of the imaginary sphere, storing (1306) images (Fr) of at least one of said image stack (5ίη(©η,Φη)) corresponding the imaging location of the imaging device (η, (Θη,Φη)), for a virtual model ofthe object to be recognized, selecting (1307) a next imaging location (n+1, (Θη+ΔΘ,Φη+ΔΦ)) for the imaging device to collect a next at least one image stack (51η+1(Θη+1,Φη+1)) corresponding an incrémental change of at least one of the Θ-direction incrément (ΔΘ) and the Φdirection incrément (ΔΦ), combing (1308) images (Fr) from said at least one image stack with other images from said at least one image stack (Stl(©b®i)) and/or from another similar at least one image stack for the virtual model (Σ5ΐη(Θη,Φη)) of the object to be recognized, recognizing and recording (1309) measures of character (Cr, CoA, Sh, 1, Bbl, Auth code) of said object to be recognized from at least one of said images (Fr) of an image stack (Stn), repeating (1310) image collection and selecting a next imaging location for the imaging device to collect a next at least one image stack ($ΐ1(©2,Φ2)) corresponding an incrémental change of at least one of the ©-direction incrément (ΔΘ) and the Φdirection incrément (ΔΦ) until ail the predefîned (μΡ) imaging locations of the moving assembly (500) around said object to be recognized has been dealt, comparing (1311) the measures of character (Cr, CoA, Sh, 1, Bbl, Auth code) to those in a database, giving (1312) an identity (ID) to said object to be recognized and to said virtual model of it (ID), if no similarity of compared measures of character found from said database.
2. Method of claim 1, wherein the method comprises as predefinition (1301, 1302, 1303) at least one of
- defining a coordinate transformation between the object centric and imaginary sphere centric coordinates (Tri, Tr2, Tr3),
- defining a correction between said coordinates if no match observed,
- correcting the location ofthe object to be recognized to the center of said imaginary sphere, and — adjusting the focus (Focl, Foc2, Foc3) of said imaging device such as Caméra (503) according to the correction.
3. Method of claim 1 or 2, wherein the method comprises retrieving (1313) said database (DB) by a user given identity, to search a Virtual model corresponding said identity.
4. Method of claim 1, 2 or 3, wherein the method comprises defming (1314) an area or volume of an object to be recognized with a sélection (Sélection) of measures of characters in said area or volume, to be used as a search criteria in a search from a database (DB) comprising data about similar objects as the one to be recognized with their measures of characters.
5. Method of any claim 1 to 4, wherein the method comprises inspection of measures (1315) of character from said Virtual model (Cr, CoA, Sh, 1, Bbl, Auth code) from a screen.
6. Method of any claim 1 to 5 wherein the measures of character comprises at least one of the following having a location in the object to be recognized:
- an ensemble of inclusions (I), each inclusion having a location in the object to be recognized,
- an ensemble of cracks (Cr), each crack having a location in the object to be recognized,
- an ensemble of shadow formation (Sh), each shadow formation having at least one of location, size and opacity,
- color
- an ensemble of color anomalies (CoA), each anomaly if any,
- index of refraction,
- an ensemble of local anomalies in index of refraction, each anomaly if any,
- a number of facets if any,
- géométrie measures of the object in 3D (such as length width and depth),
- regularity in shape,
- measures of regular forms if any, comprising at least one of crown dimensions and pavilion dimensions; and
-opacity.
7. Method of any of claims 1 to 6, wherein the récognition is based at least partly on a predefined sélection of an ensemble of said measures of characters.
8. Method of any of claims 1 to 7, wherein it comprises accessing to such a reference data in a data base location that is outside the imaging device’s control unit location.
9. Method of claim 8, wherein said data base location is at least one of Internet or similar information network defined network location and/or a géographie location.
10. Method of any of the claims 1 to 9, wherein the method comprises adding an authentication tag (tagl, tag2, tagn) and/or code (Auth code Σ tagn(©n,On)) to the Virtual model (ZStn(0n,On)) ofthe object to be recognized or its part thereof.
11. Method of claim 10, wherein the tag and/or code is added to a selected image or frame (Fr) that is an image or frame of an ensemble of selected images and respective frames to be marked by said tag and/or code.
12. Method of claim 11, wherein said tag (tagn) and/or code is a steganographic marking.
13. Method of claim 12, wherein the method comprises defining the image (Fr) and/or frame (Fr) to be marked by a first sériés of selected Fibonacci numbers and/or defining the tag in the image by a second sériés of selected Fibonacci numbers.
14. Method of claim 10, wherein the tag/or code comprises in addition or optionally at least one of géographie coordinates ofthe virtual model (Σ5ίη(Θη,Φη)) recording location, date of recording and operator identity.
15. Method according to any previous claims, wherein the imaging device (503, Caméra) in the system comprises a caméra and an adjustable focusing optics (Focl, Foc2, Foc3) to the optical axis.
16. Method of claim 15, wherein said optics comprises at least one ofthe following:
- a co-axial beam splitter (SPL 25, SPL33, SPL50) to split between a caméra unit and an additional caméra unit of the caméra the image to be recorded from different depths (Focl, Foc2, Foc3) accordingly,
- an ensemble of co-axial beam splitters in sériés (SPL 25, SPL33, SPL50) to split the image to be recorded between an ensemble of additional caméra units of said caméra, wherein each additional caméra unit has an additional-camera-specific optics (Filter 1, Filter2) to focus according to the adjustment to additional-camera-specific-depth (Focl, Foc2, Foc3) into the object to be recognized.
17. Method of claim 16, wherein the optics comprises an interferometer (Filter 1, Filter 2, Filter 3) to filter to the image of a caméra unit the illumination used in the illumination of the object to be recognized.
18. Method of claim 15 or 16, wherein the at least one image stack (Stl, St2, St3) of each caméra is processed in each thread in an individual pipeline utilized in the Virtual model (Σ5ίη(Θη,Φη)) formation.
19. Method of any previous claims, wherein the method comprises making and giving a certification Certificate about the object to be recognized according to the identity (ID) being recognized, in an electric form and/or on paper or corresponding media.
20. The method according to any previous claims, wherein the object to be recognized is a gemstone, a gemstone eut into form, a raw gemstone, a diamond, a piece of jewelry, an industrial stone or diamond or a like.
21. The imaging method of claim 1, wherein the method comprises defining the incréments (ΔΘ, ΔΦ) in Cartesian co-ordinates.
22. A non-transitory computer-readable medium storing computer-executable instructions which when executed by one or more processors resuit in performing operations means executes at least partly the method according to any previous claims.
23. An imaging system, arranged to operate according to any claim l to 20, comprising at least :
- caméra (503, Caméra),
- caméra support (502, 507, Arm) to support the caméra and facilitate a respective movement of the caméra and the targeted gemstone (Object) in respect to each other,
- base to hold the targeted object and facilitate a respective movement of the targeted gemstone object in respect to the caméra (503, Caméra) and/or the caméra support (502, 507, Arm).
24. The imaging system (500) of claim 23 wherein the system comprises such caméra support (502, 507, Arm) and/or base that the imaging of the target as the object to be recognized is made from the system predefined imaging angles.
25. The imaging system (500) of claim 23, further comprising a radiation source for illuminating a gemstone as a targeted object to be recognized, in an illumination screen geometry.
26. The system of claim 24, wherein the system further comprises an accessory such as a mirror to provide optical path to an otherwise dead-angle of the targeted gemstone, polarizer of an illumination source, polarizer at the caméra as analyzer.
27. The system of claim 24, wherein the illumination of the object to be imaged comprises at least one of the following light source: laser, eximer laser, white light source, a light source with few characteristic wavelengths, an X-ray source to pro-duce excitation of the object's éléments, an UV source to enhance the object's features, a point source comprising at least one of the just mentioned light sources, a diffuse light source comprising at least one of the just mentioned lights sources opérable via a screen in a screen geometry, arranged to indirect illumination of the object to be imaged.
28. The system of claim 24 wherein the system comprises a base with a vibration damping
5 arrangement to improve the image quality.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US62/478,221 | 2017-03-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| OA19485A true OA19485A (en) | 2020-10-23 |
Family
ID=
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11514689B2 (en) | Gemological object recognition | |
| EP3295145B1 (en) | Apparatus, system and method of determining one or more optical parameters of a lens | |
| WO2019185974A1 (en) | Holder arrangement for gemological object recognition system | |
| US9737381B2 (en) | Desktop three-dimensional scanner for dental use provided with two-axis motion unit in which camera and projector are coupled to unit for changing horizontal axis of rotation of stage | |
| CN110270769B (en) | Non-destructive detection method | |
| US11852593B2 (en) | Broadband wafer defect detection | |
| US8773648B2 (en) | Imaging system with motorized positioning of image capture device | |
| US10036711B2 (en) | Gemstone registration and recovery system, and systems for evaluating the light performance of a gemstone and capturing forensic characteristics of a gemstone | |
| CN106918306A (en) | Industrial products three-dimensional appearance real-time detecting system based on light field one camera | |
| CN115666856A (en) | Automated apparatus and method for object faceting | |
| US11346788B2 (en) | Fluorescence imaging of gemstone on transparent stage | |
| US20150138532A1 (en) | Motion strategies for scanning microscope imaging | |
| JP2015085398A (en) | Cutting device | |
| OA19485A (en) | Gemological object recognition. | |
| JP2015511308A (en) | Air pocket detection method and system | |
| JP2015511308A5 (en) | ||
| US20240102937A1 (en) | High clarity gemstone facet and internal imaging analysis | |
| Li et al. | Research on measurement method of grinding wheel profile based on image mosaic | |
| CN104237167B (en) | The bearing calibration of scanning means scanning OCT faultage image distortion and system | |
| Dyomin et al. | The internal defects detection in crystals by digital holographic methods | |
| KR101883748B1 (en) | A method and apparatus for quantitative measurement of surface accuracy of an area | |
| CN107869984B (en) | Position and orientation estimation method and position and orientation estimation system | |
| JP2010243189A (en) | Device and method for analyzing carbon component in steel by image processing of spark test | |
| JP2021513463A (en) | Laser processing method and laser processing system on the surface | |
| JP5972715B2 (en) | Image clipping method and image acquisition apparatus |