WO2014201009A2 - Systems and methods for infrared detection - Google Patents
Systems and methods for infrared detection Download PDFInfo
- Publication number
- WO2014201009A2 WO2014201009A2 PCT/US2014/041719 US2014041719W WO2014201009A2 WO 2014201009 A2 WO2014201009 A2 WO 2014201009A2 US 2014041719 W US2014041719 W US 2014041719W WO 2014201009 A2 WO2014201009 A2 WO 2014201009A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- filament
- mobile device
- printer
- images
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F13/655—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/69—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
- G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
- G07D7/06—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
- G07D7/12—Visible light, infrared or ultraviolet radiation
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07D—HANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
- G07D7/00—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
- G07D7/06—Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
- G07D7/12—Visible light, infrared or ultraviolet radiation
- G07D7/1205—Testing spectral properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/131—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N2021/6417—Spectrofluorimetric devices
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/02—Mechanical
- G01N2201/022—Casings
- G01N2201/0221—Portable; cableless; compact; hand-held
Definitions
- CMOS complementary metal-oxide semiconductor
- IR cut-off filter prevents infrared radiation from distorting colors in images from colors as generally perceived by the human eye. While this results in more natural looking images, conventional mobile devices are unsuitable for detecting fluorescent emission at IR wavelengths without removal of the included infrared cut-off filter.
- a fluorescence detection system includes a light source for coupling with a mobile device and software, having machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: activating the light source in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the light source on with an image captured with the light source off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating objects by measuring the intensity shift within the images.
- a fluorescence detection system includes software, having machine readable instructions loadable into memory of a mobile device and executable by a processor of the mobile device, capable of: activating a display of the mobile device to emit light in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the display on with an image captured with the display off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating an object by measuring the intensity shift within the images.
- a fluorescence detection system couples with a mobile device having a camera.
- the system includes a filter for placing over a flash of the camera, software, having machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, that is capable of: capturing a first image of an object using a camera of the mobile device when the flash is not active; activating the flash in coordination with capturing a second image of the object using the camera; analyzing the first and second images to detect a shift of intensity within a predetermined color range within the images based upon fluorescence from the object in response to activation of the flash; and identifying and authenticating the object based upon the detected shift in intensity.
- a near-IR filter array layer for an electromagnetic sensor array includes a plurality of infrared filters arranged over the sensor array such that, for each pixel of the sensor array, each infrared filter is configured to pass a different wavelength of electromagnetic radiation within the infrared wavelength band to one sensor of the pixel.
- a 3D printer has filament authentication, and includes a print engine for generating a 3D object using a filament of material, and an IR authenticator positioned to authenticate the filament before use by the print engine. Operation of the print engine is based upon authentication of the filament by the IR authenticator.
- a method authenticates a filament used in a 3D printer.
- An IR beam at a first wavelength is projected onto the filament within the 3D printer.
- IR fluorescence at a second wavelength from a dye within the filament is detected in response to the IR beam.
- the detected IR fluorescence indicates authentication of the filament within the 3D printer.
- FIG. 1 schematically illustrates one exemplary fluorescence detection system coupled with a mobile device, illustrated as a smart phone, in an embodiment.
- FIGs. 2 and 3 show a perspective view of operation of the mobile device of FIG. 1 to capture an IR image and an RGB image of an object to be authenticated.
- FIG. 4 shows exemplary location of the IR fluorescent dye within the object of
- FIG. 5 is a schematic showing one exemplary IR image sensor for use in a digital camera, in an embodiment.
- FIG. 6 is a graph showing three exemplary responses of the sensor and filter combinations of FIG. 5.
- FIG. 7 shows one exemplary 3D printer for printing a 3D object that may be externally authenticated, in an embodiment.
- FIG. 8 shows one exemplary 3D printer with 3D printer consumable authentication, in an embodiment.
- a system for fluorescent detection using a mobile device includes a light source such as an LED powered by the mobile device.
- the LED may be configured with the mobile device (e.g., a "flash" for use with the camera of the mobile device) or adapted for plugging into the mobile device (e.g., using the headphone jack of the mobile device).
- Software running on the mobile device activates the LED to illuminate an object/subject of interest in coordination with capturing one or more images of the object/subject using the on-board camera of the mobile device.
- a first image of the object, captured when the LED is turned off, is compared to a second image of the object, captured when the LED is turned on, by software to detect a shift of intensity for a given color range within the images.
- a blue to violet LED e.g., 450nm wavelength
- the software detects a shift of intensity within a red wavelength band when the object includes a material that fluoresces in the red wavelength band when excited by light at a wavelength of 450nm.
- a band-pass filter is applied to the LED "flash" of the mobile device such that when activated, the LED emits light of a particular wavelength.
- the measured intensity shift allows the software on the mobile device to identify and authenticate objects. Identifying data may be hidden within the intensity shift, by combining known information about (a) the size of a fluorescent marker within or on the object that is used to gauge distance from the object with (b) the amount of intensity shift detected within the captured images.
- an object may be impregnated or coated (in part or in whole) with one or more fluorescent dyes.
- a fluorescent "signature" of the object may be measured using the LED and the camera as described above, and the information stored in memory accessible by the software.
- fluorescent signatures of a plurality of objects used in playing a mobile game may be included in gaming data stored within memory of the mobile device or accessible via the Internet.
- the mobile device When used in connection with a game, for example, the mobile device may be used to authenticate an action figure or other object, and thus, to "unlock" a corresponding character within the game.
- the mobile device may therefore replace USB platforms currently used to link toys/objects with video game characters, thus granting a player the freedom to play his or her game away from the platform.
- software running on the mobile device controls an RGB LED to emit light within a desired wavelength band in coordination with image capture (i.e., to emit light of a desired color when taking a picture).
- software controls the RGB LED to emit blue- violet light, in order to elicit a fluorescent response measurable in the red wavelength band.
- One or more images taken with the LED emitting in the desired wavelength band are processed with one or more images taken with the LED off, to determine an intensity shift in the red band, in order to identify and authenticate objects.
- a filter may be placed over the flash of a mobile device camera, in order to limit emission by the flash, in order to elicit a measurable fluorescent response by the object.
- a filter may block green and red emissions of the flash, to limit light striking the object to blue. An intensity shift within the red color channel may then be detected within captured images and analyzed to authenticate the object.
- Dyes may be designed to regulate object emission. Given that the fluorescence is within visible light, the authentication process may be noticeable, barely noticeable, or hardly detectable to the human eye.
- the disclosed systems and methods beneficially provide not only mobile authentication, but also rapid authentication.
- Mobile device cameras typically run at 24 to 30 frames per second, and as little as one frame is needed to capture a fluorescence response to an excitation wavelength in order to authenticate the object.
- noticeability by the human eye of the LED activation and of the corresponding fluorescence response would be negligible.
- additional frames may be used to provide data to sort against false positives.
- a mobile device (such as an iPhone) may be configured with a fluorescence detection system for acquisition, identity and authentication of an object.
- An LED powered by the phone jack of the mobile device and attached with a back surface of the device, proximate the device camera and camera flash, emits at 450nm.
- the object being detected is painted with a dye that fluoresces when illuminated by the LED, as shown in the image displayed on the mobile device screen.
- the mobile device screen shows a standard, RGB image of the object as taken by the built-in mobile device camera, and an IR / differenced image in which object fluorescence is visible.
- FIG. 1 schematically illustrates one exemplary fluorescence detection system 100 configured as a mobile device 102, illustrated as a smart phone.
- FIGs. 2 and 3 show a perspective view of operation of mobile device 102 of FIG. 1 capturing an IR image 116 and an RGB image 118 of an object 202 to be authenticated.
- FIG. 4 shows exemplary location of IR fluorescent dye 306 within object 202.
- FIGs. 1, 2, 3 and 4 are best viewed together with the following description.
- Software 104 stored within memory 106 of mobile device 102, includes machine readable instructions that when executed by a processor 108 of mobile device 102 interact with mobile device 102 to activate an LED 110 coupled with mobile device 102 in coordination with capturing one or more images of object 202 with a camera 112 of mobile device 102.
- LED 110 is for example powered by mobile device 102 at an interface 114, such as a jack of mobile device 102 for example. It will be appreciated that features of system 100 are placed as shown in FIG. 1 for purposes of illustration only, and that shown features (e.g., LED 110, interface 114, camera 112, a display 122 and others) may be located in positions other than those shown in FIG. 1.
- At least one captured IR image 116 (captured by camera 112 when LED 110 is on), and at least one RGB image 118 (captured by camera 112 when LED 110 is off) are processed/compared by processor 108 to generate a difference image 119 for detecting a shift of intensity for a given color range within images 116 and 118.
- software 104 triggers LED 110 to flash in synch with a frame rate of camera 112 such that LED 110 is active to illuminate object 202 only during capture of alternate frames by camera 112.
- LED 110 represents a built-in "flash" LED of mobile device 102 that is controlled to provide illumination for use with camera 112.
- software 104 detects a shift of intensity within a red wavelength band when the imaged object includes fluorescent dye 306 (or other material with fluorescing pigments) that fluoresces in the red wavelength band when excited by light at a wavelength of 450nm.
- the measured intensity shift within the red wavelength band allows software 104 to identify and
- Software 104 executed by processor 108, compares a measured intensity shift and other image data of images 116, 118, 119 with a database 150 of fluorescent signatures 152 of known, authentic objects to identity and authenticate an object within images 116, 118, where each signature 152 may define one or more of wavelength, position, shape, and other specifics of fluorescent marker(s) present within object 202.
- database 150 is stored in memory 106, but may be stored elsewhere that is otherwise accessible by software 104, for example from a database stored on a server and accessible via the Internet via a wireless interface 120.
- IR Image 116, RGB image 118 and/or difference image 119 highlighting fluorescence of object 202 may be displayed on a display 122 of mobile device 102.
- object identity/authentication and other information from database 150 may also be displayed on display 122, once object 202 is identified and authenticated.
- software 104 may trigger or invoke other actions, both on mobile device 102 and external thereto using wireless interface 120.
- display 122 is controlled by software 104 to display blue (e.g., to emit light at a 450nm wavelength) to illuminate an object placed in front of display 122, thereby eliminating the need for LED 110.
- camera 112 is forward facing on mobile device 102 to capture images of the object illuminated by light from display 112.
- Control (e.g., activation and deactivation) of display 122 is similar to control of LED 110 as described above, and camera 112 is controlled to capture RGB image 118 when display 122 is inactive, and to capture IR image 116 when display 1122 is emitting light at a 450nm wavelength.
- This embodiment is particularly advantageous where mobile device 102 is a tablet computer that does not have a built in "flash" LED.
- Bayer filter or Bayer layer
- the Bayer filter is a "visible light" filter array comprised of red, green and blue color filters mounted directly before sensors grouped as pixels. Each filter of the array allows only photons of a specific color onto the corresponding sensor, where each pixel has one red, two green, and one blue filter and four corresponding sensors.
- Software then applies various demosaicing algorithms to determine color (e.g., a set of RGB values) for each pixel based upon sensed light levels and the geometry of the group of filters and sensors forming each pixel.
- CMOS and CCD sensors are sensitive to light with wavelengths between about 400 and about 1 lOOnm, and therefore may be used to detect radiation in at least part of the near infrared (700-1200 nm) portion of the electromagnetic spectrum.
- the Bayer layer allows only light within a human visible wavelength (e.g., 400nm to 700nm) to pass through, conventional cameras formed with the Bayer layer are unable to detect IR wavelengths and are not suited for infrared image capture. With the Bayer filters array removed, these conventional cameras detect only intensity levels of near IR radiation.
- FIG. 5 is a schematic showing one exemplary IR image sensor 500 for use in a digital camera.
- IR image sensor 500 has an array of sensors 502 and an array of IR filters 504 positioned thereon. Sensors 502 and filters 504 are grouped into pixels 506 that each has four sensors 502 and four corresponding filters 504 in this example. Each sensor 502 operates to sense electromagnetic energy in the wavelength range of 700- 1200 nm. Within each pixel 506, filters 504 are selected to pass IR energy at two or more different wavelengths.
- FIG. 5 is a schematic showing one exemplary IR image sensor 500 for use in a digital camera.
- IR image sensor 500 has an array of sensors 502 and an array of IR filters 504 positioned thereon. Sensors 502 and filters 504 are grouped into pixels 506 that each has four sensors 502 and four corresponding filters 504 in this example. Each sensor 502 operates to sense electromagnetic energy in the wavelength range of 700- 1200 nm. Within each pixel 506, filters 504 are selected to pass
- FIG. 6 is a graph showing three exemplary responses of sensor 502 and filter 504 combinations.
- filter 504(1) has a pass band wavelength centered at 720nm
- a filter 504(2) has a pass band wavelength centered at 775nm
- a filter 504(3) has a pass band wavelength centered at 845nm.
- two or more filters 504 may be configured at the same pass band wavelength.
- pixels may have more than four sensors 502 and filters 504 such that greater selectivity within the near IR waveband may be achieved.
- each pixel 506 certain filters 504 are selected to pass visible light (e.g., as with conventional Bayer filters) and other filters are configured to pass only IR wavelengths as shown in FIG. 6, wherein software (e.g., software 104) operates to selectively process output for sensors 502 for each pixel 506 to generate one or both of a visible image and an IR image.
- software e.g., software 104
- the software may operate to identify specific frequency responses from object 202 for purposes of authentication.
- an object may be configured with multiple fluorescing dyes that fluoresce at different wavelengths, where filters 504 are configured to determine presence or absence of these fluorescent responses to achieve stronger authentication.
- camera 112 of system 100 is configured with image sensor 500 of FIG. 5 and used for infrared photography, detection and authentication.
- LED 110 is controlled by software 104 to elicit a fluorescent emission from object 202 tagged (impregnated or otherwise marked) with fluorescent dye 306.
- software 104 activates LED 110 to illuminate object 202 in coordination with capturing IR image 116, deactivates LED 110 in coordination with capturing RGB image 118, where RGB image 118 does not represent a visible image, but is used to detect background IR levels.
- Software 104 compares IR image 116 with RGB image 118 to generate difference image 119 that has background levels of IR removed.
- Software 104 may then process selective sensors 502 values for each pixel 506 within difference image 118 to identify a fluorescent response "signature" (a fluorescent stamp, pattern, marking, complex emission or simple emission) of object 202. Additional multiple wavelength analysis of IR image 116 and/or difference image 119 may be performed to determine object identity and authentication, for example by comparing a unique spectral signature of the dye or material (or combinations thereof) with a database of signatures of tagged objects.
- a fluorescent response "signature" a fluorescent stamp, pattern, marking, complex emission or simple emission
- filament/resin/fiber used in cooperation with fluorescent detection, companies may digitally distribute their physical goods, by adding one or more IR fluorescing dyes of a known frequency response to filament, fibers or resins used to manufacture items through 3D printing.
- the filament/resin/fiber (which may be used interchangeably hereafter) may be impregnated with or produced with one or more dyes that fluoresce at a known wavelength when illuminated by a light source.
- FIG. 7 shows one exemplary 3D printer 700 for printing a 3D object 708 that may be externally authenticated.
- 3D printer 700 includes a print engine 702 that uses a filament consumable 704 such as a resin, illustratively shown supplied on a reel 706, for creating 3D object 708.
- a consumer purchases filament consumable 704 and downloads a digital design 720 for printing 3D object 708 from the resin. The consumer may then print (create) 3D object 708 using 3D printer 700.
- resin 704 to create 3D object 708 may be used interactively with other devices.
- an IR authenticator 710 e.g., system 100 of FIG.
- IR authenticator 710 may include a computer/microprocessor, an IR projector, and an IR camera, and optionally an RGB camera.
- 3D object 708 is detected within a field of view of the IR camera (and optional RGB camera). Images of the object are captured with the camera, with the IR projector turned off and with the IR projector turned on, and the images are processed to detect a fluorescent response of the dye incorporated with 3D object 708.
- a fluorescent signature of 3D object 708 may be authenticated via an authentication algorithm, thus allowing 3D object 708 become interactive with game 750.
- authentication of 3D object 708 by IR authenticator 710 may unlock promotions offered via an external system for identifying specific objects (for example, a team jersey worn at a sporting event or while viewing a sporting event in front of a Smart TV).
- 3D object 708 represents a building block or other component of a children's toy, that is then identified and authenticated by IR authenticator 710 to unlock functionality of a third party system or device looking for the authenticated 3D object 708.
- This technology may lower the cost of manufactured goods, as authentic products may be created at home or at local stores or distribution centers.
- new revenue streams may grow from consumers licensing and downloading digital files needed to print desired objects from the tagged filament/resin/fiber (e.g., filament/resin/fiber 704).
- objects made with tagged resin may be authenticated and the owner of the objects may receive a warranty for authenticated objects.
- filament 704 may be may be tagged with an invisible IR dye or combination of dyes that fluoresce at known wavelengths, such that a printed weapon may be detected by systems for detecting IR response incorporated into airport security for example.
- FIG. 8 shows one exemplary 3D printer 800 with 3D printer consumable authentication, in an embodiment.
- 3D printer 800 includes a print engine 802 that uses a filament consumable 804, illustratively shown supplied on a reel 806, for creating a 3D object 808.
- Print engine 802 is coupled with an IR authenticator 810 that is invoked to authenticate filament 804.
- IR authenticator 810 includes an IR source and an IR detector (e.g., a camera capable of detecting IR wavelengths) that cooperate to detect presence of IR fluorescing pigments (e.g., dyes) within filament 804 in the beam of the IR source, for example at location 812.
- IR authenticator 810 utilizes simple, low-cost and commonly available sensors (e.g., photodiode, phototransistors, CMOS and/or other sensors) for detection of fluorescence from dyes within filament 804.
- location 812 is within 3D printer 800 and positioned on a path of filament 804 as it is taken from reel 806 into print engine 802.
- IR authenticator 810 detects fluorescence of pigments within filament 804 while it is still on reel 806.
- print engine 802 controls IR authenticator 810 to authenticate filament 804 when installed into 3D printer 800, wherein IR authenticator 810 generates IR at a first wavelength, and detects corresponding IR fluorescence at a second wavelength from one or more IR fluorescing dyes present within filament 804.
- first and second wavelengths are 30-80nm or more apart, for example.
- print engine 802 utilizes identification of IR fluorescence to configure operating parameters for using filament 804. For example, presence or absence of one or more of a plurality of fluorescence responses may be used to specify processing parameters (e.g., temperature, feed rate, heat bed temperature, etc.) for using filament 804, wherein print engine 802 is thereby configured automatically when filament 804 is changed and a new IR "signature" identified.
- processing parameters e.g., temperature, feed rate, heat bed temperature, etc.
- functionality of print engine 802 is restricted when filament 804 is not authenticated by IR authenticator 810.
- 3D printer 800 may not function if filament 804 is not authenticated by print engine 802.
- a product manufacturer may release a 3D print design file of an object 808 that is associated with filament 804, wherein 3D printer 800 does not print the 3D print design unless the specific filament 804 is authenticated.
- the product manufacturer, or a third party associated with the manufacturer may sell filament 804 at a premium price for use with 3D printer 800 to print one or more copies of the object from the 3D design file.
- printer 800 compares a fluorescence response of filament loaded into the printer with the fluorescence response expected of authentic filament 804 from the manufacturer.
- print engine 802 inhibits generation of object 808. That is, unless IR authenticator 810 authenticates filament 804 within 3D printer 800, object 808 will not be printed. In one example, printer 800 will not run or complete the 3D design file if the filament is not authentic filament 804. In another example, print engine 802 is locked if authentication fails. A fluorescent signature of the filament may be authenticated via an authentication algorithm run by IR authenticator 810.
- print engine 802 and IR authenticator 810 may periodically authenticate filament 804 during printing of object 808, wherein failure to authenticate filament 804 may interrupt generation of object 808.
- print engine 802 is configured based upon
- output quality of print engine 802 may be determined based upon authentication of filament 804, where the quality of material of filament 804, as identified and authenticated by IR authenticator 810, defines the output quality of print engine 802.
- a printer manufacturer may direct users of 3D printer 800 to use a particular filament 804, such as from a preferred supplier.
- a third party filament supplier would not include fluorescing dyes within the filament, or would not include the unique fluorescent signature of the particular filament 804, and thereby this third party product could not be used within 3D printer 800, or could be used only with reduced performance of 3D printer 800.
- Fluorescing dyes may be added to other 3D printer filament materials, such as one or more of rubbers, metals, gelatins/lipids (e.g., for printing artificial tissues), stainless steel, brass, wood pulp-plastic mixtures, nylon, polyester, graphene/carbon fiber, ceramic, bacteria, and paper. Combination of Features
- a fluorescence detection system including a light source for coupling with a mobile device, and software, comprising machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: activating the light source in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the light source on with an image captured with the light source off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating an object by measuring the intensity shift within the images.
- the light source being an LED adapted to plug into a port of the mobile device.
- the step of analyzing including detecting a fluorescent response from an object tagged with an IR- fluorescing dye in the red wavelength band within the image in response to the emission from the light source.
- the mobile device being selected from the group including a mobile phone, a tablet, a laptop computer, a notebook computer, an MP3 player, an iPad, an iTouch, an iPod and a personal data assistant.
- a fluorescence detection system for coupling with a mobile device having a camera including: a filter for placing over a flash of the camera, and software, comprising machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: capturing a first image of an object using the camera when the flash is not active; activating the flash in coordination with capturing a second image of the object using the camera; analyzing the first and second images to detect a shift in intensity within a predetermined color range within the first and second images based upon fluorescence from the object in response to activation of the flash; and identifying and authenticating the object based upon the detected shift in intensity.
- the predetermined color range comprising a red wavelength band
- the object is configured with an IR- fluorescing dye that fluoresces at the red wavelength band in response to the filtered emission from the flash.
- a 3D printer with filament authentication including: a print engine for generating a 3D object using a filament of material; and an infrared (IR) authenticator positioned to authenticate the filament before use by the print engine; wherein operation of the print engine is based upon authentication of the filament by the IR authenticator.
- IR infrared
- the IR authenticator including: an IR generator for generating IR at a first wavelength, and an IR detector for detecting fluorescence of a dye within the filament at a second IR wavelength. The authentication of the filament being based upon detection of the fluorescence at the second IR wavelength.
- (q) A method for authenticating a filament used in a 3D printer, including: projecting, within the 3D printer, an IR beam at a first wavelength onto the filament; and detecting, in response to the IR beam, IR fluorescence at a second wavelength from a dye within the filament; wherein the detected IR fluorescence indicates authentication of the filament within the 3D printer.
- (r) In the method denoted as (q), the steps of projecting and detecting being repeated periodically during operation of the 3D printer.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Toxicology (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Inspection Of Paper Currency And Valuable Securities (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| HK16111258.6A HK1223153A1 (zh) | 2013-06-10 | 2014-06-10 | 用於红外检测的系统和方法 |
| EP14810817.8A EP3008453A4 (en) | 2013-06-10 | 2014-06-10 | Systems and methods for infrared detection |
| CN201480032974.6A CN105518437A (zh) | 2013-06-10 | 2014-06-10 | 用于红外检测的系统和方法 |
| JP2016519593A JP2016525680A (ja) | 2013-06-10 | 2014-06-10 | 赤外線検出用のシステム及び方法 |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201361833365P | 2013-06-10 | 2013-06-10 | |
| US61/833,365 | 2013-06-10 | ||
| US201361902524P | 2013-11-11 | 2013-11-11 | |
| US61/902,524 | 2013-11-11 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2014201009A2 true WO2014201009A2 (en) | 2014-12-18 |
| WO2014201009A3 WO2014201009A3 (en) | 2015-02-05 |
Family
ID=52005165
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2014/041719 Ceased WO2014201009A2 (en) | 2013-06-10 | 2014-06-10 | Systems and methods for infrared detection |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US9699391B2 (enExample) |
| EP (1) | EP3008453A4 (enExample) |
| JP (2) | JP2016525680A (enExample) |
| CN (1) | CN105518437A (enExample) |
| HK (1) | HK1223153A1 (enExample) |
| WO (1) | WO2014201009A2 (enExample) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10318775B2 (en) | 2016-06-24 | 2019-06-11 | Authentic Labs | Authenticable digital code and associated systems and methods |
Families Citing this family (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9642606B2 (en) | 2012-06-27 | 2017-05-09 | Camplex, Inc. | Surgical visualization system |
| US9936863B2 (en) | 2012-06-27 | 2018-04-10 | Camplex, Inc. | Optical assembly providing a surgical microscope view for a surgical visualization system |
| US9782159B2 (en) | 2013-03-13 | 2017-10-10 | Camplex, Inc. | Surgical visualization systems |
| US10881286B2 (en) | 2013-09-20 | 2021-01-05 | Camplex, Inc. | Medical apparatus for use with a surgical tubular retractor |
| US10108924B2 (en) * | 2013-09-26 | 2018-10-23 | At&T Mobility Ii Llc | Methods and apparatus to emulate a toy |
| US20160078706A1 (en) * | 2014-09-17 | 2016-03-17 | Thomas D. Pawlik | Method of authenticating an object |
| US11042869B1 (en) | 2014-09-30 | 2021-06-22 | Amazon Technologies, Inc. | Method, medium, and system for associating a payment amount with a physical object |
| JP6729381B2 (ja) * | 2014-10-06 | 2020-07-22 | ソニー株式会社 | 固体撮像装置、及び、電子機器 |
| EP3226799A4 (en) | 2014-12-05 | 2018-07-25 | Camplex, Inc. | Surgical visualization systems and displays |
| US10168281B2 (en) * | 2015-01-27 | 2019-01-01 | Hitachi High-Technologies Corporation | Multicolor fluorescence analysis device |
| US11154378B2 (en) | 2015-03-25 | 2021-10-26 | Camplex, Inc. | Surgical visualization systems and displays |
| US10139342B2 (en) * | 2015-08-04 | 2018-11-27 | Spectra Systems Corporation | Photoluminescent authentication devices, systems, and methods |
| US10140494B1 (en) * | 2015-08-04 | 2018-11-27 | Spectra Systems Corporation | Photoluminescent authentication devices, systems, and methods |
| US20230065252A1 (en) * | 2015-08-17 | 2023-03-02 | Lego A/S | Toy system and a method of operating the toy system |
| DK3337585T3 (da) | 2015-08-17 | 2022-11-07 | Lego As | Fremgangsmåde til at skabe et virtuelt spilmiljø og interaktivt spilsystem under anvendelse af fremgangsmåden |
| DK180058B1 (en) * | 2018-07-06 | 2020-02-27 | Lego A/S | toy system |
| EP3383247A4 (en) * | 2015-11-25 | 2019-06-26 | Camplex, Inc. | SURGICAL VISUALIZATION SYSTEMS AND DISPLAYS |
| ITUB20159638A1 (it) * | 2015-12-15 | 2017-06-15 | Gd Spa | Metodo e sistema per realizzare un oggetto mediante una tecnica di produzione additiva e per renderlo tracciabile. |
| HUE062485T2 (hu) * | 2016-05-18 | 2023-11-28 | Colop Digital Gmbh | Eljárás egy szubsztrát hitelesítésére speckle-minták felhasználásával és egy eszköz az eljárás végrehajtásához |
| KR102314241B1 (ko) * | 2017-03-28 | 2021-10-20 | 삼성전자주식회사 | 적응적 인증 수행 방법 및 이를 지원하는 전자 장치 |
| US10918455B2 (en) | 2017-05-08 | 2021-02-16 | Camplex, Inc. | Variable light source |
| KR102472629B1 (ko) * | 2017-10-23 | 2022-11-30 | 삼성전자주식회사 | 적외선 다중 대역을 감지하는 이미지 센서 및 이를 이용한 전자 장치 |
| WO2019083541A1 (en) * | 2017-10-27 | 2019-05-02 | Hewlett-Packard Development Company, L.P. | THREE-DIMENSIONAL (3D) MODEL PROTECTION THROUGH CONSUMABLES |
| US10935376B2 (en) * | 2018-03-30 | 2021-03-02 | Koninklijke Philips N.V. | System and method for 3D scanning |
| US11776313B2 (en) * | 2018-12-10 | 2023-10-03 | Gentex Corporation | Scanning apparatus for reducing field of view search space |
| EP3903093A4 (en) * | 2019-01-07 | 2022-12-14 | Intelligent Material Solutions, Inc. | SYSTEM AND METHOD FOR PHOSPHORUS EXCITATION AND DETECTION BY A MOBILE DEVICE |
| CN112288008B (zh) * | 2020-10-29 | 2022-03-01 | 四川九洲电器集团有限责任公司 | 一种基于深度学习的马赛克多光谱图像伪装目标检测方法 |
| EP4241256A2 (en) * | 2020-11-04 | 2023-09-13 | VerifyMe, Inc. | Remote infrared ink reader and authenticator |
| CN113870479B (zh) * | 2021-08-31 | 2023-06-13 | 中钞印制技术研究院有限公司 | 防伪纸张鉴别方法和装置、电子设备和可读存储介质 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001024107A2 (en) | 1999-09-30 | 2001-04-05 | Dna Technologies, Inc. | Product authentication system |
| US20030112423A1 (en) | 2000-04-24 | 2003-06-19 | Rakesh Vig | On-line verification of an authentication mark applied to products or product packaging |
| US20130135081A1 (en) | 2011-11-30 | 2013-05-30 | Waba Fun, Llc | Systems And Methods For Authenticating Objects Using IR |
Family Cites Families (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5402364A (en) | 1993-01-15 | 1995-03-28 | Sanyo Machine Works, Ltd. | Three dimensional measuring apparatus |
| US5691909A (en) | 1995-12-29 | 1997-11-25 | Western Atlas | Method of virtual machining to predict the accuracy of part to be made with machine tools |
| JP3068483B2 (ja) * | 1996-02-08 | 2000-07-24 | 株式会社東芝 | パターン読み出し方法、および光学的信号読み取り装置 |
| US5988862A (en) | 1996-04-24 | 1999-11-23 | Cyra Technologies, Inc. | Integrated system for quickly and accurately imaging and modeling three dimensional objects |
| GB2364894B8 (en) | 2000-07-19 | 2010-07-07 | Fmc Corp | Three axis portioning method |
| WO2002061405A2 (en) | 2001-01-31 | 2002-08-08 | Pottier Roy H | Method and hand-held device for fluorescence detection |
| TW563345B (en) * | 2001-03-15 | 2003-11-21 | Canon Kk | Image processing for correcting defects of read image |
| US7092089B2 (en) * | 2002-02-07 | 2006-08-15 | Rgb Technologies Ab | Method and system for chemical or biochemical analysis of a target analyte in a target environment |
| JP2004171109A (ja) | 2002-11-18 | 2004-06-17 | Nippon Telegr & Teleph Corp <Ntt> | デバイス認証システム |
| EP1606121A4 (en) | 2003-03-27 | 2010-05-05 | Graphic Security Systems Corp | SYSTEM AND METHOD FOR AUTHENTICATING OBJECTS |
| WO2004113889A1 (en) * | 2003-06-20 | 2004-12-29 | The Texas A & M University System | Method and system for near-infrared fluorescence contrast-enhanced imaging with area illumination and area detection |
| JP2005196627A (ja) * | 2004-01-09 | 2005-07-21 | Olympus Corp | 偽券検知機能付きカメラ及びカメラを用いた偽券検知方法 |
| US20060202132A1 (en) * | 2005-03-14 | 2006-09-14 | Chua Janet B Y | Portable fluorescence detection unit adapted for eye protection |
| JP2006263044A (ja) * | 2005-03-23 | 2006-10-05 | Fuji Photo Film Co Ltd | 蛍光検出システム |
| WO2007109690A2 (en) | 2006-03-21 | 2007-09-27 | Ultradots, Inc. | Authenticating and identifying objects by detecting markings through turbid materials |
| JP4968436B2 (ja) * | 2006-06-08 | 2012-07-04 | 大日本印刷株式会社 | セキュリティ情報媒体読取装置 |
| US7547894B2 (en) * | 2006-09-15 | 2009-06-16 | Performance Indicator, L.L.C. | Phosphorescent compositions and methods for identification using the same |
| EP1912059A1 (en) | 2006-10-11 | 2008-04-16 | Basf Se | Mobile device for fluorescence detection and its use |
| US7706700B2 (en) * | 2007-03-21 | 2010-04-27 | Xerox Corporation | System and method for authenticating an electrostatographic material in an image forming apparatus |
| WO2009121775A2 (de) * | 2008-04-01 | 2009-10-08 | Bauhaus-Universität Weimar | Verfahren und beleuchtungsvorrichtung zur optischen kontrastverstärkung |
| JP2011521237A (ja) | 2008-05-20 | 2011-07-21 | ユニバーシティー ヘルス ネットワーク | 螢光に基づく画像化およびモニタリング用装置ならびにその方法 |
| DE102008058177A1 (de) * | 2008-11-20 | 2010-06-24 | Eos Gmbh Electro Optical Systems | Verfahren zur Identifizierung von Lasersinterpulvern |
| CN101751714A (zh) * | 2008-12-05 | 2010-06-23 | 深圳富泰宏精密工业有限公司 | 多功能便携式电子装置 |
| US8553973B2 (en) | 2009-07-07 | 2013-10-08 | University Of Basel | Modeling methods and systems |
| US20110055053A1 (en) | 2009-09-02 | 2011-03-03 | Corpus.E Ag | Computerized method of identifying best fitting footwear |
| US20110117268A1 (en) * | 2009-11-19 | 2011-05-19 | Stratasys, Inc. | Consumable materials having encoded markings for use with direct digital manufacturing systems |
| US20120157160A1 (en) | 2010-12-21 | 2012-06-21 | The Regents Of The University Of California | Compact wide-field fluorescent imaging on a mobile device |
| US9057702B2 (en) | 2010-12-21 | 2015-06-16 | The Regents Of The University Of California | Compact wide-field fluorescent imaging on a mobile device |
| JP2012188630A (ja) * | 2011-03-14 | 2012-10-04 | Osaka Univ | 蛍光体、該蛍光体と発光素子とを組み合わせた発光装置、及び、該蛍光体を含有する真贋識別標識 |
| US9250246B2 (en) * | 2011-06-29 | 2016-02-02 | Portland State University | Near-infrared fluorescent dyes with large stokes shifts |
| WO2013119824A1 (en) * | 2012-02-10 | 2013-08-15 | Visualant, Inc. | Systems, methods and articles related to machine-readable indicia and symbols |
| JP3175377U (ja) * | 2012-02-20 | 2012-05-10 | 株式会社グルマンディーズ | 携帯通信端末用受信報知装置 |
| US8970867B2 (en) * | 2012-03-06 | 2015-03-03 | Mercury 3D, Llc | Secure management of 3D print media |
| US9308690B2 (en) * | 2012-07-31 | 2016-04-12 | Makerbot Industries, Llc | Fabrication of objects with enhanced structural characteristics |
| US9473760B2 (en) * | 2012-08-08 | 2016-10-18 | Makerbot Industries, Llc | Displays for three-dimensional printers |
-
2014
- 2014-06-10 CN CN201480032974.6A patent/CN105518437A/zh active Pending
- 2014-06-10 HK HK16111258.6A patent/HK1223153A1/zh unknown
- 2014-06-10 US US14/300,791 patent/US9699391B2/en not_active Expired - Fee Related
- 2014-06-10 JP JP2016519593A patent/JP2016525680A/ja active Pending
- 2014-06-10 EP EP14810817.8A patent/EP3008453A4/en not_active Withdrawn
- 2014-06-10 WO PCT/US2014/041719 patent/WO2014201009A2/en not_active Ceased
-
2018
- 2018-10-10 JP JP2018191883A patent/JP2019053069A/ja active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2001024107A2 (en) | 1999-09-30 | 2001-04-05 | Dna Technologies, Inc. | Product authentication system |
| US20030112423A1 (en) | 2000-04-24 | 2003-06-19 | Rakesh Vig | On-line verification of an authentication mark applied to products or product packaging |
| US20130135081A1 (en) | 2011-11-30 | 2013-05-30 | Waba Fun, Llc | Systems And Methods For Authenticating Objects Using IR |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3008453A4 |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10318775B2 (en) | 2016-06-24 | 2019-06-11 | Authentic Labs | Authenticable digital code and associated systems and methods |
| US10726224B2 (en) | 2016-06-24 | 2020-07-28 | Authentic Labs | Authenticable digital code and associated systems and methods |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3008453A4 (en) | 2017-01-18 |
| EP3008453A2 (en) | 2016-04-20 |
| HK1223153A1 (zh) | 2017-07-21 |
| US9699391B2 (en) | 2017-07-04 |
| CN105518437A (zh) | 2016-04-20 |
| JP2019053069A (ja) | 2019-04-04 |
| WO2014201009A3 (en) | 2015-02-05 |
| JP2016525680A (ja) | 2016-08-25 |
| US20140362228A1 (en) | 2014-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9699391B2 (en) | Systems and methods for infrared detection | |
| US10733825B2 (en) | Covert secure document registration system | |
| GB2566860B (en) | A system and method of determining if a surface is printed or a mobile device screen | |
| AU2012345705B2 (en) | Systems and methods for authenticating objects using IR | |
| US10891630B2 (en) | Product authentication using barcode characteristics | |
| US10726224B2 (en) | Authenticable digital code and associated systems and methods | |
| US9922224B1 (en) | Method and system for identifying and authenticating an object | |
| JP2016525680A5 (enExample) | ||
| JP6954355B2 (ja) | 情報取得システム、情報取得方法及び記憶媒体 | |
| JP2019531478A (ja) | 製品認証のシステムおよび方法 | |
| US20170039794A1 (en) | Photoluminescent authentication devices, systems, and methods | |
| JP6185801B2 (ja) | 判定システム及び判定装置 | |
| US11683551B2 (en) | Systems and methods for detecting light signatures and performing actions in response thereto | |
| Berchtold et al. | Fingerprinting blank paper and printed material by smartphones | |
| JP2016122893A (ja) | 画像プリント装置、システム及び方法 | |
| JP2017037271A (ja) | 遊戯用撮影装置 | |
| US12130232B2 (en) | System and method for mobile device phosphor excitation and detection |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14810817 Country of ref document: EP Kind code of ref document: A2 |
|
| DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
| ENP | Entry into the national phase |
Ref document number: 2016519593 Country of ref document: JP Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2014810817 Country of ref document: EP |