WO2014201009A2 - Systems and methods for infrared detection - Google Patents

Systems and methods for infrared detection Download PDF

Info

Publication number
WO2014201009A2
WO2014201009A2 PCT/US2014/041719 US2014041719W WO2014201009A2 WO 2014201009 A2 WO2014201009 A2 WO 2014201009A2 US 2014041719 W US2014041719 W US 2014041719W WO 2014201009 A2 WO2014201009 A2 WO 2014201009A2
Authority
WO
WIPO (PCT)
Prior art keywords
filament
mobile device
printer
images
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2014/041719
Other languages
English (en)
French (fr)
Other versions
WO2014201009A3 (en
Inventor
David C. MCCLOSKEY
Jeffrey L. BARNETT
Stanley R. JAMES
John Robert BLAKELY
Bradley Matthew White
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
RELEVANT PLAY LLC
Original Assignee
RELEVANT PLAY LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by RELEVANT PLAY LLC filed Critical RELEVANT PLAY LLC
Priority to HK16111258.6A priority Critical patent/HK1223153A1/zh
Priority to EP14810817.8A priority patent/EP3008453A4/en
Priority to CN201480032974.6A priority patent/CN105518437A/zh
Priority to JP2016519593A priority patent/JP2016525680A/ja
Publication of WO2014201009A2 publication Critical patent/WO2014201009A2/en
Publication of WO2014201009A3 publication Critical patent/WO2014201009A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • A63F13/655Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/69Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor by enabling or updating specific game elements, e.g. unlocking hidden features, items, levels or versions
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/06Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
    • G07D7/12Visible light, infrared or ultraviolet radiation
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07DHANDLING OF COINS OR VALUABLE PAPERS, e.g. TESTING, SORTING BY DENOMINATIONS, COUNTING, DISPENSING, CHANGING OR DEPOSITING
    • G07D7/00Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency
    • G07D7/06Testing specially adapted to determine the identity or genuineness of valuable papers or for segregating those which are unacceptable, e.g. banknotes that are alien to a currency using wave or particle radiation
    • G07D7/12Visible light, infrared or ultraviolet radiation
    • G07D7/1205Testing spectral properties
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N2021/6417Spectrofluorimetric devices
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N2201/00Features of devices classified in G01N21/00
    • G01N2201/02Mechanical
    • G01N2201/022Casings
    • G01N2201/0221Portable; cableless; compact; hand-held

Definitions

  • CMOS complementary metal-oxide semiconductor
  • IR cut-off filter prevents infrared radiation from distorting colors in images from colors as generally perceived by the human eye. While this results in more natural looking images, conventional mobile devices are unsuitable for detecting fluorescent emission at IR wavelengths without removal of the included infrared cut-off filter.
  • a fluorescence detection system includes a light source for coupling with a mobile device and software, having machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: activating the light source in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the light source on with an image captured with the light source off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating objects by measuring the intensity shift within the images.
  • a fluorescence detection system includes software, having machine readable instructions loadable into memory of a mobile device and executable by a processor of the mobile device, capable of: activating a display of the mobile device to emit light in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the display on with an image captured with the display off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating an object by measuring the intensity shift within the images.
  • a fluorescence detection system couples with a mobile device having a camera.
  • the system includes a filter for placing over a flash of the camera, software, having machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, that is capable of: capturing a first image of an object using a camera of the mobile device when the flash is not active; activating the flash in coordination with capturing a second image of the object using the camera; analyzing the first and second images to detect a shift of intensity within a predetermined color range within the images based upon fluorescence from the object in response to activation of the flash; and identifying and authenticating the object based upon the detected shift in intensity.
  • a near-IR filter array layer for an electromagnetic sensor array includes a plurality of infrared filters arranged over the sensor array such that, for each pixel of the sensor array, each infrared filter is configured to pass a different wavelength of electromagnetic radiation within the infrared wavelength band to one sensor of the pixel.
  • a 3D printer has filament authentication, and includes a print engine for generating a 3D object using a filament of material, and an IR authenticator positioned to authenticate the filament before use by the print engine. Operation of the print engine is based upon authentication of the filament by the IR authenticator.
  • a method authenticates a filament used in a 3D printer.
  • An IR beam at a first wavelength is projected onto the filament within the 3D printer.
  • IR fluorescence at a second wavelength from a dye within the filament is detected in response to the IR beam.
  • the detected IR fluorescence indicates authentication of the filament within the 3D printer.
  • FIG. 1 schematically illustrates one exemplary fluorescence detection system coupled with a mobile device, illustrated as a smart phone, in an embodiment.
  • FIGs. 2 and 3 show a perspective view of operation of the mobile device of FIG. 1 to capture an IR image and an RGB image of an object to be authenticated.
  • FIG. 4 shows exemplary location of the IR fluorescent dye within the object of
  • FIG. 5 is a schematic showing one exemplary IR image sensor for use in a digital camera, in an embodiment.
  • FIG. 6 is a graph showing three exemplary responses of the sensor and filter combinations of FIG. 5.
  • FIG. 7 shows one exemplary 3D printer for printing a 3D object that may be externally authenticated, in an embodiment.
  • FIG. 8 shows one exemplary 3D printer with 3D printer consumable authentication, in an embodiment.
  • a system for fluorescent detection using a mobile device includes a light source such as an LED powered by the mobile device.
  • the LED may be configured with the mobile device (e.g., a "flash" for use with the camera of the mobile device) or adapted for plugging into the mobile device (e.g., using the headphone jack of the mobile device).
  • Software running on the mobile device activates the LED to illuminate an object/subject of interest in coordination with capturing one or more images of the object/subject using the on-board camera of the mobile device.
  • a first image of the object, captured when the LED is turned off, is compared to a second image of the object, captured when the LED is turned on, by software to detect a shift of intensity for a given color range within the images.
  • a blue to violet LED e.g., 450nm wavelength
  • the software detects a shift of intensity within a red wavelength band when the object includes a material that fluoresces in the red wavelength band when excited by light at a wavelength of 450nm.
  • a band-pass filter is applied to the LED "flash" of the mobile device such that when activated, the LED emits light of a particular wavelength.
  • the measured intensity shift allows the software on the mobile device to identify and authenticate objects. Identifying data may be hidden within the intensity shift, by combining known information about (a) the size of a fluorescent marker within or on the object that is used to gauge distance from the object with (b) the amount of intensity shift detected within the captured images.
  • an object may be impregnated or coated (in part or in whole) with one or more fluorescent dyes.
  • a fluorescent "signature" of the object may be measured using the LED and the camera as described above, and the information stored in memory accessible by the software.
  • fluorescent signatures of a plurality of objects used in playing a mobile game may be included in gaming data stored within memory of the mobile device or accessible via the Internet.
  • the mobile device When used in connection with a game, for example, the mobile device may be used to authenticate an action figure or other object, and thus, to "unlock" a corresponding character within the game.
  • the mobile device may therefore replace USB platforms currently used to link toys/objects with video game characters, thus granting a player the freedom to play his or her game away from the platform.
  • software running on the mobile device controls an RGB LED to emit light within a desired wavelength band in coordination with image capture (i.e., to emit light of a desired color when taking a picture).
  • software controls the RGB LED to emit blue- violet light, in order to elicit a fluorescent response measurable in the red wavelength band.
  • One or more images taken with the LED emitting in the desired wavelength band are processed with one or more images taken with the LED off, to determine an intensity shift in the red band, in order to identify and authenticate objects.
  • a filter may be placed over the flash of a mobile device camera, in order to limit emission by the flash, in order to elicit a measurable fluorescent response by the object.
  • a filter may block green and red emissions of the flash, to limit light striking the object to blue. An intensity shift within the red color channel may then be detected within captured images and analyzed to authenticate the object.
  • Dyes may be designed to regulate object emission. Given that the fluorescence is within visible light, the authentication process may be noticeable, barely noticeable, or hardly detectable to the human eye.
  • the disclosed systems and methods beneficially provide not only mobile authentication, but also rapid authentication.
  • Mobile device cameras typically run at 24 to 30 frames per second, and as little as one frame is needed to capture a fluorescence response to an excitation wavelength in order to authenticate the object.
  • noticeability by the human eye of the LED activation and of the corresponding fluorescence response would be negligible.
  • additional frames may be used to provide data to sort against false positives.
  • a mobile device (such as an iPhone) may be configured with a fluorescence detection system for acquisition, identity and authentication of an object.
  • An LED powered by the phone jack of the mobile device and attached with a back surface of the device, proximate the device camera and camera flash, emits at 450nm.
  • the object being detected is painted with a dye that fluoresces when illuminated by the LED, as shown in the image displayed on the mobile device screen.
  • the mobile device screen shows a standard, RGB image of the object as taken by the built-in mobile device camera, and an IR / differenced image in which object fluorescence is visible.
  • FIG. 1 schematically illustrates one exemplary fluorescence detection system 100 configured as a mobile device 102, illustrated as a smart phone.
  • FIGs. 2 and 3 show a perspective view of operation of mobile device 102 of FIG. 1 capturing an IR image 116 and an RGB image 118 of an object 202 to be authenticated.
  • FIG. 4 shows exemplary location of IR fluorescent dye 306 within object 202.
  • FIGs. 1, 2, 3 and 4 are best viewed together with the following description.
  • Software 104 stored within memory 106 of mobile device 102, includes machine readable instructions that when executed by a processor 108 of mobile device 102 interact with mobile device 102 to activate an LED 110 coupled with mobile device 102 in coordination with capturing one or more images of object 202 with a camera 112 of mobile device 102.
  • LED 110 is for example powered by mobile device 102 at an interface 114, such as a jack of mobile device 102 for example. It will be appreciated that features of system 100 are placed as shown in FIG. 1 for purposes of illustration only, and that shown features (e.g., LED 110, interface 114, camera 112, a display 122 and others) may be located in positions other than those shown in FIG. 1.
  • At least one captured IR image 116 (captured by camera 112 when LED 110 is on), and at least one RGB image 118 (captured by camera 112 when LED 110 is off) are processed/compared by processor 108 to generate a difference image 119 for detecting a shift of intensity for a given color range within images 116 and 118.
  • software 104 triggers LED 110 to flash in synch with a frame rate of camera 112 such that LED 110 is active to illuminate object 202 only during capture of alternate frames by camera 112.
  • LED 110 represents a built-in "flash" LED of mobile device 102 that is controlled to provide illumination for use with camera 112.
  • software 104 detects a shift of intensity within a red wavelength band when the imaged object includes fluorescent dye 306 (or other material with fluorescing pigments) that fluoresces in the red wavelength band when excited by light at a wavelength of 450nm.
  • the measured intensity shift within the red wavelength band allows software 104 to identify and
  • Software 104 executed by processor 108, compares a measured intensity shift and other image data of images 116, 118, 119 with a database 150 of fluorescent signatures 152 of known, authentic objects to identity and authenticate an object within images 116, 118, where each signature 152 may define one or more of wavelength, position, shape, and other specifics of fluorescent marker(s) present within object 202.
  • database 150 is stored in memory 106, but may be stored elsewhere that is otherwise accessible by software 104, for example from a database stored on a server and accessible via the Internet via a wireless interface 120.
  • IR Image 116, RGB image 118 and/or difference image 119 highlighting fluorescence of object 202 may be displayed on a display 122 of mobile device 102.
  • object identity/authentication and other information from database 150 may also be displayed on display 122, once object 202 is identified and authenticated.
  • software 104 may trigger or invoke other actions, both on mobile device 102 and external thereto using wireless interface 120.
  • display 122 is controlled by software 104 to display blue (e.g., to emit light at a 450nm wavelength) to illuminate an object placed in front of display 122, thereby eliminating the need for LED 110.
  • camera 112 is forward facing on mobile device 102 to capture images of the object illuminated by light from display 112.
  • Control (e.g., activation and deactivation) of display 122 is similar to control of LED 110 as described above, and camera 112 is controlled to capture RGB image 118 when display 122 is inactive, and to capture IR image 116 when display 1122 is emitting light at a 450nm wavelength.
  • This embodiment is particularly advantageous where mobile device 102 is a tablet computer that does not have a built in "flash" LED.
  • Bayer filter or Bayer layer
  • the Bayer filter is a "visible light" filter array comprised of red, green and blue color filters mounted directly before sensors grouped as pixels. Each filter of the array allows only photons of a specific color onto the corresponding sensor, where each pixel has one red, two green, and one blue filter and four corresponding sensors.
  • Software then applies various demosaicing algorithms to determine color (e.g., a set of RGB values) for each pixel based upon sensed light levels and the geometry of the group of filters and sensors forming each pixel.
  • CMOS and CCD sensors are sensitive to light with wavelengths between about 400 and about 1 lOOnm, and therefore may be used to detect radiation in at least part of the near infrared (700-1200 nm) portion of the electromagnetic spectrum.
  • the Bayer layer allows only light within a human visible wavelength (e.g., 400nm to 700nm) to pass through, conventional cameras formed with the Bayer layer are unable to detect IR wavelengths and are not suited for infrared image capture. With the Bayer filters array removed, these conventional cameras detect only intensity levels of near IR radiation.
  • FIG. 5 is a schematic showing one exemplary IR image sensor 500 for use in a digital camera.
  • IR image sensor 500 has an array of sensors 502 and an array of IR filters 504 positioned thereon. Sensors 502 and filters 504 are grouped into pixels 506 that each has four sensors 502 and four corresponding filters 504 in this example. Each sensor 502 operates to sense electromagnetic energy in the wavelength range of 700- 1200 nm. Within each pixel 506, filters 504 are selected to pass IR energy at two or more different wavelengths.
  • FIG. 5 is a schematic showing one exemplary IR image sensor 500 for use in a digital camera.
  • IR image sensor 500 has an array of sensors 502 and an array of IR filters 504 positioned thereon. Sensors 502 and filters 504 are grouped into pixels 506 that each has four sensors 502 and four corresponding filters 504 in this example. Each sensor 502 operates to sense electromagnetic energy in the wavelength range of 700- 1200 nm. Within each pixel 506, filters 504 are selected to pass
  • FIG. 6 is a graph showing three exemplary responses of sensor 502 and filter 504 combinations.
  • filter 504(1) has a pass band wavelength centered at 720nm
  • a filter 504(2) has a pass band wavelength centered at 775nm
  • a filter 504(3) has a pass band wavelength centered at 845nm.
  • two or more filters 504 may be configured at the same pass band wavelength.
  • pixels may have more than four sensors 502 and filters 504 such that greater selectivity within the near IR waveband may be achieved.
  • each pixel 506 certain filters 504 are selected to pass visible light (e.g., as with conventional Bayer filters) and other filters are configured to pass only IR wavelengths as shown in FIG. 6, wherein software (e.g., software 104) operates to selectively process output for sensors 502 for each pixel 506 to generate one or both of a visible image and an IR image.
  • software e.g., software 104
  • the software may operate to identify specific frequency responses from object 202 for purposes of authentication.
  • an object may be configured with multiple fluorescing dyes that fluoresce at different wavelengths, where filters 504 are configured to determine presence or absence of these fluorescent responses to achieve stronger authentication.
  • camera 112 of system 100 is configured with image sensor 500 of FIG. 5 and used for infrared photography, detection and authentication.
  • LED 110 is controlled by software 104 to elicit a fluorescent emission from object 202 tagged (impregnated or otherwise marked) with fluorescent dye 306.
  • software 104 activates LED 110 to illuminate object 202 in coordination with capturing IR image 116, deactivates LED 110 in coordination with capturing RGB image 118, where RGB image 118 does not represent a visible image, but is used to detect background IR levels.
  • Software 104 compares IR image 116 with RGB image 118 to generate difference image 119 that has background levels of IR removed.
  • Software 104 may then process selective sensors 502 values for each pixel 506 within difference image 118 to identify a fluorescent response "signature" (a fluorescent stamp, pattern, marking, complex emission or simple emission) of object 202. Additional multiple wavelength analysis of IR image 116 and/or difference image 119 may be performed to determine object identity and authentication, for example by comparing a unique spectral signature of the dye or material (or combinations thereof) with a database of signatures of tagged objects.
  • a fluorescent response "signature" a fluorescent stamp, pattern, marking, complex emission or simple emission
  • filament/resin/fiber used in cooperation with fluorescent detection, companies may digitally distribute their physical goods, by adding one or more IR fluorescing dyes of a known frequency response to filament, fibers or resins used to manufacture items through 3D printing.
  • the filament/resin/fiber (which may be used interchangeably hereafter) may be impregnated with or produced with one or more dyes that fluoresce at a known wavelength when illuminated by a light source.
  • FIG. 7 shows one exemplary 3D printer 700 for printing a 3D object 708 that may be externally authenticated.
  • 3D printer 700 includes a print engine 702 that uses a filament consumable 704 such as a resin, illustratively shown supplied on a reel 706, for creating 3D object 708.
  • a consumer purchases filament consumable 704 and downloads a digital design 720 for printing 3D object 708 from the resin. The consumer may then print (create) 3D object 708 using 3D printer 700.
  • resin 704 to create 3D object 708 may be used interactively with other devices.
  • an IR authenticator 710 e.g., system 100 of FIG.
  • IR authenticator 710 may include a computer/microprocessor, an IR projector, and an IR camera, and optionally an RGB camera.
  • 3D object 708 is detected within a field of view of the IR camera (and optional RGB camera). Images of the object are captured with the camera, with the IR projector turned off and with the IR projector turned on, and the images are processed to detect a fluorescent response of the dye incorporated with 3D object 708.
  • a fluorescent signature of 3D object 708 may be authenticated via an authentication algorithm, thus allowing 3D object 708 become interactive with game 750.
  • authentication of 3D object 708 by IR authenticator 710 may unlock promotions offered via an external system for identifying specific objects (for example, a team jersey worn at a sporting event or while viewing a sporting event in front of a Smart TV).
  • 3D object 708 represents a building block or other component of a children's toy, that is then identified and authenticated by IR authenticator 710 to unlock functionality of a third party system or device looking for the authenticated 3D object 708.
  • This technology may lower the cost of manufactured goods, as authentic products may be created at home or at local stores or distribution centers.
  • new revenue streams may grow from consumers licensing and downloading digital files needed to print desired objects from the tagged filament/resin/fiber (e.g., filament/resin/fiber 704).
  • objects made with tagged resin may be authenticated and the owner of the objects may receive a warranty for authenticated objects.
  • filament 704 may be may be tagged with an invisible IR dye or combination of dyes that fluoresce at known wavelengths, such that a printed weapon may be detected by systems for detecting IR response incorporated into airport security for example.
  • FIG. 8 shows one exemplary 3D printer 800 with 3D printer consumable authentication, in an embodiment.
  • 3D printer 800 includes a print engine 802 that uses a filament consumable 804, illustratively shown supplied on a reel 806, for creating a 3D object 808.
  • Print engine 802 is coupled with an IR authenticator 810 that is invoked to authenticate filament 804.
  • IR authenticator 810 includes an IR source and an IR detector (e.g., a camera capable of detecting IR wavelengths) that cooperate to detect presence of IR fluorescing pigments (e.g., dyes) within filament 804 in the beam of the IR source, for example at location 812.
  • IR authenticator 810 utilizes simple, low-cost and commonly available sensors (e.g., photodiode, phototransistors, CMOS and/or other sensors) for detection of fluorescence from dyes within filament 804.
  • location 812 is within 3D printer 800 and positioned on a path of filament 804 as it is taken from reel 806 into print engine 802.
  • IR authenticator 810 detects fluorescence of pigments within filament 804 while it is still on reel 806.
  • print engine 802 controls IR authenticator 810 to authenticate filament 804 when installed into 3D printer 800, wherein IR authenticator 810 generates IR at a first wavelength, and detects corresponding IR fluorescence at a second wavelength from one or more IR fluorescing dyes present within filament 804.
  • first and second wavelengths are 30-80nm or more apart, for example.
  • print engine 802 utilizes identification of IR fluorescence to configure operating parameters for using filament 804. For example, presence or absence of one or more of a plurality of fluorescence responses may be used to specify processing parameters (e.g., temperature, feed rate, heat bed temperature, etc.) for using filament 804, wherein print engine 802 is thereby configured automatically when filament 804 is changed and a new IR "signature" identified.
  • processing parameters e.g., temperature, feed rate, heat bed temperature, etc.
  • functionality of print engine 802 is restricted when filament 804 is not authenticated by IR authenticator 810.
  • 3D printer 800 may not function if filament 804 is not authenticated by print engine 802.
  • a product manufacturer may release a 3D print design file of an object 808 that is associated with filament 804, wherein 3D printer 800 does not print the 3D print design unless the specific filament 804 is authenticated.
  • the product manufacturer, or a third party associated with the manufacturer may sell filament 804 at a premium price for use with 3D printer 800 to print one or more copies of the object from the 3D design file.
  • printer 800 compares a fluorescence response of filament loaded into the printer with the fluorescence response expected of authentic filament 804 from the manufacturer.
  • print engine 802 inhibits generation of object 808. That is, unless IR authenticator 810 authenticates filament 804 within 3D printer 800, object 808 will not be printed. In one example, printer 800 will not run or complete the 3D design file if the filament is not authentic filament 804. In another example, print engine 802 is locked if authentication fails. A fluorescent signature of the filament may be authenticated via an authentication algorithm run by IR authenticator 810.
  • print engine 802 and IR authenticator 810 may periodically authenticate filament 804 during printing of object 808, wherein failure to authenticate filament 804 may interrupt generation of object 808.
  • print engine 802 is configured based upon
  • output quality of print engine 802 may be determined based upon authentication of filament 804, where the quality of material of filament 804, as identified and authenticated by IR authenticator 810, defines the output quality of print engine 802.
  • a printer manufacturer may direct users of 3D printer 800 to use a particular filament 804, such as from a preferred supplier.
  • a third party filament supplier would not include fluorescing dyes within the filament, or would not include the unique fluorescent signature of the particular filament 804, and thereby this third party product could not be used within 3D printer 800, or could be used only with reduced performance of 3D printer 800.
  • Fluorescing dyes may be added to other 3D printer filament materials, such as one or more of rubbers, metals, gelatins/lipids (e.g., for printing artificial tissues), stainless steel, brass, wood pulp-plastic mixtures, nylon, polyester, graphene/carbon fiber, ceramic, bacteria, and paper. Combination of Features
  • a fluorescence detection system including a light source for coupling with a mobile device, and software, comprising machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: activating the light source in coordination with capturing one or more images using a camera of the mobile device; analyzing an image captured with the light source on with an image captured with the light source off, to detect a shift of intensity within a predetermined color range within the images; and identifying and authenticating an object by measuring the intensity shift within the images.
  • the light source being an LED adapted to plug into a port of the mobile device.
  • the step of analyzing including detecting a fluorescent response from an object tagged with an IR- fluorescing dye in the red wavelength band within the image in response to the emission from the light source.
  • the mobile device being selected from the group including a mobile phone, a tablet, a laptop computer, a notebook computer, an MP3 player, an iPad, an iTouch, an iPod and a personal data assistant.
  • a fluorescence detection system for coupling with a mobile device having a camera including: a filter for placing over a flash of the camera, and software, comprising machine readable instructions loadable into memory of the mobile device and executable by a processor of the mobile device, capable of: capturing a first image of an object using the camera when the flash is not active; activating the flash in coordination with capturing a second image of the object using the camera; analyzing the first and second images to detect a shift in intensity within a predetermined color range within the first and second images based upon fluorescence from the object in response to activation of the flash; and identifying and authenticating the object based upon the detected shift in intensity.
  • the predetermined color range comprising a red wavelength band
  • the object is configured with an IR- fluorescing dye that fluoresces at the red wavelength band in response to the filtered emission from the flash.
  • a 3D printer with filament authentication including: a print engine for generating a 3D object using a filament of material; and an infrared (IR) authenticator positioned to authenticate the filament before use by the print engine; wherein operation of the print engine is based upon authentication of the filament by the IR authenticator.
  • IR infrared
  • the IR authenticator including: an IR generator for generating IR at a first wavelength, and an IR detector for detecting fluorescence of a dye within the filament at a second IR wavelength. The authentication of the filament being based upon detection of the fluorescence at the second IR wavelength.
  • (q) A method for authenticating a filament used in a 3D printer, including: projecting, within the 3D printer, an IR beam at a first wavelength onto the filament; and detecting, in response to the IR beam, IR fluorescence at a second wavelength from a dye within the filament; wherein the detected IR fluorescence indicates authentication of the filament within the 3D printer.
  • (r) In the method denoted as (q), the steps of projecting and detecting being repeated periodically during operation of the 3D printer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Toxicology (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • Chemical & Material Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Inspection Of Paper Currency And Valuable Securities (AREA)
PCT/US2014/041719 2013-06-10 2014-06-10 Systems and methods for infrared detection Ceased WO2014201009A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
HK16111258.6A HK1223153A1 (zh) 2013-06-10 2014-06-10 用於红外检测的系统和方法
EP14810817.8A EP3008453A4 (en) 2013-06-10 2014-06-10 Systems and methods for infrared detection
CN201480032974.6A CN105518437A (zh) 2013-06-10 2014-06-10 用于红外检测的系统和方法
JP2016519593A JP2016525680A (ja) 2013-06-10 2014-06-10 赤外線検出用のシステム及び方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361833365P 2013-06-10 2013-06-10
US61/833,365 2013-06-10
US201361902524P 2013-11-11 2013-11-11
US61/902,524 2013-11-11

Publications (2)

Publication Number Publication Date
WO2014201009A2 true WO2014201009A2 (en) 2014-12-18
WO2014201009A3 WO2014201009A3 (en) 2015-02-05

Family

ID=52005165

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/041719 Ceased WO2014201009A2 (en) 2013-06-10 2014-06-10 Systems and methods for infrared detection

Country Status (6)

Country Link
US (1) US9699391B2 (enExample)
EP (1) EP3008453A4 (enExample)
JP (2) JP2016525680A (enExample)
CN (1) CN105518437A (enExample)
HK (1) HK1223153A1 (enExample)
WO (1) WO2014201009A2 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10318775B2 (en) 2016-06-24 2019-06-11 Authentic Labs Authenticable digital code and associated systems and methods

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9642606B2 (en) 2012-06-27 2017-05-09 Camplex, Inc. Surgical visualization system
US9936863B2 (en) 2012-06-27 2018-04-10 Camplex, Inc. Optical assembly providing a surgical microscope view for a surgical visualization system
US9782159B2 (en) 2013-03-13 2017-10-10 Camplex, Inc. Surgical visualization systems
US10881286B2 (en) 2013-09-20 2021-01-05 Camplex, Inc. Medical apparatus for use with a surgical tubular retractor
US10108924B2 (en) * 2013-09-26 2018-10-23 At&T Mobility Ii Llc Methods and apparatus to emulate a toy
US20160078706A1 (en) * 2014-09-17 2016-03-17 Thomas D. Pawlik Method of authenticating an object
US11042869B1 (en) 2014-09-30 2021-06-22 Amazon Technologies, Inc. Method, medium, and system for associating a payment amount with a physical object
JP6729381B2 (ja) * 2014-10-06 2020-07-22 ソニー株式会社 固体撮像装置、及び、電子機器
EP3226799A4 (en) 2014-12-05 2018-07-25 Camplex, Inc. Surgical visualization systems and displays
US10168281B2 (en) * 2015-01-27 2019-01-01 Hitachi High-Technologies Corporation Multicolor fluorescence analysis device
US11154378B2 (en) 2015-03-25 2021-10-26 Camplex, Inc. Surgical visualization systems and displays
US10139342B2 (en) * 2015-08-04 2018-11-27 Spectra Systems Corporation Photoluminescent authentication devices, systems, and methods
US10140494B1 (en) * 2015-08-04 2018-11-27 Spectra Systems Corporation Photoluminescent authentication devices, systems, and methods
US20230065252A1 (en) * 2015-08-17 2023-03-02 Lego A/S Toy system and a method of operating the toy system
DK3337585T3 (da) 2015-08-17 2022-11-07 Lego As Fremgangsmåde til at skabe et virtuelt spilmiljø og interaktivt spilsystem under anvendelse af fremgangsmåden
DK180058B1 (en) * 2018-07-06 2020-02-27 Lego A/S toy system
EP3383247A4 (en) * 2015-11-25 2019-06-26 Camplex, Inc. SURGICAL VISUALIZATION SYSTEMS AND DISPLAYS
ITUB20159638A1 (it) * 2015-12-15 2017-06-15 Gd Spa Metodo e sistema per realizzare un oggetto mediante una tecnica di produzione additiva e per renderlo tracciabile.
HUE062485T2 (hu) * 2016-05-18 2023-11-28 Colop Digital Gmbh Eljárás egy szubsztrát hitelesítésére speckle-minták felhasználásával és egy eszköz az eljárás végrehajtásához
KR102314241B1 (ko) * 2017-03-28 2021-10-20 삼성전자주식회사 적응적 인증 수행 방법 및 이를 지원하는 전자 장치
US10918455B2 (en) 2017-05-08 2021-02-16 Camplex, Inc. Variable light source
KR102472629B1 (ko) * 2017-10-23 2022-11-30 삼성전자주식회사 적외선 다중 대역을 감지하는 이미지 센서 및 이를 이용한 전자 장치
WO2019083541A1 (en) * 2017-10-27 2019-05-02 Hewlett-Packard Development Company, L.P. THREE-DIMENSIONAL (3D) MODEL PROTECTION THROUGH CONSUMABLES
US10935376B2 (en) * 2018-03-30 2021-03-02 Koninklijke Philips N.V. System and method for 3D scanning
US11776313B2 (en) * 2018-12-10 2023-10-03 Gentex Corporation Scanning apparatus for reducing field of view search space
EP3903093A4 (en) * 2019-01-07 2022-12-14 Intelligent Material Solutions, Inc. SYSTEM AND METHOD FOR PHOSPHORUS EXCITATION AND DETECTION BY A MOBILE DEVICE
CN112288008B (zh) * 2020-10-29 2022-03-01 四川九洲电器集团有限责任公司 一种基于深度学习的马赛克多光谱图像伪装目标检测方法
EP4241256A2 (en) * 2020-11-04 2023-09-13 VerifyMe, Inc. Remote infrared ink reader and authenticator
CN113870479B (zh) * 2021-08-31 2023-06-13 中钞印制技术研究院有限公司 防伪纸张鉴别方法和装置、电子设备和可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001024107A2 (en) 1999-09-30 2001-04-05 Dna Technologies, Inc. Product authentication system
US20030112423A1 (en) 2000-04-24 2003-06-19 Rakesh Vig On-line verification of an authentication mark applied to products or product packaging
US20130135081A1 (en) 2011-11-30 2013-05-30 Waba Fun, Llc Systems And Methods For Authenticating Objects Using IR

Family Cites Families (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5402364A (en) 1993-01-15 1995-03-28 Sanyo Machine Works, Ltd. Three dimensional measuring apparatus
US5691909A (en) 1995-12-29 1997-11-25 Western Atlas Method of virtual machining to predict the accuracy of part to be made with machine tools
JP3068483B2 (ja) * 1996-02-08 2000-07-24 株式会社東芝 パターン読み出し方法、および光学的信号読み取り装置
US5988862A (en) 1996-04-24 1999-11-23 Cyra Technologies, Inc. Integrated system for quickly and accurately imaging and modeling three dimensional objects
GB2364894B8 (en) 2000-07-19 2010-07-07 Fmc Corp Three axis portioning method
WO2002061405A2 (en) 2001-01-31 2002-08-08 Pottier Roy H Method and hand-held device for fluorescence detection
TW563345B (en) * 2001-03-15 2003-11-21 Canon Kk Image processing for correcting defects of read image
US7092089B2 (en) * 2002-02-07 2006-08-15 Rgb Technologies Ab Method and system for chemical or biochemical analysis of a target analyte in a target environment
JP2004171109A (ja) 2002-11-18 2004-06-17 Nippon Telegr & Teleph Corp <Ntt> デバイス認証システム
EP1606121A4 (en) 2003-03-27 2010-05-05 Graphic Security Systems Corp SYSTEM AND METHOD FOR AUTHENTICATING OBJECTS
WO2004113889A1 (en) * 2003-06-20 2004-12-29 The Texas A & M University System Method and system for near-infrared fluorescence contrast-enhanced imaging with area illumination and area detection
JP2005196627A (ja) * 2004-01-09 2005-07-21 Olympus Corp 偽券検知機能付きカメラ及びカメラを用いた偽券検知方法
US20060202132A1 (en) * 2005-03-14 2006-09-14 Chua Janet B Y Portable fluorescence detection unit adapted for eye protection
JP2006263044A (ja) * 2005-03-23 2006-10-05 Fuji Photo Film Co Ltd 蛍光検出システム
WO2007109690A2 (en) 2006-03-21 2007-09-27 Ultradots, Inc. Authenticating and identifying objects by detecting markings through turbid materials
JP4968436B2 (ja) * 2006-06-08 2012-07-04 大日本印刷株式会社 セキュリティ情報媒体読取装置
US7547894B2 (en) * 2006-09-15 2009-06-16 Performance Indicator, L.L.C. Phosphorescent compositions and methods for identification using the same
EP1912059A1 (en) 2006-10-11 2008-04-16 Basf Se Mobile device for fluorescence detection and its use
US7706700B2 (en) * 2007-03-21 2010-04-27 Xerox Corporation System and method for authenticating an electrostatographic material in an image forming apparatus
WO2009121775A2 (de) * 2008-04-01 2009-10-08 Bauhaus-Universität Weimar Verfahren und beleuchtungsvorrichtung zur optischen kontrastverstärkung
JP2011521237A (ja) 2008-05-20 2011-07-21 ユニバーシティー ヘルス ネットワーク 螢光に基づく画像化およびモニタリング用装置ならびにその方法
DE102008058177A1 (de) * 2008-11-20 2010-06-24 Eos Gmbh Electro Optical Systems Verfahren zur Identifizierung von Lasersinterpulvern
CN101751714A (zh) * 2008-12-05 2010-06-23 深圳富泰宏精密工业有限公司 多功能便携式电子装置
US8553973B2 (en) 2009-07-07 2013-10-08 University Of Basel Modeling methods and systems
US20110055053A1 (en) 2009-09-02 2011-03-03 Corpus.E Ag Computerized method of identifying best fitting footwear
US20110117268A1 (en) * 2009-11-19 2011-05-19 Stratasys, Inc. Consumable materials having encoded markings for use with direct digital manufacturing systems
US20120157160A1 (en) 2010-12-21 2012-06-21 The Regents Of The University Of California Compact wide-field fluorescent imaging on a mobile device
US9057702B2 (en) 2010-12-21 2015-06-16 The Regents Of The University Of California Compact wide-field fluorescent imaging on a mobile device
JP2012188630A (ja) * 2011-03-14 2012-10-04 Osaka Univ 蛍光体、該蛍光体と発光素子とを組み合わせた発光装置、及び、該蛍光体を含有する真贋識別標識
US9250246B2 (en) * 2011-06-29 2016-02-02 Portland State University Near-infrared fluorescent dyes with large stokes shifts
WO2013119824A1 (en) * 2012-02-10 2013-08-15 Visualant, Inc. Systems, methods and articles related to machine-readable indicia and symbols
JP3175377U (ja) * 2012-02-20 2012-05-10 株式会社グルマンディーズ 携帯通信端末用受信報知装置
US8970867B2 (en) * 2012-03-06 2015-03-03 Mercury 3D, Llc Secure management of 3D print media
US9308690B2 (en) * 2012-07-31 2016-04-12 Makerbot Industries, Llc Fabrication of objects with enhanced structural characteristics
US9473760B2 (en) * 2012-08-08 2016-10-18 Makerbot Industries, Llc Displays for three-dimensional printers

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001024107A2 (en) 1999-09-30 2001-04-05 Dna Technologies, Inc. Product authentication system
US20030112423A1 (en) 2000-04-24 2003-06-19 Rakesh Vig On-line verification of an authentication mark applied to products or product packaging
US20130135081A1 (en) 2011-11-30 2013-05-30 Waba Fun, Llc Systems And Methods For Authenticating Objects Using IR

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3008453A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10318775B2 (en) 2016-06-24 2019-06-11 Authentic Labs Authenticable digital code and associated systems and methods
US10726224B2 (en) 2016-06-24 2020-07-28 Authentic Labs Authenticable digital code and associated systems and methods

Also Published As

Publication number Publication date
EP3008453A4 (en) 2017-01-18
EP3008453A2 (en) 2016-04-20
HK1223153A1 (zh) 2017-07-21
US9699391B2 (en) 2017-07-04
CN105518437A (zh) 2016-04-20
JP2019053069A (ja) 2019-04-04
WO2014201009A3 (en) 2015-02-05
JP2016525680A (ja) 2016-08-25
US20140362228A1 (en) 2014-12-11

Similar Documents

Publication Publication Date Title
US9699391B2 (en) Systems and methods for infrared detection
US10733825B2 (en) Covert secure document registration system
GB2566860B (en) A system and method of determining if a surface is printed or a mobile device screen
AU2012345705B2 (en) Systems and methods for authenticating objects using IR
US10891630B2 (en) Product authentication using barcode characteristics
US10726224B2 (en) Authenticable digital code and associated systems and methods
US9922224B1 (en) Method and system for identifying and authenticating an object
JP2016525680A5 (enExample)
JP6954355B2 (ja) 情報取得システム、情報取得方法及び記憶媒体
JP2019531478A (ja) 製品認証のシステムおよび方法
US20170039794A1 (en) Photoluminescent authentication devices, systems, and methods
JP6185801B2 (ja) 判定システム及び判定装置
US11683551B2 (en) Systems and methods for detecting light signatures and performing actions in response thereto
Berchtold et al. Fingerprinting blank paper and printed material by smartphones
JP2016122893A (ja) 画像プリント装置、システム及び方法
JP2017037271A (ja) 遊戯用撮影装置
US12130232B2 (en) System and method for mobile device phosphor excitation and detection

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14810817

Country of ref document: EP

Kind code of ref document: A2

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2016519593

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2014810817

Country of ref document: EP