WO2004064391B1 - Versatile camera for various visibility conditions - Google Patents
Versatile camera for various visibility conditionsInfo
- Publication number
- WO2004064391B1 WO2004064391B1 PCT/IL2004/000038 IL2004000038W WO2004064391B1 WO 2004064391 B1 WO2004064391 B1 WO 2004064391B1 IL 2004000038 W IL2004000038 W IL 2004000038W WO 2004064391 B1 WO2004064391 B1 WO 2004064391B1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensor
- camera according
- versatile camera
- sensors
- visibility conditions
- Prior art date
Links
- 230000003287 optical effect Effects 0.000 claims abstract 6
- 238000000034 method Methods 0.000 claims 22
- 238000001914 filtration Methods 0.000 claims 6
- 230000002123 temporal effect Effects 0.000 claims 6
- 230000006641 stabilisation Effects 0.000 claims 4
- 238000011105 stabilization Methods 0.000 claims 4
- 210000003128 head Anatomy 0.000 claims 3
- 230000003595 spectral effect Effects 0.000 claims 3
- JBRZTFJDHDCESZ-UHFFFAOYSA-N AsGa Chemical compound [As]#[Ga] JBRZTFJDHDCESZ-UHFFFAOYSA-N 0.000 claims 2
- 229910001218 Gallium arsenide Inorganic materials 0.000 claims 2
- 229910000530 Gallium indium arsenide Inorganic materials 0.000 claims 2
- KXNLCSXBJCPWGL-UHFFFAOYSA-N [Ga].[As].[In] Chemical compound [Ga].[As].[In] KXNLCSXBJCPWGL-UHFFFAOYSA-N 0.000 claims 2
- 229910001935 vanadium oxide Inorganic materials 0.000 claims 2
- XHCLAFWTIXFWPH-UHFFFAOYSA-N [O-2].[O-2].[O-2].[O-2].[O-2].[V+5].[V+5] Chemical compound [O-2].[O-2].[O-2].[O-2].[O-2].[V+5].[V+5] XHCLAFWTIXFWPH-UHFFFAOYSA-N 0.000 claims 1
- 230000004927 fusion Effects 0.000 claims 1
- 229910052738 indium Inorganic materials 0.000 claims 1
- APFVFJFRJDLVQX-UHFFFAOYSA-N indium atom Chemical compound [In] APFVFJFRJDLVQX-UHFFFAOYSA-N 0.000 claims 1
- 238000005459 micromachining Methods 0.000 claims 1
- 230000004297 night vision Effects 0.000 claims 1
- 229910052959 stibnite Inorganic materials 0.000 claims 1
- IHBMMJGTJFPEQY-UHFFFAOYSA-N sulfanylidene(sulfanylidenestibanylsulfanyl)stibane Chemical compound S=[Sb]S[Sb]=S IHBMMJGTJFPEQY-UHFFFAOYSA-N 0.000 claims 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
A versatile camera that operates in various visibility conditions, such as daylight and poor visibility conditions, the camera including at least two sensors that capture images in a scene and provide a digital representation of the captured images, each sensor having a particular operational wavelength, and an optical and routing module that receives incoming rays from the scene and routes the incoming rays toward the two sensors.
Claims
1. Versatile camera for various visibility conditions, comprising: at least two sensors for capturing images of a scene and providing a digital signal representation of said images; 5 an optical and routing module for receiving incoming rays from said scene and routing said incoming rays toward said at least two sensors, respectively; and a processor for merging in registration and processing the images provided by said at least two sensors, ιo wherein at least one of said at least two sensors comprises a good visibility conditions sensor; wherein at least another of said at least two sensors comprises a poor visibility conditions sensor, and wherein said optical and routing module comprises a small- 15 portion/large-portion splitter, said splitter directing a small-portion of the light intensity of said incoming rays toward said good visibility conditions sensor, said splitter further directing a large-portion of the light intensity of said incoming rays toward said poor visibility conditions sensor.
20
2. The versatile camera according to claim 1 , wherein said poor visibility conditions sensor comprises a dim light amplifier.
3. The versatile camera according to claim 1 , wherein said poor visibility 25. conditions sensor comprises an invisible light sensor for detecting and converting invisible light to a visible representation.
4. The versatile camera according to claim 1 , further comprising at least two accelerometers for spatial stabilization of said display.
30
42
5. The versatile camera according to claim 1 , further comprising at least one gyroscope for spatial stabilization of said display.
6. The versatile camera according to claim 1 , further comprising a user line-of-sight detector, for spatial and temporal filtering.
7. The versatile camera according to claim 6, wherein said user line-of- sight detector comprises a head line-of-sight reader for spatial and temporal filtering at the pixel level with reference to the readings of said head line-of-sight reader.
8. The versatile camera according to claim 6, wherein said user line-of- sight detector comprises an eye line-of-sight tracker for spatial and temporal filtering at the pixel level with reference to the readings of said eye line-of-sight tracker.
9. The versatile camera according to claim 1 , wherein said at least two sensors include any combination from the list consisting of: a visible daylight sensor; - a night vision enhancement sensor; a dim light enhancement sensor; a 1.06 micron sensor; and a Forward looking infra-red (FLIR) sensor.
10. The versatile camera according to claim 9, wherein said FLIR sensor may include any combination from the list consisting of: an Indium Gallium Arsenide (InGaA) sensor; an Indium Stibnite (InSb) sensor; a non-refrigerated Vanadium Oxide (VOx) bolometer; - a Gallium Arsenide (GaA) sensor; and a Quantum Well Infrared Photodetector (QWIP).
43
11. The versatile camera according to claim 1 , wherein said good visibility conditions sensor comprises an Active Pixel Sensor (APS) operational for the visible band from about 400-450nm to about 650-
5 680nm.
12. The versatile camera according to claim 1 , wherein one sensor of said at least two sensors comprises an Active Pixel Sensor (APS) operational at wavelengths above 950nm (high pass IR). 0
13. The versatile camera according to claim 1 , wherein one sensor of said at least two sensors comprises an Active Pixel Sensor (APS) operational at the 1064nm IR frequency.
5 14. The versatile camera according to claim 1 , wherein said good visibility conditions sensor comprises an Active Pixel Sensor (APS) operational at visible daylight and at ranges extending beyond the visible daylight, and wherein said Active Pixel Sensor (APS) comprises a sensor selected from the list consisting of: o - a sensor ai 1064nm IR frequency; a high pass IR sensor above the wavelength of 950nm; and a broadband sensor substantially operational from about 400nrn to about 1 10Onm.
5 15. The versatile camera according to claim 1 , wherein at least one of said at least two sensors comprises an image intensifier (I2) coupled to an electronic video sensor.
16. The versatile camera according to claim 1 , wherein said poor visibility 0 conditions sensor comprises an image intensifier (I2) coupled to an
44 electronic video sensor, which is operational for the about 650-680nm to about 950nm wavelength band.
17. The versatile camera according to claim 15, wherein said image intensifier (I2) comprises an optical on/off iris shutter.
18. The versatile camera according to claim 15, wherein said image intensifier (I2) is gated.
19. The versatile camera according to claim 1 , wherein at least one of said at least two sensors comprises an Electron Bombardment Active Pixel Sensor (EBAPS).
20. The versatile camera according to claim 19, wherein said EBAPS is gated.
21. The versatile camera according to claim 1 , wherein at least one of said at least two sensors comprises an Active Pixel Sensor (APS) compatible to a standard format selected from the list consisting of: - VGA;
SVGA; XGA; QXGA;
UXGA - SXGA and
HDTV.
22. The versatile camera according to claim 2, further comprising a High Voltage Power Supply (HVPS) for said dim light amplifier.
23. The versatile camera according to claim 1 , wherein said optical and routing module further comprises a router selected from the list consisting of: slanted semitransparent partially reflecting mirror; - prism; pellicle; spectral splitter; lenses; diffractive element; - micro machining (mechanically deflecting plates -
MEMS/ OEMS); bifocal optics; and multiple path optics.
24. The versatile camera according to claim 1 , wherein said small- portion/large-portion splitter is selected from the list consisting of:
10%-90% prism, wherein 10% of the light intensity is directed toward said good visibility conditions sensor and 90% of the light intensity is directed toward said poor visibility conditions sensor; and
10%-90% pellicle, wherein 90% of the light intensity is directed toward said poor visibility conditions sensor and 10% of the light intensity is directed toward said good visibility conditions sensor.
25. The versatile camera according to claim 23, wherein said spectral splitter is a VIS-NIR separator.
26. The versatile camera according to claim 1 , wherein said optical and routing module includes a notch filter for the 1064nm frequency.
46
27. The versatile camera according to claim 1 , wherein said versatile camera is coupled with a display for displaying said scene.
28. The versatile camera according to claim 27, wherein said display comprises a head mounted display.
29. The versatile camera according to claim 28, wherein said head mounted display is selected from the list consisting of: helmet mounted display; - headset mounted display; goggles; eyepiece; binocular display; and monocle.
30. The versatile camera according to claim 1 , wherein said versatile camera is operative to apply display(s) to both eyes of the user, and wherein said digital signal representation of said images is divided for its separate application to each eye.
31. The versatile camera according to claim 1 , wherein said versatile camera is operative to apply a display to a single eye of the user.
32. The versatile camera according to claim 1 , wherein a second similar versatile camera is operative to apply a display to the other eye of the user.
33. The versatile camera according to claim 1 , mounted on, integral with, added on, or attachable to a device selected from the list consisting of: helmet;
47 headset; goggles; eyepiece; binoculars; and i - monocle.
34. The versatile camera according to claim 1 , adapted for use in an air, space, sea, or land environment, for a direct or indirect scene, onboard a vehicle or for portable use by an individual.
35. The versatile camera according to claim 1 , wherein said scene is a direct scene, and said digital signal representation of said images is compatible to display in registration with said direct scene as seen by the user.
36. A method for providing images of a scene under various visibility conditions for a display, comprising the procedures of: receiving incoming rays from said scene; routing said incoming rays toward at least two sensors, wherein each of said at least two sensors has a particular operational wavelength range; capturing images of said scene in each of said at least two sensors; providing a digital signal representation of said images; and - merging in registration the images provided by said at least two sensors, wherein at least one of said at least two sensors comprises a good visibility conditions sensor; wherein at least another of said at least two sensors comprises a poor visibility conditions sensor; and
48 wherein a small-portion of the light intensity of said incoming rays is directed toward said good visibility conditions sensor, and a large-portion of the light intensity of said incoming rays is directed toward said poor visibility conditions sensor.
37. The method for providing images according to claim 36, wherein said procedure of providing a digital signal representation of said images includes any combination of procedures selected from the list consisting of: - amplifying dim light; and converting invisible light to a visible representation, wherein said procedure is performed in at least one of said at least two sensors.
38. The method for providing images according to claim 36, wherein said procedure of merging comprises the sub-procedure of image fusion between at least two sensors on the basis of pixel intensity, at the pixel level.
39. The method for providing images according to claim 36, wherein said procedure of merging further comprises the sub-procedure of generating a synthetic colorized image, on the basis of spectral response, at the pixel level.
40. The method for providing images according to claim 36, further comprising the procedure of applying the resultant merged image to a display.
41. The method for providing images according to claim 36, further comprising the procedure of spatial image stabilization based on the reading of at least two accelerometers.
49
42, The method for providing images according to claim 36, further comprising the procedure of spatial image stabilization based on the reading of at least one gyroscope.
43. The method for providing images according to claim 36, further comprising the procedure of spatial and temporal filtering with respect to the user line-of-sight.
44. The method for providing images according to claim 43, wherein said procedure of spatial and temporal filtering comprises spatial and temporal filtering at the pixel level with respect to the readings of a head line-of-sight reader or an eye line of sight tracker.
50
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US11/182,302 US7496293B2 (en) | 2004-01-14 | 2005-07-15 | Versatile camera for various visibility conditions |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IL153967 | 2003-01-15 | ||
| IL153967A IL153967A (en) | 2003-01-15 | 2003-01-15 | Versatile camera for various visibility conditions |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US11/182,302 Continuation-In-Part US7496293B2 (en) | 2004-01-14 | 2005-07-15 | Versatile camera for various visibility conditions |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2004064391A1 WO2004064391A1 (en) | 2004-07-29 |
| WO2004064391B1 true WO2004064391B1 (en) | 2004-09-16 |
Family
ID=32697012
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2004/000038 WO2004064391A1 (en) | 2003-01-15 | 2004-01-14 | Versatile camera for various visibility conditions |
Country Status (2)
| Country | Link |
|---|---|
| IL (1) | IL153967A (en) |
| WO (1) | WO2004064391A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107534738A (en) * | 2015-05-01 | 2018-01-02 | 迪尤莱特公司 | System and method for generating digital picture |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2866714B1 (en) * | 2004-02-19 | 2006-08-25 | Jean Claude Robin | METHOD AND DEVICE FOR CAPTURING IMAGES WITH HIGH DYNAMIC LIGHT LEVEL |
| JP4534756B2 (en) * | 2004-12-22 | 2010-09-01 | ソニー株式会社 | Image processing apparatus, image processing method, imaging apparatus, program, and recording medium |
| IL166042A (en) * | 2004-12-29 | 2014-04-30 | Elbit Systems Ltd | Night vision coloring |
| US7805020B2 (en) * | 2006-07-25 | 2010-09-28 | Itt Manufacturing Enterprises, Inc. | Motion compensated image registration for overlaid/fused video |
| DE102007026337B4 (en) * | 2007-06-06 | 2016-11-03 | Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg | Digital camera |
| US9918017B2 (en) | 2012-09-04 | 2018-03-13 | Duelight Llc | Image sensor apparatus and method for obtaining multiple exposures with zero interframe time |
| US9819849B1 (en) | 2016-07-01 | 2017-11-14 | Duelight Llc | Systems and methods for capturing digital images |
| US10558848B2 (en) | 2017-10-05 | 2020-02-11 | Duelight Llc | System, method, and computer program for capturing an image with correct skin tone exposure |
| US9807322B2 (en) | 2013-03-15 | 2017-10-31 | Duelight Llc | Systems and methods for a digital image sensor |
| US10924688B2 (en) | 2014-11-06 | 2021-02-16 | Duelight Llc | Image sensor apparatus and method for obtaining low-noise, high-speed captures of a photographic scene |
| US11463630B2 (en) | 2014-11-07 | 2022-10-04 | Duelight Llc | Systems and methods for generating a high-dynamic range (HDR) pixel stream |
| EP3507765A4 (en) | 2016-09-01 | 2020-01-01 | Duelight LLC | Systems and methods for adjusting focus based on focus target information |
| DE102020133691A1 (en) | 2020-12-16 | 2022-06-23 | Valeo Schalter Und Sensoren Gmbh | Infrared thermal imaging camera and on-board system to assist in driving a motor vehicle having such a camera |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1990005426A1 (en) * | 1988-11-03 | 1990-05-17 | Pearpoint Limited | T.v. surveillance camera |
| US5541655A (en) * | 1991-11-05 | 1996-07-30 | Canon Kabushiki Kaisha | Image pickup device |
| US6215597B1 (en) * | 1999-11-17 | 2001-04-10 | Duncan Technologies, Inc. | Apparatus for forming a plurality of subimages having different characteristics |
| FR2809568B1 (en) * | 2000-05-26 | 2002-11-29 | Thomson Csf | DEVICE AND METHOD FOR ANALYSIS OF ONE OR MORE SIGNALS WITH A LARGE DYNAMIC |
| US20030048493A1 (en) * | 2001-09-10 | 2003-03-13 | Pontifex Brian Decoursey | Two sensor quantitative low-light color camera |
-
2003
- 2003-01-15 IL IL153967A patent/IL153967A/en active IP Right Grant
-
2004
- 2004-01-14 WO PCT/IL2004/000038 patent/WO2004064391A1/en active Search and Examination
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107534738A (en) * | 2015-05-01 | 2018-01-02 | 迪尤莱特公司 | System and method for generating digital picture |
| CN107534738B (en) * | 2015-05-01 | 2020-09-25 | 迪尤莱特公司 | System and method for generating digital images |
Also Published As
| Publication number | Publication date |
|---|---|
| IL153967A (en) | 2014-01-30 |
| WO2004064391A1 (en) | 2004-07-29 |
| IL153967A0 (en) | 2004-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7496293B2 (en) | Versatile camera for various visibility conditions | |
| US9271648B2 (en) | Eye tracking apparatus | |
| US9148579B1 (en) | Fusion night vision system | |
| US7345277B2 (en) | Image intensifier and LWIR fusion/combination system | |
| US9285877B2 (en) | Heads-up display | |
| US7786424B2 (en) | Electronic day and night vision goggles having dual camera | |
| US7911687B2 (en) | Sighted device operable in visible-wavelength or electro-optical/visible-wavelength sighting modes | |
| US20200341282A1 (en) | Wearable devices | |
| US8326142B2 (en) | Optical image systems | |
| WO2004064391B1 (en) | Versatile camera for various visibility conditions | |
| US7755047B2 (en) | Clip-on infrared imager | |
| US7170057B2 (en) | Image enhancement system and method for night goggles | |
| US7576919B2 (en) | Electronic spectacles, in particular night vision spectacles | |
| US10520724B2 (en) | Multi-wavelength head up display systems and methods | |
| US10893181B2 (en) | System and apparatus for color imaging device | |
| US6639706B2 (en) | Optical path switch and method of using thereof | |
| US20170208262A1 (en) | Digital enhanced vision system | |
| NO311114B1 (en) | Aim | |
| JP5953636B2 (en) | Modular night vision system with fusion optical sensor | |
| EP1410419B1 (en) | Gathering image data using multiple sensors | |
| US5629807A (en) | Helmet mounted image intensifier | |
| US11867908B2 (en) | Folded optic augmented reality display | |
| CN219162478U (en) | Binocular night vision device | |
| Zhou | Synthesized night vision goggle | |
| GB2538256A (en) | Optical data insertion device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| B | Later publication of amended claims |
Effective date: 20040809 |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 11182302 Country of ref document: US |
|
| 122 | Ep: pct application non-entry in european phase | ||
| DPEN | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101) | ||
| WWP | Wipo information: published in national office |
Ref document number: 11182302 Country of ref document: US |