WO2019042535A1 - System and method of redirecting image of an object into a camera - Google Patents
System and method of redirecting image of an object into a camera Download PDFInfo
- Publication number
- WO2019042535A1 WO2019042535A1 PCT/EP2017/071714 EP2017071714W WO2019042535A1 WO 2019042535 A1 WO2019042535 A1 WO 2019042535A1 EP 2017071714 W EP2017071714 W EP 2017071714W WO 2019042535 A1 WO2019042535 A1 WO 2019042535A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- infrared
- light rays
- transparent pane
- image
- aspect ratio
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19626—Surveillance camera constructional details optical details, e.g. lenses, mirrors or multiple lenses
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
- B60R11/04—Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0179—Display position adjusting means not related to the information to be displayed
- G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/06—Alarms for ensuring the safety of persons indicating a condition of sleep, e.g. anti-dozing alarms
Definitions
- the optical axis may be perpendicular to the image device. This allows the infrared light rays within the operational angle of view to be redirected into the image device.
- an optical sensor for receiving light rays in the infrared spectrum and converting the light rays into electronic signals .
- the optical sensor may be a package structure comprising one or more optical device made up of a transparent pane and a layer of infrared reflective material on a side of the transparent pane as a layer of the package structure.
- Fig. 1 shows an imaging system for redirecting images of an object into an imaging device according to one of the preferred embodiments .
- Fig. 2 shows a flowchart for a method of redirecting images of an object into an imaging device according to one of the preferred embodiments .
- transparent pane used herein, shall be construed to refer to see-through pane made of plastic or glass material. Suitable applications may include for instance, screens for displaying information, panels for displaying information, such as a display unit within an interior of a vehicle or used as a cover to protect a display unit, for eg. cover of an instrument cluster.
- Typical plastic materials for covering an instrument cluster according to industrial standards include acryloni- trile-butadiene-styrene (ABS) , ABS/polycarbonate alloys, polycarbonates, polypropylene, modified polyphenylene ether (PPE) and SMA (styrene maleic anhydride) resins.
- the term "illuminated surface” shall be construed to include a display or a projection of information, a screen of a display unit, an illuminated electronic component of an instrument cluster for mounting within a vehicle, such as a speedometer or fuel gauge.
- aspect ratio used herein, in relation to an image or geometry shall refer to the proportional relationship between a width and a length of the image or geometry.
- an aspect ratio of the object shall be construed to refer to the aspect ratio of the object being monitored within an interior of a vehicle, and the term “an aspect ratio of the captured infrared image” shall therefore, be construed to refer to the proportional relationship between the width and length of the infrared image.
- the infrared images may then be calibrated according to a calibration process as shown in Fig. 3, showing a flowchart of a calibration process 300 according to one of the preferred embodiments .
- the calibration process 300 includes in 302, the step of capturing an infrared image of an object is provided. Subsequently at 304, the step of determining a geometrical outline of the infrared image of the object is provided. Forming one or more control points on the geometrical outline is provided in step 306 and measuring coordinates the one or more control points from a reference point is provided in step 308. At step 310, calculating a differential value between the one or more control points from the reference point is provided and at step 312, generating an aspect ratio of the captured image from the reference point in all orientation is generated. Based on the differential value between the aspect ratio of captured infrared image and an aspect ratio of the object is calibrated to near zero at step 314.
- the image device 406 may be positioned in a steering wheel column 428, of the vehicle.
- the image device 406 may include an optical lens 418 to receive and converge infrared light rays 412 reflected off the transparent pane 402, captured within the operational angle of view 410.
- the image device 406 further includes an image sensor 420 to receive and convert the converged infrared light rays 412 into electrical signals, wherein the electrical signals are electronically converted into infrared images 422.
- the infrared light rays 412 which are being reflected off the side of the transparent pane 402 coated with the infrared reflective material 416 or low emissive coating into an optical axis 424 of the image device 406.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
A system and method of redirecting image of an object into a camera is disclosed. The imaging system comprises of a transparent pane for viewing an illuminated surface, an image device to capture one or more images of an object within an operational angle of view, where the transparent pane placed within the operational angle of view of the image device. In particular, the transparent pane is layered with an infrared reflective material on a side of the transparent pane, thereby reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum. A calibration process for calibrating an aspect ratio between the captured image and the object within an operational angle of view is also disclosed.
Description
System and Method of Redirecting Image of An Object Into A Camera Beschreibung / Description FIELD OF INVENTION
This invention relates to an imaging system and method for redirecting images of an object into the imaging system. In particular the imaging system includes a transparent pane layered with an infrared reflective material on a side of the transparent pane, configurable to reflect light rays in an infrared spectrum and propagate light rays in a visible spectrum. A calibration process for calibrating an aspect ratio between the captured image and the object within an operational angle of view is also disclosed .
BACKGROUND OF INVENTION
Increasingly, imaging systems are incorporated in vehicles, to either monitor the surrounding of the vehicle or within an interior of a passenger compartment.
Imaging systems within an interior of a passenger compartment are commonly used for monitoring amongst others, a driver' s alertness or events ongoing within the passenger compartment. Other functions of imaging systems may include capturing images of a person in driver's seat, for facial recognition purposes, or to authenticate ownership of vehicle. However, image system designs are usually restricted by physical distance or space constraints . Yet at the same time, imaging systems for vehicles must functionally possess a field of view sufficiently wide enough to capture images effectively. By way of an example, imaging systems for monitoring the surrounding of the vehicle must have a wide
angle of view to capture different orientations of the surrounding of the vehicle. If the imaging system is implemented within an interior for monitoring a driver for instance, then the imaging system must be able to capture the features on the driver's face which will give clues on the state of the driver. One of the challenges of designing an imaging system for on-board vehicle applications is that the imaging system shall not block the view of the driver, for safety reasons. Nonetheless, the imaging system must still provide an angle of view that captures the features of the driver's face.
US 8052338 B2 discloses an on-board camera located in a steering column with a support mechanism to pivot the angle of a reflector for reflecting light into a camera in the event of a collision during an accident. However, the camera design disclosed in US 8052338 B2 requires specific physical range which restricts design flexibility.
With the increasing need for vehicle imaging systems and design restrictions, there is a need for a technical solution that addresses the challenging design restrictions.
SUMMARY OF INVENTION
It is therefore an object of the invention to provide an imaging system and method for redirecting images of an object into a camera to address the problems as discussed above.
In a first aspect, an imaging system suitable for redirecting images of an object into the imaging system is provided. The image system comprises of: (1) a transparent pane configured to view an illuminated surface; and (2) an image device configured to capture at least one image of an object within an operational angle of view of the object, the transparent pane being within the operational angle of view. The transparent pane is configured to reflect light rays in an infrared spectrum and propagate light rays in a visible spectrum, by layering the transparent pane with an infrared reflective material on a side of the transparent pane. Advantageously, because light rays in the visible spectrum propagates through the transparent pane, the illuminated surface will be visible and yet at the same time, the image device is able to capture infrared images of the object within the operational angle of view. At the same time, although the image device is hidden from visible view of the object, i.e. there is no direct line of sight between the object and the image device, light rays in the infrared spectrum emitted from the object in the operational angle of view are re-directed or reflected towards the image device, to thereby allow processing of infrared images.
The infrared reflective material may be a low emissive coating that emits low levels of thermal energy. Using a low emissive coating allows light rays with a lower level of thermal energy to propagate through the transparent pane.
The image device may further comprise an optical lens configured to receive and converge infrared light rays reflected off the transparent pane, captured within the operational angle of view; and an image sensor may be configured to receive and convert the converged infrared light rays into electrical signals. The electrical signals are electronically converted into infrared images. The conversion of light rays into electrical signals allows the signals to be processed into infrared images.
Preferably, the optical lens may be configured to converge infrared light rays into an optical axis of the image device.
The optical axis may be perpendicular to the image device. This allows the infrared light rays within the operational angle of view to be redirected into the image device.
Preferably, a grid may be applied to the transparent pane, the grid may be configured to determine an aspect ratio. The aspect ratio is used as a means to calibrate a differential value between an aspect ratio of the object and an aspect ratio of the captured infrared image. The application of a grid to the transparent pane allows the aspect ratio to be adjusted in all orientations.
In a second aspect, a method for redirecting light rays of an object is provided. The method may comprise the steps of: (1) reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum within an operational angle of view of the object by means of a transparent pane layered with an infrared reflective material; (2) receiving and converging, by an optical lens of an image device, the reflected light rays in the infrared spectrum into an optical axis, the optical axis being perpendicular to the transparent pane; and (3) receiving and converting, by an image sensor of the image device, the reflected infrared light rays into electrical signals, thereby
processing the electrical signals into infrared images. Advantageously, supplying a transparent pane layered with an infrared reflective material allows visibility of the illuminated surface and yet at the same time, the image device is able to capture images within the operational angle of view.
The infrared images may be calibrated according to a calibration process. The calibration process may include the steps of: (1) capturing an infrared image of an object; (2) determining a geometrical outline of the infrared image of the object; (3) forming one or more control points on the geometrical outline; (4) measuring coordinates the one or more control points from a reference point; (5) calculating a differential value between the one or more control points from the reference point; (6) generating an aspect ratio of the captured image from the reference point in all orientation, thereby calibrating the captured infrared image when the differential value between the aspect ratio of captured infrared image and an aspect ratio of the object is near zero. By reducing differential value of the aspect ratio of the captured infrared image and the aspect ratio of the actual object to near zero ensures that the calibration process is carried out efficiently, i.e. zero difference in aspect ratio value.
In a third aspect, the imaging system for redirecting images of an object into the imaging system may be for use in a vehicle. Preferably, the illuminated surface may be an instrument cluster of the vehicle and the transparent pane may be configured to cover the instrument cluster. The image device may be positioned in a steering wheel column of the vehicle. This arrangement provides a flexible design of an imaging system for capturing images within the vehicle, by redirecting light rays in the infrared spectrum of an interior of the vehicle into the image device in the steering wheel column, while at the same time, propagates light rays in
the visible spectrum such that the illuminated surface may be viewed by human's eyes.
The image device may be electrically connected to a printed circuit board if necessary. Alternatively, the image device may work with a microprocessor for processing images.
In a fourth aspect, the imaging system for redirecting images of an object into the imaging system may be for use in a vehicle, wherein the imaging system further comprises an auxiliary transparent pane configured to reflect light rays in an infrared spectrum into the image device and propagate light rays in a visible spectrum, by layering the auxiliary transparent pane with an infrared reflective material on a side of the auxiliary transparent pane. This arrangement is suitable to solve issues of space or geometrical constraints due to different designs of components such as size of steering wheel column and/or instrument cluster in different types of vehicle.
Preferably, a grid may be applied to the auxiliary transparent pane . The grid may be used to determine an aspect ratio . The aspect ratio may be used as a means to calibrate a differential value between an aspect ratio of the object and an aspect ratio of the captured infrared image. This ensures that the captured images has the same aspect ratio as the real object, thus minimizing distortions .
The image device may be configured to capture at least one image of at least part of a driver of the vehicle.
It shall be understood any aspects of the embodiments may be implemented in an interior of a vehicle.
In a fifth aspect, an optical device adapted for reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum is provided. The optical device may comprise a transparent pane and a layer of infrared reflective material on a side of the transparent pane to achieve the desired results.
In a sixth aspect, an autostereoscopy display having a lens arrangement for integrating images projected from a screen is provided. The lens arrangement may comprises at least one optical device, the optical device may include a transparent pane and a layer of infrared reflective material on a side of the transparent pane. This set up allows reflection light rays in an infrared spectrum and propagation light rays in a visible spectrum.
In a seventh aspect, an optical sensor for receiving light rays in the infrared spectrum and converting the light rays into electronic signals . The optical sensor may be a package structure comprising one or more optical device made up of a transparent pane and a layer of infrared reflective material on a side of the transparent pane as a layer of the package structure. By including one or more of such optical device as part of the package structure allows the optical sensor to reflect light rays in an infrared spectrum and propagate light rays in a visible spectrum.
In an eight aspect, a method for fabricating an optical device for reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum is provided. Preferably, the method may include the steps of: (1) supplying a transparent pane and (2) layering a side of the transparent pane with an infrared reflective material.
BRIEF DESCRIPTION OF DRAWINGS
Other objects and aspects will become apparent from the following description of embodiments with reference to the accompany drawings in which:
Fig. 1 shows an imaging system for redirecting images of an object into an imaging device according to one of the preferred embodiments .
Fig. 2 shows a flowchart for a method of redirecting images of an object into an imaging device according to one of the preferred embodiments .
Fig. 3 shows a flowchart of a calibration process according to one of the preferred embodiments.
Fig. 4 shows an imaging system according to one of the preferred embodiments, for use in a vehicle.
Fig. 5 shows an imaging system according to an alternative preferred embodiments, for use in a vehicle.
Fig. 6 shows an optical device according to one of the preferred embodiments .
DETAILED DESCRIPTION OF PREFERRED EMBODIMENT
Hereinafter, the term "field of view" (FOV) or more in particular, "angle of view" (AOV) shall refer to an operational angle or space which an image detector or image sensor is most sensitive to infrared radiation or electromagnetic radiation, where the image sensor may receive infrared images. Typically, the angle of view
can be measured without restriction to horizontal, vertical or diagonal orientation.
The term "transparent pane" used herein, shall be construed to refer to see-through pane made of plastic or glass material. Suitable applications may include for instance, screens for displaying information, panels for displaying information, such as a display unit within an interior of a vehicle or used as a cover to protect a display unit, for eg. cover of an instrument cluster. Typical plastic materials for covering an instrument cluster according to industrial standards include acryloni- trile-butadiene-styrene (ABS) , ABS/polycarbonate alloys, polycarbonates, polypropylene, modified polyphenylene ether (PPE) and SMA (styrene maleic anhydride) resins. It shall be appreciated by a person skilled in the art, potential applications using a transparent pane fabricated according to a preferred embodiment of this invention shall also be applicable to other areas of display technologies, in particular displays requiring camera or optical sensor, for e.g. autostereoscopy (three dimensional displays viewing without specially designed headgear or glasses for stereoscopic effect) .
In view of the above, the term "illuminated surface" shall be construed to include a display or a projection of information, a screen of a display unit, an illuminated electronic component of an instrument cluster for mounting within a vehicle, such as a speedometer or fuel gauge.
The term "visible spectrum" refers to electromagnetic radiation or spectrum that is visible to the human eye, with a wavelength between 390nm to 700 nm. The term "infrared spectrum" refers to electromagnetic radiation with longer wavelengths than visible light, and therefore invisible to the human eyes. The infrared radiation or electromagnetic radiation in the infrared spectrum
is within the range of 700 nm to 1,000,000 nm. It shall be understood by a person skilled in the relevant art that the temperature of wavelengths in the visible spectrum has a temperature range higher than wavelengths in the infrared spectrum .
The term "low emissive coating" refers to coatings made of materials with characteristics of emitting low levels of radiant thermal energy. Suitable types of low emissive or dichroic coatings are for example, silicon dioxide (S1O2) and tantalum pentoxide (Ta205) .
The term "optical axis" refers to a line along which an axis of symmetry forms in an optical system. In this context, it refers to the axis of the optical lens for converging and redirecting infrared light rays into an image device, image sensor or image detector .
The term "aspect ratio" used herein, in relation to an image or geometry shall refer to the proportional relationship between a width and a length of the image or geometry. Used in the context herein, "an aspect ratio of the object" shall be construed to refer to the aspect ratio of the object being monitored within an interior of a vehicle, and the term "an aspect ratio of the captured infrared image" shall therefore, be construed to refer to the proportional relationship between the width and length of the infrared image.
It is understood that the term "vehicle" as used herein is inclusive of motor vehicles in general such as passenger automobiles including sports utility vehicles (SUV), buses, trucks, various commercial vehicles, watercraft including a variety of boats and ships, aircraft, and the like, and includes hybrid vehicles, electric vehicles, combustion, plug-in hybrid
electric vehicles, hydrogen-powered vehicles and other alternative fuel vehicles (e.g. fuels derived from resources other than petroleum) . The term "an interior of a vehicle" refers to a space confined inside the vehicle, for eg. a passenger compartment of a passenger automobile.
In one of the preferred embodiments, an imaging system 100 for redirecting images of an object 108 into an imaging device 106 is as shown in Fig. 1.
The imaging system 100 as shown in Fig. 1 comprises a transparent pane 102 for viewing an illuminated surface 104; and an image device 106 to capture at least one image of an object 108 within an operational angle of view 110 of the object 108, the transparent pane 102 being within the operational angle of view 110. The transparent pane 102 reflects light rays in an infrared spectrum 112 and propagates light rays in a visible spectrum 114. This is achievable by layering the transparent pane 102 with an infrared reflective material 116 on a side of the transparent pane 102. The infrared reflective material 116 may be a low emissive coating or dichroic coating. Suitable types of low emissive coating includes silicon dioxide (Si02) and tantalum pentox- ide(Ta205) . It shall be understood by a person skilled in the art other types of materials with low emissive properties may achieve similar results.
The image device 106 includes an optical lens 118 to receive and converge infrared light rays 112 reflected off the transparent pane 102, captured within the operational angle of view 110. The image device further includes an image sensor 120 to receive and convert the converged infrared light rays 112 into electrical signals, wherein the electrical signals are electronically
converted into infrared images 122. The infrared light rays 112 which are being reflected off the side of the transparent pane 102 coated with the infrared reflective material 116 or low emissive coating into an optical axis 124 of the image device 106. The optical axis 124 is perpendicular to the image device 106.
As shown in Fig. 1, light rays within the operational angle of view 110 travels towards the transparent pane 102 with one side of the transparent pane 102 layered with the infrared reflective material 116. Light rays 112 in the infrared spectrum is being reflected off the side of the transparent pane 102 layered with the infrared reflective material 116, into the optical axis 124 of the image device 106. Light rays 114 in the visible spectrum propagates through the transparent pane 102, thus any information projected from illuminated surface 104 is visible to human eyes. The reflected infrared light rays 112 travels towards optical lens 118 which receives and converges the infrared light rays 112 into the image device 106, thus enabling redirection of the infrared light rays towards the image device. Image sensor 120 converts the received and converged infrared light rays 112 into electrical signals, which are then in turn electronically processed to produce infrared image (s) 122.
In a preferred embodiment, a grid (not shown in Fig. 1) may be applied to the transparent pane 102, for determining an aspect ratio. The aspect ratio is used as a means to calibrate a differential value between an aspect ratio of the object 108 and an aspect ratio of the captured infrared image 122, details of the calibration process will be further discussed below.
Fig. 2 shows a flowchart for a method of redirecting images of an object into an imaging device 200 according to one of the
preferred embodiments. Assume the scenario where a transparent pane layered with an infrared reflective material is provided and light rays present within an operational angle of view within the transparent pane. An object is placed within the operational field of view. Thus, the space between the object and the transparent pane comprises light rays (including the visible and infrared spectrum) that can be reflected and propagated by the transparent pane. Propagation of a light ray includes refraction of the light ray or otherwise transmitting the light ray through the transparent pane. Accordingly, it is clear that propagation of a light ray excludes absorption of the light ray by the transparent pane. In step 202, light rays in an infrared spectrum is reflected from the transparent pane and light rays in a visible spectrum is propagated through the transparent pane. At step 204, an optical lens of an image device receives converge the reflected infrared light rays from step 202 into an optical axis of the image device. In step 206, an image sensor of the image device receives and convert the reflected infrared light rays into electrical signals, thereby processing the electrical signals into infrared images .
The infrared images may then be calibrated according to a calibration process as shown in Fig. 3, showing a flowchart of a calibration process 300 according to one of the preferred embodiments .
The calibration process 300 includes in 302, the step of capturing an infrared image of an object is provided. Subsequently at 304, the step of determining a geometrical outline of the infrared image of the object is provided. Forming one or more control points on the geometrical outline is provided in step 306 and measuring coordinates the one or more control points from a reference point is provided in step 308. At step 310, calculating a differential value between the one or more control points from
the reference point is provided and at step 312, generating an aspect ratio of the captured image from the reference point in all orientation is generated. Based on the differential value between the aspect ratio of captured infrared image and an aspect ratio of the object is calibrated to near zero at step 314.
In a second embodiment, the image system 400 is implemented for use in a vehicle as shown in Fig. 4, based upon the above discussed preferred embodiment. With reference to Fig. 4, the imaging system 400 comprises a transparent pane 402 for viewing an illuminated surface 404; and an image device 406 to capture one or more images of an object 408, such as a user in the driver's seat, within an operational angle of view 410 of the object 408, the transparent pane 402 being within the operational angle of view 410. That is, the object 408 can visibly view at least part of the transparent pane 402. The transparent pane 402 reflects light rays in an infrared spectrum 412 into the image device 406 and propagates light rays in a visible spectrum 414, such that contents shown on the illuminated surface 404 is visible to human eye. The illuminated surface 404 may be an instrument cluster on-board the vehicle and the transparent pane 404 may be a cover of the instrument cluster.
The reflecting of infrared light waves and propagating of visible light rays is achievable by layering the transparent pane 402 with an infrared reflective material 416 on a side of the transparent pane 402. The infrared reflective material 416 may be a low emissive coating or dichroic coating as discussed above.
The image device 406 may be positioned in a steering wheel column 428, of the vehicle. The image device 406 may include an optical lens 418 to receive and converge infrared light rays 412 reflected off the transparent pane 402, captured within the operational
angle of view 410. The image device 406 further includes an image sensor 420 to receive and convert the converged infrared light rays 412 into electrical signals, wherein the electrical signals are electronically converted into infrared images 422. The infrared light rays 412 which are being reflected off the side of the transparent pane 402 coated with the infrared reflective material 416 or low emissive coating into an optical axis 424 of the image device 406. The optical axis 424 is perpendicular to the image device 406. The image device 406 may be electrically connected to a printed circuit board 426. In other embodiments, the image sensor 420 may include a microprocessor, thus eliminating the need of a printed circuit board 426.
Light rays within the operational angle of view 410 travels towards the transparent pane 402 with one side of the transparent pane 402 layered with the infrared reflective material 416. Light rays 412 in the infrared spectrum is being reflected off the side of the transparent pane 402 layered with the infrared reflective material 416, into the optical axis 424 of the image device 406. Light rays 414 in the visible spectrum propagates through the transparent pane 402, thus any information projected from illuminated surface 404 is visible to human eyes. The reflected infrared light rays 412 travels towards optical lens 418 which receives and converges the infrared light rays 412 into the image device 406. Image sensor 420 converts the received and converged infrared light rays 412 into electrical signals, which are then in turn electronically processed to produce infrared image (s) 422.
In an alternative embodiment, imaging system 500 for use in a vehicle may further include an auxiliary transparent pane 502, as shown in Fig. 5. The auxiliary pane 502 may be configured to
reflect light rays 512 in an infrared spectrum into the image device 506 and propagate light rays 514 in a visible spectrum, by layering the auxiliary transparent pane 502 with an infrared reflective material 516 on one side of the auxiliary transparent pane 502.
As shown in Fig. 5, the imaging system 500 comprises a transparent pane 502' for viewing an illuminated surface 504; and an image device 506 to capture one or more images of an object 508, within an operational angle of view 510 of the object 508, the auxiliary transparent pane 502 being within the operational angle of view 510. The auxiliary transparent pane 502 reflects light rays in an infrared spectrum 512 into the image device 506 and propagates light rays in a visible spectrum 514, such that contents shown on the illuminated surface 504 is visible to human eye, by layering a low emissive coating or infrared reflective material 512 on the auxiliary transparent pane 502.
The illuminated surface 504 may be an electronic component for displaying contents or information, for eg. a fuel gauge or speedometer, within an instrument cluster. The instrument cluster may be suitable for mounting on-board the vehicle and a transparent pane 502' may function as a cover of the instrument cluster. It shall be understood by a person skilled in the art, the transparent pane 502' may also be configured to reflect light rays in an infrared spectrum 512 into the image device 506 and propagate light rays in a visible spectrum 514, by layering a low emissive coating or infrared reflective material 512 on the transparent pane 502' .
The image device 506 may be positioned in a steering wheel column 528, of the vehicle. The image device 506 may include an optical lens 518 to receive and converge infrared light rays 512 reflected
off the transparent pane 502, captured within the operational angle of view 510. The image device further includes an image sensor 520 to receive and convert the converged infrared light rays 512 into electrical signals, wherein the electrical signals are electronically converted into infrared images 522. The infrared light rays 512 which are being reflected off the side of the transparent pane 502 coated with the infrared reflective material 516 or low emissive coating into an optical axis 524 of the image device 506. The optical axis 524 is perpendicular to the image device 506. The image device 506 may be electrically connected to a printed circuit board 524.
Light rays within the operational angle of view 510 travels towards the auxiliary transparent pane 502 with one side of the auxiliary transparent pane 502 layered with the infrared reflective material 516. Light rays 512 in the infrared spectrum is being reflected off the side of the transparent pane 502 layered with the infrared reflective material 516, into the optical axis 524 of the image device 506. Light rays 514 in the visible spectrum propagates through the transparent pane 502, thus any information projected from illuminated surface 504 is visible to human eyes. The reflected infrared light rays 512 travels towards optical lens 518 which receives and converges the infrared light rays 512 into the image device 506. Image sensor 520 converts the received and converged infrared light rays 512 into electrical signals, which are then in turn electronically processed to produce infrared image (s ) 522. In other embodiments , the image sensor 520 may include a microprocessor, thus eliminating the need of a printed circuit board 526.
The auxiliary pane 502 may be applied with a grid (not shown in Fig. 5) , configured to determine an aspect ratio. The aspect ratio
is used as a means to calibrate a differential value between an aspect ratio of the object and an aspect ratio of the captured infrared image (s) 522. The calibration process for calibrating the differential value to near zero is as illustrated in Fig. 3 and discussed above. The image device 506 may be configured to capture one or more images of the driver 508, certain features of the driver 508, or an interior of the vehicle, or combination thereof .
Turning now to Fig. 6 which shows an optical device 600 according to one of the preferred embodiments. The optical device 600 is adapted for reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum. The optical device 600 may include a transparent pane made from suitable materials for intended type of application. The transparent pane may be layer of infrared reflective material 604 on a side of the transparent pane 604.
For purposes of determining an aspect ratio, a grid 606 may be applied to the transparent pane 602 layered with the infrared reflective material 604. Other types of patterns apart from grid may be applicable, insofar as the distance between different orientations of the patterns are known. Calibration using calibration process 300 as discussed above may be done using the known distances of the patterns to determine an aspect ratio.
The optical device 600 may be applicable to any type of applications that requires reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum. An example is an autosteroscopy display having a lens arrangement for integrating images projected from a screen, where the lens arrangement aids to allow viewing of three-dimensional displays
without the need for a specially designed headgear or glasses. Another example may be the application of optical device 600 to one or more layers of a package structure of an optical sensor, where the optical sensor is adapted for converting light into electronic signals.
While the preferred embodiment and alternative embodiments of the invention have been disclosed and described in detail herein, it may be apparent to those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope thereof.
Claims
1. An imaging system (100) comprising:
a transparent pane (102) configured to view an il- luminated surface (104); and
an image device (106) configured to capture at least one image of an object (108) within an operational angle of view (110) of the object (108), the transparent pane (102) being within the operational angle of view (110); wherein the transparent pane (102) is configured to reflect light rays (112) in an infrared spectrum and propagate light rays (114) in a visible spectrum, by layering the transparent pane (102) with an infrared reflective material (116) on a side of the transparent pane (102) .
2. The system of Claim 1, wherein the infrared reflective material (116) is a low emissive coating.
3. The system of Claim 1 and 2, wherein the image device (106) further comprises
an optical lens (118) configured to receive and converge infrared light rays (112) reflected off the transparent pane (102), captured within the operational angle of view (110); and
an image sensor (120) is configured to receive and convert the converged infrared light rays (112) into electrical signals, wherein the electrical signals are electronically converted into infrared images (122) .
The system according to Claim 3, wherein the optical lens (118) configured to converge infrared light rays (112) into an optical axis (124) of the image device (106) .
The system according to Claim 4, wherein the optical axis (124) is perpendicular to the image device (106) .
The system according to any of the preceding claims, wherein a grid (206) is applied to the transparent pane (102), the grid (206) is configured to determine an aspect ratio .
The system according to Claim 6, wherein the aspect ratio is used as a means to calibrate a differential value between an aspect ratio of the object (108) and an aspect ratio of the captured infrared image (122) .
A method for redirecting light rays of an object into an imaging system (200) according to any of Claims 1-7, the method comprising the steps of:
reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum within an operational angle of view of the object by means of a transparent pane layered with an infrared reflective material (202 ) ;
receiving and converging, by an optical lens of an image device, the reflected light rays in the infrared spectrum into an optical axis, the optical axis being perpendicular to the image device (204); and
receiving and converting, by an image sensor of the image device, the reflected infrared light rays into electrical signals, thereby processing the electrical signals into infrared images (206) .
9. The method according to Claim 8, wherein the infrared images are calibrated according to a calibration process (300) .
10. he method according to Claim 8 or 9, wherein the calibration process (300) includes the steps of:
capturing an infrared image of an object (302); determining a geometrical outline of the infrared image of the object (304);
forming one or more control points on the geometrical outline (306) ;
measuring coordinates the one or more control points from a reference point (308);
calculating a differential value between the one or more control points from the reference point (310);
generating an aspect ratio of the captured image from the reference point in all orientation (312),
thereby calibrating the captured infrared image when the differential value between the aspect ratio of captured infrared image and an aspect ratio of the object is near zero (314) .
11. he imaging system (400) of any one of claims 1-8, for use in a vehicle:
wherein the illuminated surface (404) is an instrument cluster and the transparent pane (402) is configured to cover the instrument cluster; and
wherein the image device (406) is positioned in a steering wheel column (428) of the vehicle.
12. The system according to Claim 11, wherein the image device (406) is electrically connected to a printed circuit board (426) .
The imaging system of any one of claims 11 and 12, for use in a vehicle, wherein the imaging system (500) further comprises an auxiliary transparent pane (502) configured to reflect light rays (512) in an infrared spectrum into
the image device (506) and propagate light rays (514) in a visible spectrum, by layering the auxiliary transparent pane (502) with an infrared reflective material (516) on a side of the auxiliary transparent pane.
14. he imaging system according to Claim 13, wherein a grid (606) is applied to the auxiliary transparent pane (502), the grid (606) is configured to determine an aspect ratio.
15. The imaging system according to Claim 14, wherein the aspect ratio is used as a means to calibrate a differential value between an aspect ratio of the object (508) and an aspect ratio of the captured infrared image (522) .
16. The imaging system according to any one of Claims 11-15, wherein the image device (506) is configured to capture at least one image (522) of at least part of a driver (508) .
17. An interior of a vehicle having an imaging system according to any one of Claims 11 to 16.
18. An optical device (600) adapted for reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum, the optical device (600) comprising a transparent pane (602); and
a layer of infrared reflective material (604) on a side of the transparent pane (604) .
19. An autostereoscopy display having a lens arrangement for integrating images projected from a screen, wherein the lens arrangement comprises at least one of the optical device (600) according to Claim 18.
20. An optical sensor for receiving light rays in the infrared spectrum and converting the light rays into electronic signals, wherein the optical sensor has a package structure comprising at least one of the optical device (600) according to Claim 18.
21. A method for fabricating an optical device for reflecting light rays in an infrared spectrum and propagating light rays in a visible spectrum, the method including the steps of:
supplying a transparent pane (602); and
layering a side of the transparent pane with an infrared reflective material (604) .
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2017/071714 WO2019042535A1 (en) | 2017-08-30 | 2017-08-30 | System and method of redirecting image of an object into a camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2017/071714 WO2019042535A1 (en) | 2017-08-30 | 2017-08-30 | System and method of redirecting image of an object into a camera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2019042535A1 true WO2019042535A1 (en) | 2019-03-07 |
Family
ID=59901473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2017/071714 WO2019042535A1 (en) | 2017-08-30 | 2017-08-30 | System and method of redirecting image of an object into a camera |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2019042535A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR3095794A1 (en) * | 2019-05-09 | 2020-11-13 | Psa Automobiles Sa | DEVICE FOR MONITORING A VEHICLE DRIVER |
| US11308721B2 (en) * | 2018-10-08 | 2022-04-19 | Aptiv Technologies Limited | System for detecting the face of a driver and method associated thereto |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1386786A1 (en) * | 2002-07-26 | 2004-02-04 | Murakami Corporation | In-vehicle occupant image pickup apparatus |
| WO2007083215A2 (en) * | 2006-01-17 | 2007-07-26 | Ferrari S.P.A. | Method of controlling a road vehicle hud system |
| US8052338B2 (en) | 2007-12-26 | 2011-11-08 | Toyota Jidosha Kabushiki Kaisha | On-board camera |
| DE102015216127A1 (en) * | 2015-08-24 | 2017-03-02 | Ford Global Technologies, Llc | Method for eye tracking in a vehicle with head-up display |
-
2017
- 2017-08-30 WO PCT/EP2017/071714 patent/WO2019042535A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1386786A1 (en) * | 2002-07-26 | 2004-02-04 | Murakami Corporation | In-vehicle occupant image pickup apparatus |
| WO2007083215A2 (en) * | 2006-01-17 | 2007-07-26 | Ferrari S.P.A. | Method of controlling a road vehicle hud system |
| US8052338B2 (en) | 2007-12-26 | 2011-11-08 | Toyota Jidosha Kabushiki Kaisha | On-board camera |
| DE102015216127A1 (en) * | 2015-08-24 | 2017-03-02 | Ford Global Technologies, Llc | Method for eye tracking in a vehicle with head-up display |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11308721B2 (en) * | 2018-10-08 | 2022-04-19 | Aptiv Technologies Limited | System for detecting the face of a driver and method associated thereto |
| FR3095794A1 (en) * | 2019-05-09 | 2020-11-13 | Psa Automobiles Sa | DEVICE FOR MONITORING A VEHICLE DRIVER |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10525886B2 (en) | Display system, electronic mirror system and movable-body apparatus equipped with the same | |
| CN204256268U (en) | Optical imaging device | |
| RU2705742C1 (en) | Display system on the windshield for displaying the visual information and calibration thereof | |
| JP4162998B2 (en) | Visible image generating method and visible image generating apparatus having infrared transmission window | |
| US10558039B2 (en) | Head-up display apparatus | |
| JP6706802B2 (en) | Display system, electronic mirror system, and moving body including the same | |
| EP2865555B1 (en) | Information display device for vehicle | |
| EP2251228A2 (en) | Vehicle Inside Mirror Device for displaying Image | |
| US11491871B2 (en) | Aerial display device | |
| US20200143184A1 (en) | Transparent ir reflective coating for driver monitoring system that is applied on or in the windshield of a car | |
| JP2022519505A (en) | Functional waveguide for detector system | |
| US11199701B2 (en) | Head-up display apparatus | |
| WO2019042535A1 (en) | System and method of redirecting image of an object into a camera | |
| CN203673145U (en) | Display device | |
| US10133067B2 (en) | Head-up display apparatus | |
| JP2015102603A (en) | Display device for vehicle | |
| JP2015120477A (en) | Auxiliary equipment for blind angle | |
| JP2022056520A (en) | Vehicular display device | |
| EP3492949B1 (en) | Lidar cover | |
| CN211375183U (en) | Head-up display device, imaging system and vehicle | |
| JP2005534549A (en) | Image display method and system | |
| CN217846898U (en) | Holographic aerial imaging structure and equipment | |
| CN114660817B (en) | Head-up display, vehicle and head-up display method | |
| CN105445936A (en) | Optical imaging device | |
| JP7230750B2 (en) | Display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17768684 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 17768684 Country of ref document: EP Kind code of ref document: A1 |