EP2618051B1 - Lamp with integrated camera - Google Patents
Lamp with integrated camera Download PDFInfo
- Publication number
- EP2618051B1 EP2618051B1 EP12151446.7A EP12151446A EP2618051B1 EP 2618051 B1 EP2618051 B1 EP 2618051B1 EP 12151446 A EP12151446 A EP 12151446A EP 2618051 B1 EP2618051 B1 EP 2618051B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- lamp
- image sensor
- light source
- optical imaging
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Not-in-force
Links
Images
Classifications
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21V—FUNCTIONAL FEATURES OR DETAILS OF LIGHTING DEVICES OR SYSTEMS THEREOF; STRUCTURAL COMBINATIONS OF LIGHTING DEVICES WITH OTHER ARTICLES, NOT OTHERWISE PROVIDED FOR
- F21V33/00—Structural combinations of lighting devices with other articles, not otherwise provided for
- F21V33/0004—Personal or domestic articles
- F21V33/0052—Audio or video equipment, e.g. televisions, telephones, cameras or computers; Remote control devices therefor
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21S—NON-PORTABLE LIGHTING DEVICES; SYSTEMS THEREOF; VEHICLE LIGHTING DEVICES SPECIALLY ADAPTED FOR VEHICLE EXTERIORS
- F21S8/00—Lighting devices intended for fixed installation
- F21S8/08—Lighting devices intended for fixed installation with a standard
- F21S8/085—Lighting devices intended for fixed installation with a standard of high-built type, e.g. street light
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21V—FUNCTIONAL FEATURES OR DETAILS OF LIGHTING DEVICES OR SYSTEMS THEREOF; STRUCTURAL COMBINATIONS OF LIGHTING DEVICES WITH OTHER ARTICLES, NOT OTHERWISE PROVIDED FOR
- F21V23/00—Arrangement of electric circuit elements in or on lighting devices
- F21V23/04—Arrangement of electric circuit elements in or on lighting devices the elements being switches
- F21V23/0442—Arrangement of electric circuit elements in or on lighting devices the elements being switches activated by means of a sensor, e.g. motion or photodetectors
- F21V23/0471—Arrangement of electric circuit elements in or on lighting devices the elements being switches activated by means of a sensor, e.g. motion or photodetectors the sensor detecting the proximity, the presence or the movement of an object or a person
- F21V23/0478—Arrangement of electric circuit elements in or on lighting devices the elements being switches activated by means of a sensor, e.g. motion or photodetectors the sensor detecting the proximity, the presence or the movement of an object or a person by means of an image recording device, e.g. a camera
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21W—INDEXING SCHEME ASSOCIATED WITH SUBCLASSES F21K, F21L, F21S and F21V, RELATING TO USES OR APPLICATIONS OF LIGHTING DEVICES OR SYSTEMS
- F21W2131/00—Use or application of lighting devices or systems not provided for in codes F21W2102/00-F21W2121/00
- F21W2131/10—Outdoor lighting
- F21W2131/103—Outdoor lighting of streets or roads
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F21—LIGHTING
- F21W—INDEXING SCHEME ASSOCIATED WITH SUBCLASSES F21K, F21L, F21S and F21V, RELATING TO USES OR APPLICATIONS OF LIGHTING DEVICES OR SYSTEMS
- F21W2131/00—Use or application of lighting devices or systems not provided for in codes F21W2102/00-F21W2121/00
- F21W2131/10—Outdoor lighting
- F21W2131/105—Outdoor lighting of arenas or the like
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19617—Surveillance camera constructional details
- G08B13/19632—Camera support structures, e.g. attachment means, poles
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B15/00—Identifying, scaring or incapacitating burglars, thieves or intruders, e.g. by explosives
- G08B15/001—Concealed systems, e.g. disguised alarm systems to make covert systems
Definitions
- the invention relates to a lamp for example for lighting a street, a place or the like.
- the lamp has a support, supporting at least one light source and at least one image sensor. Beam forming means direct light from the light source to obtain a given light distribution.
- the lamp further comprises at least one optical imaging element for projecting images onto the image sensor.
- CN 200920013082 discloses a street lamp with a housing.
- the housing has an opening into which a surveillance camera is fitted.
- a surveillance camera For mounting the lamp with the camera it is sufficient to attach the housing to a lamp post and to provide the electrical connections.
- US 2009/0185376 discloses a street lamp.
- the street lamp has a housing with a transparent cover.
- a printed circuit board supporting a light source and an image sensor of a camera.
- the camera has a casing for positioning a lens group in a defined distance to the image sensor of the camera.
- the invention is based on the observation that the integration of the camera in a common housing with the components for lighting the street like lampshade, light source and the like as suggested in US 2009/0185376 facilitates the production and operation if compared to the suggestion of CN 200920013082 .
- the problem to be solved by the invention is to provide a lamp with an integrated camera and further reduced manufacturing costs.
- US 2010/0277082 discloses a lamp for replacing mercury vapour or other gas-discharge lamps
- the lamp has a base plate as support for LEDs.
- a cover plate In front of the base plate is a cover plate with beam forming means for directing light from the LEDs to obtain a given light distribution.
- a black box like camera module can be mounted on the front side of the cover plate or, if the cover plate is omitted to the base plate.
- WO 2011/049435 A1 relates a well to a LED-light with an integrated camera.
- the LEDs are mounted to form a ring like structure on a printed circuit board
- the LED-light has an enlarged compartment for an electronic circuit by means of a second printed circuit board that is connected to the first printed circuit board by means of a plug which also offers installing at the front of the lamp.
- WO 2011/067749 A1 discloses a LED-light with a camera.
- the camera is a ready to use module and connected via fitting to a cover and to an electronic box. Alternatively, the camera may be inserted on a printed circuit board on which LEDs are fitted.
- the lamp comprises at least a support, supporting at least one light source and at least one image sensor.
- the lamp has at least one beam forming means for directing light emitted by the light source to obtain a given light distribution.
- the beam forming means may be for example a lens and/or a reflector.
- the lamp further comprises at least one optical imaging element for projecting images from outside the lamp onto the image sensor, for example a lens and/or an aperture.
- the beam forming means and the optical imaging element are arranged on a common carrier. This permits an easy manufacturing of the lamp, because it is sufficient to place the beam forming means and the optical imaging element on the common carrier and to position the common carrier relative to the light source(s) and the image sensor.
- the common carrier is a common reference for the orientation of the beam forming elements and the optical imaging element, thus the respective optical axes are aligned by design when placing the beam forming elements and the optical imaging element on the common carrier.
- the adjustment of the optical axes is thus included in the assembly step and a subsequent manual alignment of the camera with the light beam of the light source subsequent to the assembly of the lamp is avoided.
- the lamp preferably comprises a housing with at least one housing body and an at least partially transparent cover.
- the light source can be a LED and is preferably mounted on a printed circuit board.
- the support may support for example multiple LEDs. Some of the LEDs may have different emission spectra. For example may some (at least one) LED emit visible light and some (at least one) other LED emit IR-light.
- the image sensor may be mounted on the same printed circuit board, serving as support.
- Printed circuit boards typically have a body of some non conducting material, like for example some epoxy compound.
- the printed circuit board may alternatively comprise a metal body or core to provide an efficient heat transfer from the LEDs to e.g. some heat sink.
- the heat sink can be integrated in the housing body.
- the support may preferably comprise a thermally conducting layer or area supporting the at least one light source and a thermally insulating layer or area, for example of some epoxy compound, supporting the image sensor.
- thermally insulating is any material that provides a lower heat conductivity as the thermally conducting layer or material supporting the at least one light source.
- the LED(s) as light source(s) could preferably be mounted on an area of the support that comprises a metal layer for transferring heat from the light source(s) to some heat sink and an area of some plastic, e.g. epoxy compound, supporting the image sensor to thermally decouple the light source(s) from the image sensor.
- the thermally conducting area is preferably in a surface-to-surface connection with a heat sink, for example a housing body.
- the thermally insulating area is preferably not in a surface-to-surface connection with the heat sink.
- the heat sink has an at least substantially plane surface being in surface-to-surface contact the thermally conducting area and a recess spanning over the rear side of the thermally insulating area.
- heat from the light source(s) may be dissipated via the heat sink and at the same time the heat transfer to the at least one image sensor may be reduced, yielding longer lifetime of the light source(s) and an enhanced signal to noise ratio of the image sensor.
- the at least one light source and and the at least one image sensor may be mounted to a common printed circuit board.
- the printed circuit board may comprise a first layer with a first thermal conductivity coefficient k 1 (e.g. k 1 ⁇ 0,25 W cm -1 K -1 at 273K).
- the first layer may include for example a metal core, in particular an aluminum core.
- On the front side of the first layer may be at least one LED as light source.
- the first layer may have a preferably through hole like opening.
- the front side and/or rear side the opening may be closed by a second layer with a second thermal conductivity coefficient k 2 , being smaller than the first thermal conductivity coefficient k 1 , (k 2 ⁇ k 1 ).
- the first layer can be considered as thermally conducting and the second layer as thermally insulating.
- the second layer may comprise some epoxy compound.
- the image sensor is preferably be supported by the second layer and thus be thermally decoupled from the first layer. The signal to noise ration of the image sensor is thereby enhanced. In addition stray light from the light sources, falling on the image sensor may be reduced.
- the image sensor may e.g. be a CCD (Charge - Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
- CCD Charge - Coupled Device
- CMOS Complementary Metal Oxide Semiconductor
- the support is the common carrier. This permits to use extremely precise and quick pick and place machines for the assembly of the electronic and optical components of the lamp. A later alignment of the optical axis of the light source to the optical axis of the image sensor can thus be avoided.
- the transparent cover may include the beam forming means and the optical imaging element for projecting an image.
- the transparent cover may be the common carrier.
- Such a transparent cover can be injection molded with very high precision.
- the beam forming means and the optical imaging element for projecting an image are integrated in the transparent cover the number of parts is reduced and their optical axes can be aligned without manually adjusting their positions and/or orientations.
- the transparent cover may have at least one protrusion facing the support.
- the protrusion is preferably arranged between the optical axes of the image sensor and the light source. These protrusions inhibit or at least reduce reflections of light from the light source by the transparent cover on the image sensor, i.e. stray light.
- the optical imaging element for projecting an image on the image senor may have the same mapping function and can thus be identically shaped. This further reduces the manufacturing costs.
- the mapping function yields a distorted image on the image sensor, the distortion can be corrected by mapping the image obtained by the image sensor with the inverse the mapping function. It is sufficient to map the image obtained by the image sensor with the inverse of the non linear term of the mapping function to reduce the distortions.
- the correction can be done some microcontroller like a digital signal processor or a computer.
- the lamp may comprise more than one image sensor, for example two or more image sensors. In front of each image sensor is a corresponding optical imaging element. This permits to obtain pictures from two or more perspectives and thereby to enhance object recognition.
- the object recognition may be used for of traffic surveillance, for example to distinguish between different types of vehicles, like cars, trucks, motorcycles, bicycles and the like. A further application for could be people counting, e.g. at stadium entrances. In addition distances can be calculated.
- At least one of the optical imaging elements may be an asymmetric lens. This permits to capture images of different angular ranges and/or magnifications with the different image sensors, although the image sensors are supported by the common support and the optical imaging elements are as well supported by the common carrier, even if the support and the carrier have plane mounting surfaces.
- the lamp includes preferably driving means for driving the light source(s) and/or the at least one image sensor.
- driving means can be integrated on a single chip and/or on at least one printed circuit board.
- the driving means are preferably thermally isolated from the light source(s), e.g. positioned in a separate compartment. This permits to reduce a heat transfer from the light sources to the driving means.
- the driving means may accomplish image data processing as well as forwarding the image data to some monitoring or control station. Further, the separate compartment can support the housing.
- the lamp 10 in figure 1 is mounted to a lamp post 5 on some ground 4.
- the lamp 10 has a compartment 12 supporting a housing 20 with a housing body 22 and a transparent cover 24 (cf. fig. 2 to 4 ).
- the housing body supports a printed circuit board 30 and may have a rim 26 for defining the position of the printed circuit board 30 in the housing body.
- the rim 26 as well defines the orientation and the position of the transparent cover 24 relative to the housing body 22, like indicated in figures 2 and 3 .
- On the printed circuit board 30 are LEDs 32 as light sources and for example two CCD-type image sensors 34. Light from the light sources 32 is directed by beam shaping elements 42 (see fig. 2 to 8 ) into some given direction to obtain a desired light distribution on the ground 4 below the lamp 10.
- the lighted ground 4 and objects on the ground 4 reflect this light.
- Light reflected by the ground 4 or objects between the ground 4 and the lamp 10 can thus be projected as an image of the ground 4 and/or the object on the image sensor 34.
- the image sensors 34 convert the projected image into some electrical signal which can be further processed by a controlling unit.
- the controlling unit may be part of some driving means for driving and controlling at least one image sensor 34 and or at least one light source 32.
- the controlling unit may store such captured images and/or transmit the images via some data bus to a main controller.
- the driving means can be positioned in the compartment 12 supporting the housing 20. Thereby the driving means can be thermally insulated from the light sources 32.
- the section as depicted in figure 3 shows for the purpose of simplicity only a reduced number of light sources 32 and image sensors 34, but corresponds in principle to the depiction of figure 2 .
- an optical imaging element 44 is placed in front of the image sensor 34 (cf. figure 4 ).
- the beam shaping element 42 and the optical imaging element 44 are each lenses, which are incorporated into transparent cover 24.
- the transparent cover 24 is a common carrier for the beam shaping element 42 and the optical imaging element 44.
- the transparent cover 24, the beam shaping element 42 and the optical imaging element 44 can thus be manufactured by single process, for example injection molding.
- a further advantage of such integration of the beam shaping elements 42 and the optical imaging element 44 is that the orientation and position of the optical axis 43 of the beam shaping element 42 and optical axis 45 of the optical imaging element 44 are defined by their common manufacturing process and there is thus no need for a difficult and time consuming adjusting process of the optical axes 43, 45 of the camera and the light beam emitted by the lamp.
- the beam shaping element 42 and the optical imaging element 44 have the same imaging function.
- This imaging function is in practice a result of a desired light distribution of the lamp 10, which may vary from application to application and may yield severe distortions of the image projected on image sensor 34by the optical imaging element 44. These distortions can be reduced by applying the inverse mapping of the imaging function to the image captured by the image sensor.
- the inverse mapping can be performed by some controlling unit, for example a controlling unit inside the housing or some external controlling unit. Different from the depicted examples may the beam shaping element(s) and the optical imaging element(s) have different mapping functions and thus different shapes.
- a light source 32 (a LED) and an image sensor 34 are mounted to a printed circuit board 30 as support.
- a beam shaping element 42 and an optical imaging element 44 are preferably directly attached to the printed circuit board 30 in front of the light source 32 and in front of the image sensor 34, respectively.
- the printed circuit board 30 is a common carrier for the beam shaping element 42, the optical imaging element 44, the light source 32 and the image sensor 34.
- the distance c between the light source and the image sensor is preferably bigger or equal to the d1•sin( ⁇ ) + d2•sin( ⁇ ) wherein d1 is the distance between the light source and the transparent cover, a is half of the angle of beam spread of the combination of the light source 32 and the beam shaping element 42, d2 is the distance between the image sensor and the transparent cover and ⁇ half of the aperture angle of the optical imaging element 43.
- d1 is the distance between the light source and the transparent cover
- a is half of the angle of beam spread of the combination of the light source 32 and the beam shaping element 42
- d2 is the distance between the image sensor and the transparent cover and ⁇ half of the aperture angle of the optical imaging element 43.
- the transparent cover has a protrusion 50.
- the protrusion 50 permits a steeper entrance angle of the light emitted by the light source 32. Thereby reflections at the transparent cover that might hit the image sensor and thus reduce the quality of the captured image can be avoided or at least reduced.
- the protrusion 50 has a light source facing surface.
- the light source facing surface may couple light, e.g. the edge beam 61 of the light source 32 into the transparent cover.
- the transparent cover may have a recess 53 at the opposite side for coupling out the light and for directing it towards an object to be lighted, e.g. ground 4.
- Figure 7 depicts a further embodiment for arranging beam shaping elements, like the one indicated with reference numeral 42 and optical imaging elements, like the one indicated with reference numeral 44 on or more precisely at a common carrier 40.
- the common carrier can be supported by the housing body 22.
- Figure 8 depicts an example for mounting a light source, like a LED 32 and an image sensor 34 to a common printed circuit board 30.
- the printed circuit board has a first layer 35 with a first thermal conductivity coefficient k 1 (e.g. k 1 ⁇ 0,25 W cm -1 K -1 ) at 273K).
- ⁇ Al 2,38 W cm -1 K -1 at 273K
- the first layer 35 has through hole like opening 36.
- the rear side of the opening 36 is closed by a second layer 37 with second thermal conductivity coefficient k 2 , wherein k 2 ⁇ k 1 .
- the second layer 37 comprise some epoxy compound.
- a typical thermal conductivity coefficient for a glass epoxy compound is in the order of 6.10 -3 W cm -1 K -1 .
- the image sensor 34 may be supported by the second layer 37 and thus be thermally decoupled from the first layer and thereby from the light source 32. The signal to noise ration of the image sensor 34 is thereby enhanced.
- the second layer 37 positioned at the opposite of side of the light source 32 on the first layer 35.
- the image sensor 34 faces into the same direction as the light source 32.
- the image sensor 34 protrudes into the through hole 36 and stray light on the image sensor is reduced.
- the detail in figure 9 shows a housing body 22 as heat sink, being in a surface-to-surface contact with the rear side of a first layer 35 of a printed circuit board.
- On the front side of the first layer 35 are light sources 32.
- the first layer 35 has a first thermal conductivity coefficient k 1 .
- the first layer 35 has a through hole like opening 36, being bridged by a second layer 37 having a second first thermal conductivity coefficient k 2 (preferably k 1 > k 2 ).
- the second layer 37 overlaps the opening 36 and is mounted to the front side of the first layer 35.
- the second layer 37 supports an image sensor 34.
- the image heat transfer from the light sources 32 to the image sensor is reduced. In this sense, the image sensor 34 is thermally decoupled from the light sources 32.
- a transparent cover 24 with integrated beam forming means 42 and an optical imaging element 44 faces the light sources 32 and the image sensor 44.
- Detail in figure 9 shows only one image sensor 34, but of course may the full lamp comprise more than only one image sensor 34, preferably being mounted similarly as the depicted one.
- FIG. 10 shows a housing body 22 as heat sink, being in a surface-to-surface contact with a first area 38 of the rear side of a printed circuit board 35.
- Two light sources 32 are mounted to the front side 31 of the first area 38.
- An image sensor 34 is mounted in between of the light sources 32 on a second area 39 of the printed circuit board 30.
- the heat sink is not in surface-to-surface contact with the second are of the printed circuit board, as a recess 23 spans over the second area 39.
- the boundary between the first area and the second area 39 is sketched by dashed lines 33
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Studio Devices (AREA)
- Non-Portable Lighting Devices Or Systems Thereof (AREA)
Description
- The invention relates to a lamp for example for lighting a street, a place or the like. The lamp has a support, supporting at least one light source and at least one image sensor. Beam forming means direct light from the light source to obtain a given light distribution. The lamp further comprises at least one optical imaging element for projecting images onto the image sensor.
-
CN 200920013082 -
US 2009/0185376 discloses a street lamp. The street lamp has a housing with a transparent cover. In the housing is a printed circuit board supporting a light source and an image sensor of a camera. The camera has a casing for positioning a lens group in a defined distance to the image sensor of the camera. - The invention is based on the observation that the integration of the camera in a common housing with the components for lighting the street like lampshade, light source and the like as suggested in
US 2009/0185376 facilitates the production and operation if compared to the suggestion ofCN 200920013082 -
US 2010/0277082 discloses a lamp for replacing mercury vapour or other gas-discharge lamps The lamp has a base plate as support for LEDs. In front of the base plate is a cover plate with beam forming means for directing light from the LEDs to obtain a given light distribution. A black box like camera module can be mounted on the front side of the cover plate or, if the cover plate is omitted to the base plate. -
WO 2011/049435 A1 relates a well to a LED-light with an integrated camera. The LEDs are mounted to form a ring like structure on a printed circuit board The LED-light has an enlarged compartment for an electronic circuit by means of a second printed circuit board that is connected to the first printed circuit board by means of a plug which also offers installing at the front of the lamp. -
WO 2011/067749 A1 discloses a LED-light with a camera. The camera is a ready to use module and connected via fitting to a cover and to an electronic box. Alternatively, the camera may be inserted on a printed circuit board on which LEDs are fitted. - Solutions of the problem are described in the independent claims. The dependent claims relate to further improvements of the invention.
- The lamp comprises at least a support, supporting at least one light source and at least one image sensor. The lamp has at least one beam forming means for directing light emitted by the light source to obtain a given light distribution. The beam forming means may be for example a lens and/or a reflector. The lamp further comprises at least one optical imaging element for projecting images from outside the lamp onto the image sensor, for example a lens and/or an aperture. The beam forming means and the optical imaging element are arranged on a common carrier. This permits an easy manufacturing of the lamp, because it is sufficient to place the beam forming means and the optical imaging element on the common carrier and to position the common carrier relative to the light source(s) and the image sensor. The common carrier is a common reference for the orientation of the beam forming elements and the optical imaging element, thus the respective optical axes are aligned by design when placing the beam forming elements and the optical imaging element on the common carrier. The adjustment of the optical axes is thus included in the assembly step and a subsequent manual alignment of the camera with the light beam of the light source subsequent to the assembly of the lamp is avoided.
- The lamp preferably comprises a housing with at least one housing body and an at least partially transparent cover.
- The light source can be a LED and is preferably mounted on a printed circuit board. The support may support for example multiple LEDs. Some of the LEDs may have different emission spectra. For example may some (at least one) LED emit visible light and some (at least one) other LED emit IR-light. The image sensor may be mounted on the same printed circuit board, serving as support. Printed circuit boards typically have a body of some non conducting material, like for example some epoxy compound. The printed circuit board may alternatively comprise a metal body or core to provide an efficient heat transfer from the LEDs to e.g. some heat sink. The heat sink can be integrated in the housing body.
- The support may preferably comprise a thermally conducting layer or area supporting the at least one light source and a thermally insulating layer or area, for example of some epoxy compound, supporting the image sensor. On the one hand this allows an efficient cooling of the light source and on the other hand to avoid a direct transfer of heat to the image sensor, thereby enhancing the signal to noise ratio in the signal provided by the image sensor. Thermally insulating is any material that provides a lower heat conductivity as the thermally conducting layer or material supporting the at least one light source. Thus in one example, the LED(s) as light source(s) could preferably be mounted on an area of the support that comprises a metal layer for transferring heat from the light source(s) to some heat sink and an area of some plastic, e.g. epoxy compound, supporting the image sensor to thermally decouple the light source(s) from the image sensor.
- The thermally conducting area is preferably in a surface-to-surface connection with a heat sink, for example a housing body. The thermally insulating area is preferably not in a surface-to-surface connection with the heat sink. In particular if the rear surfaces of the thermally conducting area and thermally insulating area are in a common plane, it is preferred if the heat sink has an at least substantially plane surface being in surface-to-surface contact the thermally conducting area and a recess spanning over the rear side of the thermally insulating area. Thereby, heat from the light source(s) may be dissipated via the heat sink and at the same time the heat transfer to the at least one image sensor may be reduced, yielding longer lifetime of the light source(s) and an enhanced signal to noise ratio of the image sensor.
- The at least one light source and and the at least one image sensor may be mounted to a common printed circuit board. The printed circuit board may comprise a first layer with a first thermal conductivity coefficient k1 (e.g. k1 ≥ 0,25 W cm-1 K-1 at 273K). The first layer may include for example a metal core, in particular an aluminum core. On the front side of the first layer may be at least one LED as light source. Thus the heat produced when operating the light source may be transferred to some heat sink, e.g. the housing body, by the first layer. The first layer may have a preferably through hole like opening. The front side and/or rear side the opening may be closed by a second layer with a second thermal conductivity coefficient k2, being smaller than the first thermal conductivity coefficient k1, (k2< k1). For simplicity, the first layer can be considered as thermally conducting and the second layer as thermally insulating. For example may the second layer comprise some epoxy compound. The image sensor is preferably be supported by the second layer and thus be thermally decoupled from the first layer. The signal to noise ration of the image sensor is thereby enhanced. In addition stray light from the light sources, falling on the image sensor may be reduced.
- The image sensor may e.g. be a CCD (Charge - Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
- In a preferred embodiment are the light source(s), the image sensor, the beam forming means and the optical imaging element for projecting the image on the image sensor arranged on the support. Thus, the support is the common carrier. This permits to use extremely precise and quick pick and place machines for the assembly of the electronic and optical components of the lamp. A later alignment of the optical axis of the light source to the optical axis of the image sensor can thus be avoided.
- The transparent cover may include the beam forming means and the optical imaging element for projecting an image. Thus the transparent cover may be the common carrier. Such a transparent cover can be injection molded with very high precision. As the beam forming means and the optical imaging element for projecting an image are integrated in the transparent cover the number of parts is reduced and their optical axes can be aligned without manually adjusting their positions and/or orientations.
- The transparent cover may have at least one protrusion facing the support. The protrusion is preferably arranged between the optical axes of the image sensor and the light source. These protrusions inhibit or at least reduce reflections of light from the light source by the transparent cover on the image sensor, i.e. stray light.
- In particular if the beam forming means include a lens, the optical imaging element for projecting an image on the image senor may have the same mapping function and can thus be identically shaped. This further reduces the manufacturing costs. If the mapping function yields a distorted image on the image sensor, the distortion can be corrected by mapping the image obtained by the image sensor with the inverse the mapping function. It is sufficient to map the image obtained by the image sensor with the inverse of the non linear term of the mapping function to reduce the distortions. The correction can be done some microcontroller like a digital signal processor or a computer.
- The lamp may comprise more than one image sensor, for example two or more image sensors. In front of each image sensor is a corresponding optical imaging element. This permits to obtain pictures from two or more perspectives and thereby to enhance object recognition. The object recognition may be used for of traffic surveillance, for example to distinguish between different types of vehicles, like cars, trucks, motorcycles, bicycles and the like. A further application for could be people counting, e.g. at stadium entrances. In addition distances can be calculated.
- At least one of the optical imaging elements may be an asymmetric lens. This permits to capture images of different angular ranges and/or magnifications with the different image sensors, although the image sensors are supported by the common support and the optical imaging elements are as well supported by the common carrier, even if the support and the carrier have plane mounting surfaces.
- The lamp includes preferably driving means for driving the light source(s) and/or the at least one image sensor. These driving means can be integrated on a single chip and/or on at least one printed circuit board. The driving means are preferably thermally isolated from the light source(s), e.g. positioned in a separate compartment. This permits to reduce a heat transfer from the light sources to the driving means. The driving means may accomplish image data processing as well as forwarding the image data to some monitoring or control station. Further, the separate compartment can support the housing.
- In the following the invention will be described by way of example, without limitation of the general inventive concept, on examples of embodiments with reference to the drawings.
-
Figure 1 shows a street lamp. -
Figure 2 shows an exploded view of head of a street lamp. -
Figure 3 shows a section of a street lamp. -
Figure 4 shows detail A offigure 3 . -
Figure 5 shows a detail of an alternative lamp. -
Figure 6 shows a detail of an alternative lamp. -
Figure 7 shows a detail of an alternative lamp. -
Figure 8 shows a detail of an alternative lamp. -
Figure 9 shows a detail of an alternative lamp. -
Figure 10 shows a detail of an alternative lamp. - The
lamp 10 infigure 1 is mounted to alamp post 5 on someground 4. Thelamp 10 has acompartment 12 supporting ahousing 20 with ahousing body 22 and a transparent cover 24 (cf.fig. 2 to 4 ). The housing body supports a printedcircuit board 30 and may have arim 26 for defining the position of the printedcircuit board 30 in the housing body. Therim 26 as well defines the orientation and the position of thetransparent cover 24 relative to thehousing body 22, like indicated infigures 2 and3 . On the printedcircuit board 30 areLEDs 32 as light sources and for example two CCD-type image sensors 34. Light from thelight sources 32 is directed by beam shaping elements 42 (seefig. 2 to 8 ) into some given direction to obtain a desired light distribution on theground 4 below thelamp 10. Thelighted ground 4 and objects on theground 4 reflect this light. Light reflected by theground 4 or objects between theground 4 and thelamp 10 can thus be projected as an image of theground 4 and/or the object on theimage sensor 34. Theimage sensors 34 convert the projected image into some electrical signal which can be further processed by a controlling unit. The controlling unit may be part of some driving means for driving and controlling at least oneimage sensor 34 and or at least onelight source 32. The controlling unit may store such captured images and/or transmit the images via some data bus to a main controller. The driving means can be positioned in thecompartment 12 supporting thehousing 20. Thereby the driving means can be thermally insulated from thelight sources 32. The section as depicted infigure 3 shows for the purpose of simplicity only a reduced number oflight sources 32 andimage sensors 34, but corresponds in principle to the depiction offigure 2 . - For projecting the image on the
image sensor 34 anoptical imaging element 44 is placed in front of the image sensor 34 (cf.figure 4 ). In the depicted example offigure 4 thebeam shaping element 42 and theoptical imaging element 44 are each lenses, which are incorporated intotransparent cover 24. Thus, thetransparent cover 24 is a common carrier for thebeam shaping element 42 and theoptical imaging element 44. Thetransparent cover 24, thebeam shaping element 42 and theoptical imaging element 44 can thus be manufactured by single process, for example injection molding. A further advantage of such integration of thebeam shaping elements 42 and theoptical imaging element 44 is that the orientation and position of theoptical axis 43 of thebeam shaping element 42 andoptical axis 45 of theoptical imaging element 44 are defined by their common manufacturing process and there is thus no need for a difficult and time consuming adjusting process of theoptical axes - In the detail in
figure 4 thebeam shaping element 42 and theoptical imaging element 44 have the same imaging function. This imaging function is in practice a result of a desired light distribution of thelamp 10, which may vary from application to application and may yield severe distortions of the image projected on image sensor 34by theoptical imaging element 44. These distortions can be reduced by applying the inverse mapping of the imaging function to the image captured by the image sensor. The inverse mapping can be performed by some controlling unit, for example a controlling unit inside the housing or some external controlling unit. Different from the depicted examples may the beam shaping element(s) and the optical imaging element(s) have different mapping functions and thus different shapes. - In
figure 5 a detail of slightly different street lamp is depicted. A light source 32 (a LED) and animage sensor 34 are mounted to a printedcircuit board 30 as support. Abeam shaping element 42 and anoptical imaging element 44, briefly as well referred to as "lenses", are preferably directly attached to the printedcircuit board 30 in front of thelight source 32 and in front of theimage sensor 34, respectively. In this example the printedcircuit board 30 is a common carrier for thebeam shaping element 42, theoptical imaging element 44, thelight source 32 and theimage sensor 34. These components can be placed quickly and very accurately with standard pick and place machines. The orientations of the components are defined by the surface of the support, i.e. in this example the mountingsurface 31 of the printedcircuit board 30. It is thus not necessary to adjust the orientations of the components after they are placed. In front of thelenses transparent cover 24. The distance c between the light source and the image sensor is preferably bigger or equal to the d1•sin(α) + d2•sin(β) wherein d1 is the distance between the light source and the transparent cover, a is half of the angle of beam spread of the combination of thelight source 32 and thebeam shaping element 42, d2 is the distance between the image sensor and the transparent cover and β half of the aperture angle of theoptical imaging element 43. Such chosen distances permits to avoid that light from the light source is reflected by the transparent cover on the image sensor. - In
figure 6 a detail of slightly different street lamp is depicted. The difference with respect to the previous examples is that the transparent cover has a protrusion 50. The protrusion 50 permits a steeper entrance angle of the light emitted by thelight source 32. Thereby reflections at the transparent cover that might hit the image sensor and thus reduce the quality of the captured image can be avoided or at least reduced. The protrusion 50 has a light source facing surface. The light source facing surface may couple light, e.g. the edge beam 61 of thelight source 32 into the transparent cover. The transparent cover may have arecess 53 at the opposite side for coupling out the light and for directing it towards an object to be lighted,e.g. ground 4. -
Figure 7 depicts a further embodiment for arranging beam shaping elements, like the one indicated withreference numeral 42 and optical imaging elements, like the one indicated withreference numeral 44 on or more precisely at acommon carrier 40. The common carrier can be supported by thehousing body 22. -
Figure 8 depicts an example for mounting a light source, like aLED 32 and animage sensor 34 to a common printedcircuit board 30. The printed circuit board has afirst layer 35 with a first thermal conductivity coefficient k1 (e.g. k1 ≥ 0,25 W cm-1 K-1) at 273K). The first layer may include for example an aluminum (κAl = 2,38 W cm-1 K-1 at 273K) core. On the ground facing side of thefirst layer 35 is aLED 32, thus the heat produced when operating thelight source 32 may be transferred to some heat sink, e.g. the housing body, by thefirst layer 35. Thefirst layer 35 has through hole like opening 36. The rear side of theopening 36 is closed by asecond layer 37 with second thermal conductivity coefficient k2, wherein k2< k1. For example may thesecond layer 37 comprise some epoxy compound. A typical thermal conductivity coefficient for a glass epoxy compound is in the order of 6.10-3 W cm-1 K-1. Theimage sensor 34 may be supported by thesecond layer 37 and thus be thermally decoupled from the first layer and thereby from thelight source 32. The signal to noise ration of theimage sensor 34 is thereby enhanced. In the depicted example is thesecond layer 37 positioned at the opposite of side of thelight source 32 on thefirst layer 35. Theimage sensor 34 faces into the same direction as thelight source 32. Thus, theimage sensor 34 protrudes into the throughhole 36 and stray light on the image sensor is reduced. - The detail in
figure 9 shows ahousing body 22 as heat sink, being in a surface-to-surface contact with the rear side of afirst layer 35 of a printed circuit board. On the front side of thefirst layer 35 arelight sources 32. Thefirst layer 35 has a first thermal conductivity coefficient k1. Thefirst layer 35 has a through hole like opening 36, being bridged by asecond layer 37 having a second first thermal conductivity coefficient k2 (preferably k1> k2). Thesecond layer 37 overlaps theopening 36 and is mounted to the front side of thefirst layer 35. Thesecond layer 37 supports animage sensor 34. Thus, the image heat transfer from thelight sources 32 to the image sensor is reduced. In this sense, theimage sensor 34 is thermally decoupled from thelight sources 32. Atransparent cover 24 with integratedbeam forming means 42 and anoptical imaging element 44 faces thelight sources 32 and theimage sensor 44. Detail infigure 9 shows only oneimage sensor 34, but of course may the full lamp comprise more than only oneimage sensor 34, preferably being mounted similarly as the depicted one. - The detail in
figure 10 shows ahousing body 22 as heat sink, being in a surface-to-surface contact with afirst area 38 of the rear side of a printedcircuit board 35. Twolight sources 32 are mounted to thefront side 31 of thefirst area 38. Animage sensor 34 is mounted in between of thelight sources 32 on asecond area 39 of the printedcircuit board 30. The heat sink is not in surface-to-surface contact with the second are of the printed circuit board, as arecess 23 spans over thesecond area 39. The boundary between the first area and thesecond area 39 is sketched by dashedlines 33 -
- 4
- ground
- 5
- lamp post
- 10
- lamp
- 12
- compartment
- 20
- housing
- 22
- housing body/heat sink
- 24
- transparent cover
- 26
- rim/support structure
- 30
- printed circuit board/support
- 31
- mounting surface / front side
- 32
- light source / LED
- 33
- dashed line
- 34
- image sensor
- 35
- first layer
- 36
- opening
- 37
- second layer
- 38
- first area
- 39
- second area
- 40
- carrier
- 42
- beam shaping element / lens
- 43
- optical axis of light source
- 44
- optical imaging element /lens
- 45
- optical axis of image sensor /camera
- 50
- protrusion
- 53
- recess for coupling out light
- 62
- edge beam
Claims (6)
- A lamp (10) for lighting a street, comprising at least:- a support (30), supporting at least one light source (32) and at least one image sensor (34),- at least one beam forming means (42) for directing light being emitted by the light source (32) to obtain a given light distribution,- at least one optical imaging element (44) for projecting images onto the image sensor (34),- a housing (20) with at least one housing body (22) and an at least partially transparent cover (24)
wherein
the beam forming means (42) and the optical imaging element (44) are arranged on a common carrier (24, 30, 40),
characterized in that
the transparent cover (24) includes the beam forming means (42) and the optical imaging element (44) for projecting an image as common carrier. - The lamp of claim 1,
characterized in that
the support is a printed circuit board (30). - The lamp of claim 1 or 2,
characterized in that
the lamp (10) comprises at least one driving means for driving at least one of the at least one light source (32) and the at least one image sensor (34), wherein the driving means are thermally isolated from the at least one light source (32). - The lamp of claim 3,
characterized in that
the driving means are positioned in a separate compartment (12), wherein the separate compartment (12) is configured for being attached to a lamp post (5) and wherein the separate compartment (12) supports the housing (20). - The lamp of any one of the preceding claims
characterized in that,
the at least one light source (32) and the at least one image sensor (34) are mounted on a front side (31) of a first area 38 of the support (30), wherein a rear side of said at least one first area (38) is in a surface-to-surface contact with at least one heat sink (22). - The lamp of claim 5
characterized in that
the heat sink (22) has a recess on its support facing side, such that the heat sink (22) is not in a surface-to-surface contact with at least one second area 39 of the rear side of the support (30), supporting the least one image sensor (34).
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12151446.7A EP2618051B1 (en) | 2012-01-17 | 2012-01-17 | Lamp with integrated camera |
PCT/EP2013/050625 WO2013107720A1 (en) | 2012-01-17 | 2013-01-15 | Lamp with integrated camera |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12151446.7A EP2618051B1 (en) | 2012-01-17 | 2012-01-17 | Lamp with integrated camera |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2618051A1 EP2618051A1 (en) | 2013-07-24 |
EP2618051B1 true EP2618051B1 (en) | 2015-10-14 |
Family
ID=47605491
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12151446.7A Not-in-force EP2618051B1 (en) | 2012-01-17 | 2012-01-17 | Lamp with integrated camera |
Country Status (2)
Country | Link |
---|---|
EP (1) | EP2618051B1 (en) |
WO (1) | WO2013107720A1 (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101493204A (en) | 2008-01-23 | 2009-07-29 | 鸿富锦精密工业(深圳)有限公司 | Outdoor lamp |
US8926139B2 (en) * | 2009-05-01 | 2015-01-06 | Express Imaging Systems, Llc | Gas-discharge lamp replacement with passive cooling |
NL1037416C2 (en) * | 2009-10-25 | 2011-04-27 | Leds Progress Holding B V | LED MODULE AND LAMP CONTAINING A LED MODULE. |
US9131557B2 (en) * | 2009-12-03 | 2015-09-08 | Led Net Ltd. | Efficient illumination system for legacy street lighting systems |
-
2012
- 2012-01-17 EP EP12151446.7A patent/EP2618051B1/en not_active Not-in-force
-
2013
- 2013-01-15 WO PCT/EP2013/050625 patent/WO2013107720A1/en active Application Filing
Also Published As
Publication number | Publication date |
---|---|
WO2013107720A1 (en) | 2013-07-25 |
EP2618051A1 (en) | 2013-07-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9344705B2 (en) | Time of flight camera with rectangular field of illumination | |
US8994051B2 (en) | Light emission module, light emission module manufacturing method, and lamp unit | |
US8500315B2 (en) | Light emitting module and automotive headlamp | |
JP4806025B2 (en) | Multifunctional automotive floodlight module, especially for the automotive front area | |
US7297932B2 (en) | Vehicle optoelectronic precipitation sensor with adjustable lens holder | |
US20160261763A1 (en) | Image sensor | |
KR20070074648A (en) | Lighting device, automotive headlights and method for producing a lighting device | |
CN102759056A (en) | Vehicular lamp | |
US20090122394A1 (en) | Camera Module | |
CN113741120A (en) | Light filling lens, light filling lamp module, lens assembly and electronic equipment | |
US20240170466A1 (en) | Optical navigation module performing lateral detection | |
US8950066B2 (en) | Method for manufacturing light emitting diode module | |
US20140146553A1 (en) | Lighting module for a vehicle lighting device with semiconductor light source | |
KR101380232B1 (en) | A light projector applicable to a surveillance camera | |
EP3734146A1 (en) | Vehicle light reflective-type led module system and vehicle light assembly | |
EP2618051B1 (en) | Lamp with integrated camera | |
US8388152B2 (en) | Light-emitting device and projector | |
JP2021152609A (en) | Imaging apparatus and vehicle | |
CN101338872B (en) | Head light for two-wheel vehicle | |
CN101813869A (en) | Active infrared video camera | |
TW202042543A (en) | Camera and light adjustment module | |
US8167207B2 (en) | Integrated optical exit window | |
KR102345684B1 (en) | Imaging device and car | |
US9671083B2 (en) | Light fixture with reflective optics | |
CN215285297U (en) | Shooting device and unmanned aerial vehicle |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
17P | Request for examination filed |
Effective date: 20131008 |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
17Q | First examination report despatched |
Effective date: 20131219 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: F21S 8/08 20060101ALI20150319BHEP Ipc: F21W 131/105 20060101ALN20150319BHEP Ipc: G08B 15/00 20060101ALI20150319BHEP Ipc: F21W 131/103 20060101ALN20150319BHEP Ipc: F21V 23/04 20060101ALI20150319BHEP Ipc: F21V 33/00 20060101AFI20150319BHEP Ipc: G08B 13/196 20060101ALI20150319BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G08B 15/00 20060101ALI20150326BHEP Ipc: G08B 13/196 20060101ALI20150326BHEP Ipc: F21W 131/103 20060101ALN20150326BHEP Ipc: F21W 131/105 20060101ALN20150326BHEP Ipc: F21V 23/04 20060101ALI20150326BHEP Ipc: F21S 8/08 20060101ALI20150326BHEP Ipc: F21V 33/00 20060101AFI20150326BHEP |
|
INTG | Intention to grant announced |
Effective date: 20150424 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 755428 Country of ref document: AT Kind code of ref document: T Effective date: 20151015 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602012011456 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20151014 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 755428 Country of ref document: AT Kind code of ref document: T Effective date: 20151014 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160114 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160214 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160115 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160215 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160131 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20160323 Year of fee payment: 5 Ref country code: GB Payment date: 20160323 Year of fee payment: 5 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602012011456 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20160330 Year of fee payment: 5 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: LU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160117 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
26N | No opposition filed |
Effective date: 20160715 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160131 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160131 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160117 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602012011456 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20170117 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20170929 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170131 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170801 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20170117 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20120117 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20160131 Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20151014 |