GB2395390A - Active projection system - Google Patents

Active projection system Download PDF

Info

Publication number
GB2395390A
GB2395390A GB0324442A GB0324442A GB2395390A GB 2395390 A GB2395390 A GB 2395390A GB 0324442 A GB0324442 A GB 0324442A GB 0324442 A GB0324442 A GB 0324442A GB 2395390 A GB2395390 A GB 2395390A
Authority
GB
United Kingdom
Prior art keywords
surroundings
image scene
thermal image
illumination intensity
intensity pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB0324442A
Other versions
GB2395390B (en
GB0324442D0 (en
Inventor
Kevin Trevor Talbot
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ford Global Technologies LLC
Original Assignee
Ford Global Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ford Global Technologies LLC filed Critical Ford Global Technologies LLC
Publication of GB0324442D0 publication Critical patent/GB0324442D0/en
Publication of GB2395390A publication Critical patent/GB2395390A/en
Application granted granted Critical
Publication of GB2395390B publication Critical patent/GB2395390B/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/04Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
    • B60Q1/18Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights being additional front lights
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q1/00Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor
    • B60Q1/02Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments
    • B60Q1/04Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights
    • B60Q1/06Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle
    • B60Q1/08Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle automatically
    • B60Q1/085Arrangement of optical signalling or lighting devices, the mounting or supporting thereof or circuits therefor the devices being primarily intended to illuminate the way ahead or to illuminate other areas of way or environments the devices being headlights adjustable, e.g. remotely-controlled from inside vehicle automatically due to special conditions, e.g. adverse weather, type of road, badly illuminated road signs or potential dangers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/56Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/74Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/05Special features for controlling or switching of the light beam
    • B60Q2300/054Variable non-standard intensity, i.e. emission of various beam intensities different from standard intensities, e.g. continuous or stepped transitions of intensity
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/40Indexing codes relating to other road users or special conditions
    • B60Q2300/41Indexing codes relating to other road users or special conditions preceding vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/40Indexing codes relating to other road users or special conditions
    • B60Q2300/42Indexing codes relating to other road users or special conditions oncoming vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q2300/00Indexing codes for automatically adjustable headlamps or automatically dimmable headlamps
    • B60Q2300/40Indexing codes relating to other road users or special conditions
    • B60Q2300/45Special conditions, e.g. pedestrians, road signs or potential dangers

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Lighting Device Outwards From Vehicle And Optical Signal (AREA)

Abstract

An Apparatus for the illumination of surroundings includes an infra red camera (22) generating data representing a two dimensional thermal image scene relating to the surroundings; a data processing system (26) for processing the data representing a two dimensional thermal image scene relating to the surroundings to produce an illumination intensity pattern therefrom; and a projector (36) for projecting the illumination intensity pattern onto the surroundings. The apparatus enables the visibility of objects to be enhanced.

Description

l interactive Lighting System Field of the Present Invention
The present invention relates to the interactive lighting of 5 surroundings, in particular, but not exclusively to the oncoming surroundings of a vehicle such as a car.
Background
The driver of a vehicle, for example a car, needs to be aware when 10 driving, sufficiently in advance, of any features of the oncoming surroundings posing as a potential hazard or danger. This allows the driver to drive more safely. This is more difficult in low light conditions and at night. In these poor lighting conditions it generally takes longer for the driver to become aware of potential hazards than in good lighting conditions despite the use of 15 standard illumination means of the oncoming surroundings.
Standard illumination means for the oncoming surroundings of a car generally involves the projection onto the surroundings of two overlapping beams of illumination of a single level of intensity. Such a method for illumination, although providing a general illumination of the oncoming 20 surroundings and therefore any potential hazards and dangers also, cannot alert the driver to any oncoming hazardous features in particular over less hazardous features of the oncoming surroundings. Additionally, the driver cannot be informed of the nature of features of the oncoming surroundings by the characteristics of the illumination.
25 Patent application US 6,144,158 describes an adaptive headlight device which modifies the intensity and angular aim of one or more micro beams of a headlight beam upon detection of incoming light radiation. The purpose is to prevent the dazzling of oncoming drivers of vehicles by dimming the region of illumination corresponding to the oncoming vehicle.
30 Patent application US 6,403,942 describes a headlamp control system wherein the intensity of an illumination of the oncoming vehicle surroundings is varied according to a detection of further vehicles in the surroundings.
]t is noted that an intelligent lighting system is described in the paper "Pixel Light", Martin Enders, BMW Group, Germany, PAL 2001 Symposium, Darmstadt University of Technology describes a Digital Micro Mirror Device (DMD) used in an interactive lighting system which is capable 5 of amplifying the contrast of objects such as traffic signs, pedestrians, bicyclists, pavement markings and obstacles. However, the manner in which features are distinguished and how an illumination pattern is generated is not clear, and does not address the issue of reducing complexity in the data processing system.
]O In accordance with the present invention, there is provided apparatus for the illumination of surroundings including: a) an infra red camera generating data representing a two dimensional thermal image scene relating to the surroundings; b) a data processing system for processing the data representing a ] 5 two dimensional thermal image scene relating to the surroundings to produce an illumination intensity pattern therefrom; and c) a projector for projecting the illumination intensity pattern onto the surroundings, wherein the data processing system is arranged to process the data representing a two dimensional thermal image scene relating to the 20 surroundings in accordance with predetermined rules for categorising features of the two dimensional thermal image scene and wherein the categorising rules include rules relating to features which are moving within the two dimensional thermal image scene.
The present invention provides apparatus for the interactive 25 illumination of the oncoming surroundings capable of varying characteristics of the illumination projected onto the oncoming surroundings. By basing the illumination pattern on thermal image data, a large majority of sensed features which are moving, such as animated objects, including humans and animals, and vehicles, and which are therefore generally of greatest potential hazard, 30 can be highlighted directly using a relatively small amount of processing power and/or with increased speed of interaction.
Different features of the oncoming surroundings can be differently illuminated such that the driver is sooner alerted to oncoming potential hazards and dangers as well as useful features of the surroundings such as a road sign. The characteristics of the illumination for a feature of the 5 oncoming surroundings also provide the driver with information about the nature of the oncoming feature.
Preferably, the data processing system applies a function, for example a thresholding function, to a thermal image scene of the vehicle surroundings to produce the illumination intensity pattern.
] O Further features and advantages of the invention wild become apparent from the following description of preferred embodiments of the invention,
given by way of example only, made with reference to the accompanying drawings. ] 5 Brief Description of the Drawings
Figure] is a schematic diagram of a projector for use in an interactive lighting system, in accordance with an embodiment of the present invention; Figure 2 is a schematic diagram of an alternative projector for use in accordance with an embodiment of the present invention; 20 Figure 3 shows schematica]]y a diagram of an embodiment of the present invention; Figure 4 shows schematically a data processing system for use in an interactive lighting system, in accordance with an embodiment of the present invention; 25 Figure S is a flow diagram showing a process followed by a data processing system in accordance with an embodiment of the present invention; Figure 6a shows an image scene of surroundings in accordance with an embodiment of the present invention; 30 Figure 6b shows an illumination intensity pattern for surroundings in accordance with an embodiment of the present invention;
Figure 7 shows representative plots of different functions applied to an image scene in accordance with an embodiment of the present invention; Figure 8 is a schematic diagram of an application of an interactive lighting system in accordance with an embodiment of the present invention; 5 and Figure 9 shows different mounting configurations of lighting systems in accordance with embodiments of the present invention.
Figure] shows a projector for use in an embodiment of the present invention. In this example the projector is mounted on a vehicle by 10 appropriate means, for example a car. A description of the structure and
function of the projector follows. The projector in this embodiment is capable of projecting an illumination pattern of only a single resultant colour of light.
A light source 2, for example a Xenon gas discharge lamp emits a beam of light which is collimated by a collimator dens 4. The collimated beam next ]5 passes through an illumination intensity modulator. In this embodiment, the illumination intensity modulator comprises a matrix of at least sixty four liquid crystal cells 6. The arrangement of liquid crystals in one liquid crystal cell of the matrix can be controllably varied by varying an applied voltage across a set of electrodes of the liquid crystal cell. Through a combination of 20 differently applied voltages across individual liquid crystal cells of the matrix, an overall configuration of the matrix of liquid crystal cells can be achieved.
Such an overall configuration corresponds to a desired pattern of illumination intensities. Thus, the collimated light beam when passing through the matrix of liquid crystal cells 6 is modulated such that a light beam with a specific 25 illumination intensity pattern results. The light beam with the specific illumination intensity pattern is subsequently focused by an objective lens 8 onto the surroundings of the car. Figure 2 shows schematically an alternative projector for the projection of an illumination intensity pattern. In this embodiment of the present invention, the projector is again mounted on a 30 vehicle, in this example a car, by appropriate means. In this embodiment, however, the projector is capable of producing an illumination comprising various colours unlike that described in the first embodiment.
s Elements of the projector described in this embodiment are similar to those of the projector of Figure 1. These elements are referenced in Figure 2 with the same numerical labels therein and the relevant descriptions according
to structure and function should be taken to apply herein also. The projector 5 comprises a first and a second light source 2, 10, the second light source 10 being similar to the hrst light source 2 as described in the previous embodiment. The light beam from the second light source has a different optical path to that from the first light source 2. The light beam from the second light source is collimated by a collimator lens 12 and is then ]0 modulated by a second matrix of liquid crystal cells 14, similar to that as described for the previous embodiment. The overall configuration of the second matrix of liquid crystal cells]4 preferably complements the overall configuration of the first matrix of liquid crystal cells 6. The light beam with an illumination intensity pattern modulated by the second matrix of liquid ]5 crystal cells]4 passes through a light filter]6 from which emerges light of a specific desired frequency. The desired frequency is selected depending on the desired colours of the illumination intensity pattern to be projected. The light beam passes from the light filter 16 through a dichroic mirror 18. At this point, the light beam from the first light source 2 joins the optical path of the 20 light beam from the second light source 10. In order for this to be achieved, the optical path of the light beam from the first light source is reflected by a folding mirror 20 and the dichroic folding mirror] 8. The now combined light beams with preferably complementary illumination intensity patterns are focused by the objective lens 8 onto the vehicle surroundings. The 25 surroundings are therefore illuminated by an illumination intensity pattern of at least one colour comprising the individual illumination intensity patterns of the light beams from the first and second light sources.
Figure 3 schematically shows an interactive lighting system of a vehicle, for example a car, according to an embodiment of the present 30 invention. An infra red camera 22 generates data which represents a two dimensional thermal image scene of the vehicle surroundings. The generated data of the two dimensional thermal image scene includes information on the
intensity of thermal radiation, in the form of infra red radiation, emitted by features of the vehicle surroundings. It should be noted that the thermal radiation detected by the infra red camera is solely emitted by the features of the vehicle surroundings and is therefore of a passive nature. The infra red 5 camera 22 is fitted with a visible light filter 24 in a manner which prevents the interference of visible light with the thermal image scene being detected by the infra red camera.
The generated data representing the two dimensional thermal image scene is sent to a data processing system 26. The data processing system also ] O receives additional data relating to the surroundings of the vehicle from a plurality of dedicated sensors 28, 30, 32. The additional data relates to parameters of the vehicle and its surroundings including: the temperature, the humidity, the light conditions, the speed of the vehicle, the angle of steering of the vehicle, the list of the vehicle. It is also envisaged that a radar device ]5 can be used to provide further data relating to the vehicle surroundings.
Following receipt of the thermal image scene data and the additional data, the data processing system 26 generates an illumination intensity pattern using this received data.
A description of further details of the structure and functioning of the
20 data processing system 26 follows shortly using Figures 4 and 5. Data representing the generated illumination intensity pattern is sent from the data processing system 26 to a matrix of liquid crystal cells 34 of a projector 36, similar to that described for a projector of an embodiment of the present invention, as shown using Figures 1 or 2. The data representing the generated 25 illumination intensity pattern results in a specific overall configuration of applied voltages across electrodes of the individual liquid crystal ce]]s such that the projector 36 projects an illumination intensity pattern onto the vehicle surroundings that is tailored to the features of the vehicle surroundings. An infra red filter 37 is fitted to the projector in a manner to prevent any emission 30 of infra red radiation onto the vehicle surroundings. Such an emission of infra red radiation would interfere with thermal image scene data detected by the infra red camera 22.
It should be noted that in further envisaged embodiments of the present invention, wherein the projector includes a plurality of liquid crystal cell matrices, the data representing the generated illumination intensity pattern is sent to each individual matrix of liquid crystal cells. Altennatively, it is 5 envisaged that the data representing the generated illumination intensity pattern is broken down by the data processing system 26 into data signals specific to each matrix of liquid crystal cells of the projector.
Refenring now to both Figures 4 and 5, Figure 4 shows a schematic diagram of the data processing system 26 in accordance with an embodiment 10 of the present invention. Figure 5 shows a flow diagram of the processes followed by the data processing system 26. An image scene processing unit 38 receives, as already described, data 40 representing the two dimensional thenn1al image scene from the infra red camera. The image processing unit 38 stores this thermal image scene data 42 and the additional data relating to the ] 5 vehicle surroundings is received 44.
According to the level of thermal intensity of features of the two dimensional thermal hnage scene and specific properties of the additional data, features of the vehicle sun oundings are highlighted 46 by the image scene processing unit 38. One example of the use of the additional data is the 20 temperature oi the ve]lic]e surroundings. The thermal intensity of features of the vehicle surroundings detected by the infra red camera relative to the thermal intensity of the background is affected by the temperature of the
vehicle sun-oundings. Tllis factor is included in the processing of the data by the image processing unit 38. In this embodiment, data representing a second 25 thenna] image scene of the vehicle surroundings is detected by the infra red camera and sent to the image processing unit 38 at a predetermined time period after the sending of the data representing' the initial thermal image scene. This second thenna] image scene is compared 48 against the initial thermal image scene as already stored 42.
30 Based on this comparison, further features of the image scene are highlighted 50 bit the image processing unit 38. The comparison involves detection of a change in position across the image scene or a change in size,
thus indicating the speed and direction of motion, of features of the image scene of the vehicle surroundings. It is also envisaged that a comparison may be performed between two subsequent values of the additional data to further highlight features of the vehicle surroundings.
5 Once the features of the thermal image scene vehicle surroundings have been highlighted, they are categorized 52 according to a predetermined set of' categorizing rules 54 which are stored in a first rule data store 56.
The categorizing rules analyse the highlighted features of the image scene and categorise then1 according to a plurality of characteristics. Possible ]0 characteristics include: the speed of motion of the feature, the direction of motion of the feature, the thermal intensity of' the feature, the size of the feature, the shape of the feature. Depending on specific details of these characteristics the features are categorized into one of' a plurality of' categories. One such example of these categories is according to a hazard ] 5 priority rating. For example, if a feature has the correct thermal intensity, size and shape of' a human, this feature will be designated a 'hazard 1' category indicating that this feature has a high hazard priority. A further feature having characteristics corresponding to a cat, for example, could be given a 'hazard 2 category, indicating that this feature has a lower hazard priority than the 20 human given the 'hazard] category. Alternative envisaged categories into which the features are sorted are according to the type of feature. These, for example, could include: humans, animals, trees, cars, road signs, buildings and miscellaneous, nonhazardous objects. Once the features of the image scene have been categorized, data detailing the categorization of the features 25 is sent from the image processing unit 38 to an illumination intensity pattern generating unit 58. Here an illumination intensity pattern is generated 60 by apply a set of illumination intensity pattern rules 62 which are stored in a second rule data store 64. The designated category of the features of the image scene determines characteristics of the illumination intensity pattern to 30 be generated, as stated by the illumination intensity pattern rules 62.
Characteristics of the illumination intensity pattern to be generated influenced by the illumination pattern rules include: the intensity of a region of the
illumination intensity pattern, the co]our of a region of the illumination intensity pattern, the shaping of a region of the illumination intensity patterns to form a symbol or an anTow for example, applying a flashing pattern of illumination to a region of the illumination intensity pattern, removal of a portion of illumination of a region of the illumination intensity pattern to prevent dazzling of a feature of the image scene.
Figure 6a shows an exemplary two dimensional thermal image scene 71 detected by the infra red camera. An animal 72 and two pedestrians 73 are easily identifiable in the image scene against the background due to their high
]0 thenma] intensity.
Figure 6b shows the generated i]]umination intensity pattern 74 for the thenna] image scene 7] as shown in Figure 6a. Fo]]owing the application of the i]luJllination pattern rules, regions of she i]]umination intensity pattern 74 corresponding to the anima] 75 and the two pedestrians 76 of the image scene ] c are modified so as not to illuminate a top portion of' the features thus preventing dazzling.
In generation of the i]]umination intensity pattern, the i]]umination intensit! of regions of the illumination intensity pattern, according to features of the image scene, are determined bat app]ving a function, for example a 2() thresholding function. to the level of theJ-ma] intensity of' the specific feature.
FOJ- example, selection of'f'eatures with specific thermal characteristics may bc made, thus discriminatiJlp between animals or humans and very hot objects such as vehicle exhaust systems.
leisure 7 shows graphical plots A, B. C showing different functions of applied by the illumination intensity pattern generating unit to the data represenlin,y the two dimensional thermal image scene. A]] plots S] 1OW a first axis 77 corresponding to the lease] of thermal intensity, of a feature of the vehicle surroundings and a second axis 78 perpendicular to the first axis 77 corresponding to the level of i]luJllination intensity of the appropriate region 30 of the illumination intensity pattern. Plot A S]lOWS the effect of a thresho}ding function 79 on the intensity of a region of the illumination intensity, pattern.
When the thcnnal intensity of a feature is below a threshold value 80 the
lo region of the illumination intensity pattern has an illumination intensity of zero. When the thermal intensity of a feature is equal to or above the threshold value SO, the corresponding region of the illumination intensity pattern now has a predetermined level of illumination intensity 81.
5 Plot B S]lOWS an envisaged alternative function applied to the thermal intensity data of a feature of the thermal image scene. This alternative function is non-linear 82 such that the difference in illumination intensity between two regions of the illumination intensity pattern is not directly proportional to the corresponding difference in level of thermal intensity of ] O two features of the image scene.
Plot C S]lOWS a further envisaged alternative function applied to the thermal intensity data of a feature of the thermal image scene. This alternative function is linear 83 such that the difference in illumination hMeJlsity between two regions of the illumination intensity pattern is directly ]5 proportional to the corresponding difference in level of thermal intensity of the two features.
Another example of' the application of illumination pattern rules involves a region of the generated illumination intensity pattern corresponding to a 'hazard 1' priority feature of the thermal image scene could be 2() illuminated in red and with a high illumination intensity so that all features of the image scene with a 'hazard 1' priority stand out more boldly than other features to the driver of the vehicle. A further example involves a feature of' the image scene moving at a higl1 speed towards the infra red camera of the interactive lighting system and deemed by the data processing system 26 to 25 impact with the vehicle. In this example, such a feature could be illuminated \x'ith a high intensity, rapidly flashing. red coloured illumination region of the illumination intensity pattern such that the driver is urgently alerted to the approaching hazard.
Illumination pattern rules are further envisaged in an alternative 30 embodiment of the present invention to be applied to features of the image scene categorized by the type of the feature, as described previously.
Now referring back to Figures 4 and 5, once the illumination intensity pattern has been generated 60, data representing the illumination intensity pattern is sent 66 to the projector for projecting the illumination intensity pattern onto the vehicle surroundings. If after the projection of the 5 illumination intensity pattern a switch off command 68 is received, then the processing by the data processing system 26 ends 70. If a switch off command is not received, the sequence of steps of processing by the data processing system 26 as shown in Figure 5 is repeated. Generally in all circumstances when the repeated processing cycle occurs, the thermal image 10 scene of the vehicle surroundings detected by the infra red camera is different to that of the previous processing cycle. Consequently, the generated . illumination intensity pattern for this different image scene is different to that . generated previously. Thus, the illumination intensity pattern projected onto . the vehicle surroundings dynamically interacts with the features of the . 15 changing vehicle surroundings. This theret'ore allows features of the vehicle .. surroundings to be tracked by a region of the illumination intensity pattern as its position relative to the vehicle changes.
. .: Embodiments of the present invention have so far described an e . *.: interactive lighting system comprising a single infra red camera and a single 20 projector. In these embodiments the infra red camera and the projector are preferably mounted in close proximity to each other at a centre point nearest the front of the vehicle. This close proximity mounting to each other helps to reduce image alignment problems. In further envisaged embodiments of the present invention, the interactive lighting system comprises a further infra red 25 camera and possibly a further projector, both of which are similar to those described previously.
In these embodiments, the infra red cameras are positioned on the vehicle such that a binocular view of the vehicle surroundings is detected through a combination of the individual two dimensional image scene from 30 each infra red camera to produce a three dimensional thermal image scene.
This therefore provides distance data of features of the image scene relative to the vehicle, without the need for analysis of size data of the features by the
data processing system 26 as previously described. In the embodiment wherein a further projector is included it is envisaged that the illumination intensity patterns projected are focused such that they complement each other on the vehicle surroundings. Alternatively, one projector projects an 5 illumination intensity pattern onto a portion of the vehicle surroundings and the further projector projects an illumination intensity pattern onto the remaining portion of the vehicle surroundings not covered by that of the first projector. In accordance with a further embodiment of the present invention, 10 Figure 8 shows an application of the interactive lighting system of a vehicle complementing a non-interactive lighting system of a vehicle, for example a headlight. A vehicle, preferably a car, 84 is driving along a road 85 in a forward direction 86. A non-interactive lighting system includes two . . headlights 88, 9O, each of which projects a fixed illumination delimited by lo. 15 edges 92, 94 respectively onto the vehicle surroundings. This fixed e illumination provides a general illumination of the vehicle surroundings to the driver. Each fixed illumination with edges 92, 94 overlaps to an extent with . - : each other and is of a constant level of illumination intensity. As features of e ...: the oncoming vehicle surroundings there is an animal 96 standing at the side 20 of the road 85 and two pedestrians 98 standing in the centre of the road 85.
Although both of these features of the vehicle surroundings are illuminated generally by the illumination of the non-interactive lighting system, the non interactive lighting system does not alert the driver of the vehicle to the presence of these features especially. However, with the interactive lighting 25 system complementing the non-interactive lighting system, this alerting of the driver is achieved. As according to the description of the functioning of the
data processing system using Figures 4 and 5, analysis of the thermal image scene of the vehicle surroundings by the data processing system results in categorization of the animal feature 96, and the two pedestrians feature 98 30 into, for example, the respective categories of 'animal' and 'human'.
As a result, the generated illumination intensity pattern projected by the projector 100 of the interactive lighting system onto the vehicle
surroundings includes a first region delimited by edges 102 of the illumination intensity pattern, for example of a high intensity of white light and modified to avoid dazzling, as described previously using Figures 6a and 6b, aimed specifically at the animal 96. A second region delimited by edges 104 of the S illumination intensity pattern, for example of a high intensity of red light and modified to avoid dazzling, is aimed specifically at the pedestrians 98. In this way, the driver is alerted in particular to these features of the vehicle surroundings whilst a general illumination of the oncoming vehicle surroundings is provided.
10 Figure 9 shows different configurations for the mounting of components of a complementary interactive and non-interactive lighting system one configuration of which was described using Figure 8.
À À Configuration A of the lighting system corresponds to that shown in ale Figure 8 and involves the single projector 108 of the interactive lighting A. 15 system positioned between and on the same horizontal level as the two À Àe headlights 110, 111 of the non-interactive lighting system each of which is À positioned close to one of the front corners of the vehicle. A single infra red Àe : camera 106 is positioned centrally and close to the projector. À. À. À.: Further configurations of the lighting system are envisaged, in
20 particular configuration B wherein an infra red camera 106 and a projector 108 are positioned close to and horizontally level with the front corner positioned first headlight I 10 and a second projector 109 and infra red camera 107 are positioned close to the second headlight 111, as viewed from the front of the vehicle, at the other front corner of the vehicle.
25 A further envisaged configuration C is similar to the embodiment just described with two infra red cameras 106, 107 positioned close to the headlights I 10, 1 1 1. In this configuration however only one projector 108 exists which is centrally positioned and on the horizontal level with the infra red cameras and headlights. In the case of configurations B and C, the two 30 infra red cameras 106, 107 allow a binocular view of the vehicle surroundings to be obtained to produce a three dimensional thermal image scene as earlier described.
The above embodiments are to be understood as illustrative examples of the invention. Further embodiments are envisaged. For example, an alternative projector for the projecting of the illumination intensity pattern onto the vehicle surroundings is envisaged to comprise three light sources, 5 that produce light beams coloured red, green and blue respectively, which enable an illumination intensity pattern of a greater number of different colours to be projected. Furthermore, instead of using a liquid crystal light valve projector, an alternative may be used, such as a Digital Micro Mirror Device (DMD).
10 It should be noted that examples given in the description with respect
to the application of categorizing and illumination pattern rules to features of the image scene are not exhaustive. Further examples include the yellow .. illumination of a cyclist feature of the image scene, the lower half being . illuminated with a brighter intensity to avoid dazzling of the cyclist; the 6. 15 illumination of the position of a pedestrian standing behind a parked car, .. detected by the high level of thermal intensity of the pedestrian's legs under À the parked car; in the case of fog, lane and road markings are illuminated in . . particular, as also are the positions of hazards within the fog which cannot be . À... : easily viewed in the fog by the driver; in the case of an approaching feature of 20 the surroundings which will impact with the vehicle, the position at which point the impact will occur is illuminated.
It should be noted that although all described embodiments of the present invention have related to a lighting system for the illumination of the surroundings of a car, further lighting situations are envisaged as suitable for 25 the present invention. For example, a floodlighting scenario or the use for the surroundings of other types of vehicles other than a car would be suitable for the use of the present invention.

Claims (1)

  1. Claims
    1. Apparatus for the illumination of surroundings including: a) an infra red camera generating data representing a two 5 dimensional thermal image scene relating to the surroundings; b) a data processing system for processing the data representing a two dimensional thermal image scene relating to the surroundings to produce an illumination intensity pattern therefrom; and c) a projector for projecting the illumination intensity pattern onto 10 the surroundings, wherein the data processing system is arranged to process the data representing a two dimensional thermal image scene relating to the . surroundings in accordance with predetermined rules for categorising features e of the two dimensional thermal image scene and wherein the categorising ale rules include rules relating to features which are moving within the two À.. 15 dimensional thermal image scene.
    a.*. À 2. Apparatus according to claim 1, wherein the categorising rules . c À À relate to features moving across the two dimensional thermal image scene.
    Àe À À À Àe 203. Apparatus according to claim 1 or claim 2, wherein the categorising rules relate to features of the two dimensional thermal image scene moving towards the infra red camera.
    4. Apparatus according to any of claims I to 3, wherein the 25categorising rules further include rules relating to at least one of the shape, size and thermal intensity values of a feature of the two dimensional thermal Image scene.
    5. Apparatus according to any of claims I to 4, wherein said 30predetermined rules include rules for modifying the generated illumination Intensity pattern from the data representing the two dimensional thermal Image scene.
    6. Apparatus according to claim 5, wherein the modification of the generated illumination intensity pattern fo]]ows categorization of the two dimensional thermal image scene.
    7. Apparatus according to any preceding claim, wherein the projector is adapted to project an illumination intensity pattern comprising a p]ura] ity of regions of individua]]y contro]]able i]]umination intensity.
    10 8. Apparatus according to claim 7, wherein the projector is adapted to project an illumination intensity pattern comprising at least sixty four regions of individua]]y controllable i]]umination intensity.
    9. Apparatus according to claim 7 or claim 8, wherein the data ] 5 processing system is arranged to produce a selected illumination intensity of at least one of the individually controllable regions of the illumination intensity pattern from the data representing the two dimensional thermal image scene using a thres]lo]ding function.
    2()]O. Apparatus according to any preceding claim, wherein said data processing system is arranged to process additional data relating to the surroundings to produce the illumination intensity pattern.
    ]]. Apparatus according to claim 10, wherein the additional data 25 relates to the surroundings including data relating to the motion of the vehicle and/or external conditions of the vehicle.
    12. Apparatus according to any preceding claim, wherein at least some of the data relating to the surroundings is updated at a predetermined 30 rate.
    ] 3. Apparatus according to claim 12, wherein the illumination intensity pattern is modified at a predetermined rate on the basis of the updated data relating to the surroundings.
    5 14. Apparatus according to any preceding claim, wherein no dedicated source of infra red radiation is associated with the infra red camera.
    ]5. Apparatus according to any preceding claim, wherein the infra red camera includes a visible light filter.
    ] 6. Apparatus according to any preceding claim, wherein the illumination intensity pattern projector includes an infra red filter.
    17. Apparatus according to any preceding claim, wherein the 15 projector includes an array of liquid crystal elements for modulating light.
    18. Apparatus according to any preceding claim, further comprising a noninteractive pro jector for illuminating the surroundings, such as a headlight.
    19. Apparatus according to claim 21, wherein the apparatus associated with the non-interactive projector includes an infra red filter.
    20. Apparatus according to any preceding claim, comprising a 25 further infra red camera generating data representing a further two dimensional thermal image scene.
    21. Apparatus according to any preceding claim, wherein the data processing system is arranged to process data representing the thermal image 30 scene, from at least two infra red cameras, to generate distance data relating to a feature of the thermal image scene.
    ]8 22. Apparatus according to claim 2], wherein the data processing system is adapted to process the distance data from a sequence of thermal image scenes to generate movement data relating to a feature of the thermal image scene.
    . 23. Apparatus according to any preceding claim, composing a further projector for projecting the illumination intensity pattern onto the surroundings. ] O 24. Apparatus according to any preceding claim, wherein said apparatus is adapted to be mounted on a vehicle.
    25. A vehicle comprising apparatus according to any preceding claim. ]5 26. Apparatus for the illumination of surroundings substantially as hereinbefore described with reference to the drawings.
GB0324442A 2002-11-06 2003-10-20 Interactive lighting system Expired - Lifetime GB2395390B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB0225839.0A GB0225839D0 (en) 2002-11-06 2002-11-06 Interactive lighting system

Publications (3)

Publication Number Publication Date
GB0324442D0 GB0324442D0 (en) 2003-11-19
GB2395390A true GB2395390A (en) 2004-05-19
GB2395390B GB2395390B (en) 2006-01-04

Family

ID=9947283

Family Applications (2)

Application Number Title Priority Date Filing Date
GBGB0225839.0A Ceased GB0225839D0 (en) 2002-11-06 2002-11-06 Interactive lighting system
GB0324442A Expired - Lifetime GB2395390B (en) 2002-11-06 2003-10-20 Interactive lighting system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GBGB0225839.0A Ceased GB0225839D0 (en) 2002-11-06 2002-11-06 Interactive lighting system

Country Status (1)

Country Link
GB (2) GB0225839D0 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005090123A1 (en) * 2004-03-18 2005-09-29 Robert Bosch Gmbh Method and device for improving the visibility in a vehicle
WO2006048559A1 (en) * 2004-11-05 2006-05-11 Tietronix Optics Motor vehicle low-beam headlight system
FR2877892A1 (en) * 2004-11-18 2006-05-19 Valeo Vision Sa Headlamp`s automatic commutation controlling method for motor vehicle, involves processing images for detecting traffic condition to commute headlamps from high beam state to low beam state, and controlling headlamps to low beam state
EP1780462A1 (en) * 2005-10-25 2007-05-02 Valeo Vision Process for modulated illumination of a road and headlamp using this process
DE102007053138A1 (en) * 2007-11-08 2009-01-29 Adc Automotive Distance Control Systems Gmbh Relevant surrounding object e.g. pedestrian, displaying device for vehicle, has controller connected with sensor system for surrounding detection over uni-directional data exchange device
WO2009112910A1 (en) * 2008-03-12 2009-09-17 Toyota Jidosha Kabushiki Kaisha Vehicle lighting device and lighting method
GB2463025A (en) * 2008-08-28 2010-03-03 Sharp Kk Method of and apparatus for acquiring an image
US7782184B2 (en) 2005-09-06 2010-08-24 Gm Global Technology Operations, Inc. Method and system for improving traffic safety
EP1841216A3 (en) * 2006-03-29 2011-11-23 LG Electronics Inc. Image pickup device, projector including the image pickup device, and image pickup method
EP2631122A1 (en) * 2012-02-24 2013-08-28 Koito Manufacturing Co., Ltd. Headlamp apparatus and headlamp control system
EP2636561A1 (en) * 2012-03-06 2013-09-11 Honda Motor Co., Ltd. Light distribution control apparatus
EP2562044A3 (en) * 2011-08-23 2014-04-23 Robert Bosch Gmbh Method for controlling a light emission of a headlamp of a vehicle
US9199574B2 (en) 2012-09-11 2015-12-01 Gentex Corporation System and method for detecting a blocked imager
DE102014008743A1 (en) * 2014-06-12 2015-12-17 Audi Ag Headlamp leveling for a motor vehicle headlamp
DE102014223913A1 (en) * 2014-11-25 2016-05-25 Conti Temic Microelectronic Gmbh Method and device for automatically adjusting a headlamp of a vehicle
DE102015012023A1 (en) * 2015-09-21 2017-03-23 Audi Ag Method for operating a lighting device of a motor vehicle and associated motor vehicle
DE102015016375A1 (en) * 2015-12-17 2017-06-22 Audi Ag System and method for object-based control of a high-resolution headlight for a motor vehicle
DE102015016333A1 (en) * 2015-12-15 2017-06-22 Audi Ag Controlling an adjustable headlight of a motor vehicle
WO2017174173A1 (en) * 2016-04-06 2017-10-12 Daimler Ag Method and apparatus for illuminating vehicle surroundings
DE102019005676A1 (en) * 2019-08-13 2020-08-13 Daimler Ag Method for operating a lighting device of a motor vehicle

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101652110B1 (en) * 2009-12-03 2016-08-29 엘지전자 주식회사 Controlling power of devices which is controllable with user's gesture

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4591918A (en) * 1983-04-18 1986-05-27 Omron Tateisi Electronics Co. Image sensor system
GB2334401A (en) * 1996-12-09 1999-08-18 Herbert D Zeman Contrast enhancing illuminator

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4591918A (en) * 1983-04-18 1986-05-27 Omron Tateisi Electronics Co. Image sensor system
GB2334401A (en) * 1996-12-09 1999-08-18 Herbert D Zeman Contrast enhancing illuminator

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7667585B2 (en) 2004-03-18 2010-02-23 Robert Bosch Gmbh Method and device for improving visibility in a vehicle
WO2005090123A1 (en) * 2004-03-18 2005-09-29 Robert Bosch Gmbh Method and device for improving the visibility in a vehicle
WO2006048559A1 (en) * 2004-11-05 2006-05-11 Tietronix Optics Motor vehicle low-beam headlight system
FR2877892A1 (en) * 2004-11-18 2006-05-19 Valeo Vision Sa Headlamp`s automatic commutation controlling method for motor vehicle, involves processing images for detecting traffic condition to commute headlamps from high beam state to low beam state, and controlling headlamps to low beam state
US7782184B2 (en) 2005-09-06 2010-08-24 Gm Global Technology Operations, Inc. Method and system for improving traffic safety
FR2894905A1 (en) * 2005-10-25 2007-06-22 Valeo Vision Sa METHOD OF LIGHTING MODULE OF A ROAD AND PROJECTOR OF A VEHICLE IMPLEMENTING SAID METHOD
EP1780462A1 (en) * 2005-10-25 2007-05-02 Valeo Vision Process for modulated illumination of a road and headlamp using this process
EP1841216A3 (en) * 2006-03-29 2011-11-23 LG Electronics Inc. Image pickup device, projector including the image pickup device, and image pickup method
DE102007053138A1 (en) * 2007-11-08 2009-01-29 Adc Automotive Distance Control Systems Gmbh Relevant surrounding object e.g. pedestrian, displaying device for vehicle, has controller connected with sensor system for surrounding detection over uni-directional data exchange device
WO2009112910A1 (en) * 2008-03-12 2009-09-17 Toyota Jidosha Kabushiki Kaisha Vehicle lighting device and lighting method
US9013058B2 (en) 2008-03-12 2015-04-21 Toyota Jidosha Kabushiki Kaisha Vehicle lighting device and lighting method
GB2463025A (en) * 2008-08-28 2010-03-03 Sharp Kk Method of and apparatus for acquiring an image
EP2562044A3 (en) * 2011-08-23 2014-04-23 Robert Bosch Gmbh Method for controlling a light emission of a headlamp of a vehicle
US9545875B2 (en) 2011-08-23 2017-01-17 Robert Bosch Gmbh Method for controlling a light emission of a headlight of a vehicle
CN103292237B (en) * 2012-02-24 2015-09-23 株式会社小糸制作所 Front lamp device and headlamp control system
EP2631122A1 (en) * 2012-02-24 2013-08-28 Koito Manufacturing Co., Ltd. Headlamp apparatus and headlamp control system
CN103292237A (en) * 2012-02-24 2013-09-11 株式会社小糸制作所 Headlamp apparatus and headlamp control system
EP2636561A1 (en) * 2012-03-06 2013-09-11 Honda Motor Co., Ltd. Light distribution control apparatus
US9037343B2 (en) 2012-03-06 2015-05-19 Honda Motor Co., Ltd Light distribution control apparatus and light distribution control method
US9199574B2 (en) 2012-09-11 2015-12-01 Gentex Corporation System and method for detecting a blocked imager
DE102014008743A1 (en) * 2014-06-12 2015-12-17 Audi Ag Headlamp leveling for a motor vehicle headlamp
DE102014223913A1 (en) * 2014-11-25 2016-05-25 Conti Temic Microelectronic Gmbh Method and device for automatically adjusting a headlamp of a vehicle
DE102015012023A1 (en) * 2015-09-21 2017-03-23 Audi Ag Method for operating a lighting device of a motor vehicle and associated motor vehicle
DE102015016333A1 (en) * 2015-12-15 2017-06-22 Audi Ag Controlling an adjustable headlight of a motor vehicle
DE102015016375A1 (en) * 2015-12-17 2017-06-22 Audi Ag System and method for object-based control of a high-resolution headlight for a motor vehicle
WO2017174173A1 (en) * 2016-04-06 2017-10-12 Daimler Ag Method and apparatus for illuminating vehicle surroundings
DE102019005676A1 (en) * 2019-08-13 2020-08-13 Daimler Ag Method for operating a lighting device of a motor vehicle

Also Published As

Publication number Publication date
GB2395390B (en) 2006-01-04
GB0324442D0 (en) 2003-11-19
GB0225839D0 (en) 2002-12-11

Similar Documents

Publication Publication Date Title
GB2395390A (en) Active projection system
CN110682856B (en) Vehicle with a vehicle body having a vehicle body support
US20060038959A1 (en) Adaptive and interactive scene illumination
CN108302477B (en) Headlamp apparatus for vehicle
KR20180070750A (en) Pixel light head lamp for vehicle
JP7034718B2 (en) Display device for vehicles
US9616805B2 (en) Method and device for controlling a headlamp of a vehicle
DE102009020910A1 (en) Headlight system for use in driver assistance system of vehicle, has light source whose light is radiated through image generator, where transmission rate of generator is changeable depending on objects in surrounding field of vehicle
WO2020067337A1 (en) Illuminating lamp for vehicle
JP2019077348A (en) Headlamp device for vehicle
JP6391347B2 (en) Vehicle display system
CN210637972U (en) Vehicle headlamp
DE102016211653A1 (en) Headlight assembly for a motor vehicle and motor vehicle with a headlight assembly
EP4129760A1 (en) Vehicle headlight
JP2017206104A (en) Vehicular lighting fixture
CN111077721B (en) Vehicle lamp projection device and projection method thereof
KR20170080240A (en) The Lamp For Vehicle
WO2022196296A1 (en) Vehicle lamp control device, vehicle lamp control method and vehicle lamp system
US20210114511A1 (en) Lighting device
DE102022120320A1 (en) ADAPTIVE LIGHT SOURCE WITH SPATIAL LIGHT MODULATOR
KR20170081018A (en) Lamp for vehicle
US11465552B2 (en) Method for obtaining an image of an object to be classified and associated system
WO2024057975A1 (en) Vehicle headlight