DE102018218479A1 - VEHICLE CONTROL - Google Patents

Abstract

A method of controlling a source of illumination associated with a controller disposed in a vehicle. The method includes detecting a hand of a vehicle occupant within a volume of space within the vehicle cabin; determining the relative position of the detected hand with respect to the control device; and controlling the illumination source in response to a distance between at least a portion of the hand and the controller that is less than or equal to a predefined threshold distance.

Description

TECHNICAL AREA

The present disclosure relates to a vehicle controller. Aspects of the invention relate to a controller for controlling a source of illumination associated with a controller disposed in a vehicle cabin, to a vehicle including the controller, to a system for controlling a source of illumination associated with the controller disposed in a vehicle cabin, and a method of controlling a source of illumination associated with a controller disposed in a vehicle.

STATE OF THE ART

Current vehicles, particularly automobiles, are often configured to illuminate control devices such as switches and other controls located within the vehicle cabin during low light conditions, for example, at night. This helps the vehicle occupants to locate and operate the control devices. To assist operation, it is common for each control device located in the vehicle cabin to be provided with an illumination source configured to automatically illuminate the control device in response to a control signal. In some known applications, the control signal may be generated in response to activation of the vehicle headlights. The activation of the vehicle headlights is considered as an indication that the vehicle is operated in low light conditions. Similarly, it is known that the illumination source of the control device is automatically activated in response to an ambient light sensor to indicate that the vehicle is operating in low light conditions.

A disadvantage associated with the above-mentioned prior art solutions is that either all control devices or none of them are illuminated. Accordingly, the performance requirements associated with the prior art solutions are significant and cause a significant load on the battery resources.

It is an object of at least certain embodiments of the present invention to improve the disadvantages associated with the prior art, and in particular to reduce the power requirements for illuminating control devices in the vehicle cabin.

BRIEF SUMMARY OF THE INVENTION

Aspects and embodiments of the invention provide: a method, a computer-readable medium, a controller, a system, and a method as claimed in the appended claims.

In accordance with one aspect of the present invention, a method for controlling a lighting source associated with a control device disposed in a vehicle is provided. The method may include detecting a hand of a vehicle occupant within a volume of space within the vehicle cabin; determining the relative position of the detected hand with respect to the control device; and controlling the illumination source in response to a distance between at least a portion of the hand and the controller that is less than or equal to a predefined threshold distance.

In this way, it is possible to selectively illuminate individual controllers, depending on whether the hand of a vehicle occupant is within a predefined threshold distance of the desired controller. This avoids the problem that all control devices must be illuminated and reduces the battery power consumption. Another advantage is that the dazzling effect is reduced within the vehicle cabin, which is particularly advantageous when driving in poorly lit environments such as at night.

The relative position of the detected hand may be determined directly or indirectly with respect to the control device, for example by determining the position of the detected hand with respect to a particular origin.

The method may include determining the relative position of the hand with respect to a control approach limit associated with the control device, the control proximity limit defining a limit deviation from the controller by the predefined limit distance, and the illumination source depending on the position of at least one Part of the hand controls that cuts the control approach limit. The proximity limit may define a volume of space adjacent to the controller, and depending on whether the hand of the vehicle occupant is at or within the vicinity of the limit, the source of illumination may be controlled.

The illumination source may have an ON state in which the illumination source is active and an OFF state in which the illumination source is active Lighting source is not active, include. The method may include activating the illumination source when the illumination source is in the OFF state, depending on the distance between at least a portion of the hand and the control device being less than or equal to the predefined threshold distance; and / or disabling the illumination source when the illumination source is in the ON state depending on the distance between at least a portion of the hand and the control device being greater than or equal to the predefined threshold distance. In this way, advantageously, the lighting source of the control device can be either activated or deactivated as needed without requiring physical contact with the control device. In this way it is also possible to activate or deactivate the illumination source without the driver having to divert his view from the road.

In certain embodiments, the method may include monitoring the relative position of the hand with respect to the control device and varying an intensity of the illumination associated with the illumination source depending on the relative position of the hand with respect to the control device. This may include, for example, increasing the intensity of the illumination in response to a reduction in a distance associated with the relative position of the hand with respect to the controller. Similarly, this may include decreasing the intensity of the illumination in response to an increase in a distance associated with the relative position of the hand with respect to the controller. This provides a convenient way to vary the intensity of the illumination without requiring physical contact with the control device or any other device.

The method may include determining whether the hand is the left or right hand of the vehicle occupant, and controlling the illumination source depending on whether the hand is the left or right hand of the vehicle occupant. This can be accomplished by determining whether the palm within the volume of space is oriented up or down relative to the control device, and depending on the orientation of the hand, it is determined whether the hand is the left or right hand of the vehicle occupant , In this way, it is possible to control the operation of the illumination source depending on whether the hand is a left or right hand.

The method may include determining whether the hand is a hand of a first occupant of the vehicle or a second occupant of the vehicle, and controlling the source of illumination depending on who owns the hand.

The method may include determining whether the hand is a driver's hand of the vehicle or an occupant of the vehicle and the source of illumination depending on who owns the hand. In this way, it is advantageously possible to selectively restrict the control of the illumination source depending on which vehicle occupant's hand belongs. This can be particularly advantageous if the driver of a vehicle does not want a vehicle occupant to disturb the illumination sources of a specific control device.

The method may include determining a direction of entry of the hand into the volume of space relative to the controller. The direction of entry of the hand may indicate to which vehicle occupant the hand belongs and therefore provides a convenient way of identifying who owns the hand, which in turn may be used to selectively restrict the control of the illumination source to a particular vehicle occupant.

In certain embodiments, the method of obtaining image data of the hand within the volume of space may include receiving a hand-reflected reflectance signal, determining a distance of the hand from a particular origin in response to the reflectance signal; and determining the relative position of the detected hand relative to the control device in dependence on the distance of the hand relative to the particular origin, the obtained image data, and a known distance of the control device relative to the particular origin. For example, the time required for the reflectance signal to be measured by a receiver is proportional to the distance of the hand from the sensor and therefore provides a convenient path for range information associated with the position of the hand to be received. In this way, it is possible to determine the distance of the hand from the control device based on a two-dimensional image of the hand relative to the control device and the distance information of the hand. This greatly simplifies the hardware required to perform the method and, in particular, avoids the need to use a complex system of two or more cameras, each of which is configured to acquire different perspective images of the hand relative to the control device from which the removal can be determined by the hand relative to the control device.

In certain embodiments, the particular origin may coincide with the position of an image capture device.

According to a further aspect of the invention, a controller for controlling a lighting source is provided, which is associated with a control device arranged in a vehicle cabin. The controller may include an input configured to receive image data obtained via an image capture device, a processor, and an output. The processor may be operatively arranged to: detect a hand of a vehicle occupant from the image, wherein the hand is within a volume of space in the vehicle cabin in which the image data is obtained by the image capture device; and determining a position of the hand with respect to the control device. The output may be operable to output a control signal to the illumination source in response to a distance between at least a portion of the hand and the controller that is less than or equal to a predefined threshold distance. The present control device benefits from the same advantages as set forth in relation to the previous aspect of the invention.

The processor may be operatively arranged to determine the position of the hand with respect to a control approach limit associated with the control device, the control approach limit defining a limit deviation from the control device by the predefined threshold distance. The output may be operable to output the control signal in response to the position of at least a portion of the hand that intersects the control proximity limit.

The processor may be configured to recognize the hand-in-picture data associated with a sequence of images captured by the image capture device, the sequence of images comprising two or more image frames; and determine if the position of the hand with respect to the control varies in the sequence of images. The output may be operable to output a control signal configured to vary an illumination intensity of the illumination source in response to the determined change in the position of the hand relative to the control device. The output may be operable to output a control signal configured to increase the intensity of the illumination in response to a decrease in a distance associated with the position of the hand with respect to the controller. The output may be operable to output a control signal configured to reduce the intensity of the illumination in response to an increase in a distance associated with the position of the hand with respect to the controller.

The processor may be operatively arranged to determine whether the hand is the left or right hand of the vehicle occupant; and the output may be operable to output the control signal depending on whether the hand is the left or right hand of the vehicle occupant.

The processor may be arranged to determine whether the palm is oriented up or down within the volume of space relative to the controller; and determining whether the hand is the left or right hand of the vehicle occupant, depending on the orientation of the hand.

The processor may be operatively arranged to determine whether the hand is a hand of a first occupant of the vehicle or a second occupant of the vehicle, and the output may be operable to issue the control signal in response to who the hand is belongs.

The processor may be arranged to determine whether the hand is a hand of a driver or a passenger of the vehicle; and the output may be arranged in operation to output the control signal depending on who owns the hand.

The processor may be operatively arranged to determine a direction of entry of the hand into the volume of space relative to the control device.

In certain embodiments, the input may be configured to receive data from a 3D imaging device configured to generate a three-dimensional model of the hand of the vehicle occupant disposed within a volume of space in the vehicle cabin. The processor may be configured to determine the relative position of the hand with respect to the control device from the three-dimensional model.

In certain embodiments, the input may be configured to receive data from a time of flight imaging device (TOF) that includes a sensor. The TOF image capture device may be arranged in operation to obtain image data of the hand to illuminate the hand and a return time of a reflected Measuring the illumination signal, wherein the time of return of the reflected illumination signal is proportional to the distance of the hand from the sensor. The data may include the image data and the time of return of the reflected illumination signal. The processor may be operatively arranged to determine the relative position of the hand with respect to the control device in dependence on the determined distance of the hand from the sensor, the obtained image data, and a known distance of the control device relative to the sensor, wherein the distance Hand is determined by the sensor in response to the return time of the reflected illumination signal. The TOF image capture device provides a convenient means for obtaining image data associated with image object distance data, and therefore simplifies determining the removal of the hand from the control device.

According to yet another aspect of the invention, there is provided a system for controlling a source of illumination associated with a control device disposed in a vehicle cabin. The system may include the above-mentioned controller and an image capture device. Optionally, the image capture device may include a runtime image capture device (TOF).

In certain embodiments, the system may include the illumination source. The illumination source may be arranged to provide the control device with a backlight function.

In accordance with still another aspect of the invention, there is provided a vehicle comprising the aforementioned controller or system.

In accordance with yet another aspect of the invention, there is provided a vehicle configured to perform the aforementioned method.

In accordance with yet another aspect of the invention, there is provided a computer program product comprising instructions for carrying out the aforementioned method.

The computer program product may include instructions that, when executed on a processor, configure the processor to: detect a hand of a vehicle occupant within a volume of space within the vehicle cabin; determine the relative position of the detected hand with respect to the control device; and control the illumination source in response to a distance between at least a portion of the hand and the controller being less than or equal to a predefined threshold distance.

According to yet another aspect of the invention, there is provided a computer readable medium having stored thereon instructions for carrying out the aforementioned method. Optionally, the computer readable medium comprises a non-transitory computer readable medium.

The data carrier may include instructions that, when executed on a processor, configure the processor to: detect a hand of a vehicle occupant within a volume of space in the vehicle cabin; determine the relative position of the detected hand with respect to the control device; and control the illumination source in response to a distance between at least a portion of the hand and the controller being less than or equal to a predefined threshold distance.

Within the scope of this application, it is expressly intended that the various aspects, embodiments, examples, and alternatives set forth in the preceding paragraphs, claims, and / or description and drawings, and in particular, their individual features, be independent of each other or in any combination. This means that all embodiments and / or features of any embodiment can be combined in any manner and / or as any combination, provided that these features are not incompatible. The Applicant reserves the right to change any originally filed claim or to submit any new claim, including the right to alter any originally filed claim, to depend on and / or disclaim any feature of any other claim although it was previously unclaimed in this way.

list of figures

• 1 ist eine schematische Schnittdarstellung eines vorderen Teils einer Fahrzeugkabine mit einer Kamera, die ein Sichtfeld aufweist, das angeordnet ist, um Bilddaten einer Hand eines Fahrzeuginsassen innerhalb eines Raumvolumens innerhalb einer Fahrzeugkabine zu erhalten;
• 2 ist eine schematische, vergrößerte Darstellung eines Teils des Bedienfelds der Fahrzeugkabine von 1, die Steuerungsvorrichtungen zeigt, die in Abhängigkeit von einem relativen Abstand zwischen mindestens einem Teil der Hand des Fahrzeuginsassen und den Steuerungsvorrichtungen beleuchtet werden;
• 3 ist eine schematische Darstellung einer Steuerung, die konfiguriert ist, um den Betrieb einer Beleuchtungsquelle zu ermöglichen, die mit einer in der Fahrzeugkabine von 1 angeordneten Steuerungsvorrichtung assoziiert ist;
• 4 ist ein Prozessflussdiagramm, das ein Verfahren zum Aktivieren einer Beleuchtungsquelle, die mit einer Steuerungsvorrichtung in einer Fahrzeugkabine assoziiert ist, in Abhängigkeit von der Nähe einer Hand zu der Steuerungsvorrichtung unter Verwendung der Kamera von 1 umreißt;
• 5 ist eine schematische Darstellung, die das Funktionsprinzip einer Laufzeitkamera (TOF-Kamera) hervorhebt, die verwendet werden kann, um die Position der Hand eines Fahrzeuginsassen in der Fahrzeugkabine von 1 zu bestimmen;
• 6a und 6b sind schematische Darstellungen, die eine dreidimensionale Punktewolke einer Hand eines Fahrzeuginsassen zeigen, die unter Verwendung der TOF-Kamera von 5 erzeugt wurde; und
• 7 ist eine schematische Darstellung eines Fahrzeugs, das die Kamera von 1 und die Steuerung von 3 umfasst.

One or more embodiments of the invention will now be described by way of example only with reference to the accompanying drawings, in which:

• 1 is a schematic sectional view of a front part of a vehicle cabin with a camera having a field of view, which is arranged to image data of a hand of a vehicle occupant within a To obtain room volume within a vehicle cabin;
• 2 is a schematic, enlarged view of a portion of the control panel of the vehicle cabin of 1 showing control devices that are illuminated in response to a relative distance between at least a portion of the hand of the vehicle occupant and the control devices;
• 3 FIG. 12 is a schematic illustration of a controller configured to enable the operation of a lighting source associated with a vehicle cabin of FIG 1 arranged control device is associated;
• 4 FIG. 3 is a process flow diagram illustrating a method of activating a source of illumination associated with a control device in a vehicle cabin, in response to the proximity of a hand to the controller using the camera of FIG 1 outlines;
• 5 FIG. 12 is a schematic diagram highlighting the operation principle of a time-of-flight camera (TOF camera) that can be used to determine the position of the hand of a vehicle occupant in the vehicle cabin of FIG 1 to determine;
• 6a and 6b 12 are schematic diagrams showing a three-dimensional point cloud of a hand of a vehicle occupant using the TOF camera of FIG 5 was generated; and
• 7 is a schematic representation of a vehicle that the camera of 1 and the control of 3 includes.

DETAILED DESCRIPTION

1 is a cutaway perspective view of a portion of the vehicle cab 1 and in particular shows the driver 3 in the driver's seat 5 sitting. An image capture device in the form of a camera 7 that a field of vision 9 that is in 1 through lines 11 is sketched, is shown arranged in the cabin roof. Optionally, the camera 7 include a TOF camera. The camera 7 is arranged so that it depicts objects that are within the field of view 9 the camera. The field of view defines a volume of space within the vehicle cabin within which objects pass through the camera 7 be imaged. The camera 7 is arranged such that a control panel 13 of the vehicle 1 within the field of view 9 the camera is lying. The control panel 13 includes a variety of different control devices 15 which may relate to, but are not limited to: air ventilation switches; C switch; Vehicle infotainment system; Recirculation switch; and any other control device configured to operate a control system of the vehicle. Every control device 15 can with its own lighting source 16 (please refer 2 ) arranged to illuminate the control device to facilitate operation in poor ambient lighting conditions. For example, in many cases, the illumination source may be configured to provide a backlight function. The vehicle cabin 1 can in the vehicle 43 from 7 be included.

2 shows an enlarged perspective view of a part of the control panel 13 of the vehicle 1 in which the lighting sources 16 that the three control devices 15 are activated to provide a backlight function. Activation of each source of illumination 16 is dependent on a relative distance between at least part of the hand of a vehicle occupant 17 and the associated control device 15 , This will be explained in more detail in the following description.

In certain embodiments, the camera 7 operational with a controller 19 (in 3 shown) and configured to receive image data from the camera 7 and receive a control signal to the illumination source 16 a specific control device 15 depending on an analysis of the received image data. This allows selective operation of the associated illumination source.

3 provides a functional overview of the controller 19 , The control 19 Can be functional in an existing electronic control unit of the vehicle 1 be embedded. The control 19 can with an entrance 21 and an exit 23 be provided. The entrance 21 can be configured to receive image data from the camera 7 be obtained, and the output 23 may be configured to provide a control signal to the illumination source 16 to spend with a given control device 15 is associated. In addition, the controller includes 19 a processor 25 which is arranged to move from the camera 7 analyze received image data to image objects such as the hand 17 of a vehicle occupant within the obtained image data, and control signals for controlling the operation of the illumination sources 16 the associated control devices 15 depending on the relative position of the hand 17 in relation to the control devices 15 to create.

In use, when the hand 17 a vehicle occupant from the camera 7 is detected, and their position relative to a control device 15 through the controller 19 is determined, typically by the processor 25 the controller 19 , can the lighting source 16 the associated control device 15 automatically from the controller 19 via a control signal to the illumination source 16 is output, that of the desired control device 15 is assigned to be activated. For example, in this way the illumination source 16 to be activated, that of the control device 15 is associated, in terms of the hand 17 of the depicted vehicle occupant is determined to be closest. This means that the controls 15 associated illumination sources 16 that the vehicle occupant wants to operate, are selectively and individually operable.

In certain embodiments, the controller may 19 be configured to control the control signal in dependence on a distance between at least a part of the hand 17 a vehicle occupant and the desired control device 15 output that is less than or equal to a predefined threshold distance. For example, if the camera 7 Image data of a hand of a vehicle occupant, such. B. the hand of the driver 17 , picks up, can control 19 configured to identify the image of the hand within the received image data. From the obtained image data can then the relative position of the imaged hand to a desired control 15 be determined. To identify an image of a hand, the controller can 19 and especially the processor 25 configured with an image recognition software configured to be a hand of a vehicle occupant 17 that are within the field of view 9 the camera is to identify from received image data.

4 FIG. 10 is a process flow diagram illustrating the method used to control the operation of the illumination source in accordance with certain embodiments of the invention. FIG 16 connected to the control device 15 is connected in response to the proximity of the hand of a vehicle occupant to the control device 15 , using the camera 7 in operative connection with the controller 19 represents. The procedure is done by the camera 7 initiated in step 301 Image data in the vehicle cabin 1 receives. In certain embodiments, the camera 7 be configured to obtain the image data continuously or periodically to obtain image data having a predefined frequency. The obtained image data can be sent to the controller 19 be forwarded to analysis where in step 303 obtained image data can be analyzed to a hand 17 of a vehicle occupant within the obtained image data. As previously mentioned, this may include the use of image recognition software. Once the hand 17 of a vehicle occupant has been identified within the obtained image data, the position of the hand becomes 17 in step 305 relative to the control device 15 certainly. When the vehicle control panel 13 a plurality of different control devices 15 includes, the step 305 determining the position of the hand 17 relative to the next control device 15 include. The position of the hand 17 relative to the control device 15 can through the processor 25 be determined. In step 307 It determines if at least part of the hand 17 is at a distance which is less than or equal to a predefined threshold distance from the control device 15 is. If it is determined that no part of the hand is within the predefined threshold distance, the processor analyzes 25 further received image data, and the process returns to step 303 back. If instead by the processor 25 determining that at least a portion of the identified hand is within the predefined threshold distance of the control device 15 The processor generates in step 308 a control signal for output to the illumination source of the relevant control device. Upon receipt of the control signal, at step 310 the illumination source 16 the associated control device 15 activated.

In certain embodiments, the predefined threshold distance may refer to a few centimeters, for example any distance within the range of 1 cm to 10 cm, including 1 cm and 10 cm. In certain embodiments, the predefined threshold may be a control approach limit that the control device 15 surrounds and staggered to limit the predefined threshold distance, wherein the control approach limit, when crossed by at least a portion of the hand of the vehicle occupant, causes the controller 19 generates the control signal for output to the illumination source of the control concerned.

The control approach limit may be geometrically shaped. For example, the control approach limit may be box-shaped or spherically shaped. Effectively, the control proximity limit refers to a volume of space offset from the controller by the predefined threshold distance.

In response to crossing any part of the control approach boundary of at least a part of the hand of the vehicle occupant, the controller generates the control signal for activating the illumination source of the associated control device. It should be noted that not all of the parts of the control approach limit from the control device are around the predefined threshold distance must be offset. For example, if the control approach boundary is box-shaped (eg, cube-shaped), it should be noted that some areas of the cube may not be offset by the predefined threshold distance from the controller.

To allow the position of the hand 17 relative to the control device 15 is determined, the camera can 7 in certain embodiments relate to a 3D mapping control arranged to provide a 3D model of the hand within the field of view 9 to create. For example, the camera may be 7 in certain embodiments relate to a time-of-flight (TOF) camera in which each detected image pixel is associated with a distance based on a return time of a reflected illumination signal. To accomplish this, the TOF camera may be configured with an illumination source arranged to illuminate the field of view of the camera. The incident illumination signal is then reflected by objects present in the field of view of the camera and the time of return of the reflected illumination signal is measured. In this way it is possible to assign a distance measurement to each imaged object. The illumination signal may refer to any electromagnetic signal and need not be included in the visible spectrum. For example, in certain embodiments, the illumination signal may operate in the infrared spectrum.

In those embodiments in which the camera 7 includes a TOF camera, the controller can 19 and especially the input 21 be configured to receive both camera image data and image object distance information data from the TOF camera. This allows the controller 19 and especially the processor 25 , the position of the hand 17 the vehicle occupant relative to a control device 15 from the received data.

5 is a schematic diagram illustrating the working principle of a TOF camera 27 represents. A modulated illumination source 29 is used to a desired destination 31 to illuminate. The incident lighting 33 gets through the goal 31 reflected and on a sensor 35 detected comprising an array of pixels. However, while at the same time the reflected modulated light 37 is detected, capture the pixels of the sensor 35 also visible light reflected from the target. Because the lighting signal 33 It can be modulated by the visible light coming from the target 31 is reflected, which makes it possible to measure the duration of the modulated illumination signal. The runtime, which requires the modulated illumination signal to reach the destination 31 to meet and to the sensor 35 Being reflected back is measured when it is on the sensor 35 falls. In this way, each captured image pixel may be assigned a distance of the corresponding image object based on the measured transit time for that of the sensor 35 reflected modulated illumination signal to be measured 37 is required. More specific details regarding the operation of TOF cameras are widely used in the art, and for this reason a more detailed discussion is not necessary for the present purposes.

If the camera 7 from 1 a TOF camera 27 it is possible to generate a three-dimensional point cloud of the hand of the vehicle occupant, which is within the field of view 9 the camera is located. The 6a and 6b illustrate an example of a three-dimensional point cloud 39 the hand 17 of the vehicle occupant using the TOF camera 27 is produced. In certain embodiments, the controller may 19 be configured to use the three-dimensional point cloud using the TOF camera 27 received image data and image removal information. 6a shows a point cloud 39 the hand 17 of the vehicle occupant when approaching a rectangular control approach boundary 41 approaches. In 6b cuts a part of the point cloud 39 the hand 17 of the vehicle occupant a part of the control approach limit 41 , In this case and as previously mentioned, the controller is 19 configured to generate a control signal for activating the illumination source of the control device.

To the position of the hand 17 the vehicle occupant relative to a control device 15 to be able to determine the position of the control device 15 relative to the TOF camera. This can in turn be done using an image recognition software. Since the position of the control device 15 relative to the TOF camera 27 is known and the hand position of the vehicle occupants 17 relative to the TOF camera 27 is known, the hand position of the vehicle occupants 17 relative to the control device 15 vary with elemental trigonometry. In certain embodiments, and to facilitate calculation during use, the controller may 19 during an initial configuration of the TOF camera 27 with distance information from each control device 15 relative to the TOF camera 27 be provided. This distance information can be stored and retrieved for subsequent use when needed. This facilitates subsequent calculation of the position of the hand relative to the control device, as only the removal of the hand of the vehicle occupant 17 regarding the TOF camera 27 and the position relative to the known position of the control device 15 must be calculated.

In certain embodiments, the controller may 19 be configured as described in a similar manner, an activated illumination source, the control device 15 is assigned, depending on that disable the distance between at least part of the hand 17 the vehicle occupant and the control device 15 is less than the predefined threshold. In such embodiments, it is contemplated that the vehicle occupant may deactivate an activated illumination source by moving his hand to a distance that is less than or equal to the predefined threshold distance.

In alternative embodiments, the controller may 19 configured to be an activated illumination source associated with a control device 15 It is associated with deactivating that distance between at least a portion of the hand 17 the vehicle occupant and the control device 15 is greater than or equal to the predefined threshold distance. For example, it is provided that the illumination source, that of the control device 15 is activated, characterized in that the vehicle occupant positions his hand such that at least a portion of the hand on or within the predefined threshold distance of the control device 15 lies; it is also envisaged that the activated illumination source can be deactivated by placing the vehicle occupant's hand in a position relative to the associated control device 15 retracts at a distance from the control device 15 which is greater than the predefined threshold distance.

In certain embodiments, it is contemplated that once the illumination source has been activated, it remains activated for a predefined amount of time regardless of the position of the hand of the vehicle occupant relative to the control device. For example, if the vehicle occupant retracts his hand to no longer within the predetermined threshold distance, the illumination source remains activated for the predetermined amount of time prior to deactivation. The predefined period of time may be several seconds, eg. Twenty seconds.

In certain embodiments, the intensity of illumination may be an activated illumination source 16 that of the control device 15 is assigned to be varied when the distance between the hand 17 the vehicle occupant and the control device 15 changes. If, for example, at least a part of the hand of the vehicle occupant 17 is at a distance equal to the predefined threshold distance, the illumination source 16 to be activated. Another movement of the hand of the vehicle occupant in the direction of the control device 15 , reducing the distance between the hand 17 the vehicle occupant and the control device 15 is reduced, may cause the intensity of the associated illumination source 16 emitted illumination increases. One way in which this can be achieved is to have the controller 19 received image and distance data continuously analyzed and the output control signal adapts to the emitted illumination as a function of the distance between the hand of the vehicle occupant 17 and the controller 15 to reduce. Similarly, the controller 19 be adapted to output a control signal for reducing the emitted illumination when the hand of the vehicle occupant is withdrawn. In this case, if the distance between the hand 17 the vehicle occupant and the control device 15 increases, the output control signal causes the intensity of the illumination decreases. Once the hand 17 of the vehicle occupant at a distance from the control device 15 greater than the predefined threshold distance can be the illumination source 16 turned off. Alternatively, the illumination source 16 remain activated for a predetermined period of time at a minimum illumination setting before switching off.

In a further embodiment, the controller 19 be configured to determine from an analysis of the received camera image data, whether the hand 17 the vehicle occupant is the left or right hand of the occupant. The control 19 can then be configured to output the control signal depending on whether the hand 17 the left or right hand of the occupant is. In this way, it is possible to limit the illumination of selected controls within the vehicle cabin depending on whether the left or right hand of a vehicle occupant is attempting to illuminate the associated illumination source 16 to activate.

In certain embodiments, the controller may 19 be configured to determine if the hand 17 the vehicle occupant relative to the camera 7 oriented up or down, and depending on whether the hand is the left or right hand of the vehicle occupant 17 Palm is oriented up or down. This can be done on the basis of the reflection signal from the hand 17 and determined by image object analysis. The skin texture between a palm and the back of the hand is different, and the amount of incident light absorbed by the palm of the hand therefore differs from the amount absorbed by the back of the hand. Accordingly, by configuring the controller to analyze the intensity of the reflected signal indicative of the amount of incident light absorbed by the hand, it is possible for the controller to determine if the palm is facing up or down.

In certain embodiments, the controller may 19 configured to determine which vehicle occupant the imaged hand belongs to. For example, whether the pictured hand 17 belongs to a driver of the vehicle or to a passenger. The operation of the illumination source 16 can then be controlled depending on who owns the hand. For example, the operation of the illumination source 16 depending on the hand 17 the driver 3 controlled by the vehicle. This helps to prevent accidental activation of the illumination source 16 to prevent a control by a vehicle occupant.

A non-limiting way on which the controller 19 determine which vehicle occupant's hand belongs to, is a direction of entry of the hand into the field of view 9 the camera relative to the control device 15 to monitor and determine. This can be done through an analysis by the camera 7 received image data by the controller 19 be achieved. The direction of entry of the hand 17 in the field of view 9 The camera may indicate where the vehicle occupant is in relation to the control device 15 sits, and therefore represents a good assumption to which vehicle occupant's hand 17 belongs.

Another non-limiting way in which the controller 19 determine to which vehicle occupant the hand belongs is to determine from an analysis of the received camera image data, whether the hand 17 of the vehicle occupant is the left or right hand of an occupant, as in a preceding embodiment. This may be particularly useful for control devices located between two vehicle occupants occupying a common row of seats within the vehicle and pointing in the same direction, e.g. B. for control devices which are arranged between the passengers on the front. As a further explanation, in this example, a first occupant is most likely to manipulate the control devices with a left hand while a second occupant is most likely to operate the control devices with a right hand (or vice versa). In this way, the controller can distinguish between two vehicle occupants sitting side by side in the vehicle.

The non-limiting examples described above may be used independently or in combination to distinguish between multiple vehicle occupants and the operation of the illumination source 16 depending on who owns the hand.

While the foregoing embodiments of the invention have been described in the context of a TOF camera, it should be understood that alternative camera configurations may be used in accordance with the embodiments described herein. Any configuration of cameras may be used which allows image data of a hand to be obtained relative to a control device and to determine the position of the hand relative to the control device. For example, a configuration of two or more cameras each configured to provide another perspective image of the hand relative to the control device to be detected may also be used. In such an arrangement, the various perspective images of the hand relative to the control device would allow the controller to triangulate the position of the hand relative to the control device.

Similarly, in an alternative embodiment, the TOF camera of the previous embodiments may be replaced by a conventional camera in combination with an optical ruler such as a LIDAR. In such an embodiment, the LIDAR provides the image object removal information while the camera provides image data. The controller, in such embodiments, may be configured to analyze the LIDAR data in combination with the obtained image data to determine the position of the hand of the vehicle occupant relative to the control device.

Many changes may be made to the foregoing examples without departing from the scope of the present invention as defined by the appended claims.

Claims (12)

A method of controlling an illumination source (16) associated with a control device (15) disposed in a vehicle cabin (1), the method comprising: detecting a hand (17) of a vehicle occupant (3) within a volume of space (9) within the vehicle cabin (1); Determining the relative position of the detected hand (17) with respect to the control device (15); and Controlling the illumination source (16) in response to a distance between at least a portion of the hand (17) and the controller (15) that is less than or equal to a predefined threshold distance. Method according to Claim 1 method comprising: determining whether the hand (17) in the volume of space (9) is oriented up or down relative to the control device (15); Determining whether the hand (17) is the left or right hand of the vehicle occupant depending on the orientation of the hand (17); and controlling the illumination source (16) in accordance with whether the hand (17) is the left or right hand of the vehicle occupant. Method according to one of the preceding claims, comprising: Determining whether the hand (17) is a driver's hand of the vehicle or an occupant of the vehicle; and Controlling the illumination source (16) depending on who owns the hand. Method according to one of the preceding claims, comprising: Determining a direction of entry of the hand (17) into the volume of space (9) relative to the control device (15). Method according to one of the preceding claims, comprising: Obtaining image data of the hand (17) within the volume space (9); Receiving a reflection signal reflected by the hand (17); Determining a distance of the hand (17) from a particular origin in response to the reflection signal; and Determining the relative position of the detected hand (17) with respect to the control device (15) in dependence on the distance of the hand (17) relative to the particular origin, the obtained image data and a known distance of the control device (15) relative to the indicated origin ; optional, wherein the particular origin coincides with the position of an image capture device (7). A controller (19) for controlling an illumination source (16) associated with a controller (15) disposed in a vehicle cabin (1), the controller (19) comprising: an input (21) configured to receive image data obtained from an image capture device (7); a processor (25) disposed in use to: to recognize a hand (17) of a vehicle occupant (3) from the image data, wherein the hand (17) is located within a volume of space (9) within the vehicle cabin (1) within which the image data is obtained by the image. ; and determine a position of the hand (17) with respect to the control device (15); and an output (23) operatively arranged to output a control signal to the illumination source (16) in response to a distance between at least a portion of the hand (17) and the controller (15) that is less than or equal to the predefined threshold distance is. The controller (19) after Claim 6 wherein the processor (25) is arranged to determine whether the hand (17) is oriented up or down within the volume of space relative to the control device (15); Determining whether the hand (17) is the left or right hand of the vehicle occupant depending on the orientation of the hand (17); and the output (23) is arranged to output the control signal depending on whether the hand (17) is the left or right hand of the vehicle occupant. The controller (19) after Claim 6 or 7 wherein the processor (25) is arranged to determine whether the hand (17) is a hand of a driver or a passenger of the vehicle; and the output (23) is arranged to output the control signal depending on who owns the hand. The controller (19) according to one of Claims 6 to 8th wherein the processor (25) is arranged in use to provide a direction of entry of the hand (17) into the volume of space (9) relative to the control device (15). The controller (19) according to one of Claims 6 to 9 wherein: the input (21) is configured to receive data from a time of flight (TOF) image acquisition device (27) comprising a sensor (35), the TOF image capture device (27) being operable to receive image data from the hand (17) to illuminate the hand (17) and to measure a return time of a reflected illumination signal (37), wherein the return time of the reflected illumination signal (37) is proportional to a distance of the hand (17) to the sensor (35), and wherein the data includes the image data and the time of return of the reflected illumination signal; and wherein the processor (25) is arranged in use to adjust, in dependence on the determined distance of the hand (17) from the sensor (35), the relative position of the hand (17) with respect to the control device (15), and the obtained image data and a known distance of the control device (15) from the sensor (35), wherein the distance of the hand (17) from the sensor (35) in dependence on the return time of the reflected illumination signal (35) determined becomes. A vehicle (43) with the control of one of Claims 6 to 10 ; optionally with the vehicle (43) configured, the method of any of Claims 1 to 5 perform. A computer program product with instructions for performing the method according to any one of Claims 1 to 5 ; and / or a computer-readable medium carrying instructions for performing the method according to any one of Claims 1 to 5 are stored.

Images