WO2009038504A1 - Position detection arrangement and operating method for a position detection arrangement - Google Patents

Position detection arrangement and operating method for a position detection arrangement Download PDF

Info

Publication number
WO2009038504A1
WO2009038504A1 PCT/SE2007/000830 SE2007000830W WO2009038504A1 WO 2009038504 A1 WO2009038504 A1 WO 2009038504A1 SE 2007000830 W SE2007000830 W SE 2007000830W WO 2009038504 A1 WO2009038504 A1 WO 2009038504A1
Authority
WO
WIPO (PCT)
Prior art keywords
light source
driver
light
optical unit
mask device
Prior art date
Application number
PCT/SE2007/000830
Other languages
French (fr)
Inventor
Lars Andersson
Original Assignee
Volvo Lastvagnar Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volvo Lastvagnar Ab filed Critical Volvo Lastvagnar Ab
Priority to EP07808835A priority Critical patent/EP2193421B1/en
Priority to US12/676,365 priority patent/US20100182152A1/en
Priority to PCT/SE2007/000830 priority patent/WO2009038504A1/en
Priority to CN200780100708A priority patent/CN101802754A/en
Priority to BRPI0722019-7A priority patent/BRPI0722019A2/en
Publication of WO2009038504A1 publication Critical patent/WO2009038504A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/113Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Arrangement of adaptations of instruments
    • B60K35/213
    • B60K35/60
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/02Rear-view mirror arrangements
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00Measuring distances in line of sight; Optical rangefinders
    • G01C3/02Details
    • G01C3/06Use of electric means to obtain final indication
    • G01C3/08Use of electric radiation detectors
    • G01C3/085Use of electric radiation detectors with electronic parallax measurement
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B23/00Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/60Static or dynamic means for assisting the user to position a body part for biometric acquisition
    • G06V40/63Static or dynamic means for assisting the user to position a body part for biometric acquisition by static guides
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source

Definitions

  • the invention relates to a position detection arrangement, an optical unit for a position detection arrangement and an operating method for a position detection arrangement according to the preambles of the independent claims.
  • Determination of a driver head position in a vehicle is known in the art.
  • Information about the driver head position is necessary for e.g. systems comprising a head-up display for rendering optical information to the driver. It is known in the art to use video cameras for locating the position of the driver's eyes. According to this information, an appropriate area for displaying the information in the head-up display, e.g. on the windscreen, can be adjusted to the eyes' positions.
  • a position detection arrangement for a head position of a driver comprising an optical unit comprising at last one light source providing backlight directed to the driver and a mask device for blocking the light of the at least one light source when being arranged in an optical path between the at least one light source and the driver's head position, a manipulator device for accomplishing a relative movement between the at least one light source and a blocking member of the mask device, a computing unit coupled to the optical unit for capturing a distance between at least one of (a) two or more dedicated light-source positions, (b) two or more dedicated blocking member positions.
  • the computing unit can also be used for calculating a position of the driver's head based on an angle between the positions and the driver's head position.
  • the position of the at least one light source can be extracted from the optical unit as well as the position of the blocking member when blocking the light source.
  • an optical path or optical axis can be defined from the light source through the blocking member to the driver's eye yielding a well defined direction from the light source to the driver's head position.
  • the light source can be a light emitting diode (LED) which features a high illuminating power. This is beneficial if the adjustment of the relative positions of the light source and the mask device have to be made in bright daylight.
  • the blocking member can be a mechanical shield or an electronic member, such as an LCD screen area which can provide an optically nontransparent or at least light-damping spot which blocks the light of the at least one light source when moved over the at least one light source.
  • the arrangement is compact and can be preferably integrated in already existing equipment of the vehicle, e.g. an instrument panel. Existing components in the vehicle can be used. Additional installation space can be minimized.
  • the driver's head is in a normal position with respect to normal driving situations when calibrating the system by determining the position of the driver's head.
  • This installation space can be easily accessed by the driver as it is in the driver's field of vision. It is possible, however, to install the arrangement in other installation spaces which can be accessed by the driver, preferably when the driver's head is in a desired position, i.e. in a position which the driver takes during driving.
  • the manipulator can be coupled to the mask device for moving the blocking member of the mask device. This means that the at least one light source is fixed and the blocking member is moved until it overlaps the light source.
  • the manipulator can be anything suitable like a rocker switch or an electronic switch or a turning knob for moving the blocking member in the mask device to reach an overlapping position with the light source below the mask device.
  • the manipulator can be coupled to the light source for moving the light source.
  • the blocking member can be fixed and the light source is moved until the blocking member overlaps the light source.
  • Moving the light source can be a mechanical movement of the light source or activating light sources in an appropriately dense array of light sources.
  • the mask device can favourably comprise an LCD-screen providing an optically nontransparent dot for blocking the light of the at least one light source. Shifting the dot to a desired position, i.e. to overlap with the light source in the field of view of the driver can be easily accomplished by electrical means known in the art. By providing an appropriate voltage to the pixels of the LCD screen a "black dot" can be provided which can block the light of the light source behind the LCD screen.
  • the at least one light source can be integrated in an array of light sources, particularly a two dimensional array of light sources. This allows for selecting an appropriate position of the at least one light source to be switched on for calibration of the head position as well as successively selecting two or more light sources to improve the accuracy of the position detection. Only one light source is active when positioning the blocking member accordingly (or vice versa). It is possible to make two or more subsequent measurements when one eye locates the light source and the blocking member and record an average value of the measurements. For a single measurement, one light source or one light source position, respectively, is chosen for one eye, i.e. one light source/position for the left eye and another light source/position for the right eye.
  • This can be a right array for the right eye and a left array for the left eye if the optical unit exhibits two light source arrays.
  • a high accuracy can be obtained if the at least one light source and/or a position of the at least one light source can be selected in the left area of the optical unit for the right eye of the driver and in the right area of the optical unit for the left eye of the driver. This can be done by choosing the left light source array for the right eye and the right light source array for the left eye of the driver if the optical unit comprises two light source arrays.
  • a two-dimensional LED array enables space triangulation not only in a horizontal plane but also in a vertical plane for calculating the head position on all three dimensions.
  • an optical unit which provides at least one light source providing a backlight directed to the driver and a mask device for blocking the light of the at least one light source when being arranged in an optical path between the at least one light source and the driver's head position.
  • the optical unit provides a compact and easy-to-use arrangement.
  • the at least one light source can be arranged in an array of light sources. This allows for flexibility in the geometrical arrangement and for flexibility in ranges of drivers' head positions.
  • a selection unit e.g. a switch
  • a selection unit can be provided for selecting at least one light source in the array depending on an eye position of the driver and/or selecting an optically blocking member of the mask device.
  • the manipulator can be coupled to the mask device for moving the blocking member of the mask device. Additionally or alternatively, the manipulator can be coupled to the light source for moving the light source.
  • an area of the blocking member can smaller than a lighted area on the mask device which is illuminated by the at least one light source.
  • this embodiment allows for an arrangement that the driver recognizes the light source, when blocked by the blocking member, as a lighted ring around the blocking member, yielding a kind of a "dioptre" vision of the light source.
  • the human eye is sensible with respect to symmetries.
  • the mask device can favourably comprise an LCD-screen providing an optically absorbing or nontransparent dot for blocking the light of the at least one light source.
  • a preferred distance of at least 0.5 cm, preferably of at least 1 cm, can be arranged between the at least one light source and the mask device. This allows for a reasonable large parallax when the adjustment of light source and mask device is performed individually for each eye of the driver, resulting in a reasonable accuracy in determining the head position.
  • two light source arrays can be provided, with one array assigned to each one eye of the driver.
  • a method for operating a position detection arrangement for a head position of a driver is proposed, wherein the following calibration steps are performed for each eye of the driver:
  • an optical axis based on a relative orientation of the at least one light source and a respective blocking member of the mask device can be determined when blocking the light of the respective at least one light source
  • the head position can be easily be decided by determining an intersection of at least two optical axes based on said relative positions and the distance between the dedicated positions.
  • the head position particularly the eye position of the driver, is located in the area of the intersection. This position can be forwarded to vehicular devices for an head- up display or for an airbag system which uses the head position for improving the driver's safety when igniting the airbag.
  • a high accuracy can be obtained if the at least one light source and/or a position of the at least one light source cam be selected in the left area of the optical unit for the right eye of the driver and in the right area of the optical unit for the left eye of the driver. This can be done by choosing the left light source array for the right eye and the right light source array for the left eye of the driver if the optical unit comprises two light source arrays. However, it is possible to use one single array in the same way if the optical unit comprises only one single array.
  • the at least one light source and/or a position of the at least one light source can be determined depending on which eye is used for calibrating the position detection arrangement.
  • Fig. 1 a sketch of a principal setup of a preferred arrangement for detecting a position of a driver's head
  • Fig. 2 a preferred integration of a position detection arrangement for a head position of a driver in an instrument panel of a vehicle
  • Fig. 3 a side cut through a preferred embodiment of an optical unit for a position detection arrangement for a head position of a driver
  • Fig. 4a, b, c a top view on a preferred optical unit looking through a mask device placed over a light source array with a light source switched on (a) with an activated blocking member of a mask device moving towards a light spot of the light source, and with the blocking member in a blocking position blocking the light of the light source (c);
  • Fig. 5 a sketch for elucidating the computation of a head position.
  • FIG. 1 elucidates the way of functioning of the invention by depicting a preferred embodiment of the arrangement 100.
  • Fig. 2 depicts a preferred installation space of a preferred arrangement 100 for detecting a position of a driver's head in an instrument panel 10 of a vehicle where a manipulator 50 and a computing unit 60 are coupled to the optical unit 20.
  • the driver is looking onto an optical unit 20 which is preferably integrated into an instrument panel 10 of a vehicle, particularly of a light duty, medium or heavy duty commercial vehicle.
  • the optical unit 20 is in the normal field of vision of the driver at the steering wheel.
  • Position signals generated in the optical unit 20 are transmitted to a computing unit 60 which receives and evaluates position information of the optical unit 20 and extracts information from this position information for determining the head position.
  • the head position 80 is then transferred to other vehicular devices such as a head-up display which is readable by the driver when his head is in the detected position 80 or an airbag system, which can adjust to a driver's head position, which indirectly indicates the driver's size by the driver's head position.
  • a light source 32 particularly an LED, emits light as a backlight directed to the driver's eyes.
  • LCD liquid crystal display
  • An LCD screen is transparent when no voltage is applied to the liquid crystal elements and becomes nontransparent or at least light absorbing when a certain voltage is applied.
  • the light source 32 emits light in a light cone 24.
  • the driver moves the blocking member 42 (i.e. "black dot") by using the manipulator 50 to overlap the light spot of the light source 32. It is also possible to move the light spot and keep the blocking member 42 fixed.
  • an optical axis 22 can be determined between the light source 32, the blocking member 42 and the driver's eye. The same is repeated by the driver with the other eye by activating another light source (not shown). This results in two spatially separated positions of one light source per eye and two spatially separate positions of one blocking member 42 per eye and two optical axes 22 from the two positions towards the driver's eye.
  • the driver's eyes 82 represent the position 80 of the driver's head. The position 80 of the driver's head is calculated based on an angle between the spatially separate positions. Particularly, the position of the driver's eyes can be determined.
  • Fig. 3 depicts a side view of a cut through a preferred embodiment of an optical unit 20 for a position detection arrangement for a head position of a driver.
  • the light source 32 e.g. an LED
  • the light source 32 can be preferably integrated in an array 30 with a multitude of horizontally and vertically spaced light sources.
  • a mask device 40 e.g. an LCD screen, is arranged in a spatial distance 26 away from the array 30.
  • the light source 32 emits light typically in a light cone which appears as a light spot 34 on the mask device 40.
  • a typical diameter of the LED light source is ca. 1 mm, whereas the light spot 34 could be 4-5 mm on the mask device 40.
  • a reasonable value for the distance 26 provides a reliable parallax if the driver switches from one eye to the other looking onto the blocking member 42. With greater distance 26, the parallax becomes larger, i.e. if the driver looks with one eye at the blocking member 42, the position of the blocking member 42 apparently changes when looking with the other eye.
  • the distance 26 is large enough to yield a reasonable parallax which allows for a reliable head position calculation even if the optical unit is operated by an inexperienced user.
  • a favourable distance 26 can be at least 1 cm, favourably a value between 1 cm and 3 cm, particularly a value between 1 and 2 cm.
  • the blocking member 42 is smaller in diameter than the light spot 34. With the blocking member 42 in its blocking position (for one eye), the light spot 34 appears as a ring 36 around the blocking member 42.
  • This geometry makes use of the fact that the human eye is sensible to symmetries and the blocking member 42 can be arranged to overlap the light spot 34 with relatively high accuracy. A small shift would result in a clearly visible asymmetric appearance of the ring 36 and could be easily corrected.
  • Fig. 4a through 4c show top views on an optical unit 20 with an array 30 of light sources 32 (only one is denoted with a reference numeral for clarity).
  • the driver looks through the transparent mask device 40 onto the array 30.
  • one first light source 32 is switched on.
  • the light source 32 casts a light spot 34 on the mask device 40 (Fig. 4a).
  • a blocking member 42 is produced in the mask device 40 and moved towards the light spot 34 via manipulator 50 (Fig. 2) as indicated in Fig. 4b.
  • the driver can gauge the blocking member 42 in the centre of the light spot 34, thus producing a light ring 36 around the blocking member 42 (Fig. 4c).
  • another light source positioned spatially apart from the first light source 32 is switched on (not shown) and the blocking member 42 is moved to overlap the new light spot as described above.
  • Fig. 1 depicts a sketch for elucidating the computation of a driver's head position 84 with an optical unit 20 comprising a light source array 30 and a mask device 40.
  • the driver locates a light source 32r and moves a blocking member 42 of a mask device 40 arranged in front of a light source array 30 and between the array 30 and the driver over this light source 32r to block the light of the light source 32r shining towards the driver.
  • the position 72 of the light source 32r and the position 42rp of the blocking member 42 in the blocking position 42rp are recorded, e.g. in the computing unit 60 (Fig. 2).
  • the driver locates a spatially separated light source 321 with the left eye and blocks its light with the blocking member 42, e.g. moves the blocking member 42 from the blocking position 42rp to a position 42Ip where the light of the light source 321 shining towards the driver is blocked.
  • the positions 42Ip of the blocking member and the position 74 of the light source 421 are recorded, too.
  • the positions 72, 74 of the light sources 32r, 321 are known, their distance 70 is known.
  • the light sources 32r, 321 and the blocking positions 42rp, 42Ip define a right eye optical axis 22r and left eye optical axis 22r, which are inclined towards and intersect in the region of the driver's head.
  • the position of the two eyes can be merged in a single position with sufficient accuracy, yielding an angle ⁇ at the intersection 84.
  • the position of the driver's head compared with the optical unit 20 and the steering wheel can be determined.

Abstract

The invention relates to a method for operating a position detection arrangement, an optical unit for a position detection arrangement and a position detection arrangement for a head position (80) of a driver. The arrangement is characterized by an optical unit (20) comprising at least one light source (32, 32r, 321) providing backlight directed to the driver and a mask device (40) for blocking the light of the at least one light source (32, 32r, 321) when being arranged in an optical path (22, 22r, 221) between the at least one light source (32, 32r, 321) and the driver's head position (80); a manipulator device (50) for accomplishing a relative movement between the at least one light source (32, 32r, 321) and a blocking member (42) of the mask device (40); a computing unit (60) coupled to the optical unit (20) for capturing a distance (70) between at least one of (a) two or more dedicated light-source positions (72, 74), (b) two or more dedicated blocking member positions (42rp, 42Ip), and/or for calculating a position (80) of the driver's head based on an angle (α) between the positions (72, 74) and the driver's head position (80).

Description

Position detection arrangement and operating method for a position detection arrangement
The invention relates to a position detection arrangement, an optical unit for a position detection arrangement and an operating method for a position detection arrangement according to the preambles of the independent claims.
Determination of a driver head position in a vehicle is known in the art. Information about the driver head position is necessary for e.g. systems comprising a head-up display for rendering optical information to the driver. It is known in the art to use video cameras for locating the position of the driver's eyes. According to this information, an appropriate area for displaying the information in the head-up display, e.g. on the windscreen, can be adjusted to the eyes' positions.
In US 6,915,231 B1 an arrangement is disclosed where a rough estimation of a driver head position is extracted from inclination angles of the right and left external rear-view mirrors.
It is an object of the invention to provide an easy-to use and reliable position detection arrangement for a head position of a driver with an optical unit, as well as an appropriate optical unit for such an arrangement and an operating method for such an arrangement.
The objects are achieved by the features of the independent claims. The other claims and the description disclose advantageous embodiments of the invention.
A position detection arrangement for a head position of a driver is proposed, comprising an optical unit comprising at last one light source providing backlight directed to the driver and a mask device for blocking the light of the at least one light source when being arranged in an optical path between the at least one light source and the driver's head position, a manipulator device for accomplishing a relative movement between the at least one light source and a blocking member of the mask device, a computing unit coupled to the optical unit for capturing a distance between at least one of (a) two or more dedicated light-source positions, (b) two or more dedicated blocking member positions. The computing unit can also be used for calculating a position of the driver's head based on an angle between the positions and the driver's head position. Advantageously, the position of the at least one light source can be extracted from the optical unit as well as the position of the blocking member when blocking the light source. In this case, an optical path or optical axis can be defined from the light source through the blocking member to the driver's eye yielding a well defined direction from the light source to the driver's head position. Preferably, the light source can be a light emitting diode (LED) which features a high illuminating power. This is beneficial if the adjustment of the relative positions of the light source and the mask device have to be made in bright daylight.
The blocking member can be a mechanical shield or an electronic member, such as an LCD screen area which can provide an optically nontransparent or at least light-damping spot which blocks the light of the at least one light source when moved over the at least one light source.
The arrangement is compact and can be preferably integrated in already existing equipment of the vehicle, e.g. an instrument panel. Existing components in the vehicle can be used. Additional installation space can be minimized.
If the optical unit can be integrated in an instrument panel of a vehicle, the driver's head is in a normal position with respect to normal driving situations when calibrating the system by determining the position of the driver's head. This installation space can be easily accessed by the driver as it is in the driver's field of vision. It is possible, however, to install the arrangement in other installation spaces which can be accessed by the driver, preferably when the driver's head is in a desired position, i.e. in a position which the driver takes during driving.
The manipulator can be coupled to the mask device for moving the blocking member of the mask device. This means that the at least one light source is fixed and the blocking member is moved until it overlaps the light source. The manipulator can be anything suitable like a rocker switch or an electronic switch or a turning knob for moving the blocking member in the mask device to reach an overlapping position with the light source below the mask device.
Additionally or alternatively, the manipulator can be coupled to the light source for moving the light source. This means that the blocking member can be fixed and the light source is moved until the blocking member overlaps the light source. Moving the light source can be a mechanical movement of the light source or activating light sources in an appropriately dense array of light sources.
The mask device can favourably comprise an LCD-screen providing an optically nontransparent dot for blocking the light of the at least one light source. Shifting the dot to a desired position, i.e. to overlap with the light source in the field of view of the driver can be easily accomplished by electrical means known in the art. By providing an appropriate voltage to the pixels of the LCD screen a "black dot" can be provided which can block the light of the light source behind the LCD screen.
Advantageously, the at least one light source can be integrated in an array of light sources, particularly a two dimensional array of light sources. This allows for selecting an appropriate position of the at least one light source to be switched on for calibration of the head position as well as successively selecting two or more light sources to improve the accuracy of the position detection. Only one light source is active when positioning the blocking member accordingly (or vice versa). It is possible to make two or more subsequent measurements when one eye locates the light source and the blocking member and record an average value of the measurements. For a single measurement, one light source or one light source position, respectively, is chosen for one eye, i.e. one light source/position for the left eye and another light source/position for the right eye. This can be a right array for the right eye and a left array for the left eye if the optical unit exhibits two light source arrays. A high accuracy can be obtained if the at least one light source and/or a position of the at least one light source can be selected in the left area of the optical unit for the right eye of the driver and in the right area of the optical unit for the left eye of the driver. This can be done by choosing the left light source array for the right eye and the right light source array for the left eye of the driver if the optical unit comprises two light source arrays.
Additionally, a two-dimensional LED array enables space triangulation not only in a horizontal plane but also in a vertical plane for calculating the head position on all three dimensions.
According to another aspect of the invention, an optical unit is proposed which provides at least one light source providing a backlight directed to the driver and a mask device for blocking the light of the at least one light source when being arranged in an optical path between the at least one light source and the driver's head position. As elucidated above, the optical unit provides a compact and easy-to-use arrangement. The at least one light source can be arranged in an array of light sources. This allows for flexibility in the geometrical arrangement and for flexibility in ranges of drivers' head positions.
Favourably, a selection unit, e.g. a switch, can be provided for selecting at least one light source in the array depending on an eye position of the driver and/or selecting an optically blocking member of the mask device.
The manipulator can be coupled to the mask device for moving the blocking member of the mask device. Additionally or alternatively, the manipulator can be coupled to the light source for moving the light source.
In a preferred embodiment, an area of the blocking member can smaller than a lighted area on the mask device which is illuminated by the at least one light source.
Advantageously, this embodiment allows for an arrangement that the driver recognizes the light source, when blocked by the blocking member, as a lighted ring around the blocking member, yielding a kind of a "dioptre" vision of the light source. The human eye is sensible with respect to symmetries. By arranging the relative position of blocking member and active light source to yield a lighted ring around the blocking member, the blocking member can easily be adjusted with high accuracy without overburdening the driver with complicated fine tuning of the alignment.
The mask device can favourably comprise an LCD-screen providing an optically absorbing or nontransparent dot for blocking the light of the at least one light source.
A preferred distance of at least 0.5 cm, preferably of at least 1 cm, can be arranged between the at least one light source and the mask device. This allows for a reasonable large parallax when the adjustment of light source and mask device is performed individually for each eye of the driver, resulting in a reasonable accuracy in determining the head position.
According to a favourable embodiment, two light source arrays can be provided, with one array assigned to each one eye of the driver. According to another aspect of the invention, a method for operating a position detection arrangement for a head position of a driver is proposed, wherein the following calibration steps are performed for each eye of the driver:
- receiving light from at least one light source of an optical unit providing backlight directed to the driver;
- blocking the light with a mask device arranged in an optical path between the at least one light source and the driver's head position;
- using spatially different light sources for each eye;
- capturing a distance between at least one of the two two or more dedicated light-source positions, two or more dedicated blocking member positions; and
- calculating a position of the driver's head based on an angle between the positions and the driver's head position. This allows for an easy-to-use determination of the driver's head position.
Advantageously, an optical axis based on a relative orientation of the at least one light source and a respective blocking member of the mask device can be determined when blocking the light of the respective at least one light source
The head position can be easily be decided by determining an intersection of at least two optical axes based on said relative positions and the distance between the dedicated positions. The head position, particularly the eye position of the driver, is located in the area of the intersection. This position can be forwarded to vehicular devices for an head- up display or for an airbag system which uses the head position for improving the driver's safety when igniting the airbag.
A high accuracy can be obtained if the at least one light source and/or a position of the at least one light source cam be selected in the left area of the optical unit for the right eye of the driver and in the right area of the optical unit for the left eye of the driver. This can be done by choosing the left light source array for the right eye and the right light source array for the left eye of the driver if the optical unit comprises two light source arrays. However, it is possible to use one single array in the same way if the optical unit comprises only one single array.
The at least one light source and/or a position of the at least one light source can be determined depending on which eye is used for calibrating the position detection arrangement. The present invention together with the above-mentioned and other objects and advantages may best be understood from the following detailed description of the embodiments, but not restricted to the embodiments, wherein is shown schematically:
Fig. 1 a sketch of a principal setup of a preferred arrangement for detecting a position of a driver's head; Fig. 2 , a preferred integration of a position detection arrangement for a head position of a driver in an instrument panel of a vehicle; Fig. 3 a side cut through a preferred embodiment of an optical unit for a position detection arrangement for a head position of a driver; Fig. 4a, b, c a top view on a preferred optical unit looking through a mask device placed over a light source array with a light source switched on (a) with an activated blocking member of a mask device moving towards a light spot of the light source, and with the blocking member in a blocking position blocking the light of the light source (c); and Fig. 5 a sketch for elucidating the computation of a head position.
In the drawings, equal or functionally similar elements are referred to by equal reference numerals. The drawings are merely schematic representations, not intended to portray specific parameters of the invention. Moreover, the drawings are intended to depict only typical embodiments of the invention and therefore should not be considered as limiting the scope of the invention.
The schematic drawing in Fig. 1 elucidates the way of functioning of the invention by depicting a preferred embodiment of the arrangement 100. Fig. 2 depicts a preferred installation space of a preferred arrangement 100 for detecting a position of a driver's head in an instrument panel 10 of a vehicle where a manipulator 50 and a computing unit 60 are coupled to the optical unit 20.
The driver is looking onto an optical unit 20 which is preferably integrated into an instrument panel 10 of a vehicle, particularly of a light duty, medium or heavy duty commercial vehicle. The optical unit 20 is in the normal field of vision of the driver at the steering wheel.
Position signals generated in the optical unit 20 are transmitted to a computing unit 60 which receives and evaluates position information of the optical unit 20 and extracts information from this position information for determining the head position. The head position 80 is then transferred to other vehicular devices such as a head-up display which is readable by the driver when his head is in the detected position 80 or an airbag system, which can adjust to a driver's head position, which indirectly indicates the driver's size by the driver's head position.
For calibrating the arrangement 100, the driver looks with one eye 82 onto the optical unit 20. A light source 32, particularly an LED, emits light as a backlight directed to the driver's eyes. In front of the light source 32 in a distance 26 a mask device 40, particularly an LCD screen (LCD = liquid crystal display), is arranged with a blocking member 42. An LCD screen is transparent when no voltage is applied to the liquid crystal elements and becomes nontransparent or at least light absorbing when a certain voltage is applied. The light source 32 emits light in a light cone 24. The driver moves the blocking member 42 (i.e. "black dot") by using the manipulator 50 to overlap the light spot of the light source 32. It is also possible to move the light spot and keep the blocking member 42 fixed.
When the position of the light source 32 is known and the blocking position of the blocking member 42 relative to the light source 32, an optical axis 22 can be determined between the light source 32, the blocking member 42 and the driver's eye. The same is repeated by the driver with the other eye by activating another light source (not shown). This results in two spatially separated positions of one light source per eye and two spatially separate positions of one blocking member 42 per eye and two optical axes 22 from the two positions towards the driver's eye. The driver's eyes 82 represent the position 80 of the driver's head. The position 80 of the driver's head is calculated based on an angle between the spatially separate positions. Particularly, the position of the driver's eyes can be determined.
Fig. 3 depicts a side view of a cut through a preferred embodiment of an optical unit 20 for a position detection arrangement for a head position of a driver. The light source 32, e.g. an LED, can be preferably integrated in an array 30 with a multitude of horizontally and vertically spaced light sources. A mask device 40, e.g. an LCD screen, is arranged in a spatial distance 26 away from the array 30.
The light source 32 emits light typically in a light cone which appears as a light spot 34 on the mask device 40. A typical diameter of the LED light source is ca. 1 mm, whereas the light spot 34 could be 4-5 mm on the mask device 40. A reasonable value for the distance 26 provides a reliable parallax if the driver switches from one eye to the other looking onto the blocking member 42. With greater distance 26, the parallax becomes larger, i.e. if the driver looks with one eye at the blocking member 42, the position of the blocking member 42 apparently changes when looking with the other eye. The distance 26 is large enough to yield a reasonable parallax which allows for a reliable head position calculation even if the optical unit is operated by an inexperienced user. A favourable distance 26 can be at least 1 cm, favourably a value between 1 cm and 3 cm, particularly a value between 1 and 2 cm.
Preferably, the blocking member 42 is smaller in diameter than the light spot 34. With the blocking member 42 in its blocking position (for one eye), the light spot 34 appears as a ring 36 around the blocking member 42. This geometry makes use of the fact that the human eye is sensible to symmetries and the blocking member 42 can be arranged to overlap the light spot 34 with relatively high accuracy. A small shift would result in a clearly visible asymmetric appearance of the ring 36 and could be easily corrected.
Fig. 4a through 4c show top views on an optical unit 20 with an array 30 of light sources 32 (only one is denoted with a reference numeral for clarity). The driver looks through the transparent mask device 40 onto the array 30. When the arrangement is to be calibrated, e.g. when starting the vehicle, one first light source 32 is switched on. The light source 32 casts a light spot 34 on the mask device 40 (Fig. 4a). A blocking member 42 is produced in the mask device 40 and moved towards the light spot 34 via manipulator 50 (Fig. 2) as indicated in Fig. 4b. While looking with one eye on the light spot 34, the driver can gauge the blocking member 42 in the centre of the light spot 34, thus producing a light ring 36 around the blocking member 42 (Fig. 4c). When the driver switches to the other eye, another light source positioned spatially apart from the first light source 32 is switched on (not shown) and the blocking member 42 is moved to overlap the new light spot as described above.
Depending on the size of the driver, his preferred sitting position behind the steering wheel and other like circumstances, the driver can choose an appropriately positioned light source 32 in the array 30 for performing the calibration. Further, instead of a single array 30, one array per eye can be provided in the optical unit 20 (Fig. 1), for instance a left array for the left eye and a right array for the right eye or vice versa. Favourably, the angles for calculating the head position are larger when the left array is used for the right eye and the right array for the left eye and thus, the calculation is more accurate. Fig. 5 depicts a sketch for elucidating the computation of a driver's head position 84 with an optical unit 20 comprising a light source array 30 and a mask device 40. With one eye, e.g. the right eye, the driver locates a light source 32r and moves a blocking member 42 of a mask device 40 arranged in front of a light source array 30 and between the array 30 and the driver over this light source 32r to block the light of the light source 32r shining towards the driver. The position 72 of the light source 32r and the position 42rp of the blocking member 42 in the blocking position 42rp are recorded, e.g. in the computing unit 60 (Fig. 2).
Then the driver locates a spatially separated light source 321 with the left eye and blocks its light with the blocking member 42, e.g. moves the blocking member 42 from the blocking position 42rp to a position 42Ip where the light of the light source 321 shining towards the driver is blocked. The positions 42Ip of the blocking member and the position 74 of the light source 421 are recorded, too. As the positions 72, 74 of the light sources 32r, 321 are known, their distance 70 is known. The light sources 32r, 321 and the blocking positions 42rp, 42Ip define a right eye optical axis 22r and left eye optical axis 22r, which are inclined towards and intersect in the region of the driver's head. Because the head of the driver is relatively far away from the optical unit 20, the position of the two eyes can be merged in a single position with sufficient accuracy, yielding an angle α at the intersection 84. With the light source distance and the angle α the position of the driver's head compared with the optical unit 20 and the steering wheel can be determined.

Claims

C L A I M S
1. A position detection arrangement for a head position (80) of a driver, characterized by an optical unit (20) comprising at last one light source (32, 32r, 32I) providing backlight directed to the driver and a mask device (40) for blocking the light of the at least one light source (32, 32r, 32I) when being arranged in an optical path (22, 22r, 22I) between the at least one light source (32, 32r, 32I) and the driver's head position (80); - a manipulator device (50) for accomplishing a relative movement between the at least one light source (32, 32r, 321) and a blocking member (42) of the mask device (40); a computing unit (60) coupled to the optical unit (20) for capturing a distance (70) between at least one of (a) two or more dedicated light-source positions (72, 74),
(b) two or more dedicated blocking member positions (42rp, 42Ip); and/or for calculating a position (80) of the driver's head based on an angle (α) between the positions (72, 74) and the driver's head position (80).
2. The arrangement according to claim 1 , characterized in that the optical unit (20) is integrated in an instrument panel (10) of a vehicle.
3. The arrangement according to claim 1 or 2, characterized in that the manipulator (50) is coupled to the mask device (40) for moving the blocking member (42) of the mask device (40).
4. The arrangement according to one of the preceding claims, characterized in that the manipulator (50) is coupled to the light source (32, 32r, 32I) for moving the light source (32, 32r, 32I).
5. The arrangement according to one of the preceding claims, characterized in that the mask device (40) comprises an LCD-screen providing an optically nontransparent dot for blocking the light of the at least one light source (32, 32r, 32I).
6. The arrangement according to one of the preceding claims, characterized in that the at least one light source (32, 32r, 321) is integrated in an array (30) of light sources (32, 32r, 321).
7. An optical unit for a position detection arrangement (100) according to one of the preceding claims, characterized by at least one light source (32, 32r, 32I) providing a backlight directed to the driver; a mask device (40) for blocking the light of the at least one light source (32, 32r, 321) when being arranged in an optical path (22, 22r, 221) between the at least one light source (32, 32r, 321) and the driver's head position (80).
8. The optical unit according to claim 7, characterized in that the at least one light source (32, 32r, 321) is arranged in an array (30) of light sources (32).
9. The optical unit according to claim 7 or 8, characterized by a selection unit for selecting at least one light source (32, 32r, 321) in the array (30) depending on an eye position (82) of the driver and/or selecting an optically blocking member (42, 42r, 421) of the mask device (40).
10. The optical unit according to one of the claims 7 to 9, characterized in that the manipulator (50) is coupled to the mask device (40) for moving the blocking member (42) of the mask device (40).
11. The optical unit according to one of the claims 7 to 10, characterized in that the manipulator (50) is coupled to the light source (32, 32r, 32I) for moving the light source (32, 32r, 32I).
12. The optical unit according to one of the claims 7 to 11 , characterized in that an area of the blocking member (42) is smaller than an lighted area (34) on the mask device (40) of the at least one light source (32, 32r, 32I).
13. The optical unit according to one of the claims 7 to 12, characterized in that the mask device (40) comprises an LCD-screen providing an optically absorbing or nontransparent dot for blocking the light of the at least one light source (32, 32r,
32I).
14. The optical unit according to one of the claims 7 to 13, characterized in that a distance (26) of at least 0.5 cm, preferably of at least 1 cm, is arranged between the at least one light source (32, 32r, 32I) and the mask device (40).
15. The optical unit according to one of the claims 7 to 14, characterized by two light source arrays (30), with one array (30) assigned to one eye (82) of the driver.
16. A method for operating a position detection arrangement (100) for a head position (80) of a driver, characterized by for each eye of the driver - receiving light from at least one light source (32r, 321) of an optical unit (20) providing backlight directed to the driver; blocking the light with a mask device (40) arranged in an optical path (221,
22r) between the at least one light source (32r, 321) and the driver's head position (80); - using spatially different light sources (32r, 321) for each eye; capturing a distance (70) between at least one of
(a) two or more dedicated light-source positions (72, 74),
(b) two or more dedicated blocking member positions (42rp, 42Ip); and calculating a position (80) of the driver's head based on an angle (α) between the positions (72, 74) and the driver's head position (80).
17. The method of claim 16, characterized by determining an optical axis (22r, 22I) based on a relative orientation of the at least one light source (32r, 32I) and a respective blocking member (42r, 42I) of the mask device (40) when blocking the light of the respective at least one light source (32r, 32I).
18. The method of claim 17, characterized by determining an intersection (84) of at least two optical axes (22r, 22I) based on said relative positions and the distance (70) between the dedicated positions.
19. The method of one of the claims 16 to 18, characterized by selecting the at least one light source (32r, 32I) and/or a position of the at least one light source (32r, 32I) in the left area of the optical unit (20) for the right eye of the driver and in the right area of the optical unit (20) for the left eye of the driver.
0. The method of one of the claims 16 to 19, characterized by selecting the at least one light source (32r, 32I) and/or a position of the at least one light source (32r, 32I) depending on which eye is used for calibrating the position detection arrangement (100).
PCT/SE2007/000830 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement WO2009038504A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP07808835A EP2193421B1 (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement
US12/676,365 US20100182152A1 (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement
PCT/SE2007/000830 WO2009038504A1 (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement
CN200780100708A CN101802754A (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement
BRPI0722019-7A BRPI0722019A2 (en) 2007-09-20 2007-09-20 POSITION DETECTION ARRANGEMENT AND OPERATION METHOD FOR POSITION DETECTION ARRANGEMENT

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2007/000830 WO2009038504A1 (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement

Publications (1)

Publication Number Publication Date
WO2009038504A1 true WO2009038504A1 (en) 2009-03-26

Family

ID=40468134

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2007/000830 WO2009038504A1 (en) 2007-09-20 2007-09-20 Position detection arrangement and operating method for a position detection arrangement

Country Status (5)

Country Link
US (1) US20100182152A1 (en)
EP (1) EP2193421B1 (en)
CN (1) CN101802754A (en)
BR (1) BRPI0722019A2 (en)
WO (1) WO2009038504A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2541176A1 (en) * 2014-01-16 2015-07-16 Universidad Complutense De Madrid Method and device for postural control and reading distance in real time, for prevention and treatment of vision disorders (Machine-translation by Google Translate, not legally binding)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5318831B2 (en) * 2010-09-08 2013-10-16 株式会社日本自動車部品総合研究所 Operation position detector
CN102175211B (en) * 2010-12-24 2012-08-22 北京控制工程研究所 Barrier position determining method based on lattice structured light
EP2567854B1 (en) * 2011-09-12 2019-11-06 Volvo Car Corporation A system for driver-vehicle interaction in a vehicle
JP5532075B2 (en) * 2012-04-18 2014-06-25 凸版印刷株式会社 Liquid crystal display
EP2936070A4 (en) * 2012-12-20 2016-09-21 Olympus Corp Position detection sensor and manipulator
CN104482449B (en) * 2014-12-04 2017-07-28 京东方科技集团股份有限公司 Eye-protecting lamp and its light intensity regulating method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5621457A (en) * 1994-09-26 1997-04-15 Nissan Motor Co., Ltd. Sighting direction detecting device for vehicle
US5714967A (en) * 1994-05-16 1998-02-03 Olympus Optical Co., Ltd. Head-mounted or face-mounted image display apparatus with an increased exit pupil
WO1998030414A1 (en) 1997-01-10 1998-07-16 Brandin Boerje A Light-based apparatus and methods for automatically adjusting rearview mirrors
US6915231B2 (en) 2003-07-28 2005-07-05 Hyundai Motor Company Method and apparatus for determining a head position of a vehicle driver

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060149426A1 (en) * 2005-01-04 2006-07-06 Unkrich Mark A Detecting an eye of a user and determining location and blinking state of the user
DE102005017313A1 (en) * 2005-04-14 2006-10-19 Volkswagen Ag Method for displaying information in a means of transport and instrument cluster for a motor vehicle
US20070146482A1 (en) * 2005-12-23 2007-06-28 Branislav Kiscanin Method of depth estimation from a single camera

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5714967A (en) * 1994-05-16 1998-02-03 Olympus Optical Co., Ltd. Head-mounted or face-mounted image display apparatus with an increased exit pupil
US5621457A (en) * 1994-09-26 1997-04-15 Nissan Motor Co., Ltd. Sighting direction detecting device for vehicle
WO1998030414A1 (en) 1997-01-10 1998-07-16 Brandin Boerje A Light-based apparatus and methods for automatically adjusting rearview mirrors
US6915231B2 (en) 2003-07-28 2005-07-05 Hyundai Motor Company Method and apparatus for determining a head position of a vehicle driver

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2193421A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
ES2541176A1 (en) * 2014-01-16 2015-07-16 Universidad Complutense De Madrid Method and device for postural control and reading distance in real time, for prevention and treatment of vision disorders (Machine-translation by Google Translate, not legally binding)

Also Published As

Publication number Publication date
EP2193421B1 (en) 2012-05-30
EP2193421A1 (en) 2010-06-09
BRPI0722019A2 (en) 2014-09-23
EP2193421A4 (en) 2011-03-30
CN101802754A (en) 2010-08-11
US20100182152A1 (en) 2010-07-22

Similar Documents

Publication Publication Date Title
EP2193421B1 (en) Position detection arrangement and operating method for a position detection arrangement
US10247941B2 (en) Vehicle vision system with light field monitor
US8810381B2 (en) Vehicular heads up display with integrated bi-modal high brightness collision warning system
US10996481B1 (en) Head-up display calibration
US11506891B2 (en) Method for operating a visual field display device for a motor vehicle
US20190155031A1 (en) Display apparatus for superimposing a virtual image into the field of vision of a user
CN112639573B (en) Method for operating a visual display device for a motor vehicle
WO2003074307A1 (en) Enhanced vision for driving
US11394952B2 (en) Imaging device and vehicular display device
WO2014130049A1 (en) Systems and methods for augmented rear-view displays
JPH07257228A (en) Display device for vehicle
US20110037682A1 (en) Image display device
JP2009008722A (en) Three-dimensional head up display device
US10274726B2 (en) Dynamic eyebox correction for automotive head-up display
US10323812B2 (en) Intelligent automotive headlamp module with combined functions
KR101424257B1 (en) Image compensation device of hud system for a car
US20060098093A1 (en) Stereo night vision system for vehicles
JP2011107382A (en) Display device for vehicle
JP2024506184A (en) Microlens array projection devices, lighting devices, and vehicles
JP7053664B2 (en) Head-up display device
JPWO2004084559A1 (en) Video display device for vehicle
KR20180046567A (en) Apparatus and method for controlling head up display (hud) device in vehicle
JP7131397B2 (en) virtual image display
JP2006273002A (en) Monitoring device for vehicle
JP2020149431A (en) Driving assist system

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200780100708.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07808835

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2007808835

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 12676365

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: PI0722019

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20100322