EP1536987A1 - Vorrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs - Google Patents

Vorrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs

Info

Publication number
EP1536987A1
EP1536987A1 EP03750318A EP03750318A EP1536987A1 EP 1536987 A1 EP1536987 A1 EP 1536987A1 EP 03750318 A EP03750318 A EP 03750318A EP 03750318 A EP03750318 A EP 03750318A EP 1536987 A1 EP1536987 A1 EP 1536987A1
Authority
EP
European Patent Office
Prior art keywords
operating mode
acceleration
unit
evaluation unit
evaluation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03750318A
Other languages
German (de)
English (en)
French (fr)
Inventor
Horst Belau
Ludwig Ertl
Thorsten KÖHLER
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Continental Automotive GmbH
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Publication of EP1536987A1 publication Critical patent/EP1536987A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • B60R21/01542Passenger detection systems detecting passenger motion
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • B60R21/0153Passenger detection systems using field detection presence sensors
    • B60R21/01538Passenger detection systems using field detection presence sensors for image processing, e.g. cameras or sensor arrays
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/107Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using stereoscopic cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60YINDEXING SCHEME RELATING TO ASPECTS CROSS-CUTTING VEHICLE TECHNOLOGY
    • B60Y2400/00Special features of vehicle units
    • B60Y2400/30Sensors
    • B60Y2400/304Acceleration sensors
    • B60Y2400/3042Collision sensors

Definitions

  • the invention relates to a device and a method for detecting an object or a person in the interior of a vehicle.
  • Non-contact optical sensors are preferably used to determine the occupant position in the vehicle.
  • a known device for object and person detection is arranged in the vehicle interior as a device separately formed from the actual control device for the personal protection means in such a way that either detection of an occupant on the vehicle seat or scanning of a danger zone in front of the folded airbag is made possible.
  • the vehicle interior or at least part of it is preferably examined for the presence of an object or a person. If a child seat or a body part of an occupant is recognized in this danger zone, the airbag is not triggered or is triggered only in a metered manner.
  • Such devices have, for example, at least one image acquisition unit and an evaluation unit for the data transmitted by the image acquisition unit.
  • the detection unit supplies images which are subjected to pattern recognition or classification in a first operating mode in the following method.
  • the classification takes place cyclically in the evaluation unit, for example by means of an image processing algorithm.
  • the classification of the seat occupancy is linked to a complex evaluation in the first operating mode. This applies all the more if the entire observation area of the image acquisition unit (s) (from the dashboard to the seat back, from the seat cushion to the headliner) is evaluated, which has an impact on the computing time, particularly in the case of stereoscopic 3D image acquisition systems.
  • the computing time is also strongly influenced if a comparatively high resolution is required; if a comparatively complex classification of the seat occupancy is carried out; when the head position in the room and its distance from the dashboard is calculated; and / or the entire image area (in the case of stereo also two full images) is read out by the image acquisition unit.
  • evaluation means and / or methods which require valuable time units for the position evaluation are used by the control system as reaction time for personal protection are sometimes missing, which do not regularly meet the strict requirements.
  • Known tracking methods have the following properties, alternatively or cumulatively: evaluation of a smaller image area, so-called subwindow, around the position of a defined body part; less spatial triggering; usually no classifications; Calculation of the body part position and the distance to the dashboard, or as an alternative, the definition of a danger area with checking the mere penetration of an object into the area with no distance calculations; and / or finally the limitation of the readout area of the image sensor (s) or acquisition units and thereby saving of readout time.
  • the switchover from the first operating or classification mode to the second operating or tracking mode has been controlled by the image processing algorithm of the evaluation unit itself.
  • the body part of the occupant to be tracked in particular its head, has already left the evaluation area that is restricted in the second operating mode, or that another object, for example an object flying around, is already located there.
  • COOP Cosmetic Out Of Position
  • This zone 13 is typically about 65 cm from the rest position 0 cm of the head 17. Up to the tap board 11 it is typically 80cm from the rest position at 0cm.
  • a device 1, for example arranged on the headlining 14 of the interior 10 of a motor vehicle, for capturing an object or a person 16 in the interior 10 of a vehicle comprises an image acquisition unit 2, for example a stereoscopic 3D camera system, which transmits corresponding image data to an evaluation unit 3.
  • the evaluation is ready at 0 ms, since the evaluation itself requires 100 ms.
  • the 3D camera does not see any movement of the head after 100 ms.
  • the evaluation is ready at 100 ms.
  • the 3D camera sees a movement of approx. 5 cm, which, however, is not yet significant with a typical measurement error of +/- 2 cm.
  • the evaluation is ready at 200 ms. The camera now perceives a significant movement of 20 cm.
  • the center of a subwindow should be calculated using a suitable model so that it is set to the 45cm position at the current time.
  • the head has moved more than one head diameter compared to the last 100 ms old evaluation.
  • the head will reach the COOP zone within the next evaluation cycle.
  • a message should be sent to the airbag control unit to deactivate the airbag in about 50ms. This would require an extrapolation of the measurement results from 20 cm to 80 cm - at least four times the distance traveled so far.
  • the evaluation is ready at 300 ms, the 3D camera now detects a movement of 45 cm. In fact, the head has been in the COOP zone for about 50ms. But even at this point the current head position can only be medium of a model can be calculated from the history. In doing so, extrapolation must be carried out over twice the distance covered so far.
  • the present invention is therefore based on the object, on the basis of the above-mentioned known device and the above-mentioned known method for detecting an object or a person in the interior of a vehicle, to take precautions which improve, in particular more timely, switching between the Allow device operating modes.
  • the evaluation unit is preferably designed such that the second operating mode is activated as soon as the value of the vehicle acceleration exceeds a threshold value or the first operating mode is activated as soon as the value of the vehicle acceleration falls below a threshold value again.
  • the values of the vehicle acceleration can preferably be obtained from an external airbag control unit.
  • the device according to the invention preferably comprises an acceleration sensor itself.
  • This can be an integral part of the evaluation unit or the image processing sensor, for example.
  • the transmission rates of the acceleration value are advantageously just as small as the probability of errors when the information is transmitted, for example via a
  • the integration of the acceleration sensor in the device has the one The advantage is that it is independent of the airbag control unit and any interference. On the other hand, no changes to the common airbag control units themselves are required. Thirdly, no additional data line, no additional utilization of existing data lines, and no increased computing power is advantageously required to send the data.
  • the second operating mode preferably provides a scanning area for the image acquisition unit that is reduced compared to the first operating mode, which advantageously takes up less computing time.
  • the second operating mode also provides an evaluation cycle for the evaluation unit that is shortened compared to the first operating mode. Due to the shorter cycle time, preferably 25 ms for each update, about four times more measurement values are available within the same measurement time interval, so that the head position can advantageously be extrapolated with considerably higher accuracy.
  • cameras preferably stereoscopic 3D cameras, are preferably used as image acquisition units
  • an object or person position can be o- when the object is actively irradiated.
  • the person can preferably be determined using the methods of measuring the transit time or triangulation.
  • the value of the vehicle acceleration is queried by the evaluation unit, preferably with a cycle time of 2 ms, in particular of 1 ms, which advantageously represents a significantly shorter cycle time than in the pure image evaluation.
  • the first, current operating mode is terminated and the second operating mode, for example fast head tracking, is immediately interrupted , preferably based on the position data of the last head position measurement. Since the last head position, as illustrated by the example in the introduction to the description, is at most 100 ms old and the head has not yet experienced any external acceleration, the position will advantageously have changed significantly less than 5 cm.
  • the next head position during tracking can then preferably be estimated even better using a comparison model.
  • the second, current operating mode is terminated and the first operating mode is started again.
  • the advantages of the invention lie in particular in the fact that the operating mode of the device can be switched significantly earlier, approximately 200 ms to 300 ms earlier, and thus in a timely manner. This increases the operational safety of the device considerably, since the physical parameter acceleration is now subject to a direct measurement, and no longer has to be determined indirectly from position measurements of the occupant.
  • the timely switchover of the operating modes for example the head position in the second operating or tracking mode, can be measured with much higher security than before.
  • the subwindow for tracking can be centered exactly on the head or another part of the body.
  • the head position can be measured with much higher accuracy during the tracking by switching the operating modes in time.
  • FIG. 2 shows the device according to the invention with an acceleration sensor arranged inside the evaluation unit
  • FIG 3 shows the device according to the invention with an acceleration sensor arranged inside the image acquisition unit
  • Fig. 4 is a flow chart of the method according to the invention.
  • Fig. 1 shows schematically the forward displacement of an occupant's head during a braking operation from a rest position at 0 cm to a dashboard.
  • the direction is indicated by means of an arrow, and the individual positions of the forward displacement are indicated by means of a dimension path.
  • the device 2 shows the device 1 according to the invention with an image acquisition unit 2 and an evaluation unit 3 for the image data transmitted by the image acquisition unit 2.
  • the evaluation unit 3 is connected to an external airbag control unit 5 for personal protection.
  • the evaluation device 3 preferably comprises an acceleration sensor 4.
  • FIG. 3 shows the device 1 according to the invention with an image acquisition unit 2 and an evaluation unit 3 for the data transmitted by the image acquisition device 2.
  • the evaluation unit 3 is connected to an external airbag control unit 5.
  • an acceleration sensor 4 is now part of the image capturing device 2.
  • FIG. 4 schematically shows a flow diagram of the method according to the invention.
  • Values of the vehicle acceleration are queried by the evaluation unit 3 with a cycle time of 1 ms to 2 ms. If these exceed a possibly filtered threshold value S, which is preferably approximately 2 m / s 2 , the current classification cycle is terminated and rapid head tracking based on the position data of the last head position measurement is started immediately. After the last head position is a maximum of 100 ms old and the head has not yet experienced any external acceleration, its position will have changed significantly less than 5 cm. Based on the measured acceleration values, the next head position during tracking can then be estimated even better using a model. When acceleration ends, the head will continue to move or slow down at maximum constant speed. If the A threshold speed can then be switched back to the classification mode.
  • S possibly filtered threshold value
  • an acceleration signal from an airbag control unit is used together with a measured movement of the occupant during a crash to define the deployment behavior of an airbag.
  • the present invention advantageously makes use of the idea of using an acceleration signal to switch between different operating modes of a device for detecting an object or a person in the interior of a vehicle. For this purpose, not only crash signals, as in the aforementioned documents, but rather acceleration signals, such as those that occur, for example, during sharp braking, are evaluated and transmitted to an airbag control unit for the purpose of further processing, which is advantageous for personal protection.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Air Bags (AREA)
EP03750318A 2002-09-11 2003-09-04 Vorrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs Withdrawn EP1536987A1 (de)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE10241993 2002-09-11
DE10241993A DE10241993B3 (de) 2002-09-11 2002-09-11 Vorrichtung und Verfahren zum Erfassen eines Objektes oder einer Person im Innenraum eines Fahrzeugs
PCT/DE2003/002939 WO2004026637A1 (de) 2002-09-11 2003-09-04 Vorrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs

Publications (1)

Publication Number Publication Date
EP1536987A1 true EP1536987A1 (de) 2005-06-08

Family

ID=31983912

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03750318A Withdrawn EP1536987A1 (de) 2002-09-11 2003-09-04 Vorrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs

Country Status (6)

Country Link
US (1) US7403635B2 (ko)
EP (1) EP1536987A1 (ko)
JP (1) JP2005537986A (ko)
KR (1) KR20050057300A (ko)
DE (1) DE10241993B3 (ko)
WO (1) WO2004026637A1 (ko)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7210047B2 (en) * 2004-06-16 2007-04-24 Gateway Inc. Method of switching modes of a computer operating in a grid environment based on the current operating mode
DE102004056416A1 (de) * 2004-11-23 2006-05-24 Robert Bosch Gmbh Beschleunigungssensor in einem Steuergerät
JP2008049718A (ja) * 2006-08-22 2008-03-06 Toyota Motor Corp 車両用乗員保護装置
DE102013005039B4 (de) 2013-03-25 2018-05-09 Jenoptik Optical Systems Gmbh Vorrichtung zum Steuern eines Airbagmoduls
DE102013019191B4 (de) 2013-11-15 2016-07-14 Audi Ag Verfahren und Vorrichtung zum Betreiben wenigstens eines Assistenzsystems eines Kraftwagens
DE102018202360B4 (de) * 2018-02-15 2020-08-20 Robert Bosch Gmbh Verfahren zum Verfolgen eines Objekts in einem optischen Suchfenster einer Kamera für ein Fahrzeug
US11354692B2 (en) * 2018-08-01 2022-06-07 Motional Ad Llc System and method for keeping an automated-taxi clean

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3942011C3 (de) * 1989-12-20 1996-10-17 Telefunken Microelectron Einrichtung zur Auslösung einer passiven Sicherheitseinrichtung für Fahrzeuginsassen
DE4005598C2 (de) * 1990-02-22 2000-06-15 Bosch Gmbh Robert Schutzverfahren für Fahrzeuginsassen und Einrichtung zur Durchführung des Verfahrens
US5835613A (en) * 1992-05-05 1998-11-10 Automotive Technologies International, Inc. Optical identification and monitoring system using pattern recognition for use with vehicles
US5446661A (en) * 1993-04-15 1995-08-29 Automotive Systems Laboratory, Inc. Adjustable crash discrimination system with occupant position detection
US6027138A (en) * 1996-09-19 2000-02-22 Fuji Electric Co., Ltd. Control method for inflating air bag for an automobile
JP3230146B2 (ja) 1996-09-30 2001-11-19 豊田合成株式会社 乗員拘束装置
JP4002343B2 (ja) 1998-07-02 2007-10-31 日産自動車株式会社 乗員保護装置
DE19852653A1 (de) * 1998-11-16 2000-05-18 Bosch Gmbh Robert Vorrichtung zum Erfassen der Belegung eines Fahrzeugsitzes
DE19932520A1 (de) * 1999-07-12 2001-02-01 Hirschmann Austria Gmbh Rankwe Vorrichtung zur Steuerung eines Sicherheitssystems
US6608910B1 (en) * 1999-09-02 2003-08-19 Hrl Laboratories, Llc Computer vision method and apparatus for imaging sensors for recognizing and tracking occupants in fixed environments under variable illumination
KR20020029128A (ko) * 1999-09-10 2002-04-17 칼 하인쯔 호르닝어 시트에 설치된 승객 보호 장치의 작동을 제어하는 방법 및 장치
DE19945614C1 (de) 1999-09-23 2000-12-28 Bosch Gmbh Robert Verfahren zur Datenübertragung zwischen einem Steuergerät für Rückhalteeinrichtungen und Sensoren
JP3716733B2 (ja) 2000-10-04 2005-11-16 トヨタ自動車株式会社 乗員保護装置の制御システム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004026637A1 *

Also Published As

Publication number Publication date
US7403635B2 (en) 2008-07-22
DE10241993B3 (de) 2004-04-08
JP2005537986A (ja) 2005-12-15
US20060120565A1 (en) 2006-06-08
KR20050057300A (ko) 2005-06-16
WO2004026637A1 (de) 2004-04-01

Similar Documents

Publication Publication Date Title
DE102018207977B4 (de) Innenüberwachung für Sicherheitsgurteinstellung
DE102005042252B4 (de) Überschlagserfassungsvorrichtung und -verfahren für Fahrzeuge
DE102004046360B4 (de) Kraftfahrzeug mit einem präventiv wirkenden Schutzsystem
EP2229293B1 (de) Verfahren und anordnung zur ansteuerung von sicherheitsmitteln für ein fahrzeug
DE60306459T2 (de) System zur Kollisionsbestimmung
DE19945923B4 (de) Verfahren und Vorrichtung zum Abfühlen von Seitenaufprallzusammenstoßzuständen mittels einer erhöhten Sicherungsfunktion
DE102005013164B4 (de) Verfahren und Vorrichtung zur Steuerung eines passiven Rückhaltesystems
EP1528992B1 (de) Verfahren zur erkennung eines überrollvorgangs
EP1632403A1 (de) Passagierschutzeinrichtung in einem Fahrzeug
EP1656282A1 (de) Kraftfahrzeug mit einem pre-safe-system
DE102008043637A1 (de) Verfahren zur Aktivierung und/oder Ansteuerung von mindestens einem Schutz-system in einem Fahrzeug
DE10044567B4 (de) Sicherheitssystem für ein Kraftfahrzeug
EP1152928B1 (de) Einrichtung und verfahren zum erfassen eines objektes oder einer person im innenraum eines fahrzeugs sowie vorrichtung für den personenschutz in einem fahrzeug mit einer solchen einrichtung
WO2004110822A1 (de) Vorrichtung zur bestimmung einer relativgeschwindigkeit zwischen einem fahrzeug und einem aufprallobjekt
DE10241993B3 (de) Vorrichtung und Verfahren zum Erfassen eines Objektes oder einer Person im Innenraum eines Fahrzeugs
WO2017207273A1 (de) Sicherheitseinrichtung für ein fahrzeug
DE112004000041B4 (de) Beschleunigungsmessvorrichtung für ein Insassenschutzsystem und Verfahren zur Auslösung eines Insassenschutzsystems
DE102008002429B4 (de) Verfahren und Steuergerät zur Ansteuerung von Personenschutzmitteln für ein Fahrzeug
DE102004017066A1 (de) Kraftfahrzeug mit Positionierungsmitteln für Fahrzeuginsassen
DE102005033937A1 (de) Verfahren und Vorrichtung zur Ansteuerung von Personenschutzmitteln
EP2105356B1 (de) Verfahren und Steuergerät zur Ansteuerung von Personenschutzmitteln für ein Fahrzeug
WO2022174852A1 (de) Insassenschutzsystem für ein fahrzeug mit einer mehrzahl von sitzplätzen und einem airbag im dach des fahrzeugs
DE10317637A1 (de) Vorrichtung zur Ansteuerung einer aktiven Kopfstütze in einem Fahrzeug
DE10037220A1 (de) Verfahren und Einrichtung zur situationsgerechten Ansteuerung
DE102012024847A1 (de) Verfahren zur Aktivierung von zumindest einer in einem Fahrzeug angeordneten Insassenschutzvorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050128

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

RBV Designated contracting states (corrected)

Designated state(s): DE FR GB IT

RIN1 Information on inventor provided before grant (corrected)

Inventor name: ERTL, LUDWIG

Inventor name: BELAU, HORST

Inventor name: KOEHLER, THORSTEN

17Q First examination report despatched

Effective date: 20060711

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: CONTINENTAL AUTOMOTIVE GMBH

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20110208