LU100451B1 - System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment - Google Patents

System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment Download PDF

Info

Publication number
LU100451B1
LU100451B1 LU100451A LU100451A LU100451B1 LU 100451 B1 LU100451 B1 LU 100451B1 LU 100451 A LU100451 A LU 100451A LU 100451 A LU100451 A LU 100451A LU 100451 B1 LU100451 B1 LU 100451B1
Authority
LU
Luxembourg
Prior art keywords
radar
passenger compartment
received
passengers
unit
Prior art date
Application number
LU100451A
Other languages
German (de)
Inventor
Da Cruz Steve Dias
Hans Peter Beise
Una Karahasanovic
Original Assignee
Iee Sa
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Iee Sa filed Critical Iee Sa
Priority to LU100451A priority Critical patent/LU100451B1/en
Priority to CN201880046547.1A priority patent/CN110891829A/en
Priority to PCT/EP2018/069065 priority patent/WO2019012099A1/en
Priority to EP18739855.7A priority patent/EP3652026B1/en
Priority to US16/630,778 priority patent/US11718255B2/en
Application granted granted Critical
Publication of LU100451B1 publication Critical patent/LU100451B1/en

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • B60R21/0153Passenger detection systems using field detection presence sensors
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • B60R21/01Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents
    • B60R21/015Electrical circuits for triggering passive safety arrangements, e.g. airbags, safety belt tighteners, in case of vehicle accidents or impending vehicle accidents including means for detecting the presence or position of passengers, passenger seats or child seats, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use
    • B60R21/01512Passenger detection systems
    • B60R21/0153Passenger detection systems using field detection presence sensors
    • B60R21/01534Passenger detection systems using field detection presence sensors using electromagneticwaves, e.g. infrared
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/02Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
    • G01S13/50Systems of measurement based on relative movement of target
    • G01S13/52Discriminating between fixed and moving objects or between objects moving at different speeds
    • G01S13/56Discriminating between fixed and moving objects or between objects moving at different speeds for presence detection

Abstract

A method of operating a radar sensor system (10) for determining a number of passengers (24) in a vehicle passenger compartment (30). The radar sensor system (10) includes at least one radar transmitting antenna (12) and at least one radar receiving antenna (16) and an evaluation and control unit (22) for evaluating Doppler information from the received radar waves (18). The method comprises transmitting radar waves (14) towards the vehicle passenger compartment (30); receiving radar waves (18) reflected by a passenger (24) or by passengers being present in the vehicle passenger compartment (30); generating received radar signals (32) from the received radar waves (18); mathematically decomposing (42) the received radar signals (32) into a plurality of received signal components; providing (44) values of the received signal components regarding a characteristic parameter to a classifier trained with a plurality of scenarios; identifying (46) one of trained scenarios, based on the provided values; and generating (48) an output signal indicative of the identified scenario.

Description

System and Method for Radar-Based Determination of a Number of Passengers inside a Vehicle Passenger Compartment
Technical field [0001] The invention relates to a method of operating a radar sensor system for determining a number of passengers in a vehicle passenger compartment, and to a radar sensor system automatically executing such method.
Background of the invention [0002] In the technical field of passenger transportation, and in particular in automotive technology, for quite many applications it is mandatory to detect whether there is a person located on a seat or not. To this end, it has been proposed in the art to use radar technology for seat occupant detection systems. Occupancy sensors based on radar technology offer advantages in comparison to other occupancy detection methods as their operation is contact-free and can be unnoticeable for vehicle occupants. Moreover, radar sensors can easily be integrated in the vehicle interior, for example behind plastic covers and textiles.
[0003] By way of example, international application WO 2015/140333 A1 describes a method for ascertaining whether an unattended child is present within an automotive vehicle, using a radar sensor system comprising a transmitter and at least one sensor and processing circuitry and exploiting a breathing motion detected by radar signals, for instance by applying autocorrelation and peak finding. The method comprises: illuminating at least one occupiable position within the vehicle with radiation, the radiation exhibiting a single frequency or multiple frequencies; generating radar sensor signals from radiation reflected as a result of the transmitted radiation, a plurality of the radar sensor signals corresponding to different frequencies; operating the processing circuitry for generating, based on the radar sensor signals, a first indicator value, the first indicator value indicating a degree of motion associated with the occupiable position; determining whether the first indicator value satisfies a first predetermined criteria; if the first indicator value satisfies the first predetermined criteria, generating, based on radar sensor signals, a second indicator value, the second indicator value indicating a degree of repetitive pattern within the radar sensor signals; and determining that an unattended child is present within the automotive vehicle if the second indicator value satisfies a second predetermined criteria. The second indicator value may comprise a breathing signature indicative of the extent to which the sensor signals indicate that motion indicative of infant breathing child is detected.
[0004] In the article “Non-Contact Estimation at 60 GHz for Human Vital Signs Monitoring Using a Robust Optimization Algorithm" by Ting Zhang et al., Conference IEEE APS 2016, Jun 2016, Fajardo (Porto-Rico), United States, 2016, AP-S/URSI 2016. <hal-01340613>, an approach to estimate body movements related to vital activities by means of a 60 GHz Doppler radar is described, using robust optimization algorithms including signal autocorrelation analysis in order to extract heart-rate and breathing information from the radar signals.
[0005] It is therefore known in the art that a presence of a single passenger can be detected by conducting electromagnetic measurements, such as Doppler radar techniques to measure, for instance, the passenger’s breathing or heartbeat. Unfortunately, received radar signals are corrupted with noise if, for instance, a vehicle is moving over a rough surface, in the presence of strong wind gusts or in the presence of engine vibrations. This noise, which could be of high amplitude compared to the signal of a passenger that is desired to detect will inevitably lead to detection errors.
[0006] In the technical field of automotive technology, for many applications it is further mandatory to determine a number of passengers that are present in a vehicle passenger compartment. Information on the number of passengers can e.g. be utilized in a system to prevent that small children and infants are left behind. For Advanced Driver Assistance Systems (ADAS) the number of passengers can be a valuable information. Other conceivable applications are the technical fields of local public transport, trains or aircrafts, for instance for avoiding overcrowding in trains, buses, and so forth.
[0007] For instance, international application WO 2016/038148 A1 describes a method for sensing occupancy status within an automotive vehicle. The method uses a radar sensor system comprising an antenna system, at least one sensor and processing circuitry. The method includes illuminating, by using the antenna system, at least one occupiable position within the vehicle with an outgoing radar signal, and receiving, by using the at least one sensor, at least one sensor signal that has been reflected as a result of the outgoing radar signal. The method further comprises obtaining accelerometer data value from at least one accelerometer, wherein the accelerometer data contain information regarding vibration or motion of the automotive vehicle and supplies the accelerometer data to the processing circuitry. The processing circuitry is being operated for generating, based on the at least one sensor signal and on the accelerometer data, one or more occupancy status signals, wherein the occupancy status signal indicates a property that is related to the at least one occupiable position.
[0008] Further, in the article by Zhangi, Ting et al. "Wavelet-based analysis of 60 GHz Doppler radar for non-stationary vital sign monitoring", 11th European Conference on Antennas and Propagation (EUCAP) IEEE, 2017, a Doppler-radar implementation at 60 GHz is proposed for contactless monitoring of vital signs (respiration and heartbeat) in order to provide constant monitoring of elderly people, to avoid accidents, and to reduce costs related to hospitalization. A realtime detection of vital signs is said to be believed to offer important information on the health condition of the patient, thus preventing critical events or acting in a timely and effective manner after them. In order to provide a real-time detection of non-stationary vital signs and critical events, an estimation technique is used by means of a wavelet transform of the received signals. Moreover, the amplitudes of the relevant vital movements can be deduced by the wavelet transform so as to distinguish the useful signal from noises and non-desired movements.
Object of the invention [0009] It is therefore an object of the invention to provide a universal, non-contact method of detection with high accuracy and reliability that enables estimating the number of passengers present inside a stationary, or moving, vehicle passenger compartment.
General Description of the Invention [0010] In one aspect of the present invention, the object is achieved by a method of operating a radar sensor system for determining a number of passengers in a vehicle passenger compartment. The radar sensor system includes a radar transmitting unit having at least one radar transmitting antenna and being configured for transmitting radar waves towards the vehicle passenger compartment, a radar receiving unit having at least one radar receiving antenna and being configured for receiving radar waves that have been transmitted by the radar transmitter unit and have been reflected by a passenger or passengers that are present in the vehicle passenger compartment, and an evaluation and control unit that is at least configured for evaluating Doppler information from the radar waves received by the radar receiving unit.
[0011] The method comprises at least steps of operate the radar transmitting unit for transmitting radar waves towards the vehicle passenger compartment, operate the radar receiving unit for receiving radar waves that have been transmitted by the radar transmitting unit and that have been reflected by a passenger or by passengers being present in the vehicle passenger compartment, operate the radar receiving unit for generating received radar signals from the received radar waves, mathematically decompose the received radar signals into a plurality of received signal components, wherein each received signal component has a different value regarding at least one characteristic parameter, provide values of the received signal components regarding the at least one characteristic parameter to a classifier that has been trained by supervised learning using data representing a plurality of scenarios with different numbers of passengers in the vehicle passenger compartment, based on the provided values of the received signal components regarding the at least one characteristic parameter, identify one of the trained scenarios, and generate an output signal that is indicative of the identified scenario.
[0012] The phrase “being configured to”, as used in this application, shall in particular be understood as being specifically programmed, laid out, furnished or arranged. The term “vehicle”, as used in this application, shall particularly be understood to encompass passenger cars, trucks, buses, aircrafts and ferry boats. The phrase “evaluating Doppler information”, as used in this application, shall in particular be understood as evaluating received radar waves for movement detection purposes.
[0013] By using the proposed method, it can be possible to detect and extract human characteristics in the noisy radar signals received by the at least one interior radar receiving antenna. The trained classifier will be capable of classifying the received radar signals based on presence or absence of these characteristic Doppler features, i.e. vital signs such as breathing or heartbeat. Further, with the proposed method the human characteristics can be detected in a non-stationary scenery, wherein the radar waves received by the at least one interior radar receiving antenna are contaminated by noise, and a clear distinction between noise and a living creature being present in the vehicle passenger compartment can be accomplished.
[0014] Appropriate classifiers that can be trained by supervised learning are readily available as commercial products, for instance as a MATLAB® module.
[0015] Preferably, the radar transmitting unit is configured for transmitting radar waves towards such regions in the vehicle passenger compartment in which breast regions and/or abdominal regions of potential passengers can be expected from positions of seats within the vehicle passenger compartment.
[0016] In preferred embodiments, the step of mathematically decomposing the received radar signals comprises to perform a discrete wavelet transform. Further, the at least one characteristic parameter is formed by a level of the wavelets, and the value regarding the at least one characteristic parameter is given by the individual energy contained in a specific level of the wavelets.
[0017] Wavelet-based analysis of a breathing signal is known in the art of vital sign monitoring, for instance from the article by Zhangi, Ting et al. "Wavelet-based analysis of 60 GHz Doppler radar for non-stationary vital sign monitoring", which has been cited as prior art before and which shall hereby be incorporated by reference in its entirety with effect for those jurisdictions permitting incorporation by reference.
[0018] Wavelet transform are a well-known tool for processing of time-dependent signals, and detailed description can be found in textbooks such as, by way of example, D.B. Percival and A.T. Walden: “Wavelet Methods for Time Series Analysis". Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge University Press, 2000 (ISBN: 9780521640688).
[0019] An important property of the wavelet transform is the conservation of energy
wherein X is the received radar signal, Wj is the jtfl level wavelet and is the Jlh level scaling filter. This means that the energy of the received radar signal is distributed among the resulting levels of the decomposition. It is a part of the insight of the invention that there is a high probability for the energy coming from living sources, e.g. breathing, heartbeat, blood flow, and so on, is distributed to some specific levels of the decomposition, whereas the energy of the noise is distributed among other levels.
[0020] Preferably, the discrete wavelet transform to be performed in the method step is the maximum-overlap discrete wavelet transform (MODWT). MODWT is described in detail in the article by S. Olhede and A. T.Walden, “The Hilbert spectrum via wavelet projections”, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 460, 955-975 (2004), which shall hereby be incorporated by reference in its entirety with effect for those jurisdictions permitting incorporation by reference.
[0021] In preferred embodiments, the step of mathematically decomposing the received radar signals comprises to perform a discrete wavelet transform, and further comprises a step of calculating the Hilbert transform for different levels of the wavelets to determine the at least one characteristic parameter that is given by an instantaneous frequency of the different levels of the wavelets.
[0022] Again, it is a part of the insight of the invention that there is a high probability that values for the characteristic parameter in the frequency domain, i.e. the instantaneous frequency, will be distributed for radar signals reflected by living beings characteristically within some specific ranges, whereas values for the instantaneous frequency from noise will be distributed among some other ranges.
[0023] Preferably, the step of mathematically decomposing the received radar signals comprises to perform a discrete Fourier transform. Herein, the at least one characteristic parameter is given by the frequency, and the value regarding the at
least one characteristic parameter is given by a Fourier coefficient. As described before, it is part of the insight of the invention that there is a high probability that values of signal components from human beings and signal components from unanimated objects and from noise generated by exterior events will distribute differently with regard to the at least one characteristic parameter, and thus can be used for distinguishing between one or several passengers present in the vehicle passenger compartment and noise generated by exterior events.
[0024] Preferably, the step of identifying one of the trained scenarios is executed by the classifier, which is formed by a support vector machine or a neural network. In this way, a trained classifier for identifying one of the trained scenarios can readily be provided.
[0025] Preferably, the data representing the various scenarios used for training the classifier comprise data simulating at least one road roughness condition. By that, the classifier can be effectively trained under realistic conditions, and a high accuracy rate for identifying a scenario with a specific number of passengers inside the vehicle passenger compartment can be achieved.
[0026] In preferred embodiments of the method, wherein the vehicle passenger compartment is a passenger car compartment, the step of providing values of the received signal components regarding the at least one characteristic parameter to a classifier that has been trained by supervised learning using data representing a plurality of scenarios with different numbers of passengers comprises a step of training the classifier with a plurality of scenarios, each one of the scenarios at least including a driver’s seat, a passenger front seat, and a three-seat rear bench.
[0027] Herein, in the various scenarios a number of passengers is varied starting from a driver occupying the driver’s seat and one passenger occupying one of the other seats, with the other seats being unoccupied, adding another passenger occupying another one of the other seats, up to a driver occupying the driver’s seat and four passengers occupying the other seats. In this way, an effective method of determining a number of passengers in a passenger car compartment can be provided. It should be noted that virtual (simulated) training data can be used as well to train the system.
[0028] In another aspect of the invention, a radar sensor system for determining a number of passengers in a vehicle passenger compartment is provided. The radar sensor system includes a radar transmitting unit having at least one radar transmitting antenna and being configured for transmitting radar waves towards the vehicle passenger compartment. The radar sensor system further comprises a radar receiving unit having at least one radar receiving antenna and being configured for receiving radar waves that have been transmitted by the radar transmitter unit and that have been reflected by passengers that are present in the vehicle passenger compartment. Moreover, the radar sensor system includes an evaluation and control unit that is configured for evaluating Doppler information from the radar waves received by the radar receiving unit and for automatically executing steps of the method disclosed herein.
[0029] The benefits described in context with the method proposed herein apply to the radar sensor system to the full extent.
[0030] Preferably, the evaluation and control unit comprises a processor unit and a digital data memory unit to which the processor unit has data access. In this way, the steps of the method disclosed herein can be performed within the radar sensor system to ensure a fast and undisturbed signal processing and evaluation.
[0031] Preferably, a radar carrier frequency of the transmitted radar waves lies in a frequency range between 2 GHz and 130 GHz, and more preferably in the frequency range between 57 GHz and 64 GHz. In this way, a sufficient spatial resolution can be achieved for the valuated Doppler information by the radar sensor system in an economic manner.
[0032] In yet another aspect of the invention, a software module for controlling automatic execution of the method disclosed herein is provided.
[0033] The method steps to be conducted are converted into a program code of the software module, wherein the program code is implementable in a digital memory unit of the radar sensor system or a separate control unit and is executable by a processor unit of the radar sensor system or a separate control unit. Preferably, the digital memory unit and/or processor unit may be a digital memory unit and/or a processing unit of the control and evaluation unit of the radar sensor system. The processor unit may, alternatively or supplementary, be another processor unit that is especially assigned to execute at least some of the method steps.
[0034] The software module can enable a robust and reliable automatic execution of the method and can allow for a fast modification of method steps if desired.
[0035] These and other aspects of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
[0036] It shall be pointed out that the features and measures detailed individually in the preceding description can be combined with one another in any technically meaningful manner and show further embodiments of the invention. The description characterizes and specifies the invention in particular in connection with the figures.
Brief Description of the Drawings [0037] Further details and advantages of the present invention will be apparent from the following detailed description of not limiting embodiments with reference to the attached drawing, wherein:
Fig. 1 schematically illustrates, in a side view, a configuration of an embodiment of a radar sensor system in accordance with the invention while executing an operation method for determining a number of passengers in a vehicle passenger compartment,
Fig. 2 shows a plot of an in-phase radar signal received by a radar receiving antenna of the radar sensor system pursuant to Fig. 1 observing a breathing motion of two passengers in the presence of vibrations of a car driving over street bumps, and
Fig. 3 shows a plot of a maximal overlap discrete wavelet transform of the radar signal pursuant to Fig. 2,
Fig. 4 is a flowchart of an embodiment of the method in accordance with the invention of operating the radar sensor system pursuant to Fig. 1 for determining a number of passengers in a vehicle passenger compartment.
Description of Preferred Embodiments [0038] Fig. 1 schematically illustrates a configuration of an embodiment of the radar sensor system 10 in accordance with the invention while executing an operating method for determining a number of passengers in a vehicle passenger compartment 30 that is formed by a passenger car compartment of a sedan-type passenger car. Fig. 1 shows a side view of a passenger 24 occupying a driver’s seat. More passengers (not shown) may be present, occupying the passenger front seat and/or one seat each of a three-seat rear bench of the passenger car.
[0039] The radar sensor system 10 comprises a radar transmitting unit having two radar transmitting antennas. The radar transmitting unit is configured for supplying the two radar transmitting antennas with radar waves having a radar carrier frequency. A front radar transmitting antenna 12 is installed in a front region of the headliner, and a rear radar transmitting antenna (not shown) is installed in a center region of the headliner. Both the radar transmitting antennas 12 are rearward directed. The radar transmitting unit is configured for transmitting radar waves 14 via the radar transmitting antennas 12 towards the vehicle passenger compartment 30, and more specifically towards a chest 26 and an abdominal region 28 of the driver and other potentially present passengers. In this specific embodiment, a radar carrier frequency of the radar sensor system 10 is selectable within a radar frequency range between 2 GHz and 130 GHz, and more preferably in the frequency range between 57 GHz and 64 GHz.
[0040] The radar sensor system 10 further includes a radar receiving unit having two radar receiving antennas 16 and being configured for receiving radar waves 18 that have been transmitted by the radar transmitter unit and have been reflected by one or more of the passengers 24 that are present in the vehicle passenger compartment 30.
[0041] Each of the radar transmitting antennas 12 is paired with one of the radar receiving antennas 16 to be co-located in a monostatic arrangement, which is indicated in Fig. 1 by use of a combined symbol. In this specific embodiment, the radar transmitter unit and the radar receiving unit form an integral part of a transceiver unit 20, sharing common electronic circuitry and a common housing. In other embodiments, the radar transmitter unit and the radar receiving unit may be designed as separate units.
[0042] Moreover, the radar sensor system 10 comprises an evaluation and control unit 22 that is configured for evaluating Doppler information from the radar waves 18 received by the radar receiving unit. The evaluation and control unit 22 is connected to the radar transmitting unit for controlling operation of the radar transmitting unit. The evaluation and control unit 22 is also connected to the radar receiving unit for receiving radar signals generated by the radar receiving unit. The evaluation and control unit 22 comprises a processor unit and a digital data memory unit (not shown) to which the processor unit has data access. The evaluation and control unit 22 is configured for recording the received radar signals generated by the radar receiving unit in the digital data memory unit. Moreover, the evaluation and control unit 22 includes a classifier for signal processing, as will be described hereinafter.
[0043] In the following, an embodiment of a method of operating the radar sensor system 10 for determining a number of passengers 24 in the vehicle passenger compartment 30 will be described with reference to Fig. 1 and Fig. 4, which provides a flowchart of the method. In preparation of operating the radar sensor system 10, it shall be understood that all involved units and devices are in an operational state and configured as illustrated in Fig. 1.
[0044] In order to be able to carry out the method automatically and in a controlled way, the evaluation and control unit 22 comprises a software module. The method steps to be conducted are converted into a program code of the software module. The program code is implemented in the digital data memory unit of the evaluation and control unit 22 and is executable by the processor unit of the evaluation and control unit 22.
[0045] Execution of the method may be initiated by turning on the passenger car ignition. In a first step 36 of the method, the radar transmitting unit is operated by the evaluation and control unit 22 for transmitting radar waves 14 towards the vehicle passenger compartment 30. In another step 38, the radar receiving unit is operated by the evaluation and control unit 22 for receiving radar waves 18 that have been transmitted by the radar transmitting unit and that have been reflected by a passenger 24 or by passengers that are present in the vehicle passenger compartment 30, and, more specifically, have been reflected by the chest and the abdominal region of the passenger 24 or the passengers.
[0046] In another step 40, the radar receiving unit is operated by the evaluation and control unit 22 for generating received radar signals 32 from the received radar waves 18. The step 40 of generating the received radar signals 32 includes low pass filtering and mixing in a conventional manner.
[0047] A plot of the received in-phase radar signal 32 while observing a breathing motion of two passengers 24 (only one passenger shown) in the presence of vibrations of the passenger car driving over street bumps is shown in Fig. 2.
[0048] The received radar signals 32 are mathematically decomposed by the evaluation and control unit 22 into a plurality of received signal components in a next step 42. The step 42 of mathematically decomposing the received radar signals 32 comprises to perform a maximum-overlap discrete wavelet transform (MODWT) 34 (Fig. 3). In this specific embodiment, the well-known orthogonal Daubechies wavelets are used, having 45 vanishing moments, but in principle other wavelet transforms may be employed that appear suitable to those skilled in the art.
[0049] Each received signal component of the plurality of received signal components has a different value regarding a characteristic parameter that is unique among the plurality of received signal components, the characteristic parameter given by a level of the Daubechies wavelets. The value regarding the characteristic parameter is given by the individual energy contained in a specific level of the Daubechies wavelets.
[0050] Referring again to Fig. 4, the different values of the plurality of received signal components regarding the energy contained in a specific level of the Daubechies wavelets is provided as an input to the classifier of the evaluation and control unit 22 in another step 44 of the method. The classifier is formed by a support vector machine and has been trained by supervised learning using data representing a plurality of scenarios with different numbers of passengers 24 in the vehicle passenger compartment 30.
[0051] The training has been conducted in a preceding step 50. The data representing the various scenarios used for training the classifier comprised data simulating road roughness condition. Based on the article “Generation of Random Road Profiles" by Feng Tyan et al., Journal of Advanced Engineering 4.2 (2009), road roughness levels A to E have been implemented. Road roughness level C represents a vertical road profile with an average road roughness.
[0052] Further, in the various scenarios used for the step 50 of training the classifier a number of passengers 24 is varied, starting from a driver occupying the driver’s seat and one passenger occupying one of the other seats, with the other seats being unoccupied, adding another passenger occupying another one of the other seats, up to a driver occupying the driver’s seat and four passengers occupying the other seats.
[0053] A sufficient level of training has to be applied to the classifier for executing the method, but additional training data can be transferred to the classifier at any later point in time, for instance as a software update during passenger car maintenance, for improved accuracy in determining the number of passengers 24 present in the vehicle passenger compartment 30.
[0054] In another step 46 of the method, based on the different values of the plurality of received signal components regarding the energy contained in specific levels of the Daubechies wavelets, the classifier identifies one of the trained scenarios.
[0055] In a next step 48 of the method, the evaluation and control unit 22 generates an output signal that is indicative of the identified scenario. The output signal can be transferred to an ADAS of the passenger car for further use.
[0056] All received radar signals, values of the received signal components regarding the characteristic parameter and training data representing a plurality of scenarios with different numbers of passengers mentioned in this description can reside at least temporarily in the digital data memory unit of the evaluation and control unit 22 and can readily be retrieved by the processor unit of the evaluation and control unit 22.
[0057] The effectiveness of the proposed method has been examined by carrying out simulations, in which a different set of possible scenarios has been used, given by 1. two passengers on the front seats, 2. one passenger and an empty seat, and 3. two empty seats.
[0058] The set of possible scenarios includes road roughness levels A to E in a first training data set, and roughness levels A to C in a second training data set.
[0059] Each passenger’s breathing motion was simulated using random breathing frequencies, breathing amplitudes of 4 mm and 5 mm, respectively, and a radar cross section of each passenger’s chest of 0.34 m2. 1440 sets of received radar signals were simulated, using half of the data sets for the step of training the classifier in a supervised manner, and using the previously mentioned characteristic parameter and the Daubechies wavelet transform having 45 vanishing moments. The other half of the data sets was used for examining the method effectiveness.
[0060] For the first training data set with road roughness classes A to E, a portion of 82.9% for a scenario being properly identified by the classifier could be achieved. For the second training data set with road roughness classes A to C, the respective portion was 99%.
[0061] While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments.
[0062] Other variations to be disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality, which is meant to express a quantity of at least two. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. Any reference signs in the claims should not be construed as limiting scope.
List of Reference Symbols 10 radar sensor system 12 radar transmitting antenna 14 transmitted radar waves 16 radar receiving antenna 18 received radar waves 20 transceiver unit 22 evaluation and control unit 24 passenger 26 chest 28 abdominal region 30 vehicle passenger compartment 32 received radar signal 34 maximum-overlap wavelet transform
Method steps 36 transmit radar waves 38 receive reflected radar waves 40 generate received radar signals 42 decompose received radar signals 44 provide values of energy contained in wavelet levels to classifier 46 identify trained scenario based on provided values of energy 48 generate output signal 50 train classifier by supervised learning

Claims (10)

1. Verfahren zum Betreiben eines Radarsensorsystems (10) zur Bestimmung einer Anzahl von Fahrgästen (24) in einem Fahrzeugfahrgastraum (30), wobei das Radarsensorsystem (10) eine Radarsendeeinheit mit mindestens einer Radarsendeantenne (12), die dafür ausgelegt ist, Radarwellen (14) zu dem Fahrzeugfahrgastraum (30) zu übertragen, eine Radarempfangseinheit mit mindestens einer Radarempfangsantenne (16), die dafür ausgelegt ist, Radarwellen (18) zu empfangen, die von der Radarsendereinheit übertragen und von Fahrgästen (24), die sich in dem Fahrzeugfahrgastraum (30) aufhalten, reflektiert worden sind, und eine Auswerte- und Steuereinheit (22) aufweist, die zumindest zum Auswerten von Dopplerinformationen aus den von der Radarempfangseinheit empfangenen Radarwellen (18) ausgelegt ist, wobei das Verfahren mindestens die folgenden Schritte aufweist: Betreiben (36) der Radarsendeeinheit zum Übertragen von Radarwellen (14) zum Fahrzeugfahrgastraum (30), Betreiben (38) der Radarempfangseinheit zum Empfangen von Radarwellen (18), die von der Radarsendeeinheit übertragen und von einem Fahrgast (24) oder von Fahrgästen, der/die sich in dem Fahrzeugfahrgastraum (30) aufhält/aufhalten, reflektiert worden sind, Betreiben (40) der Radarempfangseinheit zum Erzeugen von empfangenen Radarsignalen (32) von den empfangenen Radarwellen (18), mathematisches Zerlegen (42) der empfangenen Radarsignale (32) in mehrere empfangene Signalkomponenten, wobei jede empfangene Signalkomponente einen anderen Wert betreffend mindestens einen charakteristischen Parameter aufweist, Bereitstellen (44) von Werten der empfangenen Signalkomponenten betreffend den mindestens einen charakteristischen Parameter für einen Klassifikator, der durch überwachtes Lemen unter Verwendung von Daten trainiert worden ist, die mehrere Szenarien mit verschiedenen Anzahlen von Fahrgästen (24) in dem Fahrzeugfahrgastraum (30) darstellen, basierend auf den bereitgestellten Werten der empfangenen Signalkomponenten betreffend den mindestens einen charakteristischen Parameter, Identifizieren (46) eines der trainierten Szenarien, Erzeugen (48) eines Ausgangssignals, das das identifizierte Szenarium anzeigt.A method of operating a radar sensor system (10) to determine a number of passengers (24) in a vehicle passenger compartment (30), the radar sensor system (10) comprising a radar transmitter unit having at least one radar transmitter antenna (12) adapted for radar waves (14 ) to the vehicle passenger compartment (30), a radar receiving unit having at least one radar receiving antenna (16) adapted to receive radar waves (18) transmitted from the radar transmitter unit and passengers (24) located in the vehicle passenger compartment (16). 30), and having an evaluation and control unit (22) which is at least designed to evaluate Doppler information from the radar waves (18) received by the radar receiving unit, the method comprising at least the following steps: operating (36 ) of the radar transmitting unit for transmitting radar waves (14) to the vehicle passenger compartment (30), operating (38) the radar receiver A unit for receiving radar waves (18) transmitted from the radar transmitting unit and reflected by a passenger (24) or passengers staying in the vehicle passenger compartment (30), driving (40) the radar receiving unit to Generating received radar signals (32) from the received radar waves (18), mathematically decomposing (42) the received radar signals (32) into a plurality of received signal components, each received signal component having a different value relating to at least one characteristic parameter, providing (44) Values of the received signal components relating to the at least one characteristic parameter for a classifier trained by supervised learning using data representing multiple scenarios with different numbers of passengers (24) in the vehicle passenger compartment (30) based on the provided values the received signal component n relating to the at least one characteristic parameter, identifying (46) one of the trained scenarios, generating (48) an output signal indicative of the identified scenario. 2. Verfahren nach Anspruch 1, wobei der Schrift (42) des mathematischen Zerlegens der empfangenen Radarsignale (32) das Ausführen einer diskreten Wavelet-Transformation umfasst, und wobei der mindestens eine charakteristische Parameter durch eine Ebene der Wavelets gebildet wird und der Wert betreffend den mindestens einen charakteristischen Parameter durch die individuelle Energie gegeben ist, die in einer spezifischen Ebene der Wavelets enthalten ist.The method of claim 1, wherein the script (42) of mathematically decomposing the received radar signals (32) comprises performing a discrete wavelet transform, and wherein the at least one characteristic parameter is formed by a plane of the wavelets and the value relating to at least one characteristic parameter is given by the individual energy contained in a specific plane of the wavelets. 3. Verfahren nach Anspruch 1, wobei der Schritt (42) des mathematischen Zerlegens der empfangenen Radarsignale (32) das Ausführen einer diskreten Wavelet-Transformation umfasst, und femer einen Schritt des Berechnens der Hilbert-Transformation fur verschiedene Ebenen der Wavelets umfasst, urn den mindestens einen charakteristischen Parameter zu bestimmen, der durch eine momentane Frequenz der verschiedenen Ebenen der Wavelets gegeben ist.3. The method of claim 1, wherein the step (42) of mathematically decomposing the received radar signals (32) comprises performing a discrete wavelet transform, and further comprising a step of calculating the Hilbert transform for different levels of the wavelets determine at least one characteristic parameter given by an instantaneous frequency of the different planes of the wavelets. 4. Verfahren nach Anspruch 1, wobei der Schrift (42) des mathematischen Zerlegens der empfangenen Radarsignale (32) das Ausfuhren einer diskreten Fourier-Transformation umfasst und wobei der mindestens eine charakteristische Parameter durch die Frequenz gegeben ist und der Wert betreffend den mindestens einen charakteristischen Parameter durch einen Fourier-Koeffizienten gegeben ist.4. The method of claim 1, wherein the script (42) of mathematically decomposing the received radar signals (32) comprises exporting a discrete Fourier transform and wherein the at least one characteristic parameter is given by the frequency and the value relating to the at least one characteristic Parameter is given by a Fourier coefficient. 5. Verfahren nach einem der vorhergehenden Ansprüche, wobei der Schritt (46) des Identifizierens eines der trainierten Szenarien durch den Klassifikator ausgeführt wird, der durch eine Support Vector Machine oder ein neurales Netz gebildet ist.The method of any one of the preceding claims, wherein the step (46) of identifying one of the trained scenarios is performed by the classifier formed by a support vector machine or a neural network. 6. Verfahren nach einem der vorhergehenden Ansprüche, wobei die Daten, die die verschiedenen Szenarien darstellen, die zum Trainieren des Klassifikators verwendet werden, Daten aufweisen, die mindestens einen Zustand einer unebenen Straße simulieren.A method according to any one of the preceding claims, wherein the data representing the various scenarios used to train the classifier comprises data simulating at least one rough road condition. 7. Verfahren nach einem der vorhergehenden Ansprüche, wobei der Fahrzeugfahrgastraum (30) ein Personenwagenraum ist, wobei der Schritt (44) des Bereitstellens von Werten der empfangenen Signalkomponenten betreffend den mindestens einen charakteristischen Parameter für einen Klassifikator, der durch überwachtes Lernen unter Verwendung von Daten trainiert worden ist, die mehrere Szenarien mit verschiedenen Anzahlen an Fahrgästen (24) darstellen, einen Schritt (50) des Trainierens des Klassifikators mit mehreren Szenarien umfasst, mindestens aufweisend einen Fahrersitz, einen vorderen Fahrgastsitz, und eine dreisitzige Rückbank, und wobei in den verschiedenen Szenarien eine Anzahl von Fahrgästen (24) variiert wird, beginnend mit einem Fahrer, der den Fahrersitz belegt, und einem Fahrgast, der einen der anderen Sitze belegt, wobei die anderen Sitze nicht belegt sind, Hinzufügen eines weiteren Fahrgastes, der einen weiteren der anderen Sitze belegt, bis zu einem Fahrer, der den Fahrersitz belegt und vier Fahrgästen, die die anderen Sitze belegen.The method of any preceding claim, wherein the vehicle passenger compartment (30) is a passenger compartment, wherein the step (44) of providing values of the received signal components relating to the at least one characteristic parameter for a classifier by supervised learning using data 24, comprising a plurality of scenarios with different numbers of passengers (24), a step (50) of training the multi-scenario classifier, comprising at least one driver's seat, a front passenger seat, and a three-seat rear bench, and wherein in the various Scenarios is varied a number of passengers (24), starting with a driver who occupies the driver's seat, and a passenger who occupies one of the other seats, the other seats are not occupied, adding another passenger who another of the other Seats occupied, up to a driver who drives the car occupied and four passengers occupying the other seats. 8. Radarsensorsystem (10) zum Bestimmen einer Anzahl von Fahrgästen (24) in einem Fahrzeugfahrgastraum (30), umfassend eine Radarsendeeinheit mit mindestens einer Radarsendeantenne (12), wobei die Radarsendeeinheit dafür ausgelegt ist, Radarwellen (14) zum Fahrzeugfahrgastraum (30) zu übertragen, eine Radarempfangseinheit mit mindestens einer Radarempfangsantenne (16), wobei die Radarempfangseinheit dafür ausgelegt ist, Radarwellen (18) zu empfangen, die von der Radarsendereinheit übertragen und von Fahrgästen (24), die sich in dem Fahrzeugfahrgastraum (30) aufhalten, reflektiert worden sind, und eine Auswerte- und Steuereinheit (22), die dafür ausgelegt ist, Dopplerinformationen von den Radarwellen (18), die von der Radarempfangseinheit empfangen werden, auszuwerten, und automatisch die Schritte des Verfahrens nach einem der vorhergehenden Ansprüche auszuführen.A radar sensor system (10) for determining a number of passengers (24) in a vehicle passenger compartment (30) comprising a radar transmitter unit having at least one radar transmitter antenna (12), the radar transmitter unit being configured to radar shafts (14) to the vehicle passenger compartment (30) a radar receiving unit having at least one radar receiving antenna (16), the radar receiving unit being adapted to receive radar waves (18) transmitted from the radar transmitter unit and reflected by passengers (24) residing in the vehicle passenger compartment (30) and an evaluation and control unit (22) adapted to evaluate Doppler information from the radar waves (18) received by the radar receiving unit, and to automatically carry out the steps of the method according to any one of the preceding claims. 9. Radarsensorsystem (10) nach Anspruch 8, wobei eine Radarträgerfrequenz der übertragenen Radarwellen (14) in einem Frequenzbereich zwischen 2 GHz und 130 GHz und stärker bevorzugt im Frequenzbereich zwischen 57 GHz und 64 GHz liegt.The radar sensor system (10) of claim 8, wherein a radar carrier frequency of the transmitted radar waves (14) is in a frequency range between 2 GHz and 130 GHz, and more preferably in the frequency range between 57 GHz and 64 GHz. 10.Softwaremodul zum Steuern einer automatischen Ausführung des Verfahrens nach einem der Ansprüche 1 bis 7, wobei auszuführende Verfahrensschritte in einen Programmcode des Softwaremoduls umgewandelt sind, wobei der Programmcode in einer digitalen Datenspeichereinheit des Radarsensorsystems oder einer separaten Steuereinheit implementierbar und von einer Prozessoreinheit des Radarsensorsystems oder einer separaten Steuereinheit ausführbar ist.10.Software module for controlling an automatic execution of the method according to one of claims 1 to 7, wherein executed process steps are converted into a program code of the software module, the program code in a digital data storage unit of the radar sensor system or a separate control unit implementable and by a processor unit of the radar sensor system or a separate control unit is executable.
LU100451A 2017-07-13 2017-09-21 System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment LU100451B1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
LU100451A LU100451B1 (en) 2017-09-21 2017-09-21 System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment
CN201880046547.1A CN110891829A (en) 2017-07-13 2018-07-13 System and method for radar-based determination of the number of passengers in a passenger compartment of a vehicle
PCT/EP2018/069065 WO2019012099A1 (en) 2017-07-13 2018-07-13 System and method for radar-based determination of a number of passengers inside a vehicle passenger compartment
EP18739855.7A EP3652026B1 (en) 2017-07-13 2018-07-13 System and method for radar-based determination of a number of passengers inside a vehicle passenger compartment
US16/630,778 US11718255B2 (en) 2017-07-13 2018-07-13 System and method for radar-based determination of a number of passengers inside a vehicle passenger compartment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
LU100451A LU100451B1 (en) 2017-09-21 2017-09-21 System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment

Publications (1)

Publication Number Publication Date
LU100451B1 true LU100451B1 (en) 2019-03-29

Family

ID=60051560

Family Applications (1)

Application Number Title Priority Date Filing Date
LU100451A LU100451B1 (en) 2017-07-13 2017-09-21 System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment

Country Status (1)

Country Link
LU (1) LU100451B1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020003345A1 (en) * 1999-04-19 2002-01-10 Stanley James G. Occupant detection system
US20050046584A1 (en) * 1992-05-05 2005-03-03 Breed David S. Asset system control arrangement and method
JP2012225825A (en) * 2011-04-21 2012-11-15 Hino Motors Ltd Radar device, bus, and passenger movement detection method, and program
WO2015022358A1 (en) * 2013-08-14 2015-02-19 Iee International Electronics & Engineering S.A. Radar sensing of vehicle occupancy

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050046584A1 (en) * 1992-05-05 2005-03-03 Breed David S. Asset system control arrangement and method
US20020003345A1 (en) * 1999-04-19 2002-01-10 Stanley James G. Occupant detection system
JP2012225825A (en) * 2011-04-21 2012-11-15 Hino Motors Ltd Radar device, bus, and passenger movement detection method, and program
WO2015022358A1 (en) * 2013-08-14 2015-02-19 Iee International Electronics & Engineering S.A. Radar sensing of vehicle occupancy

Similar Documents

Publication Publication Date Title
US11718255B2 (en) System and method for radar-based determination of a number of passengers inside a vehicle passenger compartment
CN112272779B (en) Method for robust vehicle occupancy detection through vital sign monitoring
LU93324B1 (en) Polarimetric Radar System and Method for Detecting and Classifying Vehicle Occupants and Other Objects in a Vehicle Interior
CN105452898B (en) The riding radar sensing of vehicle
CN106456062A (en) Method and system for unattended child detection
CN115023744B (en) Method for operating a radar sensor system for vital sign detection, which eliminates signals excited by interfering movements
LU100925B1 (en) Removing noise caused by vehicular movement from sensor signals using Deep Neural Networks
CN108919218A (en) A kind of contactless number of people in car and the method and device of position judgement
WO2020202159A1 (en) System for determining object status and method thereof
LU100451B1 (en) System and Method for Radar-Based Detremination of a Number of Passengers inside a Vehicle Passenger Compartment
CN113925479B (en) Life monitoring method and device based on intelligent vehicle-mounted box
KR20220104444A (en) Apparatus for recognizing passenger based on radar and method thereof
DE102018117516B3 (en) Detection and elimination of interference signals by coded ultrasonic emissions on an ultrasonic sensor
Ranta et al. Detection of human presence in a vehicle by vibration analysis
WO2023144977A1 (en) Occupant state detection device
DE102021128801A1 (en) Biological detection device
Sriranga et al. Novel radar based in-vehicle occupant detection using convolutional neural networks
JP2023101293A (en) Biological information detection device
LU100364B1 (en) Radar-Based Passenger Classification and Monitoring
LU100894B1 (en) Method for Robust Vehicle Occupancy Detection with Vital Sign Monitoring
DE102021128802A1 (en) Biological detection device
JP2023150739A (en) Occupant detection device and program
WO2023156312A1 (en) Method and system for detecting a seat occupancy state of a seating arrangement on the basis of radar point clouds
DE102022119526A1 (en) METHOD AND SYSTEM FOR DETECTING THE PRESENCE OF LIFE IN A VEHICLE
DE112020007622T5 (en) BODY DETECTION DEVICE, BODY DETECTION METHOD, SEAT BELT REMINDER SYSTEM AND AIR BAG CONTROL SYSTEM

Legal Events

Date Code Title Description
FG Patent granted

Effective date: 20190329