WO2023016350A1 - Seat occupancy identification method and vehicle control method using same - Google Patents
Seat occupancy identification method and vehicle control method using same Download PDFInfo
- Publication number
- WO2023016350A1 WO2023016350A1 PCT/CN2022/110322 CN2022110322W WO2023016350A1 WO 2023016350 A1 WO2023016350 A1 WO 2023016350A1 CN 2022110322 W CN2022110322 W CN 2022110322W WO 2023016350 A1 WO2023016350 A1 WO 2023016350A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- echo signal
- area
- occupancy
- time
- vehicle
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 103
- 238000005070 sampling Methods 0.000 claims abstract description 94
- 238000012545 processing Methods 0.000 claims abstract description 36
- 238000001514 detection method Methods 0.000 claims abstract description 28
- 238000004590 computer program Methods 0.000 claims description 39
- 230000009466 transformation Effects 0.000 claims description 14
- 238000009825 accumulation Methods 0.000 claims description 9
- 230000001427 coherent effect Effects 0.000 claims description 8
- 230000000007 visual effect Effects 0.000 claims description 7
- 230000014759 maintenance of location Effects 0.000 claims description 6
- 230000000875 corresponding effect Effects 0.000 claims 17
- 230000001276 controlling effect Effects 0.000 claims 1
- 230000006870 function Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000004364 calculation method Methods 0.000 description 5
- 230000003068 static effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000007958 sleep Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 239000000428 dust Substances 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 206010003497 Asphyxia Diseases 0.000 description 1
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 208000027418 Wounds and injury Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000006378 damage Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000005059 dormancy Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 208000014674 injury Diseases 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60H—ARRANGEMENTS OF HEATING, COOLING, VENTILATING OR OTHER AIR-TREATING DEVICES SPECIALLY ADAPTED FOR PASSENGER OR GOODS SPACES OF VEHICLES
- B60H1/00—Heating, cooling or ventilating [HVAC] devices
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60J—WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES; REMOVABLE EXTERNAL PROTECTIVE COVERINGS SPECIALLY ADAPTED FOR VEHICLES
- B60J7/00—Non-fixed roofs; Roofs with movable panels, e.g. rotary sunroofs
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R22/00—Safety belts or body harnesses in vehicles
- B60R22/48—Control systems, alarms, or interlock systems, for the correct application of the belt or harness
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/93—Radar or analogous systems specially adapted for specific applications for anti-collision purposes
- G01S13/931—Radar or analogous systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S3/00—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received
- G01S3/02—Direction-finders for determining the direction from which infrasonic, sonic, ultrasonic, or electromagnetic waves, or particle emission, not having a directional significance, are being received using radio waves
- G01S3/14—Systems for determining direction or deviation from predetermined direction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
- G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/14—Fourier, Walsh or analogous domain transformations, e.g. Laplace, Hilbert, Karhunen-Loeve, transforms
Definitions
- the present application belongs to the technical field of radar, and in particular relates to an occupancy recognition method and a vehicle control method using the same.
- vehicle security is gradually shifting from physical security to cyber security and safety assistance systems.
- vehicle occupancy recognition that is, judging whether a certain seat is occupied
- vehicle occupancy recognition is mostly detected by a pressure sensor, and then judged by the wearing state of the seat belt whether to issue an alarm.
- collect the image information of a certain location through the camera and then judge whether there is a person in the location, and then judge whether to issue an alarm based on the wearing status of the seat belt.
- the misjudgment rate of the pressure sensor is high, which leads to a low accuracy rate of the seat belt warning.
- the camera has extremely high requirements on light, is easily affected by dust, etc., and has high cost, and also has the problem of high misjudgment rate. That is, the existing seat belt warning method is prone to misjudgment, and the accuracy of occupancy recognition is poor.
- the present application provides an occupancy recognition method and a vehicle control method using the same, aiming to solve the problems of easy misjudgment and poor occupancy recognition accuracy in existing seat belt warning methods.
- the present application provides a method for occupancy identification, including:
- each antenna echo signal in the preset area is an echo signal obtained by detecting a preset area inside the vehicle;
- For each time-domain echo signal in the time-domain echo signal set perform one-dimensional FFT (Fast Fourier Transform, Fast Fourier Transform) processing on the time-domain echo signal to obtain distance information of the time-domain echo signal;
- FFT Fast Fourier Transform, Fast Fourier Transform
- each time-domain echo signal in the time-domain echo signal set determines the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signal sets corresponding to each occupancy area, Determine whether each occupied area is occupied.
- an occupancy recognition device including:
- the sampling module is used to sample each antenna echo signal in the preset area to obtain a time-domain echo signal set; each antenna echo signal in the preset area is the echo obtained by detecting the preset area inside the vehicle wave signal;
- the transformation module is used for performing one-dimensional FFT processing on each time domain echo signal in the time domain echo signal set to obtain the distance information of the time domain echo signal;
- the judging module is configured to determine the time domain echo signals corresponding to each occupying area inside the vehicle according to the distance information of each time domain echo signal in the time domain echo signal set, and determine the time domain echo signals corresponding to each occupying area respectively according to the distance information of each occupying area in the time domain echo signal set domain echo signals to determine whether each occupancy area is occupied.
- the present application provides a first millimeter-wave radar, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor.
- the processor executes the computer program, the above-mentioned first aspect is realized. Steps of the placeholder recognition method.
- the present application provides a first computer-readable storage medium, where a computer program is stored in the first computer-readable storage medium, and when the computer program is executed by a processor, the steps of the occupancy identification method described in the above-mentioned first aspect are implemented.
- the present application provides a vehicle control method, including:
- vehicle status signals include unlock status signals, driving status signals or locking status signals;
- the vehicle state signal is an unlocked state signal
- the vehicle state signal is a driving state signal
- perform gesture recognition on the received echo signal in the first preset area and control the vehicle according to the gesture recognition result
- Execute the corresponding preset operation
- perform occupancy identification on the echo signal received in the second preset area and determine whether to perform a seat belt warning according to the occupancy identification result
- the vehicle state signal When the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life body identification on the received echo signal in the third preset area, and determine whether to perform a personnel detention alarm according to the life body identification result .
- the present application provides a vehicle control device, including:
- the acquiring module is used to acquire the vehicle state signal;
- the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal;
- the first control module is configured to send a detection signal to the first preset area when the vehicle state signal is an unlocked state signal; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle according to the gesture recognition result The vehicle performs the corresponding preset operation;
- the second control module is configured to send detection signals to the first preset area and the second preset area when the vehicle status signal is a driving status signal; perform gesture recognition on the received echo signal in the first preset area, And control the vehicle to perform the corresponding preset operation according to the gesture recognition result; perform occupancy recognition on the echo signal received in the second preset area, and determine whether to perform a seat belt warning according to the occupancy recognition result;
- the third control module is configured to send a detection signal to the third preset area when the vehicle status signal is a locked status signal; perform life body identification on the received echo signal in the third preset area, and identify the life body according to the life body identification As a result, it is determined whether to carry out an alarm for personnel retention.
- the present application provides a second millimeter-wave radar, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor.
- the processor executes the computer program, the vehicle described in the fifth aspect above The steps of the control method.
- the present application provides a second computer-readable storage medium, where a computer program is stored in the second computer-readable storage medium, and when the computer program is executed by a processor, the steps of the vehicle control method described in the above-mentioned first aspect are realized.
- the occupancy identification method realizes occupancy identification through the following steps: separately sample the echo signals of each antenna in the preset area to obtain a time-domain echo signal set; the preset area Each antenna echo signal is an echo signal obtained by detecting a preset area inside the vehicle; for each time domain echo signal in the time domain echo signal set, perform a one-dimensional FFT transformation on the time domain echo signal processing to obtain the distance information of the time-domain echo signal; determine the effective echo signal sets corresponding to each occupying area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set, and according to each The valid echo signal sets corresponding to the occupied areas respectively determine whether each occupied area is occupied.
- the antenna echo signal can accurately reflect the situation in the vehicle; by processing the antenna echo signal to determine whether the occupancy area is occupied, the accuracy of occupancy identification can be improved, thereby preventing misjudgment , Timely remind drivers and passengers to fasten their seat belts to ensure their personal safety.
- the vehicle control method controls the vehicle through the following steps: acquiring a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal; when it is an unlocked state signal, Perform gesture recognition on the echo signal received in the first preset area, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result; when it is a driving state signal, the received echo signal in the first preset area Perform gesture recognition on the signal, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result, perform occupancy recognition on the echo signal received in the second preset area, and determine whether to perform a seat belt warning according to the occupancy recognition result; When the signal is in a locked state, the received echo signal in the third preset area is identified as a living body, and it is determined whether to perform a personnel detention alarm according to the result of the living body identification.
- the millimeter-wave radar is used to obtain the echo signals in different areas, and the echo signals are analyzed to realize the gesture recognition of the vehicle, the judgment of the seat belt warning and the judgment of the personnel stranded warning; Therefore, according to the different states of the vehicle, the multifunctional intelligent auxiliary control of the vehicle can be realized, the control mode of the vehicle becomes diversified, the vehicle is more intelligent, and the user experience is optimized.
- Fig. 1 is the implementation flowchart of the occupancy identification method provided by the embodiment of the present application.
- Fig. 2 is a schematic diagram of the structural composition of the occupancy recognition device provided by the embodiment of the present application.
- Fig. 3 is a schematic diagram of a first millimeter-wave radar provided by an embodiment of the present application.
- Fig. 4 is an implementation flow chart of the vehicle control method provided by the embodiment of the present application.
- Fig. 5 is a schematic diagram of the structural composition of the vehicle control device provided by the embodiment of the present application.
- FIG. 6 is a schematic diagram of a second millimeter-wave radar provided by an embodiment of the present application.
- Millimeter wave radar can be installed on the roof of the vehicle.
- Millimeter wave radar can use monolithic microwave integrated circuit (Monolithic Microwave Integrated Circuit, MMIC) and multiple input multiple output (Multiple Input Multiple Output, MIMO) technology.
- MMIC monolithic microwave integrated circuit
- MIMO Multiple Input Multiple Output
- MMIC's highly integrated processor and sensors can reduce the size of mmWave radar.
- the arrangement of the MIMO array antenna can not only reduce the size of the antenna, but also ensure good angular resolution.
- the millimeter-wave radar can adopt the CAN (Controller Area Network, controller area network) communication method, and supports sleep wake-up network management and remote firmware flashing and upgrading functions.
- CAN Controller Area Network, controller area network
- advanced signal processing technology can be used to enable millimeter-wave radar to achieve multi-dimensional resolution such as distance, speed, azimuth and elevation angle, and further improve the recognition performance of targets in the vehicle.
- the radar can be installed in a non-exposed manner, that is, the radar can be installed between the inner roof of the vehicle and the outer sheet metal of the vehicle.
- This non-exposed installation method not only prevents the car body material from being cut and damaged, but also facilitates the installation of the radar, and makes the radar hidden between the ceiling and the sheet metal, so that passengers cannot feel the existence of the radar device at all, and will not give Passengers feel stressed.
- the occupancy identification method provided by the present application may include steps S101 to S103. The three steps are described below.
- each antenna echo signal in the preset area is an echo signal obtained by detecting a preset area inside the vehicle .
- the occupancy recognition method provided in the present application is executed by a millimeter-wave radar
- the preset area is an area that the millimeter-wave radar can detect inside the vehicle.
- the preset area may include a front seat area inside the vehicle, and/or a rear seat area inside the vehicle.
- Each antenna corresponds to one time-domain echo signal, and the time-domain echo signals of all antennas form a time-domain echo signal set.
- step S101 may be to perform ADC (Analog-to-Digital Converter) sampling on the antenna echo signal along the distance dimension and the time dimension for each antenna; when sampling, a fast time sampling method may be selected.
- ADC Analog-to-Digital Converter
- the millimeter wave radar includes multiple transmitting antennas and multiple receiving antennas arranged in an array.
- the millimeter-wave radar transmits multiple detection signals to the interior of the vehicle through multiple transmitting antennas, and receives corresponding multiple antenna echo signals through multiple receiving antennas.
- the millimeter-wave radar is powered on, and the transmitting antenna transmits electromagnetic waves of a specific frequency to the preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves carry target information.
- the target information includes the distance of the measured object in the preset area , speed, and spatial angle information; the receiving antenna receives the reflected electromagnetic wave (ie, echo signal), and samples the reflected electromagnetic wave to obtain a time-domain echo signal.
- step S102 the one-dimensional FFT processing can transform the time-domain echo signal into the frequency-domain echo signal, and then obtain the distance information of the time-domain echo signal in the preset area, that is, the time-domain echo signal can be obtained at The distance distribution of the preset area.
- the occupied area mentioned in step S103 may be a part of the preset area; for example, the preset area may be the front seat space inside the vehicle, and the occupied area may be the main driving area and/or the co-driving area.
- the occupancy area can be understood as the occupancy area is occupied; for example, one occupancy area is the co-pilot, and the occupancy area is occupied by the co-pilot.
- steps S101 to S103 perform occupancy identification through the following steps: each antenna echo signal in the preset area is sampled separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is a pair of The echo signal obtained by detecting the preset area inside the vehicle; for each time domain echo signal in the time domain echo signal set, perform one-dimensional FFT processing on the time domain echo signal to obtain the time domain echo signal Distance information; according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area The signal set is used to determine whether each occupied area is occupied.
- the antenna echo signal can accurately reflect the situation inside the vehicle; by processing the antenna echo signal, it is judged whether the occupancy area is occupied, which can improve the accuracy of occupancy recognition and prevent misjudgment. Timely remind drivers and passengers to fasten their seat belts to ensure their personal safety.
- each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points.
- the preset range described in step S1031 may be a range not smaller than the first preset distance value and not larger than the second preset distance value; wherein, the first preset distance value is smaller than the second preset distance value.
- the preset range can be determined according to the distance between the passenger and the millimeter wave radar.
- the distance between the passenger and the millimeter-wave radar is greater than 0.5m, so the preset range can be set to 0.5m ⁇ 1.5m.
- step S1031 selects time-domain echo signals whose distance values are in the range of 0.5m-1.5m as effective echo signals.
- the area within the preset range may be referred to as an effective area inside the vehicle, and each of the effective echo signals is an echo signal within the effective area.
- Step S1032 obtains position information of each effective echo signal by processing each effective echo signal in the effective area.
- the location information may include elevation angle information and azimuth angle information.
- Step S1033 according to the location information of each effective echo signal (for example, pitch angle information and azimuth angle information), associate each effective echo signal with each occupancy area, (that is, determine which occupancy area each effective echo signal comes from bit area), and then determine the effective echo signal set corresponding to each occupied area. According to the effective echo signal set corresponding to the occupied area, it can be further judged whether each occupied area is occupied.
- location information of each effective echo signal for example, pitch angle information and azimuth angle information
- each sampling point corresponds to an actual point in a preset area.
- two-dimensional DOA estimation in azimuth (horizontal) and pitch (longitudinal) directions between multiple antennas can be performed on each effective echo signal to obtain the position information of the sampling points corresponding to each effective echo signal, namely The position information of each sampling point within the preset distance range can be obtained.
- the power of the signal in the specified direction can be enhanced, and at the same time, sidelobe cancellation can be performed on the antenna to reduce clutter interference.
- the process of two-dimensional DOA estimation can be:
- the optimal weight coefficient W ⁇ R ⁇ , where ⁇ is a constant; then find min( W H RW ) ⁇ is the best target direction ⁇ .
- the pitch direction ⁇ is obtained, that is, the two-dimensional DOA estimation of azimuth and pitch is completed.
- each occupancy area inside the vehicle and the time-domain echo signal corresponding to each occupancy area may be determined according to the location information of the sampling points corresponding to each effective echo signal.
- the above S103 of "determining whether each occupied area is occupied according to the effective echo signal sets corresponding to each occupied area” may include the following steps:
- each occupancy area may correspond to a piece of point cloud information
- the point cloud information may include three-dimensional coordinates of each point cloud corresponding to the occupancy area.
- the fretting velocity of each point cloud of the occupied area may be calculated by means of existing technologies.
- each occupancy area may also include multiple point cloud information.
- Each point cloud information includes the three-dimensional coordinates of each point cloud therein.
- the time-domain echo signals including distance, azimuth, and elevation angle on each occupancy area can be pre-extracted to obtain the point cloud of each occupancy area information.
- "determine whether the occupied area is occupied according to the fretting speed of each point cloud of the occupied area" in the above S1035 may include the following steps:
- the occupied area is not occupied.
- each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points
- step S102 before "performing one-dimensional FFT processing on the time-domain echo signal", the occupancy identification method provided by the present application may further include the following steps:
- step S102 "performing one-dimensional FFT processing on the time-domain echo signal to obtain the distance information of the time-domain echo signal” includes the following steps:
- steps S104 to S106 realizes the static clutter removal of the echo signal in the time domain. Since the body micro-movement signal is a weak target, it is easily interfered by the complex echo of the cockpit. Steps S104 to S106 improve the accuracy of occupancy identification by performing static clutter removal on the time-domain echo signal.
- step S104 the formula for obtaining the signal average value of the echo signal at the sampling point is:
- the number of echo signals of the sampling points included, m is the number of time points, S i S m is the signal of the echo signal S i at time m .
- an average value along the time dimension of each sampling point in the distance dimension may be calculated, and the average value may be subtracted to obtain a filtered time-domain echo signal.
- the time-domain echo signal S ' [ S 1 - S mean , S 2 - S mean , ..., S n - S mean ] after removing static clutter is obtained; in this way, the interference of static clutter can be reduced.
- the occupancy identification method may further include the following steps:
- step S108 the vehicle's millimeter-wave radar can send the occupancy determination result to the vehicle's central control, and the vehicle's central control determines whether to issue a seat belt audible and visual warning based on the occupancy determination result and in combination with the other two conditions.
- step S108 when the occupancy determination result is that the occupancy area is not occupied, or the vehicle central control detects that the seat belt in the occupancy area is fastened, or detects that the speed of the vehicle is not greater than the preset speed threshold, do not proceed.
- Seat belt sound and light warning may include the following six steps:
- Step 1 The millimeter-wave radar sends detection signals to the preset area in the vehicle through multiple antennas, and samples the echo signals received from each antenna to obtain a time-domain echo signal set.
- Step 2 Static clutter removal is performed on each of the time-domain echo signals in the time-domain echo signal set to obtain a filtered time-domain echo signal set.
- Step 3 Perform one-dimensional FFT processing on the time-domain echo signals in the filtered time-domain echo signal set to obtain distance information of each time-domain echo signal.
- Step 4 According to the distance information of each time-domain echo signal, determine which occupancy area each time-domain echo signal corresponds to and the effective echo signal set corresponding to each occupancy area. From the distance information, select time-domain echo signals within a preset range as effective echo signals; perform two-dimensional DOA estimation on each effective echo signal, and obtain sampling points corresponding to each effective echo signal respectively The position information of each effective echo signal; determine the point cloud information of each occupied area according to the position information of the sampling points corresponding to each effective echo signal.
- Step 5 For each occupied area, calculate the fretting speed of each point cloud in the occupied area according to the point cloud information of the occupied area, and determine Whether the occupied area is occupied.
- Step 6 Send the occupancy determination result to the vehicle central control, and instruct the vehicle central control whether to issue seat belt audible and visual warnings.
- the size of the sequence number of each step does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not be used in the embodiment of the present application.
- the implementation process constitutes no limitation.
- FIG. 2 is a schematic diagram of the structural composition of the occupancy recognition device provided by the present application.
- FIG. 2 only shows the parts related to the present application, which are described in detail as follows.
- the occupancy identification device 20 may include a sampling module 201 , a transformation module 202 and a judging module 203 .
- the sampling module 201 is used to execute step S101, that is, to sample each antenna echo signal in the preset area respectively to obtain a time-domain echo signal set; each antenna echo signal in the preset area is a preview of the vehicle interior The echo signal obtained by setting the area for detection.
- the transformation module 202 is configured to execute step S102, that is, for each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT processing on the time-domain echo signal to obtain distance information of the time-domain echo signal.
- the judging module 203 is used to execute step S103, that is, determine the effective echo signal sets corresponding to each occupied area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set, and The valid echo signal sets corresponding to the areas respectively determine whether each occupied area is occupied.
- each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points.
- the judging module 203 may include an effective signal selection unit, an estimation unit, and an effective signal determination unit.
- the effective signal selection unit is used to perform step S1031, that is, for each time-domain echo signal in the time-domain echo signal set, from all distance values in the time-domain echo signal, select a distance within a preset range
- the echo signal at the sampling point is used as an effective echo signal corresponding to the time-domain echo signal.
- the estimating unit is configured to execute step S1032, that is, perform two-dimensional DOA estimation on each effective echo signal respectively, to obtain position information of sampling points corresponding to each effective echo signal.
- the effective signal determining unit is configured to perform step S1033, that is, determine effective echo signal sets corresponding to respective occupied areas inside the vehicle according to position information of sampling points corresponding to respective effective echo signals.
- the judging module 203 may further include a point cloud information determination unit and a calculation unit.
- the point cloud information determining unit is configured to execute step S1034, that is, obtain point cloud information of each occupied area according to the effective echo signal sets corresponding to each occupied area.
- the calculation unit is used to execute step S1035, that is, for each occupied area, calculate the fretting velocity of each point cloud of the occupied area according to the point cloud information of the occupied area, and calculate the fretting speed of each point cloud of the occupied area according to the The fretting speed of each point cloud determines whether the occupied area is occupied.
- the calculation unit is further configured to execute step S1036, that is, if the number of point clouds whose inching speed is greater than the preset inching speed in the occupied area is greater than the preset number, then It is determined that the occupied area is occupied.
- each time domain echo signal in the time domain echo signal set includes echo signals of multiple sampling points; in this embodiment, the occupancy identification device 20 may also include a preprocessing module and difference modules.
- the pre-processing module is used to execute step S104, that is, calculating the signal average value of the echo signals at each sampling point in the time-domain echo signal.
- the difference module is used to execute step S105, that is, the echo signal of each sampling point in the time-domain echo signal is respectively different from the corresponding signal average value to obtain the filtered time-domain echo signal time-domain echo signal.
- the transformation module 202 is further configured to execute step S106, that is, perform one-dimensional FFT processing on the filtered time-domain echo signal to obtain distance information of the time-domain echo signal.
- the occupancy identification device 20 may further include an occupancy sending module.
- the occupancy sending module is used to execute steps S107 and S108, that is, to send the occupancy determination results of each occupancy area to the vehicle central control; for the occupancy determination results of each occupancy area, when the occupancy determination result When the occupancy area is occupied, and the vehicle central control detects that the seat belt in the occupancy area is not fastened, and when the speed of the vehicle is detected to be greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupancy area will be performed. .
- Fig. 3 is a schematic diagram of the first millimeter-wave radar provided by the present application.
- the first millimeter wave radar 30 includes a processor 300 , a memory 301 , and a computer program 302 stored in the memory 301 and operable on the processor 300 .
- the processor 300 executes the computer program 302
- it can realize the steps in the above embodiments of the occupancy recognition method, for example, steps S101 to S103 shown in FIG. 1 .
- the processor 300 executes the computer program 302
- the functions of the modules/units in the above-mentioned device embodiments are realized, for example, the functions of the modules 201 to 203 shown in FIG. 2 .
- the computer program 302 can be divided into one or more modules/units, and these modules/units can be stored in the memory 301 and executed by the processor 300, so as to realize the inventive concept of the present application.
- These modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and these instruction segments are used to describe the execution process of the computer program 302 in the first millimeter wave radar 30 .
- the computer program 302 may be divided into instruction segments corresponding to the modules 201 to 203 shown in FIG. 2 .
- the first millimeter wave radar 30 may include, but not limited to, a processor 300 and a memory 301 . Those skilled in the art can understand that FIG. 3 is only an example of the first millimeter-wave radar 30 , and does not constitute a limitation to the first millimeter-wave radar 30 .
- the first millimeter wave radar may include more or fewer components than shown, or combine certain components, or different components.
- the present application also provides a first computer-readable storage medium.
- the storage medium stores a computer program.
- the computer program is executed by the processor, the steps described in the embodiments corresponding to the above-mentioned occupancy identification method can be realized, and the occupancy identification of the vehicle can be realized.
- the present application also provides a vehicle control method.
- Driving safety is gradually shifting from physical safety to network safety and safety assistance systems.
- the gesture control of the vehicle can collect images through the camera, and then recognize the image; then recognize the movement of the person, and then perform gesture control according to the recognition result.
- this control method is relatively simple and cannot meet user needs.
- the vehicle control method provided in the present application can realize gesture recognition through vehicle radar. Not only that, but the method can also realize the identification of living body and occupancy, so that the control mode of the vehicle becomes diversified, and the vehicle is also more intelligent.
- Fig. 4 is a flow chart of the implementation of the vehicle control method provided by the present application. As shown in Fig. 4, the vehicle control method provided by the present application may include steps S401 to S404. The four steps are described below.
- the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal.
- the vehicle control method provided in this application is executed by a millimeter-wave radar.
- the unlocked status signal indicates that the vehicle has been unlocked, but has not been started, and the vehicle is in a stationary state.
- the driving state signal indicates that the vehicle is running and the vehicle is in motion.
- the locked state signal indicates that the vehicle's power source (such as the engine or electric motor) has stopped, the doors are locked, and the vehicle is stationary.
- the unlocked state signal may be a signal sent by a car key, or a signal sent by a main driver's door lock.
- the locked state signal can be a signal sent by the car key, or a signal sent by the main driver's door lock.
- the first preset area may be a fixed gesture area.
- the interior equipment of the vehicle may include a sunroof or an air conditioner and the like.
- Gesture recognition in the unlocked state of the vehicle allows the driver to use gestures to turn on or off various functions of the vehicle, or to control various parameters of the vehicle, thus (especially when the vehicle is driving) to make the driver's attention more focused Focus more on observing the surrounding environment of the vehicle to better ensure driving safety.
- the transmitting antenna of the millimeter-wave radar transmits electromagnetic waves of a specific frequency to the fixed gesture area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves (ie Echo signal) carries various information of the fixed gesturing area; the receiving antenna of the millimeter wave radar receives the echo signal of the fixed gesturing area, and performs gesture recognition according to the echo signal; and then controls the vehicle according to the gesture recognition result Execute the corresponding preset operation.
- the vehicle's air conditioner or sunroof can be controlled according to the result of gesture recognition.
- the vehicle state signal is a driving state signal
- the vehicle is controlled to perform a corresponding preset operation; occupancy identification is performed on the echo signal received in the second preset area, and whether to perform a seat belt warning is determined according to the occupancy identification result.
- step S403 when identifying the occupancy of the echo signal in the second preset area, the occupancy identification method provided in the present application may be used, or the occupancy identification method in the prior art may be used.
- the second preset area is an area within the vehicle that can be detected by the millimeter-wave radar.
- the second preset area may include a front seat area inside the vehicle, and/or a rear seat area inside the vehicle.
- gesture recognition and/or occupancy recognition may be performed.
- Gesture recognition in the driving state of the vehicle can make the driver pay more attention to driving safety, avoid auxiliary operations such as switching the air conditioner or sunroof from distracting the driver's attention, and ensure the driving safety of the vehicle.
- the occupancy recognition through the detection signal can make the vehicle judge whether to carry out the seat belt warning, so as to remind the drivers and passengers who are not wearing seat belts in the driving state to wear seat belts, and provide safety protection for the drivers and passengers. Reduce or avoid injuries in the event of traffic accidents.
- the millimeter-wave radar works when it is powered on.
- the transmitting antenna of the millimeter-wave radar emits electromagnetic waves of a specific frequency to the second preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves ( That is, the echo signal) carries various information of the second preset area; the receiving antenna of the millimeter-wave radar receives the echo signal of the second preset area, and performs occupancy identification according to the echo signal, and then judges whether Carry out seat belt warning.
- the third preset area is a specific area inside the vehicle, which may include the passenger area and the trunk area, or may only be the passenger area. Identifying living organisms when the vehicle is locked can effectively prevent living organisms such as children or pets from being left in the vehicle and prevent tragedies from happening.
- the millimeter-wave radar is powered on and works.
- the transmitting antenna of the millimeter-wave radar transmits electromagnetic waves of a specific frequency to the third preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves ( That is, the echo signal) carries various information of the third preset area; the receiving antenna of the millimeter-wave radar receives the echo signal of the third preset area, and performs living body identification according to the echo signal, and then judges whether Carry out personnel stranded alarm.
- the personnel retention alarm can realize the anti-forgetting function of children.
- the millimeter-wave radar used in this application is not only suitable for detecting large-scale moving targets, but also has high detection accuracy for chest micro-movement signals.
- the millimeter-wave radar uses a large bandwidth of 4GHz, which can convert small chest displacements into obvious phase changes. When the frequency and correlation information of the phase meet the threshold requirements, it is determined that there is a real target, that is, there is a living body in the vehicle.
- steps S401 to S404 carry out vehicle control through the following steps: acquire the vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal; The area sends detection signals, performs gesture recognition on the received echo signals in the first preset area, and controls the vehicle to perform corresponding preset operations according to the gesture recognition results; Send detection signals from the set area and the second preset area, perform gesture recognition on the echo signal received in the first preset area, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result, and perform gesture recognition on the received second preset area.
- the echo signal in the preset area is used to identify the living body, and according to the result of the living body identification, it is determined whether to issue an alarm for personnel retention.
- the echo signals in different areas are obtained through the millimeter wave radar, and the echo signals are analyzed to realize the gesture recognition of the vehicle, the judgment of the safety belt warning and the judgment of the personnel stranded warning; thus, it can be based on different states of the vehicle. , realize the multi-functional intelligent auxiliary control of the vehicle, diversify the control methods of the vehicle, make the vehicle more intelligent, and optimize the user experience.
- the "determining whether to issue a seat belt warning based on the occupancy recognition result" in the above S403 may include the following steps:
- S4031 Send the occupancy recognition result to the vehicle central control (that is, the vehicle's central control system), when the occupancy recognition result is that the occupancy area is occupied, and the vehicle central control detects the seat belt in the occupancy area When it is not fastened and it is detected that the driving speed of the vehicle is greater than a preset speed threshold, a seat belt warning is issued in the occupied area; wherein the occupied area is an area in the second preset area.
- the vehicle central control that is, the vehicle's central control system
- the occupied area may be the main driving area and/or the co-driving area, both of which belong to the second preset area.
- the alarm form can be sound and light alarm.
- step S4031 may send the occupancy recognition results of each occupancy area to the vehicle central control.
- the vehicle central control detects that the seat belt of the occupancy area is not fastened, and detects that the vehicle When the speed of the vehicle is greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupied area will be carried out.
- the occupancy recognition result shows that the occupancy area is not occupied, or it is detected that the seat belt in the occupancy area has been fastened, or when it is detected that the speed of the vehicle is not greater than the preset speed threshold, no seat belt is performed. alarm.
- the "determining whether to perform a personnel detention alarm based on the result of the living body identification" in the above S404 may include the following steps:
- the identification result of the living body can be sent to the vehicle central control through the CAN bus, and the vehicle will be controlled to give a double-flashing whistle alarm; at the same time, the vehicle central control can send the alarm to The information is sent to the client's mobile phone, and a double alarm is issued to further protect the safety of stranded children.
- the vehicle control method may further include the following steps:
- the above two steps record the seat belt warning and personnel retention warning, so that the generation and application process of vehicle warning information can be further optimized through data analysis.
- the vehicle control method when the vehicle state signal is a locked state signal, the vehicle control method further includes the following steps:
- the millimeter-wave radar can realize the gesture recognition function, and then control the sunroof switch and the temperature of the air conditioner;
- the millimeter-wave radar detects whether there is a person on the seat.
- the vehicle speed is greater than a certain speed and there are people without seat belts, an audible and visual alarm will be issued to remind drivers and passengers to fasten their seat belts;
- the working time can be set by the user (for example, the above-mentioned 30min); after the working time is over, the millimeter-wave radar enters the sleep mode, the working current is ⁇ 100uA, and the power consumption is extremely low, which meets the vehicle safety requirements.
- the "occupancy identification of the received echo signal in the second preset area" in the above S403 may include the following steps S4031 to S4033. The three steps are described below.
- each antenna echo signal in the second preset area is a second preset area inside the vehicle. The detected echo signal.
- each antenna corresponds to one time-domain echo signal, and the time-domain echo signals of all antennas form a time-domain echo signal set.
- three-dimensional data of distance dimension, azimuth dimension and pitch dimension can be used to represent the three-dimensional position information of the measured object in spherical coordinates.
- the sampling described in step S4031 may be to perform ADC sampling on the antenna echo signal along the distance dimension and the time dimension for each antenna; when sampling, a fast time sampling method may be selected.
- the echo signals in the second preset area include multi-channel antenna echo signals.
- the one-dimensional FFT processing can transform the time-domain echo signal into the frequency-domain echo signal, and then obtain the distance information of the time-domain echo signal in the second preset area, that is, the time-domain echo signal can be obtained The distance distribution in the second preset area.
- each time-domain echo signal in the time-domain echo signal set determines the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area set to determine whether each occupancy area is occupied.
- the occupancy area is occupied can be understood as the occupancy area is occupied; for example, an occupancy area is the co-pilot, and the occupancy area is occupied by the co-pilot.
- each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance of the time-domain echo signal The information includes distance values of echo signals at multiple sampling points corresponding to the time-domain echo signal.
- step S4033 determining the effective echo signal sets corresponding to each occupancy area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set.
- the "gesture recognition of the received echo signal in the first preset area" in the above S402 or S403 may include the following steps:
- each antenna echo signal in the first preset area is obtained by detecting the first preset area inside the vehicle the echo signal;
- Point cloud data includes distance information and velocity information of each sampling point
- S4026 Perform gesture recognition according to spatial angle information of sampling points corresponding to each point cloud data in the target point cloud data set.
- the distance between the first preset area and the radar is less than 0.5m
- the gesture is an action with speed
- steps S4021 to S4026 can intercept point cloud data within 0 ⁇ 0.5m and with a non-zero speed
- the point cloud data is subjected to non-coherent accumulation processing, and all point cloud data whose magnitude after non-coherent accumulation processing is greater than the preset magnitude are selected to form the target point cloud data set.
- Non-coherent accumulation is a well-known technique in the art.
- each point cloud data in the target point cloud dataset includes multi-dimensional information such as distance, velocity, azimuth, and pitch angle.
- the process of gesture recognition can be:
- the left side of the first preset area corresponds to the negative angle of the millimeter-wave radar azimuth, and the right side of the first preset area corresponds to the positive angle of the millimeter-wave radar azimuth;
- a group of gestures that slide from left to right at a constant speed within 30cm from the millimeter-wave radar lasts for 60 frames.
- the 60 frames are divided into three stages (here for illustration, the three stages are For example, the actual can be further refined);
- the point set is concentrated on the negative angle of azimuth
- the point set is concentrated on the zero angle of orientation
- the point set is concentrated on the positive angle of azimuth.
- All motion gestures are classified according to the above-mentioned trajectory principle, and the point set trajectory information presented by different motion gestures is different, and the type of the gesture can be judged, thereby realizing gesture recognition.
- millimeter wave technology used in this application has high frequency band, wide bandwidth, high detection accuracy, and is not affected by light, temperature, dust, climate, etc.; millimeter wave technology can use the Doppler effect to sensitively monitor the movement of the occupants in the car. Perception, high detection accuracy; millimeter wave technology can realize gesture recognition, occupancy seat belt reminder, children's anti-forgetting and other functions, providing an intelligent solution for the development of intelligent vehicle alarms.
- sequence numbers of the steps do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not be used in the implementation of the embodiment of the present application. process constitutes any qualification.
- FIG. 5 is a schematic diagram of the structural composition of the vehicle control device provided by the present application.
- FIG. 5 only shows the parts related to the present application, which are described in detail as follows.
- the vehicle control device 50 may include an acquisition module 501 , a first control module 502 , a second control module 503 and a third control module 504 .
- the acquiring module 501 is configured to execute step S401, that is, acquiring a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal.
- the first control module 502 is configured to execute step S402, that is, when the vehicle state signal is an unlocked state signal, send a detection signal to the first preset area; perform gesture recognition on the received echo signal in the first preset area, And control the vehicle to perform the corresponding preset operation according to the gesture recognition result.
- the second control module 503 is configured to execute step S403, that is, when the vehicle state signal is a driving state signal, send detection signals to the first preset area and the second preset area; wave signal for gesture recognition, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result; adopt the above-mentioned occupancy recognition method provided by this application to perform the echo signal received in the second preset area Occupancy recognition, and according to the result of occupancy recognition, it is determined whether to issue a seat belt warning.
- the third control module 504 is configured to execute step S404, that is, when the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life recognition on the received echo signal in the third preset area , and determine whether to perform a personnel detention alarm according to the result of the identification of the living body.
- the second control module 203 may include an occupancy recognition unit.
- the occupancy identification unit is used to execute step S4031, that is, to send the occupancy identification result to the vehicle central control (that is, the vehicle's central control system), when the occupancy identification result is that the occupancy area is occupied, and the
- the vehicle central control detects that the seat belt in the occupied area is not fastened, and detects that the driving speed of the vehicle is greater than the preset speed threshold, a seat belt alarm is issued in the occupied area; wherein, the occupied area is the second preset area in the area.
- the third control module 204 may include a living body identification unit.
- the living body identification unit is used to execute step S4041, that is, to send the living body identification result to the vehicle central control, and when the living body identification result shows that there is a living body in the third preset area, perform the identification of the third preset area. Personnel stranded alarm.
- the third control module 204 may further include a sleep unit.
- the dormancy unit is configured to execute step S407, that is, when the vehicle status signal is a locked status signal, and when the duration of the locked status signal is greater than a preset time threshold, stop sending detection signals to the third preset area.
- the second control module 203 may include an occupancy sampling unit, an occupancy conversion unit, and a judging unit.
- the occupancy sampling unit is used to perform step S4031, that is, to sample each antenna echo signal in the second preset area respectively to obtain a time-domain echo signal set; each antenna echo signal in the second preset area
- the signal is an echo signal obtained by detecting the second preset area inside the vehicle.
- the occupancy transformation unit is configured to perform step S4032, that is, for each time domain echo signal in the time domain echo signal set, perform one-dimensional FFT processing on the time domain echo signal to obtain the time domain echo signal distance information.
- the judging unit is used to execute step S4033, that is, according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupied area inside the vehicle, and according to each The effective echo signal sets corresponding to the occupied areas respectively determine whether each occupied area is occupied.
- each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points.
- the judgment unit may include a selection subunit, an estimation subunit and an echo determination subunit.
- the selection subunit is used to perform step S4033-1, that is, for each time domain echo signal in the time domain echo signal set, from all the distance values in the time domain echo signal, select The echo signal at the sampling point is used as the effective echo signal corresponding to the time-domain echo signal.
- the estimating subunit is used to perform step S4033-2, that is, perform two-dimensional DOA estimation on each effective echo signal respectively, and obtain position information of sampling points corresponding to each effective echo signal;
- the echo determination subunit is configured to perform step S4033-3, that is, determine the time-domain echo signals corresponding to each occupied area inside the vehicle according to the location information of the sampling points corresponding to each effective echo signal.
- both the first control module 502 and the second control module 503 may include a gesture sampling unit, a gesture transformation unit, a gesture calculation unit, a gesture processing unit, a gesture estimation unit and a gesture recognition unit.
- the gesture sampling unit is used to perform step S4021, that is, to sample each antenna echo signal in the first preset area to obtain a gesture echo signal set; each antenna echo signal in the first preset area is a pair of The echo signal obtained by detecting the first preset area inside the vehicle.
- the gesture transformation unit is used to perform step S4022, that is, perform one-dimensional FFT transformation on each gesture echo signal in the gesture echo signal set, and perform two-dimensional FFT transformation on each gesture echo signal after one-dimensional transformation, to obtain The point cloud data of each sampling point in the first preset area; the point cloud data of the sampling point includes the distance and speed of the sampling point;
- the gesture calculation unit is used to execute step S4023, that is, to calculate the point cloud data of all sampling points whose speed is not zero in the first preset area, and obtain the magnitude of the point cloud data of each sampling point whose speed is not zero ;
- the gesture processing unit is used to execute step S4024, that is, perform non-coherent accumulation processing on the amplitude of the point cloud data of each sampling point whose speed is not zero, and select all amplitudes after non-coherent accumulation processing that are greater than the preset
- the point cloud data of the sampling point of the amplitude forms the target point cloud data set;
- the gesture estimation unit is used to perform step S4025, that is, perform two-dimensional DOA wave-of-arrival estimation on the target point cloud data set, and obtain the spatial angle information of each point cloud data corresponding to the sampling point in the target point cloud data set;
- the gesture recognition unit is configured to perform step S4026, that is, perform gesture recognition according to the spatial angle information of the sampling points corresponding to each point cloud data in the target point cloud dataset.
- FIG. 6 is a schematic diagram of a second millimeter-wave radar provided by the present application.
- the second millimeter wave radar 60 includes a processor 600 , a memory 601 , and a computer program 602 stored in the memory 601 and operable on the processor 600 .
- the processor 600 executes the computer program 602 , the steps in the above-mentioned embodiments of the vehicle control method are realized, such as S401 to S404 shown in FIG. 4 .
- the processor 600 executes the computer program 602
- the functions of the modules/units in the above-mentioned device embodiments are implemented, for example, the functions of the modules 501 to 504 shown in FIG. 5 .
- the computer program 602 can be divided into one or more modules/units, and these modules/units are stored in the memory 601 and executed by the processor 600, so as to realize the inventive concept of the present application.
- These modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and these instruction segments are used to describe the execution process of the computer program 602 in the second millimeter wave radar 60 .
- the computer program 602 may be divided into instruction segments corresponding to the modules 501 to 504 shown in FIG. 2 .
- the second millimeter wave radar 30 may include, but not limited to, a processor 600 and a memory 601 .
- FIG. 3 is only an example of the second millimeter-wave radar 60 , and does not constitute a limitation to the second millimeter-wave radar 60 .
- the second mmWave radar may include more or fewer components than shown, or combine certain components, or different components
- the present application also provides a second computer-readable storage medium.
- the storage medium stores a computer program.
- the computer program is executed by the processor, the steps described in the embodiments corresponding to the above-mentioned vehicle control method can be realized, and the control of various auxiliary functions of the vehicle can be realized.
- the device/terminal and method disclosed in the present application can also be implemented in other deformation manners that can be obtained without any creative effort. That is to say, the device/terminal embodiments described above are only illustrative; for example, the division of the above modules or units is only a logical function division, and there may be other division methods in actual implementation. For example, several units or modules may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
- a unit described as a separate component may or may not be physically separated, and a component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
- an integrated module/unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the implementation of all or part of the procedures in the methods of the above-mentioned embodiments in the present application may also be completed by computer program instructions related hardware.
- the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can realize the steps of the above embodiments of the occupancy recognition method and/or the vehicle control method.
- the computer program includes computer program code.
- the computer program code may be in source code form, object code form, executable file or some intermediate form, etc.
- the computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, read-only memory (Read-Only Memory, ROM), random access Memory (Random Access Memory, RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc.
- computer readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media does not include It is an electrical carrier signal and a telecommunication signal.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- General Physics & Mathematics (AREA)
- Mechanical Engineering (AREA)
- Mathematical Physics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Mathematical Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- Computational Mathematics (AREA)
- Mathematical Optimization (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Thermal Sciences (AREA)
- Automation & Control Theory (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Algebra (AREA)
- Human Computer Interaction (AREA)
- Radar Systems Or Details Thereof (AREA)
Abstract
A seat occupancy identification method and a vehicle control method using same. The seat occupancy identification method comprises: sampling each antenna echo signal within a preset area, so as to obtain a time-domain echo signal set, wherein each antenna echo signal within the preset area is an echo signal that is obtained by means of performing detection on the preset area inside a vehicle; for each time-domain echo signal in the time-domain echo signal set, performing one-dimensional FFT processing on the time-domain echo signal, so as to obtain distance information of the time-domain echo signal; and according to the distance information of each time-domain echo signal in the time-domain echo signal set, determining valid echo signal sets respectively corresponding to seat occupancy areas inside the vehicle, and according to the valid echo signal sets respectively corresponding to the seat occupancy areas, respectively determining whether the seat occupancy area are occupied.
Description
本专利申请要求于2021年08月12日提交的中国专利申请No. CN202110926413.2和No. CN202110926416.6的优先权。在先申请的公开内容通过整体引用并入本申请。This patent application claims the priority of Chinese patent applications No. CN202110926413.2 and No. CN202110926416.6 submitted on August 12, 2021. The disclosure of the prior application is incorporated by reference in its entirety into this application.
本申请属于雷达技术领域,尤其涉及一种占位识别方法及应用其的车辆控制方法。The present application belongs to the technical field of radar, and in particular relates to an occupancy recognition method and a vehicle control method using the same.
随着车辆的普及,车辆安全越来越受到重视。安全带作为保证驾乘人员安全的重要保护设备,其在车辆安全中尤为重要。车辆安全逐渐从物理安全向网络安全和安全辅助系统方面转变。目前,车辆的占位识别(即判断某一座位是否有人)大多是通过压力传感器进行检测,再通过安全带的佩戴状态判断是否进行告警。或者,通过摄像头采集某一位置的图像信息,进而判断该位置是否有人,再结合安全带的佩戴状态判断是否进行告警。With the popularization of vehicles, vehicle safety has been paid more and more attention. As an important protective device to ensure the safety of drivers and passengers, seat belts are particularly important in vehicle safety. Vehicle security is gradually shifting from physical security to cyber security and safety assistance systems. At present, vehicle occupancy recognition (that is, judging whether a certain seat is occupied) is mostly detected by a pressure sensor, and then judged by the wearing state of the seat belt whether to issue an alarm. Or, collect the image information of a certain location through the camera, and then judge whether there is a person in the location, and then judge whether to issue an alarm based on the wearing status of the seat belt.
压力传感器的误判率较高,进而导致安全带告警的准确率较低。摄像头对光线要求极高,易受灰尘等影响,且成本高,也存在误判率高的问题。即,现有的安全带告警方式容易出现误判,占位识别准确度较差。The misjudgment rate of the pressure sensor is high, which leads to a low accuracy rate of the seat belt warning. The camera has extremely high requirements on light, is easily affected by dust, etc., and has high cost, and also has the problem of high misjudgment rate. That is, the existing seat belt warning method is prone to misjudgment, and the accuracy of occupancy recognition is poor.
本申请提供了一种占位识别方法及应用其的车辆控制方法,旨在解决现有的安全带告警方式容易出现误判,占位识别准确度差的问题。The present application provides an occupancy recognition method and a vehicle control method using the same, aiming to solve the problems of easy misjudgment and poor occupancy recognition accuracy in existing seat belt warning methods.
第一方面,本申请提供了一种占位识别方法,包括:In a first aspect, the present application provides a method for occupancy identification, including:
对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;Sampling each antenna echo signal in the preset area separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is an echo signal obtained by detecting a preset area inside the vehicle;
针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT(Fast Fourier Transform,快速傅里叶变换)处理,得到该时域回波信号的距离信息;For each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT (Fast Fourier Transform, Fast Fourier Transform) processing on the time-domain echo signal to obtain distance information of the time-domain echo signal;
根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。According to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signal sets corresponding to each occupancy area, Determine whether each occupied area is occupied.
第二方面,本申请提供了一种占位识别装置,包括:In a second aspect, the present application provides an occupancy recognition device, including:
采样模块,用于对预设区域的每一路天线回波信号进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;The sampling module is used to sample each antenna echo signal in the preset area to obtain a time-domain echo signal set; each antenna echo signal in the preset area is the echo obtained by detecting the preset area inside the vehicle wave signal;
变换模块,用于针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息;The transformation module is used for performing one-dimensional FFT processing on each time domain echo signal in the time domain echo signal set to obtain the distance information of the time domain echo signal;
判断模块,用于根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的时域回波信号,并根据各个占位区域分别对应的时域回波信号,分别判定各个占位区域是否被占位。The judging module is configured to determine the time domain echo signals corresponding to each occupying area inside the vehicle according to the distance information of each time domain echo signal in the time domain echo signal set, and determine the time domain echo signals corresponding to each occupying area respectively according to the distance information of each occupying area in the time domain echo signal set domain echo signals to determine whether each occupancy area is occupied.
第三方面,本申请提供了第一毫米波雷达,其括存储器、处理器以及存储在存储器中并可在处理器上运行的计算机程序,处理器执行计算机程序时实现上述第一方面所述的占位识别方法的步骤。In a third aspect, the present application provides a first millimeter-wave radar, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the above-mentioned first aspect is realized. Steps of the placeholder recognition method.
第四方面,本申请提供了第一计算机可读存储介质,第一计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现上述第一方面所述的占位识别方法的步骤。In a fourth aspect, the present application provides a first computer-readable storage medium, where a computer program is stored in the first computer-readable storage medium, and when the computer program is executed by a processor, the steps of the occupancy identification method described in the above-mentioned first aspect are implemented.
第五方面,本申请提供了一种车辆控制方法,包括:In a fifth aspect, the present application provides a vehicle control method, including:
获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号;Acquire vehicle status signals; vehicle status signals include unlock status signals, driving status signals or locking status signals;
在车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;When the vehicle state signal is an unlocked state signal, send a detection signal to the first preset area; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result ;
在车辆状态信号为行车状态信号时,向第一预设区域和第二预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警;When the vehicle state signal is a driving state signal, send a detection signal to the first preset area and the second preset area; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle according to the gesture recognition result Execute the corresponding preset operation; perform occupancy identification on the echo signal received in the second preset area, and determine whether to perform a seat belt warning according to the occupancy identification result;
在车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号;对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。When the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life body identification on the received echo signal in the third preset area, and determine whether to perform a personnel detention alarm according to the life body identification result .
第六方面,本申请提供了一种车辆控制装置,包括:In a sixth aspect, the present application provides a vehicle control device, including:
获取模块,用于获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号;The acquiring module is used to acquire the vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal;
第一控制模块,用于在车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;The first control module is configured to send a detection signal to the first preset area when the vehicle state signal is an unlocked state signal; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle according to the gesture recognition result The vehicle performs the corresponding preset operation;
第二控制模块,用于在车辆状态信号为行车状态信号时,向第一预设区域和第二预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警;The second control module is configured to send detection signals to the first preset area and the second preset area when the vehicle status signal is a driving status signal; perform gesture recognition on the received echo signal in the first preset area, And control the vehicle to perform the corresponding preset operation according to the gesture recognition result; perform occupancy recognition on the echo signal received in the second preset area, and determine whether to perform a seat belt warning according to the occupancy recognition result;
第三控制模块,用于在车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号;对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。The third control module is configured to send a detection signal to the third preset area when the vehicle status signal is a locked status signal; perform life body identification on the received echo signal in the third preset area, and identify the life body according to the life body identification As a result, it is determined whether to carry out an alarm for personnel retention.
第七方面,本申请提供了第二毫米波雷达,其包括存储器、处理器以及存储在存储器中并可在处理器上运行的计算机程序,处理器执行计算机程序时上述第五方面所述的车辆控制方法的步骤。In a seventh aspect, the present application provides a second millimeter-wave radar, which includes a memory, a processor, and a computer program stored in the memory and operable on the processor. When the processor executes the computer program, the vehicle described in the fifth aspect above The steps of the control method.
第八方面,本申请提供了第二计算机可读存储介质,第二计算机可读存储介质存储有计算机程序,计算机程序被处理器执行时实现上述第一方面所述的车辆控制方法的步骤。In an eighth aspect, the present application provides a second computer-readable storage medium, where a computer program is stored in the second computer-readable storage medium, and when the computer program is executed by a processor, the steps of the vehicle control method described in the above-mentioned first aspect are realized.
相比于现有技术,本申请提供的占位识别方法,通过以下步骤实现占位识别:对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT变换处理,得到该时域回波信号的距离信息;根据时域回波信号集中的各个时域回波信号的距离信息确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集分别判定各个占位区域是否被占位。上述占位识别过程中,天线回波信号可以准确反映车内状况;通过对天线回波信号进行处理,判断占位区域是否被占位,可以提高占位识别的准确度,从而能够防止误判,及时提醒驾乘人员系好安全带,保障其人身安全。Compared with the prior art, the occupancy identification method provided by the present application realizes occupancy identification through the following steps: separately sample the echo signals of each antenna in the preset area to obtain a time-domain echo signal set; the preset area Each antenna echo signal is an echo signal obtained by detecting a preset area inside the vehicle; for each time domain echo signal in the time domain echo signal set, perform a one-dimensional FFT transformation on the time domain echo signal processing to obtain the distance information of the time-domain echo signal; determine the effective echo signal sets corresponding to each occupying area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set, and according to each The valid echo signal sets corresponding to the occupied areas respectively determine whether each occupied area is occupied. During the above occupancy identification process, the antenna echo signal can accurately reflect the situation in the vehicle; by processing the antenna echo signal to determine whether the occupancy area is occupied, the accuracy of occupancy identification can be improved, thereby preventing misjudgment , Timely remind drivers and passengers to fasten their seat belts to ensure their personal safety.
相比于现有技术,本申请提供的车辆控制方法,通过以下步骤进行车辆控制:获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号;在为解锁状态信号时,对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;在为行车状态信号时,对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作,对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警;在为闭锁状态信号时,对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。上述车辆控制过程中,在车辆处于不同状态时,通过毫米波雷达获取不同区域的回波信号,并对回波信号进行分析,实现了车辆的手势识别、安全带告警判断以及人员滞留告警判断;从而可以根据车辆不同的状态,实现车辆多功能智能辅助控制,使车辆的控制方式变得多样化,也使车辆更加智能化,优化了用户体验。Compared with the prior art, the vehicle control method provided by the present application controls the vehicle through the following steps: acquiring a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal; when it is an unlocked state signal, Perform gesture recognition on the echo signal received in the first preset area, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result; when it is a driving state signal, the received echo signal in the first preset area Perform gesture recognition on the signal, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result, perform occupancy recognition on the echo signal received in the second preset area, and determine whether to perform a seat belt warning according to the occupancy recognition result; When the signal is in a locked state, the received echo signal in the third preset area is identified as a living body, and it is determined whether to perform a personnel detention alarm according to the result of the living body identification. In the above vehicle control process, when the vehicle is in different states, the millimeter-wave radar is used to obtain the echo signals in different areas, and the echo signals are analyzed to realize the gesture recognition of the vehicle, the judgment of the seat belt warning and the judgment of the personnel stranded warning; Therefore, according to the different states of the vehicle, the multifunctional intelligent auxiliary control of the vehicle can be realized, the control mode of the vehicle becomes diversified, the vehicle is more intelligent, and the user experience is optimized.
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art will be briefly introduced below. Obviously, the accompanying drawings in the following description are only for the present application For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without paying creative efforts.
图1是本申请实施例提供的占位识别方法的实现流程图;Fig. 1 is the implementation flowchart of the occupancy identification method provided by the embodiment of the present application;
图2是本申请实施例提供的占位识别装置的结构组成示意图;Fig. 2 is a schematic diagram of the structural composition of the occupancy recognition device provided by the embodiment of the present application;
图3是本申请实施例提供的第一毫米波雷达的示意图。Fig. 3 is a schematic diagram of a first millimeter-wave radar provided by an embodiment of the present application.
图4是本申请实施例提供的车辆控制方法的实现流程图;Fig. 4 is an implementation flow chart of the vehicle control method provided by the embodiment of the present application;
图5是本申请实施例提供的车辆控制装置的结构组成示意图;Fig. 5 is a schematic diagram of the structural composition of the vehicle control device provided by the embodiment of the present application;
图6是本申请实施例提供的第二毫米波雷达的示意图。FIG. 6 is a schematic diagram of a second millimeter-wave radar provided by an embodiment of the present application.
具体实施方式Detailed ways
以下描述中,为了说明而不是为了限定,提出了诸如特定系统结构、技术之类的具体细节,以便透彻理解本申请实施例。然而,本领域的技术人员应当清楚,在没有这些具体细节的其它实施例中也可以实现本申请。在其它情况中,省略对众所周知的系统、装置、电路以及方法的详细说明,以免不必要的细节妨碍本申请的描述。In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图通过具体实施例来进行说明。In order to make the purpose, technical solution and advantages of the present application clearer, specific embodiments will be described below in conjunction with the accompanying drawings.
本申请提供的占位识别方法和车辆控制方法均可以使用毫米波雷达实施。毫米波雷达可以安装在车辆内顶部。毫米波雷达可以采用单片微波集成电路(Monolithic Microwave Integrated
Circuit,MMIC)和多进多出(Multiple Input Multiple Output,MIMO)技术。MMIC高度集成的处理器和传感器可以减小毫米波雷达的尺寸。MIMO阵列天线排布,既能减小天线尺寸,又能保证良好的角度分辨能力。Both the occupancy recognition method and the vehicle control method provided in the present application can be implemented using millimeter wave radar. Millimeter wave radar can be installed on the roof of the vehicle. Millimeter wave radar can use monolithic microwave integrated circuit (Monolithic Microwave Integrated
Circuit, MMIC) and multiple input multiple output (Multiple Input Multiple Output, MIMO) technology. MMIC's highly integrated processor and sensors can reduce the size of mmWave radar. The arrangement of the MIMO array antenna can not only reduce the size of the antenna, but also ensure good angular resolution.
毫米波雷达可以采用CAN(Controller Area Network,控制器局域网)通讯方式,支持休眠唤醒网络管理和远程固件刷写升级功能。同时可以采用先进的信号处理技术,使毫米波雷达能够实现距离、速度、方位角和俯仰角等多维分辨,进一步提高对车内目标的识别性能。The millimeter-wave radar can adopt the CAN (Controller Area Network, controller area network) communication method, and supports sleep wake-up network management and remote firmware flashing and upgrading functions. At the same time, advanced signal processing technology can be used to enable millimeter-wave radar to achieve multi-dimensional resolution such as distance, speed, azimuth and elevation angle, and further improve the recognition performance of targets in the vehicle.
相比超声波和摄像头等外露式安装的传感器,由于雷达发射的电磁波能够穿透车辆顶棚材质,雷达可采用非外露安装方式,即雷达可以安装在车辆内部顶棚和车辆外层钣金中间。这种非外露的安装方式不仅很好地避免了车体材质被切割破坏,便于实现雷达的安装,而且使雷达隐藏在顶棚和钣金中间,乘客完全感受不到雷达装置的存在,不会给乘客带来压力感。Compared with externally installed sensors such as ultrasonic waves and cameras, since the electromagnetic waves emitted by the radar can penetrate the roof material of the vehicle, the radar can be installed in a non-exposed manner, that is, the radar can be installed between the inner roof of the vehicle and the outer sheet metal of the vehicle. This non-exposed installation method not only prevents the car body material from being cut and damaged, but also facilitates the installation of the radar, and makes the radar hidden between the ceiling and the sheet metal, so that passengers cannot feel the existence of the radar device at all, and will not give Passengers feel stressed.
参见图1,其示出了本申请提供的占位识别方法的实现流程图。如图1所示,在一个实施例中,本申请提供的占位识别方法可以包括步骤S101至S103。下面分别对这3个步骤进行说明。Referring to FIG. 1 , it shows a flow chart of realizing the occupancy recognition method provided by the present application. As shown in FIG. 1 , in one embodiment, the occupancy identification method provided by the present application may include steps S101 to S103. The three steps are described below.
S101,对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号。S101. Sampling each antenna echo signal in the preset area separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is an echo signal obtained by detecting a preset area inside the vehicle .
可选的,本申请提供的占位识别方法的执行主体为毫米波雷达,所述预设区域为毫米波雷达在车辆内部可以探测到的区域。例如,所述预设区域可以包括车辆内部的前排座位区域,和/或车辆内部的后排座位区域。每一路天线对应一路时域回波信号,所有天线的时域回波信号形成时域回波信号集。Optionally, the occupancy recognition method provided in the present application is executed by a millimeter-wave radar, and the preset area is an area that the millimeter-wave radar can detect inside the vehicle. For example, the preset area may include a front seat area inside the vehicle, and/or a rear seat area inside the vehicle. Each antenna corresponds to one time-domain echo signal, and the time-domain echo signals of all antennas form a time-domain echo signal set.
在雷达领域中,可以使用距离维、方位维、俯仰维三个维度的数据表征被测物在球坐标中的三维空间位置。步骤S101中所述的采样可以是对每一路天线,沿距离维和时间维对天线回波信号进行ADC(Analog-to-Digital Converter)采样;采样时,可以选用快时间采样方式。In the field of radar, three-dimensional data of distance dimension, azimuth dimension and pitch dimension can be used to represent the three-dimensional spatial position of the measured object in spherical coordinates. The sampling described in step S101 may be to perform ADC (Analog-to-Digital Converter) sampling on the antenna echo signal along the distance dimension and the time dimension for each antenna; when sampling, a fast time sampling method may be selected.
本申请中,毫米波雷达包括阵列排布的多路发射天线以及多路接收天线。当毫米波雷达处于工作状态时,毫米波雷达通过多路发射天线向车辆内部发射多路探测信号,并通过多路接收天线接收对应的多路天线回波信号。In this application, the millimeter wave radar includes multiple transmitting antennas and multiple receiving antennas arranged in an array. When the millimeter-wave radar is in working state, the millimeter-wave radar transmits multiple detection signals to the interior of the vehicle through multiple transmitting antennas, and receives corresponding multiple antenna echo signals through multiple receiving antennas.
具体的,毫米波雷达上电工作,发射天线向预设区域发射特定频率的电磁波;电磁波遇到物体发生反射,反射的电磁波携带了目标信息,目标信息包括该预设区域中被测物体的距离、速度、空间角度信息;接收天线接收该反射的电磁波(也即回波信号),并对该反射的电磁波进行采样,得到时域回波信号。Specifically, the millimeter-wave radar is powered on, and the transmitting antenna transmits electromagnetic waves of a specific frequency to the preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves carry target information. The target information includes the distance of the measured object in the preset area , speed, and spatial angle information; the receiving antenna receives the reflected electromagnetic wave (ie, echo signal), and samples the reflected electromagnetic wave to obtain a time-domain echo signal.
S102,针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT(Fast Fourier Transform,快速傅里叶变换)处理,得到该时域回波信号的距离信息。S102. For each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT (Fast Fourier Transform, Fast Fourier Transform) processing on the time-domain echo signal to obtain the distance of the time-domain echo signal information.
步骤S102中,一维FFT处理可以将时域回波信号变换至频域回波信号,进而得到在预设区域内该时域回波信号的距离信息,即可以得到该时域回波信号在预设区域的距离分布。In step S102, the one-dimensional FFT processing can transform the time-domain echo signal into the frequency-domain echo signal, and then obtain the distance information of the time-domain echo signal in the preset area, that is, the time-domain echo signal can be obtained at The distance distribution of the preset area.
S103,根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。S103, according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area set to determine whether each occupancy area is occupied.
步骤S103中所述的占位区域可以为预设区域中的部分区域;例如,预设区域可以为车辆内部的前排座位空间,则占位区域可以为主驾驶区域和/或副驾驶区域。占位区域被占位可以理解为该占位区域有人;如例,一个占位区域为副驾驶,该占位区域被占位表现为副驾驶有人。The occupied area mentioned in step S103 may be a part of the preset area; for example, the preset area may be the front seat space inside the vehicle, and the occupied area may be the main driving area and/or the co-driving area. The occupancy area can be understood as the occupancy area is occupied; for example, one occupancy area is the co-pilot, and the occupancy area is occupied by the co-pilot.
综上,步骤S101至S103通过以下步骤进行占位识别:对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息;根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。上述占位识别过程中,天线回波信号可以准确反映车内状况;通过对天线回波信号进行处理,判断占位区域是否被占位,可以提高占位识别的准确度从而能够防止误判,及时提醒驾乘人员系好安全带,保障其人身安全。To sum up, steps S101 to S103 perform occupancy identification through the following steps: each antenna echo signal in the preset area is sampled separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is a pair of The echo signal obtained by detecting the preset area inside the vehicle; for each time domain echo signal in the time domain echo signal set, perform one-dimensional FFT processing on the time domain echo signal to obtain the time domain echo signal Distance information; according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area The signal set is used to determine whether each occupied area is occupied. In the above process of occupancy recognition, the antenna echo signal can accurately reflect the situation inside the vehicle; by processing the antenna echo signal, it is judged whether the occupancy area is occupied, which can improve the accuracy of occupancy recognition and prevent misjudgment. Timely remind drivers and passengers to fasten their seat belts to ensure their personal safety.
在本申请的一个实施例中,时域回波信号集中的各个时域回波信号均包括多个采样点的回波信号;时域回波信号的距离信息包括该时域回波信号对应的多个采样点的回波信号的距离值。In an embodiment of the present application, each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points.
上述S103中“根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集”,可以包括以下步骤:In the above S103, "according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupying area inside the vehicle", may include the following steps:
S1031,针对时域回波信号集中每个时域回波信号,从该时域回波信号中的所有距离值中,选取在预设范围内的采样点的回波信号,作为该时域回波信号对应的有效回波信号;S1031, for each time-domain echo signal in the time-domain echo signal set, from all distance values in the time-domain echo signal, select an echo signal at a sampling point within a preset range as the time-domain echo signal The effective echo signal corresponding to the wave signal;
S1032,对各个有效回波信号分别进行二维DOA(Direction Of Arrival,波达方向)估计,得到各个有效回波信号分别对应的采样点的位置信息;S1032. Perform two-dimensional DOA (Direction Of Arrival, direction of arrival) estimation on each effective echo signal, and obtain position information of sampling points corresponding to each effective echo signal;
S1033,根据各个有效回波信号分别对应的采样点的位置信息,确定车辆内部的各个占位区域分别对应的有效回波信号集。S1033. According to the location information of the sampling points corresponding to each effective echo signal, determine the effective echo signal sets corresponding to each occupied area inside the vehicle.
步骤S1031中所述的预设范围可以为不小于第一预设距离值,且不大于第二预设距离值的范围;其中,第一预设距离值小于第二预设距离值。预设范围可以根据乘客与毫米波雷达的距离确定。The preset range described in step S1031 may be a range not smaller than the first preset distance value and not larger than the second preset distance value; wherein, the first preset distance value is smaller than the second preset distance value. The preset range can be determined according to the distance between the passenger and the millimeter wave radar.
示例性的,乘客与毫米波雷达的距离大于0.5m,因此预设范围可以设置为0.5m~1.5m。如此,则步骤S1031选取距离值在0.5m~1.5m范围内的时域回波信号,作为有效回波信号。所述预设范围内的区域,可以称为车辆内部的有效区域,所述的各个有效回波信号为有效区域内的回波信号。步骤S1032通过对有效区域内的各个有效回波信号进行处理,得到各个有效回波信号的位置信息。所述位置信息可以包括俯仰角信息和方位角信息。步骤S1033根据各个有效回波信号的位置信息(例如,俯仰角信息和方位角信息),将各个有效回波信号与各个占位区域对应起来,(即,确定各个有效回波信号分别来自哪个占位区域),进而确定对应于各个占位区域的有效回波信号集。根据占位区域对应的有效回波信号集,即可进一步判断各个占位区域是否被占位。Exemplarily, the distance between the passenger and the millimeter-wave radar is greater than 0.5m, so the preset range can be set to 0.5m~1.5m. In this way, step S1031 selects time-domain echo signals whose distance values are in the range of 0.5m-1.5m as effective echo signals. The area within the preset range may be referred to as an effective area inside the vehicle, and each of the effective echo signals is an echo signal within the effective area. Step S1032 obtains position information of each effective echo signal by processing each effective echo signal in the effective area. The location information may include elevation angle information and azimuth angle information. Step S1033, according to the location information of each effective echo signal (for example, pitch angle information and azimuth angle information), associate each effective echo signal with each occupancy area, (that is, determine which occupancy area each effective echo signal comes from bit area), and then determine the effective echo signal set corresponding to each occupied area. According to the effective echo signal set corresponding to the occupied area, it can be further judged whether each occupied area is occupied.
可选的,每一个采样点对应一个预设区域内实际的点。S1032中,可以对各个有效回波信号进行多路天线之间的方位向(横向)和俯仰向(纵向)二维DOA估计,以得到各个有效回波信号分别对应的采样点的位置信息,即可以得到所述预设距离范围内的各个采样点的位置信息。通过二维DOA估计,可以增强指定方向信号的功率,同时对天线进行旁瓣相消,降低杂波干扰。Optionally, each sampling point corresponds to an actual point in a preset area. In S1032, two-dimensional DOA estimation in azimuth (horizontal) and pitch (longitudinal) directions between multiple antennas can be performed on each effective echo signal to obtain the position information of the sampling points corresponding to each effective echo signal, namely The position information of each sampling point within the preset distance range can be obtained. Through two-dimensional DOA estimation, the power of the signal in the specified direction can be enhanced, and at the same time, sidelobe cancellation can be performed on the antenna to reduce clutter interference.
示例性的,二维DOA估计的过程可以为:Exemplarily, the process of two-dimensional DOA estimation can be:
设目标方位角
θ的导向矢量为
α、各方位
R
i 阵元空时采样数据的协方差矩阵为
R,则最优权系数
W=
μRα,其中
μ为常数;然后寻找min(
W
HRW
)时的
θ,即为最佳目标来向
θ。同理求得俯仰向
Ψ,即完成方位俯仰二维DOA估计。
Let the steering vector of the target azimuth angle θ be α , and the covariance matrix of the space-time sampling data of each azimuth R i array be R , then the optimal weight coefficient W = μRα , where μ is a constant; then find min( W H RW ) θ is the best target direction θ . In the same way, the pitch direction Ψ is obtained, that is, the two-dimensional DOA estimation of azimuth and pitch is completed.
以毫米波雷达为中心,各个占位区域相对毫米波雷达的位置不同。例如,主驾驶相对毫米波雷达的位置,和副驾驶相对毫米波雷达的位置不同。步骤S1033中,可以根据各个有效回波信号分别对应的采样点的位置信息,确定车辆内部的各个占位区域,以及各个占位区域对应的时域回波信号。With the millimeter-wave radar as the center, the positions of each occupied area relative to the millimeter-wave radar are different. For example, the position of the main driver relative to the millimeter-wave radar is different from that of the co-pilot relative to the millimeter-wave radar. In step S1033, each occupancy area inside the vehicle and the time-domain echo signal corresponding to each occupancy area may be determined according to the location information of the sampling points corresponding to each effective echo signal.
在本申请的一个实施例中,上述S103中“根据各个占位区域分别对应的有效回波信号集分别判定各个占位区域是否被占位”,可以包括以下步骤:In one embodiment of the present application, the above S103 of "determining whether each occupied area is occupied according to the effective echo signal sets corresponding to each occupied area" may include the following steps:
S1034,根据各个占位区域分别对应的有效回波信号集,得到各个占位区域的点云信息;S1034. Obtain point cloud information of each occupied area according to the effective echo signal sets corresponding to each occupied area;
S1035,针对每个占位区域,根据该占位区域的点云信息,计算该占位区域的每一点云的微动速度,并根据该占位区域的每一点云的微动速度,确定该占位区域是否被占位。S1035. For each occupied area, calculate the fretting speed of each point cloud in the occupied area according to the point cloud information of the occupied area, and determine the fretting speed of each point cloud in the occupied area. Whether the occupied area is occupied.
可选的,每个占位区域可以对应一个点云信息,该点云信息可以包括该占位区域对应的各个点云的三维坐标。S1035中,根据该占位区域的点云信息,可以使用现有技术手段,计算该占位区域的每一点云的微动速度。Optionally, each occupancy area may correspond to a piece of point cloud information, and the point cloud information may include three-dimensional coordinates of each point cloud corresponding to the occupancy area. In S1035, according to the point cloud information of the occupied area, the fretting velocity of each point cloud of the occupied area may be calculated by means of existing technologies.
可选的,每个占位区域还可以包括多个点云信息。每个点云信息均包括其中的各个点云的三维坐标。示例性的,可以根据车辆座位的占位区域布局情况,对符合每一占位区域上的包括距离、方位角、俯仰角的时域回波信号进行预提取,得到各个占位区域的点云信息。Optionally, each occupancy area may also include multiple point cloud information. Each point cloud information includes the three-dimensional coordinates of each point cloud therein. Exemplarily, according to the layout of the occupancy area of the vehicle seat, the time-domain echo signals including distance, azimuth, and elevation angle on each occupancy area can be pre-extracted to obtain the point cloud of each occupancy area information.
在本申请的一个实施例中,上述S1035中“根据该占位区域的每一点云的微动速度确定该占位区域是否被占位”,可以包括以下步骤:In one embodiment of the present application, "determine whether the occupied area is occupied according to the fretting speed of each point cloud of the occupied area" in the above S1035 may include the following steps:
S1036,若该占位区域中,微动速度大于预设微动速度的点云的数量,大于预设数量,则判定该占位区域被占位。S1036, if in the occupied area, the number of point clouds whose inching speed is greater than the preset inching speed is greater than the preset number, then it is determined that the occupied area is occupied.
相应的,若该占位区域中,微动速度大于预设微动速度的点云的数量,不大于预设数量,则判定该占位区域未被占位。Correspondingly, if the number of point clouds whose inching speed is greater than the preset inching speed in the occupied area is not greater than the preset number, it is determined that the occupied area is not occupied.
S1036对应的实施例,根据微动速度和点云数量两个条件判断该占位区域是否被占位,可以剔除一些偶然干扰因素,比单独一个条件的判断准确。In the embodiment corresponding to S1036, it is judged whether the occupied area is occupied according to the two conditions of the fretting speed and the number of point clouds, which can eliminate some occasional interference factors, which is more accurate than the judgment of a single condition.
在本申请的一个实施例中,时域回波信号集中的各个时域回波信号,均包括多个采样点的回波信号;In an embodiment of the present application, each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points;
在步骤S102中,对“该时域回波信号进行一维FFT处理”之前,本申请提供的占位识别方法还可以包括以下步骤:In step S102, before "performing one-dimensional FFT processing on the time-domain echo signal", the occupancy identification method provided by the present application may further include the following steps:
S104,求取该时域回波信号中,各个采样点的回波信号的信号平均值;S104, calculating the signal average value of the echo signals at each sampling point in the time-domain echo signal;
S105,将该时域回波信号中的各个采样点的回波信号,分别与对应的信号平均值作差,得到该时域回波信号的过滤后的时域回波信号;S105, making a difference between the echo signal of each sampling point in the time domain echo signal and the corresponding signal average value, to obtain a filtered time domain echo signal of the time domain echo signal;
相应的,步骤S102中,对“该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息”,包括以下步骤:Correspondingly, in step S102, "performing one-dimensional FFT processing on the time-domain echo signal to obtain the distance information of the time-domain echo signal" includes the following steps:
S106,对过滤后的时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。S106. Perform one-dimensional FFT processing on the filtered time-domain echo signal to obtain distance information of the time-domain echo signal.
步骤S104至S106所述过程实现了时域回波信号的静态杂波剔除。由于肢体微动信号属于弱目标,极易受座舱复杂回波干扰。步骤S104至S106通过对时域回波信号进行静态杂波剔除,提高了占位识别的准确度。The process described in steps S104 to S106 realizes the static clutter removal of the echo signal in the time domain. Since the body micro-movement signal is a weak target, it is easily interfered by the complex echo of the cockpit. Steps S104 to S106 improve the accuracy of occupancy identification by performing static clutter removal on the time-domain echo signal.
在本申请的一个实施例中,步骤S104中,求取采样点的回波信号的信号平均值的公式为:In one embodiment of the present application, in step S104, the formula for obtaining the signal average value of the echo signal at the sampling point is:
其中,所述时域回波信号为
S=[
S
1,
S
2,…,
S
n],
S
i
=[
S
iS
1,
S
iS
2,…,
S
iS
j,…,
S
iS
m];
S
meani
为该时域回波信号中第
i个采样点的回波信号
S
i
的信号平均值,
i=1~
n,
j=1~
m,
n为该时域回波信号包括的采样点的回波信号的数量,
m为时刻的数量,
S
i S
m为回波信号
S
i
在
m时刻的信号。
Wherein, the time-domain echo signal is S = [ S 1 , S 2 , ..., S n ], S i = [ S i S 1 , S i S 2 , ..., S i S j , ..., S i S m ]; S meani is the signal mean value of the echo signal S i of the i -th sampling point in the time domain echo signal, i =1~ n , j =1~ m , n is the time domain echo signal The number of echo signals of the sampling points included, m is the number of time points, S i S m is the signal of the echo signal S i at time m .
示例性的,对某一时域回波信号,可以求取每一距离维采样点沿时间维的均值,并减去该均值,得到过滤后的时域回波信号。Exemplarily, for a certain time-domain echo signal, an average value along the time dimension of each sampling point in the distance dimension may be calculated, and the average value may be subtracted to obtain a filtered time-domain echo signal.
例如,设某一天线的时域回波信号为
S=[
S
1,
S
2,…,
S
n],其中,
S
i
=[
S
iS
1,
S
iS
2,…,
S
iS
j,…,
S
i S
m],
i=1~
n,
j=1~
m,
n为距离维采样点,
m为时间维采样点,均值
S
mean
=[
S
mean
1,
S
mean
2,…,
S
mean
n],
For example, suppose the time-domain echo signal of an antenna is S =[ S 1 , S 2 ,…, S n ], where S i =[ S i S 1 , S i S 2 ,…, S i S j ,…, S i S m ], i =1~ n , j =1~ m , n is the sampling point in the distance dimension, m is the sampling point in the time dimension, the mean value S mean =[ S mean 1 , S mean 2 ,…, S mean n ],
得到剔除静态杂波后的时域回波信号
S'=[
S
1-
S
mean
,
S
2-
S
mean
,…,
S
n-
S
mean
];如此,可以降低静物杂波的干扰。
The time-domain echo signal S '=[ S 1 - S mean , S 2 - S mean , ..., S n - S mean ] after removing static clutter is obtained; in this way, the interference of static clutter can be reduced.
在本申请的一个实施例中,占位识别方法还可以包括以下步骤:In one embodiment of the present application, the occupancy identification method may further include the following steps:
S107,将各个占位区域的占位判定结果发送至车辆的中央控制系统(简称“车辆中控”);S107, sending the occupancy determination results of each occupancy area to the vehicle's central control system (referred to as "vehicle central control");
S108,针对每个占位区域的占位判定结果,当该占位判定结果为该占位区域被占位时,且车辆中控检测到该占位区域的安全带未系,且检测到车辆的车速大于预设车速阈值时,进行该占位区域的安全带声光告警。S108, for the occupancy determination result of each occupancy area, when the occupancy determination result is that the occupancy area is occupied, and the vehicle central control detects that the seat belt of the occupancy area is not fastened, and detects that the vehicle When the speed of the vehicle is greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupied area will be performed.
步骤S108中,车辆的毫米波雷达可以将占位判定结果发送至车辆中控,车辆中控根据占位判定结果,并结合另外两个条件判断是否进行安全带声光告警。In step S108, the vehicle's millimeter-wave radar can send the occupancy determination result to the vehicle's central control, and the vehicle's central control determines whether to issue a seat belt audible and visual warning based on the occupancy determination result and in combination with the other two conditions.
对应于步骤S108,当占位判定结果为占位区域未被占位,或者车辆中控检测到占位区域的安全带已系,或者检测到车辆的车速不大于预设车速阈值时,不进行安全带声光告警。在一个实施例中,通过本申请提供的占位识别方法,进行安全带告警的过程可以包括以下六个步骤:Corresponding to step S108, when the occupancy determination result is that the occupancy area is not occupied, or the vehicle central control detects that the seat belt in the occupancy area is fastened, or detects that the speed of the vehicle is not greater than the preset speed threshold, do not proceed. Seat belt sound and light warning. In one embodiment, through the occupancy recognition method provided in this application, the process of performing seat belt warning may include the following six steps:
步骤一、毫米波雷达通过多路天线向车内预设区域发送探测信号,并对接收到的每一路天线回波信号进行采样,得到时域回波信号集。Step 1. The millimeter-wave radar sends detection signals to the preset area in the vehicle through multiple antennas, and samples the echo signals received from each antenna to obtain a time-domain echo signal set.
步骤二、对时域回波信号集中的各个时域回波信号进行静态杂波剔除,得到过滤后的时域回波信号集。Step 2: Static clutter removal is performed on each of the time-domain echo signals in the time-domain echo signal set to obtain a filtered time-domain echo signal set.
步骤三、对过滤后的时域回波信号集中的时域回波信号,进行一维FFT处理,得到各个时域回波信号的距离信息。Step 3: Perform one-dimensional FFT processing on the time-domain echo signals in the filtered time-domain echo signal set to obtain distance information of each time-domain echo signal.
步骤四、根据各个时域回波信号的距离信息,确定各个时域回波信号分别对应哪个占位区域以及各个占位区域对应的有效回波信号集。从所述距离信息中,选取在预设范围内的时域回波信号,作为有效回波信号;对各个有效回波信号分别进行二维DOA估计,得到各个有效回波信号分别对应的采样点的位置信息;根据各个有效回波信号分别对应的采样点的位置信息,确定各个占位区域的点云信息。Step 4: According to the distance information of each time-domain echo signal, determine which occupancy area each time-domain echo signal corresponds to and the effective echo signal set corresponding to each occupancy area. From the distance information, select time-domain echo signals within a preset range as effective echo signals; perform two-dimensional DOA estimation on each effective echo signal, and obtain sampling points corresponding to each effective echo signal respectively The position information of each effective echo signal; determine the point cloud information of each occupied area according to the position information of the sampling points corresponding to each effective echo signal.
步骤五、针对每个占位区域,根据该占位区域的点云信息,计算该占位区域的每一点云的微动速度,并根据该占位区域的每一点云的微动速度,确定该占位区域是否被占位。Step 5. For each occupied area, calculate the fretting speed of each point cloud in the occupied area according to the point cloud information of the occupied area, and determine Whether the occupied area is occupied.
步骤六、将占位判定结果发送至车辆中控,并指示车辆中控是否进行安全带声光告警。Step 6: Send the occupancy determination result to the vehicle central control, and instruct the vehicle central control whether to issue seat belt audible and visual warnings.
应理解,上述占位识别方法的实施例中,各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that in the above embodiment of the occupancy identification method, the size of the sequence number of each step does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not be used in the embodiment of the present application. The implementation process constitutes no limitation.
以下为对应于本申请提供的占位识别方法的装置实施例,对于其中未详尽描述的细节,可以参考上述占位识别方法的实施例。The following are device embodiments corresponding to the occupancy recognition method provided in this application. For details not described in detail therein, reference may be made to the above embodiments of the occupancy recognition method.
图2是本申请提供的占位识别装置的结构组成示意图。为了便于说明,图2仅示出了与本申请相关的部分,详述如下。Fig. 2 is a schematic diagram of the structural composition of the occupancy recognition device provided by the present application. For ease of description, FIG. 2 only shows the parts related to the present application, which are described in detail as follows.
如图2所示,占位识别装置20可以包括采样模块201、变换模块202和判断模块203。As shown in FIG. 2 , the occupancy identification device 20 may include a sampling module 201 , a transformation module 202 and a judging module 203 .
采样模块201用于执行步骤S101,即,对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号。The sampling module 201 is used to execute step S101, that is, to sample each antenna echo signal in the preset area respectively to obtain a time-domain echo signal set; each antenna echo signal in the preset area is a preview of the vehicle interior The echo signal obtained by setting the area for detection.
变换模块202用于执行步骤S102,即,针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。The transformation module 202 is configured to execute step S102, that is, for each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT processing on the time-domain echo signal to obtain distance information of the time-domain echo signal.
判断模块203用于执行步骤S103,即,根据时域回波信号集中的各个时域回波信号的距离信息确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。The judging module 203 is used to execute step S103, that is, determine the effective echo signal sets corresponding to each occupied area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set, and The valid echo signal sets corresponding to the areas respectively determine whether each occupied area is occupied.
在本申请的一个实施例中,时域回波信号集中的各个时域回波信号均包括多个采样点的回波信号;时域回波信号的距离信息包括该时域回波信号对应的多个采样点的回波信号的距离值。本实施例中,判断模块203可以包括有效信号选取单元、估计单元和有效信号确定单元。In an embodiment of the present application, each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points. In this embodiment, the judging module 203 may include an effective signal selection unit, an estimation unit, and an effective signal determination unit.
所述有效信号选取单元用于执行步骤S1031,即,针对时域回波信号集中每个时域回波信号,从该时域回波信号中的所有距离值中,选取在预设范围内的采样点的回波信号,作为该时域回波信号对应的有效回波信号。The effective signal selection unit is used to perform step S1031, that is, for each time-domain echo signal in the time-domain echo signal set, from all distance values in the time-domain echo signal, select a distance within a preset range The echo signal at the sampling point is used as an effective echo signal corresponding to the time-domain echo signal.
所述估计单元用于执行步骤S1032,即,对各个有效回波信号分别进行二维DOA估计,得到各个有效回波信号分别对应的采样点的位置信息。The estimating unit is configured to execute step S1032, that is, perform two-dimensional DOA estimation on each effective echo signal respectively, to obtain position information of sampling points corresponding to each effective echo signal.
所述有效信号确定单元用于执行步骤S1033,即,根据各个有效回波信号分别对应的采样点的位置信息,确定车辆内部的各个占位区域分别对应的有效回波信号集。The effective signal determining unit is configured to perform step S1033, that is, determine effective echo signal sets corresponding to respective occupied areas inside the vehicle according to position information of sampling points corresponding to respective effective echo signals.
在本申请的一个实施例中,判断模块203还可以包括点云信息确定单元和计算单元。In an embodiment of the present application, the judging module 203 may further include a point cloud information determination unit and a calculation unit.
所述点云信息确定单元用于执行步骤S1034,即,根据各个占位区域分别对应的有效回波信号集,得到各个占位区域的点云信息。The point cloud information determining unit is configured to execute step S1034, that is, obtain point cloud information of each occupied area according to the effective echo signal sets corresponding to each occupied area.
所述计算单元用于执行步骤S1035,即,针对每个占位区域,根据该占位区域的点云信息,计算该占位区域的每一点云的微动速度,并根据该占位区域的每一点云的微动速度,确定该占位区域是否被占位。The calculation unit is used to execute step S1035, that is, for each occupied area, calculate the fretting velocity of each point cloud of the occupied area according to the point cloud information of the occupied area, and calculate the fretting speed of each point cloud of the occupied area according to the The fretting speed of each point cloud determines whether the occupied area is occupied.
在本申请的一个实施例中,所述计算单元还用于执行步骤S1036,即,若该占位区域中,微动速度大于预设微动速度的点云的数量,大于预设数量,则判定该占位区域被占位。In one embodiment of the present application, the calculation unit is further configured to execute step S1036, that is, if the number of point clouds whose inching speed is greater than the preset inching speed in the occupied area is greater than the preset number, then It is determined that the occupied area is occupied.
在本申请的一个实施例中,时域回波信号集中的各个时域回波信号,均包括多个采样点的回波信号;本实施例中,占位识别装置20还可以包括预处理模块和差值模块。In one embodiment of the present application, each time domain echo signal in the time domain echo signal set includes echo signals of multiple sampling points; in this embodiment, the occupancy identification device 20 may also include a preprocessing module and difference modules.
所述预处理模块用于执行步骤S104,即,求取该时域回波信号中,各个采样点的回波信号的信号平均值。The pre-processing module is used to execute step S104, that is, calculating the signal average value of the echo signals at each sampling point in the time-domain echo signal.
所述差值模块用于执行步骤S105,即,将该时域回波信号中的各个采样点的回波信号,分别与对应的信号平均值作差,得到该时域回波信号的过滤后的时域回波信号。The difference module is used to execute step S105, that is, the echo signal of each sampling point in the time-domain echo signal is respectively different from the corresponding signal average value to obtain the filtered time-domain echo signal time-domain echo signal.
相应的,变换模块202还用于执行步骤S106,即,对过滤后的时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。Correspondingly, the transformation module 202 is further configured to execute step S106, that is, perform one-dimensional FFT processing on the filtered time-domain echo signal to obtain distance information of the time-domain echo signal.
在本申请的一个实施例中,占位识别装置20还可以包括占位发送模块。In an embodiment of the present application, the occupancy identification device 20 may further include an occupancy sending module.
所述占位发送模块用于执行步骤S107和S108,即,将各个占位区域的占位判定结果发送至车辆中控;针对每个占位区域的占位判定结果,当该占位判定结果为该占位区域被占位时,且车辆中控检测到该占位区域的安全带未系,且检测到车辆的车速大于预设车速阈值时,进行该占位区域的安全带声光告警。The occupancy sending module is used to execute steps S107 and S108, that is, to send the occupancy determination results of each occupancy area to the vehicle central control; for the occupancy determination results of each occupancy area, when the occupancy determination result When the occupancy area is occupied, and the vehicle central control detects that the seat belt in the occupancy area is not fastened, and when the speed of the vehicle is detected to be greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupancy area will be performed. .
图3是本申请提供的第一毫米波雷达的示意图。如图3所示,第一毫米波雷达30包括处理器300、存储器301以及存储在存储器301中并可在处理器300上运行的计算机程序302。处理器300执行计算机程序302时能够实现上述各个占位识别方法实施例中的步骤,例如图1所示的步骤S101至S103。或者,处理器300执行计算机程序302时实现上述各装置实施例中各模块/单元的功能,例如图2所示模块201至203的功能。Fig. 3 is a schematic diagram of the first millimeter-wave radar provided by the present application. As shown in FIG. 3 , the first millimeter wave radar 30 includes a processor 300 , a memory 301 , and a computer program 302 stored in the memory 301 and operable on the processor 300 . When the processor 300 executes the computer program 302, it can realize the steps in the above embodiments of the occupancy recognition method, for example, steps S101 to S103 shown in FIG. 1 . Alternatively, when the processor 300 executes the computer program 302, the functions of the modules/units in the above-mentioned device embodiments are realized, for example, the functions of the modules 201 to 203 shown in FIG. 2 .
示例性的,计算机程序302可以被分割成一个或多个模块/单元,这些模块/单元可以被存储在存储器301中,并由处理器300执行,以实现本申请的发明构思。这些模块/单元可以是能够完成特定功能的一系列计算机程序指令段,这些指令段用于描述计算机程序302在第一毫米波雷达30中的执行过程。例如,计算机程序302可以被分割成对应于图2所示的模块201至203的指令段。Exemplarily, the computer program 302 can be divided into one or more modules/units, and these modules/units can be stored in the memory 301 and executed by the processor 300, so as to realize the inventive concept of the present application. These modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and these instruction segments are used to describe the execution process of the computer program 302 in the first millimeter wave radar 30 . For example, the computer program 302 may be divided into instruction segments corresponding to the modules 201 to 203 shown in FIG. 2 .
第一毫米波雷达30可包括,但不仅限于,处理器300和存储器301。本领域技术人员可以理解,图3仅仅是第一毫米波雷达30的一种示例,并不构成对第一毫米波雷达30的限定。第一毫米波雷达可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件。The first millimeter wave radar 30 may include, but not limited to, a processor 300 and a memory 301 . Those skilled in the art can understand that FIG. 3 is only an example of the first millimeter-wave radar 30 , and does not constitute a limitation to the first millimeter-wave radar 30 . The first millimeter wave radar may include more or fewer components than shown, or combine certain components, or different components.
本申请还提供了第一计算机可读存储介质。该存储介质存储有计算机程序。该计算机程序被处理器执行时,可以实现上述占位识别方法对应的实施例记载的步骤,实现车辆的占位识别。The present application also provides a first computer-readable storage medium. The storage medium stores a computer program. When the computer program is executed by the processor, the steps described in the embodiments corresponding to the above-mentioned occupancy identification method can be realized, and the occupancy identification of the vehicle can be realized.
本申请还提供了一种车辆控制方法。The present application also provides a vehicle control method.
随着社会发展,人们生活水平的提高,车辆作为一种交通工具,不管是在家庭、个人,亦或是公司、集体等,汽车的普及率不断上升。车辆的驾乘安全受到越来越多人的关注。With the development of society and the improvement of people's living standards, vehicles are used as a means of transportation, whether in families, individuals, companies, collectives, etc., the popularity of cars continues to rise. The driving safety of vehicles has attracted more and more attention.
驾乘安全逐渐从物理安全向网络安全和安全辅助系统方面转变。目前,车辆的手势控制可以通过摄像头采集图像,然后对图像进行识别;进而识别人员动作,然后根据识别结果进行手势控制。但是这种控制方式比较单一,无法满足用户需求。本申请提供的车辆控制方法可以通过车载雷达实现手势识别。不仅如此,所述方法还能够实现生命体识别和占位识别,使车辆的控制方式变得多样化,也使车辆更加智能化。Driving safety is gradually shifting from physical safety to network safety and safety assistance systems. At present, the gesture control of the vehicle can collect images through the camera, and then recognize the image; then recognize the movement of the person, and then perform gesture control according to the recognition result. However, this control method is relatively simple and cannot meet user needs. The vehicle control method provided in the present application can realize gesture recognition through vehicle radar. Not only that, but the method can also realize the identification of living body and occupancy, so that the control mode of the vehicle becomes diversified, and the vehicle is also more intelligent.
图4是本申请提供的车辆控制方法的实现流程图。如图4所示,本申请提供的车辆控制方法可以包括步骤S401至S404。下面分别对这4个步骤进行说明。Fig. 4 is a flow chart of the implementation of the vehicle control method provided by the present application. As shown in Fig. 4, the vehicle control method provided by the present application may include steps S401 to S404. The four steps are described below.
S401,获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号。S401. Acquire a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal.
可选的,本申请提供的车辆控制方法的执行主体为毫米波雷达。解锁状态信号表示车辆已解锁,但是还未启动,车辆处于静止状态。行车状态信号表示车辆正在行驶过程中,车辆处于运动状态。闭锁状态信号表示车辆的动力源(例如,发动机或电动机)已停止工作,车门已锁闭,车辆处于静止状态。Optionally, the vehicle control method provided in this application is executed by a millimeter-wave radar. The unlocked status signal indicates that the vehicle has been unlocked, but has not been started, and the vehicle is in a stationary state. The driving state signal indicates that the vehicle is running and the vehicle is in motion. The locked state signal indicates that the vehicle's power source (such as the engine or electric motor) has stopped, the doors are locked, and the vehicle is stationary.
可选的,解锁状态信号可以是车钥匙发送的信号,也可以是主驾驶车门锁发送的信号。闭锁状态信号可以是车钥匙发送的信号,也可以是主驾驶车门锁发送的信号。Optionally, the unlocked state signal may be a signal sent by a car key, or a signal sent by a main driver's door lock. The locked state signal can be a signal sent by the car key, or a signal sent by the main driver's door lock.
S402,在车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作。S402. When the vehicle state signal is an unlocked state signal, send a detection signal to the first preset area; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle to perform a corresponding preset according to the gesture recognition result. set operation.
可选的,第一预设区域可以为固定打手势区域。车辆的内部设备可以包括天窗或者空调等。在车辆解锁状态下进行手势识别,可以让驾驶员使用手势来开启或关闭车辆的各项功能,或者控制车辆的各种参数,从而(尤其是在车辆行驶过程中)令驾驶员的注意力更多放在观察车辆周边环境上,更好的保障行车安全。Optionally, the first preset area may be a fixed gesture area. The interior equipment of the vehicle may include a sunroof or an air conditioner and the like. Gesture recognition in the unlocked state of the vehicle allows the driver to use gestures to turn on or off various functions of the vehicle, or to control various parameters of the vehicle, thus (especially when the vehicle is driving) to make the driver's attention more focused Focus more on observing the surrounding environment of the vehicle to better ensure driving safety.
具体的,毫米波雷达上电工作,当毫米波雷达获取到解锁状态信号时,毫米波雷达的发射天线向固定打手势区域发射特定频率的电磁波;电磁波遇到物体发生反射,反射的电磁波(即回波信号)携带了该固定打手势区域的各种信息;毫米波雷达的接收天线接收该固定打手势区域的回波信号,并根据该回波信号进行手势识别;进而根据手势识别结果控制车辆执行对应的预设操作。例如,可以根据手势识别结果控制车辆的空调或者天窗等。Specifically, when the millimeter-wave radar is powered on, when the millimeter-wave radar obtains the unlock status signal, the transmitting antenna of the millimeter-wave radar transmits electromagnetic waves of a specific frequency to the fixed gesture area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves (ie Echo signal) carries various information of the fixed gesturing area; the receiving antenna of the millimeter wave radar receives the echo signal of the fixed gesturing area, and performs gesture recognition according to the echo signal; and then controls the vehicle according to the gesture recognition result Execute the corresponding preset operation. For example, the vehicle's air conditioner or sunroof can be controlled according to the result of gesture recognition.
S403,在车辆状态信号为行车状态信号时,向第一预设区域和第二预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警。S403. When the vehicle state signal is a driving state signal, send a detection signal to the first preset area and the second preset area; perform gesture recognition on the received echo signal in the first preset area, and perform gesture recognition based on the gesture recognition result The vehicle is controlled to perform a corresponding preset operation; occupancy identification is performed on the echo signal received in the second preset area, and whether to perform a seat belt warning is determined according to the occupancy identification result.
需要说明的是,步骤S403中,对第二预设区域的回波信号进行占位识别时,可以采用本申请提供的占位识别方法,也可以采用现有技术中的占位识别方法。It should be noted that, in step S403, when identifying the occupancy of the echo signal in the second preset area, the occupancy identification method provided in the present application may be used, or the occupancy identification method in the prior art may be used.
如上文所述,第二预设区域为毫米波雷达在车辆内部可以探测到的区域。例如,第二预设区域可以包括车辆内部的前排座位区域,和/或车辆内部的后排座位区域。As mentioned above, the second preset area is an area within the vehicle that can be detected by the millimeter-wave radar. For example, the second preset area may include a front seat area inside the vehicle, and/or a rear seat area inside the vehicle.
具体的,在毫米波雷达获取到的车辆状态信号为行车状态信号时,可以进行手势识别,和/或占位识别。在车辆行驶状态中进行手势识别,可以使驾驶员将更多的注意力放在行驶安全上,避免开关空调或天窗等辅助操作分散驾驶员的注意力,保障车辆的行驶安全。在车辆行驶状态中,通过探测信号进行占位识别,能够使车辆判断是否进行安全带告警,以提醒在行车状态下未系安全带的驾乘人员系安全带,为驾乘人员提供安全保障,减少或者避免在发生交通事故时的伤害。Specifically, when the vehicle state signal acquired by the millimeter-wave radar is a driving state signal, gesture recognition and/or occupancy recognition may be performed. Gesture recognition in the driving state of the vehicle can make the driver pay more attention to driving safety, avoid auxiliary operations such as switching the air conditioner or sunroof from distracting the driver's attention, and ensure the driving safety of the vehicle. In the driving state of the vehicle, the occupancy recognition through the detection signal can make the vehicle judge whether to carry out the seat belt warning, so as to remind the drivers and passengers who are not wearing seat belts in the driving state to wear seat belts, and provide safety protection for the drivers and passengers. Reduce or avoid injuries in the event of traffic accidents.
具体的,毫米波雷达上电工作,当毫米波雷达获取到行车状态信号时,毫米波雷达的发射天线向第二预设区域发射特定频率的电磁波;电磁波遇到物体发生反射,反射的电磁波(即回波信号)携带了该第二预设区域的各种信息;毫米波雷达的接收天线接收该第二预设区域的回波信号,并根据该回波信号进行占位识别,进而判断是否进行安全带告警。Specifically, the millimeter-wave radar works when it is powered on. When the millimeter-wave radar acquires the driving status signal, the transmitting antenna of the millimeter-wave radar emits electromagnetic waves of a specific frequency to the second preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves ( That is, the echo signal) carries various information of the second preset area; the receiving antenna of the millimeter-wave radar receives the echo signal of the second preset area, and performs occupancy identification according to the echo signal, and then judges whether Carry out seat belt warning.
S404,在车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号;对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。S404. When the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life body identification on the received echo signal in the third preset area, and determine whether to carry out personnel identification according to the life body identification result. Stay alert.
可选的,第三预设区域为车辆内部的特定区域,可以包括可乘坐人员区域和后备箱区域,也可以仅为可乘坐人员区域。在车辆闭锁状态下进行生命体识别,可以有效避免将儿童或宠物等生命体遗忘在车内,防止惨剧的发生。Optionally, the third preset area is a specific area inside the vehicle, which may include the passenger area and the trunk area, or may only be the passenger area. Identifying living organisms when the vehicle is locked can effectively prevent living organisms such as children or pets from being left in the vehicle and prevent tragedies from happening.
具体的,毫米波雷达上电工作,当毫米波雷达获取到闭锁状态信号时,毫米波雷达的发射天线向第三预设区域发射特定频率的电磁波;电磁波遇到物体发生反射,反射的电磁波(即回波信号)携带了该第三预设区域的各种信息;毫米波雷达的接收天线接收该第三预设区域的回波信号,并根据该回波信号进行生命体识别,进而判断是否进行人员滞留告警。Specifically, the millimeter-wave radar is powered on and works. When the millimeter-wave radar acquires the signal of the locked state, the transmitting antenna of the millimeter-wave radar transmits electromagnetic waves of a specific frequency to the third preset area; the electromagnetic waves are reflected by objects, and the reflected electromagnetic waves ( That is, the echo signal) carries various information of the third preset area; the receiving antenna of the millimeter-wave radar receives the echo signal of the third preset area, and performs living body identification according to the echo signal, and then judges whether Carry out personnel stranded alarm.
可选的,人员滞留告警可以实现孩童防遗忘功能。本申请采用的毫米波雷达不仅适用于大幅度运动目标的探测,而且对胸腔微动信号也有很高的检测精度。毫米波雷达采用了4GHz大带宽,能够将微小的胸腔位移,转换成明显的相位变化。当相位的频率和相关性信息满足阈值要求时,则判定为存在真实目标,即车内存在生命体。Optionally, the personnel retention alarm can realize the anti-forgetting function of children. The millimeter-wave radar used in this application is not only suitable for detecting large-scale moving targets, but also has high detection accuracy for chest micro-movement signals. The millimeter-wave radar uses a large bandwidth of 4GHz, which can convert small chest displacements into obvious phase changes. When the frequency and correlation information of the phase meet the threshold requirements, it is determined that there is a real target, that is, there is a living body in the vehicle.
综上,步骤S401至S404通过以下步骤进行车辆控制:获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号;在车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号,对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;在车辆状态信号为行车状态信号时,向第一预设区域和第二预设区域发送探测信号,对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作,对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警;在车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号,对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。上述车辆控制过程中,通过毫米波雷达获取不同区域的回波信号,并对回波信号进行分析,实现了车辆的手势识别、安全带告警判断以及人员滞留告警判断;从而可以根据车辆不同的状态,实现车辆多功能智能辅助控制,使车辆的控制方式变得多样化,也使车辆更加智能化,优化了用户体验。To sum up, steps S401 to S404 carry out vehicle control through the following steps: acquire the vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal; The area sends detection signals, performs gesture recognition on the received echo signals in the first preset area, and controls the vehicle to perform corresponding preset operations according to the gesture recognition results; Send detection signals from the set area and the second preset area, perform gesture recognition on the echo signal received in the first preset area, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result, and perform gesture recognition on the received second preset area. Set the echo signal of the area for occupancy identification, and determine whether to issue a seat belt warning according to the occupancy identification result; The echo signal in the preset area is used to identify the living body, and according to the result of the living body identification, it is determined whether to issue an alarm for personnel retention. In the above vehicle control process, the echo signals in different areas are obtained through the millimeter wave radar, and the echo signals are analyzed to realize the gesture recognition of the vehicle, the judgment of the safety belt warning and the judgment of the personnel stranded warning; thus, it can be based on different states of the vehicle. , realize the multi-functional intelligent auxiliary control of the vehicle, diversify the control methods of the vehicle, make the vehicle more intelligent, and optimize the user experience.
在本申请的一个实施例中,如上文(步骤S107和S108)所述,上述S403中的“根据占位识别结果判定是否进行安全带告警”,可以包括以下步骤:In one embodiment of the present application, as described above (steps S107 and S108), the "determining whether to issue a seat belt warning based on the occupancy recognition result" in the above S403 may include the following steps:
S4031:将占位识别结果发送至车辆中控(即车辆的中央控制系统),当占位识别结果为占位区域被占位时,且所述车辆中控检测到该占位区域的安全带未系,且检测到车辆的行驶速度大于预设速度阈值时,进行占位区域的安全带告警;其中,占位区域为所述第二预设区域中的区域。S4031: Send the occupancy recognition result to the vehicle central control (that is, the vehicle's central control system), when the occupancy recognition result is that the occupancy area is occupied, and the vehicle central control detects the seat belt in the occupancy area When it is not fastened and it is detected that the driving speed of the vehicle is greater than a preset speed threshold, a seat belt warning is issued in the occupied area; wherein the occupied area is an area in the second preset area.
如前文所述,占位区域可以为主驾驶区域和/或副驾驶区域,这两个区域都属于第二预设区域中的区域。告警形式可以为声光告警。As mentioned above, the occupied area may be the main driving area and/or the co-driving area, both of which belong to the second preset area. The alarm form can be sound and light alarm.
示例性的,占位区域可以为多个,步骤S4031可以将各个占位区域的占位识别结果均发送至车辆中控。Exemplarily, there may be multiple occupancy areas, and step S4031 may send the occupancy recognition results of each occupancy area to the vehicle central control.
针对每个占位区域的占位识别结果,当该占位识别结果为该占位区域被占位时,且所述车辆中控检测到该占位区域的安全带未系,且检测到车辆的车速大于预设车速阈值时,则进行该占位区域的安全带声光告警。For the occupancy recognition result of each occupancy area, when the occupancy identification result is that the occupancy area is occupied, and the vehicle central control detects that the seat belt of the occupancy area is not fastened, and detects that the vehicle When the speed of the vehicle is greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupied area will be carried out.
可选的,当占位识别结果为占位区域未被占位时,或者检测到占位区域的安全带已系,或者检测到车辆的车速不大于预设车速阈值时,则不进行安全带告警。Optionally, when the occupancy recognition result shows that the occupancy area is not occupied, or it is detected that the seat belt in the occupancy area has been fastened, or when it is detected that the speed of the vehicle is not greater than the preset speed threshold, no seat belt is performed. alarm.
在本申请的一个实施例中,上述S404中的“根据生命体识别结果判定是否进行人员滞留告警”,可以包括以下步骤:In one embodiment of the present application, the "determining whether to perform a personnel detention alarm based on the result of the living body identification" in the above S404 may include the following steps:
S4041,将生命体识别结果发送至车辆中控,当所述生命体识别结果为第三预设区域存在生命体时,进行第三预设区域的人员滞留告警。S4041. Send the living body identification result to the vehicle central control, and when the living body identification result shows that there is a living body in the third preset area, perform an alarm for people staying in the third preset area.
相应的,当所述生命体识别结果为第三预设区域不存在生命体时,不进行第三预设区域的人员滞留告警。Correspondingly, when the result of the identification of the living body is that there is no living body in the third preset area, an alarm for personnel staying in the third preset area is not performed.
可选的,如果检测到车内有生命体,可以将有生命体识别结果通过CAN总线发送到车辆中控,并控制车辆进行双闪鸣笛报警;同时,车辆中控可以通过车联网将报警信息发至客户手机端,进行双重告警,进一步保障滞留儿童的安全。Optionally, if a living body is detected in the vehicle, the identification result of the living body can be sent to the vehicle central control through the CAN bus, and the vehicle will be controlled to give a double-flashing whistle alarm; at the same time, the vehicle central control can send the alarm to The information is sent to the client's mobile phone, and a double alarm is issued to further protect the safety of stranded children.
在本申请的一个实施例中,车辆控制方法还可以包括以下步骤:In one embodiment of the present application, the vehicle control method may further include the following steps:
S405,记录并上传安全带告警和人员滞留告警;S405, recording and uploading the seat belt warning and personnel detention warning;
S406,将人员滞留告警发送至用户端。S406. Sending the people retention alarm to the user terminal.
上述两个步骤将安全带告警和人员滞留告警进行记录,从而能够通过数据分析进一步优化车辆告警信息的生成和应用过程。The above two steps record the seat belt warning and personnel retention warning, so that the generation and application process of vehicle warning information can be further optimized through data analysis.
在本申请的一个实施例中,在车辆状态信号为闭锁状态信号时,车辆控制方法还包括以下步骤:In one embodiment of the present application, when the vehicle state signal is a locked state signal, the vehicle control method further includes the following steps:
S407,当闭锁状态信号的持续时间大于预设时间阈值时,停止向第三预设区域发送探测信号。S407. When the duration of the locked state signal is greater than the preset time threshold, stop sending the detection signal to the third preset area.
示例性的,车辆控制的工作逻辑可以表现为:Exemplarily, the working logic of vehicle control can be expressed as:
车辆解锁状态下,毫米波雷达可实现手势识别功能,进而控制天窗开关和空调温度等;When the vehicle is unlocked, the millimeter-wave radar can realize the gesture recognition function, and then control the sunroof switch and the temperature of the air conditioner;
车辆行驶过程中,毫米波雷达探测座位上有无人员,当车速大于某一速度时且有人且未系安全带时,进行声光报警,提示驾乘人员系好安全带;When the vehicle is running, the millimeter-wave radar detects whether there is a person on the seat. When the vehicle speed is greater than a certain speed and there are people without seat belts, an audible and visual alarm will be issued to remind drivers and passengers to fasten their seat belts;
车辆锁车状态下,自锁车动作发生后的30min内,探测车内有无滞留孩童,防止高温窒息事故的发生。一般情况下,工作时长可由用户进行设置(例如设置为上述的30min);工作时长过完后,毫米波雷达进入休眠(sleep)模式,工作电流<100uA,功耗极低,符合车辆安全要求。When the vehicle is locked, within 30 minutes after the self-locking action occurs, it will detect whether there are children stranded in the vehicle to prevent the occurrence of high temperature suffocation accidents. In general, the working time can be set by the user (for example, the above-mentioned 30min); after the working time is over, the millimeter-wave radar enters the sleep mode, the working current is <100uA, and the power consumption is extremely low, which meets the vehicle safety requirements.
在本申请的一个实施例中,如上文(步骤S101至S103)所述,上述S403中的“对接收到的第二预设区域的回波信号进行占位识别”,可以包括以下步骤S4031至S4033。下面分别对这3个步骤进行说明。In one embodiment of the present application, as described above (steps S101 to S103), the "occupancy identification of the received echo signal in the second preset area" in the above S403 may include the following steps S4031 to S4033. The three steps are described below.
S4031,对第二预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;第二预设区域的每一路天线回波信号为对车辆内部的第二预设区域进行探测得到的回波信号。S4031. Sampling each antenna echo signal in the second preset area respectively to obtain a time-domain echo signal set; each antenna echo signal in the second preset area is a second preset area inside the vehicle. The detected echo signal.
可选的,每一路天线对应一路时域回波信号,所有天线的时域回波信号形成时域回波信号集。在雷达领域中,可以使用距离维、方位维、俯仰维三个维度的数据表征被测物在球坐标中的三维位置信息。步骤S4031中所述的采样可以是对每一路天线,沿距离维和时间维对天线回波信号进行ADC采样;采样时,可以选用快时间采样方式。第二预设区域的回波信号包括多路天线回波信号。Optionally, each antenna corresponds to one time-domain echo signal, and the time-domain echo signals of all antennas form a time-domain echo signal set. In the field of radar, three-dimensional data of distance dimension, azimuth dimension and pitch dimension can be used to represent the three-dimensional position information of the measured object in spherical coordinates. The sampling described in step S4031 may be to perform ADC sampling on the antenna echo signal along the distance dimension and the time dimension for each antenna; when sampling, a fast time sampling method may be selected. The echo signals in the second preset area include multi-channel antenna echo signals.
S4032,针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。S4032. For each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT processing on the time-domain echo signal to obtain distance information of the time-domain echo signal.
步骤S4032中,一维FFT处理可以将时域回波信号变换至频域回波信号,进而得到该时域回波信号在第二预设区域的距离信息,即可以得到该时域回波信号在第二预设区域的距离分布。In step S4032, the one-dimensional FFT processing can transform the time-domain echo signal into the frequency-domain echo signal, and then obtain the distance information of the time-domain echo signal in the second preset area, that is, the time-domain echo signal can be obtained The distance distribution in the second preset area.
S4033,根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。S4033. According to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area set to determine whether each occupancy area is occupied.
占位区域被占位可以理解为该占位区域有人;例如,一个占位区域为副驾驶,该占位区域被占位表现为副驾驶有人。The occupancy area is occupied can be understood as the occupancy area is occupied; for example, an occupancy area is the co-pilot, and the occupancy area is occupied by the co-pilot.
在本申请提供的车辆控制方法的一个实施例中,如上文所述,时域回波信号集中的各个时域回波信号均包括多个采样点的回波信号;时域回波信号的距离信息包括该时域回波信号对应的多个采样点的回波信号的距离值。In one embodiment of the vehicle control method provided by the present application, as described above, each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance of the time-domain echo signal The information includes distance values of echo signals at multiple sampling points corresponding to the time-domain echo signal.
上述步骤S4033中“根据时域回波信号集中的各个时域回波信号的距离信息确定车辆内部的各个占位区域分别对应的有效回波信号集”,可以包括以下步骤:In the above-mentioned step S4033, "determining the effective echo signal sets corresponding to each occupancy area inside the vehicle according to the distance information of each time-domain echo signal in the time-domain echo signal set" may include the following steps:
S4033-1,针对时域回波信号集中每个时域回波信号,从该时域回波信号中的所有距离值中,选取在预设范围内的采样点的回波信号,作为该时域回波信号对应的有效回波信号;S4033-1. For each time-domain echo signal in the time-domain echo signal set, select an echo signal at a sampling point within a preset range from all distance values in the time-domain echo signal as the time-domain echo signal. Effective echo signal corresponding to domain echo signal;
S4033-2,对各个有效回波信号分别进行二维DOA估计,得到各个有效回波信号分别对应的采样点的位置信息;S4033-2, respectively performing two-dimensional DOA estimation on each effective echo signal, and obtaining position information of sampling points respectively corresponding to each effective echo signal;
S4033-3,根据各个有效回波信号分别对应的采样点的位置信息,确定车辆内部的各个占位区域分别对应的有效回波信号集。S4033-3. According to the location information of the sampling points corresponding to each effective echo signal, determine the effective echo signal sets corresponding to each occupying area inside the vehicle.
在本申请的一个实施例中,上述S402或者S403中的“对接收到的第一预设区域的回波信号进行手势识别”,可以包括以下步骤:In one embodiment of the present application, the "gesture recognition of the received echo signal in the first preset area" in the above S402 or S403 may include the following steps:
S4021,对第一预设区域的每一路天线回波信号进行采样,得到手势回波信号集;第一预设区域的每一路天线回波信号为对车辆内部的第一预设区域进行探测得到的回波信号;S4021. Sampling each antenna echo signal in the first preset area to obtain a gesture echo signal set; each antenna echo signal in the first preset area is obtained by detecting the first preset area inside the vehicle the echo signal;
S4022,对手势回波信号集中的各个手势回波信号进行一维FFT,并对一维变换后的各个手势回波信号进行二维FFT,得到第一预设区域中各个采样点的点云数据;点云数据包括各个采样点的距离信息和速度信息;S4022. Perform one-dimensional FFT on each gesture echo signal in the gesture echo signal set, and perform two-dimensional FFT on each gesture echo signal after one-dimensional transformation, to obtain point cloud data of each sampling point in the first preset area ; Point cloud data includes distance information and velocity information of each sampling point;
S4023,对第一预设区域内所有速度不为零的采样点的点云数据进行计算,得到各个速度不为零的采样点的点云数据的幅度;S4023. Calculate the point cloud data of all sampling points whose speed is not zero in the first preset area, and obtain the amplitude of the point cloud data of each sampling point whose speed is not zero;
S4024,对各个速度不为零的点云数据的幅度进行非相参积累处理,并选取所有非相参积累处理后幅度大于预设幅度的点云数据形成目标点云数据集;S4024, perform non-coherent accumulation processing on the magnitude of each point cloud data whose speed is not zero, and select all point cloud data whose magnitude after non-coherent accumulation processing is greater than the preset magnitude to form a target point cloud data set;
S4025,对目标点云数据集进行二维DOA估计,得到目标点云数据集中各个点云数据对应采样点的空间角度信息;S4025. Perform two-dimensional DOA estimation on the target point cloud data set, and obtain spatial angle information of each point cloud data corresponding to the sampling point in the target point cloud data set;
S4026,根据目标点云数据集中,各个点云数据对应的采样点的空间角度信息,进行手势识别。S4026. Perform gesture recognition according to spatial angle information of sampling points corresponding to each point cloud data in the target point cloud data set.
可选的,第一预设区域与雷达的距离小于0.5m,加上手势是有速度的动作,故步骤S4021至S4026可以截取0~0.5m内、速度非零的点云数据;对得到的点云数据进行非相参积累处理,并选取所有非相参积累处理后幅度大于预设幅度的点云数据形成目标点云数据集。非相参积累是本领域公知的技术手段。Optionally, the distance between the first preset area and the radar is less than 0.5m, and the gesture is an action with speed, so steps S4021 to S4026 can intercept point cloud data within 0~0.5m and with a non-zero speed; The point cloud data is subjected to non-coherent accumulation processing, and all point cloud data whose magnitude after non-coherent accumulation processing is greater than the preset magnitude are selected to form the target point cloud data set. Non-coherent accumulation is a well-known technique in the art.
可选的,目标点云数据集中的各个点云数据均包含距离、速度、方位角、俯仰角等多维信息。Optionally, each point cloud data in the target point cloud dataset includes multi-dimensional information such as distance, velocity, azimuth, and pitch angle.
示例性的,手势识别的过程可以为:Exemplarily, the process of gesture recognition can be:
设定1:第一预设区域的左侧对应毫米波雷达方位的负角度、第一预设区域的右侧对应毫米波雷达方位的正角度;Setting 1: The left side of the first preset area corresponds to the negative angle of the millimeter-wave radar azimuth, and the right side of the first preset area corresponds to the positive angle of the millimeter-wave radar azimuth;
设定2:距离毫米波雷达30cm内的一组由左向右滑动的匀速手势共历时60帧,按时间先后来看,将60帧划分为三个阶段(这里为了说明,以三个阶段为例,实际可进一步细化);Setting 2: A group of gestures that slide from left to right at a constant speed within 30cm from the millimeter-wave radar lasts for 60 frames. According to the time sequence, the 60 frames are divided into three stages (here for illustration, the three stages are For example, the actual can be further refined);
则点集轨迹应该呈现为:Then the point set trajectory should be rendered as:
第一个阶段(1~20帧),点集集中在方位负角度上;In the first stage (1~20 frames), the point set is concentrated on the negative angle of azimuth;
第二个阶段(21~40帧),点集集中在方位零角度上;In the second stage (21~40 frames), the point set is concentrated on the zero angle of orientation;
第三个阶段(41~60帧),点集集中在方位正角度上。In the third stage (41~60 frames), the point set is concentrated on the positive angle of azimuth.
所有运动手势按上述轨迹原理进行分类,利用不同运动手势呈现的点集轨迹信息不同,即可判断出该手势是何种类型,从而实现手势识别。All motion gestures are classified according to the above-mentioned trajectory principle, and the point set trajectory information presented by different motion gestures is different, and the type of the gesture can be judged, thereby realizing gesture recognition.
本申请采用的毫米波技术频段高,带宽大,探测精度极高,不受光线、温度、灰尘、气候等影响;毫米波技术能够利用多普勒效应,对车内驾乘人员的运动进行灵敏的感知,探测精度高;毫米波技术可实现手势识别、占位安全带提醒、孩童防遗忘等功能,为智能车辆告警的发展提供了智能化解决方案。The millimeter wave technology used in this application has high frequency band, wide bandwidth, high detection accuracy, and is not affected by light, temperature, dust, climate, etc.; millimeter wave technology can use the Doppler effect to sensitively monitor the movement of the occupants in the car. Perception, high detection accuracy; millimeter wave technology can realize gesture recognition, occupancy seat belt reminder, children's anti-forgetting and other functions, providing an intelligent solution for the development of intelligent vehicle alarms.
应理解,上述车辆控制方法的实施例中,各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that in the above embodiments of the vehicle control method, the sequence numbers of the steps do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, and should not be used in the implementation of the embodiment of the present application. process constitutes any qualification.
以下为对应于本申请提供的车辆控制方法的装置实施例,对于其中未详尽描述的细节,可以参考上述车辆控制方法的实施例。The following are device embodiments corresponding to the vehicle control method provided in this application. For details not described in detail, reference may be made to the above embodiments of the vehicle control method.
图5是本申请提供的车辆控制装置的结构组成示意图。为了便于说明,图5仅示出了与本申请相关的部分,详述如下。Fig. 5 is a schematic diagram of the structural composition of the vehicle control device provided by the present application. For ease of description, FIG. 5 only shows the parts related to the present application, which are described in detail as follows.
如图5所示,车辆控制装置50可以包括获取模块501、第一控制模块502、第二控制模块503和第三控制模块504。As shown in FIG. 5 , the vehicle control device 50 may include an acquisition module 501 , a first control module 502 , a second control module 503 and a third control module 504 .
获取模块501用于执行步骤S401,即,获取车辆状态信号;车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号。The acquiring module 501 is configured to execute step S401, that is, acquiring a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal.
第一控制模块502用于执行步骤S402,即,在车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作。The first control module 502 is configured to execute step S402, that is, when the vehicle state signal is an unlocked state signal, send a detection signal to the first preset area; perform gesture recognition on the received echo signal in the first preset area, And control the vehicle to perform the corresponding preset operation according to the gesture recognition result.
第二控制模块503用于执行步骤S403,即,在车辆状态信号为行车状态信号时,向第一预设区域和第二预设区域发送探测信号;对接收到的第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;采用上文所述的、本申请提供的占位识别方法,对接收到的第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警。The second control module 503 is configured to execute step S403, that is, when the vehicle state signal is a driving state signal, send detection signals to the first preset area and the second preset area; wave signal for gesture recognition, and control the vehicle to perform the corresponding preset operation according to the gesture recognition result; adopt the above-mentioned occupancy recognition method provided by this application to perform the echo signal received in the second preset area Occupancy recognition, and according to the result of occupancy recognition, it is determined whether to issue a seat belt warning.
第三控制模块504用于执行步骤S404,即,在车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号;对接收到的第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。The third control module 504 is configured to execute step S404, that is, when the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life recognition on the received echo signal in the third preset area , and determine whether to perform a personnel detention alarm according to the result of the identification of the living body.
在本申请的一个实施例中,第二控制模块203可以包括占位识别单元。In an embodiment of the present application, the second control module 203 may include an occupancy recognition unit.
所述占位识别单元用于执行步骤S4031,即,将占位识别结果发送至车辆中控(即车辆的中央控制系统),当占位识别结果为占位区域被占位时,且所述车辆中控检测到占位区域的安全带未系,且检测到车辆的行驶速度大于预设速度阈值时,进行占位区域的安全带告警;其中,占位区域为所述第二预设区域中的区域。The occupancy identification unit is used to execute step S4031, that is, to send the occupancy identification result to the vehicle central control (that is, the vehicle's central control system), when the occupancy identification result is that the occupancy area is occupied, and the When the vehicle central control detects that the seat belt in the occupied area is not fastened, and detects that the driving speed of the vehicle is greater than the preset speed threshold, a seat belt alarm is issued in the occupied area; wherein, the occupied area is the second preset area in the area.
在本申请的一个实施例中,第三控制模块204可以包括生命体识别单元。In an embodiment of the present application, the third control module 204 may include a living body identification unit.
所述生命体识别单元用于执行步骤S4041,即,将生命体识别结果发送至车辆中控,当所述生命体识别结果为第三预设区域存在生命体时,进行第三预设区域的人员滞留告警。The living body identification unit is used to execute step S4041, that is, to send the living body identification result to the vehicle central control, and when the living body identification result shows that there is a living body in the third preset area, perform the identification of the third preset area. Personnel stranded alarm.
在本申请的一个实施例中,第三控制模块204还可以包括休眠单元。In an embodiment of the present application, the third control module 204 may further include a sleep unit.
所述休眠单元用于执行步骤S407,即,在车辆状态信号为闭锁状态信号时,当闭锁状态信号的持续时间大于预设时间阈值时,停止向第三预设区域发送探测信号。The dormancy unit is configured to execute step S407, that is, when the vehicle status signal is a locked status signal, and when the duration of the locked status signal is greater than a preset time threshold, stop sending detection signals to the third preset area.
在本申请的一个实施例中,第二控制模块203可以包括占位采样单元、占位变换单元和判断单元。In an embodiment of the present application, the second control module 203 may include an occupancy sampling unit, an occupancy conversion unit, and a judging unit.
所述占位采样单元用于执行步骤S4031,即,对第二预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;第二预设区域的每一路天线回波信号为对车辆内部的第二预设区域进行探测得到的回波信号。The occupancy sampling unit is used to perform step S4031, that is, to sample each antenna echo signal in the second preset area respectively to obtain a time-domain echo signal set; each antenna echo signal in the second preset area The signal is an echo signal obtained by detecting the second preset area inside the vehicle.
所述占位变换单元用于执行步骤S4032,即,针对时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。The occupancy transformation unit is configured to perform step S4032, that is, for each time domain echo signal in the time domain echo signal set, perform one-dimensional FFT processing on the time domain echo signal to obtain the time domain echo signal distance information.
所述判断单元用于执行步骤S4033,即,根据时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。The judging unit is used to execute step S4033, that is, according to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupied area inside the vehicle, and according to each The effective echo signal sets corresponding to the occupied areas respectively determine whether each occupied area is occupied.
在本申请的一个实施例中,时域回波信号集中的各个时域回波信号均包括多个采样点的回波信号;时域回波信号的距离信息包括该时域回波信号对应的多个采样点的回波信号的距离值。在这种情况下,所述判断单元可以包括选取子单元、估计子单元和回波确定子单元。In an embodiment of the present application, each time-domain echo signal in the time-domain echo signal set includes echo signals of multiple sampling points; the distance information of the time-domain echo signal includes the corresponding The distance value of the echo signal of multiple sampling points. In this case, the judgment unit may include a selection subunit, an estimation subunit and an echo determination subunit.
所述选取子单元用于执行步骤S4033-1,即,针对时域回波信号集中每个时域回波信号,从该时域回波信号中的所有距离值中,选取在预设范围内的采样点的回波信号,作为该时域回波信号对应的有效回波信号。The selection subunit is used to perform step S4033-1, that is, for each time domain echo signal in the time domain echo signal set, from all the distance values in the time domain echo signal, select The echo signal at the sampling point is used as the effective echo signal corresponding to the time-domain echo signal.
所述估计子单元用于执行步骤S4033-2,即,对各个有效回波信号分别进行二维DOA估计,得到各个有效回波信号分别对应的采样点的位置信息;The estimating subunit is used to perform step S4033-2, that is, perform two-dimensional DOA estimation on each effective echo signal respectively, and obtain position information of sampling points corresponding to each effective echo signal;
所述回波确定子单元用于执行步骤S4033-3,即,根据各个有效回波信号分别对应的采样点的位置信息确定车辆内部的各个占位区域分别对应的时域回波信号。The echo determination subunit is configured to perform step S4033-3, that is, determine the time-domain echo signals corresponding to each occupied area inside the vehicle according to the location information of the sampling points corresponding to each effective echo signal.
在本申请的一个实施例中,第一控制模块502和第二控制模块503,均可以包括手势采样单元、手势变换单元、手势计算单元、手势处理单元、手势估计单元和手势识别单元。In an embodiment of the present application, both the first control module 502 and the second control module 503 may include a gesture sampling unit, a gesture transformation unit, a gesture calculation unit, a gesture processing unit, a gesture estimation unit and a gesture recognition unit.
所述手势采样单元用于执行步骤S4021,即,对第一预设区域的每一路天线回波信号进行采样,得到手势回波信号集;第一预设区域的每一路天线回波信号为对车辆内部的第一预设区域进行探测得到的回波信号。The gesture sampling unit is used to perform step S4021, that is, to sample each antenna echo signal in the first preset area to obtain a gesture echo signal set; each antenna echo signal in the first preset area is a pair of The echo signal obtained by detecting the first preset area inside the vehicle.
所述手势变换单元用于执行步骤S4022,即,对手势回波信号集中的各个手势回波信号进行一维FFT变换,并对一维变换后的各个手势回波信号进行二维FFT变换,得到第一预设区域中各个采样点的点云数据;采样点的点云数据包括该采样点的距离和速度;The gesture transformation unit is used to perform step S4022, that is, perform one-dimensional FFT transformation on each gesture echo signal in the gesture echo signal set, and perform two-dimensional FFT transformation on each gesture echo signal after one-dimensional transformation, to obtain The point cloud data of each sampling point in the first preset area; the point cloud data of the sampling point includes the distance and speed of the sampling point;
所述手势计算单元用于执行步骤S4023,即,对第一预设区域内所有速度不为零的采样点的点云数据进行计算,得到各个速度不为零的采样点的点云数据的幅度;The gesture calculation unit is used to execute step S4023, that is, to calculate the point cloud data of all sampling points whose speed is not zero in the first preset area, and obtain the magnitude of the point cloud data of each sampling point whose speed is not zero ;
所述手势处理单元用于执行步骤S4024,即,对各个速度不为零的采样点的点云数据的幅度分别进行非相参积累处理,并选取所有非相参积累处理后的幅度大于预设幅度的采样点的点云数据形成目标点云数据集;The gesture processing unit is used to execute step S4024, that is, perform non-coherent accumulation processing on the amplitude of the point cloud data of each sampling point whose speed is not zero, and select all amplitudes after non-coherent accumulation processing that are greater than the preset The point cloud data of the sampling point of the amplitude forms the target point cloud data set;
所述手势估计单元用于执行步骤S4025,即,对目标点云数据集进行二维DOA波达估计,得到目标点云数据集中各个点云数据对应采样点的空间角度信息;The gesture estimation unit is used to perform step S4025, that is, perform two-dimensional DOA wave-of-arrival estimation on the target point cloud data set, and obtain the spatial angle information of each point cloud data corresponding to the sampling point in the target point cloud data set;
所述手势识别单元用于执行步骤S4026,即,根据目标点云数据集中各个点云数据对应的采样点的空间角度信息进行手势识别。The gesture recognition unit is configured to perform step S4026, that is, perform gesture recognition according to the spatial angle information of the sampling points corresponding to each point cloud data in the target point cloud dataset.
图6是本申请提供的第二毫米波雷达的示意图。如图6所示,第二毫米波雷达60包括处理器600、存储器601以及存储在存储器601中并可在处理器600上运行的计算机程序602。处理器600执行计算机程序602时实现上述各个车辆控制方法实施例中的步骤,例如图4所示的S401至S404。或者,处理器600执行计算机程序602时实现上述各装置实施例中各模块/单元的功能,例如图5所示模块501至504的功能。FIG. 6 is a schematic diagram of a second millimeter-wave radar provided by the present application. As shown in FIG. 6 , the second millimeter wave radar 60 includes a processor 600 , a memory 601 , and a computer program 602 stored in the memory 601 and operable on the processor 600 . When the processor 600 executes the computer program 602 , the steps in the above-mentioned embodiments of the vehicle control method are realized, such as S401 to S404 shown in FIG. 4 . Alternatively, when the processor 600 executes the computer program 602, the functions of the modules/units in the above-mentioned device embodiments are implemented, for example, the functions of the modules 501 to 504 shown in FIG. 5 .
示例性的,计算机程序602可以被分割成一个或多个模块/单元,这些模块/单元被存储在存储器601中,并由处理器600执行,以实现本申请的发明构思。这些模块/单元可以是能够完成特定功能的一系列计算机程序指令段,这些指令段用于描述计算机程序602在第二毫米波雷达60中的执行过程。例如,计算机程序602可以被分割成对应于图2所示的模块501至504的指令段。Exemplarily, the computer program 602 can be divided into one or more modules/units, and these modules/units are stored in the memory 601 and executed by the processor 600, so as to realize the inventive concept of the present application. These modules/units may be a series of computer program instruction segments capable of accomplishing specific functions, and these instruction segments are used to describe the execution process of the computer program 602 in the second millimeter wave radar 60 . For example, the computer program 602 may be divided into instruction segments corresponding to the modules 501 to 504 shown in FIG. 2 .
第二毫米波雷达30可包括,但不仅限于,处理器600和存储器601。本领域技术人员可以理解,图3仅仅是第二毫米波雷达60的一种示例,并不构成对第二毫米波雷达60的限定。第二毫米波雷达可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件The second millimeter wave radar 30 may include, but not limited to, a processor 600 and a memory 601 . Those skilled in the art can understand that FIG. 3 is only an example of the second millimeter-wave radar 60 , and does not constitute a limitation to the second millimeter-wave radar 60 . The second mmWave radar may include more or fewer components than shown, or combine certain components, or different components
本申请还提供了第二计算机可读存储介质。该存储介质存储有计算机程序。该计算机程序被处理器执行时,可以实现上述车辆控制方法对应的实施例记载的步骤,实现对车辆的各个辅助功能的控制。The present application also provides a second computer-readable storage medium. The storage medium stores a computer program. When the computer program is executed by the processor, the steps described in the embodiments corresponding to the above-mentioned vehicle control method can be realized, and the control of various auxiliary functions of the vehicle can be realized.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明。实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。本申请实施例中的各功能单元、模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。另外,各功能单元、模块的具体名称也只是为了便于相互区分,并不用于限制本申请的保护范围。本申请中各个单元、模块的具体工作过程,可以参考与之对应的方法实施例描述的过程,在此不再赘述。Those skilled in the art can clearly understand that, for convenience and brevity of description, only the division of the above functional units and modules is used as an example for illustration. In practical applications, the above function allocation can be completed by different functional units or modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application. For the specific working process of each unit and module in the present application, reference may be made to the process described in the corresponding method embodiment, which will not be repeated here.
本申请的实施例中,对各个实施例的描述都各有侧重;某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the embodiments of the present application, the description of each embodiment has its own focus; for the part that is not detailed or recorded in a certain embodiment, refer to the relevant descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的保护范围。Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Professionals may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the protection scope of the present application.
在本申请所提供的实施例中,应该理解到,本申请公开的装置/终端和方法,还可以通过其它不付出创造性劳动即可得到的变形方式实现。也就是说,以上所描述的装置/终端实施例仅仅是示意性的;例如,上述模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。例如,多个单元或模块可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通讯连接可以是通过一些接口,装置或单元的间接耦合或通讯连接,可以是电性,机械或其它的形式。In the embodiments provided in the present application, it should be understood that the device/terminal and method disclosed in the present application can also be implemented in other deformation manners that can be obtained without any creative effort. That is to say, the device/terminal embodiments described above are only illustrative; for example, the division of the above modules or units is only a logical function division, and there may be other division methods in actual implementation. For example, several units or modules may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。A unit described as a separate component may or may not be physically separated, and a component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实现上述实施例方法中的全部或部分流程,也可以通过计算机程序指令相关的硬件来完成。计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个占位识别方法实施例和/或车辆控制方法实施例的步骤。其中,计算机程序包括计算机程序代码。计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。计算机可读介质可以包括:能够携带计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、电载波信号、电信信号以及软件分发介质等。需要说明的是,计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括是电载波信号和电信信号。If an integrated module/unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the implementation of all or part of the procedures in the methods of the above-mentioned embodiments in the present application may also be completed by computer program instructions related hardware. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, it can realize the steps of the above embodiments of the occupancy recognition method and/or the vehicle control method. Wherein, the computer program includes computer program code. The computer program code may be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, read-only memory (Read-Only Memory, ROM), random access Memory (Random Access Memory, RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained on computer readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media does not include It is an electrical carrier signal and a telecommunication signal.
以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still apply to the foregoing embodiments Modifications to the technical solutions recorded, or equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of each embodiment of the application, and should be included in this application. within the scope of protection.
Claims (15)
- 一种占位识别方法,其特征在于,包括: A method for occupancy identification, characterized in that it comprises:对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;所述预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;Sampling each antenna echo signal in the preset area separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is an echo signal obtained by detecting a preset area inside the vehicle ;针对所述时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT(Fast Fourier Transform,快速傅里叶变换)处理,得到该时域回波信号的距离信息;For each time-domain echo signal in the time-domain echo signal set, perform one-dimensional FFT (Fast Fourier Transform, Fast Fourier Transform) processing on the time-domain echo signal to obtain the distance of the time-domain echo signal information;根据所述时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。According to the distance information of each time-domain echo signal in the time-domain echo signal set, determine the effective echo signal sets corresponding to each occupancy area inside the vehicle, and according to the effective echo signals corresponding to each occupancy area set to determine whether each occupancy area is occupied.
- 根据权利要求1所述的占位识别方法,其特征在于,所述时域回波信号集中的各个时域回波信号均包括多个采样点的回波信号;时域回波信号的距离信息包括该时域回波信号对应的多个采样点的回波信号的距离值; The occupancy identification method according to claim 1, wherein each time domain echo signal in the time domain echo signal set includes echo signals of a plurality of sampling points; the distance information of the time domain echo signals including distance values of echo signals of multiple sampling points corresponding to the time-domain echo signal;所述根据所述时域回波信号集中的各个时域回波信号的距离信息确定车辆内部的各个占位区域分别对应的有效回波信号集,包括:The determining, according to the distance information of each time-domain echo signal in the time-domain echo signal set, the effective echo signal sets corresponding to each occupying area inside the vehicle respectively, includes:针对所述时域回波信号集中每个时域回波信号,从该时域回波信号中的所有距离值中,选取在预设范围内的采样点的回波信号,作为该时域回波信号对应的有效回波信号;For each time domain echo signal in the time domain echo signal set, from all distance values in the time domain echo signal, select an echo signal at a sampling point within a preset range as the time domain echo signal The effective echo signal corresponding to the wave signal;对各个有效回波信号分别进行二维DOA(Direction Of Arrival,波达方向)估计,得到各个有效回波信号分别对应的采样点的位置信息;Two-dimensional DOA (Direction Of Arrival (direction of arrival) estimation to obtain the position information of the sampling points corresponding to each effective echo signal;根据各个有效回波信号分别对应的采样点的位置信息,确定车辆内部的各个占位区域分别对应的有效回波信号集。According to the position information of the sampling points corresponding to each effective echo signal, the effective echo signal sets corresponding to each occupying area inside the vehicle are respectively determined.
- 根据权利要求1所述的占位识别方法,其特征在于,所述根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位,包括: The occupancy identification method according to claim 1, wherein, according to the effective echo signal sets corresponding to each occupancy area, respectively determining whether each occupancy area is occupied comprises:根据各个占位区域分别对应的有效回波信号集,得到各个占位区域的点云信息;According to the effective echo signal sets corresponding to each occupied area, the point cloud information of each occupied area is obtained;针对每个占位区域,根据该占位区域的点云信息,计算该占位区域的每一点云的微动速度,并根据该占位区域的每一点云的微动速度,确定该占位区域是否被占位。For each occupancy area, calculate the fretting speed of each point cloud in the occupancy area according to the point cloud information of the occupancy area, and determine the occupancy area according to the fretting speed of each point cloud in the occupancy area Whether the region is occupied.
- 根据权利要求3所述的占位识别方法,其特征在于,所述根据该占位区域的每一点云的微动速度确定该占位区域是否被占位,包括: The occupancy recognition method according to claim 3, wherein said determining whether the occupancy area is occupied according to the fretting speed of each point cloud of the occupancy area comprises:若该占位区域中,微动速度大于预设微动速度的点云的数量,大于预设数量,则判定该占位区域被占位。If the number of point clouds whose inching speed is greater than the preset inching speed in the occupied area is greater than the preset number, it is determined that the occupied area is occupied.
- 根据权利要求1所述的占位识别方法,其特征在于,所述时域回波信号集中的各个时域回波信号,均包括多个采样点的回波信号; The occupancy identification method according to claim 1, wherein each time-domain echo signal in the time-domain echo signal set includes echo signals of a plurality of sampling points;在所述对该时域回波信号进行一维FFT处理之前,所述方法还包括:Before performing one-dimensional FFT processing on the time-domain echo signal, the method also includes:求取该时域回波信号中,各个采样点的回波信号的信号平均值;Calculating the signal average value of the echo signals at each sampling point in the time-domain echo signal;将该时域回波信号中的各个采样点的回波信号,分别与对应的信号平均值作差,得到该时域回波信号的过滤后的时域回波信号;The echo signal of each sampling point in the time-domain echo signal is respectively different from the corresponding signal average value to obtain a filtered time-domain echo signal of the time-domain echo signal;相应的,所述对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息,包括:Correspondingly, performing one-dimensional FFT processing on the time-domain echo signal to obtain distance information of the time-domain echo signal, including:对所述过滤后的时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息。One-dimensional FFT processing is performed on the filtered time-domain echo signal to obtain distance information of the time-domain echo signal.
- 根据权利要求1至5任一项所述的占位识别方法,其特征在于,所述方法还包括: The occupancy identification method according to any one of claims 1 to 5, wherein the method further comprises:将各个占位区域的占位判定结果发送至车辆的中央控制系统;Send the occupancy determination results of each occupancy area to the central control system of the vehicle;针对每个占位区域的占位判定结果,当该占位判定结果为该占位区域被占位时,且所述中央控制系统检测到该占位区域的安全带未系,且检测到车辆的车速大于预设车速阈值时,进行该占位区域的安全带声光告警。For the occupancy determination result of each occupancy area, when the occupancy determination result is that the occupancy area is occupied, and the central control system detects that the seat belt of the occupancy area is not fastened, and detects that the vehicle When the speed of the vehicle is greater than the preset speed threshold, the audible and visual warning of the seat belt in the occupied area will be performed.
- 一种占位识别装置,其特征在于,包括: An occupancy recognition device, characterized in that it comprises:采样模块,用于对预设区域的每一路天线回波信号分别进行采样,得到时域回波信号集;所述预设区域的每一路天线回波信号为对车辆内部的预设区域进行探测得到的回波信号;The sampling module is used to sample each antenna echo signal in the preset area separately to obtain a time-domain echo signal set; each antenna echo signal in the preset area is used to detect the preset area inside the vehicle The echo signal obtained;变换模块,用于针对所述时域回波信号集中的每一时域回波信号,对该时域回波信号进行一维FFT处理,得到该时域回波信号的距离信息;A transformation module, configured to perform one-dimensional FFT processing on each time-domain echo signal in the time-domain echo signal set to obtain distance information of the time-domain echo signal;判断模块,用于根据所述时域回波信号集中的各个时域回波信号的距离信息,确定车辆内部的各个占位区域分别对应的有效回波信号集,并根据各个占位区域分别对应的有效回波信号集,分别判定各个占位区域是否被占位。A judging module, configured to determine, according to the distance information of each time-domain echo signal in the time-domain echo signal set, the valid echo signal sets corresponding to each occupancy area inside the vehicle, and corresponding to each occupancy area The effective echo signal set is used to determine whether each occupancy area is occupied.
- 毫米波雷达,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如上的权利要求1至6中任一项所述的占位识别方法的步骤。A millimeter-wave radar, comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, characterized in that, when the processor executes the computer program, the above claims 1 to 1 are realized. Steps of the occupancy recognition method described in any one of 6.
- 计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如上的权利要求1至6中任一项所述的占位识别方法的步骤。A computer-readable storage medium, the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the occupancy identification method as described in any one of claims 1 to 6 is implemented A step of.
- 一种车辆控制方法,其特征在于,包括: A vehicle control method, characterized by comprising:获取车辆状态信号;所述车辆状态信号包括解锁状态信号、行车状态信号或者闭锁状态信号;Obtaining a vehicle state signal; the vehicle state signal includes an unlocked state signal, a driving state signal or a locked state signal;在所述车辆状态信号为解锁状态信号时,向第一预设区域发送探测信号;对接收到的所述第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;When the vehicle state signal is an unlocked state signal, send a detection signal to the first preset area; perform gesture recognition on the received echo signal in the first preset area, and control the vehicle to perform corresponding actions according to the gesture recognition result. default operation;在所述车辆状态信号为行车状态信号时,向所述第一预设区域和第二预设区域发送探测信号;对接收到的所述第一预设区域的回波信号进行手势识别,并根据手势识别结果控制车辆执行对应的预设操作;采用权利要求1至6任一项所述的占位识别方法,对接收到的所述第二预设区域的回波信号进行占位识别,并根据占位识别结果判定是否进行安全带告警;When the vehicle state signal is a driving state signal, sending a detection signal to the first preset area and the second preset area; performing gesture recognition on the received echo signal in the first preset area, and Controlling the vehicle to perform a corresponding preset operation according to the gesture recognition result; using the occupancy recognition method according to any one of claims 1 to 6 to perform occupancy recognition on the received echo signal in the second preset area, And according to the occupancy recognition result, it is determined whether to carry out the seat belt warning;在所述车辆状态信号为闭锁状态信号时,向第三预设区域发送探测信号;对接收到的所述第三预设区域的回波信号进行生命体识别,并根据生命体识别结果判定是否进行人员滞留告警。When the vehicle state signal is a locked state signal, send a detection signal to the third preset area; perform life body identification on the received echo signal in the third preset area, and determine whether to Carry out personnel stranded alarm.
- 根据权利要求10所述的车辆控制方法,其特征在于,所述根据占位识别结果判定是否进行安全带告警,包括: The vehicle control method according to claim 10, wherein the determining whether to perform seat belt warning according to the occupancy recognition result comprises:将所述占位识别结果发送至车辆的中央控制系统,当所述占位识别结果为占位区域被占位时,且所述中央控制系统检测到所述占位区域的安全带未系,且检测到所述车辆的行驶速度大于预设速度阈值时,进行所述占位区域的安全带告警;其中,所述占位区域为所述第二预设区域中的区域。Sending the occupancy identification result to the central control system of the vehicle, when the occupancy identification result is that the occupancy area is occupied, and the central control system detects that the seat belt in the occupancy area is not fastened, And when it is detected that the driving speed of the vehicle is greater than a preset speed threshold, a seat belt warning is performed in the occupied area; wherein the occupied area is an area in the second preset area.
- 根据权利要求10所述的车辆控制方法,其特征在于,所述根据生命体识别结果判定是否进行人员滞留告警,包括: The vehicle control method according to claim 10, characterized in that the determining whether to perform an alarm for personnel retention according to the life body identification result comprises:将所述生命体识别结果发送至车辆的中央控制系统,当所述生命体识别结果为第三预设区域存在生命体时,进行所述第三预设区域的人员滞留告警。The living body identification result is sent to the central control system of the vehicle, and when the living body identification result shows that there is a living body in the third preset area, an alarm for personnel staying in the third preset area is issued.
- 根据权利要求10所述的车辆控制方法,其特征在于,所述在所述车辆状态信号为闭锁状态信号时,所述方法还包括: The vehicle control method according to claim 10, wherein when the vehicle state signal is a locked state signal, the method further comprises:当所述闭锁状态信号的持续时间大于预设时间阈值时,停止向所述第三预设区域发送探测信号。When the duration of the locked state signal is greater than a preset time threshold, stop sending detection signals to the third preset area.
- 根据权利要求10至13任一项所述的车辆控制方法,其特征在于,所述对接收到的所述第一预设区域的回波信号进行手势识别,包括: The vehicle control method according to any one of claims 10 to 13, wherein the gesture recognition of the received echo signal in the first preset area comprises:对所述第一预设区域的每一路天线回波信号进行采样,得到手势回波信号集;所述第一预设区域的每一路天线回波信号为对车辆内部的第一预设区域进行探测得到的回波信号;Sampling each antenna echo signal in the first preset area to obtain a gesture echo signal set; each antenna echo signal in the first preset area is for the first preset area inside the vehicle The detected echo signal;对手势回波信号集中的各个手势回波信号进行一维FFT,并对一维变换后的各个手势回波信号进行二维FFT,得到第一预设区域中各个采样点的点云数据;采样点的点云数据包括该采样点的距离和速度;Performing a one-dimensional FFT on each gesture echo signal in the gesture echo signal set, and performing a two-dimensional FFT on each gesture echo signal after the one-dimensional transformation, to obtain point cloud data of each sampling point in the first preset area; sampling Point cloud data includes the distance and velocity of the sampling point;对第一预设区域内所有速度不为零的采样点的点云数据进行计算,得到各个速度不为零的采样点的点云数据的幅度;Calculating the point cloud data of all sampling points whose velocity is not zero in the first preset area to obtain the magnitude of the point cloud data of each sampling point whose velocity is not zero;对各个速度不为零的采样点的点云数据的幅度分别进行非相参积累处理,并选取所有非相参积累处理后的幅度大于预设幅度的采样点的点云数据形成目标点云数据集;Perform non-coherent accumulation processing on the amplitude of the point cloud data of each sampling point whose speed is not zero, and select all point cloud data of the sampling point whose amplitude after non-coherent accumulation processing is greater than the preset amplitude to form the target point cloud data set;对目标点云数据集进行二维DOA波达估计,得到目标点云数据集中各个点云数据对应采样点的空间角度信息;Perform two-dimensional DOA wave-of-arrival estimation on the target point cloud data set, and obtain the spatial angle information of each point cloud data corresponding to the sampling point in the target point cloud data set;根据目标点云数据集中,各个点云数据对应的采样点的空间角度信息,进行手势识别。Gesture recognition is performed according to the spatial angle information of the sampling points corresponding to each point cloud data in the target point cloud data set.
- 毫米波雷达,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现如上的权利要求10至14中任一项所述的车辆控制方法的步骤。A millimeter-wave radar, comprising a memory, a processor, and a computer program stored in the memory and operable on the processor, characterized in that, when the processor executes the computer program, the above claims 10 to 10 are realized. The steps of the vehicle control method described in any one of 14.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110926416.6 | 2021-08-12 | ||
CN202110926416.6A CN113561911B (en) | 2021-08-12 | 2021-08-12 | Vehicle control method, vehicle control device, millimeter wave radar, and storage medium |
CN202110926413.2 | 2021-08-12 | ||
CN202110926413.2A CN113740855B (en) | 2021-08-12 | 2021-08-12 | Space occupation identification method and device, millimeter wave radar and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023016350A1 true WO2023016350A1 (en) | 2023-02-16 |
Family
ID=85200533
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/110322 WO2023016350A1 (en) | 2021-08-12 | 2022-08-04 | Seat occupancy identification method and vehicle control method using same |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2023016350A1 (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017181225A (en) * | 2016-03-30 | 2017-10-05 | 本田技研工業株式会社 | Vehicle occupant detection device |
DE102017214009A1 (en) * | 2017-08-10 | 2019-02-14 | Volkswagen Aktiengesellschaft | Method and device for detecting the presence and / or movement of a vehicle occupant |
CN112272779A (en) * | 2018-06-11 | 2021-01-26 | Iee国际电子工程股份公司 | Method for robust vehicle occupancy detection through vital sign monitoring |
CN113219446A (en) * | 2021-04-30 | 2021-08-06 | 森思泰克河北科技有限公司 | In-vehicle radar occupancy identification method and device and vehicle-mounted radar |
CN113561911A (en) * | 2021-08-12 | 2021-10-29 | 森思泰克河北科技有限公司 | Vehicle control method, vehicle control device, millimeter wave radar, and storage medium |
CN113740855A (en) * | 2021-08-12 | 2021-12-03 | 森思泰克河北科技有限公司 | Occupancy identification method and device, millimeter wave radar and storage medium |
-
2022
- 2022-08-04 WO PCT/CN2022/110322 patent/WO2023016350A1/en unknown
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017181225A (en) * | 2016-03-30 | 2017-10-05 | 本田技研工業株式会社 | Vehicle occupant detection device |
DE102017214009A1 (en) * | 2017-08-10 | 2019-02-14 | Volkswagen Aktiengesellschaft | Method and device for detecting the presence and / or movement of a vehicle occupant |
CN112272779A (en) * | 2018-06-11 | 2021-01-26 | Iee国际电子工程股份公司 | Method for robust vehicle occupancy detection through vital sign monitoring |
CN113219446A (en) * | 2021-04-30 | 2021-08-06 | 森思泰克河北科技有限公司 | In-vehicle radar occupancy identification method and device and vehicle-mounted radar |
CN113561911A (en) * | 2021-08-12 | 2021-10-29 | 森思泰克河北科技有限公司 | Vehicle control method, vehicle control device, millimeter wave radar, and storage medium |
CN113740855A (en) * | 2021-08-12 | 2021-12-03 | 森思泰克河北科技有限公司 | Occupancy identification method and device, millimeter wave radar and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN113561911B (en) | Vehicle control method, vehicle control device, millimeter wave radar, and storage medium | |
CN112816960B (en) | In-vehicle life detection method, device, equipment and storage medium | |
WO2022068097A1 (en) | Noise reduction method for improving frequency-modulated continuous wave radar target detection | |
KR20190129622A (en) | Method of clustering targets detected by automotive radar system and apparatus for the same | |
CN109703557B (en) | Rear side early warning device and method for learning driving mode | |
Abedi et al. | AI-powered in-vehicle passenger monitoring using low-cost mm-wave radar | |
US20220198205A1 (en) | System and method for classification of objects in vehicle using feature vectors | |
CN113945913A (en) | Method for detecting personnel in vehicle based on millimeter wave radar point cloud | |
KR100759757B1 (en) | An active automotive safety system using a short range radar and an image sensor | |
EP4306991A1 (en) | Interference detection method and device | |
WO2023284764A1 (en) | Method and apparatus for detecting living body in vehicle by means of radar, and terminal device | |
CN114212045A (en) | Method and system for detecting passengers in vehicle | |
CN113406613B (en) | Personnel detection method, device, equipment and storage medium | |
CN113740855B (en) | Space occupation identification method and device, millimeter wave radar and storage medium | |
CN112034464B (en) | Target classification method | |
WO2023016350A1 (en) | Seat occupancy identification method and vehicle control method using same | |
Li et al. | In-vehicle occupant detection system using mm-wave radar | |
CN116644271A (en) | Target object detection method, device, vehicle and medium | |
EP4239364A1 (en) | Electronic device, electronic device control method, and program | |
EP4386447A1 (en) | Detection method, detection apparatus and radar | |
CN116627382A (en) | Data processing method and device and radar sensor | |
Kruse et al. | Target classification based on near-distance radar sensors | |
CN115932825A (en) | Millimeter wave radar-based method for monitoring people staying in vehicle | |
WO2022024690A1 (en) | Electronic device, method for controlling electronic device, and program | |
EP4239367A1 (en) | Electronic device, method for controlling electronic device, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22855332 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |