CN114241015B - Method and device for counting number of people who pass in and out based on millimeter wave radar - Google Patents

Method and device for counting number of people who pass in and out based on millimeter wave radar Download PDF

Info

Publication number
CN114241015B
CN114241015B CN202210183623.1A CN202210183623A CN114241015B CN 114241015 B CN114241015 B CN 114241015B CN 202210183623 A CN202210183623 A CN 202210183623A CN 114241015 B CN114241015 B CN 114241015B
Authority
CN
China
Prior art keywords
target
state
center
crossing line
tracking
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210183623.1A
Other languages
Chinese (zh)
Other versions
CN114241015A (en
Inventor
刘军辉
唐德琴
张理斌
杨青山
谷林峰
肖文剑
章锡阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha Microbrain Intelligent Technology Co ltd
Original Assignee
Changsha Microbrain Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha Microbrain Intelligent Technology Co ltd filed Critical Changsha Microbrain Intelligent Technology Co ltd
Priority to CN202210183623.1A priority Critical patent/CN114241015B/en
Publication of CN114241015A publication Critical patent/CN114241015A/en
Application granted granted Critical
Publication of CN114241015B publication Critical patent/CN114241015B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • G06T7/277Analysis of motion involving stochastic approaches, e.g. using Kalman filters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/66Radar-tracking systems; Analogous systems
    • G01S13/72Radar-tracking systems; Analogous systems for two-dimensional tracking, e.g. combination of angle and range tracking, track-while-scan radar
    • G01S13/723Radar-tracking systems; Analogous systems for two-dimensional tracking, e.g. combination of angle and range tracking, track-while-scan radar by using numerical data
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20076Probabilistic image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30232Surveillance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30241Trajectory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30242Counting objects in image

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Electromagnetism (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Multimedia (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

The invention discloses a method for counting the number of people passing in and out based on a millimeter wave radar, which comprises the steps of carrying out point cloud cluster tracking processing on a human target and outputting an output clustered target set; predicting and updating each target in the clustered target set by adopting an extended Kalman tracking algorithm, and acquiring the position information of the target in real time; converting the target position information into a Cartesian coordinate system from a polar coordinate to obtain a tracking target set; continuously tracking the same track ID, judging the in-out state of the tracked target according to the position and the speed of the tracked target relative to the first crossing line, the second crossing line and the third crossing line, adding 1 to the number of the in-out persons of the target in the tracked state, and subtracting 1 from the number of the in-out persons of the target in the tracked state. The method allocates a unique track ID to the pedestrian in the monitoring area, and judges the position and the speed direction on the adjacent frames; effectively avoiding repeated counting of people staying at the doorway.

Description

Method and device for counting number of people who pass in and out based on millimeter wave radar
Technical Field
The invention belongs to the technical field of monitoring, and particularly relates to a method and a device for counting the number of people passing in and out based on a millimeter wave radar.
Background
The existing statistical method for the number of people passing in and out comprises an image processing technology and an infrared correlation technology. The image processing is based on optical camera imaging, and algorithms such as target extraction, target recognition, track analysis and the like are mainly adopted; it is greatly influenced by ambient light, and has complex treatment process and high cost. The infrared correlation adopts a transmitting head and a receiving head, if an object passes through the middle, light rays are shielded, a pulse signal is output to trigger a counting circuit, the transmitting head and the receiving head are combined into an infrared probe, when the object appears in front of the probe, the infrared rays of the transmitting head are reflected to the receiving head, the probe outputs a pulse to count a counter, and the defects that the direction of a target cannot be judged, whether the target leaves cannot be confirmed, and the counting is easy to repeat.
Disclosure of Invention
The millimeter wave radar detection mainly applies Doppler effect and FMCW technology. The basic principle is that the transmitted wave is a frequency-modulated continuous wave, and the frequency of the frequency-modulated continuous wave changes along with the time according to the triangular wave rule. The frequency change rule of the received echo and the transmitted frequency is the same as a triangular wave rule, only a time difference exists, the target distance can be calculated by utilizing the small time difference, and radar point cloud containing distance, speed and direction information is obtained. The device has the advantages of high detection precision, all-weather work and no influence of weather. In view of this, the invention provides a method for counting the number of people passing in and out based on a millimeter wave radar.
The invention discloses a method for counting the number of people who enter and exit based on a millimeter wave radar, which comprises the following steps:
detecting a human body target by the millimeter wave radar, carrying out point cloud cluster tracking processing on the human body target, and outputting an output clustered target set T = { T =1......,TkWhere T is1......,TkK is the number of clustering targets;
adopting an extended Kalman tracking algorithm to perform clustering on the target set T = { T = { (T) }1......,TkEach target T iniPredicting and updating, and acquiring the position information of the target in real time;
converting the position of the target Ti from a polar coordinate to a Cartesian coordinate system to obtain a tracking target set tracks = { TR = { (TR) }0,TR1,......TRn-1In which TRi=[Tid,Xi,Yi,Vi],Xi,YiIs the spatial coordinate, T, of the relative radar in the radar three-dimensional spaceidIs track ID, ViIs the speed;
continuously tracking the same track ID in the track list, judging the in-out state of the tracked target according to the position and the speed of the tracked target of the same track ID relative to the first crossing line, the second crossing line and the third crossing line, adding 1 to the number of the in-out persons of the target of which the tracked target is in an entried state, and subtracting 1 from the number of the in-out persons of the target of which the tracked target is in an exited state.
Further, the point cloud cluster tracking clustering process comprises the following steps:
clustering: selecting a first point from the point cloud set, and marking as P0And is combined with P0As centres of targets T to be clustered, i.e. Tkcenter=[Rcenter,Vcenter,θcenter]=[R0,V0,θ0]Wherein R iscenterDistance of center point, VcenterVelocity at the center point, θcenterAngle of center point, P0And the point cloud P remains in the point cloud seti(i = {1,2...., n-1} successive comparisons;
if conditions a, b are satisfied simultaneously:
a.|Rcenter*Rcenter+Ri*Ri-2Rcenter*Ri*cos(θcenteri)|<a first threshold value;
b.|Vcenter-Vi|<a second threshold value;
updating the central point of the target to be clustered,
Tcenter=[Rcenter,Vcentercenter]=[(Rcenter+Ri)/2,(Vcenter+Vi)/2,(θcenteri)/2],
wherein R isiIs a target point cloud P i Is a distance ofViIs a target point cloud P i Velocity of (e), thetaiIs a target point cloud P i The angle of (d);
the point cloud PiMarkingIs in a traversed state and is associated with a clustering target TkLabel uniformityTarget TkContaining point clouds Tk={Pi,.......};
iPlus 1, i.e. T to be updatedkcenterComparing with the next point in the point cloud set;
if the conditions a and b are not met, the central point of the target to be clustered is not required to be updated, and the central point of the target to be clustered is required to be updatediPlus 1, i.e. TkcenterComparing with the next point in the point cloud set;
target T to be clusteredk,Comprises m point clouds, if m is larger than a preset minimum point cloud number threshold value PnumAnd the sum S of the SNR of all pointssumIf the energy is greater than the preset energy threshold value, T is judgedKIs a valid clustering target.
Further, when tracking the target TiAt the k frame, X thereofiUnknown region outside the first crossing line, and X at the k +1 th frameiInside the first passing line while satisfying the velocity ViIf the current state is unknown, the target is passing through the first crossing line, that is, the target enters the first region from the unknown region; its state becomes Ti_state=detected_incoming;
When tracking target TiAt the k frame, X thereofiOutside the second crossing line; and X at the k +1 th frameiAt the inner side of the second crossing line, while satisfying the velocity ViPositive and the current state is detected _ accompanying, indicating that the object is crossing the second crossing line 2, i.e. it enters the second area from the first area; its state becomes Ti_state=incoming;
When tracking target TiX at the k frameiOutside the third crossing line; and X at the k +1 th frameiAt the inner side of the third passing line, while satisfying the velocity ViPositive and the current state is incomming, which means that the target is passing through the third crossing line, i.e. it enters the third area from the second area; its state becomes Ti_state=entered;
Adding 1 to the total number of people in the room, and changing the state of the tracking target track ID into unknown againState, i.e. Ti_state=unknow。
Further, when tracking the target TiX in the k frameiInside the third crossing line; and X at the k +1 th frameiOutside the third passing line while satisfying the velocity ViNegative and the current state is unknown, it means that the object is passing through the third crossing line, i.e. it enters the second region from the third region; its state becomes Ti_state=detected_outgoing;
When tracking target TiX at the k frameiOn the inner side of the second crossing line; and X at the k +1 th frameiOutside the second crossing line, while satisfying the velocity ViNegative and the current state is detected _ outputting, indicating that the object is crossing the first crossing line, i.e. it enters the first area from the second area; its state becomes Ti_state=outgoing;
When tracking target TiX at the k frameiX at the k +1 th frame inside the first crossing lineiOutside the first passing line while satisfying the velocity ViNegative and the current state is outgoing, it means that the object is crossing the first crossing line, i.e. it enters the unknown area from the first area; its state becomes Ti_state=exited;
Subtracting 1 from the total number of people in the room, and changing the state of the track ID of the tracking target into an unknown state, namely Ti_state=unknow。
The invention discloses a device for counting the number of people passing in and out based on a millimeter wave radar, which comprises a microprocessor, the millimeter wave radar, a battery and a wireless transmission module; the microprocessor is respectively connected with the millimeter wave radar and the wireless transmission module through serial ports; the device is installed in the middle of the top of an entrance and exit door, the normal direction of the millimeter wave radar is perpendicular to the ground, and the coordinate X direction of the millimeter wave radar is consistent with the entrance and exit direction.
Compared with the prior art, the invention has the following beneficial effects:
the invention is based on the millimeter wave radar, can distribute the only track ID to the pedestrian in the monitoring area, judge the position and speed direction of the same track ID on the adjacent frame at the same time; and four kinds of switching of the in-out state quantities are designed, so that the in-out number of the target is judged and counted, the stable counting of the number of the in-out people is ensured by switching of the four states, and the repeated counting of people staying at the doorway is avoided.
Drawings
FIG. 1 is a system framework of the present invention;
FIG. 2 is a diagram of the internal data processing process of the present invention;
FIG. 3 is a schematic view of a cross-over line arrangement according to the present invention;
FIG. 4 is a diagram of the in-out counting process of the present invention;
FIG. 5 is a diagram illustrating an in-out counting process according to an embodiment of the present invention.
In the figure, 1-the first crossing line, 2-the second crossing line, and 3-the third crossing line.
Detailed Description
The invention is further described with reference to the accompanying drawings, but the invention is not limited in any way, and any alterations or substitutions based on the teaching of the invention are within the scope of the invention.
As shown in fig. 1, the millimeter wave radar in-out people counting device is composed of a microprocessor, a millimeter wave radar, a battery and a wireless transmission module; the microprocessor is connected with the millimeter wave radar and the wireless transmission module through serial ports respectively. The device is installed in the middle of the top of an entrance and exit door, the normal direction of a radar is vertical to the ground, and the X direction of a radar coordinate is consistent with the entrance and exit direction.
Detecting a human body target by the millimeter wave radar, carrying out point cloud cluster tracking processing on the human body target, and outputting a cluster target set T = { T =1......,TkWhere T is1......,TkK is the number of clustering targets;
the clustering process in the point cloud cluster tracking is as follows:
clustering: selecting a first point from the point cloud set, and marking as P0And is combined with P0As centres of targets T to be clustered, i.e. Tkcenter=[Rcenter,Vcenter,θcenter]=[R0,V0,θ0],P0And the point cloud P remains in the point cloud seti(i = {1,2...., n-1} successive comparisons;
if conditions a, b are satisfied simultaneously:
a.|Rcenter*Rcenter+Ri*Ri-2Rcenter*Ri*cos(θcenteri)|<0.5;
b.|Vcenter-Vi|<1;
updating the central point of the target to be clustered:
Tcenter=[Rcenter,Vcentercenter]=[(Rcenter+Ri)/2,(Vcenter+Vi)/2,(θcenteri)/2];
the point cloud PiMarked as traversed state and associated with clustering target TkLabel uniformityTarget TkContaining point clouds Tk={Pi,.......};
iPlus 1, i.e. T to be updatedkcenterComparing with the next point in the point cloud set;
if the conditions a and b are not met, the central point of the target to be clustered is not required to be updated, and the central point of the target to be clustered is required to be updatediPlus 1, i.e. TkcenterComparing with the next point in the point cloud set;
target T to be clusteredk,Comprises m point clouds, if m is larger than a preset minimum point cloud number threshold value PnumAnd the sum S of the SNR of all pointssumIf the energy is greater than the preset energy threshold value, T is judgedKIs a valid clustering target.
Adopting an extended Kalman tracking algorithm to perform clustering on the target set T = { T = { (T) }1,......,TkEach target T iniPredicting and updating, and acquiring the position information of the target in real time; the distance and angle of information contained by each target, i.e. Ti={Tid,Ri,θi,Vi};
Mixing Ti = { Tid,Rii,ViConverting from polar coordinates to Cartesian seatsIn the standard system, a tracking target set tracks = { TR = is obtained0,TR1,......,TRn-1In which TRi=[Tid,Xi,Yi,Vi],Xi,YiIs the spatial coordinate, T, of the relative radar in the radar three-dimensional spaceidIs track ID, ViIs the speed;
continuously tracking the same track ID in the track list, wherein the state of the track ID is switched after passing through a plurality of areas preset by a counting algorithm;
as shown in fig. 3, three crossing lines are provided, in which the crossing line 1 is a first crossing line, the crossing line 2 is a second crossing line, the radar is disposed directly above the crossing line 2, the crossing line 3 is a third crossing line, an area outside the first crossing line (i.e., in the direction toward the outside of the door) is an unknown area, a first area (i.e., area 1) is between the first crossing line and the second crossing line, a second area (i.e., area 2) is between the second crossing line and the third crossing line, and an area inside the third crossing line (i.e., in the direction toward the inside of the door) is a third area (i.e., area 3).
The method comprises the following steps:
when tracking target TiAt the k frame, X thereofiOn the outside of the gate (also called unknown region) of the crossing line 1; and at the k +1 th frame, X thereofiOn the inner side of the door of the crossing line 1, while satisfying the velocity ViPositive and the current state is unknown, it means that the target is crossing the crossing line 1, i.e. it enters the region 1 from an unknown region; its state becomes Ti_state=detected_incoming;
When tracking target TiAt the k frame, X thereofiOn the outside of the door of the crossing line 2; and at the k +1 th frame, X thereofiOn the inner side of the door of the crossing line 2, while satisfying the velocity ViPositive and the current state is detected _ accompanying, indicating that the object is crossing the crossing line 2, i.e. it is entering area 2 from area 1; its state becomes Ti_state=incoming;
When tracking target TiAt the k frame, X thereofiOn the outside of the door of the crossing line 3; and at the k +1 th frame, X thereofiOn the inner side of the door across the thread 3,simultaneously satisfy the speed ViPositive and the current state is incomming, indicating that the target is crossing cross-over line 3, i.e. it is entering area 3 from area 2; its state becomes Ti_state=entered;
Adding 1 to the total number of people in the room, changing the ID state to unknown state again after adding the total number of people in the room, Ti_state=unknow;
An outgoing process:
when tracking target TiAt the k frame, X thereofiInside the door of the crossing line 3; and at the k +1 th frame, X thereofiOn the outside of the door through the line 3 while satisfying the velocity ViNegative and the current state is unknown, indicating that the object is crossing the crossing line 3, i.e. it enters the region 2 from an unknown region (which now coincides with the region 3); its state becomes Ti_state=detected_outgoing;
When tracking target TiAt the k frame, X thereofiOn the inside of the door of the crossing line 2; and at the k +1 th frame, X thereofiOn the outside of the door of the crossing line 2, while satisfying the velocity ViNegative and the current state is detected _ outputting, this means that the target is crossing the crossing line 1, i.e. it is entering area 1 from area 2; its state becomes Ti_state=outgoing;
When tracking target TiAt the k frame, X thereofiOn the inside of the door of the crossing line 1; and at the k +1 th frame, X thereofiOn the outside of the door of the crossing line 1, while satisfying the velocity ViNegative and the current state is outgoing, it means that the object is crossing the crossing line 1, i.e. it is going from area 1 into unknown area; its state becomes Ti_state=exited;
The total number of people in the room is reduced by 1, and the state of the ID is changed into an unknown state again, Ti_state=unknow。
Examples
When the track ID is TiThe pedestrian of (1) in the k-th frame, X thereofiOn the outside of the door (X) of the crossing line 1i<-1.5 m); and at the k +1 th frame, X thereofiOn the inside of the door (X) of the crossing line 1iNot less than-1.5 m) while satisfying the velocity ViIs positive and the current state is unknow, this indicates that the target is crossing the crossing line 1.
In one embodiment, as shown in fig. 1, the millimeter wave radar in-out people counting device is composed of a microprocessor, a millimeter wave radar, a battery and a wireless module; the microprocessor is connected with the millimeter wave radar and the wireless transmission module through serial ports respectively. The device is arranged in the center of the top of an in-out door, the normal direction of a radar is vertical to the ground, and the X direction of a radar coordinate is consistent with the in-out direction.
Referring to fig. 2, a millimeter wave radar within a device transmits a millimeter-wave band radio frequency signal to a monitored area through its multiple-transmit multiple-receive (MIMO) antenna while receiving an echo signal scattered via a reflection point within the monitored area; the echo signal is down-converted into a beat intermediate frequency signal si (T) after being mixed with the transmitting signal, si (T) is subjected to ADC (analog to digital converter) sampling, distance dimension FFT (fast Fourier transform), speed estimation, CFAR (computational fluid dynamics) detection and horizontal and vertical angle estimation to obtain a dynamic moving pedestrian point cloud set in the current scene, and the point cloud is subjected to group tracking processing to obtain a tracking target set tracks = { T = (T) }0,T1,......Tn-1In which T isi=[Tid,Xi,Yi,Vi],Xi,YiCan be regarded as the space coordinate, T, of the relative radar in the radar three-dimensional spaceidIs track ID, ViIs the velocity.
When each pedestrian passes through the monitoring area of the radar, a track with a unique ID can be formed; and judging the passing-in and passing-out state of the pedestrian by judging the position and the speed direction of the flight path. The method comprises the following specific steps:
suppose the position of the crossing line 1 is x1=1.5m, the position of the crossing line 2 is x2=0m, the position of the crossing line 3 is x3=1.5 m; the speed direction that the radar monitored the pedestrian and got into is positive, and the speed direction that the radar monitored the pedestrian and got out is negative.
Referring to fig. 4, the entry counting process is as follows:
when the track ID is TiThe pedestrian of (1) in the k-th frame, X thereofiOn the outside of the door (X) of the crossing line 1i<-1.5 m); and at the k +1 th frame, X thereofiOn the inside of the door (X) of the crossing line 1iNot less than-1.5 m) while satisfying the velocity ViPositive and the current state is unknown, it means that the target is crossing the crossing line 1, i.e. it enters the region 1 from an unknown region; its state becomes Ti_state=detected_incoming;
When tracking target TiAt the k frame, X thereofiOn the outside of the door (X) of the crossing line 2i<0 m); and at the k +1 th frame, X thereofiOn the inside of the door (X) of the crossing line 2iNot less than 0m) while satisfying the velocity ViPositive and the current state is detected _ accompanying, indicating that the object is crossing the crossing line 2, i.e. it is entering area 2 from area 1; its state becomes Ti_state=incoming;
When tracking target TiAt the k frame, X thereofiOn the outside of the door (X) of the crossing line 3i<1.5 m); and at the k +1 th frame, X thereofiOn the inside of the door (X) across the line 3iNot less than 1.5m) while satisfying the velocity ViPositive and the current state is incomming, indicating that the target is crossing cross-over line 3, i.e. it is entering area 3 from area 2; its state becomes Ti_state=entered;
At this time, the total number of people in the room is increased by 1, and after the total number of people is increased, the state of the ID is changed into an unknown state again, Ti_state=unknow。
Other situations in the process of entering a person, such as a person crossing back and forth between a first area and a second area, will always keep its status in the last status (for example, a person is in the first area to the second area, the status changes to incoming, the target returns from the second area to the first area, the status does not change, or incoming is kept, so that the status switching from the second area to the third area is not affected).
Referring to fig. 5, the exit count process is as follows:
when tracking target TiAt the k frame, X thereofiOn the inside of the door (X) across the line 3iMore than or equal to 1.5 m); and at the k +1 th frame, X thereofiOn the outside of the door (X) of the crossing line 3i<1.5m) while satisfying the velocity ViNegative and the current state is unknown, this means that the target is passing through the crossing line 3, i.e. it is in an unknown region (in this case, the unknown region is overlapped with the region 3)And) into zone 2; its state becomes Ti_state=detected_outgoing;
When tracking target TiAt the k frame, X thereofiOn the inside of the door (X) of the crossing line 2iMore than or equal to 0 m); and at the k +1 th frame, X thereofiOn the outside of the door (X) of the crossing line 2i<0m) while satisfying the velocity ViNegative and the current state is detected _ outputting, this means that the object is crossing the crossing line 1, i.e. it enters the area 1 from the area 2; its state becomes Ti_state=outgoing;
When tracking target TiAt the k frame, X thereofiOn the inside of the door (X) of the crossing line 1iMore than or equal to-1.5 m); and in the (k + 1) th frame (X)i<-1.5m), X thereofiOn the outside of the door of the crossing line 1, while satisfying the velocity ViNegative and the current state is outgoing, it means that the object is crossing the crossing line 1, i.e. it is going from area 1 into unknown area; its state becomes Ti_state=exited。
The total number of people in the room is reduced by 1, and the state of the ID is changed into an unknown state again, Ti_state=unknow。
Other situations in the process of leaving a person, such as a person crossing back and forth between the second area and the first area, will always keep its status in the last state (e.g. a person in the second area goes to the first area, the status changes to outgoing, the target returns from the first area to the second area, the status does not change, or remains outgoing, and therefore does not affect its status switch from the first area to the unknown area (leaving)).
Compared with the prior art, the invention has the following beneficial effects:
the invention is based on the millimeter wave radar, can distribute the only track ID to the pedestrian in the monitoring area, judge the position and speed direction of the same track ID on the adjacent frame at the same time; and four kinds of switching of the in-out state quantities are designed, so that the in-out number of the target is judged and counted, the stable counting of the number of the in-out people is ensured by switching of the four states, and the repeated counting of people staying at the doorway is avoided.
The word "preferred" is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as "preferred" is not necessarily to be construed as advantageous over other aspects or designs. Rather, use of the word "preferred" is intended to present concepts in a concrete fashion. The term "or" as used in this application is intended to mean an inclusive "or" rather than an exclusive "or". That is, unless specified otherwise or clear from context, "X employs A or B" is intended to include either of the permutations as a matter of course. That is, if X employs A; b is used as X; or X employs both A and B, then "X employs A or B" is satisfied in any of the foregoing examples.
Also, although the disclosure has been shown and described with respect to one or an implementation, equivalent alterations and modifications will occur to others skilled in the art based upon a reading and understanding of this specification and the annexed drawings. The present disclosure includes all such modifications and alterations, and is limited only by the scope of the appended claims. In particular regard to the various functions performed by the above described components (e.g., elements, etc.), the terms used to describe such components are intended to correspond, unless otherwise indicated, to any component which performs the specified function of the described component (e.g., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary implementations of the disclosure. In addition, while a particular feature of the disclosure may have been disclosed with respect to only one of several implementations, such feature may be combined with one or other features of the other implementations as may be desired and advantageous for a given or particular application. Furthermore, to the extent that the terms "includes," has, "" contains, "or variants thereof are used in either the detailed description or the claims, such terms are intended to be inclusive in a manner similar to the term" comprising.
Each functional unit in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or a plurality of or more than one unit are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium. The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Each apparatus or system described above may execute the storage method in the corresponding method embodiment.
In summary, the above-mentioned embodiment is an implementation manner of the present invention, but the implementation manner of the present invention is not limited by the above-mentioned embodiment, and any other changes, modifications, substitutions, combinations, and simplifications which do not depart from the spirit and principle of the present invention should be regarded as equivalent replacements within the protection scope of the present invention.

Claims (4)

1. A method for counting the number of people passing in and out based on a millimeter wave radar is characterized by comprising the following steps:
detecting a human body target by the millimeter wave radar, carrying out point cloud cluster tracking processing on the human body target, and outputting a cluster target set T ═ T1......,TkWhere T is1......,TkK is the number of clustering targets;
adopting an extended Kalman tracking algorithm to cluster the target set T ═ { T ═ T1......,TkEach target T iniPredicting and updating, and acquiring the position information of the target in real time;
converting the position of the target Ti from a polar coordinate to a Cartesian coordinate system to obtain a tracking target set tracks ═ { TR ═ TR { (TR) }0,TR1,......TRn-1In which TRi=[Tid,Xi,Yi,Vi],Xi,YiIs the spatial coordinate, T, of the relative radar in the radar three-dimensional spaceidIs track ID, ViIs the speed;
continuously tracking the same track ID in the track list, judging the in-out state of the tracked target according to the position and the speed of the tracked target of the same track ID relative to the first crossing line, the second crossing line and the third crossing line, adding 1 to the number of the in-out persons of the target of which the tracked target is in an entried state, and subtracting 1 from the number of the in-out persons of the target of which the tracked target is in an exited state;
wherein when tracking the target TiAt the k frame, X thereofiUnknown region outside the first crossing line, and X at the k +1 th frameiInside the first passing line while satisfying the velocity ViIf the current state is unknown, the target is passing through the first crossing line, that is, the target enters the first region from the unknown region; its state becomes Ti_state=detected_incoming;
When tracking target TiAt the k frame, X thereofiOutside the second crossing line; and X at the k +1 th frameiAt the inner side of the second crossing line, while satisfying the velocity ViPositive and the current state is detected _ accompanying, indicating that the object is crossing the second crossing line 2, i.e. it enters the second area from the first area; its state becomes Ti_state=incoming;
When tracking target TiX at the k frameiOutside the third crossing line; and X at the k +1 th frameiAt the inner side of the third passing line, while satisfying the velocity ViPositive and the current state is incomming, which means that the target is passing through the third crossing line, i.e. it enters the third area from the second area; its state becomes Ti_state=entered;
Adding 1 to the total number of people in the room, and changing the state of the tracking target track ID into an unknown state, namely Ti_state=unknow。
2. The millimeter wave radar-based people in and out counting method according to claim 1, wherein the clustering process in the point cloud cluster tracking is as follows:
clustering: selecting a first point from the point cloud set, and marking as P0And is combined with P0As centres of targets T to be clustered, i.e. Tkcenter=[Rcenter,Vcenter,θcenter]=[R0,V0,θ0]Wherein R iscenterDistance of center point, VcenterVelocity at the center point, θcenterAngle of center point, P0With the remaining point cloudPi(i ═ 1,2...., n-1} successive comparisons;
if conditions a, b are satisfied simultaneously:
a.|Rcenter*Rcenter+Ri*Ri-2Rcenter*Ri*cos(θcenteri)|<a first threshold value;
b.|Vcenter-Vi|<a second threshold value;
updating the central point of the target to be clustered:
Tcenter=[Rcenter,Vcentercenter]=[(Rcenter+Ri)/2,(Vcenter+Vi)/2,(θcenteri)/2],
wherein R isiIs a target point cloud PiDistance of (V)iIs a target point cloud PiVelocity of (e), thetaiIs a target point cloud PiThe angle of (d);
point cloud PiMarked as traversed state and associated with clustering target TkThe labels are consistent; target TkContaining point clouds Tk={Pi,.......};
i plus 1, i.e. T after updatingkcenterComparing with the next point in the point cloud set;
if the conditions a and b are not met, the central point of the target to be clustered is not required to be updated, i is added with 1, namely TkcenterComparing with the next point in the point cloud set;
target T to be clusteredkM point clouds are included, if m is larger than a preset minimum point cloud number threshold value PnumAnd the sum S of the SNR of all pointssumIf the energy is greater than the preset energy threshold value, T is judgedKIs a valid clustering target.
3. The millimeter wave radar-based entry-exit people counting method according to claim 1,
when tracking target TiX in the k frameiInside the third crossing line; and X at the k +1 th frameiOutside the third passing line while satisfying the velocity ViNegative and the current state is unknown, it means that the object is passing through the third crossing line, i.e. it enters the second region from the third region; its state becomes Ti_state=detected_outgoing;
When tracking target TiX at the k frameiOn the inner side of the second crossing line; and X at the k +1 th frameiOutside the second crossing line, while satisfying the velocity ViNegative and the current state is detected _ outputting, indicating that the object is crossing the first crossing line, i.e. it enters the first area from the second area; its state becomes Ti_state=outgoing;
When tracking target TiX at the k frameiX at the k +1 th frame inside the first crossing lineiOutside the first crossing line while satisfying the velocity ViNegative and the current state is outgoing, it means that the object is crossing the first crossing line, i.e. it enters the unknown area from the first area; its state becomes Ti_state=exited;
Subtracting 1 from the total number of people in the room, and changing the state of the track ID of the tracking target into an unknown state, namely Ti_state=unknow。
4. A device for counting the number of people passing in and out based on a millimeter wave radar is characterized in that the device for counting the number of people passing in and out based on the millimeter wave radar is applied to the method for counting the number of people passing in and out based on the millimeter wave radar as claimed in any one of claims 1 to 3, and the device comprises a microprocessor, the millimeter wave radar, a battery and a wireless module; the microprocessor is respectively connected with the millimeter wave radar and the wireless transmission module through serial ports; the device is installed in the middle of the top of an entrance and exit door, the normal direction of the millimeter wave radar is perpendicular to the ground, and the coordinate X direction of the millimeter wave radar is consistent with the entrance and exit direction.
CN202210183623.1A 2022-02-28 2022-02-28 Method and device for counting number of people who pass in and out based on millimeter wave radar Active CN114241015B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210183623.1A CN114241015B (en) 2022-02-28 2022-02-28 Method and device for counting number of people who pass in and out based on millimeter wave radar

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210183623.1A CN114241015B (en) 2022-02-28 2022-02-28 Method and device for counting number of people who pass in and out based on millimeter wave radar

Publications (2)

Publication Number Publication Date
CN114241015A CN114241015A (en) 2022-03-25
CN114241015B true CN114241015B (en) 2022-05-13

Family

ID=80748239

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210183623.1A Active CN114241015B (en) 2022-02-28 2022-02-28 Method and device for counting number of people who pass in and out based on millimeter wave radar

Country Status (1)

Country Link
CN (1) CN114241015B (en)

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103477355B (en) * 2011-03-31 2016-04-20 松下电器产业株式会社 Number measurement mechanism
CN102736079A (en) * 2012-07-10 2012-10-17 中国船舶重工集团公司第七二四研究所 Realization method for tracing boats at state of passing through bridges by using boat traffic navigation system
CN102902971A (en) * 2012-08-31 2013-01-30 电子科技大学 Method and system for conducting statistics on elevator visitor flow based on intelligent visual perception
CN103279791B (en) * 2013-05-30 2016-03-30 上海汇纳信息科技股份有限公司 Based on pedestrian's computing method of multiple features
EP3195541B1 (en) * 2014-07-17 2021-11-03 Origin Wireless, Inc. Wireless positioning systems
CN108596938A (en) * 2018-04-25 2018-09-28 杭州光珀智能科技有限公司 A kind of passenger flow statistical method and device
US11163057B2 (en) * 2018-05-02 2021-11-02 Panasonic Intellectual Property Management Co., Ltd. Estimation device, living body count estimation device, estimation method, and recording medium
CN111209781B (en) * 2018-11-22 2023-05-23 珠海格力电器股份有限公司 Method and device for counting indoor people
CN109814080B (en) * 2018-12-11 2022-12-20 长沙莫之比智能科技有限公司 Millimeter wave radar target tracking and confidence coefficient algorithm and device thereof
CN110118966B (en) * 2019-05-28 2020-10-13 长沙莫之比智能科技有限公司 Personnel detection and counting system based on millimeter wave radar
CN111382720A (en) * 2020-03-18 2020-07-07 浩云科技股份有限公司 Real-time personnel number statistical method and device based on top-view monocular camera
CN112926722B (en) * 2021-01-27 2022-11-01 上海兰宝传感科技股份有限公司 Method for counting people in escalator entrance area
CN113093170B (en) * 2021-06-07 2021-08-13 长沙莫之比智能科技有限公司 Millimeter wave radar indoor personnel detection method based on KNN algorithm
CN113189575B (en) * 2021-07-01 2021-09-10 长沙莫之比智能科技有限公司 Detection method and device for positioning personnel in smoke scene
CN113671481B (en) * 2021-07-21 2024-04-09 西安电子科技大学 3D multi-target tracking processing method based on millimeter wave radar
CN113835074B (en) * 2021-08-04 2024-01-16 南京常格科技发展有限公司 Dynamic people flow monitoring method based on millimeter wave radar

Also Published As

Publication number Publication date
CN114241015A (en) 2022-03-25

Similar Documents

Publication Publication Date Title
CN110118966B (en) Personnel detection and counting system based on millimeter wave radar
US7154434B1 (en) Anti-personnel airborne radar application
CN111830508B (en) Road gate anti-smashing system and method adopting millimeter wave radar
Liu et al. A blind spot detection and warning system based on millimeter wave radar for driver assistance
Chang et al. An algorithm for UWB radar-based human detection
CN109932702B (en) Barrier gate control method and barrier gate radar
Rohling Some radar topics: waveform design, range CFAR and target recognition
CN112162283B (en) Multi-target detection system of full-road-section networking traffic radar
CN111239727B (en) Passenger counting method and communication equipment
CN113267773B (en) Millimeter wave radar-based accurate detection and accurate positioning method for indoor personnel
CN113835074B (en) Dynamic people flow monitoring method based on millimeter wave radar
CN113791410B (en) Road environment comprehensive cognition method based on multi-sensor information fusion
CN112233416A (en) Traffic flow detection method and device
WO2023041097A2 (en) Interference signal detection method and apparatus, and integrated circuit, radio device and terminal
CN112859033A (en) Target detection method, device and related equipment
CN113009448A (en) Method, device, equipment and storage medium for detecting multipath target
US20220404486A1 (en) People Counting Based on Radar Measurement
CN210572736U (en) Low, small and slow target automatic detection, tracking and identification system
Cai et al. Foreign objects intrusion detection using millimeter wave radar on railway crossings
CN113189575B (en) Detection method and device for positioning personnel in smoke scene
Cao et al. Lane determination of vehicles based on a novel clustering algorithm for intelligent traffic monitoring
Wang et al. A channel awareness vehicle detector
Yang et al. Urban traffic congestion alleviation system based on millimeter wave radar and improved probabilistic neural network
CN114241015B (en) Method and device for counting number of people who pass in and out based on millimeter wave radar
Argüello et al. Radar classification for traffic intersection surveillance based on micro-Doppler signatures

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant