CN107609075A - A kind of periodicity surveillance information abnormal data cleaning method - Google Patents

A kind of periodicity surveillance information abnormal data cleaning method Download PDF

Info

Publication number
CN107609075A
CN107609075A CN201710784137.4A CN201710784137A CN107609075A CN 107609075 A CN107609075 A CN 107609075A CN 201710784137 A CN201710784137 A CN 201710784137A CN 107609075 A CN107609075 A CN 107609075A
Authority
CN
China
Prior art keywords
data
surveillance information
spot
information data
maintenance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710784137.4A
Other languages
Chinese (zh)
Other versions
CN107609075B (en
Inventor
王运锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan University
Original Assignee
Sichuan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan University filed Critical Sichuan University
Priority to CN201710784137.4A priority Critical patent/CN107609075B/en
Publication of CN107609075A publication Critical patent/CN107609075A/en
Application granted granted Critical
Publication of CN107609075B publication Critical patent/CN107609075B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Closed-Circuit Television Systems (AREA)
  • Alarm Systems (AREA)

Abstract

The invention discloses a kind of surveillance information abnormal data cleaning method, comprise the following steps:Travel through the spot list of all maintenances, to the surveillance information data that this is received, the relation between current reconnaissance data and the spot state change of maintenance is calculated, when surveillance information data fit spot motion state, it is judged as correct data, otherwise regards as data to be cleaned;The spot list of Inspection and maintenance, the transient target of spot list is safeguarded to being added before this, when meeting its motion state without this surveillance information data, the transient target for regarding as adding before is abnormal surveillance information data, is purged;Data to be cleaned are regarded as to this, the transient target to be confirmed as one, add the spot list of maintenance.

Description

A kind of periodicity surveillance information abnormal data cleaning method
Technical field
The present invention relates to the abnormal data that surveillance information data are obtained with the Active Intelligence such as radar, photoelectricity cycle sensor Cleaning treatment field, abnormal data of the surveillance information particularly obtained in the case of by system environments noise, outside active interference Cleaning problem, the present invention establish scouting object motion state periodically to scout the information data of acquisition, provide a kind of periodicity The cleaning method of surveillance information abnormal data.
Background technology
Field is cleaned in mass data, common are the system such as Hadoop platform and MapReduce frameworks processing side at present Method, but these system processing platforms are all to handle different classes of and industry data with a flexible data structure, because of it The data characteristicses for considering the versatility of platform and can not being directed to specific industry are applied.
To surveillance information data cleansing field, CFAR detection, detection probability control, unruly-value rejecting, dry presently, there are A variety of methods such as suppression are disturbed, but these methods are to solve the problems, such as abnormal data in terms of some of principle is scouted, also Can not solve the abnormal data occurred in scouting before terminal processes.
The present invention combines the mass data record that periodically continued scouting obtains, and gives a kind of based on scouting object motion The abnormal data cleaning method of state, efficiently solve the data interference problem in subsequent treatment.
The content of the invention
The present invention does not consider the situation of surveillance information industry data feature for available data cleaning treatment framework, proposes one Kind is based on the abnormal data cleaning method for scouting object motion state, and this method is an indivisible entirety, by following step Rapid composition.
(1)The spot list of all maintenances is traveled through, to the surveillance information data that this is received, calculates current scouting number According to the relation between the spot state change of maintenance, when surveillance information data fit spot motion state, sentence Break as correct data, otherwise regard as data to be cleaned.
(2)The spot list of Inspection and maintenance, the transient target of spot list is safeguarded to being added before this, When meeting its motion state without this surveillance information data, the transient target for regarding as adding before is abnormal surveillance information number According to being purged;To the transient target of this new addition, treat that subsequent time period determines whether to remove.
(3)Data to be cleaned are regarded as to this, the transient target to be confirmed as one, add the scouting mesh of maintenance Mark list.
(4)The judgement whether surveillance information data are met with target state is as follows:
The location variation of preservation 5 periodic motions of target, course variable quantity, velocity variable, acceleration change amount, identical Time cycle in, above-mentioned 4 variable quantities of target state meet the characteristics of motion for scouting object, including position Sudden Changing Rate Relevant with speed and acceleration, velocity variable is relevant with acceleration change amount, and course variable quantity is by speed Variable quantity influences.
Brief description of the drawings
Fig. 1 is surveillance information abnormal data cleaning false code process chart.
Beneficial effect
By the periodicity surveillance information data cleaning method of the present invention, solve by reconnaissance system ambient noise, outside active The influence of the false surveillance information data interference obtained when interference, the application processing to follow-up surveillance information data provide Beneficial to help.
Implementation steps
A kind of " periodicity surveillance information abnormal data cleaning method " patent of invention is a system schema, by such as following rapid real Apply.
The first step:Configuration data cleaning parameterses, including the spot intelligence report cycle, spot velocity variations maximum, Spot acceleration change maximum.
Second step:The surveillance information data received with this, according to the spot intelligence report cycle, calculate the scouting with safeguarding Dbjective state changes, including location variation, velocity variable, course variable quantity, acceleration change amount, when velocity variable and Acceleration change amount is respectively less than the maximum of first step setting, and location variation, course variable quantity are respectively less than computation of Period change During change amount, it is judged as correct data, otherwise regards as data to be cleaned.
3rd step:To data to be cleaned, new transient target is established, adds the spot list of maintenance.
4th step:The spot list of Inspection and maintenance, the interim mesh of spot list is safeguarded to being added before this Mark, when this reconnaissance data is in second step detection, during no correct data, the transient target for assert maintenance is by scouting extremely Information data generation, it is purged.
5th step:The spot list of Inspection and maintenance, to the transient target of this new addition, treat subsequent time period by Four-step method determines whether to clean the data.

Claims (2)

1. a kind of periodicity surveillance information abnormal data cleaning method, it is characterised in that comprise the following steps:
(1)Travel through the spot list of all maintenances, to the surveillance information data that this is received, calculate current reconnaissance data with Relation between the spot state change of maintenance, when surveillance information data fit spot motion state, it is judged as Correct data, otherwise regard as data to be cleaned;
(2)The spot list of Inspection and maintenance, the transient target of spot list is safeguarded to being added before this, when without this When secondary surveillance information data meet its motion state, the transient target for regarding as adding before is abnormal surveillance information data, is entered Row is removed;To the transient target of this new addition, treat that subsequent time period determines whether to remove;
(3)Data to be cleaned are regarded as to this, the transient target to be confirmed as one, the spot for adding maintenance arranges Table.
2. based on claim 1 the(1)The judgement whether described surveillance information data of step meet target state is as follows:
The location variation of preservation 5 periodic motions of target, course variable quantity, velocity variable, acceleration change amount, identical Time cycle in, above-mentioned 4 variable quantities of target state meet the characteristics of motion for scouting object, including position Sudden Changing Rate Meet time cycle variation relation with speed and acceleration, velocity variable meets that time cycle change is closed with acceleration change amount System, course variable quantity meet Time Continuous variation relation.
CN201710784137.4A 2017-09-04 2017-09-04 A kind of periodicity surveillance information abnormal data cleaning method Active CN107609075B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710784137.4A CN107609075B (en) 2017-09-04 2017-09-04 A kind of periodicity surveillance information abnormal data cleaning method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710784137.4A CN107609075B (en) 2017-09-04 2017-09-04 A kind of periodicity surveillance information abnormal data cleaning method

Publications (2)

Publication Number Publication Date
CN107609075A true CN107609075A (en) 2018-01-19
CN107609075B CN107609075B (en) 2019-11-01

Family

ID=61057298

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710784137.4A Active CN107609075B (en) 2017-09-04 2017-09-04 A kind of periodicity surveillance information abnormal data cleaning method

Country Status (1)

Country Link
CN (1) CN107609075B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102879774A (en) * 2011-07-11 2013-01-16 哈尔滨工业大学 Method and apparatus for synthesizing short flight paths
US20130226882A1 (en) * 2012-02-29 2013-08-29 International Business Machines Corporation Automatic table cleanup for relational databases
CN104280723A (en) * 2014-10-22 2015-01-14 四川大学 Method for processing newly built system track in radar clutter area
CN104569964A (en) * 2015-01-30 2015-04-29 中国科学院电子学研究所 Moving target two-dimensional detecting and tracking method for ultra-wideband through-wall radar

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102879774A (en) * 2011-07-11 2013-01-16 哈尔滨工业大学 Method and apparatus for synthesizing short flight paths
US20130226882A1 (en) * 2012-02-29 2013-08-29 International Business Machines Corporation Automatic table cleanup for relational databases
CN104280723A (en) * 2014-10-22 2015-01-14 四川大学 Method for processing newly built system track in radar clutter area
CN104569964A (en) * 2015-01-30 2015-04-29 中国科学院电子学研究所 Moving target two-dimensional detecting and tracking method for ultra-wideband through-wall radar

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
牟之英等: "多平台对多目标无源融合定位方法", 《探测与控制学报》 *
袁德诚等: "杂波环境下雷达新建航迹处理方法分析", 《四川大学学报(自然科学版)》 *

Also Published As

Publication number Publication date
CN107609075B (en) 2019-11-01

Similar Documents

Publication Publication Date Title
Battistelli et al. A distributed Kalman filter with event-triggered communication and guaranteed stability
WO2020256418A3 (en) Computing system for implementing virtual sensor by using digital twin, and real-time data collection method using same
Purcaru et al. Optimal robot path planning using gravitational search algorithm
CN110253572B (en) Event trigger control method for input saturated multi-single-arm manipulator
CN110111363A (en) A kind of tracking and equipment based on target detection
Synnaeve et al. Forward modeling for partial observation strategy games-a starcraft defogger
Zeng et al. Pixel modeling using histograms based on fuzzy partitions for dynamic background subtraction
Sabaliauskaite et al. A comprehensive approach, and a case study, for conducting attack detection experiments in cyber–physical systems
Perales Gómez et al. SafeMan: A unified framework to manage cybersecurity and safety in manufacturing industry
CN107609075A (en) A kind of periodicity surveillance information abnormal data cleaning method
CN110335466B (en) Traffic flow prediction method and apparatus
CN107169992A (en) A kind of traffic video moving target detecting method
CN106257507A (en) The methods of risk assessment of user behavior and device
CN108961287B (en) Intelligent shelf triggering method, intelligent shelf system, storage medium and electronic equipment
CN111736593A (en) Stage mobile robot formation asynchronous control method for preventing uncertain DoS attack
Negi et al. A LSTM approach to detection of autonomous vehicle hijacking
Han et al. Multi‐tracking of first order multi‐agent networks via self‐triggered control
CN116384594A (en) Crop pest early warning method, system, terminal and medium based on big data analysis
Bekhtaoui et al. Maneuvering target tracking using q-learning based Kalman filter
An et al. Noise mitigation for multiple target tracking in acoustic wireless sensor networks
CN115147590A (en) Raise dust reduction method and device, electronic equipment and storage medium
Kim An Alternative State Estimation Filtering Algorithm for Temporarily Uncertain Continuous Time System.
Yoon et al. Learning image attacks toward vision guided autonomous vehicles
CN104239557A (en) Method and device for monitoring promoted accounts
RU2016131908A (en) METHOD FOR COMPUTATIONAL MODELING OF GAS DYNAMICS OF COMBUSTION

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant