CN109307524A - A kind of sensor measurement data spot detection recovery technique - Google Patents

A kind of sensor measurement data spot detection recovery technique Download PDF

Info

Publication number
CN109307524A
CN109307524A CN201710622863.6A CN201710622863A CN109307524A CN 109307524 A CN109307524 A CN 109307524A CN 201710622863 A CN201710622863 A CN 201710622863A CN 109307524 A CN109307524 A CN 109307524A
Authority
CN
China
Prior art keywords
measurement data
spot
data
sensor measurement
recovery technique
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710622863.6A
Other languages
Chinese (zh)
Other versions
CN109307524B (en
Inventor
胡绍林
张彩霞
宋鹤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian University of Technology
Foshan University
Original Assignee
Xian University of Technology
Foshan University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian University of Technology, Foshan University filed Critical Xian University of Technology
Priority to CN201710622863.6A priority Critical patent/CN109307524B/en
Publication of CN109307524A publication Critical patent/CN109307524A/en
Application granted granted Critical
Publication of CN109307524B publication Critical patent/CN109307524B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D18/00—Testing or calibrating apparatus or arrangements provided for in groups G01D1/00 - G01D15/00
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/11—Complex mathematical operations for solving equations, e.g. nonlinear equations, general mathematical optimization problems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Computational Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Operations Research (AREA)
  • Testing Or Calibration Of Command Recording Devices (AREA)

Abstract

A kind of sensor measurement data spot detection of the present invention and recovery technique belong to sensor measurement data processing and application field, are suitable for spacecraft telemetry and analyze and handle.Blob data detection proposed by the present invention and recovery technique, 50% is carried out to the sample sequence of constant duration and picks a fitting, digital simulation residual variance, construct safety corridor radius, abnormal data is judged to beyond the measurement data in safety corridor, it is spot if occurring multiple abnormal datas in succession, the multiple abnormal data spots occurred to single abnormal data and in succession are repaired.The present invention has strong engineering practicability, can simply, easily complete the spot diagnosis and repair process of various types of measurement data sequences.

Description

A kind of sensor measurement data spot detection recovery technique
Technical field
The present invention relates to sensor measurement data process fields, and in particular to a kind of sensor measurement data spot detection is repaired Recovering technology.
Background technique
Sensor is the important composition component of Engineering Control.Sensor measurement data quality directly influences control engineering Effect and safety.In the wide range of areas such as aerospace, due to measurement object operating condition shakiness, environmental disturbances, transmission error code, measurement Error and the operation a variety of causes such as fault, the outlier and spot of the normal true value containing substantial deviation of sensor measurement.Outlier and spot Presence, data reliability can be reduced, influence processing result quality, or even control system can be threatened to be safely operated.For example, spaceborne The measurement data of the equipment such as gyro and sun sensor is abnormal, will lead to attitude of satellite unstability, and then will affect its safe operation. Therefore, in sensor measurement data treatment process, it is necessary to first carry out abnormal data differentiation and processing, improve the quality of data.
Outlier common manifestation form has jump point, isolated outlier, outlier spot several types in sensor sample data.Its In, there is in flakes and typically exhibits non-regularity and irregularity, detection, diagnosis and reparation because of it in outlier spot (abbreviation spot) Difficulty it is much more difficult more than single outlier.
The angle handled from project data, spot processing is both one of measurement data analysis and the difficult point of processing, and is protected Hinder one of data processing reliability and " bottleneck " problem of processing accuracy.The common isolated outliers number in sampled-data processing field According to processing method, it is difficult to spot bring effectively be overcome to adversely affect.
Summary of the invention
To solve the problems, such as the impurity datas such as outlier and spot in sensor measurement data, the present invention provides a kind of sensors The measuring and repairing technology of measurement data outlier and spot, summary of the invention include: the 50% of measurement data to pick fitting, building safety Pipeline and spot detection and reparation three parts method.
The beneficial effects of the present invention are: invention picks a spot detection and recovery technique for fitting based on 50%, it is reliable, real With convenient for engineer application, it can be achieved that quick diagnosis and reparation to outlier in dissimilar sensor measurement data and spot, changes Into the quality of data, data processed result precision and reliability are improved.
Specific embodiment
Measurement data 50% picks a fitting: setting windows radiusk=5, it calculates 3 rank of sliding window and puts fitting entirely
。
Wherein,。
It calculates sliding window and puts regression criterion sequence entirely。
Remember median operatormed, windows radius is setr=2k, calculate sliding window residual absolute value segment intermediate value
。
Windows radius is setr=2k, construct 50% discrimination matrix
,。
Structural matrix
,。
It calculates 3 rank of sliding window 50% and picks a fitting
。
Building safety corridor: the purpose of safety corridor building is to judge whether measurement data is abnormal.
The specific construction method of safety corridor is to calculate sliding window 50% to pick a most reliable valuation for regression criterion sequence root variance
。
Design measurement data safety corridor upper wall and lower wall
。
Spot detection and reparation: being abnormal data beyond the measurement data in safety corridor, compression is beyond safety corridor In data to safety corridor, spot reparation is realized.
Specifically judge algorithm are as follows: if, then measurement dataFor type outlier bigger than normal；If, then measurement dataFor type outlier bigger than normal；If continuously there are multiple outlier, for spot.
Specific spot reparation are as follows: if, then data reparation is；Such as Fruit, then data reparation is。
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair Principle described in bright description is improved or is retouched, and is applied directly or indirectly in other relevant technical fields, same Reason is included within the scope of the present invention.

Claims (2)

1. this patent is suitable for dissimilar sensor sampled data spot detection and repairs, range is claimed: measurement data Pick a fitting algorithm and safety corridor construction method.
2. this patent is suitable for dissimilar sensor sampled data spot detection and repairs, range is claimed: spot detection Technology and spot recovery technique.
CN201710622863.6A 2017-07-27 2017-07-27 Sensor measurement data spot detection and repair technology Active CN109307524B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710622863.6A CN109307524B (en) 2017-07-27 2017-07-27 Sensor measurement data spot detection and repair technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710622863.6A CN109307524B (en) 2017-07-27 2017-07-27 Sensor measurement data spot detection and repair technology

Publications (2)

Publication Number Publication Date
CN109307524A true CN109307524A (en) 2019-02-05
CN109307524B CN109307524B (en) 2021-07-30

Family

ID=65201956

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710622863.6A Active CN109307524B (en) 2017-07-27 2017-07-27 Sensor measurement data spot detection and repair technology

Country Status (1)

Country Link
CN (1) CN109307524B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL2028492A (en) * 2021-06-21 2021-09-01 Univ Guangdong Petrochem Tech Method for diagnosing and repairing patchy outliers in sensor measurement data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103983997A (en) * 2014-05-09 2014-08-13 北京航空航天大学 Vehicle-mounted integrated navigation method of resisting to failure of global positioning system
CN104502633A (en) * 2014-12-29 2015-04-08 南京世海声学科技有限公司 Flow field data correction method for acoustic Doppler flow velocity profiler
WO2017055461A1 (en) * 2015-09-30 2017-04-06 Ge Healthcare Bio-Sciences Ab Method and system for improving the evaluation of an interaction between an analyte and a ligand using a biosensor
CN106643723A (en) * 2016-11-07 2017-05-10 哈尔滨工程大学 Calculation method of safe navigation position of unmanned ship

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103983997A (en) * 2014-05-09 2014-08-13 北京航空航天大学 Vehicle-mounted integrated navigation method of resisting to failure of global positioning system
CN104502633A (en) * 2014-12-29 2015-04-08 南京世海声学科技有限公司 Flow field data correction method for acoustic Doppler flow velocity profiler
WO2017055461A1 (en) * 2015-09-30 2017-04-06 Ge Healthcare Bio-Sciences Ab Method and system for improving the evaluation of an interaction between an analyte and a ligand using a biosensor
CN106643723A (en) * 2016-11-07 2017-05-10 哈尔滨工程大学 Calculation method of safe navigation position of unmanned ship

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
S.HU ET AL.: "Outlier-Tolerant Fitting and Online Diagnosis of Outliers", 《AICI2011》 *
王利伟: "应用最小二乘B样条函数进行野值剔除应注意的几点问题", 《计算机与信息技术》 *
胡绍林: "非平稳信号的2⊗2 型双重中值容错滤波算法", 《系统仿真学报》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL2028492A (en) * 2021-06-21 2021-09-01 Univ Guangdong Petrochem Tech Method for diagnosing and repairing patchy outliers in sensor measurement data

Also Published As

Publication number Publication date
CN109307524B (en) 2021-07-30

Similar Documents

Publication Publication Date Title
CN107861383B (en) Satellite fault diagnosis and fault-tolerant control method based on adaptive observer
Kourti Application of latent variable methods to process control and multivariate statistical process control in industry
CA2877421C (en) Design development and implementation of analyzer based control system and algorithm
CN107632592A (en) Nonlinear time-varying procedure fault monitoring method based on efficient recursion core pivot element analysis
CN108181917B (en) Spacecraft attitude control system fault diagnosability quantitative analysis method
CN103472820A (en) Method for diagnosing propulsion system failure based on partial least squares algorithm
CN107014398B (en) Satellite simulation sun sensor fault detection method and device
CN108763250B (en) Photovoltaic power station monitoring data restoration method
CN109307524A (en) A kind of sensor measurement data spot detection recovery technique
CN105674943B (en) A kind of non-linear whole Deformation Prediction method of general multiple spot
Li et al. A data driven fault detection and isolation scheme for UAV flight control system
Kelly et al. A question of time: Revisiting the use of recursive filtering for temporal calibration of multisensor systems
JP4610946B2 (en) Odor identification method
Mellah et al. Mobile robot additive fault diagnosis and accommodation
US20190242788A1 (en) Data processing method, data processing device, and computer-readable recording medium having recorded thereon data processing program
EP3846976A1 (en) Control apparatus for a robot arrangement, robot arrangement, method, computer program, and machine-readable storage medium
Zhao et al. A fault-tolerant architecture for mobile robot localization
CN103793765A (en) Satellite telemetering data predicting method based on Kalman smoothing
CN107703215A (en) A kind of GIS device discharge fault chemical diagnosis method
CN111006688A (en) Intelligent online monitoring system for inertial navigation temperature test
CN112114578B (en) Steady method for multi-process multivariable process online monitoring and abnormal source diagnosis
EP4119939A1 (en) Magnetic flaw detection method, magnetic field measurement processing device, and magnetic flaw detection device
Dogruer Online identification of odometer parameters of a mobile robot
Ma et al. Adaptive finite-time tracking control for a robotic manipulator with unknown deadzone
Bhargava et al. Improved reliability, accuracy and failure minimization of spacecraft satellite architecture by using fuzzy logic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant