CN104572333B - 用于检测、校正并验证数据流中的不良数据的系统和方法 - Google Patents

用于检测、校正并验证数据流中的不良数据的系统和方法 Download PDF

Info

Publication number
CN104572333B
CN104572333B CN201410578376.0A CN201410578376A CN104572333B CN 104572333 B CN104572333 B CN 104572333B CN 201410578376 A CN201410578376 A CN 201410578376A CN 104572333 B CN104572333 B CN 104572333B
Authority
CN
China
Prior art keywords
data
value
data flow
singular value
exception
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201410578376.0A
Other languages
English (en)
Chinese (zh)
Other versions
CN104572333A (zh
Inventor
C.A.鲍恩
N.R.乔扈里
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
General Electric Company PLC
Original Assignee
General Electric Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by General Electric Co filed Critical General Electric Co
Publication of CN104572333A publication Critical patent/CN104572333A/zh
Application granted granted Critical
Publication of CN104572333B publication Critical patent/CN104572333B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1415—Saving, restoring, recovering or retrying at system level
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D3/00—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups
    • G01D3/028—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups mitigating undesired influences, e.g. temperature, pressure
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D3/00—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups
    • G01D3/028—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups mitigating undesired influences, e.g. temperature, pressure
    • G01D3/032—Indicating or recording apparatus with provision for the special purposes referred to in the subgroups mitigating undesired influences, e.g. temperature, pressure affecting incoming signal, e.g. by averaging; gating undesired signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/06—Energy or water supply
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J2203/00—Indexing scheme relating to details of circuit arrangements for AC mains or AC distribution networks
    • H02J2203/20—Simulating, e g planning, reliability check, modelling or computer assisted design [CAD]
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J3/00—Circuit arrangements for AC mains or AC distribution networks
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E40/00—Technologies for an efficient electrical power generation, transmission or distribution
    • Y02E40/70—Smart grids as climate change mitigation technology in the energy generation sector
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
    • Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
    • Y04S10/00—Systems supporting electrical power generation, transmission or distribution
    • Y04S10/22—Flexible AC transmission systems [FACTS] or power factor or reactive power compensating or correcting units
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
    • Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
    • Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
    • Y04S40/20—Information technology specific aspects, e.g. CAD, simulation, modelling, system security

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Public Health (AREA)
  • General Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Health & Medical Sciences (AREA)
  • Tourism & Hospitality (AREA)
  • Water Supply & Treatment (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • Remote Monitoring And Control Of Power-Distribution Networks (AREA)
  • Testing And Monitoring For Control Systems (AREA)
  • Complex Calculations (AREA)
  • Maintenance And Management Of Digital Transmission (AREA)
  • Selective Calling Equipment (AREA)
CN201410578376.0A 2013-10-24 2014-10-24 用于检测、校正并验证数据流中的不良数据的系统和方法 Expired - Fee Related CN104572333B (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/062,720 US9239760B2 (en) 2013-10-24 2013-10-24 Systems and methods for detecting, correcting, and validating bad data in data streams
US14/062720 2013-10-24

Publications (2)

Publication Number Publication Date
CN104572333A CN104572333A (zh) 2015-04-29
CN104572333B true CN104572333B (zh) 2019-04-23

Family

ID=51900085

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410578376.0A Expired - Fee Related CN104572333B (zh) 2013-10-24 2014-10-24 用于检测、校正并验证数据流中的不良数据的系统和方法

Country Status (5)

Country Link
US (1) US9239760B2 (enExample)
EP (1) EP2866190A1 (enExample)
JP (1) JP6467186B2 (enExample)
CN (1) CN104572333B (enExample)
CA (1) CA2867187A1 (enExample)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9239760B2 (en) * 2013-10-24 2016-01-19 General Electric Company Systems and methods for detecting, correcting, and validating bad data in data streams
US10133614B2 (en) * 2015-03-24 2018-11-20 Ca, Inc. Anomaly classification, analytics and resolution based on annotated event logs
US9909940B2 (en) * 2015-04-27 2018-03-06 General Electric Company System and method for non-invasive generator damping torque estimation
CN107448363B (zh) * 2015-10-27 2019-03-05 南通大学 具备数据异常实时监测的多微处理器垂直轴风力发电测试装置
CN105608060A (zh) * 2015-12-21 2016-05-25 中国银联股份有限公司 基于离群点检测的行业趋势预测方法及其系统
US10598702B2 (en) * 2016-05-13 2020-03-24 Hitachi, Ltd. Similarity detection of abnormal waveforms using PMU measurement
EP3288278B1 (en) * 2016-08-23 2020-05-27 General Electric Technology GmbH Sensor system
US10423186B2 (en) 2016-09-29 2019-09-24 Enel X North America, Inc. Building control system including automated validation, estimation, and editing rules configuration engine
US10291022B2 (en) 2016-09-29 2019-05-14 Enel X North America, Inc. Apparatus and method for automated configuration of estimation rules in a network operations center
US10461533B2 (en) 2016-09-29 2019-10-29 Enel X North America, Inc. Apparatus and method for automated validation, estimation, and editing configuration
US10170910B2 (en) 2016-09-29 2019-01-01 Enel X North America, Inc. Energy baselining system including automated validation, estimation, and editing rules configuration engine
US10191506B2 (en) 2016-09-29 2019-01-29 Enel X North America, Inc. Demand response dispatch prediction system including automated validation, estimation, and editing rules configuration engine
US10298012B2 (en) 2016-09-29 2019-05-21 Enel X North America, Inc. Network operations center including automated validation, estimation, and editing configuration engine
US10566791B2 (en) 2016-09-29 2020-02-18 Enel X North America, Inc. Automated validation, estimation, and editing processor
US10203714B2 (en) 2016-09-29 2019-02-12 Enel X North America, Inc. Brown out prediction system including automated validation, estimation, and editing rules configuration engine
JP7206657B2 (ja) * 2017-09-15 2023-01-18 東京電力ホールディングス株式会社 盗電監視システム、盗電監視装置、盗電監視方法及びプログラム
US10990072B2 (en) * 2017-11-28 2021-04-27 PXiSE Energy Solutions, LLC Maintaining power grid stability using predicted data
CN108680776A (zh) * 2018-05-23 2018-10-19 浙江中凯科技股份有限公司 一种电信号的补偿系统及设备
US10795715B2 (en) 2018-06-28 2020-10-06 At&T Intellectual Property I, L.P. Cloud oversubscription system
DK201800635A1 (en) * 2018-09-25 2020-04-28 Scada International A/S A method for improving reporting of operational data of a wind turbine
CN109545113B (zh) 2018-09-30 2022-09-06 合肥鑫晟光电科技有限公司 一种异常数据处理方法及装置
WO2020070169A1 (de) * 2018-10-01 2020-04-09 Volkswagen Aktiengesellschaft Verfahren und vorrichtung zum überwachen der zuverlässigkeit eines elektronischen systems
CN109884469A (zh) * 2019-03-06 2019-06-14 山东理工大学 配电网故障区段与故障时刻的判定方法
US11657148B2 (en) 2019-05-10 2023-05-23 General Electric Company Event analysis in an electric power system
US10948527B2 (en) * 2019-05-21 2021-03-16 University Of Tennessee Research Foundation Power system detection of sustained oscillations based on synchrophasor frequency measurements
US10884038B1 (en) * 2020-06-08 2021-01-05 North China Electric Power University Phasor estimation algorithm for PMU calibration
US11290481B2 (en) 2020-07-09 2022-03-29 Bank Of America Corporation Security threat detection by converting scripts using validation graphs
US20220140648A1 (en) * 2020-10-30 2022-05-05 University Of Tennessee Research Foundation Methods, systems, and computer program products for adaptive wide-area damping control using a transfer function model derived from measurements
US11314584B1 (en) * 2020-11-25 2022-04-26 International Business Machines Corporation Data quality-based confidence computations for KPIs derived from time-series data
US11056912B1 (en) 2021-01-25 2021-07-06 PXiSE Energy Solutions, LLC Power system optimization using hierarchical clusters
CN112966957A (zh) * 2021-03-22 2021-06-15 国家电网有限公司大数据中心 一种数据链路异常定位方法、装置、电子设备及存储介质
US11363049B1 (en) 2021-03-25 2022-06-14 Bank Of America Corporation Information security system and method for anomaly detection in data transmission
US20240296261A1 (en) * 2021-04-30 2024-09-05 Siemens Corporation Power system model calibration using measurement data
CN113515512B (zh) * 2021-06-22 2024-06-14 国网辽宁省电力有限公司鞍山供电公司 一种工业互联网平台数据的质量治理及提升方法
CN113468158B (zh) * 2021-07-13 2023-10-31 广域铭岛数字科技有限公司 数据修复方法、系统、电子设备及介质
US12111821B2 (en) * 2021-07-22 2024-10-08 Abb Schweiz Ag Systems and methods for optimal synchrophasor data recovery
EP4160866A1 (de) * 2021-09-29 2023-04-05 Siemens Aktiengesellschaft Verfahren zur steuerung eines energienetzes und netzsteuerungsanordnung
CN114416587A (zh) * 2022-01-26 2022-04-29 吉旗（成都）科技有限公司 流媒体数据测试方法、装置、电子设备及存储介质
CN114579933B (zh) * 2022-05-05 2022-08-12 威胜集团有限公司 误差测量优化方法、装置、电子设备及可读存储介质
CN116269450B (zh) * 2023-03-21 2023-12-19 苏州海臻医疗器械有限公司 一种基于肌电信号的患者肢体康复状态评估系统及方法
WO2025193135A1 (en) * 2024-03-11 2025-09-18 Telefonaktiebolaget Lm Ericsson (Publ) First node and methods performed thereby, for handling data

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009048964A1 (en) * 2007-10-09 2009-04-16 Schweitzer Engineering Laboratories, Inc. Real-time power system oscillation detection using modal analysis
US7904261B2 (en) * 2006-08-24 2011-03-08 British Columbia Hydro And Power Authority Method and system for using phasor measurements in state estimation of power systems
CN103033789A (zh) * 2012-12-26 2013-04-10 华北电力大学 一种同步相量测量单元pmu的静动态测试系统
CN104572333A (zh) * 2013-10-24 2015-04-29 通用电气公司 用于检测、校正并验证数据流中的不良数据的系统和方法

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0356432A4 (en) 1988-02-22 1990-12-12 Brandeau, Edward P. Digital image noise suppression method using svd block transform
US7085824B2 (en) * 2001-02-23 2006-08-01 Power Measurement Ltd. Systems for in the field configuration of intelligent electronic devices
US7475027B2 (en) 2003-02-06 2009-01-06 Mitsubishi Electric Research Laboratories, Inc. On-line recommender system
WO2005015366A2 (en) 2003-08-08 2005-02-17 Electric Power Group, Llc Real-time performance monitoring and management system
US8108184B2 (en) * 2004-01-15 2012-01-31 Bruce Fardanesh Methods and systems for power systems analysis: a non-iterative state solver/estimator for power systems operation and control
JP5017678B2 (ja) * 2005-08-31 2012-09-05 鵬 陳山 信号検査方法および信号検査モジュール
JP2009512097A (ja) 2005-10-18 2009-03-19 ハネウェル・インターナショナル・インコーポレーテッド 早期イベント検出のためのシステム、方法、およびコンピュータプログラム
US7912676B2 (en) * 2006-07-25 2011-03-22 Fisher-Rosemount Systems, Inc. Method and system for detecting abnormal operation in a process plant
US20090088990A1 (en) 2007-09-30 2009-04-02 Schweitzer Iii Edmund O Synchronized phasor processor for a power system
US8000914B2 (en) 2008-03-04 2011-08-16 Washington State University Systems and methods for electromechanical oscillation monitoring
US8788244B2 (en) 2010-05-24 2014-07-22 Washington State University Systems and methods for global voltage security assessment in power systems
CN101924364B (zh) 2010-07-23 2013-05-01 清华大学 变电站-调度中心两级分布式电网的非线性状态估计方法
US8738191B2 (en) 2010-09-17 2014-05-27 Sarantos K. Aivaliotis System and method for power grid management
WO2012048734A1 (en) * 2010-10-12 2012-04-19 Abb Research Ltd Method for controlling an industrial process
US8781767B2 (en) * 2011-08-19 2014-07-15 General Electric Company Systems and methods for data anomaly detection
US20130173322A1 (en) 2011-12-30 2013-07-04 Schneider Electric USA, Inc. Energy Management with Correspondence Based Data Auditing Signoff
CN103281266B (zh) * 2013-05-06 2016-06-15 重庆邮电大学 基于线性模型的伪码调相正弦调频复合信号伪码序列估计方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7904261B2 (en) * 2006-08-24 2011-03-08 British Columbia Hydro And Power Authority Method and system for using phasor measurements in state estimation of power systems
WO2009048964A1 (en) * 2007-10-09 2009-04-16 Schweitzer Engineering Laboratories, Inc. Real-time power system oscillation detection using modal analysis
CN103033789A (zh) * 2012-12-26 2013-04-10 华北电力大学 一种同步相量测量单元pmu的静动态测试系统
CN103033789B (zh) * 2012-12-26 2015-12-09 华北电力大学 一种同步相量测量单元pmu的静动态测试系统
CN104572333A (zh) * 2013-10-24 2015-04-29 通用电气公司 用于检测、校正并验证数据流中的不良数据的系统和方法

Also Published As

Publication number Publication date
US9239760B2 (en) 2016-01-19
CN104572333A (zh) 2015-04-29
JP6467186B2 (ja) 2019-02-06
US20150121160A1 (en) 2015-04-30
EP2866190A1 (en) 2015-04-29
JP2015082843A (ja) 2015-04-27
CA2867187A1 (en) 2015-04-24

Similar Documents

Publication Publication Date Title
CN104572333B (zh) 用于检测、校正并验证数据流中的不良数据的系统和方法
EP3173799B1 (en) Estimating the locations of power system events using pmu measurements
US10025336B2 (en) System and method for analyzing oscillatory stability in electrical power transmission systems
US20150149128A1 (en) Systems and methods for analyzing model parameters of electrical power systems using trajectory sensitivities
Cuffe et al. Visualizing the electrical structure of power systems
US20150371151A1 (en) Energy infrastructure sensor data rectification using regression models
CN105740975B (zh) 一种基于数据关联关系的设备缺陷评估与预测方法
US20160252562A1 (en) Performance analysis of power grid monitors
US20190033351A1 (en) Data cost effective fast similarity search with priority access
CN118839866B (zh) 一种基于人工智能的电力线路状态评估方法及系统
US9252633B2 (en) System and method for accelerated assessment of operational uncertainties in electrical power distribution systems
JP2023545098A (ja) 高分解能電気測定データ処理
Biswas et al. An open-source library of phasor measurement unit data capturing real bulk power systems behavior
KR20140109596A (ko) 미검침 구간의 검침 데이터 예측 및 보정 방법과 그 장치
Ju et al. Indices for automated identification of questionable generator models using synchrophasors
Evans et al. Validation of high-definition electric power delivery network simulation
Kezunovic et al. Life cycle management tools for synchrophasor systems: Why we need them and what they should entail
Bank et al. Generator trip identification using wide-area measurements and historical data analysis
Jiang et al. Synchrophasor measurement-based modal analysis in power grids
Pawar et al. OPTIMAL PLACEMENT OF PMU FOR ENHANCING POWER SYSTEM MONITORING.
Maaß et al. Preparing the electrical data recorder for comparative power network measurements
Ingram et al. Situational awareness of grid anomalies (SAGA) for visual analytics—near-real-time cyber-physical resiliency through machine learning
Ginocchi et al. Optimal meter placement for distribution system state estimation: A global sensitivity analysis-based framework
Firouzjah et al. Multi-objective allocation of measuring system based on binary particle swarm optimization
Venturi et al. The role of accurate measurements within smartgrids

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20231228

Address after: Swiss Baden

Patentee after: GENERAL ELECTRIC CO. LTD.

Address before: New York State, USA

Patentee before: General Electric Co.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20190423