CN110990393A - 一种行业企业数据异常行为的大数据识别方法 - Google Patents
一种行业企业数据异常行为的大数据识别方法 Download PDFInfo
- Publication number
- CN110990393A CN110990393A CN201911298999.1A CN201911298999A CN110990393A CN 110990393 A CN110990393 A CN 110990393A CN 201911298999 A CN201911298999 A CN 201911298999A CN 110990393 A CN110990393 A CN 110990393A
- Authority
- CN
- China
- Prior art keywords
- data
- abnormal
- index features
- value
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000002159 abnormal effect Effects 0.000 title claims abstract description 41
- 230000006399 behavior Effects 0.000 title claims abstract description 15
- 238000000605 extraction Methods 0.000 claims abstract description 19
- 238000010606 normalization Methods 0.000 claims abstract description 19
- 238000004140 cleaning Methods 0.000 claims abstract description 11
- 230000005856 abnormality Effects 0.000 claims abstract description 10
- 238000007781 pre-processing Methods 0.000 claims abstract description 9
- 238000009826 distribution Methods 0.000 claims abstract description 8
- 230000009466 transformation Effects 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 10
- 206010000117 Abnormal behaviour Diseases 0.000 claims description 8
- 238000013507 mapping Methods 0.000 claims description 7
- 238000001276 Kolmogorov–Smirnov test Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 claims description 4
- 238000001514 detection method Methods 0.000 claims description 3
- 238000007619 statistical method Methods 0.000 claims description 2
- 230000001502 supplementing effect Effects 0.000 claims description 2
- 238000004364 calculation method Methods 0.000 abstract description 3
- 238000012544 monitoring process Methods 0.000 description 14
- 238000012216 screening Methods 0.000 description 7
- 239000003344 environmental pollutant Substances 0.000 description 4
- 238000011156 evaluation Methods 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 4
- 231100000719 pollutant Toxicity 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- RAHZWNYVWXNFOC-UHFFFAOYSA-N sulfur dioxide Inorganic materials O=S=O RAHZWNYVWXNFOC-UHFFFAOYSA-N 0.000 description 4
- MWUXSHHQAYIFBG-UHFFFAOYSA-N Nitric oxide Chemical compound O=[N] MWUXSHHQAYIFBG-UHFFFAOYSA-N 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 239000011159 matrix material Substances 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 239000004568 cement Substances 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 239000013618 particulate matter Substances 0.000 description 2
- 239000010865 sewage Substances 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 102000003712 Complement factor B Human genes 0.000 description 1
- 108090000056 Complement factor B Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003203 everyday effect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000002994 raw material Substances 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000005406 washing Methods 0.000 description 1
- 239000002912 waste gas Substances 0.000 description 1
- 239000002351 wastewater Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2462—Approximate or statistical queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2477—Temporal data queries
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Probability & Statistics with Applications (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Fuzzy Systems (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911298999.1A CN110990393B (zh) | 2019-12-17 | 2019-12-17 | 一种行业企业数据异常行为的大数据识别方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911298999.1A CN110990393B (zh) | 2019-12-17 | 2019-12-17 | 一种行业企业数据异常行为的大数据识别方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110990393A true CN110990393A (zh) | 2020-04-10 |
CN110990393B CN110990393B (zh) | 2023-09-08 |
Family
ID=70094494
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911298999.1A Active CN110990393B (zh) | 2019-12-17 | 2019-12-17 | 一种行业企业数据异常行为的大数据识别方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110990393B (zh) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111879522A (zh) * | 2020-07-24 | 2020-11-03 | 山东大学 | 基于时序概率的汽轮机运行监测和故障判别方法及系统 |
CN111984934A (zh) * | 2020-09-01 | 2020-11-24 | 黑龙江八一农垦大学 | 一种对动物血液生化指标进行优选的方法 |
CN112258689A (zh) * | 2020-10-26 | 2021-01-22 | 上海船舶研究设计院(中国船舶工业集团公司第六0四研究院) | 船舶数据处理方法、装置和船舶数据质量管理平台 |
CN112415968A (zh) * | 2020-11-19 | 2021-02-26 | 华润三九(枣庄)药业有限公司 | 一种基于区块链的中药生产信息化管理系统 |
CN112612824A (zh) * | 2020-12-15 | 2021-04-06 | 重庆梅安森科技股份有限公司 | 基于大数据的供水管网异常数据检测方法 |
CN113807413A (zh) * | 2021-08-30 | 2021-12-17 | 北京百度网讯科技有限公司 | 对象的识别方法、装置、电子设备 |
CN114049033A (zh) * | 2021-11-22 | 2022-02-15 | 国网江苏省电力有限公司连云港供电分公司 | 一种基于用电数据分布的排污企业监测方法 |
CN114662981A (zh) * | 2022-04-15 | 2022-06-24 | 广东柯内特环境科技有限公司 | 基于大数据应用的污染源企业监管方法 |
CN114912804A (zh) * | 2022-05-17 | 2022-08-16 | 四川大学华西医院 | 一种科研数据相关性质控方法和系统 |
CN117235624A (zh) * | 2023-09-22 | 2023-12-15 | 中节能天融科技有限公司 | 排放数据造假检测方法、装置及系统和存储介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180176241A1 (en) * | 2016-12-21 | 2018-06-21 | Hewlett Packard Enterprise Development Lp | Abnormal behavior detection of enterprise entities using time-series data |
CN108510006A (zh) * | 2018-04-08 | 2018-09-07 | 重庆邮电大学 | 一种基于数据挖掘的企业用电量分析与预测方法 |
CN110245880A (zh) * | 2019-07-02 | 2019-09-17 | 浙江成功软件开发有限公司 | 一种污染源在线监控数据作弊识别方法 |
-
2019
- 2019-12-17 CN CN201911298999.1A patent/CN110990393B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180176241A1 (en) * | 2016-12-21 | 2018-06-21 | Hewlett Packard Enterprise Development Lp | Abnormal behavior detection of enterprise entities using time-series data |
CN108510006A (zh) * | 2018-04-08 | 2018-09-07 | 重庆邮电大学 | 一种基于数据挖掘的企业用电量分析与预测方法 |
CN110245880A (zh) * | 2019-07-02 | 2019-09-17 | 浙江成功软件开发有限公司 | 一种污染源在线监控数据作弊识别方法 |
Non-Patent Citations (1)
Title |
---|
阿永嘎: "《大数据技术在环境执法工作中的应用研究》" * |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111879522A (zh) * | 2020-07-24 | 2020-11-03 | 山东大学 | 基于时序概率的汽轮机运行监测和故障判别方法及系统 |
CN111984934A (zh) * | 2020-09-01 | 2020-11-24 | 黑龙江八一农垦大学 | 一种对动物血液生化指标进行优选的方法 |
CN112258689A (zh) * | 2020-10-26 | 2021-01-22 | 上海船舶研究设计院(中国船舶工业集团公司第六0四研究院) | 船舶数据处理方法、装置和船舶数据质量管理平台 |
CN112415968A (zh) * | 2020-11-19 | 2021-02-26 | 华润三九(枣庄)药业有限公司 | 一种基于区块链的中药生产信息化管理系统 |
CN112612824A (zh) * | 2020-12-15 | 2021-04-06 | 重庆梅安森科技股份有限公司 | 基于大数据的供水管网异常数据检测方法 |
CN113807413B (zh) * | 2021-08-30 | 2024-02-06 | 北京百度网讯科技有限公司 | 对象的识别方法、装置、电子设备 |
CN113807413A (zh) * | 2021-08-30 | 2021-12-17 | 北京百度网讯科技有限公司 | 对象的识别方法、装置、电子设备 |
CN114049033A (zh) * | 2021-11-22 | 2022-02-15 | 国网江苏省电力有限公司连云港供电分公司 | 一种基于用电数据分布的排污企业监测方法 |
CN114049033B (zh) * | 2021-11-22 | 2024-06-07 | 国网江苏省电力有限公司连云港供电分公司 | 一种基于用电数据分布的排污企业监测方法 |
CN114662981A (zh) * | 2022-04-15 | 2022-06-24 | 广东柯内特环境科技有限公司 | 基于大数据应用的污染源企业监管方法 |
CN114912804A (zh) * | 2022-05-17 | 2022-08-16 | 四川大学华西医院 | 一种科研数据相关性质控方法和系统 |
CN117235624A (zh) * | 2023-09-22 | 2023-12-15 | 中节能天融科技有限公司 | 排放数据造假检测方法、装置及系统和存储介质 |
CN117235624B (zh) * | 2023-09-22 | 2024-05-07 | 中节能数字科技有限公司 | 排放数据造假检测方法、装置及系统和存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN110990393B (zh) | 2023-09-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110990393B (zh) | 一种行业企业数据异常行为的大数据识别方法 | |
CN111080502B (zh) | 一种区域企业数据异常行为的大数据识别方法 | |
CN106951984B (zh) | 一种系统健康度动态分析预测方法及装置 | |
CN110751451B (zh) | 一种实验室大数据管理系统 | |
CN109947815B (zh) | 一种基于离群点算法的窃电辨识方法 | |
CN114201374A (zh) | 基于混合机器学习的运维时序数据异常检测方法及系统 | |
CN114328075A (zh) | 一种智能配电房传感器多维数据融合异常事件检测方法、系统及计算机可读存储介质 | |
CN115719283A (zh) | 一种智能化会计管理系统 | |
CN115883163A (zh) | 网络安全告警监测方法 | |
CN113657747B (zh) | 一种企业安全生产标准化级别智能评定系统 | |
CN111597510B (zh) | 一种输变电运检数据质量评估方法及系统 | |
CN116126807A (zh) | 一种日志分析方法及相关装置 | |
CN115904955A (zh) | 性能指标的诊断方法、装置、终端设备及存储介质 | |
CN112765553B (zh) | 一种基于大数据的工程项目管理系统 | |
CN111882289B (zh) | 一种项目数据审核指标区间测算的装置和方法 | |
CN114168409A (zh) | 一种业务系统运行状态监控预警方法与系统 | |
CN110956340A (zh) | 工程试验检测数据管理预警决策方法 | |
CN113610344A (zh) | 一种污染预警方法、装置、电子设备及存储介质 | |
CN112150036B (zh) | 一种基于数据驱动的锅炉用气用户偷盗气检测方法及装置 | |
CN117349777B (zh) | 一种水环境在线监测数据真伪智能识别系统及方法 | |
CN117273670B (zh) | 一种具有学习功能的工程资料管理系统 | |
CN117574180B (zh) | 燃料生产排放系统数据关联性控制管理系统 | |
CN116011882B (zh) | 一种港口危险货物安全监管效能督查管理系统 | |
Wei et al. | A Method of Abnormal Measurement Screening for Special Transformer Users Based on Correlation Measurement Algorithm | |
KR101697086B1 (ko) | 재현주기 기반 인적 오류 경향 분석 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: He Weiqi Inventor after: Chen Rong Inventor after: Guo Chaoshuo Inventor after: Liu Yi Inventor before: He Weiqi Inventor before: Chen Rong Inventor before: Liu Na |
|
CB03 | Change of inventor or designer information | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210407 Address after: 215000 building 16, 158 Jinfeng Road, Huqiu District, Suzhou City, Jiangsu Province Applicant after: RESEARCH INSTITUTE FOR ENVIRONMENTAL INNOVATION (SUZHOU) TSINGHUA Applicant after: TSINGHUA University Address before: 215000 building 16, 158 Jinfeng Road, Huqiu District, Suzhou City, Jiangsu Province Applicant before: RESEARCH INSTITUTE FOR ENVIRONMENTAL INNOVATION (SUZHOU) TSINGHUA |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240205 Address after: 215163 floor 2, building 1, No. 100, Guangqi Road, high tech Zone, Suzhou, Jiangsu Patentee after: Xunfei Qinghuan (Suzhou) Technology Co.,Ltd. Country or region after: China Address before: 215000 building 16, 158 Jinfeng Road, Huqiu District, Suzhou City, Jiangsu Province Patentee before: RESEARCH INSTITUTE FOR ENVIRONMENTAL INNOVATION (SUZHOU) TSINGHUA Country or region before: China Patentee before: TSINGHUA University |
|
TR01 | Transfer of patent right |