CN111538886B - 一种基于人工智能的大数据采集存储系统及方法 - Google Patents
一种基于人工智能的大数据采集存储系统及方法 Download PDFInfo
- Publication number
- CN111538886B CN111538886B CN202010361774.2A CN202010361774A CN111538886B CN 111538886 B CN111538886 B CN 111538886B CN 202010361774 A CN202010361774 A CN 202010361774A CN 111538886 B CN111538886 B CN 111538886B
- Authority
- CN
- China
- Prior art keywords
- data
- big data
- grabbing
- distributed
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 10
- 238000013523 data management Methods 0.000 claims abstract description 15
- 230000008569 process Effects 0.000 claims abstract description 15
- 230000000737 periodic effect Effects 0.000 claims abstract description 7
- 238000012545 processing Methods 0.000 claims abstract description 6
- 230000002265 prevention Effects 0.000 claims abstract description 4
- 238000013500 data storage Methods 0.000 claims description 22
- 238000007726 management method Methods 0.000 claims description 9
- 238000004458 analytical method Methods 0.000 claims description 6
- 238000012937 correction Methods 0.000 claims description 6
- 238000007405 data analysis Methods 0.000 claims description 3
- 238000013481 data capture Methods 0.000 claims description 3
- 230000003203 everyday effect Effects 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000006872 improvement Effects 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 2
- 230000002159 abnormal effect Effects 0.000 claims 7
- 206010000117 Abnormal behaviour Diseases 0.000 claims 1
- 230000005856 abnormality Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9536—Search customisation based on social or collaborative filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
Description
Claims (1)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010361774.2A CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010361774.2A CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111538886A CN111538886A (zh) | 2020-08-14 |
CN111538886B true CN111538886B (zh) | 2024-04-19 |
Family
ID=71979020
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010361774.2A Active CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111538886B (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112445958A (zh) * | 2020-11-18 | 2021-03-05 | 厦门物之联智能科技有限公司 | 一种基于人工智能的大数据采集存储系统及方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103248625A (zh) * | 2013-04-27 | 2013-08-14 | 北京京东尚科信息技术有限公司 | 一种网络爬虫运行异常监控方法和系统 |
CN104077402A (zh) * | 2014-07-04 | 2014-10-01 | 用友软件股份有限公司 | 数据处理方法和数据处理系统 |
CN106886518A (zh) * | 2015-12-15 | 2017-06-23 | 国家计算机网络与信息安全管理中心 | 一种微博账号分类的方法 |
WO2017117595A1 (en) * | 2015-12-31 | 2017-07-06 | Fractal Industries, Inc. | Distributed system for large volume deep web data extraction |
-
2020
- 2020-04-30 CN CN202010361774.2A patent/CN111538886B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103248625A (zh) * | 2013-04-27 | 2013-08-14 | 北京京东尚科信息技术有限公司 | 一种网络爬虫运行异常监控方法和系统 |
CN104077402A (zh) * | 2014-07-04 | 2014-10-01 | 用友软件股份有限公司 | 数据处理方法和数据处理系统 |
CN106886518A (zh) * | 2015-12-15 | 2017-06-23 | 国家计算机网络与信息安全管理中心 | 一种微博账号分类的方法 |
WO2017117595A1 (en) * | 2015-12-31 | 2017-07-06 | Fractal Industries, Inc. | Distributed system for large volume deep web data extraction |
Non-Patent Citations (1)
Title |
---|
云环境中Web信息抓取技术的研究及应用;王仕艳;《通信电源技术》;20180925(第09期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN111538886A (zh) | 2020-08-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN205247194U (zh) | 一种自动控制智能专家故障诊断系统 | |
CN107145576B (zh) | 一种支持可视化和流程化的大数据etl调度系统 | |
CN111538886B (zh) | 一种基于人工智能的大数据采集存储系统及方法 | |
CN113468159A (zh) | 一种数据应用全链路管控方法及系统 | |
CN111123873B (zh) | 一种基于流处理技术的生产数据采集方法及系统 | |
CN115391444A (zh) | 一种异构数据采集与交互方法、装置、设备及存储介质 | |
CN106649034B (zh) | 一种可视化智能运维方法及平台 | |
CN113065580A (zh) | 一种基于多信息融合的电厂设备管理方法及系统 | |
CN110378585B (zh) | 电网故障处置计算任务编排调用方法、系统及存储介质 | |
CN109886434B (zh) | 一种智能钻井平台维护保养系统及方法 | |
CN111538887B (zh) | 一种基于人工智能的大数据图文识别系统及方法 | |
CN115719139A (zh) | 电网调度运行管理的调度自查系统 | |
CN115840656A (zh) | 一种基于故障自愈的应用程序自动化运维方法和系统 | |
CN112467806B (zh) | 一种基于dmn电网调控规则确定电网运行状态的方法及系统 | |
CN112668912A (zh) | 人工神经网络的训练方法、动态计算切分调度方法、存储介质及系统 | |
Zhang et al. | Modeling the economic and economic impact of artificial intelligence data feature analysis | |
CN112711508A (zh) | 面向大规模客户端系统的智能运维服务系统 | |
Wu et al. | Characteristics and development prospect of computer automatic patrol inspection technology | |
Xu et al. | Research on condition monitoring platform for mineral processing equipment based on industrial cloud | |
CN202736114U (zh) | 基于业务规则技术的智慧档案管理系统 | |
CN111245632A (zh) | 一种基于云分析的安全日志存储与管理系统 | |
CN212032204U (zh) | 一种电力企业海外投资信息监测装置 | |
Habib et al. | 21st century present condition and challenges related to large-scale data processing in smart grid and optional framework for large data storage and analysis | |
CN116955465A (zh) | 提升质量分析效率的方法、装置、介质及电子设备 | |
Li et al. | Research on Digital Operation and Maintenance of Informati on System in Distributed Environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20240325 Address after: Room 902, Anyuan Building, No. 217 Ping'an Middle Avenue, Anyuan District, Pingxiang City, Jiangxi Province, 337000 Applicant after: Pingxiang Anyuan Digital Investment Co.,Ltd. Country or region after: China Address before: B410, Building 9, Foshan New Media Industrial Park, No. 5-13 Wuhua Road, Zhangcha Street, Chancheng District, Foshan City, Guangdong Province, 528000 Applicant before: Guangdong suneng Network Co.,Ltd. Country or region before: China |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant |