CN111538886A - 一种基于人工智能的大数据采集存储系统及方法 - Google Patents
一种基于人工智能的大数据采集存储系统及方法 Download PDFInfo
- Publication number
- CN111538886A CN111538886A CN202010361774.2A CN202010361774A CN111538886A CN 111538886 A CN111538886 A CN 111538886A CN 202010361774 A CN202010361774 A CN 202010361774A CN 111538886 A CN111538886 A CN 111538886A
- Authority
- CN
- China
- Prior art keywords
- data
- big data
- capturing
- grabbing
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 16
- 230000008569 process Effects 0.000 claims abstract description 16
- 238000013523 data management Methods 0.000 claims abstract description 14
- 238000012545 processing Methods 0.000 claims abstract description 5
- 238000013500 data storage Methods 0.000 claims description 20
- 238000013481 data capture Methods 0.000 claims description 11
- 238000007726 management method Methods 0.000 claims description 8
- 238000012937 correction Methods 0.000 claims description 6
- 230000005055 memory storage Effects 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 238000007405 data analysis Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 3
- 230000003203 everyday effect Effects 0.000 claims description 3
- 238000001914 filtration Methods 0.000 claims description 3
- 230000006872 improvement Effects 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 claims description 3
- 230000002159 abnormal effect Effects 0.000 claims 7
- 206010000117 Abnormal behaviour Diseases 0.000 claims 1
- 230000005856 abnormality Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9536—Search customisation based on social or collaborative filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
Description
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010361774.2A CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010361774.2A CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111538886A true CN111538886A (zh) | 2020-08-14 |
CN111538886B CN111538886B (zh) | 2024-04-19 |
Family
ID=71979020
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010361774.2A Active CN111538886B (zh) | 2020-04-30 | 2020-04-30 | 一种基于人工智能的大数据采集存储系统及方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111538886B (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112445958A (zh) * | 2020-11-18 | 2021-03-05 | 厦门物之联智能科技有限公司 | 一种基于人工智能的大数据采集存储系统及方法 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103248625A (zh) * | 2013-04-27 | 2013-08-14 | 北京京东尚科信息技术有限公司 | 一种网络爬虫运行异常监控方法和系统 |
CN104077402A (zh) * | 2014-07-04 | 2014-10-01 | 用友软件股份有限公司 | 数据处理方法和数据处理系统 |
CN106886518A (zh) * | 2015-12-15 | 2017-06-23 | 国家计算机网络与信息安全管理中心 | 一种微博账号分类的方法 |
WO2017117595A1 (en) * | 2015-12-31 | 2017-07-06 | Fractal Industries, Inc. | Distributed system for large volume deep web data extraction |
-
2020
- 2020-04-30 CN CN202010361774.2A patent/CN111538886B/zh active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103248625A (zh) * | 2013-04-27 | 2013-08-14 | 北京京东尚科信息技术有限公司 | 一种网络爬虫运行异常监控方法和系统 |
CN104077402A (zh) * | 2014-07-04 | 2014-10-01 | 用友软件股份有限公司 | 数据处理方法和数据处理系统 |
CN106886518A (zh) * | 2015-12-15 | 2017-06-23 | 国家计算机网络与信息安全管理中心 | 一种微博账号分类的方法 |
WO2017117595A1 (en) * | 2015-12-31 | 2017-07-06 | Fractal Industries, Inc. | Distributed system for large volume deep web data extraction |
Non-Patent Citations (1)
Title |
---|
王仕艳: "云环境中Web信息抓取技术的研究及应用", 《通信电源技术》 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112445958A (zh) * | 2020-11-18 | 2021-03-05 | 厦门物之联智能科技有限公司 | 一种基于人工智能的大数据采集存储系统及方法 |
Also Published As
Publication number | Publication date |
---|---|
CN111538886B (zh) | 2024-04-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9009850B2 (en) | Database management by analyzing usage of database fields | |
CN205247194U (zh) | 一种自动控制智能专家故障诊断系统 | |
CN107748782A (zh) | 查询语句处理方法及装置 | |
CN113836131A (zh) | 一种大数据清洗方法、装置、计算机设备及存储介质 | |
CN114648393A (zh) | 一种应用于招投标的数据挖掘方法、系统及设备 | |
CN113468159A (zh) | 一种数据应用全链路管控方法及系统 | |
CN114021156A (zh) | 漏洞自动化聚合的整理方法、装置、设备以及存储介质 | |
CN112287275A (zh) | 一种城市级数据中台 | |
CN114968727A (zh) | 基于人工智能运维的数据库贯穿基础设施的故障定位方法 | |
CN111538886B (zh) | 一种基于人工智能的大数据采集存储系统及方法 | |
CN106817262A (zh) | 一种日志分析装置 | |
CN106649034B (zh) | 一种可视化智能运维方法及平台 | |
CN115686280A (zh) | 深度学习模型管理系统、方法、计算机设备及存储介质 | |
CN109150603A (zh) | 云服务端自动扩容方法及装置 | |
CN113065580A (zh) | 一种基于多信息融合的电厂设备管理方法及系统 | |
CN111046059B (zh) | 基于分布式数据库集群的低效sql语句分析方法及系统 | |
CN109886434B (zh) | 一种智能钻井平台维护保养系统及方法 | |
CN116644136A (zh) | 一种增量和全量数据的数据采集方法、装置、设备及介质 | |
CN111538887B (zh) | 一种基于人工智能的大数据图文识别系统及方法 | |
Nashivochnikov et al. | The system for operational monitoring and analytics of industry cyber-physical systems security in fuel and energy domains based on anomaly detection and prediction methods | |
CN109977700A (zh) | 一种基于网络安全的大数据处理系统 | |
CN112711508A (zh) | 面向大规模客户端系统的智能运维服务系统 | |
CN113505167A (zh) | 一种链路预测关系推荐的用户数据预处理系统 | |
Wu et al. | Cluster based detection and analysis of internet topics | |
Fang et al. | Research on computer information processing technology in the “big data” era |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20240325 Address after: Room 902, Anyuan Building, No. 217 Ping'an Middle Avenue, Anyuan District, Pingxiang City, Jiangxi Province, 337000 Applicant after: Pingxiang Anyuan Digital Investment Co.,Ltd. Country or region after: China Address before: B410, Building 9, Foshan New Media Industrial Park, No. 5-13 Wuhua Road, Zhangcha Street, Chancheng District, Foshan City, Guangdong Province, 528000 Applicant before: Guangdong suneng Network Co.,Ltd. Country or region before: China |
|
GR01 | Patent grant | ||
GR01 | Patent grant |