CN115062722B - 基于云端业务大数据清洗的ai训练方法及人工智能云系统 - Google Patents
基于云端业务大数据清洗的ai训练方法及人工智能云系统 Download PDFInfo
- Publication number
- CN115062722B CN115062722B CN202210785807.5A CN202210785807A CN115062722B CN 115062722 B CN115062722 B CN 115062722B CN 202210785807 A CN202210785807 A CN 202210785807A CN 115062722 B CN115062722 B CN 115062722B
- Authority
- CN
- China
- Prior art keywords
- acquisition
- noise
- training
- cleaning
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012549 training Methods 0.000 title claims abstract description 386
- 238000004140 cleaning Methods 0.000 title claims abstract description 294
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000013473 artificial intelligence Methods 0.000 title claims abstract description 21
- 238000005457 optimization Methods 0.000 claims abstract description 55
- 238000013480 data collection Methods 0.000 claims abstract description 23
- 230000035515 penetration Effects 0.000 claims description 88
- 230000000694 effects Effects 0.000 claims description 64
- 238000005065 mining Methods 0.000 claims description 25
- 238000000605 extraction Methods 0.000 claims description 19
- 238000004891 communication Methods 0.000 claims description 18
- 238000013135 deep learning Methods 0.000 claims description 18
- 238000009826 distribution Methods 0.000 claims description 12
- 238000012216 screening Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 9
- 238000003860 storage Methods 0.000 claims description 8
- 238000002372 labelling Methods 0.000 claims description 4
- 230000001172 regenerating effect Effects 0.000 claims 1
- 238000005406 washing Methods 0.000 claims 1
- 238000013461 design Methods 0.000 description 30
- 238000010926 purge Methods 0.000 description 11
- 239000000284 extract Substances 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 230000006399 behavior Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 2
- 230000004580 weight loss Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biomedical Technology (AREA)
- Computational Linguistics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- Health & Medical Sciences (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Claims (8)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210785807.5A CN115062722B (zh) | 2022-07-06 | 2022-07-06 | 基于云端业务大数据清洗的ai训练方法及人工智能云系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210785807.5A CN115062722B (zh) | 2022-07-06 | 2022-07-06 | 基于云端业务大数据清洗的ai训练方法及人工智能云系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115062722A CN115062722A (zh) | 2022-09-16 |
CN115062722B true CN115062722B (zh) | 2023-03-28 |
Family
ID=83205029
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210785807.5A Expired - Fee Related CN115062722B (zh) | 2022-07-06 | 2022-07-06 | 基于云端业务大数据清洗的ai训练方法及人工智能云系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115062722B (zh) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113706151A (zh) * | 2021-04-07 | 2021-11-26 | 腾讯科技(深圳)有限公司 | 一种数据处理方法、装置、计算机设备及存储介质 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108446621A (zh) * | 2018-03-14 | 2018-08-24 | 平安科技(深圳)有限公司 | 票据识别方法、服务器及计算机可读存储介质 |
CN111105860B (zh) * | 2019-12-18 | 2023-07-28 | 青岛科技大学 | 面向慢性病康复的精准运动大数据智能预测、分析及优化系统 |
CN112434809B (zh) * | 2021-01-26 | 2021-04-06 | 成都点泽智能科技有限公司 | 基于主动学习的模型训练方法、装置及服务器 |
CN114691665B (zh) * | 2022-04-13 | 2023-11-14 | 众坤(北京)航空设备有限公司 | 基于大数据分析的采集噪声点挖掘方法及大数据采集系统 |
-
2022
- 2022-07-06 CN CN202210785807.5A patent/CN115062722B/zh not_active Expired - Fee Related
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113706151A (zh) * | 2021-04-07 | 2021-11-26 | 腾讯科技(深圳)有限公司 | 一种数据处理方法、装置、计算机设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN115062722A (zh) | 2022-09-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112394942B (zh) | 基于云计算的分布式软件开发编译方法及软件开发平台 | |
CN109933515B (zh) | 一种回归测试用例集的优化方法和自动优化装置 | |
US11481440B2 (en) | System and method for processing metadata to determine an object sequence | |
US11995438B2 (en) | System and method for software architecture redesign | |
CN114697128B (zh) | 通过人工智能决策的大数据去噪方法及大数据采集系统 | |
CN112288249A (zh) | 业务流程执行方法、装置、计算机设备和介质 | |
CN112732577A (zh) | 一种多任务软件测试用例进化生成方法 | |
CN113360349A (zh) | 基于大数据和云业务的信息优化方法及人工智能监测系统 | |
CN115048370A (zh) | 用于大数据清洗的人工智能处理方法及大数据清洗系统 | |
CN114661785A (zh) | 基于大数据挖掘的用户画像确定方法及云计算服务系统 | |
CN116431520A (zh) | 测试场景确定方法、装置、电子设备和存储介质 | |
CN111258876B (zh) | 一种微服务架构下的精确回归测试方法及装置 | |
CN115062722B (zh) | 基于云端业务大数据清洗的ai训练方法及人工智能云系统 | |
CN113722711A (zh) | 基于大数据安全漏洞挖掘的数据添加方法及人工智能系统 | |
CN115422179B (zh) | 基于大数据清洗的ai训练处理方法及人工智能训练系统 | |
CN115712843B (zh) | 基于人工智能的数据匹配检测处理方法及系统 | |
CN115422486B (zh) | 基于人工智能的云服务在线页面优化方法及大数据系统 | |
CN114978765B (zh) | 服务于信息攻击防御的大数据处理方法及ai攻击防御系统 | |
CN115062227B (zh) | 采用人工智能分析的用户行为活动分析方法及大数据系统 | |
CN114661984A (zh) | 基于人工智能和用户画像的信息推送方法及云计算系统 | |
CN114678114A (zh) | 应用于智慧医疗的大数据挖掘评估方法及大数据挖掘系统 | |
CN115455426A (zh) | 基于漏洞分析模型开发的业务错误分析方法及云端ai系统 | |
CN114041281B (zh) | 现场数据传输方法、装置、系统和计算机可读介质 | |
CN114896236B (zh) | 应用人工智能分析的大数据去噪优化方法及大数据系统 | |
CN114756541B (zh) | 用于人工智能训练的大数据特征清洗决策方法及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20221208 Address after: No.10, Xianfeng Road, Daowai District, Harbin City, Heilongjiang Province Applicant after: Liu Zhanlong Address before: Room 502, No. 23, Beishidao Street, Daowai District, Harbin City, Heilongjiang Province, 150000 Applicant before: Harbin Bineng Technology Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20230307 Address after: 201100 floor 10, building 5, No. 525, Yuanjiang Road, Minhang District, Shanghai Applicant after: Areba Data Technology (Shanghai) Co.,Ltd. Address before: No.10, Xianfeng Road, Daowai District, Harbin City, Heilongjiang Province Applicant before: Liu Zhanlong |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20230328 |