CN113762504B - 模型训练系统、方法和存储介质 - Google Patents

模型训练系统、方法和存储介质

Info

Publication number
CN113762504B
CN113762504B CN202110850132.3A CN202110850132A CN113762504B CN 113762504 B CN113762504 B CN 113762504B CN 202110850132 A CN202110850132 A CN 202110850132A CN 113762504 B CN113762504 B CN 113762504B
Authority
CN
China
Prior art keywords
data
training
model
platform
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110850132.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN113762504A (zh
Inventor
陈普
廖乔勃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Huawei Cloud Computing Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd, Huawei Cloud Computing Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202110850132.3A priority Critical patent/CN113762504B/zh
Publication of CN113762504A publication Critical patent/CN113762504A/zh
Application granted granted Critical
Publication of CN113762504B publication Critical patent/CN113762504B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9017—Indexing; Data structures therefor; Storage structures using directory or table look-up
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9038—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0807—Network architectures or network communication protocols for network security for authentication of entities using tickets, e.g. Kerberos
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0884—Network architectures or network communication protocols for network security for authentication of entities by delegation of authentication, e.g. a proxy authenticates an entity to be authenticated on behalf of this entity vis-à-vis an authentication entity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Mathematical Physics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • Bioethics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storage Device Security (AREA)
CN202110850132.3A 2017-11-29 2017-11-29 模型训练系统、方法和存储介质 Active CN113762504B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110850132.3A CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711227185.XA CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质
CN202110850132.3A CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201711227185.XA Division CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Publications (2)

Publication Number Publication Date
CN113762504A CN113762504A (zh) 2021-12-07
CN113762504B true CN113762504B (zh) 2025-09-12

Family

ID=66663796

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110850132.3A Active CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质
CN201711227185.XA Active CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201711227185.XA Active CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Country Status (8)

Country Link
US (2) US12184725B2 (https=)
EP (1) EP3709226A4 (https=)
JP (2) JP7144117B2 (https=)
KR (1) KR102514325B1 (https=)
CN (2) CN113762504B (https=)
AU (1) AU2018374912B2 (https=)
CA (1) CA3091405A1 (https=)
WO (1) WO2019105189A1 (https=)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113762504B (zh) 2017-11-29 2025-09-12 华为云计算技术有限公司 模型训练系统、方法和存储介质
JP2019136429A (ja) * 2018-02-15 2019-08-22 株式会社三洋物産 遊技機
JP2019136431A (ja) * 2018-02-15 2019-08-22 株式会社三洋物産 遊技機
US10979416B2 (en) * 2018-03-26 2021-04-13 Nicira, Inc. System and method for authentication in a public cloud
KR102074353B1 (ko) * 2018-04-13 2020-02-06 한국전자통신연구원 제어시스템 분야의 실시간 사이버 보안 훈련 제공 장치 및 방법
CN112149139B (zh) * 2019-06-28 2024-08-09 杭州海康威视数字技术股份有限公司 权限管理方法及装置
CN112148205A (zh) * 2019-06-28 2020-12-29 杭州海康威视数字技术股份有限公司 数据管理方法及装置
CN111147603A (zh) * 2019-09-30 2020-05-12 华为技术有限公司 一种推理服务网络化的方法及装置
CN111092935B (zh) * 2019-11-27 2022-07-12 中国联合网络通信集团有限公司 一种用于机器学习的数据共享方法和虚拟训练装置
CN111064797B (zh) * 2019-12-20 2023-01-10 深圳前海微众银行股份有限公司 一种数据处理方法及装置
CN113128528A (zh) * 2019-12-27 2021-07-16 无锡祥生医疗科技股份有限公司 超声影像深度学习分布式训练系统和训练方法
CN112668016B (zh) * 2020-01-02 2023-12-08 华控清交信息科技(北京)有限公司 一种模型训练方法、装置和电子设备
CN113128686A (zh) * 2020-01-16 2021-07-16 华为技术有限公司 模型训练方法及装置
CN113554450B (zh) * 2020-04-24 2024-08-30 阿里巴巴集团控股有限公司 数据模型训练及数据处理方法、装置、设备及存储介质
WO2021217610A1 (zh) * 2020-04-30 2021-11-04 华为技术有限公司 数据标注系统、方法和数据标注管理器
CN113762292B (zh) * 2020-06-03 2024-02-02 杭州海康威视数字技术股份有限公司 一种训练数据获取方法、装置及模型训练方法、装置
US11461292B2 (en) * 2020-07-01 2022-10-04 International Business Machines Corporation Quick data exploration
US11847544B2 (en) 2020-07-21 2023-12-19 International Business Machines Corporation Preventing data leakage in automated machine learning
CN112085208B (zh) * 2020-07-30 2024-08-20 北京聚云科技有限公司 一种利用云端进行模型训练的方法及装置
CN112102263A (zh) * 2020-08-31 2020-12-18 深圳思谋信息科技有限公司 缺陷检测模型生成系统、方法、装置和计算机设备
CN114358302A (zh) * 2020-10-14 2022-04-15 华为云计算技术有限公司 一种人工智能ai训练的方法、系统及设备
WO2022131663A1 (en) * 2020-12-18 2022-06-23 Samsung Electronics Co., Ltd. Method for preventing data leakage to machine learning engines available in electronic device
EP4200736A4 (en) 2020-12-18 2024-01-24 Samsung Electronics Co., Ltd. METHOD FOR PREVENTING DATA LEAKS ON MACHINE LEARNING MOTORS AVAILABLE IN AN ELECTRONIC DEVICE
CN114254766B (zh) * 2021-12-10 2024-07-05 智己汽车科技有限公司 一种车云两端联合训练机器学习模型的方法及系统
WO2023151829A1 (en) * 2022-02-14 2023-08-17 Telefonaktiebolaget Lm Ericsson (Publ) Blockchain-enabled trusted data layer for artificial intelligence (ai) applications
CN114896056A (zh) * 2022-04-18 2022-08-12 浙江安存云链数据技术有限公司 数据应用方法、装置、存储介质及电子设备
CN115114288B (zh) * 2022-06-23 2025-07-11 北京奇艺世纪科技有限公司 数据检索方法、平台、服务器、系统、设备及介质
KR102753024B1 (ko) * 2022-08-31 2025-01-14 (주)지비유 데이터링크스 사용자 맞춤형 인공지능 모델 제작 서비스 제공방법, 장치 및 컴퓨터프로그램
WO2024062400A1 (en) * 2022-09-21 2024-03-28 Genxt Ltd Mediation systems and methods for a federated confidential computing environment
CN117793767A (zh) * 2022-09-29 2024-03-29 华为技术有限公司 Ai模型训练中用于获取训练数据的方法以及通信装置
CN115757599A (zh) * 2022-10-28 2023-03-07 山东浪潮科学研究院有限公司 训练推理平台及方法
CN115618234A (zh) * 2022-11-03 2023-01-17 上海浦东发展银行股份有限公司 一种模型训练方法、装置、设备及存储介质
CN115618239B (zh) * 2022-12-16 2023-04-11 四川金信石信息技术有限公司 一种深度学习框架训练的管理方法、系统、终端及介质
US20240211605A1 (en) * 2022-12-22 2024-06-27 Acronis International Gmbh Automation Platform for Pentest Collaboration
CN116561244A (zh) * 2023-04-14 2023-08-08 国家计算机网络与信息安全管理中心 目标关系的识别方法及装置
CN117150025B (zh) * 2023-10-31 2024-01-26 湖南锦鳞智能科技有限公司 一种数据服务智能识别系统
US20250211584A1 (en) * 2023-12-22 2025-06-26 Capital One Services, Llc Systems and methods for authenticating network operations via dynamic selection of access tokens
WO2025174107A1 (en) * 2024-02-16 2025-08-21 Samsung Electronics Co., Ltd. System and method for dynamic machine learning model distribution

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005185560A (ja) * 2003-12-25 2005-07-14 Konica Minolta Medical & Graphic Inc 医用画像処理装置及び医用画像処理システム
US7869647B2 (en) * 2004-04-02 2011-01-11 Agilent Technologies, Inc. System and method for processing training data for a statistical application
US8438122B1 (en) * 2010-05-14 2013-05-07 Google Inc. Predictive analytic modeling platform
US8521664B1 (en) * 2010-05-14 2013-08-27 Google Inc. Predictive analytical model matching
US8229864B1 (en) * 2011-05-06 2012-07-24 Google Inc. Predictive model application programming interface
US20130110675A1 (en) 2011-10-31 2013-05-02 Microsoft Corporation Marketplace for Composite Application and Data Solutions
US9483740B1 (en) * 2012-09-06 2016-11-01 Go Daddy Operating Company, LLC Automated data classification
US9338157B1 (en) * 2013-03-15 2016-05-10 Microstrategy Incorporated Credential technology
CN103389719B (zh) * 2013-08-02 2015-07-22 临沂市拓普网络股份有限公司 基于云计算的智能家居监控系统及方法
US9489630B2 (en) * 2014-05-23 2016-11-08 DataRobot, Inc. Systems and techniques for predictive data analytics
US20160019324A1 (en) 2014-07-15 2016-01-21 WikiModel LLC Analysis and sharing of custom defined computation models and experimental data
US9946970B2 (en) * 2014-11-07 2018-04-17 Microsoft Technology Licensing, Llc Neural networks for encrypted data
EP3286711A1 (en) * 2015-04-23 2018-02-28 Rovi Guides, Inc. Systems and methods for improving accuracy in media asset recommendation models
US20180239904A1 (en) * 2015-08-12 2018-08-23 Entit Software Llc Assigning classifiers to classify security scan issues
US20180314984A1 (en) * 2015-08-12 2018-11-01 Entit Software Llc Retraining a machine classifier based on audited issue data
US20170061311A1 (en) * 2015-08-27 2017-03-02 Li Liu Method for providing data analysis service by a service provider to data owner and related data transformation method for preserving business confidential information of the data owner
US10373069B2 (en) * 2015-09-26 2019-08-06 Intel Corporation Technologies for platform-targeted machine learning
JP6116650B1 (ja) * 2015-11-17 2017-04-19 エヌ・ティ・ティ・コムウェア株式会社 学習支援システム、学習支援方法、学習支援装置、および学習支援プログラム
CN105426857B (zh) * 2015-11-25 2019-04-12 小米科技有限责任公司 人脸识别模型训练方法和装置
EP3382609A4 (en) * 2015-11-27 2018-12-05 Fujitsu Limited Risk assessment method, risk assessment program, and information processing device
US10452705B2 (en) * 2015-11-30 2019-10-22 Walmart Apollo, Llc System, method, and non-transitory computer-readable storage media for evaluating search results
CN105575389B (zh) * 2015-12-07 2019-07-30 百度在线网络技术（北京）有限公司 模型训练方法、系统和装置
US10438132B2 (en) * 2015-12-16 2019-10-08 Accenture Global Solutions Limited Machine for development and deployment of analytical models
US10671938B2 (en) * 2016-01-27 2020-06-02 Bonsai AI, Inc. Artificial intelligence engine configured to work with a pedagogical programming language to train one or more trained artificial intelligence models
CN105550374A (zh) * 2016-01-29 2016-05-04 湖南大学 Spark云服务环境下面向大数据的随机森林并行机器学习方法
EP3432227A4 (en) * 2016-03-14 2019-07-10 Omron Corporation LEARNING SERVICE PROVISION DEVICE
JP2017187850A (ja) * 2016-04-01 2017-10-12 株式会社リコー 画像処理システム、情報処理装置、プログラム
JP6151404B1 (ja) * 2016-04-26 2017-06-21 ヤフー株式会社 学習装置、学習方法および学習プログラム
EP3455743A1 (en) 2016-05-13 2019-03-20 Equals 3 LLC Searching structured and unstructured data sets
CN106204780A (zh) * 2016-07-04 2016-12-07 武汉理工大学 一种基于深度学习和云服务的人脸识别考勤系统及方法
CN106502889B (zh) * 2016-10-13 2019-09-13 华为技术有限公司 预测云软件性能的方法和装置
CN106529673B (zh) * 2016-11-17 2019-05-03 北京百度网讯科技有限公司 基于人工智能的深度学习网络训练方法及装置
CN106648994B (zh) * 2017-01-04 2020-09-11 华为技术有限公司 一种备份操作日志的方法，设备和系统
CN106856508A (zh) * 2017-02-08 2017-06-16 北京百度网讯科技有限公司 数据中心的云监控方法及云平台
CN107124276B (zh) * 2017-04-07 2020-07-28 西安电子科技大学 一种安全的数据外包机器学习数据分析方法
CN107195186A (zh) * 2017-06-07 2017-09-22 千寻位置网络有限公司 自动优化路口车辆通行速度的方法和系统
US12198014B2 (en) * 2017-07-07 2025-01-14 Sony Corporation Providing device, processing device, method for processing information, and program
WO2019061132A1 (zh) * 2017-09-28 2019-04-04 深圳清华大学研究院 混合文件系统架构、文件存储、动态迁移及其应用
WO2019097474A1 (en) * 2017-11-17 2019-05-23 Calgary Scientific Inc. Data analysis collaboration architecture and methods of use thereof
US12045693B2 (en) * 2017-11-22 2024-07-23 Amazon Technologies, Inc. Packaging and deploying algorithms for flexible machine learning
US11977958B2 (en) * 2017-11-22 2024-05-07 Amazon Technologies, Inc. Network-accessible machine learning model training and hosting system
US12277480B1 (en) * 2017-11-22 2025-04-15 Amazon Technologies, Inc. In-flight scaling of machine learning training jobs
CN113762504B (zh) 2017-11-29 2025-09-12 华为云计算技术有限公司 模型训练系统、方法和存储介质

Also Published As

Publication number Publication date
JP7222036B2 (ja) 2023-02-14
JP2022000757A (ja) 2022-01-04
CN109840591A (zh) 2019-06-04
EP3709226A1 (en) 2020-09-16
CN109840591B (zh) 2021-08-03
AU2018374912B2 (en) 2023-10-19
EP3709226A4 (en) 2021-01-06
CA3091405A1 (en) 2019-06-06
AU2018374912A1 (en) 2020-06-18
KR20200093007A (ko) 2020-08-04
WO2019105189A1 (zh) 2019-06-06
JP7144117B2 (ja) 2022-09-29
US20250088556A1 (en) 2025-03-13
US12184725B2 (en) 2024-12-31
CN113762504A (zh) 2021-12-07
JP2021504832A (ja) 2021-02-15
KR102514325B1 (ko) 2023-03-24
US20200285978A1 (en) 2020-09-10

Similar Documents

Publication Publication Date Title
CN113762504B (zh) 模型训练系统、方法和存储介质
JP2022000757A5 (https=)
US7454421B2 (en) Database access control method, database access controller, agent processing server, database access control program, and medium recording the program
CN103078859B (zh) 业务系统权限管理方法、设备及系统
CN101251881B (zh) 一种内容识别的方法、系统和装置
US10476733B2 (en) Single sign-on system and single sign-on method
CN104506487A (zh) 云环境下隐私策略的可信执行方法
US20210120002A1 (en) Authorization apparatus, data server and communication system
US20230071489A1 (en) Method of and system for providing access to access restricted content to a user
US9665732B2 (en) Secure Download from internet marketplace
CN115203670A (zh) 业务访问处理方法、装置、计算机可读介质及电子设备
CN111767524B (zh) 权限管理方法、装置、系统、服务器及介质
US20090217049A1 (en) Method for linking a digital content to a person
CN109740308B (zh) 一种服务器端版本的保护方法及系统
CN121077793A (zh) 水平鉴权控制方法及装置
CN118626203A (zh) 一种区块链虚拟资源的处理方法及其装置、存储介质
CN120729495A (zh) 一种基于区块链的能源数据共享方法、设备及介质
CN120295972A (zh) 文件系统多租方法、系统、引擎、设备、介质和程序产品
CN121567439A (zh) 越权检测方法及装置
CN118250049A (zh) 一种物联网授权系统、方法、装置、电子设备及存储介质
AU2019271954A1 (en) A method of and system for providing access to access restricted content to a user
JP2002351836A (ja) 固有データ発行装置および方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220302

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Applicant after: Huawei Cloud Computing Technologies Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd.

GR01 Patent grant
GR01 Patent grant