CN113762504B - 模型训练系统、方法和存储介质 - Google Patents

模型训练系统、方法和存储介质

Info

Publication number
CN113762504B
CN113762504B CN202110850132.3A CN202110850132A CN113762504B CN 113762504 B CN113762504 B CN 113762504B CN 202110850132 A CN202110850132 A CN 202110850132A CN 113762504 B CN113762504 B CN 113762504B
Authority
CN
China
Prior art keywords
data
training
model
platform
cloud
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110850132.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN113762504A (zh
Inventor
陈普
廖乔勃
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Huawei Cloud Computing Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd, Huawei Cloud Computing Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202110850132.3A priority Critical patent/CN113762504B/zh
Publication of CN113762504A publication Critical patent/CN113762504A/zh
Application granted granted Critical
Publication of CN113762504B publication Critical patent/CN113762504B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9017—Indexing; Data structures therefor; Storage structures using directory or table look-up
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9032—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9038—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
    • G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0807—Network architectures or network communication protocols for network security for authentication of entities using tickets, e.g. Kerberos
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0884—Network architectures or network communication protocols for network security for authentication of entities by delegation of authentication, e.g. a proxy authenticates an entity to be authenticated on behalf of this entity vis-à-vis an authentication entity

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mathematical Physics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioethics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storage Device Security (AREA)
CN202110850132.3A 2017-11-29 2017-11-29 模型训练系统、方法和存储介质 Active CN113762504B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110850132.3A CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110850132.3A CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质
CN201711227185.XA CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201711227185.XA Division CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Publications (2)

Publication Number Publication Date
CN113762504A CN113762504A (zh) 2021-12-07
CN113762504B true CN113762504B (zh) 2025-09-12

Family

ID=66663796

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110850132.3A Active CN113762504B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质
CN201711227185.XA Active CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201711227185.XA Active CN109840591B (zh) 2017-11-29 2017-11-29 模型训练系统、方法和存储介质

Country Status (8)

Country Link
US (2) US12184725B2 (https=)
EP (1) EP3709226A4 (https=)
JP (2) JP7144117B2 (https=)
KR (1) KR102514325B1 (https=)
CN (2) CN113762504B (https=)
AU (1) AU2018374912B2 (https=)
CA (1) CA3091405A1 (https=)
WO (1) WO2019105189A1 (https=)

Families Citing this family (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113762504B (zh) 2017-11-29 2025-09-12 华为云计算技术有限公司 模型训练系统、方法和存储介质
JP2019136429A (ja) * 2018-02-15 2019-08-22 株式会社三洋物産 遊技機
JP2019136431A (ja) * 2018-02-15 2019-08-22 株式会社三洋物産 遊技機
US10979416B2 (en) * 2018-03-26 2021-04-13 Nicira, Inc. System and method for authentication in a public cloud
KR102074353B1 (ko) * 2018-04-13 2020-02-06 한국전자통신연구원 제어시스템 분야의 실시간 사이버 보안 훈련 제공 장치 및 방법
CN112149139B (zh) * 2019-06-28 2024-08-09 杭州海康威视数字技术股份有限公司 权限管理方法及装置
CN112148205A (zh) * 2019-06-28 2020-12-29 杭州海康威视数字技术股份有限公司 数据管理方法及装置
CN111147603A (zh) * 2019-09-30 2020-05-12 华为技术有限公司 一种推理服务网络化的方法及装置
CN111092935B (zh) * 2019-11-27 2022-07-12 中国联合网络通信集团有限公司 一种用于机器学习的数据共享方法和虚拟训练装置
CN111064797B (zh) * 2019-12-20 2023-01-10 深圳前海微众银行股份有限公司 一种数据处理方法及装置
CN113128528A (zh) * 2019-12-27 2021-07-16 无锡祥生医疗科技股份有限公司 超声影像深度学习分布式训练系统和训练方法
CN112668016B (zh) * 2020-01-02 2023-12-08 华控清交信息科技(北京)有限公司 一种模型训练方法、装置和电子设备
CN113128686A (zh) * 2020-01-16 2021-07-16 华为技术有限公司 模型训练方法及装置
CN113554450B (zh) * 2020-04-24 2024-08-30 阿里巴巴集团控股有限公司 数据模型训练及数据处理方法、装置、设备及存储介质
JP7529800B2 (ja) * 2020-04-30 2024-08-06 華為技術有限公司 データラベリングシステムおよび方法、ならびにデータラベリングマネージャ
CN113762292B (zh) * 2020-06-03 2024-02-02 杭州海康威视数字技术股份有限公司 一种训练数据获取方法、装置及模型训练方法、装置
US11461292B2 (en) * 2020-07-01 2022-10-04 International Business Machines Corporation Quick data exploration
US11847544B2 (en) 2020-07-21 2023-12-19 International Business Machines Corporation Preventing data leakage in automated machine learning
CN112085208B (zh) * 2020-07-30 2024-08-20 北京聚云科技有限公司 一种利用云端进行模型训练的方法及装置
CN112102263A (zh) * 2020-08-31 2020-12-18 深圳思谋信息科技有限公司 缺陷检测模型生成系统、方法、装置和计算机设备
CN114358302A (zh) * 2020-10-14 2022-04-15 华为云计算技术有限公司 一种人工智能ai训练的方法、系统及设备
WO2022131663A1 (en) * 2020-12-18 2022-06-23 Samsung Electronics Co., Ltd. Method for preventing data leakage to machine learning engines available in electronic device
EP4200736A4 (en) 2020-12-18 2024-01-24 Samsung Electronics Co., Ltd. METHOD FOR PREVENTING DATA LEAKS ON MACHINE LEARNING MOTORS AVAILABLE IN AN ELECTRONIC DEVICE
CN114254766B (zh) * 2021-12-10 2024-07-05 智己汽车科技有限公司 一种车云两端联合训练机器学习模型的方法及系统
WO2023151829A1 (en) * 2022-02-14 2023-08-17 Telefonaktiebolaget Lm Ericsson (Publ) Blockchain-enabled trusted data layer for artificial intelligence (ai) applications
CN114896056A (zh) * 2022-04-18 2022-08-12 浙江安存云链数据技术有限公司 数据应用方法、装置、存储介质及电子设备
CN115114288B (zh) * 2022-06-23 2025-07-11 北京奇艺世纪科技有限公司 数据检索方法、平台、服务器、系统、设备及介质
KR102753024B1 (ko) * 2022-08-31 2025-01-14 (주)지비유 데이터링크스 사용자 맞춤형 인공지능 모델 제작 서비스 제공방법, 장치 및 컴퓨터프로그램
WO2024062400A1 (en) * 2022-09-21 2024-03-28 Genxt Ltd Mediation systems and methods for a federated confidential computing environment
CN117793767A (zh) * 2022-09-29 2024-03-29 华为技术有限公司 Ai模型训练中用于获取训练数据的方法以及通信装置
CN115757599A (zh) * 2022-10-28 2023-03-07 山东浪潮科学研究院有限公司 训练推理平台及方法
CN115618234A (zh) * 2022-11-03 2023-01-17 上海浦东发展银行股份有限公司 一种模型训练方法、装置、设备及存储介质
CN115618239B (zh) * 2022-12-16 2023-04-11 四川金信石信息技术有限公司 一种深度学习框架训练的管理方法、系统、终端及介质
US20240211605A1 (en) * 2022-12-22 2024-06-27 Acronis International Gmbh Automation Platform for Pentest Collaboration
CN116561244A (zh) * 2023-04-14 2023-08-08 国家计算机网络与信息安全管理中心 目标关系的识别方法及装置
CN117150025B (zh) * 2023-10-31 2024-01-26 湖南锦鳞智能科技有限公司 一种数据服务智能识别系统
US20250211584A1 (en) * 2023-12-22 2025-06-26 Capital One Services, Llc Systems and methods for authenticating network operations via dynamic selection of access tokens
WO2025174107A1 (en) * 2024-02-16 2025-08-21 Samsung Electronics Co., Ltd. System and method for dynamic machine learning model distribution

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005185560A (ja) * 2003-12-25 2005-07-14 Konica Minolta Medical & Graphic Inc 医用画像処理装置及び医用画像処理システム
US7869647B2 (en) * 2004-04-02 2011-01-11 Agilent Technologies, Inc. System and method for processing training data for a statistical application
US8521664B1 (en) * 2010-05-14 2013-08-27 Google Inc. Predictive analytical model matching
US8438122B1 (en) * 2010-05-14 2013-05-07 Google Inc. Predictive analytic modeling platform
US8229864B1 (en) * 2011-05-06 2012-07-24 Google Inc. Predictive model application programming interface
US20130110675A1 (en) 2011-10-31 2013-05-02 Microsoft Corporation Marketplace for Composite Application and Data Solutions
US9483740B1 (en) * 2012-09-06 2016-11-01 Go Daddy Operating Company, LLC Automated data classification
US9338157B1 (en) * 2013-03-15 2016-05-10 Microstrategy Incorporated Credential technology
CN103389719B (zh) * 2013-08-02 2015-07-22 临沂市拓普网络股份有限公司 基于云计算的智能家居监控系统及方法
JP6444494B2 (ja) * 2014-05-23 2018-12-26 データロボット， インコーポレイテッド 予測データ分析のためのシステムおよび技術
US20160019324A1 (en) 2014-07-15 2016-01-21 WikiModel LLC Analysis and sharing of custom defined computation models and experimental data
US9946970B2 (en) * 2014-11-07 2018-04-17 Microsoft Technology Licensing, Llc Neural networks for encrypted data
CA2954133A1 (en) * 2015-04-23 2016-10-27 Rovi Guides, Inc. Systems and methods for improving accuracy in media asset recommendation models
US20180314984A1 (en) * 2015-08-12 2018-11-01 Entit Software Llc Retraining a machine classifier based on audited issue data
US20180239904A1 (en) * 2015-08-12 2018-08-23 Entit Software Llc Assigning classifiers to classify security scan issues
US20170061311A1 (en) * 2015-08-27 2017-03-02 Li Liu Method for providing data analysis service by a service provider to data owner and related data transformation method for preserving business confidential information of the data owner
US10373069B2 (en) * 2015-09-26 2019-08-06 Intel Corporation Technologies for platform-targeted machine learning
JP6116650B1 (ja) * 2015-11-17 2017-04-19 エヌ・ティ・ティ・コムウェア株式会社 学習支援システム、学習支援方法、学習支援装置、および学習支援プログラム
CN105426857B (zh) * 2015-11-25 2019-04-12 小米科技有限责任公司 人脸识别模型训练方法和装置
EP3382609A4 (en) * 2015-11-27 2018-12-05 Fujitsu Limited Risk assessment method, risk assessment program, and information processing device
US10452705B2 (en) * 2015-11-30 2019-10-22 Walmart Apollo, Llc System, method, and non-transitory computer-readable storage media for evaluating search results
CN105575389B (zh) * 2015-12-07 2019-07-30 百度在线网络技术（北京）有限公司 模型训练方法、系统和装置
US10438132B2 (en) * 2015-12-16 2019-10-08 Accenture Global Solutions Limited Machine for development and deployment of analytical models
US10733531B2 (en) * 2016-01-27 2020-08-04 Bonsai AI, Inc. Artificial intelligence engine having an architect module
CN105550374A (zh) * 2016-01-29 2016-05-04 湖南大学 Spark云服务环境下面向大数据的随机森林并行机器学习方法
CN108701265A (zh) * 2016-03-14 2018-10-23 欧姆龙株式会社 学习服务提供装置
JP2017187850A (ja) * 2016-04-01 2017-10-12 株式会社リコー 画像処理システム、情報処理装置、プログラム
JP6151404B1 (ja) * 2016-04-26 2017-06-21 ヤフー株式会社 学習装置、学習方法および学習プログラム
EP3809283A1 (en) 2016-05-13 2021-04-21 Equals 3 LLC Searching structured and unstructured data sets
CN106204780A (zh) * 2016-07-04 2016-12-07 武汉理工大学 一种基于深度学习和云服务的人脸识别考勤系统及方法
CN106502889B (zh) * 2016-10-13 2019-09-13 华为技术有限公司 预测云软件性能的方法和装置
CN106529673B (zh) * 2016-11-17 2019-05-03 北京百度网讯科技有限公司 基于人工智能的深度学习网络训练方法及装置
CN106648994B (zh) * 2017-01-04 2020-09-11 华为技术有限公司 一种备份操作日志的方法，设备和系统
CN106856508A (zh) * 2017-02-08 2017-06-16 北京百度网讯科技有限公司 数据中心的云监控方法及云平台
CN107124276B (zh) * 2017-04-07 2020-07-28 西安电子科技大学 一种安全的数据外包机器学习数据分析方法
CN107195186A (zh) * 2017-06-07 2017-09-22 千寻位置网络有限公司 自动优化路口车辆通行速度的方法和系统
WO2019008853A1 (ja) * 2017-07-07 2019-01-10 ソニー株式会社 提供装置、処理装置、情報処理方法、およびプログラム
WO2019061132A1 (zh) * 2017-09-28 2019-04-04 深圳清华大学研究院 混合文件系统架构、文件存储、动态迁移及其应用
EP3710959A4 (en) * 2017-11-17 2021-07-28 Calgary Scientific Inc. DATA ANALYSIS COLLABORATIVE ARCHITECTURE AND METHODS FOR USING THE SAME
US12277480B1 (en) * 2017-11-22 2025-04-15 Amazon Technologies, Inc. In-flight scaling of machine learning training jobs
US11977958B2 (en) * 2017-11-22 2024-05-07 Amazon Technologies, Inc. Network-accessible machine learning model training and hosting system
US12045693B2 (en) * 2017-11-22 2024-07-23 Amazon Technologies, Inc. Packaging and deploying algorithms for flexible machine learning
CN113762504B (zh) 2017-11-29 2025-09-12 华为云计算技术有限公司 模型训练系统、方法和存储介质

Also Published As

Publication number Publication date
KR102514325B1 (ko) 2023-03-24
US20250088556A1 (en) 2025-03-13
EP3709226A1 (en) 2020-09-16
CA3091405A1 (en) 2019-06-06
KR20200093007A (ko) 2020-08-04
EP3709226A4 (en) 2021-01-06
JP2022000757A (ja) 2022-01-04
JP7222036B2 (ja) 2023-02-14
CN113762504A (zh) 2021-12-07
AU2018374912B2 (en) 2023-10-19
CN109840591A (zh) 2019-06-04
CN109840591B (zh) 2021-08-03
WO2019105189A1 (zh) 2019-06-06
JP2021504832A (ja) 2021-02-15
JP7144117B2 (ja) 2022-09-29
US12184725B2 (en) 2024-12-31
US20200285978A1 (en) 2020-09-10
AU2018374912A1 (en) 2020-06-18

Similar Documents

Publication Publication Date Title
CN113762504B (zh) 模型训练系统、方法和存储介质
JP2022000757A5 (https=)
US7454421B2 (en) Database access control method, database access controller, agent processing server, database access control program, and medium recording the program
US20220329446A1 (en) Enhanced asset management using an electronic ledger
CN103078859B (zh) 业务系统权限管理方法、设备及系统
CN101251881B (zh) 一种内容识别的方法、系统和装置
US10476733B2 (en) Single sign-on system and single sign-on method
CN104506487A (zh) 云环境下隐私策略的可信执行方法
US20230071489A1 (en) Method of and system for providing access to access restricted content to a user
CN116232655B (zh) 一种基于物联网云平台的组态应用权限管理方法以及系统
CN111767524B (zh) 权限管理方法、装置、系统、服务器及介质
US20090217049A1 (en) Method for linking a digital content to a person
CN109740308B (zh) 一种服务器端版本的保护方法及系统
CN121077793A (zh) 水平鉴权控制方法及装置
CN118626203A (zh) 一种区块链虚拟资源的处理方法及其装置、存储介质
CN120729495A (zh) 一种基于区块链的能源数据共享方法、设备及介质
CN120295972A (zh) 文件系统多租方法、系统、引擎、设备、介质和程序产品
CN121567439A (zh) 越权检测方法及装置
CN118250049A (zh) 一种物联网授权系统、方法、装置、电子设备及存储介质
AU2019271954A1 (en) A method of and system for providing access to access restricted content to a user
JP2002351836A (ja) 固有データ発行装置および方法

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220302

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Applicant after: Huawei Cloud Computing Technologies Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd.

GR01 Patent grant
GR01 Patent grant