SG11202100975PA - Determining suitability of machine learning models for datasets - Google Patents

Determining suitability of machine learning models for datasets

Info

Publication number
SG11202100975PA
SG11202100975PA SG11202100975PA SG11202100975PA SG11202100975PA SG 11202100975P A SG11202100975P A SG 11202100975PA SG 11202100975P A SG11202100975P A SG 11202100975PA SG 11202100975P A SG11202100975P A SG 11202100975PA SG 11202100975P A SG11202100975P A SG 11202100975PA
Authority
SG
Singapore
Prior art keywords
datasets
machine learning
learning models
determining suitability
suitability
Prior art date
Application number
SG11202100975PA
Inventor
Sindhu Ghanta
Drew Roselli
Nisha Talagala
Vinay Sridhar
Swaminathan Sundararaman
Lior Amar
Lior Khermosh
Bharath Ramsundar
Sriram Subramanian
Original Assignee
Datarobot Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Datarobot Inc filed Critical Datarobot Inc
Publication of SG11202100975PA publication Critical patent/SG11202100975PA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/98—Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Computational Linguistics (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Medical Informatics (AREA)
  • Algebra (AREA)
  • Operations Research (AREA)
  • Probability & Statistics with Applications (AREA)
  • Databases & Information Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Debugging And Monitoring (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
SG11202100975PA 2018-07-30 2019-07-30 Determining suitability of machine learning models for datasets SG11202100975PA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/049,647 US20200034665A1 (en) 2018-07-30 2018-07-30 Determining validity of machine learning algorithms for datasets
PCT/US2019/044250 WO2020028440A1 (en) 2018-07-30 2019-07-30 Determining suitability of machine learning models for datasets

Publications (1)

Publication Number Publication Date
SG11202100975PA true SG11202100975PA (en) 2021-02-25

Family

ID=67614662

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202100975PA SG11202100975PA (en) 2018-07-30 2019-07-30 Determining suitability of machine learning models for datasets

Country Status (7)

Country Link
US (2) US20200034665A1 (en)
EP (1) EP3830765A1 (en)
JP (1) JP7486472B2 (en)
KR (1) KR20210032521A (en)
AU (1) AU2019312568A1 (en)
SG (1) SG11202100975PA (en)
WO (1) WO2020028440A1 (en)

Families Citing this family (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018176000A1 (en) 2017-03-23 2018-09-27 DeepScale, Inc. Data synthesis for autonomous control systems
US10671349B2 (en) 2017-07-24 2020-06-02 Tesla, Inc. Accelerated mathematical engine
US11157441B2 (en) 2017-07-24 2021-10-26 Tesla, Inc. Computational array microprocessor system using non-consecutive data formatting
US11409692B2 (en) 2017-07-24 2022-08-09 Tesla, Inc. Vector computational unit
US11893393B2 (en) 2017-07-24 2024-02-06 Tesla, Inc. Computational array microprocessor system with hardware arbiter managing memory requests
US11561791B2 (en) 2018-02-01 2023-01-24 Tesla, Inc. Vector computational unit receiving data elements in parallel from a last row of a computational array
US11215999B2 (en) 2018-06-20 2022-01-04 Tesla, Inc. Data pipeline and deep learning system for autonomous driving
US11361457B2 (en) 2018-07-20 2022-06-14 Tesla, Inc. Annotation cross-labeling for autonomous control systems
US11636333B2 (en) 2018-07-26 2023-04-25 Tesla, Inc. Optimizing neural network structures for embedded systems
US11562231B2 (en) 2018-09-03 2023-01-24 Tesla, Inc. Neural networks for embedded devices
WO2020077117A1 (en) 2018-10-11 2020-04-16 Tesla, Inc. Systems and methods for training machine models with augmented data
US11196678B2 (en) 2018-10-25 2021-12-07 Tesla, Inc. QOS manager for system on a chip communications
US11816585B2 (en) 2018-12-03 2023-11-14 Tesla, Inc. Machine learning models operating at different frequencies for autonomous vehicles
US11537811B2 (en) 2018-12-04 2022-12-27 Tesla, Inc. Enhanced object detection for autonomous vehicles based on field view
US11610117B2 (en) 2018-12-27 2023-03-21 Tesla, Inc. System and method for adapting a neural network model on a hardware platform
US11625641B2 (en) * 2018-12-28 2023-04-11 Esurance Insurance Services, Inc. Machine learning based function testing
KR102544265B1 (en) * 2019-01-09 2023-06-16 삼성전자주식회사 Electronic device and control method thereof
US10997461B2 (en) 2019-02-01 2021-05-04 Tesla, Inc. Generating ground truth for machine learning from time series elements
US11150664B2 (en) 2019-02-01 2021-10-19 Tesla, Inc. Predicting three-dimensional features for autonomous driving
US11567514B2 (en) 2019-02-11 2023-01-31 Tesla, Inc. Autonomous and user controlled vehicle summon to a target
US10956755B2 (en) 2019-02-19 2021-03-23 Tesla, Inc. Estimating object properties using visual image data
US11562176B2 (en) * 2019-02-22 2023-01-24 Cisco Technology, Inc. IoT fog as distributed machine learning structure search platform
US20220191107A1 (en) * 2019-02-26 2022-06-16 Telefonaktiebolaget Lm Ericsson (Publ) Method and devices for transfer learning for inductive tasks in radio access network
US11605025B2 (en) * 2019-05-14 2023-03-14 Msd International Gmbh Automated quality check and diagnosis for production model refresh
US11507869B2 (en) * 2019-05-24 2022-11-22 Digital Lion, LLC Predictive modeling and analytics for processing and distributing data traffic
US11934971B2 (en) * 2019-05-24 2024-03-19 Digital Lion, LLC Systems and methods for automatically building a machine learning model
US11468361B2 (en) * 2019-05-24 2022-10-11 Bank Of America Corporation Real-time convergence analysis of machine learning population output in rapid changing and adversarial environments
US20200387836A1 (en) * 2019-06-04 2020-12-10 Accenture Global Solutions Limited Machine learning model surety
EP3764179A1 (en) * 2019-07-08 2021-01-13 ABB Schweiz AG Assessing conditions of instustrial equipment and processes
US11983609B2 (en) * 2019-07-10 2024-05-14 Sony Interactive Entertainment LLC Dual machine learning pipelines for transforming data and optimizing data transformation
US20210018205A1 (en) * 2019-07-16 2021-01-21 Johnson Controls Technology Company Systems and methods for automated system identification
US11774122B2 (en) 2019-07-16 2023-10-03 Johnson Controls Tyco IP Holdings LLP Building control system with adaptive online system identification
US11521019B2 (en) * 2019-08-06 2022-12-06 Bank Of America Corporation Systems and methods for incremental learning and autonomous model reconfiguration in regulated AI systems
US11829871B2 (en) * 2019-08-20 2023-11-28 Lg Electronics Inc. Validating performance of a neural network trained using labeled training data
US11281975B1 (en) * 2019-09-24 2022-03-22 PerceptiLabs AB Creating and modifying machine learning models in a model training engine
US12039415B2 (en) 2019-09-30 2024-07-16 Amazon Technologies, Inc. Debugging and profiling of machine learning model training
US11449798B2 (en) * 2019-09-30 2022-09-20 Amazon Technologies, Inc. Automated problem detection for machine learning models
US11468365B2 (en) 2019-09-30 2022-10-11 Amazon Technologies, Inc. GPU code injection to summarize machine learning training data
FI20195894A1 (en) * 2019-10-16 2021-04-17 Kemira Oyj A method and system for monitoring a process
EP3809341A1 (en) * 2019-10-18 2021-04-21 Fujitsu Limited Inference verification of machine learning algorithms
TWI732370B (en) * 2019-12-04 2021-07-01 財團法人工業技術研究院 Training device and training method for neural network model
JP2021092998A (en) * 2019-12-11 2021-06-17 セイコーエプソン株式会社 Search method, and computer program
US11625558B2 (en) * 2019-12-13 2023-04-11 Microsoft Technology Licensing, Llc Punctuation controlled machine learning model temporal validity
US12106198B2 (en) * 2020-01-21 2024-10-01 Accenture Global Solutions Limited Machine learning model robustness against adversarial attacks in production
US11636387B2 (en) * 2020-01-27 2023-04-25 Microsoft Technology Licensing, Llc System and method for improving machine learning models based on confusion error evaluation
US11972361B2 (en) * 2020-01-29 2024-04-30 Samsung Electronics Co., Ltd. Performance optimization of object grouping schema in a network key-value storage device using adaptive regression
US12067463B2 (en) * 2020-02-18 2024-08-20 Mind Foundry Ltd Machine learning platform
US11514364B2 (en) 2020-02-19 2022-11-29 Microsoft Technology Licensing, Llc Iterative vectoring for constructing data driven machine learning models
US11636389B2 (en) 2020-02-19 2023-04-25 Microsoft Technology Licensing, Llc System and method for improving machine learning models by detecting and removing inaccurate training data
CN111340287A (en) * 2020-02-24 2020-06-26 清华大学 Power distribution cabinet operation state prediction method and device
US20230088561A1 (en) * 2020-03-02 2023-03-23 Telefonaktiebolaget Lm Ericsson (Publ) Synthetic data generation in federated learning systems
US11238772B2 (en) * 2020-03-18 2022-02-01 Qualcomm Incorporated Methods and apparatus for compositor learning models
US11734614B1 (en) * 2020-03-26 2023-08-22 Amazon Technologies, Inc. Training service for an aggregated machine learning model
CN111488995B (en) * 2020-04-08 2021-12-24 北京字节跳动网络技术有限公司 Method, device and system for evaluating joint training model
JP7487556B2 (en) * 2020-05-22 2024-05-21 富士通株式会社 MODEL GENERATION PROGRAM, MODEL GENERATION DEVICE, AND MODEL GENERATION METHOD
EP3916496A1 (en) * 2020-05-29 2021-12-01 ABB Schweiz AG An industrial process model generation system
US11586919B2 (en) 2020-06-12 2023-02-21 International Business Machines Corporation Task-oriented machine learning and a configurable tool thereof on a computing environment
US11748638B2 (en) * 2020-07-22 2023-09-05 International Business Machines Corporation Machine learning model monitoring
US20220036200A1 (en) * 2020-07-28 2022-02-03 International Business Machines Corporation Rules and machine learning to provide regulatory complied fraud detection systems
US20220076144A1 (en) * 2020-09-09 2022-03-10 International Business Machines Corporation Machine learning with multiple constraints
US11481685B2 (en) * 2020-11-11 2022-10-25 T-Mobile Usa, Inc. Machine-learning model for determining post-visit phone call propensity
EP4016222B1 (en) * 2020-12-18 2024-09-04 Honeywell International Inc. Monitoring the remaining useful lifetime of an asset
CN112668180B (en) * 2020-12-28 2024-06-11 中国科学院上海微系统与信息技术研究所 Online learning prediction chip and method by using memory to replace calculation
KR20220097313A (en) 2020-12-31 2022-07-07 (주)제이엘케이 Container based AutoML method, device and program using API
WO2022208401A1 (en) * 2021-03-30 2022-10-06 Visa International Service Association System, method, and computer program product to compare machine learning models
US11693570B2 (en) * 2021-04-29 2023-07-04 EMC IP Holding Company LLC Machine learning to improve caching efficiency in a storage system
CN113361625A (en) * 2021-06-23 2021-09-07 中国科学技术大学 Error data detection method with privacy protection in federated learning scene
US20220414532A1 (en) * 2021-06-28 2022-12-29 Bank Of America Corporation Machine learning model scenario-based training system
CN113435516B (en) * 2021-06-29 2024-02-06 京东科技控股股份有限公司 Data classification method and device
CN113435653B (en) * 2021-07-02 2022-11-04 国网新疆电力有限公司经济技术研究院 Method and system for predicting saturated power consumption based on logistic model
KR20230012809A (en) * 2021-07-16 2023-01-26 연세대학교 산학협력단 Multitask Distributed Learning System and Method Based on Lottery Ticket Neural Network
US20230032912A1 (en) * 2021-08-02 2023-02-02 International Business Machines Corporation Automatically detecting outliers in federated data
CN117730317A (en) * 2021-08-04 2024-03-19 高通股份有限公司 Machine learning group switching
CN117882086A (en) * 2021-08-05 2024-04-12 交互数字Ce专利控股有限公司 Methods, architecture, apparatus and systems for continuous evaluation, training and deployment of AI/ML models
JPWO2023013024A1 (en) * 2021-08-06 2023-02-09
US11489743B1 (en) * 2021-09-17 2022-11-01 Arista Networks, Inc. Anomaly detection for multivariate metrics in networks
CN114095503A (en) * 2021-10-19 2022-02-25 广西综合交通大数据研究院 Block chain-based federated learning participation node selection method
KR102402314B1 (en) * 2021-12-02 2022-05-25 세종대학교산학협력단 Federated learning method for edge network
KR102681777B1 (en) * 2022-01-25 2024-07-05 주식회사 디섹 System And Method For Estimation Of HVAC Capacity For Ship Using AI Algorithm
CN114707720B (en) * 2022-03-30 2024-07-02 中国民航大学 Longitudinal federal learning-based flight delay prediction method and system
CN114997325B (en) * 2022-06-20 2024-04-26 上海电器科学研究所（集团）有限公司 Deep learning algorithm management system based on network cooperation
CN115204387B (en) * 2022-07-21 2023-10-03 法奥意威(苏州)机器人系统有限公司 Learning method and device under layered target condition and electronic equipment
WO2024064022A1 (en) * 2022-09-22 2024-03-28 Apple Inc. Trustworthy level control of ai/ml models trained in wireless networks
WO2024076253A1 (en) * 2022-10-06 2024-04-11 Публичное Акционерное Общество "Сбербанк России" Method and system for managing model risk
WO2024145710A1 (en) * 2023-01-03 2024-07-11 Squint AI Inc. Systems and methods for evaluating machine-learning models and predictions
WO2024157418A1 (en) * 2023-01-26 2024-08-02 日本電気株式会社 Model evaluation device, model evaluation method, and program
WO2024190135A1 (en) * 2023-03-13 2024-09-19 コニカミノルタ株式会社 Model management method, model management system, and program
CN116523136B (en) * 2023-05-05 2024-09-20 中国自然资源航空物探遥感中心 Mineral resource space intelligent prediction method and device based on multi-model integrated learning
KR102664201B1 (en) * 2023-08-23 2024-05-08 국방과학연구소 Apparatus and method for verifying learning data based on virtual data

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3214876B2 (en) * 1991-09-19 2001-10-02 株式会社日立製作所 Neural network configuration method and neural network construction support system
JP6444494B2 (en) 2014-05-23 2018-12-26 データロボット， インコーポレイテッド Systems and techniques for predictive data analysis
US10614056B2 (en) * 2015-03-24 2020-04-07 NetSuite Inc. System and method for automated detection of incorrect data
US20160358099A1 (en) * 2015-06-04 2016-12-08 The Boeing Company Advanced analytical infrastructure for machine learning
JP6758406B2 (en) 2016-04-13 2020-09-23 グーグル エルエルシー Wide and deep machine learning model
JP6703264B2 (en) 2016-06-22 2020-06-03 富士通株式会社 Machine learning management program, machine learning management method, and machine learning management device

Also Published As

Publication number Publication date
JP2021532488A (en) 2021-11-25
US20200034665A1 (en) 2020-01-30
JP7486472B2 (en) 2024-05-17
WO2020028440A1 (en) 2020-02-06
EP3830765A1 (en) 2021-06-09
US20230196101A1 (en) 2023-06-22
AU2019312568A1 (en) 2021-03-04
KR20210032521A (en) 2021-03-24

Similar Documents

Publication Publication Date Title
SG11202100975PA (en) Determining suitability of machine learning models for datasets
SG11202011918WA (en) Detecting suitability of machine learning models for datasets
SG11202009597XA (en) Evolved machine learning models
SG11202106315QA (en) Explainability-based adjustment of machine learning models
EP3602420A4 (en) Embedded predictive machine learning models
IL283463A (en) Automated generation of machine learning models
EP3895082A4 (en) Distributed training of machine learning models for personalization
PL3396547T3 (en) Compute optimizations for low precision machine learning operations
GB2609854B (en) Stem Cell-Based Lung-On-Chip Models
HK1251689A1 (en) Dynamic execution of predictive models
EP3510363C0 (en) Method for distributed acoustic sensing
SG10201609588PA (en) Machine For Development Of Analytical Models
GB201609977D0 (en) Chemosensitivity predictive biomarkers
EP3895103A4 (en) Framework for generating risk evaluation models
GB2548555B (en) A method of redatuming geophysical data
EP3426466A4 (en) Predicting quality of a 3d object part
EP3711176A4 (en) Determining a tpmi for a codebook set
GB201810944D0 (en) Machine learning
GB201702825D0 (en) A method for determining well depth
GB201720360D0 (en) Method of determining the boundary of a driveable space
BR112017000179A2 (en) analysis of displacement parts for selection of candidate lines for seismic surveys.
GB201903172D0 (en) Methods of deploying machine learning models
GB201814807D0 (en) Dementia Biomarkers
GB201515070D0 (en) Method for determining affinity of a biomolecule
NO20151370A1 (en) Sensor node for point measurement on the seabed during seismic surveys