JP7245961B2 - 対話型機械学習 - Google Patents

対話型機械学習 Download PDF

Info

Publication number
JP7245961B2
JP7245961B2 JP2022521962A JP2022521962A JP7245961B2 JP 7245961 B2 JP7245961 B2 JP 7245961B2 JP 2022521962 A JP2022521962 A JP 2022521962A JP 2022521962 A JP2022521962 A JP 2022521962A JP 7245961 B2 JP7245961 B2 JP 7245961B2
Authority
JP
Japan
Prior art keywords
machine learning
learning module
user
prediction
user interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022521962A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022548333A (ja
Inventor
－ クロール、シャンタール ビッソン
リン、ジェン
アムレカール、アイシャン
シェン、ケビン
ノウラシャラフェディン、セイエナセル
オーレット、セバスチャン
Original Assignee
キナクシス インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/697,620 external-priority patent/US12154013B2/en
Application filed by キナクシス インコーポレイテッド filed Critical キナクシス インコーポレイテッド
Publication of JP2022548333A publication Critical patent/JP2022548333A/ja
Priority to JP2023007474A priority Critical patent/JP7624465B2/ja
Application granted granted Critical
Publication of JP7245961B2 publication Critical patent/JP7245961B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217—Validation; Performance evaluation; Active pattern learning techniques
    • G06F18/2178—Validation; Performance evaluation; Active pattern learning techniques based on feedback of a supervisor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/40—Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • G06F18/41—Interactive pattern learning with a human teacher
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0499—Feedforward networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/091—Active learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G06N3/105—Shells for specifying net layout
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/23—Clustering techniques
    • G06F18/232—Non-hierarchical techniques
    • G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Medical Informatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Machine Translation (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2022521962A 2019-10-15 2020-10-15 対話型機械学習 Active JP7245961B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2023007474A JP7624465B2 (ja) 2019-10-15 2023-01-20 対話型機械学習

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201962915076P 2019-10-15 2019-10-15
US62/915,076 2019-10-15
US16/697,620 2019-11-27
US16/697,620 US12154013B2 (en) 2019-10-15 2019-11-27 Interactive machine learning
US16/699,010 2019-11-28
US16/699,010 US12242954B2 (en) 2019-10-15 2019-11-28 Interactive machine learning
PCT/CA2020/051379 WO2021072537A1 (en) 2019-10-15 2020-10-15 Interactive machine learning

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2023007474A Division JP7624465B2 (ja) 2019-10-15 2023-01-20 対話型機械学習

Publications (2)

Publication Number Publication Date
JP2022548333A JP2022548333A (ja) 2022-11-17
JP7245961B2 true JP7245961B2 (ja) 2023-03-24

Family

ID=75382129

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022521962A Active JP7245961B2 (ja) 2019-10-15 2020-10-15 対話型機械学習
JP2023007474A Active JP7624465B2 (ja) 2019-10-15 2023-01-20 対話型機械学習

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2023007474A Active JP7624465B2 (ja) 2019-10-15 2023-01-20 対話型機械学習

Country Status (5)

Country Link
US (2) US12242954B2 (enExample)
EP (1) EP4046086A4 (enExample)
JP (2) JP7245961B2 (enExample)
CA (1) CA3154982C (enExample)
WO (1) WO2021072537A1 (enExample)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11727284B2 (en) * 2019-12-12 2023-08-15 Business Objects Software Ltd Interpretation of machine learning results using feature analysis
US11615330B2 (en) * 2020-03-18 2023-03-28 Kyndryl, Inc. Virtual subject matter expert provisioning
US11748239B1 (en) * 2020-05-06 2023-09-05 Allstate Solutions Private Limited Data driven testing automation using machine learning
US11663296B2 (en) * 2020-09-02 2023-05-30 nbn co limited Automatic work order analysis
US12417407B2 (en) * 2021-02-03 2025-09-16 Royal Bank Of Canada System and method for machine learning monitoring
US12387108B2 (en) * 2021-04-21 2025-08-12 Google Llc Enhanced uncertainty management for optical communication systems

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018147261A (ja) 2017-03-06 2018-09-20 Kddi株式会社 モデル統合装置、モデル統合システム、方法およびプログラム

Family Cites Families (82)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11316763A (ja) 1998-05-01 1999-11-16 Mitsubishi Electric Corp 文書分類装置，文書分類方法及び記憶媒体
AUPS017302A0 (en) 2002-01-25 2002-02-14 Tritronics (Australia) Pty Ltd Performance monitoring system and method
US9785951B1 (en) 2006-02-28 2017-10-10 International Business Machines Corporation Scalable tuning engine
US7792353B2 (en) * 2006-10-31 2010-09-07 Hewlett-Packard Development Company, L.P. Retraining a machine-learning classifier using re-labeled training samples
US8108423B2 (en) 2008-10-03 2012-01-31 Disney Enterprises, Inc. System and method for ontology and rules based segmentation engine for networked content delivery
US20100138273A1 (en) 2008-12-01 2010-06-03 Arash Bateni Repeatability index to enhance seasonal product forecasting
JP4745424B2 (ja) 2009-06-05 2011-08-10 株式会社東芝 文書分類装置及び文書分類プログラム
CA2766914C (en) 2009-06-30 2019-02-26 Daniel Caraviello Mining association rules in plant and animal data sets and utilizing features for classification or prediction
CN102792680B (zh) * 2010-02-19 2016-08-17 汤姆逊许可证公司 媒体内容空间导航
US20120303412A1 (en) 2010-11-24 2012-11-29 Oren Etzioni Price and model prediction system and method
US8386285B2 (en) 2011-05-25 2013-02-26 International Business Machines Corporation Demand modeling and prediction in a retail category
US20130166350A1 (en) 2011-06-28 2013-06-27 Smart Software, Inc. Cluster based processing for forecasting intermittent demand
US10192243B1 (en) 2013-06-10 2019-01-29 Groupon, Inc. Method and apparatus for determining promotion pricing parameters
US20180047071A1 (en) 2012-07-24 2018-02-15 Ebay Inc. System and methods for aggregating past and predicting future product ratings
JP2014067154A (ja) 2012-09-25 2014-04-17 Toshiba Corp 文書分類支援装置、方法及びプログラム
US9111228B2 (en) 2012-10-29 2015-08-18 Sas Institute Inc. System and method for combining segmentation data
US8924910B2 (en) 2012-11-09 2014-12-30 Analog Devices, Inc. Filter design tool
US20140236875A1 (en) 2012-11-15 2014-08-21 Purepredictive, Inc. Machine learning for real-time adaptive website interaction
US20140156346A1 (en) 2012-12-04 2014-06-05 Sap Ag Methods and systems for dynamic demand sensing
US20140358828A1 (en) 2013-05-29 2014-12-04 Purepredictive, Inc. Machine learning generated action plan
US9218574B2 (en) 2013-05-29 2015-12-22 Purepredictive, Inc. User interface for machine learning
US10372815B2 (en) 2013-07-12 2019-08-06 Microsoft Technology Licensing, Llc Interactive concept editing in computer-human interactive learning
US9959675B2 (en) 2014-06-09 2018-05-01 Microsoft Technology Licensing, Llc Layout design using locally satisfiable proposals
US10452992B2 (en) 2014-06-30 2019-10-22 Amazon Technologies, Inc. Interactive interfaces for machine learning model evaluations
US11100420B2 (en) 2014-06-30 2021-08-24 Amazon Technologies, Inc. Input processing for machine learning
US9390086B2 (en) * 2014-09-11 2016-07-12 Palantir Technologies Inc. Classification system with methodology for efficient verification
US20160092519A1 (en) 2014-09-26 2016-03-31 Wal-Mart Stores, Inc. System and method for capturing seasonality and newness in database searches
US10002329B2 (en) 2014-09-26 2018-06-19 Facebook, Inc. Selection and modification of features used by one or more machine learned models used by an online system
US9760990B2 (en) 2014-12-14 2017-09-12 International Business Machines Corporation Cloud-based infrastructure for feedback-driven training and image recognition
US10453026B2 (en) 2015-03-06 2019-10-22 Walmart Apollo, Llc System and method for forecasting high-sellers using multivariate bayesian time series
US10713594B2 (en) 2015-03-20 2020-07-14 Salesforce.Com, Inc. Systems, methods, and apparatuses for implementing machine learning model training and deployment with a rollback mechanism
US20160358099A1 (en) 2015-06-04 2016-12-08 The Boeing Company Advanced analytical infrastructure for machine learning
WO2017023416A1 (en) 2015-07-31 2017-02-09 Northrop Grumman Systems Corporation System and method for in-situ classifier retraining for malware identification and model heterogeneity
JP6555015B2 (ja) 2015-08-31 2019-08-07 富士通株式会社 機械学習管理プログラム、機械学習管理装置および機械学習管理方法
GB201517462D0 (en) 2015-10-02 2015-11-18 Tractable Ltd Semi-automatic labelling of datasets
JP6702421B2 (ja) 2015-12-25 2020-06-03 日本電気株式会社 コスト関数設計システム、コスト関数設計方法、およびコスト関数設計プログラム
US20190018823A1 (en) 2016-02-03 2019-01-17 Nec Corporation Information processing device, information processing method, and recording medium
US10643182B2 (en) 2016-03-16 2020-05-05 Oracle International Corporation Resume extraction based on a resume type
US12236497B2 (en) 2016-04-22 2025-02-25 FiscalNote, Inc. Systems and methods for predicting policy adoption
CN105930934B (zh) 2016-04-27 2018-08-14 第四范式（北京）技术有限公司 展示预测模型的方法、装置及调整预测模型的方法、装置
US10520905B2 (en) 2016-04-28 2019-12-31 Veritone Alpha, Inc. Using forecasting to control target systems
US10489986B2 (en) 2018-01-25 2019-11-26 Ctrl-Labs Corporation User-controlled tuning of handstate representation model parameters
US11416680B2 (en) 2016-08-18 2022-08-16 Sap Se Classifying social media inputs via parts-of-speech filtering
US11188824B2 (en) 2017-02-17 2021-11-30 Google Llc Cooperatively training and/or using separate input and subsequent content neural networks for information retrieval
US20180247227A1 (en) 2017-02-24 2018-08-30 Xtract Technologies Inc. Machine learning systems and methods for data augmentation
WO2018170595A1 (en) 2017-03-23 2018-09-27 Rubikloud Technologies Inc. Method and system for generation of adjustable automated forecasts for a promotion
CA3235875A1 (en) 2017-03-23 2018-09-27 Kinaxis Inc. Method and system for generation of at least one output analytic for a promotion
US10395210B2 (en) 2017-04-24 2019-08-27 Walmart Apollo, Llc System and method for using stores as receiving points for third party, E-commerce suppliers
US10255550B1 (en) 2017-06-07 2019-04-09 States Title, Inc. Machine learning using multiple input data types
US11068916B2 (en) 2017-06-26 2021-07-20 Kronos Technology Systems Limited Partnershi Using machine learning to predict retail business volume
US10108902B1 (en) 2017-09-18 2018-10-23 CS Disco, Inc. Methods and apparatus for asynchronous and interactive machine learning using attention selection techniques
US11928616B2 (en) 2017-09-18 2024-03-12 Kinaxis Inc. Method and system for hierarchical forecasting
US20190102693A1 (en) 2017-09-29 2019-04-04 Facebook, Inc. Optimizing parameters for machine learning models
US11748653B2 (en) 2017-10-05 2023-09-05 DataRobot, Inc. Machine learning abstraction
US11922440B2 (en) 2017-10-31 2024-03-05 Oracle International Corporation Demand forecasting using weighted mixed machine learning models
US10535138B2 (en) 2017-11-21 2020-01-14 Zoox, Inc. Sensor data segmentation
US20190156357A1 (en) 2017-11-22 2019-05-23 Staples, Inc. Advanced computational prediction models for heterogeneous data
US10402788B2 (en) 2017-11-29 2019-09-03 Aon Global Operations Ltd (Singapore Branch) Dashboard interface, platform, and environment for intelligent subscription product selection
CN108090508B (zh) 2017-12-12 2020-01-31 腾讯科技（深圳）有限公司 一种分类训练方法、装置及存储介质
US10489126B2 (en) 2018-02-12 2019-11-26 Oracle International Corporation Automated code generation
US11017422B2 (en) 2018-03-01 2021-05-25 Adobe Inc. Dynamically generating digital product notifications over time based on product expiration data
US11599894B2 (en) 2018-06-29 2023-03-07 Tata Consultancy Services Limited Method and system for generating customer decision tree through machine learning
KR102814797B1 (ko) 2018-08-02 2025-05-30 삼성전자주식회사 메타-학습에 기반하여 기계학습의 모델을 선정하는 방법 및 장치
US10896237B2 (en) 2018-08-22 2021-01-19 International Business Machines Corporation Reducing database stress using cognitive data caching
US11475404B2 (en) 2018-09-05 2022-10-18 Trax Technology Solutions Pte Ltd. Aggregating product shortage information
US10740656B2 (en) 2018-09-19 2020-08-11 Hughes Network Systems, Llc Machine learning clustering models for determining the condition of a communication system
US11107166B2 (en) 2018-09-25 2021-08-31 Business Objects Software Ltd. Multi-step day sales outstanding forecasting
US10997614B2 (en) 2018-10-09 2021-05-04 Oracle International Corporation Flexible feature regularization for demand model generation
US11295324B2 (en) 2018-10-26 2022-04-05 Target Brands, Inc. Method and system for generating disaggregated demand forecasts from ensemble demand forecasts
US11170391B2 (en) 2018-10-26 2021-11-09 Target Brands, Inc. Method and system for validating ensemble demand forecasts
US20200130425A1 (en) 2018-10-26 2020-04-30 Pilot Inc. Beadlock with filler ring
US20200184494A1 (en) 2018-12-05 2020-06-11 Legion Technologies, Inc. Demand Forecasting Using Automatic Machine-Learning Model Selection
JP2020094928A (ja) 2018-12-13 2020-06-18 本田技研工業株式会社 経路案内装置およびその制御方法、情報処理サーバ、ならびに経路案内システム
US20200210920A1 (en) 2019-01-02 2020-07-02 Legion Technologies, Inc. Machine Learning System for Demand Forecasting With Improved Date Alignment
US11568286B2 (en) 2019-01-31 2023-01-31 Fair Isaac Corporation Providing insights about a dynamic machine learning model
US11537825B2 (en) 2019-10-11 2022-12-27 Kinaxis Inc. Systems and methods for features engineering
US11526899B2 (en) 2019-10-11 2022-12-13 Kinaxis Inc. Systems and methods for dynamic demand sensing
US20220292308A1 (en) 2021-03-12 2022-09-15 DataRobot, Inc. Systems and methods for time series modeling
US20220318711A1 (en) 2021-03-31 2022-10-06 Coupa Software Incorporated Automated supply chain demand forecasting
WO2022251837A1 (en) 2021-05-25 2022-12-01 Google Llc Machine learning time series anomaly detection
US20230091610A1 (en) 2021-09-13 2023-03-23 DataRobot, Inc. Systems and methods of generating and validating time-series features using machine learning
US20230401468A1 (en) 2022-05-17 2023-12-14 Dell Products L.P. Methods and systems for generating forecasts using an ensemble online demand generation forecaster

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018147261A (ja) 2017-03-06 2018-09-20 Kddi株式会社 モデル統合装置、モデル統合システム、方法およびプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吉崎 亮介 RYOUSUKE YOSHIZAKI，実践で学ぶ機械学習活用ガイド 初版 ，第1版，株式会社マイナビ出版 滝口 直樹，2019年09月20日，第156頁－第165頁

Also Published As

Publication number Publication date
EP4046086A1 (en) 2022-08-24
US20210110299A1 (en) 2021-04-15
CA3154982C (en) 2024-05-28
EP4046086A4 (en) 2023-12-20
US20240370723A1 (en) 2024-11-07
WO2021072537A1 (en) 2021-04-22
CA3154982A1 (en) 2022-04-22
JP7624465B2 (ja) 2025-01-30
JP2022548333A (ja) 2022-11-17
US12242954B2 (en) 2025-03-04
JP2023052555A (ja) 2023-04-11

Similar Documents

Publication Publication Date Title
JP7245961B2 (ja) 対話型機械学習
JP7640539B2 (ja) 対話型機械学習
US12211593B2 (en) Trial design platform with recommendation engine
US12051488B2 (en) Interactive trial design platform
US20200401939A1 (en) Systems and methods for preparing data for use by machine learning algorithms
CN110956272A (zh) 实现数据处理的方法和系统
US11429863B2 (en) Computer-readable recording medium having stored therein learning program, learning method, and learning apparatus
US20200327419A1 (en) Utilizing a genetic algorithm in applying objective functions to determine distribution times for electronic communications
US20220414470A1 (en) Multi-Task Attention Based Recurrent Neural Networks for Efficient Representation Learning
US20210232895A1 (en) Flexible Parameter Sharing for Multi-Task Learning
US12443967B2 (en) Apparatus and methods for high-order system growth modeling
US11176177B2 (en) Computer-readable recording medium storing search program and search method
US12386639B1 (en) Apparatus and method for dynamic generation of visual elements in a user-interface
US12182178B1 (en) System and methods for varying optimization solutions using constraints based on an endpoint
US12436657B1 (en) System and method for generating a visual representation of an execution sequence within a graphical user interface
US20250232212A1 (en) Apparatus and methods for multiple stage process modeling
US20250299208A1 (en) System and methods for varying optimization solutions using constraints
US12475422B2 (en) Apparatus and methods for generating a process enhancement
HK40081370A (en) Trial design platform

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220609

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20220609

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221021

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230120

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230222

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230313

R150 Certificate of patent or registration of utility model

Ref document number: 7245961

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150