IL294712A - למידה עם הערכת רגעית תוך שימוש בקבועי זמן שונים - Google Patents
למידה עם הערכת רגעית תוך שימוש בקבועי זמן שוניםInfo
- Publication number
- IL294712A IL294712A IL294712A IL29471222A IL294712A IL 294712 A IL294712 A IL 294712A IL 294712 A IL294712 A IL 294712A IL 29471222 A IL29471222 A IL 29471222A IL 294712 A IL294712 A IL 294712A
- Authority
- IL
- Israel
- Prior art keywords
- model
- moment
- estimates
- gradient
- training
- Prior art date
Links
- 238000012549 training Methods 0.000 claims description 120
- 238000000034 method Methods 0.000 claims description 55
- 238000012545 processing Methods 0.000 claims description 24
- 230000006870 function Effects 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 11
- 230000015654 memory Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 3
- 230000008859 change Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 23
- 230000007774 longterm Effects 0.000 description 7
- 230000003044 adaptive effect Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 6
- 238000013145 classification model Methods 0.000 description 5
- 238000013528 artificial neural network Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000593 degrading effect Effects 0.000 description 3
- 230000007613 environmental effect Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 206010064127 Solar lentigo Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000001186 cumulative effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 230000007787 long-term memory Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 238000000611 regression analysis Methods 0.000 description 1
- 230000006403 short-term memory Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Molecular Biology (AREA)
- Health & Medical Sciences (AREA)
- Pure & Applied Mathematics (AREA)
- Probability & Statistics with Applications (AREA)
- Algebra (AREA)
- Mathematical Optimization (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Feedback Control In General (AREA)
- Control Of Electric Motors In General (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US16/787,443 US11631030B2 (en) | 2020-02-11 | 2020-02-11 | Learning with moment estimation using different time constants |
| PCT/IB2021/050895 WO2021161136A1 (en) | 2020-02-11 | 2021-02-04 | Learning with moment estimation using different time constants |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| IL294712A true IL294712A (he) | 2022-09-01 |
Family
ID=77177596
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| IL294712A IL294712A (he) | 2020-02-11 | 2021-02-04 | למידה עם הערכת רגעית תוך שימוש בקבועי זמן שונים |
Country Status (10)
| Country | Link |
|---|---|
| US (2) | US11631030B2 (he) |
| JP (1) | JP2023512508A (he) |
| KR (1) | KR20220110535A (he) |
| CN (1) | CN115004194A (he) |
| AU (1) | AU2021219995B2 (he) |
| CA (1) | CA3165001A1 (he) |
| DE (1) | DE112021000282T5 (he) |
| GB (1) | GB2607832A (he) |
| IL (1) | IL294712A (he) |
| WO (1) | WO2021161136A1 (he) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB202017262D0 (en) * | 2020-10-30 | 2020-12-16 | Graphcore Ltd | Batch processing in a machine learning computer |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10289962B2 (en) | 2014-06-06 | 2019-05-14 | Google Llc | Training distilled machine learning models |
| EP3446259A1 (en) | 2016-05-20 | 2019-02-27 | Deepmind Technologies Limited | Training machine learning models |
| WO2018017546A1 (en) | 2016-07-18 | 2018-01-25 | Google Llc | Training machine learning models on multiple machine learning tasks |
| US10963783B2 (en) | 2017-02-19 | 2021-03-30 | Intel Corporation | Technologies for optimized machine learning training |
| CN110134636B (zh) | 2018-02-09 | 2023-04-18 | 中兴通讯股份有限公司 | 模型训练方法、服务器和计算机可读存储介质 |
| CN108601033B (zh) | 2018-04-25 | 2020-03-31 | 北京科技大学 | 一种基于Adam的网络工作参数优化方法 |
| CN109325395A (zh) | 2018-04-28 | 2019-02-12 | 二十世纪空间技术应用股份有限公司 | 图像的识别方法、卷积神经网络模型的训练方法及装置 |
| CN109389222A (zh) | 2018-11-07 | 2019-02-26 | 清华大学深圳研究生院 | 一种快速的自适应神经网络优化方法 |
-
2020
- 2020-02-11 US US16/787,443 patent/US11631030B2/en active Active
-
2021
- 2021-02-04 WO PCT/IB2021/050895 patent/WO2021161136A1/en active Application Filing
- 2021-02-04 DE DE112021000282.1T patent/DE112021000282T5/de active Pending
- 2021-02-04 AU AU2021219995A patent/AU2021219995B2/en active Active
- 2021-02-04 CA CA3165001A patent/CA3165001A1/en active Pending
- 2021-02-04 IL IL294712A patent/IL294712A/he unknown
- 2021-02-04 GB GB2213042.1A patent/GB2607832A/en active Pending
- 2021-02-04 CN CN202180011677.3A patent/CN115004194A/zh active Pending
- 2021-02-04 KR KR1020227022553A patent/KR20220110535A/ko unknown
- 2021-02-04 JP JP2022545373A patent/JP2023512508A/ja active Pending
-
2023
- 2023-04-13 US US18/300,007 patent/US12020129B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021161136A1 (en) | 2021-08-19 |
| AU2021219995A1 (en) | 2022-07-14 |
| DE112021000282T5 (de) | 2022-09-22 |
| AU2021219995B2 (en) | 2023-12-14 |
| GB2607832A (en) | 2022-12-14 |
| CN115004194A (zh) | 2022-09-02 |
| US20210248510A1 (en) | 2021-08-12 |
| GB202213042D0 (en) | 2022-10-19 |
| US12020129B2 (en) | 2024-06-25 |
| US20230252357A1 (en) | 2023-08-10 |
| US11631030B2 (en) | 2023-04-18 |
| CA3165001A1 (en) | 2021-08-19 |
| KR20220110535A (ko) | 2022-08-08 |
| JP2023512508A (ja) | 2023-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107765347B (zh) | 一种高斯过程回归和粒子滤波的短期风速预测方法 | |
| CN107480028B (zh) | 磁盘可使用的剩余时长的获取方法及装置 | |
| US20180075360A1 (en) | Accuracy-estimating-model generating system and accuracy estimating system | |
| US20190392363A1 (en) | Predicting arrival time of components based on historical receipt data | |
| EP3938929A1 (en) | Determining causal models for controlling environments | |
| GB2557674A (en) | Automated decision making apparatus and methods | |
| TWI831893B (zh) | 用於高度共線響應空間中的規範性分析的方法、系統與電腦可讀取媒體 | |
| CN111143989A (zh) | 频率调整量计算方法、模块、系统、存储介质和设备 | |
| JP2007215354A (ja) | 電力負荷予測方法、及び電力負荷予測処理プログラム | |
| CN109344967B (zh) | 一种基于人工神经网络的智能电表生命周期预测方法 | |
| JP6529096B2 (ja) | シミュレートシステム、シミュレート方法およびシミュレート用プログラム | |
| WO2017015184A1 (en) | Output efficiency optimization in production systems | |
| US12020129B2 (en) | Learning with moment estimation using different time constants | |
| JP2005004658A (ja) | 変化点検出装置，変化点検出方法および変化点検出用プログラム | |
| CN111832693A (zh) | 神经网络层运算、模型训练方法、装置及设备 | |
| KR20200000660A (ko) | 실시간 시계열 데이터를 위한 예측 모형 생성 시스템 및 방법 | |
| CN113532614A (zh) | 用于预测传感器数据的方法、处理器及称重系统 | |
| CN108897818B (zh) | 确定数据处理过程老化状态的方法、装置及可读存储介质 | |
| WO2017142737A1 (en) | A prognostics and health management model for predicting wind turbine oil filter wear level | |
| KR102539223B1 (ko) | 엣지 컴퓨팅 환경에서 ami 데이터 스트림 가속처리를 위한 딥 러닝 방법 | |
| US20240211234A1 (en) | Maintenance time window prediction | |
| US20230351146A1 (en) | Device and computer-implemented method for a neural architecture search | |
| KR20200137130A (ko) | 영 과잉 데이터의 모델을 생성하는 방법 및 그 장치 | |
| WO2020237077A1 (en) | Closed loop adaptive particle forecasting | |
| CN115630721A (zh) | 基于潜在图结构生成的轨迹预测方法及装置 |