KR102956712B1 - 지도 머신 학습 문제를 위한 신경망 아키텍처 선택 - Google Patents
지도 머신 학습 문제를 위한 신경망 아키텍처 선택Info
- Publication number
- KR102956712B1 KR102956712B1 KR1020207032320A KR20207032320A KR102956712B1 KR 102956712 B1 KR102956712 B1 KR 102956712B1 KR 1020207032320 A KR1020207032320 A KR 1020207032320A KR 20207032320 A KR20207032320 A KR 20207032320A KR 102956712 B1 KR102956712 B1 KR 102956712B1
- Authority
- KR
- South Korea
- Prior art keywords
- neural network
- machine learning
- measure
- learning problem
- candidate neural
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/047—Probabilistic or stochastic networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0499—Feedforward networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/0985—Hyperparameter optimisation; Meta-learning; Learning-to-learn
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/04—Inference or reasoning models
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Probability & Statistics with Applications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Complex Calculations (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Image Analysis (AREA)
- Debugging And Monitoring (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/976,514 | 2018-05-10 | ||
| US15/976,514 US11995538B2 (en) | 2018-05-10 | 2018-05-10 | Selecting a neural network architecture for a supervised machine learning problem |
| PCT/US2019/029532 WO2019217113A1 (en) | 2018-05-10 | 2019-04-27 | Selecting a neural network architecture for a supervised machine learning problem |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20210008480A KR20210008480A (ko) | 2021-01-22 |
| KR102956712B1 true KR102956712B1 (ko) | 2026-04-24 |
Family
ID=66429706
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020207032320A Active KR102956712B1 (ko) | 2018-05-10 | 2019-04-27 | 지도 머신 학습 문제를 위한 신경망 아키텍처 선택 |
Country Status (7)
| Country | Link |
|---|---|
| US (3) | US11995538B2 (cg-RX-API-DMAC7.html) |
| EP (1) | EP3791326A1 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7344900B2 (cg-RX-API-DMAC7.html) |
| KR (1) | KR102956712B1 (cg-RX-API-DMAC7.html) |
| CN (2) | CN120297334A (cg-RX-API-DMAC7.html) |
| CA (1) | CA3097036A1 (cg-RX-API-DMAC7.html) |
| WO (1) | WO2019217113A1 (cg-RX-API-DMAC7.html) |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018126076A1 (en) | 2016-12-30 | 2018-07-05 | Intel Corporation | Data packaging protocols for communications between iot devices |
| CN111819580B (zh) * | 2018-05-29 | 2025-01-14 | 谷歌有限责任公司 | 用于密集图像预测任务的神经架构搜索 |
| US11537846B2 (en) * | 2018-08-21 | 2022-12-27 | Wisconsin Alumni Research Foundation | Neural network architecture with concurrent uncertainty output |
| KR102200212B1 (ko) * | 2018-12-07 | 2021-01-08 | 서울대학교 산학협력단 | 불확실성 예측을 위한 샘플링 모델 생성 장치 및 방법, 불확실성 예측 장치 |
| US10616257B1 (en) * | 2019-02-19 | 2020-04-07 | Verizon Patent And Licensing Inc. | Method and system for anomaly detection and network deployment based on quantitative assessment |
| CN112884118A (zh) * | 2019-11-30 | 2021-06-01 | 华为技术有限公司 | 神经网络的搜索方法、装置及设备 |
| US11240340B2 (en) * | 2020-05-12 | 2022-02-01 | International Business Machines Corporation | Optimized deployment of analytic models in an edge topology |
| CN113807376A (zh) * | 2020-06-15 | 2021-12-17 | 富泰华工业(深圳)有限公司 | 网络模型优化方法、装置、电子设备及存储介质 |
| CN112134876A (zh) * | 2020-09-18 | 2020-12-25 | 中移(杭州)信息技术有限公司 | 流量识别系统及方法、服务器 |
| KR102535007B1 (ko) * | 2020-11-13 | 2023-05-19 | 숭실대학교 산학협력단 | Snn 모델 파라미터를 기반으로 모델 수행을 위한 뉴로모픽 아키텍처 동적 선택 방법, 이를 수행하기 위한 기록 매체 및 장치 |
| US20220164646A1 (en) * | 2020-11-24 | 2022-05-26 | EMC IP Holding Company LLC | Hydratable neural networks for devices |
| CN113204916B (zh) * | 2021-04-15 | 2021-11-19 | 特斯联科技集团有限公司 | 基于强化学习的智能决策方法及系统 |
| US20220027792A1 (en) * | 2021-10-08 | 2022-01-27 | Intel Corporation | Deep neural network model design enhanced by real-time proxy evaluation feedback |
| US12367248B2 (en) * | 2021-10-19 | 2025-07-22 | Intel Corporation | Hardware-aware machine learning model search mechanisms |
| US12367249B2 (en) * | 2021-10-19 | 2025-07-22 | Intel Corporation | Framework for optimization of machine learning architectures |
| US12417260B2 (en) | 2021-10-20 | 2025-09-16 | Intel Corporation | Machine learning model scaling system with energy efficient network data transfer for power aware hardware |
| CN114037058B (zh) * | 2021-11-05 | 2024-05-17 | 北京百度网讯科技有限公司 | 预训练模型的生成方法、装置、电子设备以及存储介质 |
| CN114188022A (zh) * | 2021-12-13 | 2022-03-15 | 浙江大学 | 一种基于TextCNN模型的临床儿童咳嗽智能预诊断系统 |
| KR102915360B1 (ko) * | 2022-11-16 | 2026-01-20 | 충북대학교 산학협력단 | 지하수위 예측을 위한 인공신경망의 파라미터들을 최적화하는 방법 및 장치 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060224533A1 (en) * | 2005-03-14 | 2006-10-05 | Thaler Stephen L | Neural network development and data analysis tool |
| JP2017520068A (ja) | 2014-05-23 | 2017-07-20 | データロボット, インコーポレイテッド | 予測データ分析のためのシステムおよび技術 |
| WO2018075995A1 (en) * | 2016-10-21 | 2018-04-26 | DataRobot, Inc. | Systems for predictive data analytics, and related methods and apparatus |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05314090A (ja) | 1992-05-14 | 1993-11-26 | Hitachi Ltd | ニューラルネットを用いたパターン認識方法およびその装置 |
| CA2887606A1 (en) | 2012-10-19 | 2014-04-24 | Apixio, Inc. | Systems and methods for medical information analysis with deidentification and reidentification |
| US20170087691A1 (en) | 2015-09-30 | 2017-03-30 | Apple Inc. | Methods for color and texture control of metallic glasses by the combination of blasting and oxidization |
| US9659248B1 (en) * | 2016-01-19 | 2017-05-23 | International Business Machines Corporation | Machine learning and training a computer-implemented neural network to retrieve semantically equivalent questions using hybrid in-memory representations |
-
2018
- 2018-05-10 US US15/976,514 patent/US11995538B2/en active Active
-
2019
- 2019-04-27 WO PCT/US2019/029532 patent/WO2019217113A1/en not_active Ceased
- 2019-04-27 CN CN202510368001.XA patent/CN120297334A/zh active Pending
- 2019-04-27 EP EP19722485.0A patent/EP3791326A1/en not_active Withdrawn
- 2019-04-27 KR KR1020207032320A patent/KR102956712B1/ko active Active
- 2019-04-27 JP JP2020555022A patent/JP7344900B2/ja active Active
- 2019-04-27 CA CA3097036A patent/CA3097036A1/en active Pending
- 2019-04-27 CN CN201980031270.XA patent/CN112470171B/zh active Active
-
2024
- 2024-04-23 US US18/643,691 patent/US12423581B2/en active Active
-
2025
- 2025-08-21 US US19/306,482 patent/US20250390745A1/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060224533A1 (en) * | 2005-03-14 | 2006-10-05 | Thaler Stephen L | Neural network development and data analysis tool |
| JP2017520068A (ja) | 2014-05-23 | 2017-07-20 | データロボット, インコーポレイテッド | 予測データ分析のためのシステムおよび技術 |
| WO2018075995A1 (en) * | 2016-10-21 | 2018-04-26 | DataRobot, Inc. | Systems for predictive data analytics, and related methods and apparatus |
Non-Patent Citations (4)
| Title |
|---|
| Brock 등, "Smash: one-shot model architecture search through hypernetworks", arXiv:1708.05344v1, 2017.08.17. |
| Elsken 등, "Simple and efficient architecture search for convolutional neural networks." arXiv:1711.04528v1, 2017.11.13. |
| Hamel 등, "Transfer learning in MIR: Sharing learned latent representations for music audio classification and similarity", International Society for Music Information Retrieval, 2013. |
| Jin-Dong Dong 등, "PPP-Net: Platform-aware Progressive Search for Pareto-optimal Neural Architectures", ICLR 2018 Workshop, 2018.02.18. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112470171A (zh) | 2021-03-09 |
| US20250390745A1 (en) | 2025-12-25 |
| JP7344900B2 (ja) | 2023-09-14 |
| WO2019217113A1 (en) | 2019-11-14 |
| EP3791326A1 (en) | 2021-03-17 |
| US12423581B2 (en) | 2025-09-23 |
| CN112470171B (zh) | 2025-04-18 |
| US20240273370A1 (en) | 2024-08-15 |
| CN120297334A (zh) | 2025-07-11 |
| US20190347548A1 (en) | 2019-11-14 |
| JP2021523430A (ja) | 2021-09-02 |
| US11995538B2 (en) | 2024-05-28 |
| KR20210008480A (ko) | 2021-01-22 |
| CA3097036A1 (en) | 2019-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12423581B2 (en) | Selecting a neural network architecture for a supervised machine learning problem | |
| US11392859B2 (en) | Large-scale automated hyperparameter tuning | |
| EP3912056B1 (en) | Leveraging query executions to improve index recommendations | |
| US11361225B2 (en) | Neural network architecture for attention based efficient model adaptation | |
| JP7157154B2 (ja) | 性能予測ニューラルネットワークを使用したニューラルアーキテクチャ探索 | |
| US10853739B2 (en) | Machine learning models for evaluating entities in a high-volume computer network | |
| US20190385073A1 (en) | Visual recognition via light weight neural network | |
| US20190019108A1 (en) | Systems and methods for a validation tree | |
| US11341429B1 (en) | Distributed machine learning for improved privacy | |
| JP2017538195A (ja) | 階層深層畳み込みニューラルネットワーク | |
| US20170200090A1 (en) | System and method of chaining algorithms for global object recognition to improve probability of correctness and reduce processing load | |
| US12216632B2 (en) | Search engine optimization by selective indexing | |
| US20160299999A1 (en) | Systems and methods for power plant model optimization | |
| US20190279097A1 (en) | Systems and methods for decision tree ensembles for selecting actions | |
| CN113869496B (zh) | 一种神经网络的获取方法、数据处理方法以及相关设备 | |
| US20260105384A1 (en) | Dynamically scalable machine learning model generation and retraining through containerization | |
| EP4487192B1 (en) | Data retention in image-based localization at scale |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PA0105 | International application |
St.27 status event code: A-0-1-A10-A15-nap-PA0105 |
|
| PG1501 | Laying open of application |
St.27 status event code: A-1-1-Q10-Q12-nap-PG1501 |
|
| A201 | Request for examination | ||
| PA0201 | Request for examination |
St.27 status event code: A-1-2-D10-D11-exm-PA0201 |
|
| P22-X000 | Classification modified |
St.27 status event code: A-2-2-P10-P22-nap-X000 |
|
| P22-X000 | Classification modified |
St.27 status event code: A-2-2-P10-P22-nap-X000 |
|
| E902 | Notification of reason for refusal | ||
| PE0902 | Notice of grounds for rejection |
St.27 status event code: A-1-2-D10-D21-exm-PE0902 |
|
| E13-X000 | Pre-grant limitation requested |
St.27 status event code: A-2-3-E10-E13-lim-X000 |
|
| P11-X000 | Amendment of application requested |
St.27 status event code: A-2-2-P10-P11-nap-X000 |
|
| D22 | Grant of ip right intended |
Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D22-EXM-PE0701 (AS PROVIDED BY THE NATIONAL OFFICE) |
|
| PE0701 | Decision of registration |
St.27 status event code: A-1-2-D10-D22-exm-PE0701 |
|
| F11 | Ip right granted following substantive examination |
Free format text: ST27 STATUS EVENT CODE: A-2-4-F10-F11-EXM-PR0701 (AS PROVIDED BY THE NATIONAL OFFICE) |
|
| PR0701 | Registration of establishment |
St.27 status event code: A-2-4-F10-F11-exm-PR0701 |
|
| PR1002 | Payment of registration fee |
St.27 status event code: A-2-2-U10-U12-oth-PR1002 Fee payment year number: 1 |
|
| U12 | Designation fee paid |
Free format text: ST27 STATUS EVENT CODE: A-2-2-U10-U12-OTH-PR1002 (AS PROVIDED BY THE NATIONAL OFFICE) Year of fee payment: 1 |
|
| PG1601 | Publication of registration |
St.27 status event code: A-4-4-Q10-Q13-nap-PG1601 |
|
| Q13 | Ip right document published |
Free format text: ST27 STATUS EVENT CODE: A-4-4-Q10-Q13-NAP-PG1601 (AS PROVIDED BY THE NATIONAL OFFICE) |