JP2019164793A - ディープニューラルネットワークの動的適応 - Google Patents
ディープニューラルネットワークの動的適応 Download PDFInfo
- Publication number
- JP2019164793A JP2019164793A JP2019051636A JP2019051636A JP2019164793A JP 2019164793 A JP2019164793 A JP 2019164793A JP 2019051636 A JP2019051636 A JP 2019051636A JP 2019051636 A JP2019051636 A JP 2019051636A JP 2019164793 A JP2019164793 A JP 2019164793A
- Authority
- JP
- Japan
- Prior art keywords
- weights
- dnn
- layer
- machine learning
- weight
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
- G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0495—Quantised networks; Sparse networks; Compressed networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/0985—Hyperparameter optimisation; Meta-learning; Learning-to-learn
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Neurology (AREA)
- Machine Translation (AREA)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2022001150A JP2022066192A (ja) | 2018-03-19 | 2022-01-06 | ディープニューラルネットワークの動的適応 |
| JP2024009579A JP7725628B2 (ja) | 2018-03-19 | 2024-01-25 | ディープニューラルネットワークの動的適応 |
Applications Claiming Priority (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201862644715P | 2018-03-19 | 2018-03-19 | |
| US62/644,715 | 2018-03-19 | ||
| US201862645358P | 2018-03-20 | 2018-03-20 | |
| US62/645,358 | 2018-03-20 | ||
| US16/133,446 US11429862B2 (en) | 2018-03-20 | 2018-09-17 | Dynamic adaptation of deep neural networks |
| US16/133,446 | 2018-09-17 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022001150A Division JP2022066192A (ja) | 2018-03-19 | 2022-01-06 | ディープニューラルネットワークの動的適応 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2019164793A true JP2019164793A (ja) | 2019-09-26 |
| JP2019164793A5 JP2019164793A5 (https=) | 2020-11-26 |
Family
ID=65904040
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2019051636A Withdrawn JP2019164793A (ja) | 2018-03-19 | 2019-03-19 | ディープニューラルネットワークの動的適応 |
| JP2022001150A Withdrawn JP2022066192A (ja) | 2018-03-19 | 2022-01-06 | ディープニューラルネットワークの動的適応 |
| JP2024009579A Active JP7725628B2 (ja) | 2018-03-19 | 2024-01-25 | ディープニューラルネットワークの動的適応 |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2022001150A Withdrawn JP2022066192A (ja) | 2018-03-19 | 2022-01-06 | ディープニューラルネットワークの動的適応 |
| JP2024009579A Active JP7725628B2 (ja) | 2018-03-19 | 2024-01-25 | ディープニューラルネットワークの動的適応 |
Country Status (3)
| Country | Link |
|---|---|
| EP (1) | EP3543917B1 (https=) |
| JP (3) | JP2019164793A (https=) |
| KR (1) | KR102329590B1 (https=) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6992864B1 (ja) | 2020-09-28 | 2022-01-13 | 沖電気工業株式会社 | ニューラルネットワーク軽量化装置、ニューラルネットワーク軽量化方法およびプログラム |
| JP2022066192A (ja) * | 2018-03-19 | 2022-04-28 | エスアールアイ インターナショナル | ディープニューラルネットワークの動的適応 |
| JP7187065B1 (ja) | 2021-06-25 | 2022-12-12 | 株式会社モルフォ | 計算手法決定システム、計算手法決定方法、及び、計算手法決定プログラム |
| WO2023120205A1 (ja) | 2021-12-24 | 2023-06-29 | ソニーセミコンダクタソリューションズ株式会社 | 推論装置、推論方法及び推論プログラム |
| JP2023550690A (ja) * | 2020-10-23 | 2023-12-05 | 維沃移動通信有限公司 | 通信情報の送信、受信方法及び通信機器 |
| US11899765B2 (en) | 2019-12-23 | 2024-02-13 | Dts Inc. | Dual-factor identification system and method with adaptive enrollment |
| US12033068B2 (en) | 2018-06-22 | 2024-07-09 | Advanced New Technologies Co., Ltd. | Method and device for cash advance recognition |
| JP2025513676A (ja) * | 2022-02-28 | 2025-04-30 | クゥアルコム・インコーポレイテッド | マルチプロセッサコンピューティングデバイス内で機械学習演算を実行するための適応スケジューリング |
| US12321836B2 (en) | 2020-02-21 | 2025-06-03 | Actapio, Inc. | Learning device, learning method, learning program, evaluation device, evaluation method, and evaluation program |
| US12619869B2 (en) | 2021-09-09 | 2026-05-05 | Actapio, Inc. | Learning apparatus, learning method, and a non-transitory computer-readable storage medium |
Families Citing this family (83)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018125928A1 (en) | 2016-12-29 | 2018-07-05 | DeepScale, Inc. | Multi-channel sensor simulation for autonomous control systems |
| WO2018176000A1 (en) | 2017-03-23 | 2018-09-27 | DeepScale, Inc. | Data synthesis for autonomous control systems |
| US11893393B2 (en) | 2017-07-24 | 2024-02-06 | Tesla, Inc. | Computational array microprocessor system with hardware arbiter managing memory requests |
| US11157441B2 (en) | 2017-07-24 | 2021-10-26 | Tesla, Inc. | Computational array microprocessor system using non-consecutive data formatting |
| US11409692B2 (en) | 2017-07-24 | 2022-08-09 | Tesla, Inc. | Vector computational unit |
| US10671349B2 (en) | 2017-07-24 | 2020-06-02 | Tesla, Inc. | Accelerated mathematical engine |
| US12307350B2 (en) | 2018-01-04 | 2025-05-20 | Tesla, Inc. | Systems and methods for hardware-based pooling |
| US11561791B2 (en) | 2018-02-01 | 2023-01-24 | Tesla, Inc. | Vector computational unit receiving data elements in parallel from a last row of a computational array |
| US11429862B2 (en) | 2018-03-20 | 2022-08-30 | Sri International | Dynamic adaptation of deep neural networks |
| US11215999B2 (en) | 2018-06-20 | 2022-01-04 | Tesla, Inc. | Data pipeline and deep learning system for autonomous driving |
| US11361457B2 (en) | 2018-07-20 | 2022-06-14 | Tesla, Inc. | Annotation cross-labeling for autonomous control systems |
| US11636333B2 (en) | 2018-07-26 | 2023-04-25 | Tesla, Inc. | Optimizing neural network structures for embedded systems |
| US11562231B2 (en) | 2018-09-03 | 2023-01-24 | Tesla, Inc. | Neural networks for embedded devices |
| KR20250078625A (ko) | 2018-10-11 | 2025-06-02 | 테슬라, 인크. | 증강 데이터로 기계 모델을 훈련하기 위한 시스템 및 방법 |
| US11196678B2 (en) | 2018-10-25 | 2021-12-07 | Tesla, Inc. | QOS manager for system on a chip communications |
| WO2020102888A1 (en) * | 2018-11-19 | 2020-05-28 | Tandemlaunch Inc. | System and method for automated precision configuration for deep neural networks |
| US11816585B2 (en) | 2018-12-03 | 2023-11-14 | Tesla, Inc. | Machine learning models operating at different frequencies for autonomous vehicles |
| US11537811B2 (en) | 2018-12-04 | 2022-12-27 | Tesla, Inc. | Enhanced object detection for autonomous vehicles based on field view |
| US11610117B2 (en) | 2018-12-27 | 2023-03-21 | Tesla, Inc. | System and method for adapting a neural network model on a hardware platform |
| US10997461B2 (en) | 2019-02-01 | 2021-05-04 | Tesla, Inc. | Generating ground truth for machine learning from time series elements |
| US11150664B2 (en) | 2019-02-01 | 2021-10-19 | Tesla, Inc. | Predicting three-dimensional features for autonomous driving |
| US11567514B2 (en) | 2019-02-11 | 2023-01-31 | Tesla, Inc. | Autonomous and user controlled vehicle summon to a target |
| US10956755B2 (en) | 2019-02-19 | 2021-03-23 | Tesla, Inc. | Estimating object properties using visual image data |
| US11657118B2 (en) * | 2019-05-23 | 2023-05-23 | Google Llc | Systems and methods for learning effective loss functions efficiently |
| CN112668362B (zh) * | 2019-10-15 | 2023-06-16 | 浙江中正智能科技有限公司 | 一种动态优化类代理的人证比对模型训练方法 |
| CN114556380B (zh) * | 2019-10-17 | 2026-01-30 | 富士通株式会社 | 机器学习程序、机器学习方法以及机器学习装置 |
| US11775611B2 (en) | 2019-11-01 | 2023-10-03 | Samsung Electronics Co., Ltd. | Piecewise quantization for neural networks |
| CN111079523B (zh) * | 2019-11-05 | 2024-05-14 | 北京迈格威科技有限公司 | 物体检测方法、装置、计算机设备和存储介质 |
| CN112784954B (zh) * | 2019-11-08 | 2025-07-29 | 华为技术有限公司 | 确定神经网络的方法和装置 |
| US11836490B2 (en) * | 2019-11-14 | 2023-12-05 | Nvidia Corporation | Kernel coefficient quantization |
| US12039430B2 (en) * | 2019-11-15 | 2024-07-16 | Samsung Electronics Co., Ltd. | Electronic device and method for inference binary and ternary neural networks |
| CN110942094B (zh) * | 2019-11-26 | 2022-04-01 | 电子科技大学 | 一种基于范数的对抗性样本检测分类方法 |
| WO2021112335A1 (ko) * | 2019-12-06 | 2021-06-10 | 주식회사 애자일소다 | 생성적 적대 신경망 기반의 분류 시스템 및 방법 |
| KR102093080B1 (ko) * | 2019-12-06 | 2020-04-27 | 주식회사 애자일소다 | 레이블 데이터 및 비레이블 데이터를 이용한 생성적 적대 신경망 기반의 분류 시스템 및 방법 |
| CN112926174B (zh) * | 2019-12-06 | 2024-07-09 | 富益成科技有限公司 | 电池智能分流的控制方法及系统 |
| US11551145B2 (en) | 2020-02-05 | 2023-01-10 | International Business Machines Corporation | Performance based switching of a model training process |
| WO2021158225A1 (en) * | 2020-02-06 | 2021-08-12 | Hewlett-Packard Development Company, L.P. | Controlling machine learning model structures |
| CN111399933B (zh) * | 2020-02-11 | 2022-05-31 | 福建师范大学 | 一种边缘-云混合计算环境下的dnn任务卸载方法及终端 |
| US11586932B2 (en) | 2020-03-10 | 2023-02-21 | International Business Machines Corporation | Model training with variable batch sizing and gradient checkpoint segments |
| CN111401430B (zh) * | 2020-03-12 | 2022-04-01 | 四川大学 | 一种基于双通道深度神经网络的图像在线分类方法 |
| US20230093630A1 (en) * | 2020-03-17 | 2023-03-23 | Interdigital Ce Patent Holdings | System and method for adapting to changing constraints |
| KR102488281B1 (ko) * | 2020-03-30 | 2023-01-13 | 주식회사 모빌린트 | 인공신경망의 활성값 및 가중값의 정밀도를 적응적으로 제어하는 방법 및 그 장치 |
| CN113688851B (zh) * | 2020-05-18 | 2023-09-15 | 华为云计算技术有限公司 | 数据标注方法和装置和精细粒度识别方法和装置 |
| US12015526B2 (en) * | 2020-05-26 | 2024-06-18 | Synopsys, Inc. | Mixed-precision neural networks |
| KR102831990B1 (ko) * | 2020-06-11 | 2025-07-10 | 울산과학기술원 | 이기종 그래픽 프로세서 유닛 클러스터를 이용한 마이크로서비스 기반의 트레이닝 시스템 및 그 동작 방법 |
| CN111738419B (zh) * | 2020-06-19 | 2024-01-12 | 北京百度网讯科技有限公司 | 神经网络模型的量化方法和装置 |
| CN111783957B (zh) * | 2020-07-02 | 2024-05-03 | 厦门美图之家科技有限公司 | 模型量化训练方法、装置、机器可读存储介质及电子设备 |
| CN111831354B (zh) * | 2020-07-09 | 2023-05-16 | 北京灵汐科技有限公司 | 数据精度配置方法、装置、芯片、芯片阵列、设备及介质 |
| US12591771B2 (en) | 2020-09-29 | 2026-03-31 | Qualcomm Incorporated | Dynamic quantization for energy efficient deep learning |
| WO2022081260A1 (en) | 2020-10-16 | 2022-04-21 | Starkey Laboratories, Inc. | Hearing device with dynamic neural networks for sound enhancement |
| US12488249B2 (en) * | 2020-10-20 | 2025-12-02 | Samsung Electronics Co., Ltd. | Secure, accurate and fast neural network inference by replacing at least one non-linear activation channel |
| CN112311488A (zh) * | 2020-11-05 | 2021-02-02 | 上海应用技术大学 | 基于小波分解的频谱感知方法 |
| US12159238B2 (en) | 2020-12-10 | 2024-12-03 | International Business Machines Corporation | Automated machine learning model selection |
| GB2602294B (en) * | 2020-12-22 | 2024-05-29 | Imagination Tech Ltd | Compressing a set of coefficients for subsequent use in a neural network |
| US20220253713A1 (en) * | 2021-02-05 | 2022-08-11 | Google Llc | Training neural networks using layer-wise losses |
| KR102314864B1 (ko) * | 2021-03-29 | 2021-10-19 | 주식회사 리트빅 | 차량운전 상태정보를 이용한 에지 딥러닝 기반의 차량 안전운전 시스템 |
| KR20220147398A (ko) * | 2021-04-27 | 2022-11-03 | 삼성전자주식회사 | 인공 지능 모델에 기반하여 데이터를 처리하는 전자 장치 및 그 동작 방법 |
| CN113761787B (zh) * | 2021-07-19 | 2024-08-02 | 中南大学 | 基于深度迁移网络的高炉铁水硅含量在线预测方法及系统 |
| WO2023023265A1 (en) | 2021-08-19 | 2023-02-23 | Tesla, Inc. | Vision-based system training with simulated content |
| US12462575B2 (en) | 2021-08-19 | 2025-11-04 | Tesla, Inc. | Vision-based machine learning model for autonomous driving with adjustable virtual camera |
| KR102590993B1 (ko) * | 2021-09-03 | 2023-10-19 | 한국전자기술연구원 | 적응형 배치 프로세싱 방법 및 시스템 |
| CN113872873B (zh) * | 2021-09-29 | 2023-05-02 | 西安交通大学 | 一种适合5g新应用的多场景跨层拥塞控制方法 |
| CN114037055A (zh) * | 2021-11-05 | 2022-02-11 | 北京市商汤科技开发有限公司 | 数据处理系统、方法、装置、设备及存储介质 |
| CN114118384B (zh) * | 2021-12-09 | 2024-06-04 | 安谋科技（中国）有限公司 | 神经网络模型的量化方法、可读介质和电子设备 |
| US20250159177A1 (en) * | 2022-02-18 | 2025-05-15 | Intellectual Discovery Co., Ltd. | Feature map compression method and apparatus |
| WO2023184359A1 (en) * | 2022-03-31 | 2023-10-05 | Qualcomm Incorporated | System and method for image processing using mixed inference precision |
| CN114861654B (zh) * | 2022-03-31 | 2025-02-14 | 合肥伴学虎科技有限公司 | 一种中文文本中基于词性融合的对抗训练的防御方法 |
| CN115131858B (zh) * | 2022-06-27 | 2025-11-18 | 合肥的卢深视科技有限公司 | 模型训练方法、人脸识别方法、电子设备及存储介质 |
| WO2024063524A1 (ko) * | 2022-09-21 | 2024-03-28 | 엘지전자 주식회사 | 무선 통신 시스템에서 온라인 학습을 수행하기 위한 장치 및 방법 |
| CN116451824B (zh) * | 2022-12-16 | 2024-08-20 | 西北工业大学 | 一种基于神经网络和蜜罐优化的光伏功率预测方法 |
| WO2024155015A1 (ko) * | 2023-01-18 | 2024-07-25 | 삼성전자 주식회사 | 영상 복호화 방법 및 장치, 및 영상 부호화 방법 및 장치 |
| CN116381536B (zh) * | 2023-03-07 | 2024-03-19 | 华中科技大学 | 一种基于回归元学习的锂电池健康状态预测的方法及系统 |
| CN116129249B (zh) * | 2023-04-04 | 2023-07-07 | 上海燧原科技有限公司 | 一种图像处理方法、装置、电子设备和存储介质 |
| CN121195482A (zh) | 2023-05-11 | 2025-12-23 | 欧摩威德国有限公司 | 用于无线电接入网络的高级模型适配的方法 |
| CN116451757B (zh) * | 2023-06-19 | 2023-09-08 | 山东浪潮科学研究院有限公司 | 一种神经网络模型的异构加速方法、装置、设备及介质 |
| CN117033733B (zh) * | 2023-10-09 | 2023-12-22 | 北京民谐文化传播有限公司 | 图书馆资源的智能自动分类与标签生成系统及方法 |
| US20250148277A1 (en) * | 2023-11-03 | 2025-05-08 | Dell Products L.P. | Entropy-based online learning with active sparse layer update for on-device training with resource-constrained devices |
| CN118196514B (zh) * | 2024-03-25 | 2024-10-01 | 东营市人民医院 | 医疗影像识别模型生成方法及系统 |
| WO2026032725A1 (en) | 2024-08-07 | 2026-02-12 | Aumovio Germany Gmbh | Method of model associated ml condition matching |
| CN119004468B (zh) * | 2024-10-24 | 2025-02-11 | 浙江君同智能科技有限责任公司 | 基于生成对抗网络数据解耦的数据平衡去毒方法 |
| CN119741543B (zh) * | 2024-12-10 | 2025-12-02 | 重庆邮电大学 | 一种用于物联网cnn推理的双支路模型训练方法 |
| CN120277469B (zh) * | 2025-04-01 | 2025-08-22 | 西北大学 | 一种基于参数融合的地层总有机碳预测方法 |
| CN120454204B (zh) * | 2025-07-01 | 2025-09-19 | 南京德睿特来电能源研究院有限公司 | 虚拟电厂功率控制方法、装置、设备及存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0628323A (ja) * | 1992-07-06 | 1994-02-04 | Nippon Telegr & Teleph Corp <Ntt> | プロセス実行制御方法 |
| JP2017509982A (ja) * | 2014-02-21 | 2017-04-06 | クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ | 原位置ニューラルネットワークコプロセッシング |
| US20170270408A1 (en) * | 2016-03-16 | 2017-09-21 | Hong Kong Applied Science and Technology Research Institute Company, Limited | Method and System for Bit-Depth Reduction in Artificial Neural Networks |
| JP2018010618A (ja) * | 2016-05-03 | 2018-01-18 | イマジネイション テクノロジーズ リミテッド | 畳み込みニューラルネットワークハードウエア構成 |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0451386A (ja) * | 1990-06-19 | 1992-02-19 | Canon Inc | ニューラルネットワーク及びその構築方法 |
| KR102329590B1 (ko) * | 2018-03-19 | 2021-11-19 | 에스알아이 인터내셔널 | 딥 신경망들의 동적 적응 |
-
2019
- 2019-03-19 KR KR1020190031438A patent/KR102329590B1/ko active Active
- 2019-03-19 EP EP19163921.0A patent/EP3543917B1/en active Active
- 2019-03-19 JP JP2019051636A patent/JP2019164793A/ja not_active Withdrawn
-
2022
- 2022-01-06 JP JP2022001150A patent/JP2022066192A/ja not_active Withdrawn
-
2024
- 2024-01-25 JP JP2024009579A patent/JP7725628B2/ja active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0628323A (ja) * | 1992-07-06 | 1994-02-04 | Nippon Telegr & Teleph Corp <Ntt> | プロセス実行制御方法 |
| JP2017509982A (ja) * | 2014-02-21 | 2017-04-06 | クゥアルコム・インコーポレイテッドＱｕａｌｃｏｍｍ Ｉｎｃｏｒｐｏｒａｔｅｄ | 原位置ニューラルネットワークコプロセッシング |
| US20170270408A1 (en) * | 2016-03-16 | 2017-09-21 | Hong Kong Applied Science and Technology Research Institute Company, Limited | Method and System for Bit-Depth Reduction in Artificial Neural Networks |
| JP2018010618A (ja) * | 2016-05-03 | 2018-01-18 | イマジネイション テクノロジーズ リミテッド | 畳み込みニューラルネットワークハードウエア構成 |
Non-Patent Citations (3)
| Title |
|---|
| ASWIN RAGHAVAN他: "BitNet: Bit-Regularized Deep Neural Networks", CORNELL UNIVERSITY LIBRARY, vol. v1, JPN6020024832, 16 August 2017 (2017-08-16), US, ISSN: 0004588933 * |
| GEOFFREY HINTON他, DISTILLING THE KNOWLEDGE IN A NEURAL NETWORK, JPN6020042798, 9 March 2015 (2015-03-09), US, ISSN: 0004588935 * |
| 廣瀬 一俊 他: "対数量子化による深層ニューラルネットワークのメモリ量削減", 電子情報通信学会技術研究報告, vol. 117, no. 45, JPN6020024835, 9 June 2017 (2017-06-09), JP, pages 39 - 44, ISSN: 0004588934 * |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2022066192A (ja) * | 2018-03-19 | 2022-04-28 | エスアールアイ インターナショナル | ディープニューラルネットワークの動的適応 |
| US12033068B2 (en) | 2018-06-22 | 2024-07-09 | Advanced New Technologies Co., Ltd. | Method and device for cash advance recognition |
| US11899765B2 (en) | 2019-12-23 | 2024-02-13 | Dts Inc. | Dual-factor identification system and method with adaptive enrollment |
| US12321836B2 (en) | 2020-02-21 | 2025-06-03 | Actapio, Inc. | Learning device, learning method, learning program, evaluation device, evaluation method, and evaluation program |
| JP2022054660A (ja) * | 2020-09-28 | 2022-04-07 | 沖電気工業株式会社 | ニューラルネットワーク軽量化装置、ニューラルネットワーク軽量化方法およびプログラム |
| JP6992864B1 (ja) | 2020-09-28 | 2022-01-13 | 沖電気工業株式会社 | ニューラルネットワーク軽量化装置、ニューラルネットワーク軽量化方法およびプログラム |
| JP7556145B2 (ja) | 2020-10-23 | 2024-09-25 | 維沃移動通信有限公司 | 通信情報の送信、受信方法及び通信機器 |
| JP2023550690A (ja) * | 2020-10-23 | 2023-12-05 | 維沃移動通信有限公司 | 通信情報の送信、受信方法及び通信機器 |
| JP2023004024A (ja) * | 2021-06-25 | 2023-01-17 | 株式会社モルフォ | 計算手法決定システム、計算手法決定方法、及び、計算手法決定プログラム |
| JP7187065B1 (ja) | 2021-06-25 | 2022-12-12 | 株式会社モルフォ | 計算手法決定システム、計算手法決定方法、及び、計算手法決定プログラム |
| US12619869B2 (en) | 2021-09-09 | 2026-05-05 | Actapio, Inc. | Learning apparatus, learning method, and a non-transitory computer-readable storage medium |
| WO2023120205A1 (ja) | 2021-12-24 | 2023-06-29 | ソニーセミコンダクタソリューションズ株式会社 | 推論装置、推論方法及び推論プログラム |
| JP2025513676A (ja) * | 2022-02-28 | 2025-04-30 | クゥアルコム・インコーポレイテッド | マルチプロセッサコンピューティングデバイス内で機械学習演算を実行するための適応スケジューリング |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2022066192A (ja) | 2022-04-28 |
| EP3543917B1 (en) | 2024-01-03 |
| JP2024050691A (ja) | 2024-04-10 |
| JP7725628B2 (ja) | 2025-08-19 |
| KR102329590B1 (ko) | 2021-11-19 |
| EP3543917A1 (en) | 2019-09-25 |
| KR20190110068A (ko) | 2019-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7725628B2 (ja) | ディープニューラルネットワークの動的適応 | |
| US11429862B2 (en) | Dynamic adaptation of deep neural networks | |
| Roth et al. | Resource-efficient neural networks for embedded systems | |
| Choudhary et al. | A comprehensive survey on model compression and acceleration | |
| Mishra et al. | A survey on deep neural network compression: Challenges, overview, and solutions | |
| Joy et al. | Fast hyperparameter tuning using Bayesian optimization with directional derivatives | |
| US12131258B2 (en) | Joint pruning and quantization scheme for deep neural networks | |
| Choi et al. | Pact: Parameterized clipping activation for quantized neural networks | |
| Tjandra et al. | Compressing recurrent neural network with tensor train | |
| Rastegari et al. | Xnor-net: Imagenet classification using binary convolutional neural networks | |
| CN116830122B (zh) | 用于联合学习的方法、系统和装置 | |
| US20160328644A1 (en) | Adaptive selection of artificial neural networks | |
| CN113632106A (zh) | 人工神经网络的混合精度训练 | |
| WO2020095321A2 (en) | Dynamic structure neural machine for solving prediction problems with uses in machine learning | |
| CN109829420A (zh) | 一种基于改进蚁狮优化算法的高光谱图像的特征选择方法 | |
| CN113222139A (zh) | 神经网络训练方法和装置、设备，及计算机存储介质 | |
| Ni et al. | Efficient off-policy reinforcement learning via brain-inspired computing | |
| GB2572164A (en) | Artificial neural networks | |
| Kokhazadeh et al. | A design space exploration methodology for enabling tensor train decomposition in edge devices | |
| Violos et al. | Frugal machine learning for energy-efficient and resource-aware artificial intelligence | |
| US20230185352A1 (en) | Analog mac aware dnn improvement | |
| Wang et al. | A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting | |
| CN111291866A (zh) | 神经网络的生成、图像处理、智能行驶控制方法及装置 | |
| Wang et al. | Pruning-Optimized Bayesian Neural Networks for Image Classification | |
| US20250371100A1 (en) | Efficient sampling for theorem proving |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A711 | Notification of change in applicant |
Free format text: JAPANESE INTERMEDIATE CODE: A711 Effective date: 20190607 |
|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190613 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20190607 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20200703 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200714 |
|
| A524 | Written submission of copy of amendment under article 19 pct |
Free format text: JAPANESE INTERMEDIATE CODE: A524 Effective date: 20201014 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20201110 |
|
| A601 | Written request for extension of time |
Free format text: JAPANESE INTERMEDIATE CODE: A601 Effective date: 20210203 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20210427 |
|
| A02 | Decision of refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A02 Effective date: 20210907 |
|
| A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220106 |
|
| C60 | Trial request (containing other claim documents, opposition documents) |
Free format text: JAPANESE INTERMEDIATE CODE: C60 Effective date: 20220106 |
|
| C11 | Written invitation by the commissioner to file amendments |
Free format text: JAPANESE INTERMEDIATE CODE: C11 Effective date: 20220118 |
|
| A911 | Transfer to examiner for re-examination before appeal (zenchi) |
Free format text: JAPANESE INTERMEDIATE CODE: A911 Effective date: 20220302 |
|
| C21 | Notice of transfer of a case for reconsideration by examiners before appeal proceedings |
Free format text: JAPANESE INTERMEDIATE CODE: C21 Effective date: 20220308 |
|
| A761 | Written withdrawal of application |
Free format text: JAPANESE INTERMEDIATE CODE: A761 Effective date: 20220318 |