JP2023024993A5 - - Google Patents

Download PDF

Info

Publication number
JP2023024993A5
JP2023024993A5 JP2022177577A JP2022177577A JP2023024993A5 JP 2023024993 A5 JP2023024993 A5 JP 2023024993A5 JP 2022177577 A JP2022177577 A JP 2022177577A JP 2022177577 A JP2022177577 A JP 2022177577A JP 2023024993 A5 JP2023024993 A5 JP 2023024993A5
Authority
JP
Japan
Prior art keywords
neural network
controller
child
instance
training
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2022177577A
Other languages
English (en)
Japanese (ja)
Other versions
JP7516482B2 (ja
JP2023024993A (ja
Filing date
Publication date
Priority claimed from JP2020215172A external-priority patent/JP7210531B2/ja
Application filed filed Critical
Publication of JP2023024993A publication Critical patent/JP2023024993A/ja
Publication of JP2023024993A5 publication Critical patent/JP2023024993A5/ja
Application granted granted Critical
Publication of JP7516482B2 publication Critical patent/JP7516482B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2022177577A 2016-10-28 2022-11-04 ニューラルアーキテクチャ検索 Active JP7516482B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662414300P 2016-10-28 2016-10-28
US62/414,300 2016-10-28
JP2020215172A JP7210531B2 (ja) 2016-10-28 2020-12-24 ニューラルアーキテクチャ検索

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
JP2020215172A Division JP7210531B2 (ja) 2016-10-28 2020-12-24 ニューラルアーキテクチャ検索

Publications (3)

Publication Number Publication Date
JP2023024993A JP2023024993A (ja) 2023-02-21
JP2023024993A5 true JP2023024993A5 (https=) 2023-06-19
JP7516482B2 JP7516482B2 (ja) 2024-07-16

Family

ID=60473590

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2019522868A Active JP6817431B2 (ja) 2016-10-28 2017-10-27 ニューラルアーキテクチャ検索
JP2020215172A Active JP7210531B2 (ja) 2016-10-28 2020-12-24 ニューラルアーキテクチャ検索
JP2022177577A Active JP7516482B2 (ja) 2016-10-28 2022-11-04 ニューラルアーキテクチャ検索

Family Applications Before (2)

Application Number Title Priority Date Filing Date
JP2019522868A Active JP6817431B2 (ja) 2016-10-28 2017-10-27 ニューラルアーキテクチャ検索
JP2020215172A Active JP7210531B2 (ja) 2016-10-28 2020-12-24 ニューラルアーキテクチャ検索

Country Status (6)

Country Link
US (3) US11030523B2 (https=)
JP (3) JP6817431B2 (https=)
KR (2) KR102532658B1 (https=)
CN (1) CN108021983A (https=)
DE (2) DE202017106532U1 (https=)
WO (1) WO2018081563A1 (https=)

Families Citing this family (87)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10565493B2 (en) * 2016-09-22 2020-02-18 Salesforce.Com, Inc. Pointer sentinel mixture architecture
DE202017106532U1 (de) * 2016-10-28 2018-02-05 Google Llc Suche nach einer neuronalen Architektur
EP3602316A4 (en) * 2017-03-24 2020-12-30 D5A1 Llc LEARNING COACH FOR AUTOMATIC LEARNING SYSTEM
US12014257B2 (en) * 2017-05-19 2024-06-18 Salesforce, Inc. Domain specific language for generation of recurrent neural network architectures
CN111406264B (zh) 2017-10-27 2024-10-18 谷歌有限责任公司 神经架构搜索
US11741342B2 (en) * 2018-05-18 2023-08-29 Baidu Usa Llc Resource-efficient neural architects
WO2019232099A1 (en) * 2018-05-29 2019-12-05 Google Llc Neural architecture search for dense image prediction tasks
CN111033535B (zh) * 2018-06-05 2024-03-26 北京嘀嘀无限科技发展有限公司 用于乘车订单调度的系统和方法
JP7287397B2 (ja) 2018-08-03 2023-06-06 ソニーグループ株式会社 情報処理方法、情報処理装置及び情報処理プログラム
US12086718B2 (en) 2018-08-07 2024-09-10 Amadeus S.A.S. Machine learning systems and methods for attributed sequences
CN110826686B (zh) * 2018-08-07 2024-09-06 艾玛迪斯简易股份公司 有属性序列的机器学习系统和方法
KR20200023238A (ko) 2018-08-23 2020-03-04 삼성전자주식회사 딥러닝 모델을 생성하는 방법 및 시스템
CN109255374A (zh) * 2018-08-27 2019-01-22 中共中央办公厅电子科技学院 一种基于密集卷积网络和多任务网络的美学属性评价方法
EP3617953A1 (en) 2018-08-30 2020-03-04 Koninklijke Philips N.V. An adaptable neural network
CN109189973B (zh) * 2018-08-30 2021-07-30 清华大学 基于策略梯度的大规模图像检索方法及装置
CN109065076B (zh) * 2018-09-05 2020-11-27 深圳追一科技有限公司 音频标签的设置方法、装置、设备和存储介质
US11334791B2 (en) * 2018-09-05 2022-05-17 Siemens Healthcare Gmbh Learning to search deep network architectures
CN110889487A (zh) * 2018-09-10 2020-03-17 富士通株式会社 神经网络架构搜索装置和方法及计算机可读记录介质
KR102066009B1 (ko) * 2018-09-14 2020-01-14 가천대학교 산학협력단 순환신경망을 사용한 의료영상기기의 영상복원 시스템
US11645509B2 (en) * 2018-09-27 2023-05-09 Salesforce.Com, Inc. Continual neural network learning via explicit structure learning
EP3629246B1 (en) * 2018-09-27 2022-05-18 Swisscom AG Systems and methods for neural architecture search
US20200104715A1 (en) * 2018-09-28 2020-04-02 Xilinx, Inc. Training of neural networks by including implementation cost as an objective
US11604992B2 (en) 2018-11-02 2023-03-14 Microsoft Technology Licensing, Llc Probabilistic neural network architecture generation
CN111144561B (zh) * 2018-11-05 2023-05-02 杭州海康威视数字技术股份有限公司 一种神经网络模型确定方法及装置
US11775812B2 (en) 2018-11-30 2023-10-03 Samsung Electronics Co., Ltd. Multi-task based lifelong learning
CN109615073B (zh) * 2018-12-03 2021-06-04 郑州云海信息技术有限公司 一种神经网络模型的构建方法、设备以及存储介质
US11556778B2 (en) * 2018-12-07 2023-01-17 Microsoft Technology Licensing, Llc Automated generation of machine learning models
CN111325311B (zh) * 2018-12-14 2024-03-29 深圳云天励飞技术有限公司 用于图像识别的神经网络模型生成方法及相关设备
US11114103B2 (en) * 2018-12-28 2021-09-07 Alibaba Group Holding Limited Systems, methods, and computer-readable storage media for audio signal processing
US10789510B2 (en) * 2019-01-11 2020-09-29 Google Llc Dynamic minibatch sizes
US10909457B2 (en) 2019-01-23 2021-02-02 Google Llc Compound model scaling for neural networks
US11790212B2 (en) * 2019-03-18 2023-10-17 Microsoft Technology Licensing, Llc Quantization-aware neural architecture search
US12050979B2 (en) 2019-03-19 2024-07-30 Cisco Technology, Inc. Budgeted neural network architecture search system and method
US11630990B2 (en) 2019-03-19 2023-04-18 Cisco Technology, Inc. Systems and methods for auto machine learning and neural architecture search
DE102019204136A1 (de) * 2019-03-26 2020-10-01 Robert Bosch Gmbh Verfahren und Vorrichtung für Training und Herstellung eines künstlichen neuronalen Netzes
DE102019205081A1 (de) * 2019-04-09 2020-10-15 Robert Bosch Gmbh Verfahren, Vorrichtung und Computerprogramm zum Betreiben eines tiefen neuronalen Netzes
CN110110861B (zh) * 2019-05-09 2021-11-26 北京市商汤科技开发有限公司 确定模型超参数及模型训练的方法和装置、存储介质
WO2020237168A1 (en) * 2019-05-23 2020-11-26 Google Llc Connection weight learning for guided architecture evolution
CN111684471A (zh) * 2019-05-31 2020-09-18 深圳市大疆创新科技有限公司 网络结构搜索的方法及装置、计算机存储介质和计算机程序产品
CN110288084A (zh) * 2019-06-06 2019-09-27 北京小米智能科技有限公司 超网络训练方法和装置
US11640539B2 (en) * 2019-07-08 2023-05-02 Vianai Systems, Inc. Techniques for visualizing the operation of neural networks using samples of training data
DE102019210167A1 (de) * 2019-07-10 2021-01-14 Robert Bosch Gmbh Robusteres Training für künstliche neuronale Netzwerke
CN110490320B (zh) * 2019-07-30 2022-08-23 西北工业大学 基于预测机制和遗传算法融合的深度神经网络结构优化方法
US11443162B2 (en) * 2019-08-23 2022-09-13 Google Llc Resource constrained neural network architecture search
CN110428046B (zh) * 2019-08-28 2023-12-15 腾讯科技(深圳)有限公司 神经网络结构的获取方法及装置、存储介质
CN110598852A (zh) * 2019-08-29 2019-12-20 北京小米移动软件有限公司 子网络采样方法、构建超网络拓扑结构的方法及装置
CN110598629B (zh) * 2019-09-11 2023-06-06 北京百度网讯科技有限公司 超网络的搜索空间构建方法、装置以及电子设备
CN110543944B (zh) * 2019-09-11 2022-08-02 北京百度网讯科技有限公司 神经网络结构搜索方法、装置、电子设备和介质
EP4012630A4 (en) 2019-09-17 2022-11-23 Huawei Cloud Computing Technologies Co., Ltd. METHOD AND DEVICE FOR MODEL OPTIMIZATION, STORAGE MEDIA AND DEVICE
IL291346B2 (en) * 2019-09-25 2026-01-01 Deepmind Tech Ltd Augmenting attention-based neural networks for selective processing of past inputs
US12293298B2 (en) * 2019-11-04 2025-05-06 Baidu Usa Llc Reducing training times of deep neural networks through efficient hybrid parallelism
CN110956262A (zh) * 2019-11-12 2020-04-03 北京小米智能科技有限公司 超网络训练方法及装置、电子设备、存储介质
CN112884118A (zh) * 2019-11-30 2021-06-01 华为技术有限公司 神经网络的搜索方法、装置及设备
CN112990461B (zh) * 2019-12-16 2023-09-19 杭州海康威视数字技术股份有限公司 构建神经网络模型的方法、装置、计算机设备和存储介质
CN113128678B (zh) * 2020-01-15 2025-05-09 华为技术有限公司 神经网络的自适应搜索方法及装置
WO2021154722A1 (en) * 2020-01-27 2021-08-05 Akkio, Inc. Methods and systems for dynamically generating a plurality of machine learning systems during processing of a user data set
EP4078458A1 (en) * 2020-02-07 2022-10-26 Google LLC Searching for normalization-activation layer architectures
US11521028B2 (en) 2020-04-10 2022-12-06 Toyota Research Institute, Inc. Meta-learning neural architecture search via graph networks on search space lattices
CN111516700A (zh) * 2020-05-11 2020-08-11 安徽大学 一种驾驶员分心细粒度监测方法和系统
TWI831016B (zh) 2020-06-05 2024-02-01 宏達國際電子股份有限公司 機器學習方法、機器學習系統以及非暫態電腦可讀取媒體
CN115398446A (zh) * 2020-06-05 2022-11-25 谷歌有限责任公司 使用符号编程的机器学习算法搜索
US11436498B2 (en) * 2020-06-09 2022-09-06 Toyota Research Institute, Inc. Neural architecture search system for generating a neural network architecture
CN113837374B (zh) * 2020-06-23 2026-01-02 中兴通讯股份有限公司 神经网络的生成方法、设备及计算机可读存储介质
CN111782398B (zh) * 2020-06-29 2024-12-13 上海商汤智能科技有限公司 数据处理的方法、装置、系统及相关设备
JP6885553B1 (ja) * 2020-07-14 2021-06-16 エッジコーティックス ピーティーイー. リミテッド ハードウェアとニューラルアーキテクチャとの共同探索
DE102020208828A1 (de) * 2020-07-15 2022-01-20 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Vorrichtung zum Erstellen eines maschinellen Lernsystems
EP4201036A1 (en) * 2020-08-18 2023-06-28 Qualcomm Incorporated Reporting configurations for neural network-based processing at a ue
EP3975060A1 (en) * 2020-09-29 2022-03-30 Samsung Electronics Co., Ltd. Method and apparatus for analysing neural network performance
US20220101063A1 (en) * 2020-09-29 2022-03-31 Samsung Electronics Co., Ltd. Method and apparatus for analyzing neural network performance
US20240005129A1 (en) * 2020-10-02 2024-01-04 Google Llc Neural architecture and hardware accelerator search
KR102264571B1 (ko) * 2020-10-30 2021-06-15 주식회사 애자일소다 계층 구조를 갖는 의사결정 에이전트
US20220180207A1 (en) * 2020-12-04 2022-06-09 Google Llc Automated Machine Learning for Time Series Prediction
US20220198260A1 (en) * 2020-12-22 2022-06-23 International Business Machines Corporation Multi-level multi-objective automated machine learning
US12498908B2 (en) 2021-01-26 2025-12-16 Akkio Inc. Methods and systems for automatically generating and executing computer code using a natural language description of a data manipulation to be performed on a data set
CN116868204A (zh) 2021-02-04 2023-10-10 谷歌有限责任公司 用于机器学习模型的渐进学习以优化训练速度的系统和方法
CN115393662A (zh) * 2021-05-08 2022-11-25 Oppo广东移动通信有限公司 图像处理方法、装置、计算机设备及存储介质
US12028188B2 (en) 2021-05-12 2024-07-02 Analog Devices, Inc. Digital predistortion with hybrid basis-function-based actuator and neural network
US12003261B2 (en) 2021-05-12 2024-06-04 Analog Devices, Inc. Model architecture search and optimization for hardware
CN113469078B (zh) * 2021-07-07 2023-07-04 西安电子科技大学 基于自动设计长短时记忆网络的高光谱图像分类方法
WO2023009766A1 (en) * 2021-07-28 2023-02-02 Google Llc Evaluating output sequences using an auto-regressive language model neural network
DE102021208197A1 (de) * 2021-07-29 2023-02-02 Robert Bosch Gesellschaft mit beschränkter Haftung Verfahren und Vorrichtung zum Erstellen eines maschinellen Lernsystems
KR102610429B1 (ko) * 2021-09-13 2023-12-06 연세대학교 산학협력단 인공신경망과 연산 가속기 구조 통합 탐색 장치 및 방법
KR20230100914A (ko) 2021-12-29 2023-07-06 경희대학교 산학협력단 인공신경망 탐색 방법 및 이를 수행하기 위한 컴퓨팅 장치
US12346665B2 (en) 2022-02-14 2025-07-01 International Business Machines Corporation Neural architecture search of language models using knowledge distillation
KR20230152448A (ko) * 2022-04-27 2023-11-03 현대자동차주식회사 Enas를 적용한 소음 및 진동 데이터 기반 이상상태 진단을 위한 ai 진단모델 자동생성 방법
KR102782300B1 (ko) 2022-05-16 2025-03-17 주식회사 뷰노 생체 신호 분석 방법
CN118798312A (zh) * 2024-01-17 2024-10-18 中国移动通信有限公司研究院 对话生成模型的训练方法、对话生成方法及装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6553357B2 (en) * 1999-09-01 2003-04-22 Koninklijke Philips Electronics N.V. Method for improving neural network architectures using evolutionary algorithms
CN102402712B (zh) 2011-08-31 2014-03-05 山东大学 基于神经网络的机器人强化学习初始化方法
US10275719B2 (en) * 2015-01-29 2019-04-30 Qualcomm Incorporated Hyper-parameter selection for deep convolutional networks
JP2017102906A (ja) * 2015-11-25 2017-06-08 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
JP6470165B2 (ja) * 2015-12-15 2019-02-13 株式会社東芝 サーバ、システム及び探索方法
US9899672B2 (en) 2016-05-17 2018-02-20 Nanotek Instruments, Inc. Chemical-free production of graphene-encapsulated electrode active material particles for battery applications
DE202017106532U1 (de) * 2016-10-28 2018-02-05 Google Llc Suche nach einer neuronalen Architektur

Similar Documents

Publication Publication Date Title
JP2023024993A5 (https=)
US11829874B2 (en) Neural architecture search
CN110490717B (zh) 基于用户会话及图卷积神经网络的商品推荐方法及系统
Ghosh et al. Misspecified linear bandits
KR102302609B1 (ko) 신경망 아키텍처 최적화
CN111406264B (zh) 神经架构搜索
Hadgu et al. Large-scale learning with AdaGrad on Spark
CN108090788B (zh) 基于时间信息集成模型的广告转化率预估方法
US12271797B2 (en) Feature selection for model training
US12566942B2 (en) System and method for generating parametric activation functions
CN113051938B (zh) 一种基于Transformer模型的机器翻译模型优化方法
KR102142943B1 (ko) 클라우드 기반의 인공지능 연산 서비스 방법 및 이를 수행하는 장치
WO2021226709A1 (en) Neural architecture search with imitation learning
Gong et al. Towards auto-regressive next-token prediction: In-context learning emerges from generalization
US11580358B1 (en) Optimization with behavioral evaluation and rule base coverage
CN116796073A (zh) 一种基于特征增强的图对比学习会话推荐方法
Mete et al. Predicting the optimizability for workflow decisions
KR102559605B1 (ko) 함수 최적화 방법 및 장치
CN117829149B (zh) 一种语言模型混合训练方法、装置、电子设备和存储介质
Xue et al. An improved extreme learning machine based on variable-length particle swarm optimization
CN118503764A (zh) 一种自然语言处理模型的流水线并行训练方法、系统、终端及存储介质
CN118396038A (zh) 参数调优信息的确定方法、装置及电子设备
Jankee et al. A fitness cloud model for adaptive metaheuristic selection methods
Candan et al. Non stationary operator selection with island models
CN106096731A (zh) 一种步长递减的进化策略优化算法