CN116258183A - 用于神经网络架构搜索的方法和装置 - Google Patents

用于神经网络架构搜索的方法和装置 Download PDF

Info

Publication number
CN116258183A
CN116258183A CN202210663806.3A CN202210663806A CN116258183A CN 116258183 A CN116258183 A CN 116258183A CN 202210663806 A CN202210663806 A CN 202210663806A CN 116258183 A CN116258183 A CN 116258183A
Authority
CN
China
Prior art keywords
neural network
hardware resource
architecture
candidate
loss
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210663806.3A
Other languages
English (en)
Chinese (zh)
Inventor
李元熙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN116258183A publication Critical patent/CN116258183A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48—Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/50—Adding; Subtracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Neurology (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
CN202210663806.3A 2021-12-03 2022-06-13 用于神经网络架构搜索的方法和装置 Pending CN116258183A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2021-0171979 2021-12-03
KR1020210171979A KR20230083716A (ko) 2021-12-03 2021-12-03 뉴럴 네트워크의 최적의 아키텍쳐를 탐색하는 장치 및 방법

Publications (1)

Publication Number Publication Date
CN116258183A true CN116258183A (zh) 2023-06-13

Family

ID=83191939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210663806.3A Pending CN116258183A (zh) 2021-12-03 2022-06-13 用于神经网络架构搜索的方法和装置

Country Status (5)

Country Link
US (1) US20230177308A1 (enExample)
EP (1) EP4191481A1 (enExample)
JP (1) JP2023083207A (enExample)
KR (1) KR20230083716A (enExample)
CN (1) CN116258183A (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112868033A (zh) * 2018-10-01 2021-05-28 谷歌有限责任公司 用于提供具有可调节计算需求的机器学习模型的系统和方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112868033A (zh) * 2018-10-01 2021-05-28 谷歌有限责任公司 用于提供具有可调节计算需求的机器学习模型的系统和方法
CN112868033B (zh) * 2018-10-01 2025-04-22 谷歌有限责任公司 用于提供具有可调节计算需求的机器学习模型的系统和方法

Also Published As

Publication number Publication date
KR20230083716A (ko) 2023-06-12
EP4191481A1 (en) 2023-06-07
JP2023083207A (ja) 2023-06-15
US20230177308A1 (en) 2023-06-08

Similar Documents

Publication Publication Date Title
CN112002309B (zh) 模型训练方法和设备
CN111428852A (zh) 用于神经网络量化的方法和装置
US20230169333A1 (en) Method and apparatus with distributed training of neural network
CN111340177B (zh) 基于嵌套位表示的神经网络处理方法和设备
US11763153B2 (en) Method and apparatus with neural network operation
US20220198270A1 (en) Neural network model training method and apparatus
US20220108180A1 (en) Method and apparatus for compressing artificial neural network
CN110163240A (zh) 对象识别方法及设备
US12373681B2 (en) Neuromorphic method and apparatus with multi-bit neuromorphic operation
US11475312B2 (en) Method and apparatus with deep neural network model fusing
CN115861675A (zh) 对象分类方法和设备
CN113408693A (zh) 识别图像的方法和设备
CN116152082A (zh) 用于图像去模糊的方法和设备
CN112015424B (zh) 编译用于机器学习模型的代码以用于在专用处理器上执行
US20210312269A1 (en) Neural network device for neural network operation, method of operating neural network device, and application processor including neural network device
CN116258183A (zh) 用于神经网络架构搜索的方法和装置
KR102783991B1 (ko) 뉴럴 네트워크 장치 및 뉴럴 네트워크 장치에서 멀티-비트 연산을 처리하는 방법
CN116663640A (zh) 用于剪枝的方法和设备
US20250190425A1 (en) Method and system for ai-based interactive searches
US20230186586A1 (en) Method and apparatus with object detection
CN116128023A (zh) 硬件加速器、电子装置和用于神经网络的装置
US20240185077A1 (en) Apparatus and method with quantization configurator
WO2025054890A1 (en) On-device unified inference-training pipeline of hybrid precision forward-backward propagation by heterogeneous floating point graphics processing unit (gpu) and fixed point digital signal processor (dsp)
CN115861862A (zh) 识别图像的方法和设备
KR20250063022A (ko) 인공신경망을 활용한 전시, 컨벤션 광고 서비스 제공 장치 및 방법

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination