JP7112802B1 - 学習モデルの軽量化 - Google Patents

学習モデルの軽量化 Download PDF

Info

Publication number
JP7112802B1
JP7112802B1 JP2022073380A JP2022073380A JP7112802B1 JP 7112802 B1 JP7112802 B1 JP 7112802B1 JP 2022073380 A JP2022073380 A JP 2022073380A JP 2022073380 A JP2022073380 A JP 2022073380A JP 7112802 B1 JP7112802 B1 JP 7112802B1
Authority
JP
Japan
Prior art keywords
learning
model
weight
data
predetermined
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022073380A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023162766A (ja
Inventor
望 窪田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to JP2022073380A priority Critical patent/JP7112802B1/ja
Priority to JP2022113601A priority patent/JP2023163102A/ja
Application granted granted Critical
Publication of JP7112802B1 publication Critical patent/JP7112802B1/ja
Priority to PCT/JP2023/016014 priority patent/WO2023210546A1/ja
Publication of JP2023162766A publication Critical patent/JP2023162766A/ja
Priority to US18/927,625 priority patent/US20250053819A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Image Analysis (AREA)
JP2022073380A 2022-04-27 2022-04-27 学習モデルの軽量化 Active JP7112802B1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2022073380A JP7112802B1 (ja) 2022-04-27 2022-04-27 学習モデルの軽量化
JP2022113601A JP2023163102A (ja) 2022-04-27 2022-07-15 学習モデルの軽量化
PCT/JP2023/016014 WO2023210546A1 (ja) 2022-04-27 2023-04-21 学習モデルの軽量化
US18/927,625 US20250053819A1 (en) 2022-04-27 2024-10-25 Compression of learning model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2022073380A JP7112802B1 (ja) 2022-04-27 2022-04-27 学習モデルの軽量化

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2022113601A Division JP2023163102A (ja) 2022-04-27 2022-07-15 学習モデルの軽量化

Publications (2)

Publication Number Publication Date
JP7112802B1 true JP7112802B1 (ja) 2022-08-04
JP2023162766A JP2023162766A (ja) 2023-11-09

Family

ID=82702006

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022073380A Active JP7112802B1 (ja) 2022-04-27 2022-04-27 学習モデルの軽量化
JP2022113601A Pending JP2023163102A (ja) 2022-04-27 2022-07-15 学習モデルの軽量化

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2022113601A Pending JP2023163102A (ja) 2022-04-27 2022-07-15 学習モデルの軽量化

Country Status (3)

Country Link
US (1) US20250053819A1 (https=)
JP (2) JP7112802B1 (https=)
WO (1) WO2023210546A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024237371A1 (ko) * 2023-05-17 2024-11-21 주식회사 사피온코리아 인공 신경망 모델의 학습 도메인을 고려한 캘리브레이션 데이터셋 생성 및 이를 이용한 인공 신경망 모델의 최적화를 위한 방법 및 장치

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW202601752A (zh) * 2024-02-02 2026-01-01 日商東京威力科創股份有限公司 電腦程式、資訊處理方法及資訊處理裝置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200125956A1 (en) 2017-05-20 2020-04-23 Google Llc Application Development Platform and Software Development Kits that Provide Comprehensive Machine Learning Services
US20200311552A1 (en) 2019-03-25 2020-10-01 Samsung Electronics Co., Ltd. Device and method for compressing machine learning model
WO2022023022A1 (en) 2020-07-28 2022-02-03 Siemens Aktiengesellschaft Method for automated determination of a model compression technique for compression of an artificial intelligence-based model

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12093675B2 (en) * 2018-05-07 2024-09-17 Google Llc Application development platform and software development kits that provide comprehensive machine learning services
DE102018210894A1 (de) * 2018-07-03 2020-01-09 Siemens Aktiengesellschaft Entwurf und Herstellung einer Strömungsmaschinenschaufel

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200125956A1 (en) 2017-05-20 2020-04-23 Google Llc Application Development Platform and Software Development Kits that Provide Comprehensive Machine Learning Services
US20200311552A1 (en) 2019-03-25 2020-10-01 Samsung Electronics Co., Ltd. Device and method for compressing machine learning model
WO2022023022A1 (en) 2020-07-28 2022-02-03 Siemens Aktiengesellschaft Method for automated determination of a model compression technique for compression of an artificial intelligence-based model

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024237371A1 (ko) * 2023-05-17 2024-11-21 주식회사 사피온코리아 인공 신경망 모델의 학습 도메인을 고려한 캘리브레이션 데이터셋 생성 및 이를 이용한 인공 신경망 모델의 최적화를 위한 방법 및 장치

Also Published As

Publication number Publication date
JP2023163102A (ja) 2023-11-09
US20250053819A1 (en) 2025-02-13
JP2023162766A (ja) 2023-11-09
WO2023210546A1 (ja) 2023-11-02

Similar Documents

Publication Publication Date Title
JP7507287B2 (ja) サンプル一致度評価による能動学習
JP7437763B2 (ja) 解析装置、解析方法及び解析プログラム
US12518135B2 (en) Sparse and differentiable mixture of experts neural networks
US20250053819A1 (en) Compression of learning model
JP2024503774A (ja) 融合パラメータの特定方法及び装置、情報推奨方法及び装置、パラメータ測定モデルのトレーニング方法及び装置、電子機器、記憶媒体、並びにコンピュータプログラム
EP4189606A1 (en) Neural architecture and hardware accelerator search
US20240152809A1 (en) Efficient machine learning model architecture selection
JP2022033695A (ja) モデルを生成するための方法、装置、電子機器、記憶媒体、及びコンピュータプログラム製品
US20210350175A1 (en) Key-value memory network for predicting time-series metrics of target entities
CN108921300A (zh) 执行自动机器学习的方法和装置
CA2436352A1 (en) Process and system for developing a predictive model
KR20240010581A (ko) 머신 러닝 하이퍼파라미터 튜닝
JP6942900B1 (ja) 情報処理装置、情報処理方法及びプログラム
JP2021193623A (ja) 試験評価システム、プログラムおよび試験評価方法
CN112015990A (zh) 待推荐网络资源的确定方法、装置、计算机设备及介质
JP2023065826A (ja) 情報処理方法、プログラム及び情報処理装置
JP7199115B1 (ja) 機械学習における分散学習
JP7199121B1 (ja) 計算グラフの改善
JP7731577B2 (ja) 学習モデルの個別化
CN115392594A (zh) 一种基于神经网络和特征筛选的用电负荷模型训练方法
JP2010204974A (ja) 時系列データ予測装置
CN118569417A (zh) 数据预测方法及系统
WO2021079966A1 (ja) 分析装置、制御方法、及びプログラム
KR20210040887A (ko) 용모 변화 조작 결과를 예측하는 방법, 장치, 전자 기기, 저장 매체 및 프로그램
CN120872274B (zh) 基于人工智能的设备自动控制方法及系统

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20220427

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20220427

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220629

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220715

R150 Certificate of patent or registration of utility model

Ref document number: 7112802

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250