EP3529752C0 - Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen - Google Patents

Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen

Info

Publication number
EP3529752C0
EP3529752C0 EP18771838.2A EP18771838A EP3529752C0 EP 3529752 C0 EP3529752 C0 EP 3529752C0 EP 18771838 A EP18771838 A EP 18771838A EP 3529752 C0 EP3529752 C0 EP 3529752C0
Authority
EP
European Patent Office
Prior art keywords
machine learning
electronic device
learning
machine
electronic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP18771838.2A
Other languages
English (en)
French (fr)
Other versions
EP3529752B1 (de
EP3529752A4 (de
EP3529752A1 (de
Inventor
Kyoung-Hoon Kim
Young-Hwan Park
Ki-Seok Kwon
Suk-Jin Kim
Chae-Seok Im
Han-Su Cho
Sang-Bok Han
Seung-Won Lee
Kang-Jin Yoon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3529752A1 publication Critical patent/EP3529752A1/de
Publication of EP3529752A4 publication Critical patent/EP3529752A4/de
Application granted granted Critical
Publication of EP3529752B1 publication Critical patent/EP3529752B1/de
Publication of EP3529752C0 publication Critical patent/EP3529752C0/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/15Correlation function computation including computation of convolution operations
    • G06F17/153Multidimensional correlation or convolution
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • G06N3/0442Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0495Quantised networks; Sparse networks; Compressed networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/08Speech classification or search
    • G10L15/16Speech classification or search using artificial neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Neurology (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Image Analysis (AREA)
  • Complex Calculations (AREA)
  • Image Processing (AREA)
EP18771838.2A 2017-03-23 2018-03-07 Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen Active EP3529752B1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020170036715A KR102414583B1 (ko) 2017-03-23 2017-03-23 머신 러닝을 수행하는 전자 장치 및 머신 러닝 수행 방법
PCT/KR2018/002725 WO2018174438A1 (en) 2017-03-23 2018-03-07 Electronic apparatus for operating machine learning and method for operating machine learning

Publications (4)

Publication Number Publication Date
EP3529752A1 EP3529752A1 (de) 2019-08-28
EP3529752A4 EP3529752A4 (de) 2020-01-08
EP3529752B1 EP3529752B1 (de) 2026-02-18
EP3529752C0 true EP3529752C0 (de) 2026-02-18

Family

ID=63583429

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18771838.2A Active EP3529752B1 (de) 2017-03-23 2018-03-07 Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen

Country Status (5)

Country Link
US (1) US11907826B2 (de)
EP (1) EP3529752B1 (de)
KR (1) KR102414583B1 (de)
CN (1) CN110494867B (de)
WO (1) WO2018174438A1 (de)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110210610B (zh) * 2018-03-27 2023-06-20 腾讯科技(深圳)有限公司 卷积计算加速器、卷积计算方法及卷积计算设备
WO2020074787A1 (en) * 2018-10-13 2020-04-16 IPRally Technologies Oy Method of searching patent documents
KR102178932B1 (ko) * 2018-12-19 2020-11-18 고려대학교 산학협력단 출력 특징 맵의 0에 대한 연산을 스킵할 수 있는 합성곱 신경망의 연산 장치 및 그 동작 방법
JP7103264B2 (ja) * 2019-02-20 2022-07-20 日本電信電話株式会社 生成装置、学習装置、生成方法及びプログラム
US11205420B1 (en) * 2019-06-10 2021-12-21 Amazon Technologies, Inc. Speech processing using a recurrent neural network
KR102868048B1 (ko) 2019-09-26 2025-10-10 삼성전자주식회사 뉴럴 프로세싱 장치 및 뉴럴 프로세싱 장치에서 뉴럴 네트워크의 풀링을 처리하는 방법
DE102019129760A1 (de) * 2019-11-05 2021-05-06 Eyyes Gmbh Verfahren zur Verarbeitung von Eingangsdaten
KR20210062838A (ko) * 2019-11-22 2021-06-01 엘지전자 주식회사 인공지능 기반의 음성처리 방법
US11488007B2 (en) 2019-12-06 2022-11-01 International Business Machines Corporation Building of custom convolution filter for a neural network using an automated evolutionary process
KR102441520B1 (ko) * 2020-02-07 2022-09-07 인하대학교 산학협력단 필터 분해 기법을 이용한 에너지 효율적 재구성형 cnn 가속기 장치 및 방법
KR102883344B1 (ko) * 2020-07-31 2025-11-07 삼성전자주식회사 딥러닝 연산 수행 방법 및 장치
CN111984423B (zh) * 2020-09-02 2024-09-03 北京小米松果电子有限公司 一种运行深度学习模型的方法、装置及介质
KR20220039313A (ko) 2020-09-22 2022-03-29 삼성전자주식회사 뉴럴 네트워크 연산 처리 방법 및 장치
JP7501315B2 (ja) * 2020-11-06 2024-06-18 富士通株式会社 演算処理プログラム、演算処理方法および情報処理装置
US12080289B2 (en) * 2020-12-22 2024-09-03 Samsung Electronics Co., Ltd. Electronic apparatus, system comprising electronic apparatus and server and controlling method thereof
KR102594484B1 (ko) * 2021-01-12 2023-10-27 성균관대학교산학협력단 시스톨릭 어레이를 이용하여 깊이별 합성곱 연산을 수행하는 방법 및 디바이스
KR102578762B1 (ko) * 2021-03-04 2023-09-13 삼성전자주식회사 뉴럴 프로세서
CN113869498B (zh) * 2021-10-13 2025-03-25 安徽芯纪元科技有限公司 一种卷积运算电路及其运算方法
US12106045B2 (en) * 2021-10-13 2024-10-01 International Business Machines Corporation Self-learning annotations to generate rules to be utilized by rule-based system
KR102414713B1 (ko) 2021-11-29 2022-07-01 주식회사 코스모스웨일 태아 모니터링 데이터로부터 태아 상태를 판단하기 위한 장치
KR102548283B1 (ko) * 2021-12-22 2023-06-27 (주)뉴로컴즈 콘볼루션 신경망 컴퓨팅 장치
US20230229507A1 (en) * 2023-03-08 2023-07-20 Intel Corporation Scheduling computations in deep neural network based on sparsity

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8326690D0 (en) 1983-10-05 1983-11-09 Secr Defence Digital data processor
GB2178876B (en) 1984-12-03 1989-06-21 Commw Of Australia Systolic architectures for sonar processing
JP3271186B2 (ja) 1989-10-06 2002-04-02 ソニー株式会社 学習処理装置
US5138695A (en) 1989-10-10 1992-08-11 Hnc, Inc. Systolic array image processing system
US5274832A (en) 1990-10-04 1993-12-28 National Semiconductor Corporation Systolic array for multidimensional matrix computations
JP2572522B2 (ja) 1992-05-12 1997-01-16 インターナショナル・ビジネス・マシーンズ・コーポレイション コンピューティング装置
US6639537B1 (en) 2000-03-31 2003-10-28 Massachusetts Institute Of Technology Highly linear analog-to-digital conversion system and method thereof
KR100442434B1 (ko) 2002-03-07 2004-07-30 엘지전자 주식회사 학습된 신경망 설계를 위한 어레이 구조 연산 방법
AU2003232418A1 (en) * 2002-05-28 2003-12-12 Droplet Technology, Inc. Systems and methods for pile-processing parallel-processors
US20050147313A1 (en) 2003-12-29 2005-07-07 Dimitry Gorinevsky Image deblurring with a systolic array processor
KR100670766B1 (ko) 2004-01-24 2007-01-17 학교법인 포항공과대학교 시스톨릭 배열 구조를 가지는 미지 신호 분리 장치 및병렬로 연결된 미지 신호 분리 장치를 포함하는 하드웨어장치
US20060277041A1 (en) 2005-06-06 2006-12-07 Stig Stuns Sparse convolution of multiple vectors in a digital signal processor
US7920741B2 (en) * 2007-05-31 2011-04-05 Adobe Systems Incorporated System and method for image processing using integral histogram convolution
WO2009149126A2 (en) * 2008-06-02 2009-12-10 New York University Method, system, and computer-accessible medium for classification of at least one ictal state
US8290782B2 (en) * 2008-07-24 2012-10-16 Dts, Inc. Compression of audio scale-factors by two-dimensional transformation
US9613001B2 (en) * 2013-12-20 2017-04-04 Intel Corporation Processing device for performing convolution operations
US10223333B2 (en) 2014-08-29 2019-03-05 Nvidia Corporation Performing multi-convolution operations in a parallel processing system
US10356440B2 (en) * 2014-10-01 2019-07-16 Qualcomm Incorporated Scalable transform hardware architecture with improved transpose buffer
US10783900B2 (en) 2014-10-03 2020-09-22 Google Llc Convolutional, long short-term memory, fully connected deep neural networks
US9563825B2 (en) * 2014-11-20 2017-02-07 Adobe Systems Incorporated Convolutional neural network using a binarized convolution layer
US10833940B2 (en) * 2015-03-09 2020-11-10 Vapor IO Inc. Autonomous distributed workload and infrastructure scheduling
US10762894B2 (en) 2015-03-27 2020-09-01 Google Llc Convolutional neural networks
US9805303B2 (en) * 2015-05-21 2017-10-31 Google Inc. Rotating data for neural network computations
US10049322B2 (en) * 2015-05-21 2018-08-14 Google Llc Prefetching weights for use in a neural network processor
US10083395B2 (en) * 2015-05-21 2018-09-25 Google Llc Batch processing in a neural network processor
CN106485192B (zh) 2015-09-02 2019-12-06 富士通株式会社 用于图像识别的神经网络的训练方法和装置
US11055063B2 (en) * 2016-05-02 2021-07-06 Marvell Asia Pte, Ltd. Systems and methods for deep learning processor
CN106203617B (zh) * 2016-06-27 2018-08-21 哈尔滨工业大学深圳研究生院 一种基于卷积神经网络的加速处理单元及阵列结构
US11663450B2 (en) * 2017-02-28 2023-05-30 Microsoft Technology Licensing, Llc Neural network processing with chained instructions
US12112141B2 (en) * 2019-12-12 2024-10-08 Samsung Electronics Co., Ltd. Accelerating 2D convolutional layer mapping on a dot product architecture

Also Published As

Publication number Publication date
EP3529752B1 (de) 2026-02-18
EP3529752A4 (de) 2020-01-08
US11907826B2 (en) 2024-02-20
EP3529752A1 (de) 2019-08-28
KR102414583B1 (ko) 2022-06-29
CN110494867B (zh) 2024-06-07
KR20180107869A (ko) 2018-10-04
WO2018174438A1 (en) 2018-09-27
US20180276532A1 (en) 2018-09-27
CN110494867A (zh) 2019-11-22

Similar Documents

Publication Publication Date Title
EP3529752C0 (de) Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen
EP3659106A4 (de) Elektronische vorrichtung und verfahren zum wechseln des chatbots
EP3721361A4 (de) Verfahren zum lernen von bereichsübergreifendem personalisiertem wortschatz und elektronische vorrichtung dafür
EP3929716A4 (de) Verfahren und elektronische vorrichtung zum hinzufügen von anmerkungen
EP3651043A4 (de) Verfahren und vorrichtung zur erkennung von url-attacken und elektronische vorrichtung
EP3542330C0 (de) Verfahren und elektronische vorrichtung zur anzeige von informationen
EP3659328A4 (de) Verfahren zur anzeige von inhalt und elektronische vorrichtung damit
EP3764206C0 (de) Elektronische vorrichtung und verfahren zur verarbeitung von gesten davon
EP3342156C0 (de) Elektronische vorrichtung und verfahren zur erzeugung von bilddaten
EP3221768C0 (de) Elektronische vorrichtung zur identifizierung von peripheren vorrichtung und verfahren dafür
EP3674881A4 (de) Elektronische vorrichtung und verfahren zur gemeinsamen bildschirmnutzung damit
EP3656115A4 (de) Verfahren zum erhalt von biometrischen informationen und elektronische vorrichtung dafür
EP3611895C0 (de) Verfahren und vorrichtung zur benutzerregistrierung und elektronische vorrichtung
EP3674920A4 (de) Verfahren und vorrichtung zur erstellung von kartendaten
EP3606259A4 (de) Verfahren zur durchführung von direktzugriffsverfahren und vorrichtung dafür
EP3579124A4 (de) Verfahren und vorrichtung zur bereitstellung von suchergebnissen
EP3669289A4 (de) Verfahren und elektronische vorrichtung zur übersetzung von sprachsignalen
EP3543896C0 (de) Verfahren zur kalkulation von fahrspurinformationen und elektronische vorrichtung
EP3975140C0 (de) Elektronische vorrichtung zur unterstützung der verifizierung von fingerabdrücken und verfahren zum betrieb davon
EP3736724C0 (de) Elektronische vorrichtung und verfahren zur erkennung von zubehör
EP3521032A4 (de) Vorrichtung und verfahren zur verwaltung von druckobjekten
EP3478188A4 (de) Verfahren und vorrichtung zur extraktion und bereitstellung von einheiten
EP3680764A4 (de) Verfahren und vorrichtung zur bewegung von symbolen
EP3673409A4 (de) Elektronische vorrichtung und verfahren zur zuverlässigkeitsbasierten objekterkennung
EP3545546A4 (de) Vorrichtung zur direktübertragung von musteranordnungen und verfahren dafür

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190523

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20191210

RIC1 Information provided on ipc code assigned before grant

Ipc: G06N 99/00 20190101ALI20191204BHEP

Ipc: G06N 3/08 20060101AFI20191204BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20211104

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20251023

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: F10

Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20260218

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018089208

Country of ref document: DE

U01 Request for unitary effect filed

Effective date: 20260219