EP3529752C0 - Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen - Google Patents
Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernenInfo
- Publication number
- EP3529752C0 EP3529752C0 EP18771838.2A EP18771838A EP3529752C0 EP 3529752 C0 EP3529752 C0 EP 3529752C0 EP 18771838 A EP18771838 A EP 18771838A EP 3529752 C0 EP3529752 C0 EP 3529752C0
- Authority
- EP
- European Patent Office
- Prior art keywords
- machine learning
- electronic device
- learning
- machine
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/15—Correlation function computation including computation of convolution operations
- G06F17/153—Multidimensional correlation or convolution
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
- G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0464—Convolutional networks [CNN, ConvNet]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0495—Quantised networks; Sparse networks; Compressed networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Biophysics (AREA)
- Computational Linguistics (AREA)
- Biomedical Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Medical Informatics (AREA)
- Neurology (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Image Analysis (AREA)
- Complex Calculations (AREA)
- Image Processing (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020170036715A KR102414583B1 (ko) | 2017-03-23 | 2017-03-23 | 머신 러닝을 수행하는 전자 장치 및 머신 러닝 수행 방법 |
| PCT/KR2018/002725 WO2018174438A1 (en) | 2017-03-23 | 2018-03-07 | Electronic apparatus for operating machine learning and method for operating machine learning |
Publications (4)
| Publication Number | Publication Date |
|---|---|
| EP3529752A1 EP3529752A1 (de) | 2019-08-28 |
| EP3529752A4 EP3529752A4 (de) | 2020-01-08 |
| EP3529752B1 EP3529752B1 (de) | 2026-02-18 |
| EP3529752C0 true EP3529752C0 (de) | 2026-02-18 |
Family
ID=63583429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP18771838.2A Active EP3529752B1 (de) | 2017-03-23 | 2018-03-07 | Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US11907826B2 (de) |
| EP (1) | EP3529752B1 (de) |
| KR (1) | KR102414583B1 (de) |
| CN (1) | CN110494867B (de) |
| WO (1) | WO2018174438A1 (de) |
Families Citing this family (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110210610B (zh) * | 2018-03-27 | 2023-06-20 | 腾讯科技(深圳)有限公司 | 卷积计算加速器、卷积计算方法及卷积计算设备 |
| WO2020074787A1 (en) * | 2018-10-13 | 2020-04-16 | IPRally Technologies Oy | Method of searching patent documents |
| KR102178932B1 (ko) * | 2018-12-19 | 2020-11-18 | 고려대학교 산학협력단 | 출력 특징 맵의 0에 대한 연산을 스킵할 수 있는 합성곱 신경망의 연산 장치 및 그 동작 방법 |
| JP7103264B2 (ja) * | 2019-02-20 | 2022-07-20 | 日本電信電話株式会社 | 生成装置、学習装置、生成方法及びプログラム |
| US11205420B1 (en) * | 2019-06-10 | 2021-12-21 | Amazon Technologies, Inc. | Speech processing using a recurrent neural network |
| KR102868048B1 (ko) | 2019-09-26 | 2025-10-10 | 삼성전자주식회사 | 뉴럴 프로세싱 장치 및 뉴럴 프로세싱 장치에서 뉴럴 네트워크의 풀링을 처리하는 방법 |
| DE102019129760A1 (de) * | 2019-11-05 | 2021-05-06 | Eyyes Gmbh | Verfahren zur Verarbeitung von Eingangsdaten |
| KR20210062838A (ko) * | 2019-11-22 | 2021-06-01 | 엘지전자 주식회사 | 인공지능 기반의 음성처리 방법 |
| US11488007B2 (en) | 2019-12-06 | 2022-11-01 | International Business Machines Corporation | Building of custom convolution filter for a neural network using an automated evolutionary process |
| KR102441520B1 (ko) * | 2020-02-07 | 2022-09-07 | 인하대학교 산학협력단 | 필터 분해 기법을 이용한 에너지 효율적 재구성형 cnn 가속기 장치 및 방법 |
| KR102883344B1 (ko) * | 2020-07-31 | 2025-11-07 | 삼성전자주식회사 | 딥러닝 연산 수행 방법 및 장치 |
| CN111984423B (zh) * | 2020-09-02 | 2024-09-03 | 北京小米松果电子有限公司 | 一种运行深度学习模型的方法、装置及介质 |
| KR20220039313A (ko) | 2020-09-22 | 2022-03-29 | 삼성전자주식회사 | 뉴럴 네트워크 연산 처리 방법 및 장치 |
| JP7501315B2 (ja) * | 2020-11-06 | 2024-06-18 | 富士通株式会社 | 演算処理プログラム、演算処理方法および情報処理装置 |
| US12080289B2 (en) * | 2020-12-22 | 2024-09-03 | Samsung Electronics Co., Ltd. | Electronic apparatus, system comprising electronic apparatus and server and controlling method thereof |
| KR102594484B1 (ko) * | 2021-01-12 | 2023-10-27 | 성균관대학교산학협력단 | 시스톨릭 어레이를 이용하여 깊이별 합성곱 연산을 수행하는 방법 및 디바이스 |
| KR102578762B1 (ko) * | 2021-03-04 | 2023-09-13 | 삼성전자주식회사 | 뉴럴 프로세서 |
| CN113869498B (zh) * | 2021-10-13 | 2025-03-25 | 安徽芯纪元科技有限公司 | 一种卷积运算电路及其运算方法 |
| US12106045B2 (en) * | 2021-10-13 | 2024-10-01 | International Business Machines Corporation | Self-learning annotations to generate rules to be utilized by rule-based system |
| KR102414713B1 (ko) | 2021-11-29 | 2022-07-01 | 주식회사 코스모스웨일 | 태아 모니터링 데이터로부터 태아 상태를 판단하기 위한 장치 |
| KR102548283B1 (ko) * | 2021-12-22 | 2023-06-27 | (주)뉴로컴즈 | 콘볼루션 신경망 컴퓨팅 장치 |
| US20230229507A1 (en) * | 2023-03-08 | 2023-07-20 | Intel Corporation | Scheduling computations in deep neural network based on sparsity |
Family Cites Families (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB8326690D0 (en) | 1983-10-05 | 1983-11-09 | Secr Defence | Digital data processor |
| GB2178876B (en) | 1984-12-03 | 1989-06-21 | Commw Of Australia | Systolic architectures for sonar processing |
| JP3271186B2 (ja) | 1989-10-06 | 2002-04-02 | ソニー株式会社 | 学習処理装置 |
| US5138695A (en) | 1989-10-10 | 1992-08-11 | Hnc, Inc. | Systolic array image processing system |
| US5274832A (en) | 1990-10-04 | 1993-12-28 | National Semiconductor Corporation | Systolic array for multidimensional matrix computations |
| JP2572522B2 (ja) | 1992-05-12 | 1997-01-16 | インターナショナル・ビジネス・マシーンズ・コーポレイション | コンピューティング装置 |
| US6639537B1 (en) | 2000-03-31 | 2003-10-28 | Massachusetts Institute Of Technology | Highly linear analog-to-digital conversion system and method thereof |
| KR100442434B1 (ko) | 2002-03-07 | 2004-07-30 | 엘지전자 주식회사 | 학습된 신경망 설계를 위한 어레이 구조 연산 방법 |
| AU2003232418A1 (en) * | 2002-05-28 | 2003-12-12 | Droplet Technology, Inc. | Systems and methods for pile-processing parallel-processors |
| US20050147313A1 (en) | 2003-12-29 | 2005-07-07 | Dimitry Gorinevsky | Image deblurring with a systolic array processor |
| KR100670766B1 (ko) | 2004-01-24 | 2007-01-17 | 학교법인 포항공과대학교 | 시스톨릭 배열 구조를 가지는 미지 신호 분리 장치 및병렬로 연결된 미지 신호 분리 장치를 포함하는 하드웨어장치 |
| US20060277041A1 (en) | 2005-06-06 | 2006-12-07 | Stig Stuns | Sparse convolution of multiple vectors in a digital signal processor |
| US7920741B2 (en) * | 2007-05-31 | 2011-04-05 | Adobe Systems Incorporated | System and method for image processing using integral histogram convolution |
| WO2009149126A2 (en) * | 2008-06-02 | 2009-12-10 | New York University | Method, system, and computer-accessible medium for classification of at least one ictal state |
| US8290782B2 (en) * | 2008-07-24 | 2012-10-16 | Dts, Inc. | Compression of audio scale-factors by two-dimensional transformation |
| US9613001B2 (en) * | 2013-12-20 | 2017-04-04 | Intel Corporation | Processing device for performing convolution operations |
| US10223333B2 (en) | 2014-08-29 | 2019-03-05 | Nvidia Corporation | Performing multi-convolution operations in a parallel processing system |
| US10356440B2 (en) * | 2014-10-01 | 2019-07-16 | Qualcomm Incorporated | Scalable transform hardware architecture with improved transpose buffer |
| US10783900B2 (en) | 2014-10-03 | 2020-09-22 | Google Llc | Convolutional, long short-term memory, fully connected deep neural networks |
| US9563825B2 (en) * | 2014-11-20 | 2017-02-07 | Adobe Systems Incorporated | Convolutional neural network using a binarized convolution layer |
| US10833940B2 (en) * | 2015-03-09 | 2020-11-10 | Vapor IO Inc. | Autonomous distributed workload and infrastructure scheduling |
| US10762894B2 (en) | 2015-03-27 | 2020-09-01 | Google Llc | Convolutional neural networks |
| US9805303B2 (en) * | 2015-05-21 | 2017-10-31 | Google Inc. | Rotating data for neural network computations |
| US10049322B2 (en) * | 2015-05-21 | 2018-08-14 | Google Llc | Prefetching weights for use in a neural network processor |
| US10083395B2 (en) * | 2015-05-21 | 2018-09-25 | Google Llc | Batch processing in a neural network processor |
| CN106485192B (zh) | 2015-09-02 | 2019-12-06 | 富士通株式会社 | 用于图像识别的神经网络的训练方法和装置 |
| US11055063B2 (en) * | 2016-05-02 | 2021-07-06 | Marvell Asia Pte, Ltd. | Systems and methods for deep learning processor |
| CN106203617B (zh) * | 2016-06-27 | 2018-08-21 | 哈尔滨工业大学深圳研究生院 | 一种基于卷积神经网络的加速处理单元及阵列结构 |
| US11663450B2 (en) * | 2017-02-28 | 2023-05-30 | Microsoft Technology Licensing, Llc | Neural network processing with chained instructions |
| US12112141B2 (en) * | 2019-12-12 | 2024-10-08 | Samsung Electronics Co., Ltd. | Accelerating 2D convolutional layer mapping on a dot product architecture |
-
2017
- 2017-03-23 KR KR1020170036715A patent/KR102414583B1/ko active Active
-
2018
- 2018-03-07 CN CN201880019678.0A patent/CN110494867B/zh active Active
- 2018-03-07 EP EP18771838.2A patent/EP3529752B1/de active Active
- 2018-03-07 WO PCT/KR2018/002725 patent/WO2018174438A1/en not_active Ceased
- 2018-03-23 US US15/934,341 patent/US11907826B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| EP3529752B1 (de) | 2026-02-18 |
| EP3529752A4 (de) | 2020-01-08 |
| US11907826B2 (en) | 2024-02-20 |
| EP3529752A1 (de) | 2019-08-28 |
| KR102414583B1 (ko) | 2022-06-29 |
| CN110494867B (zh) | 2024-06-07 |
| KR20180107869A (ko) | 2018-10-04 |
| WO2018174438A1 (en) | 2018-09-27 |
| US20180276532A1 (en) | 2018-09-27 |
| CN110494867A (zh) | 2019-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3529752C0 (de) | Elektronische vorrichtung zur operation von maschinellem lernen und verfahren zur operation von maschinellem lernen | |
| EP3659106A4 (de) | Elektronische vorrichtung und verfahren zum wechseln des chatbots | |
| EP3721361A4 (de) | Verfahren zum lernen von bereichsübergreifendem personalisiertem wortschatz und elektronische vorrichtung dafür | |
| EP3929716A4 (de) | Verfahren und elektronische vorrichtung zum hinzufügen von anmerkungen | |
| EP3651043A4 (de) | Verfahren und vorrichtung zur erkennung von url-attacken und elektronische vorrichtung | |
| EP3542330C0 (de) | Verfahren und elektronische vorrichtung zur anzeige von informationen | |
| EP3659328A4 (de) | Verfahren zur anzeige von inhalt und elektronische vorrichtung damit | |
| EP3764206C0 (de) | Elektronische vorrichtung und verfahren zur verarbeitung von gesten davon | |
| EP3342156C0 (de) | Elektronische vorrichtung und verfahren zur erzeugung von bilddaten | |
| EP3221768C0 (de) | Elektronische vorrichtung zur identifizierung von peripheren vorrichtung und verfahren dafür | |
| EP3674881A4 (de) | Elektronische vorrichtung und verfahren zur gemeinsamen bildschirmnutzung damit | |
| EP3656115A4 (de) | Verfahren zum erhalt von biometrischen informationen und elektronische vorrichtung dafür | |
| EP3611895C0 (de) | Verfahren und vorrichtung zur benutzerregistrierung und elektronische vorrichtung | |
| EP3674920A4 (de) | Verfahren und vorrichtung zur erstellung von kartendaten | |
| EP3606259A4 (de) | Verfahren zur durchführung von direktzugriffsverfahren und vorrichtung dafür | |
| EP3579124A4 (de) | Verfahren und vorrichtung zur bereitstellung von suchergebnissen | |
| EP3669289A4 (de) | Verfahren und elektronische vorrichtung zur übersetzung von sprachsignalen | |
| EP3543896C0 (de) | Verfahren zur kalkulation von fahrspurinformationen und elektronische vorrichtung | |
| EP3975140C0 (de) | Elektronische vorrichtung zur unterstützung der verifizierung von fingerabdrücken und verfahren zum betrieb davon | |
| EP3736724C0 (de) | Elektronische vorrichtung und verfahren zur erkennung von zubehör | |
| EP3521032A4 (de) | Vorrichtung und verfahren zur verwaltung von druckobjekten | |
| EP3478188A4 (de) | Verfahren und vorrichtung zur extraktion und bereitstellung von einheiten | |
| EP3680764A4 (de) | Verfahren und vorrichtung zur bewegung von symbolen | |
| EP3673409A4 (de) | Elektronische vorrichtung und verfahren zur zuverlässigkeitsbasierten objekterkennung | |
| EP3545546A4 (de) | Vorrichtung zur direktübertragung von musteranordnungen und verfahren dafür |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20190523 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| A4 | Supplementary search report drawn up and despatched |
Effective date: 20191210 |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06N 99/00 20190101ALI20191204BHEP Ipc: G06N 3/08 20060101AFI20191204BHEP |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20211104 |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20251023 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: F10 Free format text: ST27 STATUS EVENT CODE: U-0-0-F10-F00 (AS PROVIDED BY THE NATIONAL OFFICE) Effective date: 20260218 Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018089208 Country of ref document: DE |
|
| U01 | Request for unitary effect filed |
Effective date: 20260219 |