CN111033522B - 用于人工智能的并行神经处理器 - Google Patents

用于人工智能的并行神经处理器 Download PDF

Info

Publication number
CN111033522B
CN111033522B CN201880055138.8A CN201880055138A CN111033522B CN 111033522 B CN111033522 B CN 111033522B CN 201880055138 A CN201880055138 A CN 201880055138A CN 111033522 B CN111033522 B CN 111033522B
Authority
CN
China
Prior art keywords
sub
signal
classifier
weighted input
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880055138.8A
Other languages
English (en)
Chinese (zh)
Other versions
CN111033522A (zh
Inventor
罗希特·塞思
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202311093908.7A priority Critical patent/CN117151177A/zh
Publication of CN111033522A publication Critical patent/CN111033522A/zh
Application granted granted Critical
Publication of CN111033522B publication Critical patent/CN111033522B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133Distances to prototypes
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/243Classification techniques relating to the number of classes
    • G06F18/24323Tree-organised classifiers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0499Feedforward networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/082Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/088Non-supervised learning, e.g. competitive learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/0895Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Neurology (AREA)
  • Image Analysis (AREA)
  • Probability & Statistics with Applications (AREA)
  • Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
  • Processing Of Solid Wastes (AREA)
  • Image Processing (AREA)
  • Feedback Control In General (AREA)
CN201880055138.8A 2017-09-08 2018-09-07 用于人工智能的并行神经处理器 Active CN111033522B (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311093908.7A CN117151177A (zh) 2017-09-08 2018-09-07 用于人工智能的并行神经处理器

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201762556312P 2017-09-08 2017-09-08
US62/556,312 2017-09-08
US16/124,104 US11507806B2 (en) 2017-09-08 2018-09-06 Parallel neural processor for Artificial Intelligence
US16/124,104 2018-09-06
PCT/IB2018/000994 WO2019048922A1 (en) 2017-09-08 2018-09-07 PARALLEL NEURONAL PROCESSOR FOR ARTIFICIAL INTELLIGENCE

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202311093908.7A Division CN117151177A (zh) 2017-09-08 2018-09-07 用于人工智能的并行神经处理器

Publications (2)

Publication Number Publication Date
CN111033522A CN111033522A (zh) 2020-04-17
CN111033522B true CN111033522B (zh) 2023-09-19

Family

ID=65631231

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201880055138.8A Active CN111033522B (zh) 2017-09-08 2018-09-07 用于人工智能的并行神经处理器
CN202311093908.7A Pending CN117151177A (zh) 2017-09-08 2018-09-07 用于人工智能的并行神经处理器

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202311093908.7A Pending CN117151177A (zh) 2017-09-08 2018-09-07 用于人工智能的并行神经处理器

Country Status (9)

Country Link
US (4) US11507806B2 (enExample)
EP (1) EP3679522A4 (enExample)
JP (1) JP7114694B2 (enExample)
KR (3) KR20230154295A (enExample)
CN (2) CN111033522B (enExample)
AU (2) AU2018330840B2 (enExample)
CA (1) CA3112064A1 (enExample)
TW (2) TWI846192B (enExample)
WO (1) WO2019048922A1 (enExample)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10592450B2 (en) 2016-10-20 2020-03-17 Micron Technology, Inc. Custom compute cores in integrated circuit devices
JP6866762B2 (ja) * 2017-05-18 2021-04-28 いすゞ自動車株式会社 車両用情報処理システム
US11507806B2 (en) 2017-09-08 2022-11-22 Rohit Seth Parallel neural processor for Artificial Intelligence
US11443185B2 (en) * 2018-10-11 2022-09-13 Powerchip Semiconductor Manufacturing Corporation Memory chip capable of performing artificial intelligence operation and method thereof
US11074344B2 (en) * 2018-12-19 2021-07-27 Intel Corporation Methods and apparatus to detect side-channel attacks
US11783917B2 (en) 2019-03-21 2023-10-10 Illumina, Inc. Artificial intelligence-based base calling
US11210554B2 (en) 2019-03-21 2021-12-28 Illumina, Inc. Artificial intelligence-based generation of sequencing metadata
US11593649B2 (en) 2019-05-16 2023-02-28 Illumina, Inc. Base calling using convolutions
US11423306B2 (en) 2019-05-16 2022-08-23 Illumina, Inc. Systems and devices for characterization and performance analysis of pixel-based sequencing
US20210265016A1 (en) 2020-02-20 2021-08-26 Illumina, Inc. Data Compression for Artificial Intelligence-Based Base Calling
WO2021168353A2 (en) 2020-02-20 2021-08-26 Illumina, Inc. Artificial intelligence-based many-to-many base calling
US12354008B2 (en) 2020-02-20 2025-07-08 Illumina, Inc. Knowledge distillation and gradient pruning-based compression of artificial intelligence-based base caller
WO2022047802A1 (en) * 2020-09-07 2022-03-10 Alibaba Group Holding Limited Processing-in-memory device and data processing method thereof
US12217829B2 (en) 2021-04-15 2025-02-04 Illumina, Inc. Artificial intelligence-based analysis of protein three-dimensional (3D) structures
US20220336057A1 (en) 2021-04-15 2022-10-20 Illumina, Inc. Efficient voxelization for deep learning
CN117217067A (zh) * 2022-05-31 2023-12-12 北京有竹居网络技术有限公司 仿真装置、仿真系统及其仿真方法、存储介质
TWI892755B (zh) * 2024-07-17 2025-08-01 凌陽科技股份有限公司 計算機硬體系統以及人工智慧計算程序

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5167008A (en) * 1990-12-14 1992-11-24 General Electric Company Digital circuitry for approximating sigmoidal response in a neural network layer
US5590218A (en) * 1993-10-18 1996-12-31 Bayer Corporation Unsupervised neural network classification with back propagation
US9195934B1 (en) * 2013-01-31 2015-11-24 Brain Corporation Spiking neuron classifier apparatus and methods using conditionally independent subsets
CN106997485A (zh) * 2016-01-26 2017-08-01 三星电子株式会社 基于神经网络的识别设备和训练神经网络的方法

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2460078B1 (fr) * 1979-06-25 1986-12-12 Trt Telecom Radio Electr Joncteur d'abonne electronique
US5253328A (en) 1989-11-17 1993-10-12 Microelectronics & Computer Technology Corp. Neural-network content-addressable memory
JP3088171B2 (ja) * 1991-02-12 2000-09-18 三菱電機株式会社 自己組織型パタ−ン分類システム及び分類方法
JP3090550B2 (ja) * 1992-09-03 2000-09-25 フィガロ技研株式会社 ガス検出システム
US6018728A (en) * 1996-02-09 2000-01-25 Sarnoff Corporation Method and apparatus for training a neural network to learn hierarchical representations of objects and to detect and classify objects with uncertain training data
US6028956A (en) * 1997-04-04 2000-02-22 Kofile Inc. Object location and span determination method and apparatus which determines a location and span of an object in an image
US6294926B1 (en) * 1999-07-16 2001-09-25 Philips Electronics North America Corporation Very fine-grain field programmable gate array architecture and circuitry
US7412428B2 (en) * 2002-03-12 2008-08-12 Knowmtech, Llc. Application of hebbian and anti-hebbian learning to nanotechnology-based physical neural networks
US7627540B2 (en) 2005-06-28 2009-12-01 Neurosciences Research Foundation, Inc. Addressing scheme for neural modeling and brain-based devices using special purpose processor
EP2295584B1 (en) 2005-09-16 2015-06-10 deVGen N.V. Transgenic plant-based methods for plant pests using RNAi
EP2122542B1 (en) 2006-12-08 2017-11-01 Medhat Moussa Architecture, system and method for artificial neural network implementation
CN101827943B (zh) 2007-05-22 2016-04-13 康乃尔研究基金会有限公司 蛋白质在细菌及其衍生小泡表面展示的组合物和方法及其用途
DE102009029519A1 (de) * 2009-09-16 2011-03-24 Robert Bosch Gmbh Digital-Analog-Wandlerschaltung und Verfahren zur Fehlererkennung
US20110098963A1 (en) 2009-10-23 2011-04-28 Cisco Technology, Inc. Context based testing
BR112014031789A2 (pt) 2012-06-22 2017-08-01 Syngenta Participations Ag controle biológico de pragas de coleópteros
US9082078B2 (en) 2012-07-27 2015-07-14 The Intellisis Corporation Neural processing engine and architecture using the same
US9672464B2 (en) 2014-02-28 2017-06-06 Qualcomm Incorporated Method and apparatus for efficient implementation of common neuron models
US9224091B2 (en) 2014-03-10 2015-12-29 Globalfoundries Inc. Learning artificial neural network using ternary content addressable memory (TCAM)
KR101510991B1 (ko) * 2014-05-09 2015-04-10 포항공과대학교 산학협력단 저항변화 메모리를 이용한 신경회로망 형태 분류기 및 형태 분류 방법
US9373058B2 (en) * 2014-05-29 2016-06-21 International Business Machines Corporation Scene understanding using a neurosynaptic system
CN107077782A (zh) * 2014-08-06 2017-08-18 李宗志 自适应和/或自主交通控制系统和方法
CN108351985A (zh) * 2015-06-30 2018-07-31 亚利桑那州立大学董事会 用于大规模机器学习的方法和装置
KR20170028629A (ko) * 2015-09-04 2017-03-14 부산대학교 산학협력단 신호패턴의 반복횟수 검출방법 및 장치
CN106599991B (zh) * 2015-10-08 2019-04-09 上海兆芯集成电路有限公司 具有神经存储器的神经网络单元和集体将来自神经存储器的数据列移位的神经处理单元阵列
DE102015223078A1 (de) 2015-11-23 2017-05-24 Siemens Aktiengesellschaft Vorrichtung und Verfahren zum Anpassen von Berechtigungsinformationen eines Endgeräts
US10296846B2 (en) * 2015-11-24 2019-05-21 Xerox Corporation Adapted domain specific class means classifier
US10373019B2 (en) * 2016-01-13 2019-08-06 Ford Global Technologies, Llc Low- and high-fidelity classifiers applied to road-scene images
US10423876B2 (en) 2016-12-01 2019-09-24 Via Alliance Semiconductor Co., Ltd. Processor with memory array operable as either victim cache or neural network unit memory
US11507806B2 (en) 2017-09-08 2022-11-22 Rohit Seth Parallel neural processor for Artificial Intelligence
US11593658B2 (en) * 2017-10-20 2023-02-28 Shanghai Cambricon Information Technology Co., Ltd Processing method and device
KR102788093B1 (ko) * 2018-08-17 2025-03-31 삼성전자주식회사 전자 장치 및 그 제어 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5167008A (en) * 1990-12-14 1992-11-24 General Electric Company Digital circuitry for approximating sigmoidal response in a neural network layer
US5590218A (en) * 1993-10-18 1996-12-31 Bayer Corporation Unsupervised neural network classification with back propagation
US9195934B1 (en) * 2013-01-31 2015-11-24 Brain Corporation Spiking neuron classifier apparatus and methods using conditionally independent subsets
CN106997485A (zh) * 2016-01-26 2017-08-01 三星电子株式会社 基于神经网络的识别设备和训练神经网络的方法

Also Published As

Publication number Publication date
US11138496B2 (en) 2021-10-05
TWI846192B (zh) 2024-06-21
KR102598208B1 (ko) 2023-11-02
AU2018330840A1 (en) 2020-02-27
KR102215619B1 (ko) 2021-02-15
CN111033522A (zh) 2020-04-17
US20230316056A1 (en) 2023-10-05
JP7114694B2 (ja) 2022-08-08
US12061974B2 (en) 2024-08-13
KR20200057707A (ko) 2020-05-26
US11507806B2 (en) 2022-11-22
US20250217635A1 (en) 2025-07-03
KR20230154295A (ko) 2023-11-07
TW201921296A (zh) 2019-06-01
EP3679522A4 (en) 2021-06-09
WO2019048922A1 (en) 2019-03-14
CA3112064A1 (en) 2019-03-14
JP2020533668A (ja) 2020-11-19
EP3679522A1 (en) 2020-07-15
US20190080228A1 (en) 2019-03-14
AU2018330840B2 (en) 2021-07-01
TW202328982A (zh) 2023-07-16
AU2021240266B2 (en) 2024-02-29
AU2021240266A1 (en) 2021-10-28
US20190080227A1 (en) 2019-03-14
CN117151177A (zh) 2023-12-01
KR20210018527A (ko) 2021-02-17
TWI789423B (zh) 2023-01-11

Similar Documents

Publication Publication Date Title
CN111033522B (zh) 用于人工智能的并行神经处理器
US11216694B2 (en) Method and apparatus for recognizing object
US12321842B2 (en) Electronic apparatus and method for controlling thereof
US20180157892A1 (en) Eye detection method and apparatus
KR102733834B1 (ko) 전자 장치 및 그 제어 방법
US11829871B2 (en) Validating performance of a neural network trained using labeled training data
US20210158837A1 (en) Sound event detection learning
HK40027705A (en) Parallel neural processor for artificial intelligence
JP7211430B2 (ja) 機械学習装置、機械学習方法、及びプログラム
HK40027705B (zh) 用於人工智能的并行神经处理器
Rahman et al. Continual learning in sensor-based human activity recognition with dynamic mixture of experts
KR20230072353A (ko) 사용자가 의도한 순간의 이미지를 획득하는 전자 장치 및 이의 제어 방법
US12453893B1 (en) Unsupervised training of an activity classifier
AU2023201686C1 (en) Image enhancement
KR102668181B1 (ko) 영상의 회전 특성 학습 방법 및 디바이스
EP4604014A1 (en) Neural network architecture
CN117011623A (zh) 数据处理方法和装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40027705

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant