CN101253493B - 在图形处理单元上训练卷积神经网络 - Google Patents
在图形处理单元上训练卷积神经网络 Download PDFInfo
- Publication number
- CN101253493B CN101253493B CN2006800313052A CN200680031305A CN101253493B CN 101253493 B CN101253493 B CN 101253493B CN 2006800313052 A CN2006800313052 A CN 2006800313052A CN 200680031305 A CN200680031305 A CN 200680031305A CN 101253493 B CN101253493 B CN 101253493B
- Authority
- CN
- China
- Prior art keywords
- gpu
- convolutional neural
- neural networks
- neural network
- texture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
- G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/18—Extraction of features or characteristics of the image
- G06V30/1801—Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections
- G06V30/18019—Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes or intersections by matching or filtering
- G06V30/18038—Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters
- G06V30/18048—Biologically-inspired filters, e.g. difference of Gaussians [DoG], Gabor filters with interaction between the responses of different filters, e.g. cortical complex cells
- G06V30/18057—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- General Physics & Mathematics (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biodiversity & Conservation Biology (AREA)
- Neurology (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (17)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/217,711 | 2005-08-31 | ||
US11/217,711 US7747070B2 (en) | 2005-08-31 | 2005-08-31 | Training convolutional neural networks on graphics processing units |
PCT/US2006/032349 WO2007027452A1 (en) | 2005-08-31 | 2006-08-17 | Training convolutional neural networks on graphics processing units |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101253493A CN101253493A (zh) | 2008-08-27 |
CN101253493B true CN101253493B (zh) | 2012-04-25 |
Family
ID=37804147
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2006800313052A Expired - Fee Related CN101253493B (zh) | 2005-08-31 | 2006-08-17 | 在图形处理单元上训练卷积神经网络 |
Country Status (10)
Country | Link |
---|---|
US (1) | US7747070B2 (zh) |
EP (1) | EP1922637A4 (zh) |
KR (1) | KR101298393B1 (zh) |
CN (1) | CN101253493B (zh) |
AU (1) | AU2006285161A1 (zh) |
BR (1) | BRPI0615219A2 (zh) |
CA (1) | CA2619973A1 (zh) |
IL (1) | IL189124A0 (zh) |
RU (1) | RU2424561C2 (zh) |
WO (1) | WO2007027452A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107710237A (zh) * | 2015-06-29 | 2018-02-16 | 微软技术许可有限责任公司 | 服务器上深度神经网络划分 |
Families Citing this family (177)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9799098B2 (en) * | 2007-04-24 | 2017-10-24 | Massachusetts Institute Of Technology | Method and apparatus for image processing |
JP5184824B2 (ja) * | 2007-06-15 | 2013-04-17 | キヤノン株式会社 | 演算処理装置及び方法 |
US8200025B2 (en) | 2007-12-07 | 2012-06-12 | University Of Ottawa | Image classification and search |
KR20110089649A (ko) * | 2010-02-01 | 2011-08-09 | 삼성전자주식회사 | 병렬 연산 처리 방법 및 장치 |
US9405975B2 (en) | 2010-03-26 | 2016-08-02 | Brain Corporation | Apparatus and methods for pulse-code invariant object recognition |
US8467623B2 (en) | 2010-03-26 | 2013-06-18 | Brain Corporation | Invariant pulse latency coding systems and methods systems and methods |
US9311593B2 (en) | 2010-03-26 | 2016-04-12 | Brain Corporation | Apparatus and methods for polychronous encoding and multiplexing in neuronal prosthetic devices |
US9122994B2 (en) | 2010-03-26 | 2015-09-01 | Brain Corporation | Apparatus and methods for temporally proximate object recognition |
US9193075B1 (en) | 2010-08-26 | 2015-11-24 | Brain Corporation | Apparatus and methods for object detection via optical flow cancellation |
US9147156B2 (en) | 2011-09-21 | 2015-09-29 | Qualcomm Technologies Inc. | Apparatus and methods for synaptic update in a pulse-coded network |
US9047568B1 (en) | 2012-09-20 | 2015-06-02 | Brain Corporation | Apparatus and methods for encoding of sensory data using artificial spiking neurons |
US8725658B2 (en) | 2011-09-21 | 2014-05-13 | Brain Corporation | Elementary network description for efficient memory management in neuromorphic systems |
US8725662B2 (en) | 2011-09-21 | 2014-05-13 | Brain Corporation | Apparatus and method for partial evaluation of synaptic updates based on system events |
US9104973B2 (en) | 2011-09-21 | 2015-08-11 | Qualcomm Technologies Inc. | Elementary network description for neuromorphic systems with plurality of doublets wherein doublet events rules are executed in parallel |
US9412064B2 (en) | 2011-08-17 | 2016-08-09 | Qualcomm Technologies Inc. | Event-based communication in spiking neuron networks communicating a neural activity payload with an efficacy update |
US8719199B2 (en) | 2011-09-21 | 2014-05-06 | Brain Corporation | Systems and methods for providing a neural network having an elementary network description for efficient implementation of event-triggered plasticity rules |
US9460387B2 (en) | 2011-09-21 | 2016-10-04 | Qualcomm Technologies Inc. | Apparatus and methods for implementing event-based updates in neuron networks |
US9098811B2 (en) | 2012-06-04 | 2015-08-04 | Brain Corporation | Spiking neuron network apparatus and methods |
US10210452B2 (en) | 2011-09-21 | 2019-02-19 | Qualcomm Incorporated | High level neuromorphic network description apparatus and methods |
US9117176B2 (en) | 2011-09-21 | 2015-08-25 | Qualcomm Technologies Inc. | Round-trip engineering apparatus and methods for neural networks |
US9224090B2 (en) | 2012-05-07 | 2015-12-29 | Brain Corporation | Sensory input processing apparatus in a spiking neural network |
US9129221B2 (en) | 2012-05-07 | 2015-09-08 | Brain Corporation | Spiking neural network feedback apparatus and methods |
RU2504006C1 (ru) * | 2012-06-05 | 2014-01-10 | Александр Николаевич Цуриков | Способ обучения искусственной нейронной сети |
US9412041B1 (en) | 2012-06-29 | 2016-08-09 | Brain Corporation | Retinal apparatus and methods |
US9256823B2 (en) | 2012-07-27 | 2016-02-09 | Qualcomm Technologies Inc. | Apparatus and methods for efficient updates in spiking neuron network |
US9311594B1 (en) | 2012-09-20 | 2016-04-12 | Brain Corporation | Spiking neuron network apparatus and methods for encoding of sensory data |
US9111226B2 (en) | 2012-10-25 | 2015-08-18 | Brain Corporation | Modulated plasticity apparatus and methods for spiking neuron network |
US9218563B2 (en) | 2012-10-25 | 2015-12-22 | Brain Corporation | Spiking neuron sensory processing apparatus and methods for saliency detection |
US9183493B2 (en) | 2012-10-25 | 2015-11-10 | Brain Corporation | Adaptive plasticity apparatus and methods for spiking neuron network |
US9275326B2 (en) | 2012-11-30 | 2016-03-01 | Brain Corporation | Rate stabilization through plasticity in spiking neuron network |
US9123127B2 (en) | 2012-12-10 | 2015-09-01 | Brain Corporation | Contrast enhancement spiking neuron network sensory processing apparatus and methods |
US9177245B2 (en) | 2013-02-08 | 2015-11-03 | Qualcomm Technologies Inc. | Spiking network apparatus and method with bimodal spike-timing dependent plasticity |
CN103279759B (zh) * | 2013-06-09 | 2016-06-01 | 大连理工大学 | 一种基于卷积神经网络的车辆前方可通行性分析方法 |
CN103366180B (zh) * | 2013-06-14 | 2016-06-01 | 山东大学 | 一种基于自动特征学习的细胞图像分割方法 |
US9239985B2 (en) | 2013-06-19 | 2016-01-19 | Brain Corporation | Apparatus and methods for processing inputs in an artificial neuron network |
US9436909B2 (en) | 2013-06-19 | 2016-09-06 | Brain Corporation | Increased dynamic range artificial neuron network apparatus and methods |
US9552546B1 (en) | 2013-07-30 | 2017-01-24 | Brain Corporation | Apparatus and methods for efficacy balancing in a spiking neuron network |
CN104346622A (zh) | 2013-07-31 | 2015-02-11 | 富士通株式会社 | 卷积神经网络分类器及其分类方法和训练方法 |
RU2553947C2 (ru) * | 2013-08-16 | 2015-06-20 | федеральное государственное автономное образовательное учреждение высшего образования "Нижегородский государственный университет им. Н.И.Лобачевского" | Способ обучения биологической нейронной сети культуры, выращенной на мультиэлектродной матрице |
US9489623B1 (en) | 2013-10-15 | 2016-11-08 | Brain Corporation | Apparatus and methods for backward propagation of errors in a spiking neuron network |
US9400925B2 (en) * | 2013-11-15 | 2016-07-26 | Facebook, Inc. | Pose-aligned networks for deep attribute modeling |
CN104809426B (zh) * | 2014-01-27 | 2019-04-05 | 日本电气株式会社 | 卷积神经网络的训练方法、目标识别方法及装置 |
JP6370469B2 (ja) | 2014-04-11 | 2018-08-08 | グーグル エルエルシー | 畳み込みニューラルネットワークのトレーニングの並列化 |
US10194163B2 (en) | 2014-05-22 | 2019-01-29 | Brain Corporation | Apparatus and methods for real time estimation of differential motion in live video |
US9939253B2 (en) | 2014-05-22 | 2018-04-10 | Brain Corporation | Apparatus and methods for distance estimation using multiple image sensors |
US9713982B2 (en) | 2014-05-22 | 2017-07-25 | Brain Corporation | Apparatus and methods for robotic operation using video imagery |
US9848112B2 (en) | 2014-07-01 | 2017-12-19 | Brain Corporation | Optical detection apparatus and methods |
US10057593B2 (en) | 2014-07-08 | 2018-08-21 | Brain Corporation | Apparatus and methods for distance estimation using stereo imagery |
CN104200224A (zh) * | 2014-08-28 | 2014-12-10 | 西北工业大学 | 基于深度卷积神经网络的无价值图像去除方法 |
WO2016033506A1 (en) | 2014-08-29 | 2016-03-03 | Google Inc. | Processing images using deep neural networks |
US9870617B2 (en) | 2014-09-19 | 2018-01-16 | Brain Corporation | Apparatus and methods for saliency detection based on color occurrence analysis |
US10417525B2 (en) | 2014-09-22 | 2019-09-17 | Samsung Electronics Co., Ltd. | Object recognition with reduced neural network weight precision |
CN104268521A (zh) * | 2014-09-23 | 2015-01-07 | 朱毅 | 一种基于非限定类别的卷积神经网络的图像识别方法 |
US9881349B1 (en) | 2014-10-24 | 2018-01-30 | Gopro, Inc. | Apparatus and methods for computerized object identification |
US10255547B2 (en) * | 2014-12-04 | 2019-04-09 | Nvidia Corporation | Indirectly accessing sample data to perform multi-convolution operations in a parallel processing system |
CN107004142B (zh) * | 2014-12-10 | 2018-04-17 | 北京市商汤科技开发有限公司 | 用于图像分类的方法和系统 |
WO2016095117A1 (en) * | 2014-12-17 | 2016-06-23 | Nokia Technologies Oy | Object detection with neural network |
US10127439B2 (en) | 2015-01-15 | 2018-11-13 | Samsung Electronics Co., Ltd. | Object recognition method and apparatus |
CN105894087A (zh) * | 2015-01-26 | 2016-08-24 | 华为技术有限公司 | 用于神经网络中训练参数集的系统和方法 |
CN107278310A (zh) | 2015-01-28 | 2017-10-20 | 谷歌公司 | 批次归一化层 |
CN106056529B (zh) * | 2015-04-03 | 2020-06-02 | 阿里巴巴集团控股有限公司 | 一种对用于图片识别的卷积神经网络训练的方法与设备 |
CN104866810B (zh) * | 2015-04-10 | 2018-07-13 | 北京工业大学 | 一种深度卷积神经网络的人脸识别方法 |
CN104866550A (zh) * | 2015-05-12 | 2015-08-26 | 湖北光谷天下传媒股份有限公司 | 一种模拟神经网络的文本过滤方法 |
CN106203619B (zh) * | 2015-05-29 | 2022-09-13 | 三星电子株式会社 | 数据优化的神经网络遍历 |
KR102084930B1 (ko) * | 2015-06-03 | 2020-03-05 | 미쓰비시덴키 가부시키가이샤 | 추론 장치 및 추론 방법 |
EP3262569A1 (en) * | 2015-06-05 | 2018-01-03 | Google, Inc. | Spatial transformer modules |
US10540588B2 (en) * | 2015-06-29 | 2020-01-21 | Microsoft Technology Licensing, Llc | Deep neural network processing on hardware accelerators with stacked memory |
US10157279B2 (en) * | 2015-07-15 | 2018-12-18 | Cylance Inc. | Malware detection |
US10197664B2 (en) | 2015-07-20 | 2019-02-05 | Brain Corporation | Apparatus and methods for detection of objects using broadband signals |
US11074492B2 (en) | 2015-10-07 | 2021-07-27 | Altera Corporation | Method and apparatus for performing different types of convolution operations with the same processing elements |
US10380479B2 (en) * | 2015-10-08 | 2019-08-13 | International Business Machines Corporation | Acceleration of convolutional neural network training using stochastic perforation |
KR102509819B1 (ko) | 2015-11-04 | 2023-03-14 | 삼성전자주식회사 | 신호 처리 장치 및 신호 처리 방법 |
US9904874B2 (en) | 2015-11-05 | 2018-02-27 | Microsoft Technology Licensing, Llc | Hardware-efficient deep convolutional neural networks |
CN106708499B (zh) * | 2015-11-13 | 2020-10-27 | 财团法人工业技术研究院 | 绘图处理程序的分析方法与分析系统 |
CN105469100B (zh) * | 2015-11-30 | 2018-10-12 | 广东工业大学 | 基于深度学习的皮肤活检图像病理特性识别方法 |
US10832134B2 (en) * | 2015-12-10 | 2020-11-10 | Deepmind Technologies Limited | Augmenting neural networks with external memory |
CN106875203A (zh) * | 2015-12-14 | 2017-06-20 | 阿里巴巴集团控股有限公司 | 一种确定商品图片的款式信息的方法及装置 |
WO2017100903A1 (en) * | 2015-12-14 | 2017-06-22 | Motion Metrics International Corp. | Method and apparatus for identifying fragmented material portions within an image |
US9785855B2 (en) | 2015-12-17 | 2017-10-10 | Conduent Business Services, Llc | Coarse-to-fine cascade adaptations for license plate recognition with convolutional neural networks |
CN105550750B (zh) * | 2015-12-21 | 2017-10-17 | 长沙网动网络科技有限公司 | 提高卷积神经网络识别精度的方法 |
WO2017113205A1 (zh) * | 2015-12-30 | 2017-07-06 | 中国科学院深圳先进技术研究院 | 一种基于深度卷积神经网络的快速磁共振成像方法及装置 |
CN111353589B (zh) * | 2016-01-20 | 2024-03-01 | 中科寒武纪科技股份有限公司 | 用于执行人工神经网络正向运算的装置和方法 |
CN106991478B (zh) * | 2016-01-20 | 2020-05-08 | 中科寒武纪科技股份有限公司 | 用于执行人工神经网络反向训练的装置和方法 |
US10013653B2 (en) * | 2016-01-26 | 2018-07-03 | Università della Svizzera italiana | System and a method for learning features on geometric domains |
US10210430B2 (en) * | 2016-01-26 | 2019-02-19 | Fabula Ai Limited | System and a method for learning features on geometric domains |
CN108701210B (zh) * | 2016-02-02 | 2021-08-17 | 北京市商汤科技开发有限公司 | 用于cnn网络适配和对象在线追踪的方法和系统 |
US11755913B2 (en) * | 2016-03-11 | 2023-09-12 | Telecom Italia S.P.A | Convolutional neural networks, particularly for image analysis |
US10420523B2 (en) | 2016-03-21 | 2019-09-24 | The Board Of Trustees Of The Leland Stanford Junior University | Adaptive local window-based methods for characterizing features of interest in digital images and systems for practicing same |
US20170277955A1 (en) * | 2016-03-23 | 2017-09-28 | Le Holdings (Beijing) Co., Ltd. | Video identification method and system |
CN107292385A (zh) * | 2016-03-31 | 2017-10-24 | 阿里巴巴集团控股有限公司 | 一种类Alexnet网络的模型训练方法和装置 |
CN109375951B (zh) * | 2016-04-27 | 2020-10-09 | 中科寒武纪科技股份有限公司 | 一种用于执行全连接层神经网络正向运算的装置和方法 |
CN107315569B (zh) * | 2016-04-27 | 2021-06-18 | 中科寒武纪科技股份有限公司 | 一种用于执行RMSprop梯度下降算法的装置及方法 |
US9847974B2 (en) | 2016-04-28 | 2017-12-19 | Xerox Corporation | Image document processing in a client-server system including privacy-preserving text recognition |
CN107341547B (zh) * | 2016-04-29 | 2021-04-20 | 中科寒武纪科技股份有限公司 | 一种用于执行卷积神经网络训练的装置和方法 |
CN107329734B (zh) * | 2016-04-29 | 2020-08-07 | 中科寒武纪科技股份有限公司 | 一种用于执行卷积神经网络正向运算的装置和方法 |
CN109643395B (zh) * | 2016-05-24 | 2024-03-05 | 英特尔公司 | 自适应窗口机制 |
US10303977B2 (en) | 2016-06-28 | 2019-05-28 | Conduent Business Services, Llc | System and method for expanding and training convolutional neural networks for large size input images |
CN106355247B (zh) * | 2016-08-16 | 2019-03-08 | 算丰科技(北京)有限公司 | 数据处理方法和装置、芯片和电子设备 |
US11080591B2 (en) | 2016-09-06 | 2021-08-03 | Deepmind Technologies Limited | Processing sequences using convolutional neural networks |
KR102353284B1 (ko) * | 2016-09-06 | 2022-01-19 | 딥마인드 테크놀로지스 리미티드 | 신경망을 사용하여 오디오 생성 |
CN109906455A (zh) * | 2016-09-08 | 2019-06-18 | Aiq私人股份有限公司 | 视觉搜索查询中的对象检测 |
EP3523751A4 (en) | 2016-10-04 | 2020-05-06 | Magic Leap, Inc. | EFFICIENT DATA ARRANGEMENTS FOR CONVOLUTIONAL NEURAL NETWORKS |
WO2018081089A1 (en) | 2016-10-26 | 2018-05-03 | Deepmind Technologies Limited | Processing text sequences using neural networks |
KR20180060149A (ko) | 2016-11-28 | 2018-06-07 | 삼성전자주식회사 | 컨볼루션 처리 장치 및 방법 |
US10360494B2 (en) * | 2016-11-30 | 2019-07-23 | Altumview Systems Inc. | Convolutional neural network (CNN) system based on resolution-limited small-scale CNN modules |
EP3330898A1 (en) * | 2016-12-01 | 2018-06-06 | Altera Corporation | Method and apparatus for performing different types of convolution operations with the same processing elements |
US10657424B2 (en) * | 2016-12-07 | 2020-05-19 | Samsung Electronics Co., Ltd. | Target detection method and apparatus |
US20180165845A1 (en) * | 2016-12-09 | 2018-06-14 | Free Construction Sp. Z o.o. | Method of Analysis of Visualised Data |
CN106855996B (zh) * | 2016-12-13 | 2020-01-03 | 中山大学 | 一种基于卷积神经网络的灰阶图像着色方法及其装置 |
KR20180073118A (ko) | 2016-12-22 | 2018-07-02 | 삼성전자주식회사 | 컨볼루션 신경망 처리 방법 및 장치 |
US10437878B2 (en) * | 2016-12-28 | 2019-10-08 | Shutterstock, Inc. | Identification of a salient portion of an image |
US10586148B2 (en) * | 2016-12-31 | 2020-03-10 | Via Alliance Semiconductor Co., Ltd. | Neural network unit with re-shapeable memory |
US11334836B2 (en) * | 2017-01-04 | 2022-05-17 | MSM Holdings Pte Ltd | System and method for analyzing media for talent discovery |
US10810721B2 (en) * | 2017-03-14 | 2020-10-20 | Adobe Inc. | Digital image defect identification and correction |
US10678244B2 (en) | 2017-03-23 | 2020-06-09 | Tesla, Inc. | Data synthesis for autonomous control systems |
RU2651147C1 (ru) * | 2017-03-27 | 2018-04-18 | Акционерное общество "ЭЛВИС-НеоТек" | Устройство и способ каскадной обработки потока изображений с помощью свёрточных нейронных сетей |
RU173468U1 (ru) * | 2017-03-27 | 2017-08-29 | Акционерное общество "ЭЛВИС-НеоТек" | Устройство каскадной обработки потока изображений с помощью свёрточных нейронных сетей |
US10546237B2 (en) | 2017-03-30 | 2020-01-28 | Atomwise Inc. | Systems and methods for correcting error in a first classifier by evaluating classifier output in parallel |
US10475165B2 (en) * | 2017-04-06 | 2019-11-12 | Disney Enterprises, Inc. | Kernel-predicting convolutional neural networks for denoising |
US11037330B2 (en) | 2017-04-08 | 2021-06-15 | Intel Corporation | Low rank matrix compression |
US10261903B2 (en) | 2017-04-17 | 2019-04-16 | Intel Corporation | Extend GPU/CPU coherency to multi-GPU cores |
US10795836B2 (en) * | 2017-04-17 | 2020-10-06 | Microsoft Technology Licensing, Llc | Data processing performance enhancement for neural networks using a virtualized data iterator |
US11164071B2 (en) * | 2017-04-18 | 2021-11-02 | Samsung Electronics Co., Ltd. | Method and apparatus for reducing computational complexity of convolutional neural networks |
US10417734B2 (en) | 2017-04-24 | 2019-09-17 | Intel Corporation | Compute optimization mechanism for deep neural networks |
US10417731B2 (en) | 2017-04-24 | 2019-09-17 | Intel Corporation | Compute optimization mechanism for deep neural networks |
CN107145902B (zh) * | 2017-04-27 | 2019-10-11 | 厦门美图之家科技有限公司 | 一种基于卷积神经网络的图像处理方法、装置及移动终端 |
US11893393B2 (en) | 2017-07-24 | 2024-02-06 | Tesla, Inc. | Computational array microprocessor system with hardware arbiter managing memory requests |
US11157441B2 (en) | 2017-07-24 | 2021-10-26 | Tesla, Inc. | Computational array microprocessor system using non-consecutive data formatting |
US10671349B2 (en) | 2017-07-24 | 2020-06-02 | Tesla, Inc. | Accelerated mathematical engine |
US11409692B2 (en) | 2017-07-24 | 2022-08-09 | Tesla, Inc. | Vector computational unit |
CN107292319A (zh) * | 2017-08-04 | 2017-10-24 | 广东工业大学 | 一种基于可变形卷积层的特征图像提取的方法及装置 |
RU2656990C1 (ru) * | 2017-09-11 | 2018-06-07 | Самсунг Электроникс Ко., Лтд. | Система и способ для искусственной нейронной сети, инвариантной к сдвигу |
KR101934443B1 (ko) | 2017-09-20 | 2019-01-02 | 대한민국 | 합성곱신경망과 이미지 추출을 이용한 주자본과 목판본의 분류 정보 제공 방법 |
US10747999B2 (en) * | 2017-10-18 | 2020-08-18 | The Trustees Of Columbia University In The City Of New York | Methods and systems for pattern characteristic detection |
US10599978B2 (en) * | 2017-11-03 | 2020-03-24 | International Business Machines Corporation | Weighted cascading convolutional neural networks |
KR20190051697A (ko) * | 2017-11-07 | 2019-05-15 | 삼성전자주식회사 | 뉴럴 네트워크의 디컨벌루션 연산을 수행하는 장치 및 방법 |
CN107808394B (zh) * | 2017-11-16 | 2020-05-15 | 厦门美图之家科技有限公司 | 一种基于卷积神经网络的图像处理方法及移动终端 |
CN109961138B (zh) * | 2017-12-14 | 2020-04-14 | 中科寒武纪科技股份有限公司 | 神经网络训练方法及相关产品 |
US11710028B2 (en) * | 2017-12-30 | 2023-07-25 | Intel Corporation | Efficient convolution in machine learning environments |
US11091162B2 (en) | 2018-01-30 | 2021-08-17 | Toyota Motor Engineering & Manufacturing North America, Inc. | Fusion of front vehicle sensor data for detection and ranging of preceding objects |
US11561791B2 (en) | 2018-02-01 | 2023-01-24 | Tesla, Inc. | Vector computational unit receiving data elements in parallel from a last row of a computational array |
CN110309912B (zh) * | 2018-03-27 | 2021-08-13 | 赛灵思公司 | 数据存取方法、装置、硬件加速器、计算设备、存储介质 |
TWI654541B (zh) | 2018-04-13 | 2019-03-21 | 矽統科技股份有限公司 | 觸控面板上的敲擊事件的識別方法及系統,以及終端觸控產品 |
CN108765247B (zh) * | 2018-05-15 | 2023-01-10 | 腾讯科技(深圳)有限公司 | 图像处理方法、装置、存储介质及设备 |
US11215999B2 (en) | 2018-06-20 | 2022-01-04 | Tesla, Inc. | Data pipeline and deep learning system for autonomous driving |
US11361457B2 (en) | 2018-07-20 | 2022-06-14 | Tesla, Inc. | Annotation cross-labeling for autonomous control systems |
US11636333B2 (en) | 2018-07-26 | 2023-04-25 | Tesla, Inc. | Optimizing neural network structures for embedded systems |
US11562231B2 (en) | 2018-09-03 | 2023-01-24 | Tesla, Inc. | Neural networks for embedded devices |
KR102633139B1 (ko) | 2018-09-07 | 2024-02-02 | 삼성전자주식회사 | 데이터를 추출하는 집적 회로, 그것을 포함하는 뉴럴 네트워크 프로세서 및 뉴럴 네트워크 장치 |
RU2704751C1 (ru) * | 2018-10-08 | 2019-10-30 | федеральное государственное бюджетное образовательное учреждение высшего образования "Пермский национальный исследовательский политехнический университет" | Способ определения параметров термомеханической обработки и химического состава функциональных материалов с помощью глубокой нейронной сети |
IL282172B2 (en) | 2018-10-11 | 2024-02-01 | Tesla Inc | Systems and methods for training machine models with enhanced data |
US11196678B2 (en) | 2018-10-25 | 2021-12-07 | Tesla, Inc. | QOS manager for system on a chip communications |
KR102533235B1 (ko) | 2018-11-01 | 2023-05-17 | 서강대학교산학협력단 | 컨볼루션 신경망 기반의 입력 분류 장치 및 방법 |
KR20210102240A (ko) * | 2018-11-07 | 2021-08-19 | 엘레먼트 에이아이 인크. | 훈련 세트로서 사용하기 위한 문서로부터 민감한 데이터를 제거하는 기법 |
US11816585B2 (en) | 2018-12-03 | 2023-11-14 | Tesla, Inc. | Machine learning models operating at different frequencies for autonomous vehicles |
US11537811B2 (en) | 2018-12-04 | 2022-12-27 | Tesla, Inc. | Enhanced object detection for autonomous vehicles based on field view |
WO2021141567A1 (en) | 2020-01-06 | 2021-07-15 | Eightfold AI Inc. | System, method, and computer program for using machine learning to calibrate job description based on diversity criteria |
US11030583B1 (en) | 2018-12-04 | 2021-06-08 | Eightfold AI Inc. | System, method, and computer program for automatically removing data from candidate profiles that may influence bias |
US11176271B1 (en) * | 2018-12-04 | 2021-11-16 | Eightfold AI Inc. | System, method, and computer program for enabling a candidate to anonymously apply for a job |
US11610117B2 (en) | 2018-12-27 | 2023-03-21 | Tesla, Inc. | System and method for adapting a neural network model on a hardware platform |
US11557107B2 (en) | 2019-01-02 | 2023-01-17 | Bank Of America Corporation | Intelligent recognition and extraction of numerical data from non-numerical graphical representations |
US11544559B2 (en) * | 2019-01-08 | 2023-01-03 | Neuralmagic Inc. | System and method for executing convolution in a neural network |
KR20200086546A (ko) | 2019-01-09 | 2020-07-17 | (주) 모터에이드 | 병렬 딥러닝 처리 시스템 |
CN111507362B (zh) * | 2019-01-30 | 2023-12-19 | 中强光电股份有限公司 | 神经网络的训练方法、基于神经网络的分类方法及其装置 |
US10997461B2 (en) | 2019-02-01 | 2021-05-04 | Tesla, Inc. | Generating ground truth for machine learning from time series elements |
US11567514B2 (en) | 2019-02-11 | 2023-01-31 | Tesla, Inc. | Autonomous and user controlled vehicle summon to a target |
CN110059813B (zh) * | 2019-02-13 | 2021-04-06 | 创新先进技术有限公司 | 利用gpu集群更新卷积神经网络的方法、装置及设备 |
US10956755B2 (en) | 2019-02-19 | 2021-03-23 | Tesla, Inc. | Estimating object properties using visual image data |
US11699070B2 (en) * | 2019-03-05 | 2023-07-11 | Samsung Electronics Co., Ltd | Method and apparatus for providing rotational invariant neural networks |
US11119820B2 (en) * | 2019-03-15 | 2021-09-14 | Intel Corporation | Local memory sharing between kernels |
KR20210004229A (ko) | 2019-07-03 | 2021-01-13 | 삼성전자주식회사 | 뉴럴 네트워크 프로세서를 구비하는 이미지 프로세싱 장치 및 이의 동작 방법 |
RU2717911C1 (ru) * | 2019-08-06 | 2020-03-26 | Общество с Ограниченной Ответственностью "Цифровые Технологии в Хирургии" | Способ обучения сверточной нейронной сети осуществлять разметки телерентгенограмм в прямой и боковой проекциях |
US11556450B2 (en) | 2019-10-11 | 2023-01-17 | International Business Machines Corporation | Hybrid data-model parallelism for efficient deep learning |
CN112785486A (zh) * | 2019-11-07 | 2021-05-11 | 英特尔公司 | 用于图像去噪声的自适应可变形核预测网络 |
US11521062B2 (en) | 2019-12-05 | 2022-12-06 | International Business Machines Corporation | Neural network training using a data flow graph and dynamic memory management |
US20230367995A1 (en) * | 2020-10-01 | 2023-11-16 | Board Of Supervisors Of Louisiana State University And Agricultural And Mechanical College | System and method for an adjustable neural network |
US11960982B1 (en) | 2021-10-21 | 2024-04-16 | Neuralmagic, Inc. | System and method of determining and executing deep tensor columns in neural networks |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1627251A (zh) * | 2003-12-09 | 2005-06-15 | 微软公司 | 使用图形处理单元加速并优化机器学习技术的处理 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5647027A (en) * | 1994-10-28 | 1997-07-08 | Lucent Technologies Inc. | Method of image enhancement using convolution kernels |
US6128606A (en) | 1997-03-11 | 2000-10-03 | At&T Corporation | Module for constructing trainable modular network in which each module inputs and outputs data structured as a graph |
US6553131B1 (en) * | 1999-09-15 | 2003-04-22 | Siemens Corporate Research, Inc. | License plate recognition with an intelligent camera |
US7016529B2 (en) * | 2002-03-15 | 2006-03-21 | Microsoft Corporation | System and method facilitating pattern recognition |
US7418128B2 (en) * | 2003-07-31 | 2008-08-26 | Microsoft Corporation | Elastic distortions for automatic generation of labeled data |
US7660713B2 (en) | 2003-10-23 | 2010-02-09 | Microsoft Corporation | Systems and methods that detect a desired signal via a linear discriminative classifier that utilizes an estimated posterior signal-to-noise ratio (SNR) |
-
2005
- 2005-08-31 US US11/217,711 patent/US7747070B2/en active Active
-
2006
- 2006-08-17 RU RU2008107746/08A patent/RU2424561C2/ru not_active IP Right Cessation
- 2006-08-17 WO PCT/US2006/032349 patent/WO2007027452A1/en active Application Filing
- 2006-08-17 CA CA002619973A patent/CA2619973A1/en not_active Abandoned
- 2006-08-17 CN CN2006800313052A patent/CN101253493B/zh not_active Expired - Fee Related
- 2006-08-17 AU AU2006285161A patent/AU2006285161A1/en not_active Abandoned
- 2006-08-17 EP EP06801862A patent/EP1922637A4/en not_active Withdrawn
- 2006-08-17 BR BRPI0615219-8A patent/BRPI0615219A2/pt not_active Application Discontinuation
- 2006-08-17 KR KR1020087003564A patent/KR101298393B1/ko not_active IP Right Cessation
-
2008
- 2008-01-30 IL IL189124A patent/IL189124A0/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1627251A (zh) * | 2003-12-09 | 2005-06-15 | 微软公司 | 使用图形处理单元加速并优化机器学习技术的处理 |
Non-Patent Citations (1)
Title |
---|
李葆青.基于卷积神经网络的模式分类器.《大连大学学报》.2003,第24卷(第2期),正文第1-2段,图1. * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107710237A (zh) * | 2015-06-29 | 2018-02-16 | 微软技术许可有限责任公司 | 服务器上深度神经网络划分 |
Also Published As
Publication number | Publication date |
---|---|
CN101253493A (zh) | 2008-08-27 |
WO2007027452A1 (en) | 2007-03-08 |
EP1922637A1 (en) | 2008-05-21 |
US7747070B2 (en) | 2010-06-29 |
US20070047802A1 (en) | 2007-03-01 |
IL189124A0 (en) | 2008-08-07 |
KR20080042083A (ko) | 2008-05-14 |
CA2619973A1 (en) | 2007-03-08 |
BRPI0615219A2 (pt) | 2011-05-10 |
EP1922637A4 (en) | 2010-03-17 |
RU2424561C2 (ru) | 2011-07-20 |
RU2008107746A (ru) | 2009-09-10 |
AU2006285161A1 (en) | 2007-03-08 |
KR101298393B1 (ko) | 2013-08-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101253493B (zh) | 在图形处理单元上训练卷积神经网络 | |
EP3788470B1 (en) | Block floating point computations using reduced bit-width vectors | |
CN108985317B (zh) | 一种基于可分离卷积和注意力机制的图像分类方法 | |
EP4357979A2 (en) | Superpixel methods for convolutional neural networks | |
CN106951962A (zh) | 用于神经网络的复合运算单元、方法和电子设备 | |
EP2648132A1 (en) | System and method for accelerating and optimizing the processing of machine learning techniques using a graphics processing unit | |
CN107239733A (zh) | 连续手写字识别方法及系统 | |
CN109902723A (zh) | 图像处理方法及装置 | |
CN113870293B (zh) | 图像处理方法、装置、电子设备及存储介质 | |
CN104285239A (zh) | 图像处理装置、图像处理方法、程序、印刷介质以及记录介质 | |
CN107832794A (zh) | 一种卷积神经网络生成方法、车系识别方法及计算设备 | |
CN111739037B (zh) | 一种针对室内场景rgb-d图像的语义分割方法 | |
CN111382759A (zh) | 一种像素级分类方法、装置、设备及存储介质 | |
CN115147598A (zh) | 目标检测分割方法、装置、智能终端及存储介质 | |
CN114283347B (zh) | 目标检测方法、系统、智能终端及计算机可读存储介质 | |
CN105740786A (zh) | 书写人的身份识别方法及装置 | |
US10747845B2 (en) | System, method and apparatus for computationally efficient data manipulation | |
CN109344839B (zh) | 图像处理方法和装置、电子设备、存储介质、程序产品 | |
US20220044104A1 (en) | Method and apparatus for forward computation of neural network, and computer-readable storage medium | |
DE102017117381A1 (de) | Beschleuniger für dünnbesetzte faltende neuronale Netze | |
Han et al. | Spatial steganalysis based on non-local block and multi-channel convolutional networks | |
CN112949841B (zh) | 一种基于Attention的CNN神经网络的行人重识别方法 | |
CN115496993B (zh) | 基于频域融合的目标检测方法、装置、设备及存储介质 | |
CN109799483A (zh) | 一种数据处理方法和装置 | |
CN113762241A (zh) | 场景文字识别模型的训练方法与识别方法及装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
ASS | Succession or assignment of patent right |
Owner name: MICROSOFT TECHNOLOGY LICENSING LLC Free format text: FORMER OWNER: MICROSOFT CORP. Effective date: 20150430 |
|
C41 | Transfer of patent application or patent right or utility model | ||
TR01 | Transfer of patent right |
Effective date of registration: 20150430 Address after: Washington State Patentee after: Micro soft technique license Co., Ltd Address before: Washington State Patentee before: Microsoft Corp. |
|
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120425 Termination date: 20140817 |
|
EXPY | Termination of patent right or utility model |