KR102574307B1 - 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체 - Google Patents

정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체 Download PDF

Info

Publication number
KR102574307B1
KR102574307B1 KR1020190118500A KR20190118500A KR102574307B1 KR 102574307 B1 KR102574307 B1 KR 102574307B1 KR 1020190118500 A KR1020190118500 A KR 1020190118500A KR 20190118500 A KR20190118500 A KR 20190118500A KR 102574307 B1 KR102574307 B1 KR 102574307B1
Authority
KR
South Korea
Prior art keywords
data
layer
shift
multiplication
shift operation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020190118500A
Other languages
English (en)
Korean (ko)
Other versions
KR20200038414A (ko
Inventor
체웨이 첸
Original Assignee
캐논 가부시끼가이샤
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 캐논 가부시끼가이샤 filed Critical 캐논 가부시끼가이샤
Publication of KR20200038414A publication Critical patent/KR20200038414A/ko
Priority to KR1020230114588A priority Critical patent/KR102585470B1/ko
Application granted granted Critical
Publication of KR102574307B1 publication Critical patent/KR102574307B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/97Determining parameters from multiple pictures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G06F7/38Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation
    • G06F7/48Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices
    • G06F7/544Methods or arrangements for performing computations using exclusively denominational number representation, e.g. using binary, ternary, decimal representation using non-contact-making devices, e.g. tube, solid state device; using unspecified devices for evaluating functions by calculation
    • G06F7/5443Sum of products
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F5/00Methods or arrangements for data conversion without changing the order or content of the data handled
    • G06F5/01Methods or arrangements for data conversion without changing the order or content of the data handled for shifting, e.g. justifying, scaling, normalising
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0495Quantised networks; Sparse networks; Compressed networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/06Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Neurology (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Complex Calculations (AREA)
KR1020190118500A 2018-10-03 2019-09-26 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체 Active KR102574307B1 (ko)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020230114588A KR102585470B1 (ko) 2018-10-03 2023-08-30 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018188612A JP7165018B2 (ja) 2018-10-03 2018-10-03 情報処理装置、情報処理方法
JPJP-P-2018-188612 2018-10-03

Related Child Applications (1)

Application Number Title Priority Date Filing Date
KR1020230114588A Division KR102585470B1 (ko) 2018-10-03 2023-08-30 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체

Publications (2)

Publication Number Publication Date
KR20200038414A KR20200038414A (ko) 2020-04-13
KR102574307B1 true KR102574307B1 (ko) 2023-09-05

Family

ID=67997368

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020190118500A Active KR102574307B1 (ko) 2018-10-03 2019-09-26 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체
KR1020230114588A Active KR102585470B1 (ko) 2018-10-03 2023-08-30 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020230114588A Active KR102585470B1 (ko) 2018-10-03 2023-08-30 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체

Country Status (5)

Country Link
US (2) US11468600B2 (enExample)
EP (1) EP3633559B1 (enExample)
JP (2) JP7165018B2 (enExample)
KR (2) KR102574307B1 (enExample)
CN (1) CN110991627B (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7165018B2 (ja) * 2018-10-03 2022-11-02 キヤノン株式会社 情報処理装置、情報処理方法
US12039430B2 (en) * 2019-11-15 2024-07-16 Samsung Electronics Co., Ltd. Electronic device and method for inference binary and ternary neural networks
CN114201129B (zh) * 2020-09-18 2024-11-15 比亚迪股份有限公司 智能设备的屏幕投影方法、装置、存储介质及终端
CN112346703B (zh) * 2020-11-24 2021-10-22 华中科技大学 一种用于卷积神经网络计算的全局平均池化电路
JP7719617B2 (ja) * 2021-03-19 2025-08-06 キヤノン株式会社 画像処理装置、画像処理方法
CN114565501B (zh) * 2022-02-21 2024-03-22 格兰菲智能科技有限公司 用于卷积运算的数据加载方法及其装置
JP2024026993A (ja) * 2022-08-16 2024-02-29 キヤノン株式会社 情報処理装置、情報処理方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017079017A (ja) * 2015-10-21 2017-04-27 キヤノン株式会社 畳み込み演算装置

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1058185A1 (en) * 1999-05-31 2000-12-06 Motorola, Inc. A multiply and accumulate apparatus and a method thereof
JP4630056B2 (ja) 2004-12-24 2011-02-09 株式会社アドバンテスト 畳み込み演算回路
JP4571903B2 (ja) 2005-12-02 2010-10-27 富士通株式会社 演算処理装置,情報処理装置,及び演算処理方法
US9031006B2 (en) * 2008-03-13 2015-05-12 Samsung Electronics Co., Ltd Apparatus and method for using guard band as data subcarrier in communication system supporting frequency overlay
JP5376920B2 (ja) * 2008-12-04 2013-12-25 キヤノン株式会社 コンボリューション演算回路、階層的コンボリューション演算回路及び物体認識装置
US8706791B2 (en) * 2009-07-30 2014-04-22 Ceva D.S.P. Ltd. Low power fir filter in multi-MAC architecture
JP5589628B2 (ja) 2010-07-12 2014-09-17 株式会社リコー 内積演算装置および内積演算方法
JP2013152454A (ja) 2011-12-27 2013-08-08 Canon Inc 画像処理装置、画像処理システム、画像処理方法および画像処理プログラム
US10623752B2 (en) 2013-12-27 2020-04-14 Sony Corporation Image processing apparatus and method
US20160328645A1 (en) * 2015-05-08 2016-11-10 Qualcomm Incorporated Reduced computational complexity for fixed point neural network
US10546211B2 (en) * 2016-07-01 2020-01-28 Google Llc Convolutional neural network on programmable two dimensional image processor
CN106528046B (zh) * 2016-11-02 2019-06-07 上海集成电路研发中心有限公司 长位宽时序累加乘法器
WO2018103736A1 (en) * 2016-12-09 2018-06-14 Beijing Horizon Information Technology Co., Ltd. Systems and methods for data management
US11775313B2 (en) * 2017-05-26 2023-10-03 Purdue Research Foundation Hardware accelerator for convolutional neural networks and method of operation thereof
CN108475188A (zh) * 2017-07-31 2018-08-31 深圳市大疆创新科技有限公司 数据处理方法和设备
JP2019074967A (ja) * 2017-10-17 2019-05-16 キヤノン株式会社 フィルタ処理装置およびその制御方法
CN107844826B (zh) * 2017-10-30 2020-07-31 中国科学院计算技术研究所 神经网络处理单元及包含该处理单元的处理系统
US10929746B2 (en) * 2017-11-27 2021-02-23 Samsung Electronics Co., Ltd. Low-power hardware acceleration method and system for convolution neural network computation
JP6540841B1 (ja) * 2018-02-27 2019-07-10 富士通株式会社 演算処理装置、情報処理装置、情報処理方法、およびプログラム
JP7165018B2 (ja) * 2018-10-03 2022-11-02 キヤノン株式会社 情報処理装置、情報処理方法
JP7402623B2 (ja) * 2019-06-17 2023-12-21 キヤノン株式会社 フィルタ処理装置及びその制御方法
JP7659373B2 (ja) * 2020-07-09 2025-04-09 キヤノン株式会社 畳み込みニューラルネットワーク処理装置

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017079017A (ja) * 2015-10-21 2017-04-27 キヤノン株式会社 畳み込み演算装置

Also Published As

Publication number Publication date
US20200111235A1 (en) 2020-04-09
JP7165018B2 (ja) 2022-11-02
CN110991627A (zh) 2020-04-10
US20220414938A1 (en) 2022-12-29
EP3633559B1 (en) 2025-05-21
CN110991627B (zh) 2025-01-07
US11468600B2 (en) 2022-10-11
US11810330B2 (en) 2023-11-07
KR102585470B1 (ko) 2023-10-06
KR20230130591A (ko) 2023-09-12
EP3633559A1 (en) 2020-04-08
JP7414930B2 (ja) 2024-01-16
JP2022188301A (ja) 2022-12-20
JP2020057286A (ja) 2020-04-09
KR20200038414A (ko) 2020-04-13

Similar Documents

Publication Publication Date Title
KR102574307B1 (ko) 정보 처리장치, 정보 처리방법, 비일시적인 컴퓨터 판독가능한 기억매체
US11429838B2 (en) Neural network device for neural network operation, method of operating neural network device, and application processor including the neural network device
US12050987B2 (en) Dynamic variable bit width neural processor
US20200364552A1 (en) Quantization method of improving the model inference accuracy
EP3528181B1 (en) Processing method of neural network and apparatus using the processing method
US12430546B2 (en) General padding support for convolution on systolic arrays
US20200394516A1 (en) Filter processing device and method of performing convolution operation at filter processing device
US20220092399A1 (en) Area-Efficient Convolutional Block
JP2022512211A (ja) 画像処理方法、装置、車載演算プラットフォーム、電子機器及びシステム
US11900577B2 (en) Processing apparatus for performing processing using a convolutional neural network
CN116348889A (zh) 用以减少GPU存储器的ReLU压缩
CN114792387A (zh) 图像恢复方法和设备
KR20250002218A (ko) 신경망에서 선형 활성화 함수를 구현하기 위한 명령어 세트 아키텍처
JP2018525730A (ja) スライディングウィンドウ演算
WO2022163861A1 (ja) ニューラルネットワーク生成装置、ニューラルネットワーク演算装置、エッジデバイス、ニューラルネットワーク制御方法およびソフトウェア生成プログラム
US20220309778A1 (en) Image processing apparatus, image processing method, and non-transitory computer-readable storage medium
US20230137502A1 (en) Method, device for processing feature image and storage medium
US20240071068A1 (en) Information processing apparatus, information processing method, and non-transitory computer-readable storage medium
US20240256901A1 (en) Information processing apparatus, information processing method and non-transitory computer-readable storage medium

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20190926

PG1501 Laying open of application
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20210326

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20190926

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20220720

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20230525

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20230830

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20230831

End annual number: 3

Start annual number: 1

PG1601 Publication of registration