JP7272937B2 - ディープソリッドステート装置及びニューラルネットワークベースの永続的データストレージ - Google Patents

ディープソリッドステート装置及びニューラルネットワークベースの永続的データストレージ Download PDF

Info

Publication number
JP7272937B2
JP7272937B2 JP2019209473A JP2019209473A JP7272937B2 JP 7272937 B2 JP7272937 B2 JP 7272937B2 JP 2019209473 A JP2019209473 A JP 2019209473A JP 2019209473 A JP2019209473 A JP 2019209473A JP 7272937 B2 JP7272937 B2 JP 7272937B2
Authority
JP
Japan
Prior art keywords
dataset
circuit
machine learning
data set
transformed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019209473A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020087468A (ja
JP2020087468A5 (enExample
Inventor
ピー． カチャレ，ラムダス
シャルマ，マナリ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of JP2020087468A publication Critical patent/JP2020087468A/ja
Publication of JP2020087468A5 publication Critical patent/JP2020087468A5/ja
Application granted granted Critical
Publication of JP7272937B2 publication Critical patent/JP7272937B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Biophysics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Neurology (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Memory System (AREA)
  • Machine Translation (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
JP2019209473A 2018-11-20 2019-11-20 ディープソリッドステート装置及びニューラルネットワークベースの永続的データストレージ Active JP7272937B2 (ja)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862770151P 2018-11-20 2018-11-20
US62/770,151 2018-11-20
US16/430,408 2019-06-03
US16/430,408 US11449268B2 (en) 2018-11-20 2019-06-03 Deep solid state device (deep-SSD): a neural network based persistent data storage

Publications (3)

Publication Number Publication Date
JP2020087468A JP2020087468A (ja) 2020-06-04
JP2020087468A5 JP2020087468A5 (enExample) 2022-11-29
JP7272937B2 true JP7272937B2 (ja) 2023-05-12

Family

ID=70727596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019209473A Active JP7272937B2 (ja) 2018-11-20 2019-11-20 ディープソリッドステート装置及びニューラルネットワークベースの永続的データストレージ

Country Status (5)

Country Link
US (1) US11449268B2 (enExample)
JP (1) JP7272937B2 (enExample)
KR (1) KR102592979B1 (enExample)
CN (1) CN111198826B (enExample)
TW (1) TWI789546B (enExample)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12061971B2 (en) 2019-08-12 2024-08-13 Micron Technology, Inc. Predictive maintenance of automotive engines
US20210049480A1 (en) * 2019-08-12 2021-02-18 Micron Technology, Inc. Predictive maintenance of automotive battery
US12249189B2 (en) 2019-08-12 2025-03-11 Micron Technology, Inc. Predictive maintenance of automotive lighting
US12497055B2 (en) 2019-08-21 2025-12-16 Micron Technology, Inc. Monitoring controller area network bus for vehicle control
US11042350B2 (en) 2019-08-21 2021-06-22 Micron Technology, Inc. Intelligent audio control in vehicles
US12210401B2 (en) 2019-09-05 2025-01-28 Micron Technology, Inc. Temperature based optimization of data storage operations
US11250648B2 (en) 2019-12-18 2022-02-15 Micron Technology, Inc. Predictive maintenance of automotive transmission
WO2021214516A1 (en) * 2020-04-21 2021-10-28 Neural Concept Sa Radius based neural network operations on sets of points
TWI769466B (zh) * 2020-06-17 2022-07-01 台達電子工業股份有限公司 類神經網路系統及其操作方法
US11429279B2 (en) 2020-09-16 2022-08-30 Samsung Electronics Co., Ltd. Automatic data separation and placement for compressed data in a storage device
KR102928347B1 (ko) 2021-02-05 2026-02-19 삼성전자주식회사 스토리지 장치의 신뢰성 정보 예측 방법 및 이를 이용한 스토리지 장치의 구동 방법
US12393830B2 (en) * 2021-06-15 2025-08-19 Seagate Technology Llc Deep learning computational storage drive
US11755208B2 (en) * 2021-10-12 2023-09-12 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks
US11893244B2 (en) 2021-10-12 2024-02-06 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170324983A1 (en) 2016-05-03 2017-11-09 Imagination Technologies Limited Compressing and Decompressing Image Data Using Compacted Region Transforms
WO2018051696A1 (ja) 2016-09-14 2018-03-22 株式会社ターボデータラボラトリー データ圧縮方法、データ圧縮装置、コンピュータプログラム及びデータベースシステム
JP2019061512A (ja) 2017-09-27 2019-04-18 株式会社Ａｂｅｊａ データの特徴を利用してデータを処理するシステム

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0765021A (ja) 1992-02-21 1995-03-10 Mitsubishi Electric Corp 情報検索装置
US6879266B1 (en) * 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
US8391070B2 (en) * 2008-12-02 2013-03-05 Spansion Llc Moving program verify level for programming of memory
JP2005333393A (ja) * 2004-05-19 2005-12-02 Sharp Corp 画像圧縮装置，画像出力装置，画像伸張装置，印刷装置，画像処理装置，複写機，画像圧縮方法，画像伸張方法，画像処理プログラムおよび画像処理プログラムを記録した記録媒体
US8363837B2 (en) * 2005-02-28 2013-01-29 HGST Netherlands B.V. Data storage device with data transformation capability
US20130254787A1 (en) * 2006-05-02 2013-09-26 Invidi Technologies Corporation Method and apparatus to perform real-time audience estimation and commercial selection suitable for targeted advertising
US8694776B2 (en) * 2007-12-21 2014-04-08 Spansion Llc Authenticated memory and controller slave
JP2010081182A (ja) * 2008-09-25 2010-04-08 Renesas Technology Corp 画像処理装置
US7995386B2 (en) * 2008-11-21 2011-08-09 Spansion Llc Applying negative gate voltage to wordlines adjacent to wordline associated with read or verify to reduce adjacent wordline disturb
EP2196895A1 (en) * 2008-12-09 2010-06-16 Thomson Licensing System for storing and/or retrieving a data-set and method thereof
US7872916B2 (en) * 2008-12-09 2011-01-18 Spansion Llc Deterministic-based programming in memory
US8407378B2 (en) * 2009-04-22 2013-03-26 Lsi Corporation High-speed inline data compression inline with an eight byte data path
US9123409B2 (en) * 2009-06-11 2015-09-01 Micron Technology, Inc. Memory device for a hierarchical memory architecture
JP5052569B2 (ja) * 2009-06-25 2012-10-17 シャープ株式会社 画像圧縮装置、画像圧縮方法、画像伸張装置、画像伸張方法、画像形成装置、コンピュータプログラム及び記録媒体
US8965819B2 (en) 2010-08-16 2015-02-24 Oracle International Corporation System and method for effective caching using neural networks
US8937644B2 (en) * 2012-03-21 2015-01-20 Canon Kabushiki Kaisha Stereoscopic image capture
WO2014076743A1 (en) * 2012-11-19 2014-05-22 Hitachi, Ltd. Storage system
US20150104152A1 (en) * 2013-03-14 2015-04-16 In Hand Guides Ltd. Wirelessly triggered smart media guides
US9461972B1 (en) * 2014-03-19 2016-10-04 NetSuite Inc. Intelligently designed user interface based on user behavior
US8837066B1 (en) * 2014-04-17 2014-09-16 Lsi Corporation Adaptive baseline correction involving estimation of filter parameter using a least mean squares algorithm
US9727459B2 (en) 2014-08-22 2017-08-08 Seagate Technology Llc Non-volatile, solid-state memory configured to perform logical combination of two or more blocks sharing series-connected bit lines
US10229356B1 (en) * 2014-12-23 2019-03-12 Amazon Technologies, Inc. Error tolerant neural network model compression
US10021837B2 (en) * 2015-01-30 2018-07-17 iUNU, LLC Radio-controlled luminaire with integrated sensors
US11080587B2 (en) * 2015-02-06 2021-08-03 Deepmind Technologies Limited Recurrent neural networks for data item generation
US11295202B2 (en) 2015-02-19 2022-04-05 Seagate Technology Llc Storage device with configurable neural networks
US10671703B1 (en) * 2015-03-26 2020-06-02 Cerner Innovation, Inc. Maintaining stability of health services entities treating influenza
US9824015B2 (en) * 2015-05-29 2017-11-21 Qualcomm Incorporated Providing memory management unit (MMU) partitioned translation caches, and related apparatuses, methods, and computer-readable media
US10614038B1 (en) * 2015-12-28 2020-04-07 EMC IP Holding Company LLC Inline deduplication of compressed data
US10235198B2 (en) * 2016-02-24 2019-03-19 Samsung Electronics Co., Ltd. VM-aware FTL design for SR-IOV NVME SSD
JP6833873B2 (ja) * 2016-05-17 2021-02-24 シリコン ストーリッジ テクノロージー インコーポレイテッドＳｉｌｉｃｏｎ Ｓｔｏｒａｇｅ Ｔｅｃｈｎｏｌｏｇｙ， Ｉｎｃ． 不揮発性メモリアレイを使用したディープラーニングニューラルネットワーク分類器
US10474567B2 (en) * 2016-05-25 2019-11-12 Samsung Electronics Co., Ltd. Multi-bit data representation framework to enable dual program operation on solid-state flash devices
US10169387B1 (en) * 2016-07-28 2019-01-01 EMC IP Holding Company LLC Self-balancing tree data structure compression
US10503443B2 (en) * 2016-09-13 2019-12-10 Netapp, Inc. Systems and methods for allocating data compression activities in a storage system
KR102656190B1 (ko) * 2016-11-24 2024-04-11 삼성전자주식회사 불휘발성 메모리 장치를 포함하는 스토리지 장치 및 불휘발성 메모리 장치의 액세스 방법
US10203897B1 (en) * 2016-12-02 2019-02-12 Nutanix, Inc. Dynamic data compression
US10649904B2 (en) * 2016-12-12 2020-05-12 Samsung Electronics Co., Ltd. System and method for store streaming detection and handling
KR102061615B1 (ko) * 2016-12-26 2020-01-02 한국과학기술원 인공 신경망 모델에서 메모리 효율성 및 학습 속도 향상을 위한 드롭아웃 방법과 이를 이용한 학습 방법
US10235064B1 (en) * 2016-12-27 2019-03-19 EMC IP Holding Company LLC Optimized data replication using special NVME protocol and running in a friendly zone of storage array
JP2018110300A (ja) * 2016-12-28 2018-07-12 キヤノン株式会社 撮像装置、その制御方法、プログラム及び記録媒体
US10366595B2 (en) * 2017-03-10 2019-07-30 Turing Video, Inc. Surveillance method and system based on human behavior recognition
EP3616198B1 (en) * 2017-04-24 2024-10-16 Virginia Tech Intellectual Properties, Inc. Radio signal identification, identification system learning, and identifier deployment
US10474458B2 (en) * 2017-04-28 2019-11-12 Intel Corporation Instructions and logic to perform floating-point and integer operations for machine learning
US11074601B2 (en) * 2018-02-06 2021-07-27 International Business Machines Corporation Real time personalized pricing for limited inventory assortments in a high-volume business environment
US20190392300A1 (en) * 2018-06-20 2019-12-26 NEC Laboratories Europe GmbH Systems and methods for data compression in neural networks
US11307977B2 (en) * 2018-09-27 2022-04-19 Intel Corporation Technologies for direct matrix read and write operations
US10846588B2 (en) * 2018-09-27 2020-11-24 Deepmind Technologies Limited Scalable and compressive neural network data storage system
US10691537B2 (en) * 2018-10-12 2020-06-23 Western Digital Technologies, Inc. Storing deep neural network weights in non-volatile storage systems using vertical error correction codes
US11625586B2 (en) * 2019-10-15 2023-04-11 Sandisk Technologies Llc Realization of neural networks with ternary inputs and ternary weights in NAND memory arrays
US11568228B2 (en) * 2020-06-23 2023-01-31 Sandisk Technologies Llc Recurrent neural network inference engine with gated recurrent unit cell and non-volatile memory arrays

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170324983A1 (en) 2016-05-03 2017-11-09 Imagination Technologies Limited Compressing and Decompressing Image Data Using Compacted Region Transforms
WO2018051696A1 (ja) 2016-09-14 2018-03-22 株式会社ターボデータラボラトリー データ圧縮方法、データ圧縮装置、コンピュータプログラム及びデータベースシステム
JP2019061512A (ja) 2017-09-27 2019-04-18 株式会社Ａｂｅｊａ データの特徴を利用してデータを処理するシステム

Also Published As

Publication number Publication date
JP2020087468A (ja) 2020-06-04
KR102592979B1 (ko) 2023-10-23
CN111198826B (zh) 2025-04-04
CN111198826A (zh) 2020-05-26
US20200159445A1 (en) 2020-05-21
US11449268B2 (en) 2022-09-20
TW202026885A (zh) 2020-07-16
TWI789546B (zh) 2023-01-11
KR20200059151A (ko) 2020-05-28

Similar Documents

Publication Publication Date Title
KR102592979B1 (ko) 딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지
CN115066692B (zh) 用于表示神经网络中的稀疏矩阵的装置和方法
CN114503125B (zh) 结构化剪枝方法、系统和计算机可读介质
CN107977704B (zh) 权重数据存储方法和基于该方法的神经网络处理器
US20220318604A1 (en) Sparse machine learning acceleration
US11314441B2 (en) Block cleanup: page reclamation process to reduce garbage collection overhead in dual-programmable NAND flash devices
CN115836346B (zh) 存内计算设备及其数据处理方法
KR102890191B1 (ko) 패턴 기반 캐시 블록 압축
JP7108784B2 (ja) データ記憶方法、データ取得方法、及び機器
US20240241736A1 (en) Systems and devices for accessing a state machine
US10445012B2 (en) System and methods for in-storage on-demand data decompression
CN119046015B (zh) 神经网络模型训练处理的电子设备、方法和介质
JP2024514448A (ja) ディープニューラルネットワーク重みのための圧縮技法
US10387302B2 (en) Managing database index by leveraging key-value solid state device
JP2022045615A (ja) 演算装置及び演算方法
CN117391160A (zh) 加速方法、加速器和存储介质
US20250181910A1 (en) Overcoming maximum token limitations of large language models
US10474567B2 (en) Multi-bit data representation framework to enable dual program operation on solid-state flash devices
Wang et al. A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting
KR102941388B1 (ko) 지식 증류를 통한 트랜스포머 신경망 모델의 압축 방법 및 이를 수행하는 컴퓨팅 장치
CN116860564B (zh) 一种云服务器数据管理方法及其数据管理装置
Shafiq et al. Automated flow for compressing convolution neural networks for efficient edge-computation with FPGA
KR20260046862A (ko) 메모리 디바이스를 위한 압축기 및 그 동작 방법
CN118194935A (zh) 一种大模型的压缩方法、装置及设备
CN121918752A (zh) 用于执行非对称压缩和解压缩的存储设备及其操作方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221118

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221118

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20221118

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20230221

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230403

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230418

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230427

R150 Certificate of patent or registration of utility model

Ref document number: 7272937

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250