CN111198826B - 存储设备、存储系统及存储方法 - Google Patents

存储设备、存储系统及存储方法 Download PDF

Info

Publication number
CN111198826B
CN111198826B CN201911109232.XA CN201911109232A CN111198826B CN 111198826 B CN111198826 B CN 111198826B CN 201911109232 A CN201911109232 A CN 201911109232A CN 111198826 B CN111198826 B CN 111198826B
Authority
CN
China
Prior art keywords
data set
circuit
storage
machine learning
transformed data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911109232.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN111198826A (zh
Inventor
瑞姆达斯·P·卡佳瑞
玛纳利·沙尔玛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of CN111198826A publication Critical patent/CN111198826A/zh
Application granted granted Critical
Publication of CN111198826B publication Critical patent/CN111198826B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Neurology (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Machine Translation (AREA)
  • Memory System (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
CN201911109232.XA 2018-11-20 2019-11-13 存储设备、存储系统及存储方法 Active CN111198826B (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862770151P 2018-11-20 2018-11-20
US62/770,151 2018-11-20
US16/430,408 US11449268B2 (en) 2018-11-20 2019-06-03 Deep solid state device (deep-SSD): a neural network based persistent data storage
US16/430,408 2019-06-03

Publications (2)

Publication Number Publication Date
CN111198826A CN111198826A (zh) 2020-05-26
CN111198826B true CN111198826B (zh) 2025-04-04

Family

ID=70727596

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911109232.XA Active CN111198826B (zh) 2018-11-20 2019-11-13 存储设备、存储系统及存储方法

Country Status (5)

Country Link
US (1) US11449268B2 (https=)
JP (1) JP7272937B2 (https=)
KR (1) KR102592979B1 (https=)
CN (1) CN111198826B (https=)
TW (1) TWI789546B (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12249189B2 (en) 2019-08-12 2025-03-11 Micron Technology, Inc. Predictive maintenance of automotive lighting
US20210049480A1 (en) * 2019-08-12 2021-02-18 Micron Technology, Inc. Predictive maintenance of automotive battery
US12061971B2 (en) 2019-08-12 2024-08-13 Micron Technology, Inc. Predictive maintenance of automotive engines
US11042350B2 (en) 2019-08-21 2021-06-22 Micron Technology, Inc. Intelligent audio control in vehicles
US12497055B2 (en) 2019-08-21 2025-12-16 Micron Technology, Inc. Monitoring controller area network bus for vehicle control
US12210401B2 (en) 2019-09-05 2025-01-28 Micron Technology, Inc. Temperature based optimization of data storage operations
US11250648B2 (en) 2019-12-18 2022-02-15 Micron Technology, Inc. Predictive maintenance of automotive transmission
WO2021214516A1 (en) * 2020-04-21 2021-10-28 Neural Concept Sa Radius based neural network operations on sets of points
TWI769466B (zh) * 2020-06-17 2022-07-01 台達電子工業股份有限公司 類神經網路系統及其操作方法
US11429279B2 (en) 2020-09-16 2022-08-30 Samsung Electronics Co., Ltd. Automatic data separation and placement for compressed data in a storage device
KR102928347B1 (ko) 2021-02-05 2026-02-19 삼성전자주식회사 스토리지 장치의 신뢰성 정보 예측 방법 및 이를 이용한 스토리지 장치의 구동 방법
US12393830B2 (en) * 2021-06-15 2025-08-19 Seagate Technology Llc Deep learning computational storage drive
US11893244B2 (en) 2021-10-12 2024-02-06 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks
US11755208B2 (en) * 2021-10-12 2023-09-12 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751470A (zh) * 2008-12-09 2010-06-23 汤姆森特许公司 用于存储和/或检索数据集的系统及其方法
CN107122314A (zh) * 2016-02-24 2017-09-01 三星电子株式会社 大容量存储器装置、包括其的系统以及访问其的方法

Family Cites Families (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0765021A (ja) 1992-02-21 1995-03-10 Mitsubishi Electric Corp 情報検索装置
US6879266B1 (en) * 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
US8391070B2 (en) * 2008-12-02 2013-03-05 Spansion Llc Moving program verify level for programming of memory
JP2005333393A (ja) * 2004-05-19 2005-12-02 Sharp Corp 画像圧縮装置，画像出力装置，画像伸張装置，印刷装置，画像処理装置，複写機，画像圧縮方法，画像伸張方法，画像処理プログラムおよび画像処理プログラムを記録した記録媒体
US8363837B2 (en) * 2005-02-28 2013-01-29 HGST Netherlands B.V. Data storage device with data transformation capability
US20130254787A1 (en) * 2006-05-02 2013-09-26 Invidi Technologies Corporation Method and apparatus to perform real-time audience estimation and commercial selection suitable for targeted advertising
US8694776B2 (en) * 2007-12-21 2014-04-08 Spansion Llc Authenticated memory and controller slave
JP2010081182A (ja) * 2008-09-25 2010-04-08 Renesas Technology Corp 画像処理装置
US7995386B2 (en) * 2008-11-21 2011-08-09 Spansion Llc Applying negative gate voltage to wordlines adjacent to wordline associated with read or verify to reduce adjacent wordline disturb
US7872916B2 (en) * 2008-12-09 2011-01-18 Spansion Llc Deterministic-based programming in memory
US8407378B2 (en) * 2009-04-22 2013-03-26 Lsi Corporation High-speed inline data compression inline with an eight byte data path
US9123409B2 (en) * 2009-06-11 2015-09-01 Micron Technology, Inc. Memory device for a hierarchical memory architecture
JP5052569B2 (ja) * 2009-06-25 2012-10-17 シャープ株式会社 画像圧縮装置、画像圧縮方法、画像伸張装置、画像伸張方法、画像形成装置、コンピュータプログラム及び記録媒体
US8965819B2 (en) 2010-08-16 2015-02-24 Oracle International Corporation System and method for effective caching using neural networks
US8937644B2 (en) * 2012-03-21 2015-01-20 Canon Kabushiki Kaisha Stereoscopic image capture
WO2014076743A1 (en) 2012-11-19 2014-05-22 Hitachi, Ltd. Storage system
US20150104152A1 (en) * 2013-03-14 2015-04-16 In Hand Guides Ltd. Wirelessly triggered smart media guides
US9461972B1 (en) * 2014-03-19 2016-10-04 NetSuite Inc. Intelligently designed user interface based on user behavior
US8837066B1 (en) * 2014-04-17 2014-09-16 Lsi Corporation Adaptive baseline correction involving estimation of filter parameter using a least mean squares algorithm
US9727459B2 (en) 2014-08-22 2017-08-08 Seagate Technology Llc Non-volatile, solid-state memory configured to perform logical combination of two or more blocks sharing series-connected bit lines
US10229356B1 (en) * 2014-12-23 2019-03-12 Amazon Technologies, Inc. Error tolerant neural network model compression
US10021837B2 (en) * 2015-01-30 2018-07-17 iUNU, LLC Radio-controlled luminaire with integrated sensors
US11080587B2 (en) * 2015-02-06 2021-08-03 Deepmind Technologies Limited Recurrent neural networks for data item generation
US11295202B2 (en) 2015-02-19 2022-04-05 Seagate Technology Llc Storage device with configurable neural networks
US10671703B1 (en) * 2015-03-26 2020-06-02 Cerner Innovation, Inc. Maintaining stability of health services entities treating influenza
US9824015B2 (en) * 2015-05-29 2017-11-21 Qualcomm Incorporated Providing memory management unit (MMU) partitioned translation caches, and related apparatuses, methods, and computer-readable media
US10614038B1 (en) * 2015-12-28 2020-04-07 EMC IP Holding Company LLC Inline deduplication of compressed data
GB2549957B (en) * 2016-05-03 2018-08-08 Imagination Tech Ltd Compressing and decompressing image data
US11308383B2 (en) * 2016-05-17 2022-04-19 Silicon Storage Technology, Inc. Deep learning neural network classifier using non-volatile memory array
US10474567B2 (en) * 2016-05-25 2019-11-12 Samsung Electronics Co., Ltd. Multi-bit data representation framework to enable dual program operation on solid-state flash devices
US10169387B1 (en) * 2016-07-28 2019-01-01 EMC IP Holding Company LLC Self-balancing tree data structure compression
US10503443B2 (en) * 2016-09-13 2019-12-10 Netapp, Inc. Systems and methods for allocating data compression activities in a storage system
JP2018046406A (ja) * 2016-09-14 2018-03-22 株式会社ターボデータラボラトリー データ圧縮方法、データ圧縮装置、コンピュータプログラム及びデータベースシステム
KR102656190B1 (ko) * 2016-11-24 2024-04-11 삼성전자주식회사 불휘발성 메모리 장치를 포함하는 스토리지 장치 및 불휘발성 메모리 장치의 액세스 방법
US10203897B1 (en) * 2016-12-02 2019-02-12 Nutanix, Inc. Dynamic data compression
US10649904B2 (en) * 2016-12-12 2020-05-12 Samsung Electronics Co., Ltd. System and method for store streaming detection and handling
KR102061615B1 (ko) * 2016-12-26 2020-01-02 한국과학기술원 인공 신경망 모델에서 메모리 효율성 및 학습 속도 향상을 위한 드롭아웃 방법과 이를 이용한 학습 방법
US10235064B1 (en) * 2016-12-27 2019-03-19 EMC IP Holding Company LLC Optimized data replication using special NVME protocol and running in a friendly zone of storage array
JP2018110300A (ja) * 2016-12-28 2018-07-12 キヤノン株式会社 撮像装置、その制御方法、プログラム及び記録媒体
US10366595B2 (en) * 2017-03-10 2019-07-30 Turing Video, Inc. Surveillance method and system based on human behavior recognition
US10643153B2 (en) * 2017-04-24 2020-05-05 Virginia Tech Intellectual Properties, Inc. Radio signal identification, identification system learning, and identifier deployment
US10474458B2 (en) * 2017-04-28 2019-11-12 Intel Corporation Instructions and logic to perform floating-point and integer operations for machine learning
JP2019061512A (ja) * 2017-09-27 2019-04-18 株式会社Ａｂｅｊａ データの特徴を利用してデータを処理するシステム
US11074601B2 (en) * 2018-02-06 2021-07-27 International Business Machines Corporation Real time personalized pricing for limited inventory assortments in a high-volume business environment
US20190392300A1 (en) * 2018-06-20 2019-12-26 NEC Laboratories Europe GmbH Systems and methods for data compression in neural networks
CN112789626B (zh) * 2018-09-27 2024-11-08 渊慧科技有限公司 可扩展和压缩的神经网络数据储存系统
US11307977B2 (en) * 2018-09-27 2022-04-19 Intel Corporation Technologies for direct matrix read and write operations
US10691537B2 (en) * 2018-10-12 2020-06-23 Western Digital Technologies, Inc. Storing deep neural network weights in non-volatile storage systems using vertical error correction codes
US11625586B2 (en) * 2019-10-15 2023-04-11 Sandisk Technologies Llc Realization of neural networks with ternary inputs and ternary weights in NAND memory arrays
US11568228B2 (en) * 2020-06-23 2023-01-31 Sandisk Technologies Llc Recurrent neural network inference engine with gated recurrent unit cell and non-volatile memory arrays

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751470A (zh) * 2008-12-09 2010-06-23 汤姆森特许公司 用于存储和/或检索数据集的系统及其方法
CN107122314A (zh) * 2016-02-24 2017-09-01 三星电子株式会社 大容量存储器装置、包括其的系统以及访问其的方法

Also Published As

Publication number Publication date
JP2020087468A (ja) 2020-06-04
CN111198826A (zh) 2020-05-26
KR102592979B1 (ko) 2023-10-23
US11449268B2 (en) 2022-09-20
TWI789546B (zh) 2023-01-11
TW202026885A (zh) 2020-07-16
US20200159445A1 (en) 2020-05-21
JP7272937B2 (ja) 2023-05-12
KR20200059151A (ko) 2020-05-28

Similar Documents

Publication Publication Date Title
CN111198826B (zh) 存储设备、存储系统及存储方法
US20250377831A1 (en) Computational data storage systems
US11868665B2 (en) Data processing near data storage
CN110196624B (zh) 用于服务器和固态设备的人工智能冷却方法
US10983729B2 (en) Method and apparatus for performing multi-object transformations on a storage device
TWI791891B (zh) 用於錯誤修正代碼的加速的裝置及系統
US11314441B2 (en) Block cleanup: page reclamation process to reduce garbage collection overhead in dual-programmable NAND flash devices
CN116997909A (zh) 稀疏机器学习加速
CN111324777A (zh) 用于分片创建的装置和系统
KR20200006938A (ko) Ssd에서 비트 카운트와 런 렝스 분포 모니터링을 오프로딩하고 가속하는 새로운 방법
US20170300407A1 (en) Managing database index by leveraging key-value solid state device
US12147358B2 (en) Systems and methods for message tunneling
KR20220100030A (ko) 패턴 기반 캐시 블록 압축
US20210357119A1 (en) Artificial intelligence-based hybrid raid controller device
CN117634571A (zh) 基于众核芯片的数据处理方法、装置、芯片、系统及设备
US10474567B2 (en) Multi-bit data representation framework to enable dual program operation on solid-state flash devices
He et al. LUT-LLM: Efficient Large Language Model Inference with Memory-based Computations on FPGAs
US10747891B2 (en) Floating data protection
US20260004202A1 (en) Encoding and decoding system and methodology to compress complex combinatorial operations of operand groups
US20250298510A1 (en) System and Method for Hardware-Accelerated Determination of Compression Performance Using Field-Programmable Gate Array Implementation
US20250181910A1 (en) Overcoming maximum token limitations of large language models
US20250298717A1 (en) Deep learning data compression using multiple hardware accelerator architectures
Zhao et al. Deployment and optimization of DenseNet model based on NNOM framework: a dynamic memory management approach
Liu et al. Accelerating Out-of-Core Graph Random Walk Processing via Locality-Aware Algorithm-Hardware Co-Design
Carreira-Perpinan et al. ParMAC: distributed optimisation of nested functions, with application to binary autoencoders

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant