KR102592979B1 - 딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지 - Google Patents

딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지 Download PDF

Info

Publication number
KR102592979B1
KR102592979B1 KR1020190145558A KR20190145558A KR102592979B1 KR 102592979 B1 KR102592979 B1 KR 102592979B1 KR 1020190145558 A KR1020190145558 A KR 1020190145558A KR 20190145558 A KR20190145558 A KR 20190145558A KR 102592979 B1 KR102592979 B1 KR 102592979B1
Authority
KR
South Korea
Prior art keywords
data set
circuit
machine learning
accuracy
transformed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020190145558A
Other languages
English (en)
Korean (ko)
Other versions
KR20200059151A (ko
Inventor
람다스 피. 카차르
마날리 샤르마
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Publication of KR20200059151A publication Critical patent/KR20200059151A/ko
Application granted granted Critical
Publication of KR102592979B1 publication Critical patent/KR102592979B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604—Improving or facilitating administration, e.g. storage management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Neurology (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Machine Translation (AREA)
  • Memory System (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
KR1020190145558A 2018-11-20 2019-11-14 딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지 Active KR102592979B1 (ko)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201862770151P 2018-11-20 2018-11-20
US62/770,151 2018-11-20
US16/430,408 US11449268B2 (en) 2018-11-20 2019-06-03 Deep solid state device (deep-SSD): a neural network based persistent data storage
US16/430,408 2019-06-03

Publications (2)

Publication Number Publication Date
KR20200059151A KR20200059151A (ko) 2020-05-28
KR102592979B1 true KR102592979B1 (ko) 2023-10-23

Family

ID=70727596

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020190145558A Active KR102592979B1 (ko) 2018-11-20 2019-11-14 딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지

Country Status (5)

Country Link
US (1) US11449268B2 (https=)
JP (1) JP7272937B2 (https=)
KR (1) KR102592979B1 (https=)
CN (1) CN111198826B (https=)
TW (1) TWI789546B (https=)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12249189B2 (en) 2019-08-12 2025-03-11 Micron Technology, Inc. Predictive maintenance of automotive lighting
US20210049480A1 (en) * 2019-08-12 2021-02-18 Micron Technology, Inc. Predictive maintenance of automotive battery
US12061971B2 (en) 2019-08-12 2024-08-13 Micron Technology, Inc. Predictive maintenance of automotive engines
US11042350B2 (en) 2019-08-21 2021-06-22 Micron Technology, Inc. Intelligent audio control in vehicles
US12497055B2 (en) 2019-08-21 2025-12-16 Micron Technology, Inc. Monitoring controller area network bus for vehicle control
US12210401B2 (en) 2019-09-05 2025-01-28 Micron Technology, Inc. Temperature based optimization of data storage operations
US11250648B2 (en) 2019-12-18 2022-02-15 Micron Technology, Inc. Predictive maintenance of automotive transmission
WO2021214516A1 (en) * 2020-04-21 2021-10-28 Neural Concept Sa Radius based neural network operations on sets of points
TWI769466B (zh) * 2020-06-17 2022-07-01 台達電子工業股份有限公司 類神經網路系統及其操作方法
US11429279B2 (en) 2020-09-16 2022-08-30 Samsung Electronics Co., Ltd. Automatic data separation and placement for compressed data in a storage device
KR102928347B1 (ko) 2021-02-05 2026-02-19 삼성전자주식회사 스토리지 장치의 신뢰성 정보 예측 방법 및 이를 이용한 스토리지 장치의 구동 방법
US12393830B2 (en) * 2021-06-15 2025-08-19 Seagate Technology Llc Deep learning computational storage drive
US11893244B2 (en) 2021-10-12 2024-02-06 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks
US11755208B2 (en) * 2021-10-12 2023-09-12 Western Digital Technologies, Inc. Hybrid memory management of non-volatile memory (NVM) devices for use with recurrent neural networks

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140143517A1 (en) 2012-11-19 2014-05-22 Hitachi, Ltd. Storage system
US20160232440A1 (en) 2015-02-06 2016-08-11 Google Inc. Recurrent neural networks for data item generation
US20180074723A1 (en) 2016-09-13 2018-03-15 Netapp, Inc. Systems and Methods For Allocating Data Compression Activities In A Storage System
US20180314985A1 (en) 2017-04-24 2018-11-01 Virginia Tech Intellectual Properties, Inc. Learning and deploying compression of radio signals

Family Cites Families (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0765021A (ja) 1992-02-21 1995-03-10 Mitsubishi Electric Corp 情報検索装置
US6879266B1 (en) * 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
US8391070B2 (en) * 2008-12-02 2013-03-05 Spansion Llc Moving program verify level for programming of memory
JP2005333393A (ja) * 2004-05-19 2005-12-02 Sharp Corp 画像圧縮装置，画像出力装置，画像伸張装置，印刷装置，画像処理装置，複写機，画像圧縮方法，画像伸張方法，画像処理プログラムおよび画像処理プログラムを記録した記録媒体
US8363837B2 (en) * 2005-02-28 2013-01-29 HGST Netherlands B.V. Data storage device with data transformation capability
US20130254787A1 (en) * 2006-05-02 2013-09-26 Invidi Technologies Corporation Method and apparatus to perform real-time audience estimation and commercial selection suitable for targeted advertising
US8694776B2 (en) * 2007-12-21 2014-04-08 Spansion Llc Authenticated memory and controller slave
JP2010081182A (ja) * 2008-09-25 2010-04-08 Renesas Technology Corp 画像処理装置
US7995386B2 (en) * 2008-11-21 2011-08-09 Spansion Llc Applying negative gate voltage to wordlines adjacent to wordline associated with read or verify to reduce adjacent wordline disturb
US7872916B2 (en) * 2008-12-09 2011-01-18 Spansion Llc Deterministic-based programming in memory
EP2196895A1 (en) * 2008-12-09 2010-06-16 Thomson Licensing System for storing and/or retrieving a data-set and method thereof
US8407378B2 (en) * 2009-04-22 2013-03-26 Lsi Corporation High-speed inline data compression inline with an eight byte data path
US9123409B2 (en) * 2009-06-11 2015-09-01 Micron Technology, Inc. Memory device for a hierarchical memory architecture
JP5052569B2 (ja) * 2009-06-25 2012-10-17 シャープ株式会社 画像圧縮装置、画像圧縮方法、画像伸張装置、画像伸張方法、画像形成装置、コンピュータプログラム及び記録媒体
US8965819B2 (en) 2010-08-16 2015-02-24 Oracle International Corporation System and method for effective caching using neural networks
US8937644B2 (en) * 2012-03-21 2015-01-20 Canon Kabushiki Kaisha Stereoscopic image capture
US20150104152A1 (en) * 2013-03-14 2015-04-16 In Hand Guides Ltd. Wirelessly triggered smart media guides
US9461972B1 (en) * 2014-03-19 2016-10-04 NetSuite Inc. Intelligently designed user interface based on user behavior
US8837066B1 (en) * 2014-04-17 2014-09-16 Lsi Corporation Adaptive baseline correction involving estimation of filter parameter using a least mean squares algorithm
US9727459B2 (en) 2014-08-22 2017-08-08 Seagate Technology Llc Non-volatile, solid-state memory configured to perform logical combination of two or more blocks sharing series-connected bit lines
US10229356B1 (en) * 2014-12-23 2019-03-12 Amazon Technologies, Inc. Error tolerant neural network model compression
US10021837B2 (en) * 2015-01-30 2018-07-17 iUNU, LLC Radio-controlled luminaire with integrated sensors
US11295202B2 (en) 2015-02-19 2022-04-05 Seagate Technology Llc Storage device with configurable neural networks
US10671703B1 (en) * 2015-03-26 2020-06-02 Cerner Innovation, Inc. Maintaining stability of health services entities treating influenza
US9824015B2 (en) * 2015-05-29 2017-11-21 Qualcomm Incorporated Providing memory management unit (MMU) partitioned translation caches, and related apparatuses, methods, and computer-readable media
US10614038B1 (en) * 2015-12-28 2020-04-07 EMC IP Holding Company LLC Inline deduplication of compressed data
US10235198B2 (en) * 2016-02-24 2019-03-19 Samsung Electronics Co., Ltd. VM-aware FTL design for SR-IOV NVME SSD
GB2549957B (en) * 2016-05-03 2018-08-08 Imagination Tech Ltd Compressing and decompressing image data
US11308383B2 (en) * 2016-05-17 2022-04-19 Silicon Storage Technology, Inc. Deep learning neural network classifier using non-volatile memory array
US10474567B2 (en) * 2016-05-25 2019-11-12 Samsung Electronics Co., Ltd. Multi-bit data representation framework to enable dual program operation on solid-state flash devices
US10169387B1 (en) * 2016-07-28 2019-01-01 EMC IP Holding Company LLC Self-balancing tree data structure compression
JP2018046406A (ja) * 2016-09-14 2018-03-22 株式会社ターボデータラボラトリー データ圧縮方法、データ圧縮装置、コンピュータプログラム及びデータベースシステム
KR102656190B1 (ko) * 2016-11-24 2024-04-11 삼성전자주식회사 불휘발성 메모리 장치를 포함하는 스토리지 장치 및 불휘발성 메모리 장치의 액세스 방법
US10203897B1 (en) * 2016-12-02 2019-02-12 Nutanix, Inc. Dynamic data compression
US10649904B2 (en) * 2016-12-12 2020-05-12 Samsung Electronics Co., Ltd. System and method for store streaming detection and handling
KR102061615B1 (ko) * 2016-12-26 2020-01-02 한국과학기술원 인공 신경망 모델에서 메모리 효율성 및 학습 속도 향상을 위한 드롭아웃 방법과 이를 이용한 학습 방법
US10235064B1 (en) * 2016-12-27 2019-03-19 EMC IP Holding Company LLC Optimized data replication using special NVME protocol and running in a friendly zone of storage array
JP2018110300A (ja) * 2016-12-28 2018-07-12 キヤノン株式会社 撮像装置、その制御方法、プログラム及び記録媒体
US10366595B2 (en) * 2017-03-10 2019-07-30 Turing Video, Inc. Surveillance method and system based on human behavior recognition
US10474458B2 (en) * 2017-04-28 2019-11-12 Intel Corporation Instructions and logic to perform floating-point and integer operations for machine learning
JP2019061512A (ja) * 2017-09-27 2019-04-18 株式会社Ａｂｅｊａ データの特徴を利用してデータを処理するシステム
US11074601B2 (en) * 2018-02-06 2021-07-27 International Business Machines Corporation Real time personalized pricing for limited inventory assortments in a high-volume business environment
US20190392300A1 (en) * 2018-06-20 2019-12-26 NEC Laboratories Europe GmbH Systems and methods for data compression in neural networks
CN112789626B (zh) * 2018-09-27 2024-11-08 渊慧科技有限公司 可扩展和压缩的神经网络数据储存系统
US11307977B2 (en) * 2018-09-27 2022-04-19 Intel Corporation Technologies for direct matrix read and write operations
US10691537B2 (en) * 2018-10-12 2020-06-23 Western Digital Technologies, Inc. Storing deep neural network weights in non-volatile storage systems using vertical error correction codes
US11625586B2 (en) * 2019-10-15 2023-04-11 Sandisk Technologies Llc Realization of neural networks with ternary inputs and ternary weights in NAND memory arrays
US11568228B2 (en) * 2020-06-23 2023-01-31 Sandisk Technologies Llc Recurrent neural network inference engine with gated recurrent unit cell and non-volatile memory arrays

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140143517A1 (en) 2012-11-19 2014-05-22 Hitachi, Ltd. Storage system
US20160232440A1 (en) 2015-02-06 2016-08-11 Google Inc. Recurrent neural networks for data item generation
US20180074723A1 (en) 2016-09-13 2018-03-15 Netapp, Inc. Systems and Methods For Allocating Data Compression Activities In A Storage System
US20180314985A1 (en) 2017-04-24 2018-11-01 Virginia Tech Intellectual Properties, Inc. Learning and deploying compression of radio signals

Also Published As

Publication number Publication date
JP2020087468A (ja) 2020-06-04
CN111198826A (zh) 2020-05-26
US11449268B2 (en) 2022-09-20
TWI789546B (zh) 2023-01-11
TW202026885A (zh) 2020-07-16
CN111198826B (zh) 2025-04-04
US20200159445A1 (en) 2020-05-21
JP7272937B2 (ja) 2023-05-12
KR20200059151A (ko) 2020-05-28

Similar Documents

Publication Publication Date Title
KR102592979B1 (ko) 딥-솔리드 스테이트 장치 및 신경망 기반의 영구적 데이터 스토리지
CN114503125B (zh) 结构化剪枝方法、系统和计算机可读介质
CN110196624B (zh) 用于服务器和固态设备的人工智能冷却方法
US12197601B2 (en) Hardware offload circuitry
CN113424144A (zh) 计算数据存储系统
CN113302584A (zh) 基于云的存储系统的存储管理
US11314441B2 (en) Block cleanup: page reclamation process to reduce garbage collection overhead in dual-programmable NAND flash devices
TWI833806B (zh) 用於分片創建的裝置及系統
EP3926456B1 (en) Prompt and gradual migration schemes
US9632831B2 (en) Distributed real-time computing framework using in-storage processing
KR20190027812A (ko) 컴퓨팅 시스템을 위한 애플리케이션 구동형 스토리지 시스템
US20230205843A1 (en) Updating of statistical sets for decentralized distributed training of a machine learning model
CN110716694A (zh) 用于存储管理的装置及系统
KR102705751B1 (ko) 장치, 그것을 포함하는 시스템, 그리고 그것의 키 저장 방법
CN111610932B (zh) 减少键值存储服务器的漏洞窗口而不牺牲可用容量的系统
KR20220100030A (ko) 패턴 기반 캐시 블록 압축
CN119046015A (zh) 神经网络模型训练处理的电子设备、方法和介质
US10474567B2 (en) Multi-bit data representation framework to enable dual program operation on solid-state flash devices
He et al. LUT-LLM: Efficient Large Language Model Inference with Memory-based Computations on FPGAs
Wang et al. A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting
US10747891B2 (en) Floating data protection
KR102941388B1 (ko) 지식 증류를 통한 트랜스포머 신경망 모델의 압축 방법 및 이를 수행하는 컴퓨팅 장치
US20250181910A1 (en) Overcoming maximum token limitations of large language models
Liu et al. Accelerating Out-of-Core Graph Random Walk Processing via Locality-Aware Algorithm-Hardware Co-Design

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20191114

PG1501 Laying open of application
A201 Request for examination
A302 Request for accelerated examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20221114

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20191114

Comment text: Patent Application

PA0302 Request for accelerated examination

Patent event date: 20221114

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

Patent event date: 20191114

Patent event code: PA03021R01I

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20230317

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20230725

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20231018

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20231019

End annual number: 3

Start annual number: 1

PG1601 Publication of registration