TWI825305B - 轉換編碼器及進行轉換編碼的方法及製品 - Google Patents
轉換編碼器及進行轉換編碼的方法及製品 Download PDFInfo
- Publication number
- TWI825305B TWI825305B TW109112659A TW109112659A TWI825305B TW I825305 B TWI825305 B TW I825305B TW 109112659 A TW109112659 A TW 109112659A TW 109112659 A TW109112659 A TW 109112659A TW I825305 B TWI825305 B TW I825305B
- Authority
- TW
- Taiwan
- Prior art keywords
- data
- chunk
- encoding
- encoded data
- input
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 80
- 238000003860 storage Methods 0.000 claims description 209
- 238000013507 mapping Methods 0.000 claims description 75
- 239000000463 material Substances 0.000 claims description 66
- 238000012545 processing Methods 0.000 claims description 33
- 238000006243 chemical reaction Methods 0.000 claims description 32
- 230000008859 change Effects 0.000 claims description 10
- 230000004044 response Effects 0.000 claims description 9
- 238000004519 manufacturing process Methods 0.000 claims description 2
- 238000012856 packing Methods 0.000 description 38
- 230000006835 compression Effects 0.000 description 24
- 238000007906 compression Methods 0.000 description 24
- 230000009466 transformation Effects 0.000 description 19
- 230000006870 function Effects 0.000 description 18
- 230000008569 process Effects 0.000 description 17
- 230000008901 benefit Effects 0.000 description 14
- 230000001133 acceleration Effects 0.000 description 11
- 238000013519 translation Methods 0.000 description 10
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 6
- 239000007787 solid Substances 0.000 description 6
- 238000012546 transfer Methods 0.000 description 6
- 230000009467 reduction Effects 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000006837 decompression Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 229920001485 poly(butyl acrylate) polymer Polymers 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000029305 taxis Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
- G06F3/0611—Improving I/O performance in relation to response time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/126—Character encoding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/151—Transformation
- G06F40/157—Transformation using dictionaries or tables
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
- G06F2212/10—Providing a specific technical effect
- G06F2212/1016—Performance improvement
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201962834900P | 2019-04-16 | 2019-04-16 | |
US62/834,900 | 2019-04-16 | ||
US201962945877P | 2019-12-09 | 2019-12-09 | |
US201962945883P | 2019-12-09 | 2019-12-09 | |
US62/945,883 | 2019-12-09 | ||
US62/945,877 | 2019-12-09 | ||
US16/820,665 | 2020-03-16 | ||
US16/820,665 US11139827B2 (en) | 2019-03-15 | 2020-03-16 | Conditional transcoding for encoded data |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202107856A TW202107856A (zh) | 2021-02-16 |
TWI825305B true TWI825305B (zh) | 2023-12-11 |
Family
ID=72913839
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109112659A TWI825305B (zh) | 2019-04-16 | 2020-04-15 | 轉換編碼器及進行轉換編碼的方法及製品 |
Country Status (4)
Country | Link |
---|---|
JP (1) | JP7381393B2 (ja) |
KR (3) | KR20200121760A (ja) |
CN (1) | CN111832257B (ja) |
TW (1) | TWI825305B (ja) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11791838B2 (en) * | 2021-01-15 | 2023-10-17 | Samsung Electronics Co., Ltd. | Near-storage acceleration of dictionary decoding |
CN115719059B (zh) * | 2022-11-29 | 2023-08-08 | 北京中科智加科技有限公司 | 一种莫尔斯分组纠错方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5861827A (en) * | 1996-07-24 | 1999-01-19 | Unisys Corporation | Data compression and decompression system with immediate dictionary updating interleaved with string search |
TW410311B (en) * | 1994-09-30 | 2000-11-01 | Ricoh Kk | Method and apparatus for encoding and decoding data |
US20030138158A1 (en) * | 1994-09-21 | 2003-07-24 | Schwartz Edward L. | Multiple coder technique |
TW200844798A (en) * | 2007-04-30 | 2008-11-16 | Jen-Te Chen | Decoding method utilizing temporally ambiguous code and apparatus using the same |
US20170155403A1 (en) * | 2014-10-07 | 2017-06-01 | Doron Kletter | Enhanced data compression for sparse multidimensional ordered series data |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2487798B1 (en) * | 2004-12-07 | 2016-08-10 | Nippon Telegraph And Telephone Corporation | Information compression-coding device, its decoding device, method thereof, program thereof and recording medium storing the program |
US7102552B1 (en) * | 2005-06-07 | 2006-09-05 | Windspring, Inc. | Data compression with edit-in-place capability for compressed data |
JP4266218B2 (ja) * | 2005-09-29 | 2009-05-20 | 株式会社東芝 | 動画像データの再圧縮符号化方法、装置及びプログラム |
US8090027B2 (en) * | 2007-08-29 | 2012-01-03 | Red Hat, Inc. | Data compression using an arbitrary-sized dictionary |
US7889102B2 (en) * | 2009-02-26 | 2011-02-15 | Red Hat, Inc. | LZSS with multiple dictionaries and windows |
US8159374B2 (en) * | 2009-11-30 | 2012-04-17 | Red Hat, Inc. | Unicode-compatible dictionary compression |
EP3119003A3 (en) * | 2015-07-13 | 2017-03-01 | Fujitsu Limited | Encoding computer program, encoding method, encoding apparatus, decoding computer program, decoding method, and decoding apparatus |
JP2017028372A (ja) * | 2015-07-16 | 2017-02-02 | 沖電気工業株式会社 | 符号化方式変換装置、方法及びプログラム |
CN108197087B (zh) * | 2018-01-18 | 2021-11-16 | 奇安信科技集团股份有限公司 | 字符编码识别方法及装置 |
-
2020
- 2020-04-15 TW TW109112659A patent/TWI825305B/zh active
- 2020-04-16 KR KR1020200046249A patent/KR20200121760A/ko not_active Application Discontinuation
- 2020-04-16 CN CN202010298627.5A patent/CN111832257B/zh active Active
- 2020-04-16 JP JP2020073662A patent/JP7381393B2/ja active Active
- 2020-04-16 KR KR1020200046258A patent/KR20200121761A/ko unknown
-
2024
- 2024-05-20 KR KR1020240065311A patent/KR20240078422A/ko active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030138158A1 (en) * | 1994-09-21 | 2003-07-24 | Schwartz Edward L. | Multiple coder technique |
TW410311B (en) * | 1994-09-30 | 2000-11-01 | Ricoh Kk | Method and apparatus for encoding and decoding data |
US5861827A (en) * | 1996-07-24 | 1999-01-19 | Unisys Corporation | Data compression and decompression system with immediate dictionary updating interleaved with string search |
TW200844798A (en) * | 2007-04-30 | 2008-11-16 | Jen-Te Chen | Decoding method utilizing temporally ambiguous code and apparatus using the same |
US20170155403A1 (en) * | 2014-10-07 | 2017-06-01 | Doron Kletter | Enhanced data compression for sparse multidimensional ordered series data |
Also Published As
Publication number | Publication date |
---|---|
CN111832257B (zh) | 2023-02-28 |
TW202107856A (zh) | 2021-02-16 |
JP7381393B2 (ja) | 2023-11-15 |
KR20240078422A (ko) | 2024-06-03 |
KR20200121760A (ko) | 2020-10-26 |
JP2020178347A (ja) | 2020-10-29 |
KR20200121761A (ko) | 2020-10-26 |
CN111832257A (zh) | 2020-10-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11838035B2 (en) | Using predicates in conditional transcoder for column store | |
US10187081B1 (en) | Dictionary preload for data compression | |
US8578058B2 (en) | Real-time multi-block lossless recompression | |
US9503123B1 (en) | Random access to compressed data using bitwise indices | |
US8937564B2 (en) | System, method and non-transitory computer readable medium for compressing genetic information | |
Mahdi et al. | Implementing a novel approach an convert audio compression to text coding via hybrid technique | |
WO2019041833A1 (zh) | 一种用于深度神经网络的压缩装置 | |
KR20240078422A (ko) | 인코딩된 데이터에 대한 조건부 트랜스코딩 | |
TWI789392B (zh) | 藉由使用主要資料篩的資料無損縮減及對於已經使用主要資料篩來無損地縮減的資料進行多維度搜索和內容關聯的檢索 | |
US9479194B2 (en) | Data compression apparatus and data decompression apparatus | |
US8407378B2 (en) | High-speed inline data compression inline with an eight byte data path | |
CN107565971B (zh) | 一种数据压缩方法及装置 | |
CN104579356A (zh) | 在存在重现的霍夫曼树的情况下加速解压缩的方法和系统 | |
WO2021012278A1 (zh) | 一种数据的处理方法、系统、编码器及解码器 | |
KR20220054651A (ko) | 다중 심볼 디코더 | |
CN108475508B (zh) | 音频数据和保存在块处理存储系统中的数据的简化 | |
CN104682966B (zh) | 列表数据的无损压缩方法 | |
TW202311996A (zh) | 用於資料壓縮的系統以及方法 | |
US10168909B1 (en) | Compression hardware acceleration | |
US20220342750A1 (en) | Method and system for facilitating efficient data compression based on error correction code and reorganization of data placement | |
Kella et al. | Apcfs: Autonomous and parallel compressed file system | |
US20140236897A1 (en) | System, method and non-transitory computer readable medium for compressing genetic information | |
JP7305609B2 (ja) | 受信したデータを処理する装置 |