CN110785734A - 数据处理方法和装置 - Google Patents

数据处理方法和装置 Download PDF

Info

Publication number
CN110785734A
CN110785734A CN201880031263.5A CN201880031263A CN110785734A CN 110785734 A CN110785734 A CN 110785734A CN 201880031263 A CN201880031263 A CN 201880031263A CN 110785734 A CN110785734 A CN 110785734A
Authority
CN
China
Prior art keywords
data
memory
valid
processed
equal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880031263.5A
Other languages
English (en)
Inventor
从勇
秦东
胡成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Dajiang Innovations Technology Co Ltd
Original Assignee
Shenzhen Dajiang Innovations Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Dajiang Innovations Technology Co Ltd filed Critical Shenzhen Dajiang Innovations Technology Co Ltd
Publication of CN110785734A publication Critical patent/CN110785734A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0653—Monitoring storage devices or systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0656—Data buffering arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30098—Register arrangements
    • G06F9/3012—Organisation of register space, e.g. banked or distributed register file
    • G06F9/30123—Organisation of register space, e.g. banked or distributed register file according to context, e.g. thread buffers
    • G06F9/30127—Register windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/188—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a video data packet, e.g. a network abstraction layer [NAL] unit
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本发明实施例提供一种数据处理方法和装置，此方法包括：从待处理数据中每次获取N个数据，然后从每N个数据中确定第一有效数据，再将第一有效数据写入存储器中，并从存储器中每次读出K个数据，其中，N为大于等于2的整数，K为大于等于1且小于N的整数。因此，提高了每次能从存储器中读出数据的概率，减少了处理从存储器中读取数据的硬件处于空置状态的现象，减少资源浪费，提高了从存储器中读取数据的后续处理效率，例如提高了解码处理效率。

Description

PCT国内申请，说明书已公开。

Claims (28)

  1. PCT国内申请，权利要求书已公开。
CN201880031263.5A 2018-04-25 2018-04-25 数据处理方法和装置 Pending CN110785734A (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/084522 WO2019205036A1 (zh) 2018-04-25 2018-04-25 数据处理方法和装置

Publications (1)

Publication Number Publication Date
CN110785734A true CN110785734A (zh) 2020-02-11

Family

ID=68293399

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880031263.5A Pending CN110785734A (zh) 2018-04-25 2018-04-25 数据处理方法和装置

Country Status (3)

Country Link
US (1) US20210042056A1 (zh)
CN (1) CN110785734A (zh)
WO (1) WO2019205036A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070186065A1 (en) * 2006-02-03 2007-08-09 Samsung Electronics Co., Ltd. Data storage apparatus with block reclaim for nonvolatile buffer
US20120203942A1 (en) * 2011-02-08 2012-08-09 Olympus Corporation Data processing apparatus
CN104133839A (zh) * 2014-06-24 2014-11-05 国家电网公司 一种具有智能检测功能的数据处理方法及系统
CN106537327A (zh) * 2014-02-05 2017-03-22 泰德系统股份有限公司 快闪存储器压缩

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3519199B2 (ja) * 1996-02-06 2004-04-12 株式会社ソニー・コンピュータエンタテインメント 画像生成装置
CN103559000B (zh) * 2013-11-21 2016-03-09 中国电子科技集团公司第十五研究所 一种面向质量的海量影像数据迁移方法和系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070186065A1 (en) * 2006-02-03 2007-08-09 Samsung Electronics Co., Ltd. Data storage apparatus with block reclaim for nonvolatile buffer
US20120203942A1 (en) * 2011-02-08 2012-08-09 Olympus Corporation Data processing apparatus
CN106537327A (zh) * 2014-02-05 2017-03-22 泰德系统股份有限公司 快闪存储器压缩
CN104133839A (zh) * 2014-06-24 2014-11-05 国家电网公司 一种具有智能检测功能的数据处理方法及系统

Also Published As

Publication number Publication date
WO2019205036A1 (zh) 2019-10-31
US20210042056A1 (en) 2021-02-11

Similar Documents

Publication Publication Date Title
CN108733344B (zh) 数据读写方法、装置以及环形队列
US20210318836A1 (en) Data compression method and apparatus
US10374628B2 (en) In-place data compression with small working memory
US20220078479A1 (en) Method, device and electronic equipment for coding/decoding based on restricting range of bv
CN109067405B (zh) 一种数据压缩的方法、装置、终端及计算机可读存储介质
CN108377394B (zh) 视频编码器的图像数据读取方法、计算机装置及计算机可读存储介质
CN113556442B (zh) 视频去噪方法、装置、电子设备及计算机可读存储介质
US9813739B2 (en) Backward adaptation apparatus for applying backward adaptation to probability table at end of processing of frame and related backward adaptation method
CN111314640B (zh) 一种视频压缩方法、设备以及介质
US7689047B2 (en) Reduced buffer size for JPEG encoding
CN114422807B (zh) 一种基于Spice协议的传输优化方法
CN108777810B (zh) 视频数据存储方法、装置、设备及存储介质
CN117095685B (zh) 一种联发科平台终端设备及其控制方法
WO2021237510A1 (zh) 数据解压缩的方法、系统、处理器及计算机存储介质
CN110413540B (zh) 一种fpga数据缓存的方法、系统、设备及存储介质
CN116934573A (zh) 数据读写方法、存储介质及电子设备
CN110785734A (zh) 数据处理方法和装置
WO2023124428A1 (zh) 芯片、加速卡以及电子设备、数据处理方法
CN110045924B (zh) 分级存储方法、装置、电子设备及计算机可读存储介质
JP4097108B2 (ja) ウェーブレット変換装置及び符号化復号化装置
WO2023083213A1 (zh) 一种数据解码方法、装置、电子设备及可读存储介质
CN102694962B (zh) 降噪方法及装置
US20210082082A1 (en) Data processing method and processing circuit
KR101652740B1 (ko) 이미지 처리 시스템, 이미지 복원 시스템 및 그 방법
CN109886862B (zh) 一种数据处理的方法及装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200211

WD01 Invention patent application deemed withdrawn after publication