US20040073710A1 - System and methods for accelerated data storage and retrieval - Google Patents

System and methods for accelerated data storage and retrieval Download PDF

Info

Publication number
US20040073710A1
US20040073710A1 US10/628,801 US62880103A US2004073710A1 US 20040073710 A1 US20040073710 A1 US 20040073710A1 US 62880103 A US62880103 A US 62880103A US 2004073710 A1 US2004073710 A1 US 2004073710A1
Authority
US
United States
Prior art keywords
data
storage device
compression
rate
input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/628,801
Inventor
James Fallon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=32072870&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20040073710(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Priority claimed from US09/266,394 external-priority patent/US6601104B1/en
Application filed by Individual filed Critical Individual
Priority to US10/628,801 priority Critical patent/US20040073710A1/en
Publication of US20040073710A1 publication Critical patent/US20040073710A1/en
Priority to US11/230,953 priority patent/US20060015650A1/en
Priority to US11/400,322 priority patent/US7395345B2/en
Priority to US11/400,008 priority patent/US8275897B2/en
Priority to US12/690,125 priority patent/US20100318684A1/en
Priority to US14/305,692 priority patent/US20150113182A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0674—Disk device
    • G06F3/0676—Magnetic disk device
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007—Time or data compression or expansion
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115—Selection of the code volume for a coding unit prior to coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42661—Internal components of the client ; Characteristics thereof for reading from or writing on a magnetic storage medium, e.g. hard disk drive
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/781—Television signal recording using magnetic recording on disks or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0674—Disk device
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007—Time or data compression or expansion
    • G11B2020/00079—Time or data compression or expansion the compression ratio or quality level being adapted to circumstances, e.g. to the available recording space
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
    • G11B2020/1075—Data buffering arrangements, e.g. recording or playback buffers the usage of the buffer being restricted to a specific kind of data
    • G11B2020/10759—Data buffering arrangements, e.g. recording or playback buffers the usage of the buffer being restricted to a specific kind of data content data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/843—Television signal recording using optical recording on film
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal

Definitions

  • the present invention relates generally to data storage and retrieval and, more particularly to systems and methods for improving data storage and retrieval bandwidth utilizing lossless and/or lossy data compression and decompression.
  • Information may be represented in a variety of manners. Discrete information such as text and numbers are easily represented in digital data. This type of data representation is known as symbolic digital data. Symbolic digital data is thus an absolute representation of data such as a letter, figure, character, mark, machine code, or drawing.
  • Continuous information such as speech, music, audio, images and video frequently exists in the natural world as analog information.
  • VLSI very large scale integration
  • Diffuse digital data is thus a representation of data that is of low information density and is typically not easily recognizable to humans in its native form.
  • Lossy data compression techniques provide for an inexact representation of the original uncompressed data such that the decoded (or reconstructed) data differs from the original unencoded/uncompressed data.
  • Lossy data compression is also known as irreversible or noisy compression. Negentropy is defined as the quantity of information in a given set of data.
  • Negentropy is defined as the quantity of information in a given set of data.
  • One obvious advantage of lossy data compression is that the compression ratios can be larger than that dictated by the negentropy limit, all at the expense of information content.
  • Many lossy data compression techniques seek to exploit various traits within the human senses to eliminate otherwise imperceptible data. For example, lossy data compression of visual imagery might seek to delete information content in excess of the display resolution or contrast ratio of the target display device.
  • lossless data compression techniques provide an exact representation of the original uncompressed data. Simply stated, the decoded (or reconstructed) data is identical to the original unencoded/uncompressed data. Lossless data compression is also known as reversible or noiseless compression. Thus, lossless data compression has, as its current limit, a minimum representation defined by the negentropy of a given data set.
  • data compression provides several unique benefits.
  • mass storage devices include magnetic and optical tape, magnetic and optical disks, and various solid-state mass storage devices. It should be noted that the present invention applies to all forms and manners of memory devices including storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • the present invention is directed to systems and methods for providing accelerated data storage and retrieval by utilizing lossless and lossy data compression and decompression.
  • the present invention provides an effective increase of the data storage and retrieval bandwidth of a memory storage device.
  • a method for providing accelerated data storage comprises the steps of receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device, compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device, and storing the compressed digital data stream in the target storage device.
  • the step of compressing may be performed using lossless data compression, lossy data compression or a combination of lossless and lossy data compression.
  • the compression process comprises the steps of reading a first parameter that is indicative of a compression type to be applied to the input digital data stream, and selecting at least one allowable encoder based on the first parameter.
  • the compression process further comprises the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data compression is selected.
  • a method for providing accelerated retrieval of stored data comprises the steps of retrieving a compressed digital data stream from a target storage device at a rate equal to a data access rate of the target storage device and decompressing the compressed data at a decompression rate that increases the effective data access rate of the target storage device.
  • the step of compressing may be performed using lossless data compression, lossy data compression or a combination of lossless and lossy data compression.
  • the decompression process comprises the steps of reading a first parameter that is indicative of a decompression type to be applied to the compressed digital data stream, and selecting at least one allowable decoder based on the first parameter.
  • the decompression process further comprises the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data decompression is selected.
  • the method for providing accelerated data storage utilizes a compression ratio that is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input data stream at the input data transmission rate.
  • the method for providing accelerated data retrieval utilizes a decompression ratio which is equal to or greater than the ratio of the data access rate to a maximum accepted output data transmission rate so as to provide a continuous and optimal data output transmission rate.
  • data storage and retrieval acceleration is employed in a disk storage adapter to reduce the time required to store and retrieve data from computer to a disk memory device.
  • data storage and retrieval acceleration is employed in conjunction with random access memory to reduce the time required to store and retrieve data from random access memory.
  • data storage and retrieval acceleration is employed in a video data storage system to reduce the time required to store digital video data.
  • data storage and retrieval acceleration is employed in a display controller to reduce the time required to send display data to the display controller or processor.
  • data storage and retrieval acceleration is employed in an input/output controller to reduce the time required to store, retrieve, or transmit data various forms of data.
  • the present invention is realized due to recent improvements in processing speed, inclusive of dedicated analog and digital hardware circuits, central processing units, digital signal processors, dedicated finite state machines (and any hybrid combinations thereof), that, coupled with advanced data compression and decompression algorithms, are enabling of ultra high bandwidth data compression and decompression methods that enable improved data storage and retrieval bandwidth.
  • FIG. 1 is a block diagram of a system for accelerated data storage and retrieval according to one embodiment of the present invention
  • FIG. 2 is a flow diagram of a method for accelerated data storage in accordance with one aspect of the present invention
  • FIG. 3 is a flow diagram of a method for accelerated data retrieval in accordance with one aspect of the present invention.
  • FIGS. 4 a and 4 b are timing diagrams of methods for accelerated data storage according to the present invention.
  • FIGS. 5 a and 5 b are timing diagrams of methods for accelerated data retrieval according to the present invention.
  • FIGS. 6 a and 6 b comprise a flow diagram of a method for accelerated data storage in accordance with a further aspect of the present invention
  • FIGS. 7 a and 7 b comprise a flow diagram of a method for accelerated data retrieval in accordance with a further aspect of the present invention
  • FIG. 8 is a detailed block diagram of a system for accelerated data storage according to a preferred embodiment of the present invention.
  • FIG. 9 is a detailed block diagram of a system for accelerated data retrieval according to a preferred embodiment of the present invention.
  • FIG. 10 is a block diagram of a system for accelerated video storage according to one embodiment of the present invention.
  • FIG. 11 is a block diagram of a system for accelerated retrieval of video data according to one embodiment of the present invention.
  • FIG. 12 is a block diagram of an input/output controller system for accelerated storage of analog, digital, and serial data according to one embodiment of the present invention
  • FIG. 13 is a flow diagram of a method for accelerated storage of analog, digital, and serial data according to one aspect of the present invention
  • FIG. 14 is a block diagram of an input/output system for accelerated retrieval of analog, digital, and serial data according to one embodiment of the present invention.
  • FIGS. 15 a and 15 b comprise a flow diagram of method for accelerated retrieval of analog, digital, and serial data according to one aspect of the present invention.
  • the present invention is directed to systems and methods for providing improved data storage and retrieval bandwidth utilizing both lossless and lossy data compression and decompression.
  • system elements having equivalent or similar functionality are designated with the same reference numerals in the Figures.
  • the present invention may be implemented in various forms of digital and/or analog hardware, software, firmware, or a combination thereof.
  • the present invention is implemented on a computer platform including hardware such as one or more central processing units (CPU) or digital signal processors (DSP), a random access memory (RAM), and input/output (I/O) interface(s).
  • CPU central processing units
  • DSP digital signal processors
  • RAM random access memory
  • I/O input/output
  • the computer platform may also include an operating system, microinstruction code, and dedicated processing hardware utilizing combinatorial logic, finite state machines, analog signal processing.
  • the various processes and functions described herein may be either part of the hardware, microinstruction code or application programs that are executed via the operating system, or any combination thereof.
  • FIG. 1 a block diagram illustrates a system for accelerated data storage and retrieval in accordance with an embodiment of the present invention.
  • the system inlcudes a data storage accelerator 10 that is operatively coupled to a data storage device 45 .
  • the data storage accelerator operates to increase the effective data storage rate of the data storage device 45 .
  • the data storage device 45 may be any form of memory device including all forms of sequential, pseudo-random, and random access storage devices.
  • the memory storage device 45 may be volatile or non-volatile in nature, or any combination thereof.
  • Storage devices as known within the current art include all forms of random access memory, magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices.
  • the current invention applies to all forms and manners of memory devices including, but not limited to, storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • the data storage accelerator 10 receives and processes data blocks from an input data stream.
  • the data blocks may range in size from individual bits through complete files or collections of multiple files, and the data block size may be fixed or variable.
  • the data storage accelerator 10 In order to achieve continuous data storage acceleration, the data storage accelerator 10 must be configured to compress a given input data block utilizing lossless or lossy data compression at a rate that is equal to or faster than receipt of the input data.
  • the rate that data blocks from the input data stream may be accepted by the data storage accelerator 10 is a function of the size of each input data block, the compression ratio achieved, and the bandwidth of the target storage device.
  • the data storage device 45 e.g., a typical target mass storage device
  • the data storage accelerator 10 is capable of providing an average compression ratio of 3:1
  • 90 megabytes per second may be accepted as input and the data storage acceleration is precisely 3:1, equivalent to the average compression ratio.
  • the storage accelerator 10 may compress a given input data block at a rate that is equal to or faster than receipt of the input data. Indeed, if the storage accelerator 10 compresses data at a rate that is less than the input data rate, buffering may be applied to accept data from the input data stream for subsequent compression. Further, since data may be received in high-speed bursts, the present invention may increase the effective bandwidth of the data storage process without increasing the instantaneous bandwidth of the data storage device.
  • the data storage accelerator 10 utilize data compression with a ratio that is at least the ratio of the input data stream to the data storage access rate of the data storage device 45 . Indeed, if the compression ratio is less than this ratio, the input data stream may be periodically halted to effectively reduce the rate of the input data stream. Alternatively, the input data stream or the output of the data accelerator 10 may be buffered to temporarily accommodate the mismatch in data bandwidth. An additional alternative is to reduce the input data rate to rate that is equal to or slower than the ratio of the input data rate to the data storage device access rate by signaling the data input source and requesting a slower data input rate, if possible.
  • a data retrieval accelerator 80 is operatively connected to and receives data from the data storage device 45 .
  • the data retrieval accelerator 80 receives and processes compressed data from data storage device 45 in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • the data retrieval accelerator 80 is configured to decompress each compressed data block which is received from the data storage device 45 . In order to achieve continuous accelerated data retrieval, the data retrieval accelerator must decompress a given input data block at a rate that is equal to or faster than receipt of the input data.
  • achieving optimum throughput with the data retrieval accelerator 80 is a function of the rate that compressed data blocks are retrieved from the data storage device 45 , the size of each data block, the decompression ratio achieved, and the limitation on the bandwidth of the output data stream, if any.
  • the data storage device 45 is capable of continuously supplying 30 megabytes per second and the data retrieval accelerator 80 is capable of providing an average decompression ratio of 1:3, then a 90 megabytes per second output data stream is achieved, and the corresponding data retrieval acceleration is precisely 1:3, equivalent to the average decompression ratio.
  • the data retrieval accelerator 80 utilize data decompression with a ratio that is at most equal to the ratio of the retrieval rate of the data storage device 45 to the maximum rate data output stream. Indeed, if the decompression ratio is greater than this ratio, retrieving data from the data storage device may be periodically halted to effectively reduce the rate of the output data stream to be at or below its maximum. Alternatively, the compressed data retrieved from the data storage device 45 or the output of the data decompressor may be buffered to temporarily accommodate the mismatch in data bandwidth. An additional alternative is to increase the output data rate by signaling or otherwise requesting the data output device(s) receiving the output data stream to accept a higher bandwidth, if possible.
  • FIG. 2 a flow diagram of a method for accelerated data storage according to one aspect of the present invention illustrates the operation of the data storage acceleration shown in FIG. 1.
  • data compression is performed on a per data block basis.
  • the initial input data block in the input data stream (step 200 ) is input into and compressed by the data storage accelerator 10 (step 202 ) utilizing lossless or lossy data compression, or any combination or permutation thereof.
  • the encoded data block is then stored in the data storage device 45 (step 204 ).
  • a check or other form of test is performed to see if there are additional data blocks available in the input stream (step 206 ). If no more data blocks are available, the storage acceleration process is terminated (step 208 ). If more data blocks are available in the input data stream, the next data block is received (step 210 ) and the process repeats beginning with data compression (step 202 ).
  • FIG. 3 a flow diagram of a method for accelerated data retrieval according to one aspect of the present invention illustrates the operation of the data retrieval accelerator 80 shown in FIG. 1.
  • Data decompression is also performed on a per data block basis.
  • the initial compressed data block is retrieved from the storage device 45 (step 300 ) and is decompressed by the data retrieval accelerator 80 (step 302 ) utilizing lossless or lossy data decompression, or any combination or permutation thereof.
  • the decoded data block is then output for subsequent processing, storage, or transmittal (step 304 ).
  • a check or other form of test is performed to see if additional data blocks available from the data storage device (step 306 ).
  • step 308 the data retrieval acceleration process is terminated. If more data blocks are available from the data storage device, the next data block is retrieved (step 310 ) and the process repeats beginning with data decompression (step 302 ).
  • FIGS. 4 a and 4 b a timing diagram illustrates methods for accelerated data storage utilizing data compression in accordance with the present invention. Successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 is received from an input stream of one or more data blocks. Similarly, data block 2 through data block n are received during time intervals T2 through Tn, respectively.
  • FIGS. 4 a and 4 b demonstrate one embodiment of the data storage utilizing a stream of n data blocks.
  • the input data stream is comprised of one or more data blocks data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • Method 1 lossless or lossy compression of data block 1 and subsequent storage of the encoded data block 1 occurs within time interval T1. Similarly, the compression and storage of each successive data block occurs within the time interval the data block is received. Specifically, data blocks 2 . . . n are compressed in time intervals T2 . . . Tn, respectively, and the corresponding encoded data blocks 2 . . . n are stored during the time intervals T2 . . . Tn, respectively. It is to be understood that Method 1 relies on data compression and encoding techniques that process data as a contiguous stream (i.e., not block oriented).
  • Method 1 possesses the advantage of introducing a minimum delay in the time from receipt of input to storage of encoded data blocks.
  • Method 2 illustrates compressing and storing data utilizing pipelined data processing.
  • successive time intervals of equal duration are represented as T1 through T(n+2).
  • Data block 1 is received from an input stream of one or more data blocks during time interval T1.
  • data block 2 through data block n are received during time intervals T2 through Tn, respectively.
  • Compression of data block 1 occurs during time interval T2 and the storage of encoded data block 1 occurs during time interval T3.
  • compression of each successive data block occurs within the next time interval after the data block is received and data storage of the corresponding encoded data block occur in the next time interval after completion of data compression.
  • the pipelining of Method 2 utilizes successive single time interval delays for lossless or lossy data compression and data storage.
  • data compression processing for a single input data block may utilize more than one time interval.
  • Accommodating more than one time interval for data compression requires additional data compressors to process successive data blocks, e.g., data compression processing of a single data block through three successive time intervals requires three data compressors, each processing a successive input data block. Due to the principle of causality, encoded data blocks are output only after compression encoding.
  • Method 2 provides for block oriented processing of the input data blocks.
  • block oriented data compression techniques provide the opportunity for increased data compression ratios. This includes various forms of dictionary compression, along with many compression techniques commonly applied to diffuse image data including current standards by the Joint Photographic Experts Group, the Motion Picture Experts Group, vector quantitization, wavelet coding, and fractal coding.
  • Method 2 may provide increased delay from receipt of input data block to storage of encoded data. However, depending on factors such as the size of input data blocks, the rate that they are received, the time required for data compression processing, the data compression ratio achieved, the bandwidth of the data storage device, and the intended application, the delay may or may not be significant.
  • Method 1 and Method 2 are not mutually exclusive, and may be utilized in any combination.
  • FIGS. 5 a and 5 b a timing diagram illustrates methods for accelerated data retrieval utilizing data decompression in accordance the present invention shown. Successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 is retrieved or otherwise accepted as input from one or more compressed data blocks retrieved from a data storage device. As shown, data block 2 through data block n are retrieved during time intervals T2 through Tn, respectively.
  • FIGS. 5 a and 5 b demonstrate one embodiment of the data retrieval accelerator utilizing a stream of n data blocks. Once again, the retrieved data stream is comprised of one or more data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the retrieved data block size may be fixed or variable.
  • Method 1 In accordance with Method 1, lossless or lossy decompression of data block 1 and subsequent outputting of the decoded data block 1 occurs within time interval T1. Similarly, decompression and outputting of each successive data block occurs within the time intervals they are retrieved. In particular, data block 2 through data block n are decompressed and decoded data block 2 through decoded data block n are output during time intervals T2 . . . Tn, respectively. It is to be understood that Method 1 relies on data decompression and decoding techniques that process compressed data as a contiguous stream (i.e., not block oriented).
  • Method 1 possesses the advantage of introducing a minimum delay in the time from retrieval of compressed data to output of decoded data blocks.
  • Method 2 involves lossless or lossy decompression and output of data utilizing pipelined data processing.
  • successive time intervals of equal duration are represented as T1 through T(n+2).
  • Data block 1 through data block n are retrieved or otherwise accepted as input from a data storage device during time intervals T1 through Tn, respectively.
  • Decompression of data block 1 occurs during time interval T2 and the decoded data block 1 is output during time interval T3.
  • decompression of each successive data block occurs within the next time interval after the data block is retrieved and the outputting of the decoded data block occurs during the next time interval after completion of data decompression.
  • the pipelining of Method 2 utilizes successive single time interval delays for data decompression and data output.
  • data decompression processing for a single input data block may utilize more than one time interval.
  • Accommodating more than one time interval for data compression requires additional data decompressors to process successive compressed data blocks, e.g., data decompression processing of a single data block through three successive time intervals requires three data decompressors, each processing a successive input data block. Due to the principle of causality, decoded data blocks are only output after decompression decoding.
  • Method 2 provides for block oriented processing of the retrieved data blocks.
  • block oriented data decompression techniques provide the opportunity to utilize both lossless and lossy data compression encoders that increase data compression ratios.
  • the disadvantage of method 2 is increased delay from retrieval of compressed data block to output of decompressed data. As previously discussed for data storage acceleration, depending on the size of retrieved data blocks, the rate that they are retrieved, the time required for data decompression processing, the data decompression ratio achieved, the bandwidth of the data output, and the intended application, the delay may or may not be significant.
  • FIGS. 6 a and 6 b a flow diagram illustrates a method for accelerated data storage according to a further aspect of the present invention.
  • the lossless or lossy data compression rate of the storage accelerator 10 is not required to be equal to or greater than the ratio of the input data rate to the data storage access rate.
  • data compression is performed on a per data block basis. Accordingly, the initial input data block in the input data stream is received (step 600 ) and then timed and counted (step 602 ). Timing and counting enables determination of the bandwidth of the input data stream. The input data block is then buffered (step 604 ).
  • certain data parameters may be read (step 606 ) to determine whether the data may be compressed utilizing lossless or lossy techniques. If lossy techniques may be employed, additional parameters may also be included to indicate the amount of information loss that is permissible. Allowable encoders and associated parameters are then selected from the pool of available encoders (step 608 ).
  • header information associated with a given data block or a series of data blocks may contain a binary flag that could be set to either logic “1” or logic “0” to indicate that the given data block or series of data blocks may be encoded using lossless or lossy data compression, respectively.
  • a multi-valued encoding parameter may be employed where all values true, for example a 16-bit value of FFFF (hexadecimal), signifies lossless encoding and where each value in the range from FFFE to 0000 denotes the amount of residual information content required.
  • a list of encoding techniques may be added wherein each encoding techniques in the list is indexed and selected via using the above information content values.
  • the values for the information content may possess different meanings dependent on system context. For example, an incoming video data stream may have an information value of 7FFF. This value may invoke a lossy encoder that scans a system parameter table which indicates video display or printer display resolution. With this information, the encoding algorithm can set the allowed information loss for the encoding process. It is to be understood that this technique may be applied to all forms of peripheral input and output devices.
  • the data is then compressed by the data storage accelerator 10 (step 610 ).
  • the encoded data block is then timed and counted (step 612 ), thus enabling determination of the compression ratio and compression bandwidth.
  • the compressed, timed and counted data block is then buffered (step 614 ).
  • the compression ratio and bandwidths of the input data stream and the encoder are then determined (step 616 ).
  • the compressed data block is then stored in the data storage device 45 (step 618 ). Checks or other forms of testing are applied to ensure that the data bandwidths of the input data stream, data compressor, and data storage device are compatible (step 620 ).
  • the input bandwidth may be adjusted by either not accepting input data requests, lowering the duty cycle of input data requests, or by signaling one or more of the data sources that transmit the input data stream to request or mandate a lower data rate.
  • the data compression ratio of the data storage accelerator 10 may be adjusted by applying a different type of encoding process such as employing lossless or lossy encoding, utilizing a single encoder, multiple parallel or sequential encoders, or any combination thereof to decrease encoding time, increase data compression ratio, or both.
  • additional temporary buffering of either the input data stream or the compressed data stream (or both) may be utilized.
  • the output of the data storage accelerator 10 would be 30 MB/sec. If the maximum data storage rate of the data storage device 45 is 20 MB/sec (which is less than the data rate output from the data storage accelerator 10 ), data congestion and backup would occur at the output of the data storage accelerator 10 .
  • This problem may be solved by adjusting any one of the system parameters as discussed above, e.g., by adjusting the compression ratio to provide a data output rate from the data storage accelerator 10 to be equal to the data storage rate of the data storage device 45 .
  • a check or other form of test is performed to determine if there are additional data blocks available in the input stream (step 624 ). If no more data blocks are available, the storage acceleration process is terminated (step 626 ). If more data blocks are available in the input data stream, the next data block is received (step 628 ) and the process repeats beginning with timing and counting of the input data block (step 602 ).
  • FIGS. 7 a and 7 b a flow diagram illustrates a method for accelerated data retrieval according to one aspect of the present invention.
  • the data decompression ratio is not required to be less than or equal to the ratio of the data retrieval access rate to the maximum output data rate.
  • data decompression is performed on a per data block basis. Accordingly, the initial input data block is retrieved from the storage device (step 700 ) and is timed and counted (step 702 ). Timing and counting enables determination of the bandwidth of data retrieval. The retrieved data block is then buffered (step 704 ).
  • encoded or encoded data parameters may be read (step 706 ) to select the allowable lossless or lossy decoders and associated data parameters (step 708 ) using, for example, the techniques discussed above for the encoding process (e.g., steps 606 and 608 , FIG. 6 a ).
  • Encoded data is then decompressed by the data retrieval accelerator 80 (step 710 ).
  • the decoded data block is then timed and counted (step 712 ), thus enabling determination of the decompression ratio and decompression bandwidth.
  • the decompressed, timed and counted data block is then buffered (step 714 ).
  • the decompression ratio and bandwidths of the retrieved data and the decoder are then determined (step 716 ).
  • the decompressed data block is then output (step 718 ). Checks or other forms of testing are applied to ensure that the data bandwidths of the retrieved data, data decompressor, and data output are compatible (step 720 ).
  • one or more system parameters may be modified to make the bandwidths compatible (step 722 ). For instance, the data retrieval bandwidth may be adjusted either not accepting (continuously) data blocks retrieved from the data storage device or lowering the duty cycle of data blocks retrieved from the data storage device.
  • one or more of the output data devices that receive the output data stream may be signaled or otherwise requested to accept a higher data rate.
  • a different type of decoding process may be applied to adjust the data decompression rate by applying, for example, lossless or lossy decoders, different decoding parameters, a single decoder, multiple parallel or sequential decoders, or any combination thereof. Also, additional temporary buffering of either the retrieved or output data or both may be utilized.
  • the output of the data retrieval accelerator 80 would be 80 MB/sec. If the maximum output data transmission rate that can be accepted from the data retrieval accelerator 80 is 60 MB/sec (which is lower than the data output data rate of 80 MB/sec of the data retrieval accelerator 80 ), data congestion and backup would occur at the output of the data retrieval accelerator 80 .
  • This problem may be solved by adjusting any one of the system parameters as discussed above, e.g., by adjusting the decompression ratio to provide a data output rate from the data storage accelerator 80 to be equal to the maximum accepted output data transmission rate.
  • step 724 a check or other form of test is performed to see if there are additional data blocks available from the data storage device. If no more data blocks are available for output, the retrieval acceleration process is terminated (step 726 ). If more data blocks are available to be retrieved from the data storage device, the next data block is retrieved (step 728 ) and the process repeats beginning with timing and counting of the retrieved data block (return to step 702 ).
  • any conventional compression/decompression system and method may be employed in the data storage accelerator 10 and data retrieval accelerator 80 for providing accelerated data storage and retrieval in accordance with the present invention.
  • the present invention employs the data compression/decompression techniques disclosed in U.S. Ser. No. 09/210,491 entitled “Content Independent Data Compression Method and System,” filed on Dec. 11, 1998, which is commonly assigned and which is fully incorporated herein by reference. It is to be appreciated that the compression and decompression systems and methods disclosed in U.S. Ser. No. 09/210,491 are suitable for compressing and decompressing data at rates which provide accelerated data storage and retrieval.
  • FIG. 8 a detailed block diagram illustrates a preferred system for accelerated data storage which employs a compression system as disclosed in the above-incorporated U.S. Ser. No. 09/210,491.
  • the data storage accelerator 10 accepts data blocks from an input data stream and stores the input data block in an input buffer or cache 15 .
  • the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • a counter 20 counts or otherwise enumerates the size of input data block in any convenient units including bits, bytes, words, double words. It should be noted that the input buffer 15 and counter 20 are not required elements of the present invention.
  • the input data buffer 15 may be provided for buffering the input data stream in order to output an uncompressed data stream in the event that, as discussed in further detail below, every encoder fails to achieve a level of compression that exceeds an a priori specified minimum compression ratio threshold.
  • Data compression is performed by an encoder module 25 which may comprise a set of encoders E 1 , E 2 , E 3 . . . En.
  • the encoder module 25 successively receives as input each of the buffered input data blocks (or unbuffered input data blocks from the counter module 20 ). Data compression is performed by the encoder module 25 wherein each of the encoders E 1 . . . En processes a given input data block and outputs a corresponding set of encoded data blocks. It is to be appreciated that the system affords a user the option to enable/disable any one or more of the encoders E 1 . . . En prior to operation. As is understood by those skilled in the art, such feature allows the user to tailor the operation of the data compression system for specific applications. It is to be further appreciated that the encoding process may be performed either in parallel or sequentially.
  • encoders E 1 through En of encoder module 25 may operate in parallel (i.e., simultaneously processing a given input data block by utilizing task multiplexing on a single central processor, via dedicated hardware, by executing on a plurality of processor or dedicated hardware systems, or any combination thereof).
  • encoders E 1 through En may operate sequentially on a given unbuffered or buffered input data block. This process is intended to eliminate the complexity and additional processing overhead associated with multiplexing concurrent encoding techniques on a single central processor and/or dedicated hardware, set of central processors and/or dedicated hardware, or any achievable combination.
  • encoders of the identical type may be applied in parallel to enhance encoding speed.
  • encoder E 1 may comprise two parallel Huffman encoders for parallel processing of an input data block.
  • a buffer/counter module 30 is operatively connected to the encoder module 25 for buffering and counting the size of each of the encoded data blocks output from encoder module 25 .
  • the buffer/counter 30 comprises a plurality of buffer/counters BC 1 , BC 2 , BC 3 . . . BCn, each operatively associated with a corresponding one of the encoders E 1 . . . En.
  • a compression ratio module 35 operatively connected to the output buffer/counter 30 , determines the compression ratio obtained for each of the enabled encoders E 1 . . . En by taking the ratio of the size of the input data block to the size of the output data block stored in the corresponding buffer/counters BC 1 . . . BCn.
  • the compression ratio module 35 compares each compression ratio with an a priori-specified compression ratio threshold limit to determine if at least one of the encoded data blocks output from the enabled encoders E 1 . . . En achieves a compression that exceeds an a priori-specified threshold.
  • the threshold limit may be specified as any value inclusive of data expansion, no data compression or expansion, or any arbitrarily desired compression limit.
  • a description module 38 operatively coupled to the compression ratio module 35 , appends a corresponding compression type descriptor to each encoded data block which is selected for output so as to indicate the type of compression format of the encoded data block.
  • a null data compression type descriptor is defined as any recognizable data token or descriptor that indicates no data encoding has been applied to the input data block. Accordingly, the unencoded input data block with its corresponding null data compression type descriptor is then output for subsequent data processing, storage, or transmittal.
  • the data storage device 45 may be volatile or non-volatile in nature, or any combination thereof.
  • Storage devices as known within the current art include all forms of random access memory (RAM), magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices (e.g., ATA/ATAPI IDE disk).
  • RAM random access memory
  • magnetic and optical tape magnetic and optical disks
  • solid-state mass storage devices e.g., ATA/ATAPI IDE disk.
  • ATA/ATAPI IDE disk solid-state mass storage devices
  • the current invention applies to all forms and manners of memory devices including, but not limited to, storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • the embodiment of the data storage accelerator of FIG. 8 is exemplary of a preferred compression system which may be implemented in the present invention, and that other compression systems and methods known to those skilled in the art may be employed for providing accelerated data storage in accordance with the teachings herein.
  • a timer is included to measure the time elapsed during the encoding process against an a priori-specified time limit. When the time limit expires, only the data output from those encoders (in the encoder module 25 ) that have completed the present encoding cycle are compared to determine the encoded data with the highest compression ratio.
  • the time limit ensures that the real-time or pseudo real-time nature of the data encoding is preserved.
  • the results from each encoder in the encoder module 25 may be buffered to allow additional encoders to be sequentially applied to the output of the previous encoder, yielding a more optimal lossless data compression ratio. Such techniques are discussed in greater detail in the above-incorporated U.S. Ser. No. 09/210,491.
  • FIG. 9 a detailed block diagram illustrates a preferred system for accelerated data retrieval employing a decompression system as disclosed in the above-incorporated U.S. Ser. No. 09/210,491.
  • the data retrieval accelerator 80 retrieves or otherwise accepts data blocks from one or more data storage devices 45 and inputs the data via a data storage interface 50 .
  • the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • the memory storage device 45 may be volatile or non-volatile in nature, or any combination thereof.
  • Storage devices as known within the current art include all forms of random access memory, magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices. Thus it should be noted that the current invention applies to all forms and manners of memory devices including storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • the data storage device interface 50 converts the input data from the storage device format to a format useful for data decompression.
  • the storage device data interface 50 is operatively connected to the data retrieval accelerator 80 which is utilized for decoding the stored (compressed) data, thus providing accelerated retrieval of stored data.
  • the data retrieval accelerator 80 comprises an input buffer 55 which receives as input an uncompressed or compressed data stream comprising one or more data blocks.
  • the data blocks may range in size from individual bits through complete files or collections of multiple files. Additionally, the data block size may be fixed or variable.
  • the input data buffer 55 is preferably included (not required) to provide storage of input data for various hardware implementations.
  • a descriptor extraction module 60 receives the buffered (or unbuffered) input data block and then parses, lexically, syntactically, or otherwise analyzes the input data block using methods known by those skilled in the art to extract the data compression type descriptor associated with the data block.
  • the data compression type descriptor may possess values corresponding to null (no encoding applied), a single applied encoding technique, or multiple encoding techniques applied in a specific or random order (in accordance with the data compression system embodiments and methods discussed above).
  • a decoder module 65 includes one or more decoders D 1 . . . Dn for decoding the input data block using a decoder, set of decoders, or a sequential set of decoders corresponding to the extracted compression type descriptor.
  • the decoders D 1 . . . Dn may include those lossless encoding techniques currently well known within the art, including: run length, Huffman, Lempel-Ziv Dictionary Compression, arithmetic coding, data compaction, and data null suppression. Decoding techniques are selected based upon their ability to effectively decode the various different types of encoded input data generated by the data compression systems described above or originating from any other desired source.
  • the decoder module 65 may include multiple decoders of the same type applied in parallel so as to reduce the data decoding time.
  • the data retrieval accelerator 80 also includes an output data buffer or cache 70 for buffering the decoded data block output from the decoder module 65 .
  • the output buffer 70 then provides data to the output data stream.
  • the data retrieval accelerator 80 may also include an input data counter and output data counter operatively coupled to the input and output, respectively, of the decoder module 65 . In this manner, the compressed and corresponding decompressed data block may be counted to ensure that sufficient decompression is obtained for the input data block.
  • the embodiment of the data retrieval accelerator 80 of FIG. 9 is exemplary of a preferred decompression system and method which may be implemented in the present invention, and that other data decompression systems and methods known to those skilled in the art may be employed for providing accelerated data retrieval in accordance with the teachings herein.
  • the data storage and retrieval accelerator system and method may be employed in for increasing the storage rate of video data.
  • FIG. 10 a block diagram illustrates a system for providing accelerated video data storage in accordance with one embodiment of the present invention.
  • the video data storage acceleration system accepts as input one or more video data streams that are analog, digital, or any combination thereof in nature.
  • the input multiplexer 1010 selects the initial video data stream for data compression and acceleration.
  • the input multiplexer 1010 is operatively connected to an A/D converter 1020 which converts analog video inputs to digital format of desired resolution.
  • the A/D converter 1020 may also include functions to strip video data synchronization to perform other data formatting functions.
  • the A/D converter 1020 is operatively connected a video memory 1030 that is, in turn, operatively connected to a video processor 1040 .
  • the video processor 1040 performs manipulation of the digital video data in accordance with any user desired processing functions.
  • the video processor 1040 is operatively coupled to a video output memory 1050 , that is operatively connected to a data storage accelerator 10 which compresses the video data to provide accelerated video data to the output data stream for subsequent data processing, storage, or transmittal of the video data. This video data acceleration process is repeated for all data blocks in the input data stream.
  • the video multiplexer selects the next block of video for accelerated processing.
  • the data storage accelerator 10 may employ any lossless or lossy data compression system which is capable of compressing data at a rate suitable for providing accelerated video data storage in accordance with the teachings herein.
  • the accelerated data storage and retrieval system may be employed in a display controller to reduce the time required to send display data to a display controller or processor.
  • FIG. 11 a block diagram illustrates a display accelerator system in accordance with one embodiment of the present invention.
  • the video display accelerator accepts as input one or more digital display data blocks from an input display data stream. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input video data block size may be fixed or variable.
  • the input data blocks are processed by a data retrieval accelerator 80 which employs lossless or lossy data decompression system in accordance with the teachings herein.
  • the decompressed data block is then output to a display memory 1110 that provides data to a display processor 1120 .
  • the display processor 1120 performs any user desired processing function. It is well known within the current art that display data is often provided in one or more symbolic formats such as Open Graphics Language (Open GL) or another display or image language.
  • the display processor 1120 is operatively connected an output memory buffer 1130 .
  • the output memory 1130 supplies data to a display formatter 1140 that converts the data to a format compatible with the output display device or devices. Data from the display formatter 1140 is provided to the display driver 1150 that outputs data in appropriate format and drive signal levels to one or more display devices.
  • the display memory 1110 , display processor 1120 , output memory 1130 , display formatter 1140 , and display driver 1150 are not required elements of the present invention.
  • the data storage and retrieval accelerator system and method may be employed in an I/O controller to reduce the time for storing, retrieving or transmitting parallel data streams.
  • FIG. 12 a block diagram illustrates a system for accelerated data storage of analog, digital, and serial data in accordance with one embodiment of the present invention.
  • the data storage accelerator 10 is capable of accepting one or more simultaneous analog, parallel digital, and serial data inputs.
  • An analog input multiplexer 1205 selects the initial analog data for data compression and acceleration.
  • the analog input multiplexer 1205 is operatively connected to an A/D converter 1210 that converts the analog input signal to digital data of the desired resolution.
  • the digitized data output of the A/D converter 1210 is stored in an analog data memory buffer 1215 for subsequent data storage acceleration.
  • a parallel digital data input multiplexer 1220 selects the initial parallel digital data for data compression and acceleration.
  • the parallel digital data input multiplexer 1220 is operatively connected to an input data latch 1225 that holds the input parallel digital data.
  • the parallel digital data is then stored in digital data memory buffer 1245 for subsequent data storage acceleration.
  • a serial digital data input multiplexer 1235 selects the initial serial digital data for data compression and acceleration.
  • the serial digital data input multiplexer 1235 is operatively connected to a serial data interface 1240 that converts the serial data stream to a format useful for data acceleration.
  • serial data memory buffer 1245 for subsequent data acceleration.
  • the analog data memory 1215 , parallel digital data memory 1230 , and serial data memory 1245 are operatively connected to the data storage accelerator device 10 . Data is selected from each data memory subsystem based upon a user defined algorithm or other selection criteria. It should be noted that the analog input multiplexer 1205 , A/D converter 1210 , analog data memory 1215 , parallel data input multiplexer 1220 , data latch 1225 , digital data memory 1230 , serial data input multiplexer 1235 , serial data interface 1240 , serial data memory 1245 , and counter 20 are not required elements of the present invention.
  • the data storage accelerator 10 employs any of the data compression methods disclosed in the above-incorporated U.S. Ser. No. 09/210,491, or any conventional lossless or lossy data compression method suitable for compressing data at a rate necessary for obtaining accelerated data storage.
  • the data storage accelerator supplies accelerated data to the output data stream for subsequent data processing, storage, or transmittal.
  • FIG. 13 a flow diagram illustrates a method for accelerated data storage of analog, digital, and serial data according to one aspect of the present invention.
  • the analog input multiplexer selects the initial analog data for data compression and acceleration (step 1300 ).
  • the analog input multiplexer provides analog data to the A/D converter that converts the analog input signal to digital data of the desired resolution (step 1302 ).
  • the digitized data output of the A/D converter is then buffered in the analog data memory buffer (step 1304 ) for subsequent data acceleration.
  • the parallel digital data multiplexer selects the initial parallel digital data for data compression and acceleration (step 1306 ).
  • the parallel digital data multiplexer provides data to the input data latch that then holds the input parallel digital data (step 1308 ).
  • the parallel digital data is then stored in digital data memory buffer for subsequent data acceleration (step 1310 ).
  • the serial digital data input multiplexer selects the initial serial digital data for lossless or lossy data compression and acceleration (step 1312 ).
  • the serial digital data input multiplexer provides serial data to the serial data interface that converts the serial data stream to a format useful for data acceleration (step 1314 ).
  • the formatted serial digital data is then stored in the serial data memory buffer for subsequent data acceleration (step 1316 ).
  • a test or other check is performed to see if new analog data is available (step 1318 ). If no new analog data is available a second check is performed to see if new parallel data is available (step 1320 ).
  • a third test is performed to see if new serial data is available (step 1322 ). If no new serial data is available (step 1322 ) the test sequence repeats with the test for new analog data (step 1318 ). If new analog data block is available (step 1318 ), or if new parallel data block is available (step 1320 ), or if new serial data block is available (step 1322 ), the input data block is compressed by the data storage accelerator (step 1324 ) utilizing any lossless or lossy compression method suitable for providing accelerated data storage in accordance with the teachings herein. After data compression is complete, the compressed data block is then output subsequent accelerated data processing, storage, or transmittal (step 1326 ). After outputting data the process repeats beginning with a test for new analog data (return to step 1318 ).
  • a data retrieval accelerator 80 receives data from an input data stream. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • the data retrieval accelerator 80 decompresses the input data utilizing any of the lossless or lossy decompression methods suitable for providing accelerated data retrieval in accordance with the teachings herein.
  • the data retrieval accelerator 80 is operatively connected to analog data memory 1405 , digital data memory 1420 , and serial data memory 1435 . Dependent upon the type of input data block, the decoded data block is stored in the appropriate analog 1405 , digital 1420 , or serial 1435 data memory.
  • the analog data memory 1405 is operatively connected to a D/A converter 1410 that converts the decompressed digital data block into an analog signal.
  • the D/A converter 1410 is further operatively connected to an analog hold and output driver 1415 .
  • the analog hold and output driver 1415 demultiplexes the analog signal output from the D/A converter 1410 , samples and holds the analog data, and buffers the output analog data.
  • the digital data memory 1420 is operatively connected to a digital data demultiplexer 1425 that routes the decompressed parallel digital data to the output data latch and driver 1430 .
  • the output latch and driver 1430 holds the digital data and buffers the parallel digital output.
  • serial data memory 1435 is operatively connected to a serial data interface 1440 that converts the decompressed data block to an output serial data stream.
  • the serial data interface 1440 is further operatively connected to the serial demultiplexer and driver 1445 that routes the serial digital data to the appropriate output and buffers the serial data output.
  • FIGS. 15 a and 15 b a flow diagram illustrates a method for accelerated retrieval of analog, digital, and serial data according to one aspect of the present invention.
  • An initial data block is received (step 1500 ) and then decompressed by the data storage retrieval accelerator (step 1502 ) utilizing lossless or lossy data decompression (as discussed above, for example, with reference to FIGS. 7 a and 7 b ).
  • a test or other check is performed to see if the data block is digitized analog data (step 1508 ). If the data block is not digitized analog data, a second check is performed to see if the data block is parallel digital data (step 1510 ). If the data block is not parallel digital data, a third test is performed to see if the data block serial data (step 1512 ). The result of at least one of the three tests will be affirmative.
  • the decoded data block is buffered in an “analog” digital data memory (step 1514 ).
  • the decoded data block is then converted to an analog signal by a D/A converter (step 1520 ).
  • the analog signal is then output (siep 1522 ).
  • the decoded data block is buffered in a “parallel” digital data memory (step 1516 ).
  • the decoded data block is then demultiplexed (step 1524 ) and routed to the appropriate the output data latch and driver.
  • the output latch and driver then holds the digital data and buffers the parallel digital output (step 1526 ).
  • the decoded data block is buffered in “serial” digital data memory (step 1518 ).
  • the decoded data is then formatted to a serial data format (step 1528 ).
  • the serial data is then demultiplexed, routed to the appropriate output, and output to a buffer (step 1530 ).
  • step 1522 Upon output of analog data (step 1522 ), parallel digital data (step 1526 ), or serial digital data (step 1530 ), a test or other form of check is performed for more data blocks in the input stream (step 1532 ). If no more data blocks are available, the test repeats (return to step 1532 ). If a data block is available, the next data block is received (step 1534 ) and the process repeats beginning with step 1502 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

Systems and methods for providing accelerated data storage and retrieval utilizing lossless and/or lossy data compression and decompression. A data storage accelerator includes one or a plurality of high speed data compression encoders that are configured to simultaneously or sequentially losslessly or lossy compress data at a rate equivalent to or faster than the transmission rate of an input data stream. The compressed data is subsequently stored in a target memory or other storage device whose input data storage bandwidth is lower than the original input data stream bandwidth. Similarly, a data retrieval accelerator includes one or a plurality of high speed data decompression decoders that are configured to simultaneously or sequentially losslessly or lossy decompress data at a rate equivalent to or faster than the input data stream from the target memory or storage device. The decompressed data is then output at rate data that is greater than the output rate from the target memory or data storage device. The data storage and retrieval accelerator method and system may employed: in a disk storage adapter to reduce the time required to store and retrieve data from computer to disk; in conjunction with random access memory to reduce the time required to store and retrieve data from random access memory; in a display controller to reduce the time required to send display data to the display controller or processor; and/or in an input/output controller to reduce the time required to store, retrieve, or transmit data.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application is a Continuation-in-Part of U.S. application Ser. No. 09/266,394 filed on Mar. 11, 1999.[0001]
    • BACKGROUND
  • 1. Technical Field [0002]
  • The present invention relates generally to data storage and retrieval and, more particularly to systems and methods for improving data storage and retrieval bandwidth utilizing lossless and/or lossy data compression and decompression. [0003]
  • 2. Description of the Related Art [0004]
  • Information may be represented in a variety of manners. Discrete information such as text and numbers are easily represented in digital data. This type of data representation is known as symbolic digital data. Symbolic digital data is thus an absolute representation of data such as a letter, figure, character, mark, machine code, or drawing. [0005]
  • Continuous information such as speech, music, audio, images and video frequently exists in the natural world as analog information. As is well-known to those skilled in the art, recent advances in very large scale integration (VLSI) digital computer technology have enabled. both discrete and analog information to be represented with digital data. Continuous information represented as digital data is often referred to as diffuse data. Diffuse digital data is thus a representation of data that is of low information density and is typically not easily recognizable to humans in its native form. [0006]
  • There are many advantages associated with digital data representation. For instance, digital data is more readily processed, stored, and transmitted due to its inherently high noise immunity. In addition, the inclusion of redundancy in digital data representation enables error detection and/or correction. Error detection and/or correction capabilities are dependent upon the amount and type of data redundancy, available error detection and correction processing, and extent of data corruption. [0007]
  • One outcome of digital data representation is the continuing need for increased capacity in data processing, storage, and transmittal. This is especially true for diffuse data where increases in fidelity and resolution create exponentially greater quantities of data. Data compression is widely used to reduce the amount of data required to process, transmit, or store a given quantity of information. In general, there are two types of data compression techniques that may be utilized either separately or jointly to encode/decode data: lossy and lossless data compression. [0008]
  • Lossy data compression techniques provide for an inexact representation of the original uncompressed data such that the decoded (or reconstructed) data differs from the original unencoded/uncompressed data. Lossy data compression is also known as irreversible or noisy compression. Negentropy is defined as the quantity of information in a given set of data. Thus, one obvious advantage of lossy data compression is that the compression ratios can be larger than that dictated by the negentropy limit, all at the expense of information content. Many lossy data compression techniques seek to exploit various traits within the human senses to eliminate otherwise imperceptible data. For example, lossy data compression of visual imagery might seek to delete information content in excess of the display resolution or contrast ratio of the target display device. [0009]
  • On the other hand, lossless data compression techniques provide an exact representation of the original uncompressed data. Simply stated, the decoded (or reconstructed) data is identical to the original unencoded/uncompressed data. Lossless data compression is also known as reversible or noiseless compression. Thus, lossless data compression has, as its current limit, a minimum representation defined by the negentropy of a given data set. [0010]
  • It is well known within the current art that data compression provides several unique benefits. First, data compression can reduce the time to transmit data by more efficiently utilizing low bandwidth data links. Second, data compression economizes on data storage and allows more information to be stored for a fixed memory size by representing information more efficiently. [0011]
  • One problem with the current art is that the bandwidth and storage capacity of existing memory storage devices severely limit the performance of consumer, entertainment, office, workstation, servers, and mainframe computers for all disk and memory intensive operations. For example, magnetic disk mass storage devices currently employed in a variety of home, business, and scientific computing applications suffer from significant seek-time access delays along with profound read/write data rate limitations. Currently the fastest available (10,000) rpm disk drives support only a 22 Megabyte per second data rate (MB/sec). This is in stark contrast to the modern Personal Computer's Peripheral Component Interconnect (PCI) Bus's input/output capability of 528 MB/sec and internal local bus capability of over 1,064 MB/sec. Substantially faster processor, internal local bus memory, and I/O bus bandwidths are expected in the near future. [0012]
  • Another problem within the current art is that emergent high performance disk interface standards such as the Small Computer Systems Interface (SCSI-3) and Fibre Channel offer only the promise of higher data transfer rates through intermediate data buffering in random access memory. These interconnect strategies do not address the fundamental problem that all modern magnetic disk storage devices for the personal computer marketplace are still limited by the same physical media restriction of 22 MB/sec. Faster disk access data rates are only achieved by the high cost solution of simultaneously accessing multiple disk drives with a technique known within the art as data striping. [0013]
  • Additional problems with bandwidth limitations similarly occur within the art by all other forms of sequential, pseudo-random, and random access mass storage devices. Typically mass storage devices include magnetic and optical tape, magnetic and optical disks, and various solid-state mass storage devices. It should be noted that the present invention applies to all forms and manners of memory devices including storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof. [0014]
    • SUMMARY OF THE INVENTION
  • The present invention is directed to systems and methods for providing accelerated data storage and retrieval by utilizing lossless and lossy data compression and decompression. The present invention provides an effective increase of the data storage and retrieval bandwidth of a memory storage device. In one aspect of the present invention, a method for providing accelerated data storage comprises the steps of receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device, compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device, and storing the compressed digital data stream in the target storage device. The step of compressing may be performed using lossless data compression, lossy data compression or a combination of lossless and lossy data compression. [0015]
  • In another aspect of the present invention, the compression process comprises the steps of reading a first parameter that is indicative of a compression type to be applied to the input digital data stream, and selecting at least one allowable encoder based on the first parameter. [0016]
  • In yet another aspect, the compression process further comprises the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data compression is selected. [0017]
  • In another aspect of the present invention, a method for providing accelerated retrieval of stored data comprises the steps of retrieving a compressed digital data stream from a target storage device at a rate equal to a data access rate of the target storage device and decompressing the compressed data at a decompression rate that increases the effective data access rate of the target storage device. The step of compressing may be performed using lossless data compression, lossy data compression or a combination of lossless and lossy data compression. [0018]
  • In yet another aspect of the present invention, the decompression process comprises the steps of reading a first parameter that is indicative of a decompression type to be applied to the compressed digital data stream, and selecting at least one allowable decoder based on the first parameter. [0019]
  • In another aspect, the decompression process further comprises the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data decompression is selected. [0020]
  • In yet another aspect of the present invention, the method for providing accelerated data storage utilizes a compression ratio that is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input data stream at the input data transmission rate. Moreover, the method for providing accelerated data retrieval utilizes a decompression ratio which is equal to or greater than the ratio of the data access rate to a maximum accepted output data transmission rate so as to provide a continuous and optimal data output transmission rate. [0021]
  • In another aspect of the present invention, data storage and retrieval acceleration is employed in a disk storage adapter to reduce the time required to store and retrieve data from computer to a disk memory device. [0022]
  • In another aspect of the present invention, data storage and retrieval acceleration is employed in conjunction with random access memory to reduce the time required to store and retrieve data from random access memory. [0023]
  • In another aspect of the present invention, data storage and retrieval acceleration is employed in a video data storage system to reduce the time required to store digital video data. [0024]
  • In another aspect of the present invention, data storage and retrieval acceleration is employed in a display controller to reduce the time required to send display data to the display controller or processor. [0025]
  • In another aspect of the present invention, data storage and retrieval acceleration is employed in an input/output controller to reduce the time required to store, retrieve, or transmit data various forms of data. [0026]
  • The present invention is realized due to recent improvements in processing speed, inclusive of dedicated analog and digital hardware circuits, central processing units, digital signal processors, dedicated finite state machines (and any hybrid combinations thereof), that, coupled with advanced data compression and decompression algorithms, are enabling of ultra high bandwidth data compression and decompression methods that enable improved data storage and retrieval bandwidth.[0027]
  • These and other aspects, features and advantages, of the present invention will become apparent from the following detailed description of preferred embodiments, that is to be read in connection with the accompanying drawings. [0028]
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of a system for accelerated data storage and retrieval according to one embodiment of the present invention; [0029]
  • FIG. 2 is a flow diagram of a method for accelerated data storage in accordance with one aspect of the present invention; [0030]
  • FIG. 3 is a flow diagram of a method for accelerated data retrieval in accordance with one aspect of the present invention; [0031]
  • FIGS. 4[0032] a and 4 b are timing diagrams of methods for accelerated data storage according to the present invention;
  • FIGS. 5[0033] a and 5 b are timing diagrams of methods for accelerated data retrieval according to the present invention;
  • FIGS. 6[0034] a and 6 b comprise a flow diagram of a method for accelerated data storage in accordance with a further aspect of the present invention;
  • FIGS. 7[0035] a and 7 b comprise a flow diagram of a method for accelerated data retrieval in accordance with a further aspect of the present invention;
  • FIG. 8 is a detailed block diagram of a system for accelerated data storage according to a preferred embodiment of the present invention; [0036]
  • FIG. 9 is a detailed block diagram of a system for accelerated data retrieval according to a preferred embodiment of the present invention; [0037]
  • FIG. 10 is a block diagram of a system for accelerated video storage according to one embodiment of the present invention; [0038]
  • FIG. 11 is a block diagram of a system for accelerated retrieval of video data according to one embodiment of the present invention; [0039]
  • FIG. 12 is a block diagram of an input/output controller system for accelerated storage of analog, digital, and serial data according to one embodiment of the present invention; [0040]
  • FIG. 13 is a flow diagram of a method for accelerated storage of analog, digital, and serial data according to one aspect of the present invention; [0041]
  • FIG. 14 is a block diagram of an input/output system for accelerated retrieval of analog, digital, and serial data according to one embodiment of the present invention; and [0042]
  • FIGS. 15[0043] a and 15 b comprise a flow diagram of method for accelerated retrieval of analog, digital, and serial data according to one aspect of the present invention.
    • DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
  • The present invention is directed to systems and methods for providing improved data storage and retrieval bandwidth utilizing both lossless and lossy data compression and decompression. In the following description, it is to be understood that system elements having equivalent or similar functionality are designated with the same reference numerals in the Figures. It is to be further understood that the present invention may be implemented in various forms of digital and/or analog hardware, software, firmware, or a combination thereof. Preferably, the present invention is implemented on a computer platform including hardware such as one or more central processing units (CPU) or digital signal processors (DSP), a random access memory (RAM), and input/output (I/O) interface(s). The computer platform may also include an operating system, microinstruction code, and dedicated processing hardware utilizing combinatorial logic, finite state machines, analog signal processing. The various processes and functions described herein may be either part of the hardware, microinstruction code or application programs that are executed via the operating system, or any combination thereof. [0044]
  • It is to be further understood that, because some of the constituent system components described herein are preferably implemented as software modules, the actual system connections shown in the Figures may differ depending upon the manner in that the systems are programmed. It is to be appreciated that special purpose microprocessors, digital signal processors, analog signal processors, dedicated hardware, or and combination thereof may be employed to implement the present invention. Given the teachings herein, one of ordinary skill in the related art will be able to contemplate these and similar implementations or configurations of the present invention. [0045]
  • Referring now to FIG. 1, a block diagram illustrates a system for accelerated data storage and retrieval in accordance with an embodiment of the present invention. The system inlcudes a [0046] data storage accelerator 10 that is operatively coupled to a data storage device 45. The data storage accelerator operates to increase the effective data storage rate of the data storage device 45. It is to be appreciated that the data storage device 45 may be any form of memory device including all forms of sequential, pseudo-random, and random access storage devices. The memory storage device 45 may be volatile or non-volatile in nature, or any combination thereof. Storage devices as known within the current art include all forms of random access memory, magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices. Thus it should be noted that the current invention applies to all forms and manners of memory devices including, but not limited to, storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • The [0047] data storage accelerator 10 receives and processes data blocks from an input data stream. The data blocks may range in size from individual bits through complete files or collections of multiple files, and the data block size may be fixed or variable. In order to achieve continuous data storage acceleration, the data storage accelerator 10 must be configured to compress a given input data block utilizing lossless or lossy data compression at a rate that is equal to or faster than receipt of the input data. Thus, to achieve optimum throughput, the rate that data blocks from the input data stream may be accepted by the data storage accelerator 10 is a function of the size of each input data block, the compression ratio achieved, and the bandwidth of the target storage device. For example, if the data storage device 45 (e.g., a typical target mass storage device) is capable of storing 30 megabytes per second and the data storage accelerator 10 is capable of providing an average compression ratio of 3:1, then 90 megabytes per second may be accepted as input and the data storage acceleration is precisely 3:1, equivalent to the average compression ratio.
  • It should be noted that it is not a requirement of the present invention to configure the [0048] storage accelerator 10 to compress a given input data block at a rate that is equal to or faster than receipt of the input data. Indeed, if the storage accelerator 10 compresses data at a rate that is less than the input data rate, buffering may be applied to accept data from the input data stream for subsequent compression. Further, since data may be received in high-speed bursts, the present invention may increase the effective bandwidth of the data storage process without increasing the instantaneous bandwidth of the data storage device.
  • Additionally, it is not a requirement that the [0049] data storage accelerator 10 utilize data compression with a ratio that is at least the ratio of the input data stream to the data storage access rate of the data storage device 45. Indeed, if the compression ratio is less than this ratio, the input data stream may be periodically halted to effectively reduce the rate of the input data stream. Alternatively, the input data stream or the output of the data accelerator 10 may be buffered to temporarily accommodate the mismatch in data bandwidth. An additional alternative is to reduce the input data rate to rate that is equal to or slower than the ratio of the input data rate to the data storage device access rate by signaling the data input source and requesting a slower data input rate, if possible.
  • Referring again to FIG. 1, a [0050] data retrieval accelerator 80 is operatively connected to and receives data from the data storage device 45. The data retrieval accelerator 80 receives and processes compressed data from data storage device 45 in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable. The data retrieval accelerator 80 is configured to decompress each compressed data block which is received from the data storage device 45. In order to achieve continuous accelerated data retrieval, the data retrieval accelerator must decompress a given input data block at a rate that is equal to or faster than receipt of the input data.
  • In a manner analogous to the [0051] data storage accelerator 10, achieving optimum throughput with the data retrieval accelerator 80 is a function of the rate that compressed data blocks are retrieved from the data storage device 45, the size of each data block, the decompression ratio achieved, and the limitation on the bandwidth of the output data stream, if any. For example, if the data storage device 45 is capable of continuously supplying 30 megabytes per second and the data retrieval accelerator 80 is capable of providing an average decompression ratio of 1:3, then a 90 megabytes per second output data stream is achieved, and the corresponding data retrieval acceleration is precisely 1:3, equivalent to the average decompression ratio.
  • It is to be understood that it is not required that the [0052] data retrieval accelerator 80 utilize data decompression with a ratio that is at most equal to the ratio of the retrieval rate of the data storage device 45 to the maximum rate data output stream. Indeed, if the decompression ratio is greater than this ratio, retrieving data from the data storage device may be periodically halted to effectively reduce the rate of the output data stream to be at or below its maximum. Alternatively, the compressed data retrieved from the data storage device 45 or the output of the data decompressor may be buffered to temporarily accommodate the mismatch in data bandwidth. An additional alternative is to increase the output data rate by signaling or otherwise requesting the data output device(s) receiving the output data stream to accept a higher bandwidth, if possible.
  • Referring now to FIG. 2, a flow diagram of a method for accelerated data storage according to one aspect of the present invention illustrates the operation of the data storage acceleration shown in FIG. 1. As previously stated above, data compression is performed on a per data block basis. Accordingly, the initial input data block in the input data stream (step [0053] 200) is input into and compressed by the data storage accelerator 10 (step 202) utilizing lossless or lossy data compression, or any combination or permutation thereof. Upon completion of the encoding of the input data block, the encoded data block is then stored in the data storage device 45 (step 204). A check or other form of test is performed to see if there are additional data blocks available in the input stream (step 206). If no more data blocks are available, the storage acceleration process is terminated (step 208). If more data blocks are available in the input data stream, the next data block is received (step 210) and the process repeats beginning with data compression (step 202).
  • Referring now to FIG. 3, a flow diagram of a method for accelerated data retrieval according to one aspect of the present invention illustrates the operation of the [0054] data retrieval accelerator 80 shown in FIG. 1. Data decompression is also performed on a per data block basis. The initial compressed data block is retrieved from the storage device 45 (step 300) and is decompressed by the data retrieval accelerator 80 (step 302) utilizing lossless or lossy data decompression, or any combination or permutation thereof. Upon completion of the decoding of the initial data block, the decoded data block is then output for subsequent processing, storage, or transmittal (step 304). A check or other form of test is performed to see if additional data blocks available from the data storage device (step 306). If no more data blocks are available, the data retrieval acceleration process is terminated (step 308). If more data blocks are available from the data storage device, the next data block is retrieved (step 310) and the process repeats beginning with data decompression (step 302).
  • Referring now to FIGS. 4[0055] a and 4 b, a timing diagram illustrates methods for accelerated data storage utilizing data compression in accordance with the present invention. Successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 is received from an input stream of one or more data blocks. Similarly, data block 2 through data block n are received during time intervals T2 through Tn, respectively. For the purposes of discussion, FIGS. 4a and 4 b demonstrate one embodiment of the data storage utilizing a stream of n data blocks. As previously stated, the input data stream is comprised of one or more data blocks data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable.
  • In accordance with [0056] Method 1, lossless or lossy compression of data block 1 and subsequent storage of the encoded data block 1 occurs within time interval T1. Similarly, the compression and storage of each successive data block occurs within the time interval the data block is received. Specifically, data blocks 2 . . . n are compressed in time intervals T2 . . . Tn, respectively, and the corresponding encoded data blocks 2 . . . n are stored during the time intervals T2 . . . Tn, respectively. It is to be understood that Method 1 relies on data compression and encoding techniques that process data as a contiguous stream (i.e., not block oriented). It is well known within the current art that certain data compression techniques including, but not limited to, dictionary compression, run length encoding, null suppression and arithmetic compression are capable of encoding data when received. Additionally many lossy data techniques commonly applied to diffuse data also exhibit this same capability including, but not limited to adaptive differential pulse code modulation, linear predictive coding, linear prediction based analysis by synthesis coding, subband adaptive transformation and adaptive transform acoustic coding. It is to be appreciated that Method 1 possesses the advantage of introducing a minimum delay in the time from receipt of input to storage of encoded data blocks.
  • Referring again to FIGS. 4[0057] a and 4 b, Method 2 illustrates compressing and storing data utilizing pipelined data processing. For Method 2, successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 is received from an input stream of one or more data blocks during time interval T1. Similarly, data block 2 through data block n are received during time intervals T2 through Tn, respectively. Compression of data block 1 occurs during time interval T2 and the storage of encoded data block 1 occurs during time interval T3. As shown by Method 2, compression of each successive data block occurs within the next time interval after the data block is received and data storage of the corresponding encoded data block occur in the next time interval after completion of data compression.
  • The pipelining of [0058] Method 2, as shown, utilizes successive single time interval delays for lossless or lossy data compression and data storage. Within the current invention, it is permissible to have increased pipelining to facilitate additional data processing or storage delays. For example, data compression processing for a single input data block may utilize more than one time interval. Accommodating more than one time interval for data compression requires additional data compressors to process successive data blocks, e.g., data compression processing of a single data block through three successive time intervals requires three data compressors, each processing a successive input data block. Due to the principle of causality, encoded data blocks are output only after compression encoding.
  • [0059] Method 2 provides for block oriented processing of the input data blocks. Within the current art, block oriented data compression techniques provide the opportunity for increased data compression ratios. This includes various forms of dictionary compression, along with many compression techniques commonly applied to diffuse image data including current standards by the Joint Photographic Experts Group, the Motion Picture Experts Group, vector quantitization, wavelet coding, and fractal coding. Method 2 may provide increased delay from receipt of input data block to storage of encoded data. However, depending on factors such as the size of input data blocks, the rate that they are received, the time required for data compression processing, the data compression ratio achieved, the bandwidth of the data storage device, and the intended application, the delay may or may not be significant. For example, in a modern database system, recording data for archival purposes, the opportunity for increased data compression may far outweigh the need for minimum delay. Conversely, in systems such as a military real-time video targeting system, minimizing delay is often of the essence. It should be noted that Method 1 and Method 2 are not mutually exclusive, and may be utilized in any combination.
  • Referring now to FIGS. 5[0060] a and 5 b, a timing diagram illustrates methods for accelerated data retrieval utilizing data decompression in accordance the present invention shown. Successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 is retrieved or otherwise accepted as input from one or more compressed data blocks retrieved from a data storage device. As shown, data block 2 through data block n are retrieved during time intervals T2 through Tn, respectively. For the purposes of discussion, FIGS. 5a and 5 b demonstrate one embodiment of the data retrieval accelerator utilizing a stream of n data blocks. Once again, the retrieved data stream is comprised of one or more data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the retrieved data block size may be fixed or variable.
  • In accordance with [0061] Method 1, lossless or lossy decompression of data block 1 and subsequent outputting of the decoded data block 1 occurs within time interval T1. Similarly, decompression and outputting of each successive data block occurs within the time intervals they are retrieved. In particular, data block 2 through data block n are decompressed and decoded data block 2 through decoded data block n are output during time intervals T2 . . . Tn, respectively. It is to be understood that Method 1 relies on data decompression and decoding techniques that process compressed data as a contiguous stream (i.e., not block oriented). It is well known within the current art that certain data decompression techniques including, but not limited to, dictionary compression, run length encoding, null suppression and arithmetic compression are capable of decoding data when received. Method 1 possesses the advantage of introducing a minimum delay in the time from retrieval of compressed data to output of decoded data blocks.
  • Referring again to FIGS. 5[0062] a and 5 b, Method 2 involves lossless or lossy decompression and output of data utilizing pipelined data processing. For Method 2, successive time intervals of equal duration are represented as T1 through T(n+2). Data block 1 through data block n are retrieved or otherwise accepted as input from a data storage device during time intervals T1 through Tn, respectively. Decompression of data block 1 occurs during time interval T2 and the decoded data block 1 is output during time interval T3. Similarly, decompression of each successive data block occurs within the next time interval after the data block is retrieved and the outputting of the decoded data block occurs during the next time interval after completion of data decompression.
  • The pipelining of [0063] Method 2, utilizes successive single time interval delays for data decompression and data output. Within the current invention, it is permissible to have increased pipelining to facilitate additional data retrieval or data decompression processing delays. For example, data decompression processing for a single input data block may utilize more than one time interval. Accommodating more than one time interval for data compression requires additional data decompressors to process successive compressed data blocks, e.g., data decompression processing of a single data block through three successive time intervals requires three data decompressors, each processing a successive input data block. Due to the principle of causality, decoded data blocks are only output after decompression decoding.
  • As before, [0064] Method 2 provides for block oriented processing of the retrieved data blocks. Within the current art, block oriented data decompression techniques provide the opportunity to utilize both lossless and lossy data compression encoders that increase data compression ratios. The disadvantage of method 2 is increased delay from retrieval of compressed data block to output of decompressed data. As previously discussed for data storage acceleration, depending on the size of retrieved data blocks, the rate that they are retrieved, the time required for data decompression processing, the data decompression ratio achieved, the bandwidth of the data output, and the intended application, the delay may or may not be significant.
  • Referring now to FIGS. 6[0065] a and 6 b, a flow diagram illustrates a method for accelerated data storage according to a further aspect of the present invention. With this method, the lossless or lossy data compression rate of the storage accelerator 10 is not required to be equal to or greater than the ratio of the input data rate to the data storage access rate. As previously stated above, data compression is performed on a per data block basis. Accordingly, the initial input data block in the input data stream is received (step 600) and then timed and counted (step 602). Timing and counting enables determination of the bandwidth of the input data stream. The input data block is then buffered (step 604).
  • Optionally, certain data parameters may be read (step [0066] 606) to determine whether the data may be compressed utilizing lossless or lossy techniques. If lossy techniques may be employed, additional parameters may also be included to indicate the amount of information loss that is permissible. Allowable encoders and associated parameters are then selected from the pool of available encoders (step 608). By way of example, in one embodiment, header information associated with a given data block or a series of data blocks may contain a binary flag that could be set to either logic “1” or logic “0” to indicate that the given data block or series of data blocks may be encoded using lossless or lossy data compression, respectively. In another embodiment, a multi-valued encoding parameter may be employed where all values true, for example a 16-bit value of FFFF (hexadecimal), signifies lossless encoding and where each value in the range from FFFE to 0000 denotes the amount of residual information content required. In a further embodiment, a list of encoding techniques may be added wherein each encoding techniques in the list is indexed and selected via using the above information content values. In yet a further embodiment, the values for the information content may possess different meanings dependent on system context. For example, an incoming video data stream may have an information value of 7FFF. This value may invoke a lossy encoder that scans a system parameter table which indicates video display or printer display resolution. With this information, the encoding algorithm can set the allowed information loss for the encoding process. It is to be understood that this technique may be applied to all forms of peripheral input and output devices.
  • The data is then compressed by the data storage accelerator [0067] 10 (step 610). During and after the encoding of the input data block, the encoded data block is then timed and counted (step 612), thus enabling determination of the compression ratio and compression bandwidth. The compressed, timed and counted data block is then buffered (step 614). The compression ratio and bandwidths of the input data stream and the encoder are then determined (step 616). The compressed data block is then stored in the data storage device 45 (step 618). Checks or other forms of testing are applied to ensure that the data bandwidths of the input data stream, data compressor, and data storage device are compatible (step 620). If the bandwidths are not compatible, then one or more system parameters may be modified to make the bandwidths compatible (step 622). For instance, the input bandwidth may be adjusted by either not accepting input data requests, lowering the duty cycle of input data requests, or by signaling one or more of the data sources that transmit the input data stream to request or mandate a lower data rate. In addition, the data compression ratio of the data storage accelerator 10 may be adjusted by applying a different type of encoding process such as employing lossless or lossy encoding, utilizing a single encoder, multiple parallel or sequential encoders, or any combination thereof to decrease encoding time, increase data compression ratio, or both. Furthermore, additional temporary buffering of either the input data stream or the compressed data stream (or both) may be utilized.
  • By way of example, assuming the input data rate is 90 MB/sec and the [0068] data storage accelerator 10 provides a compression ration of 3:1, then the output of the data storage accelerator 10 would be 30 MB/sec. If the maximum data storage rate of the data storage device 45 is 20 MB/sec (which is less than the data rate output from the data storage accelerator 10), data congestion and backup would occur at the output of the data storage accelerator 10. This problem may be solved by adjusting any one of the system parameters as discussed above, e.g., by adjusting the compression ratio to provide a data output rate from the data storage accelerator 10 to be equal to the data storage rate of the data storage device 45.
  • On the other hand, if the bandwidths are compatible (or made compatible by adjusting one or more of the system parameters), then a check or other form of test is performed to determine if there are additional data blocks available in the input stream (step [0069] 624). If no more data blocks are available, the storage acceleration process is terminated (step 626). If more data blocks are available in the input data stream, the next data block is received (step 628) and the process repeats beginning with timing and counting of the input data block (step 602).
  • Referring now to FIGS. 7[0070] a and 7 b, a flow diagram illustrates a method for accelerated data retrieval according to one aspect of the present invention. With this method, the data decompression ratio is not required to be less than or equal to the ratio of the data retrieval access rate to the maximum output data rate. As previously stated above, data decompression is performed on a per data block basis. Accordingly, the initial input data block is retrieved from the storage device (step 700) and is timed and counted (step 702). Timing and counting enables determination of the bandwidth of data retrieval. The retrieved data block is then buffered (step 704). Optionally, encoded or encoded data parameters may be read (step 706) to select the allowable lossless or lossy decoders and associated data parameters (step 708) using, for example, the techniques discussed above for the encoding process (e.g., steps 606 and 608, FIG. 6a).
  • Encoded data is then decompressed by the data retrieval accelerator [0071] 80 (step 710). During and after the decoding of the input data block, the decoded data block is then timed and counted (step 712), thus enabling determination of the decompression ratio and decompression bandwidth. The decompressed, timed and counted data block is then buffered (step 714). The decompression ratio and bandwidths of the retrieved data and the decoder are then determined (step 716). The decompressed data block is then output (step 718). Checks or other forms of testing are applied to ensure that the data bandwidths of the retrieved data, data decompressor, and data output are compatible (step 720). If the bandwidths are not compatible, then one or more system parameters may be modified to make the bandwidths compatible (step 722). For instance, the data retrieval bandwidth may be adjusted either not accepting (continuously) data blocks retrieved from the data storage device or lowering the duty cycle of data blocks retrieved from the data storage device. In addition, one or more of the output data devices that receive the output data stream may be signaled or otherwise requested to accept a higher data rate. Moreover, a different type of decoding process may be applied to adjust the data decompression rate by applying, for example, lossless or lossy decoders, different decoding parameters, a single decoder, multiple parallel or sequential decoders, or any combination thereof. Also, additional temporary buffering of either the retrieved or output data or both may be utilized.
  • By way of example, assuming the [0072] data storage device 45 has a data retrieval rate of 20 MB/sec and the data retrieval accelerator 80 provides a 1:4 decompression ratio, then the output of the data retrieval accelerator 80 would be 80 MB/sec. If the maximum output data transmission rate that can be accepted from the data retrieval accelerator 80 is 60 MB/sec (which is lower than the data output data rate of 80 MB/sec of the data retrieval accelerator 80), data congestion and backup would occur at the output of the data retrieval accelerator 80. This problem may be solved by adjusting any one of the system parameters as discussed above, e.g., by adjusting the decompression ratio to provide a data output rate from the data storage accelerator 80 to be equal to the maximum accepted output data transmission rate.
  • On the other hand, if the bandwidths are compatible (or made compatible by adjusting one or more system parameters), then a check or other form of test is performed to see if there are additional data blocks available from the data storage device (step [0073] 724). If no more data blocks are available for output, the retrieval acceleration process is terminated (step 726). If more data blocks are available to be retrieved from the data storage device, the next data block is retrieved (step 728) and the process repeats beginning with timing and counting of the retrieved data block (return to step 702).
  • It is to be understood that any conventional compression/decompression system and method (which comply with the above mentioned constraints) may be employed in the [0074] data storage accelerator 10 and data retrieval accelerator 80 for providing accelerated data storage and retrieval in accordance with the present invention. Preferably, the present invention employs the data compression/decompression techniques disclosed in U.S. Ser. No. 09/210,491 entitled “Content Independent Data Compression Method and System,” filed on Dec. 11, 1998, which is commonly assigned and which is fully incorporated herein by reference. It is to be appreciated that the compression and decompression systems and methods disclosed in U.S. Ser. No. 09/210,491 are suitable for compressing and decompressing data at rates which provide accelerated data storage and retrieval.
  • Referring now to FIG. 8, a detailed block diagram illustrates a preferred system for accelerated data storage which employs a compression system as disclosed in the above-incorporated U.S. Ser. No. 09/210,491. In this embodiment, the [0075] data storage accelerator 10 accepts data blocks from an input data stream and stores the input data block in an input buffer or cache 15. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable. A counter 20 counts or otherwise enumerates the size of input data block in any convenient units including bits, bytes, words, double words. It should be noted that the input buffer 15 and counter 20 are not required elements of the present invention. The input data buffer 15 may be provided for buffering the input data stream in order to output an uncompressed data stream in the event that, as discussed in further detail below, every encoder fails to achieve a level of compression that exceeds an a priori specified minimum compression ratio threshold.
  • Data compression is performed by an [0076] encoder module 25 which may comprise a set of encoders E1, E2, E3 . . . En. The encoder set E1, E2, E3 . . . En may include any number “n” (where n may =1) of those lossless encoding techniques currently well known within the art such as run length, Huffman, Lempel-Ziv Dictionary Compression, arithmetic coding, data compaction, and data null suppression. It is to be understood that the encoding techniques are selected based upon their ability to effectively encode different types of input data. It is to be appreciated that a full complement of encoders are preferably selected to provide a broad coverage of existing and future data types.
  • The [0077] encoder module 25 successively receives as input each of the buffered input data blocks (or unbuffered input data blocks from the counter module 20). Data compression is performed by the encoder module 25 wherein each of the encoders E1 . . . En processes a given input data block and outputs a corresponding set of encoded data blocks. It is to be appreciated that the system affords a user the option to enable/disable any one or more of the encoders E1 . . . En prior to operation. As is understood by those skilled in the art, such feature allows the user to tailor the operation of the data compression system for specific applications. It is to be further appreciated that the encoding process may be performed either in parallel or sequentially. In particular, the encoders E1 through En of encoder module 25 may operate in parallel (i.e., simultaneously processing a given input data block by utilizing task multiplexing on a single central processor, via dedicated hardware, by executing on a plurality of processor or dedicated hardware systems, or any combination thereof). In addition, encoders E1 through En may operate sequentially on a given unbuffered or buffered input data block. This process is intended to eliminate the complexity and additional processing overhead associated with multiplexing concurrent encoding techniques on a single central processor and/or dedicated hardware, set of central processors and/or dedicated hardware, or any achievable combination. It is to be further appreciated that encoders of the identical type may be applied in parallel to enhance encoding speed. For instance, encoder E1 may comprise two parallel Huffman encoders for parallel processing of an input data block.
  • A buffer/[0078] counter module 30 is operatively connected to the encoder module 25 for buffering and counting the size of each of the encoded data blocks output from encoder module 25. Specifically, the buffer/counter 30 comprises a plurality of buffer/counters BC1, BC2, BC3 . . . BCn, each operatively associated with a corresponding one of the encoders E1 . . . En. A compression ratio module 35, operatively connected to the output buffer/counter 30, determines the compression ratio obtained for each of the enabled encoders E1 . . . En by taking the ratio of the size of the input data block to the size of the output data block stored in the corresponding buffer/counters BC1 . . . BCn. In addition, the compression ratio module 35 compares each compression ratio with an a priori-specified compression ratio threshold limit to determine if at least one of the encoded data blocks output from the enabled encoders E1 . . . En achieves a compression that exceeds an a priori-specified threshold. As is understood by those skilled in the art, the threshold limit may be specified as any value inclusive of data expansion, no data compression or expansion, or any arbitrarily desired compression limit. A description module 38, operatively coupled to the compression ratio module 35, appends a corresponding compression type descriptor to each encoded data block which is selected for output so as to indicate the type of compression format of the encoded data block. A data compression type descriptor is defined as any recognizable data token or descriptor that indicates which data encoding technique has been applied to the data. It is to be understood that, since encoders of the identical type may be applied in parallel to enhance encoding speed (as discussed above), the data compression type descriptor identifies the corresponding encoding technique applied to the encoded data block, not necessarily the specific encoder. The encoded data block having the greatest compression ratio along with its corresponding data compression type descriptor is then output for subsequent data processing, storage, or transmittal. If there are no encoded data blocks having a compression ratio that exceeds the compression ratio threshold limit, then the original unencoded input data block is selected for output and a null data compression type descriptor is appended thereto. A null data compression type descriptor is defined as any recognizable data token or descriptor that indicates no data encoding has been applied to the input data block. Accordingly, the unencoded input data block with its corresponding null data compression type descriptor is then output for subsequent data processing, storage, or transmittal.
  • The data [0079] storage acceleration device 10 is connected to a data storage device interface 40. The function of the data storage interface 40 is to facilitate the formatting and transfer of data to one or more data storage devices 45. The data storage interface may be any of the data interfaces known to those skilled in the art such as SCSI (Small Computer Systems Interface), Fibre Channel, “Firewire”, IEEE P1394, SSA (Serial Storage Architecture), IDE (Integrated Disk Electronics), and ATA/ATAPI interfaces. It should be noted that the storage device data interface 40 is not required for implementing the present invention. As before, the data storage device 45 may be any form of memory device including all forms of sequential, pseudo-random, and random access storage devices. The data storage device 45 may be volatile or non-volatile in nature, or any combination thereof. Storage devices as known within the current art include all forms of random access memory (RAM), magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices (e.g., ATA/ATAPI IDE disk). Thus it should be noted that the current invention applies to all forms and manners of memory devices including, but not limited to, storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof.
  • Again, it is to be understood that the embodiment of the data storage accelerator of FIG. 8 is exemplary of a preferred compression system which may be implemented in the present invention, and that other compression systems and methods known to those skilled in the art may be employed for providing accelerated data storage in accordance with the teachings herein. Indeed, in another embodiment of the compression system disclosed in the above-incorporated U.S. Ser. No. 09/210,491, a timer is included to measure the time elapsed during the encoding process against an a priori-specified time limit. When the time limit expires, only the data output from those encoders (in the encoder module [0080] 25) that have completed the present encoding cycle are compared to determine the encoded data with the highest compression ratio. The time limit ensures that the real-time or pseudo real-time nature of the data encoding is preserved. In addition, the results from each encoder in the encoder module 25 may be buffered to allow additional encoders to be sequentially applied to the output of the previous encoder, yielding a more optimal lossless data compression ratio. Such techniques are discussed in greater detail in the above-incorporated U.S. Ser. No. 09/210,491.
  • Referring now to FIG. 9, a detailed block diagram illustrates a preferred system for accelerated data retrieval employing a decompression system as disclosed in the above-incorporated U.S. Ser. No. 09/210,491. In this embodiment, the [0081] data retrieval accelerator 80 retrieves or otherwise accepts data blocks from one or more data storage devices 45 and inputs the data via a data storage interface 50. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable. As stated above, the memory storage device 45 may be volatile or non-volatile in nature, or any combination thereof. Storage devices as known within the current art include all forms of random access memory, magnetic and optical tape, magnetic and optical disks, along with various other forms of solid-state mass storage devices. Thus it should be noted that the current invention applies to all forms and manners of memory devices including storage devices utilizing magnetic, optical, and chemical techniques, or any combination thereof. The data storage device interface 50 converts the input data from the storage device format to a format useful for data decompression.
  • The storage [0082] device data interface 50 is operatively connected to the data retrieval accelerator 80 which is utilized for decoding the stored (compressed) data, thus providing accelerated retrieval of stored data. In this embodiment, the data retrieval accelerator 80 comprises an input buffer 55 which receives as input an uncompressed or compressed data stream comprising one or more data blocks. The data blocks may range in size from individual bits through complete files or collections of multiple files. Additionally, the data block size may be fixed or variable. The input data buffer 55 is preferably included (not required) to provide storage of input data for various hardware implementations. A descriptor extraction module 60 receives the buffered (or unbuffered) input data block and then parses, lexically, syntactically, or otherwise analyzes the input data block using methods known by those skilled in the art to extract the data compression type descriptor associated with the data block. The data compression type descriptor may possess values corresponding to null (no encoding applied), a single applied encoding technique, or multiple encoding techniques applied in a specific or random order (in accordance with the data compression system embodiments and methods discussed above).
  • A [0083] decoder module 65 includes one or more decoders D1 . . . Dn for decoding the input data block using a decoder, set of decoders, or a sequential set of decoders corresponding to the extracted compression type descriptor. The decoders D1 . . . Dn may include those lossless encoding techniques currently well known within the art, including: run length, Huffman, Lempel-Ziv Dictionary Compression, arithmetic coding, data compaction, and data null suppression. Decoding techniques are selected based upon their ability to effectively decode the various different types of encoded input data generated by the data compression systems described above or originating from any other desired source.
  • As with the data compression systems discussed in U.S. application Ser. No. 09/210,491, the [0084] decoder module 65 may include multiple decoders of the same type applied in parallel so as to reduce the data decoding time. The data retrieval accelerator 80 also includes an output data buffer or cache 70 for buffering the decoded data block output from the decoder module 65. The output buffer 70 then provides data to the output data stream. It is to be appreciated by those skilled in the art that the data retrieval accelerator 80 may also include an input data counter and output data counter operatively coupled to the input and output, respectively, of the decoder module 65. In this manner, the compressed and corresponding decompressed data block may be counted to ensure that sufficient decompression is obtained for the input data block.
  • Again, it is to be understood that the embodiment of the [0085] data retrieval accelerator 80 of FIG. 9 is exemplary of a preferred decompression system and method which may be implemented in the present invention, and that other data decompression systems and methods known to those skilled in the art may be employed for providing accelerated data retrieval in accordance with the teachings herein.
  • In accordance with another aspect of the present invention, the data storage and retrieval accelerator system and method may be employed in for increasing the storage rate of video data. In particular, referring now to FIG. 10, a block diagram illustrates a system for providing accelerated video data storage in accordance with one embodiment of the present invention. The video data storage acceleration system accepts as input one or more video data streams that are analog, digital, or any combination thereof in nature. The [0086] input multiplexer 1010 selects the initial video data stream for data compression and acceleration. The input multiplexer 1010 is operatively connected to an A/D converter 1020 which converts analog video inputs to digital format of desired resolution. The A/D converter 1020 may also include functions to strip video data synchronization to perform other data formatting functions. It should be noted that the analog-to-digital conversion process is not required for digital video inputs. The A/D converter 1020 is operatively connected a video memory 1030 that is, in turn, operatively connected to a video processor 1040. The video processor 1040 performs manipulation of the digital video data in accordance with any user desired processing functions. The video processor 1040 is operatively coupled to a video output memory 1050, that is operatively connected to a data storage accelerator 10 which compresses the video data to provide accelerated video data to the output data stream for subsequent data processing, storage, or transmittal of the video data. This video data acceleration process is repeated for all data blocks in the input data stream. If more video data blocks are available in the input data stream, the video multiplexer selects the next block of video for accelerated processing. Again, it is to be understood that the data storage accelerator 10 may employ any lossless or lossy data compression system which is capable of compressing data at a rate suitable for providing accelerated video data storage in accordance with the teachings herein.
  • In accordance with another aspect of the present invention, the accelerated data storage and retrieval system may be employed in a display controller to reduce the time required to send display data to a display controller or processor. In particular, referring now to FIG. 11, a block diagram illustrates a display accelerator system in accordance with one embodiment of the present invention. The video display accelerator accepts as input one or more digital display data blocks from an input display data stream. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input video data block size may be fixed or variable. The input data blocks are processed by a [0087] data retrieval accelerator 80 which employs lossless or lossy data decompression system in accordance with the teachings herein. Upon completion of data decompression, the decompressed data block is then output to a display memory 1110 that provides data to a display processor 1120. The display processor 1120 performs any user desired processing function. It is well known within the current art that display data is often provided in one or more symbolic formats such as Open Graphics Language (Open GL) or another display or image language. The display processor 1120 is operatively connected an output memory buffer 1130. The output memory 1130 supplies data to a display formatter 1140 that converts the data to a format compatible with the output display device or devices. Data from the display formatter 1140 is provided to the display driver 1150 that outputs data in appropriate format and drive signal levels to one or more display devices. It should be noted that the display memory 1110, display processor 1120, output memory 1130, display formatter 1140, and display driver 1150 are not required elements of the present invention.
  • In accordance with yet another aspect of the present invention, the data storage and retrieval accelerator system and method may be employed in an I/O controller to reduce the time for storing, retrieving or transmitting parallel data streams. In particular, referring now to FIG. 12, a block diagram illustrates a system for accelerated data storage of analog, digital, and serial data in accordance with one embodiment of the present invention. The [0088] data storage accelerator 10 is capable of accepting one or more simultaneous analog, parallel digital, and serial data inputs. An analog input multiplexer 1205 selects the initial analog data for data compression and acceleration. The analog input multiplexer 1205 is operatively connected to an A/D converter 1210 that converts the analog input signal to digital data of the desired resolution. The digitized data output of the A/D converter 1210 is stored in an analog data memory buffer 1215 for subsequent data storage acceleration. Similarly, a parallel digital data input multiplexer 1220 selects the initial parallel digital data for data compression and acceleration. The parallel digital data input multiplexer 1220 is operatively connected to an input data latch 1225 that holds the input parallel digital data. The parallel digital data is then stored in digital data memory buffer 1245 for subsequent data storage acceleration. In addition, a serial digital data input multiplexer 1235 selects the initial serial digital data for data compression and acceleration. The serial digital data input multiplexer 1235 is operatively connected to a serial data interface 1240 that converts the serial data stream to a format useful for data acceleration. The formatted serial digital data is then stored in serial data memory buffer 1245 for subsequent data acceleration. The analog data memory 1215, parallel digital data memory 1230, and serial data memory 1245 are operatively connected to the data storage accelerator device 10. Data is selected from each data memory subsystem based upon a user defined algorithm or other selection criteria. It should be noted that the analog input multiplexer 1205, A/D converter 1210, analog data memory 1215, parallel data input multiplexer 1220, data latch 1225, digital data memory 1230, serial data input multiplexer 1235, serial data interface 1240, serial data memory 1245, and counter 20 are not required elements of the present invention. As stated above, the data storage accelerator 10 employs any of the data compression methods disclosed in the above-incorporated U.S. Ser. No. 09/210,491, or any conventional lossless or lossy data compression method suitable for compressing data at a rate necessary for obtaining accelerated data storage. The data storage accelerator supplies accelerated data to the output data stream for subsequent data processing, storage, or transmittal.
  • Referring now to FIG. 13, a flow diagram illustrates a method for accelerated data storage of analog, digital, and serial data according to one aspect of the present invention. The analog input multiplexer selects the initial analog data for data compression and acceleration (step [0089] 1300). The analog input multiplexer provides analog data to the A/D converter that converts the analog input signal to digital data of the desired resolution (step 1302). The digitized data output of the A/D converter is then buffered in the analog data memory buffer (step 1304) for subsequent data acceleration. Similarly, the parallel digital data multiplexer selects the initial parallel digital data for data compression and acceleration (step 1306). The parallel digital data multiplexer provides data to the input data latch that then holds the input parallel digital data (step 1308). The parallel digital data is then stored in digital data memory buffer for subsequent data acceleration (step 1310). The serial digital data input multiplexer selects the initial serial digital data for lossless or lossy data compression and acceleration (step 1312). The serial digital data input multiplexer provides serial data to the serial data interface that converts the serial data stream to a format useful for data acceleration (step 1314). The formatted serial digital data is then stored in the serial data memory buffer for subsequent data acceleration (step 1316). A test or other check is performed to see if new analog data is available (step 1318). If no new analog data is available a second check is performed to see if new parallel data is available (step 1320). If no new parallel data is available, a third test is performed to see if new serial data is available (step 1322). If no new serial data is available (step 1322) the test sequence repeats with the test for new analog data (step 1318). If new analog data block is available (step 1318), or if new parallel data block is available (step 1320), or if new serial data block is available (step 1322), the input data block is compressed by the data storage accelerator (step 1324) utilizing any lossless or lossy compression method suitable for providing accelerated data storage in accordance with the teachings herein. After data compression is complete, the compressed data block is then output subsequent accelerated data processing, storage, or transmittal (step 1326). After outputting data the process repeats beginning with a test for new analog data (return to step 1318).
  • Referring now to FIG. 14, a block diagram illustrates a system for accelerated retrieval of analog, digital, and serial data in accordance with one embodiment of the present invention. A [0090] data retrieval accelerator 80 receives data from an input data stream. It is to be understood that the system processes the input data stream in data blocks that may range in size from individual bits through complete files or collections of multiple files. Additionally, the input data block size may be fixed or variable. The data retrieval accelerator 80 decompresses the input data utilizing any of the lossless or lossy decompression methods suitable for providing accelerated data retrieval in accordance with the teachings herein. The data retrieval accelerator 80 is operatively connected to analog data memory 1405, digital data memory 1420, and serial data memory 1435. Dependent upon the type of input data block, the decoded data block is stored in the appropriate analog 1405, digital 1420, or serial 1435 data memory.
  • The [0091] analog data memory 1405 is operatively connected to a D/A converter 1410 that converts the decompressed digital data block into an analog signal. The D/A converter 1410 is further operatively connected to an analog hold and output driver 1415. The analog hold and output driver 1415 demultiplexes the analog signal output from the D/A converter 1410, samples and holds the analog data, and buffers the output analog data.
  • In a similar manner, the [0092] digital data memory 1420 is operatively connected to a digital data demultiplexer 1425 that routes the decompressed parallel digital data to the output data latch and driver 1430. The output latch and driver 1430 holds the digital data and buffers the parallel digital output.
  • Likewise, the [0093] serial data memory 1435 is operatively connected to a serial data interface 1440 that converts the decompressed data block to an output serial data stream. The serial data interface 1440 is further operatively connected to the serial demultiplexer and driver 1445 that routes the serial digital data to the appropriate output and buffers the serial data output.
  • Referring now to FIGS. 15[0094] a and 15 b, a flow diagram illustrates a method for accelerated retrieval of analog, digital, and serial data according to one aspect of the present invention. An initial data block is received (step 1500) and then decompressed by the data storage retrieval accelerator (step 1502) utilizing lossless or lossy data decompression (as discussed above, for example, with reference to FIGS. 7a and 7 b). Upon completion of data decompression, a test or other check is performed to see if the data block is digitized analog data (step 1508). If the data block is not digitized analog data, a second check is performed to see if the data block is parallel digital data (step 1510). If the data block is not parallel digital data, a third test is performed to see if the data block serial data (step 1512). The result of at least one of the three tests will be affirmative.
  • If the data block is comprised of digitized analog data, the decoded data block is buffered in an “analog” digital data memory (step [0095] 1514). The decoded data block is then converted to an analog signal by a D/A converter (step 1520). The analog signal is then output (siep 1522).
  • If the data block is comprised of parallel digital data, the decoded data block is buffered in a “parallel” digital data memory (step [0096] 1516). The decoded data block is then demultiplexed (step 1524) and routed to the appropriate the output data latch and driver. The output latch and driver then holds the digital data and buffers the parallel digital output (step 1526).
  • If the data block is comprised of serial data, the decoded data block is buffered in “serial” digital data memory (step [0097] 1518). The decoded data is then formatted to a serial data format (step 1528). The serial data is then demultiplexed, routed to the appropriate output, and output to a buffer (step 1530).
  • Upon output of analog data (step [0098] 1522), parallel digital data (step 1526), or serial digital data (step 1530), a test or other form of check is performed for more data blocks in the input stream (step 1532). If no more data blocks are available, the test repeats (return to step 1532). If a data block is available, the next data block is received (step 1534) and the process repeats beginning with step 1502.
  • Although illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the present invention is not limited to those precise embodiments, and that various other changes and modifications may be affected therein by one skilled in the art without departing from the scope or spirit of the invention. All such changes and modifications are intended to be included within the scope of the invention as defined by the appended claims. [0099]

Claims (30)

What is claimed is:
1. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for providing accelerated data storage, said method steps comprising:
receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device;
compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device; and
storing the compressed digital data stream in the target storage device.
2. The program storage device of claim 1, wherein the compression rate is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input digital data stream at the input data transmission rate.
3. The program storage device of claim 1, wherein the instructions for performing the step of compressing comprise instructions for performing lossy data compression.
4. The program storage device of claim 1, wherein the instructions for performing the step of compressing step comprise instructions for performing lossless and lossy data compression.
5. The program storage device of claim 1, wherein the instructions for performing the step of compressing comprise instructions for performing the steps of:
reading a first parameter that is indicative of a compression type to be applied to the input digital data stream; and
selecting at least one allowable encoder based on the first parameter.
6. The program storage device of claim 5, wherein the compression type is one of lossless data compression, lossy data compression, and a combination thereof.
7. The program storage device of claim 5, wherein the input digital data stream comprises a plurality of data blocks and wherein each data block has a first parameter associated therewith indicative of a compression type to be applied to the data block.
8. The program storage device of claim 5, further comprising instructions for performing the step of reading a second data parameter that is indicative of an amount of information loss that is permissible, if lossy data compression is selected.
9. The program storage device of claim 8, wherein the first and second data parameters are located within a header of the data block.
10. A program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for providing accelerated retrieval of stored data, said method steps comprising:
retrieving a compressed digital data stream from a target storage device at a rate equal to a data access rate of the target storage device; and
decompressing the compressed data at a decompression rate that increases the effective data access rate of the target storage device.
11. The program storage device of claim 10, wherein the instructions for performing the step of decompressing step comprise instructions for performing lossy data decompression.
12. The program storage device of claim 10, wherein the instructions for performing the step of decompressing comprise instructions for performing a combination of lossless and lossy data decompression.
13. The program storage device of claim 10, wherein the instructions for performing the step of decompressing comprise instructions for performing the steps of:
reading a first parameter that is indicative of a decompression type to be applied to the compressed digital data stream; and
selecting at least one allowable decoder based on the first parameter.
14. The program storage device of claim 13, wherein the decompression type is one of lossless and lossy data decompression.
15. The program storage device of claim 10, further comprising instructions for performing the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data decompression is selected.
16. A method for providing accelerated data storage, comprising the steps of:
receiving a digital data stream at an input data transmission rate which is greater than a data storage rate of a target storage device;
compressing the digital data stream at a compression rate that increases the effective data storage rate of the target storage device; and
storing the compressed digital data stream in the target storage device.
17. The method of claim 16, wherein the compression rate is at least equal to the ratio of the input data transmission rate to the data storage rate so as to provide continuous storage of the input digital data stream at the input data transmission rate.
18. The method of claim 16, wherein the step of compressing is performed using lossy data compression.
19. The method of claim 16, wherein the step of compressing is performed using lossless and lossy data compression.
20. The method of claim 16, wherein the step of compressing comprises the steps of:
reading a first parameter that is indicative of a compression type to be applied to the input digital data stream; and
selecting at least one allowable encoder based on the first parameter.
21. The method of claim 20, wherein the compression type is one of lossless data compression, lossy data compression, and a combination thereof.
22. The method of claim 20, wherein the input digital data stream comprises a plurality of data blocks and wherein each data block has a first parameter associated therewith indicative of a compression type to be applied to the data block.
23. The method of claim 20, further comprising the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data compression is selected.
24. The method of claim 23, wherein the first and second parameters are located within a header of the data block.
25. A method for providing accelerated retrieval of stored data, comprising the steps of:
retrieving a compressed digital data stream from a target storage device at a rate equal to a data access rate of the target storage device; and
decompressing the compressed data at a decompression rate that increases the effective data access rate of the target storage device.
26. The method of claim 25, wherein the step of decompressing is performed using lossy data decompression.
27. The method of claim 25, wherein the step of decompressing is performed using lossless and lossy data decompression.
28. The method of claim 25, wherein the step of decompressing comprises the steps of:
reading a first parameter that is indicative of a decompression type to be applied to the compressed digital data stream; and
selecting at least one allowable decoder based on the first parameter.
29. The method of claim 28, wherein the decompression type is one of lossless and lossy data decompression.
30. The method of claim 28, further comprising the step of reading a second parameter that is indicative of an amount of information loss that is permissible, if lossy data decompression is selected.
US10/628,801 1999-03-11 2003-07-28 System and methods for accelerated data storage and retrieval Abandoned US20040073710A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US10/628,801 US20040073710A1 (en) 1999-03-11 2003-07-28 System and methods for accelerated data storage and retrieval
US11/230,953 US20060015650A1 (en) 1999-03-11 2005-09-19 System and methods for accelerated data storage and retrieval
US11/400,322 US7395345B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US11/400,008 US8275897B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US12/690,125 US20100318684A1 (en) 1999-03-11 2010-01-20 System and methods for accelerated data storage and retrieval
US14/305,692 US20150113182A1 (en) 1999-03-11 2014-06-16 System and methods for accelerated data storage and retrieval

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/266,394 US6601104B1 (en) 1999-03-11 1999-03-11 System and methods for accelerated data storage and retrieval
US09/481,243 US6604158B1 (en) 1999-03-11 2000-01-11 System and methods for accelerated data storage and retrieval
US10/628,801 US20040073710A1 (en) 1999-03-11 2003-07-28 System and methods for accelerated data storage and retrieval

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/481,243 Continuation US6604158B1 (en) 1999-03-11 2000-01-11 System and methods for accelerated data storage and retrieval

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US11/230,953 Continuation US20060015650A1 (en) 1999-03-11 2005-09-19 System and methods for accelerated data storage and retrieval

Publications (1)

Publication Number Publication Date
US20040073710A1 true US20040073710A1 (en) 2004-04-15

Family

ID=32072870

Family Applications (7)

Application Number Title Priority Date Filing Date
US09/481,243 Expired - Lifetime US6604158B1 (en) 1999-03-11 2000-01-11 System and methods for accelerated data storage and retrieval
US10/628,801 Abandoned US20040073710A1 (en) 1999-03-11 2003-07-28 System and methods for accelerated data storage and retrieval
US11/230,953 Abandoned US20060015650A1 (en) 1999-03-11 2005-09-19 System and methods for accelerated data storage and retrieval
US11/400,008 Expired - Fee Related US8275897B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US11/400,322 Expired - Fee Related US7395345B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US12/690,125 Abandoned US20100318684A1 (en) 1999-03-11 2010-01-20 System and methods for accelerated data storage and retrieval
US14/305,692 Abandoned US20150113182A1 (en) 1999-03-11 2014-06-16 System and methods for accelerated data storage and retrieval

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/481,243 Expired - Lifetime US6604158B1 (en) 1999-03-11 2000-01-11 System and methods for accelerated data storage and retrieval

Family Applications After (5)

Application Number Title Priority Date Filing Date
US11/230,953 Abandoned US20060015650A1 (en) 1999-03-11 2005-09-19 System and methods for accelerated data storage and retrieval
US11/400,008 Expired - Fee Related US8275897B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US11/400,322 Expired - Fee Related US7395345B2 (en) 1999-03-11 2006-04-08 System and methods for accelerated data storage and retrieval
US12/690,125 Abandoned US20100318684A1 (en) 1999-03-11 2010-01-20 System and methods for accelerated data storage and retrieval
US14/305,692 Abandoned US20150113182A1 (en) 1999-03-11 2014-06-16 System and methods for accelerated data storage and retrieval

Country Status (1)

Country Link
US (7) US6604158B1 (en)

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030191876A1 (en) * 2000-02-03 2003-10-09 Fallon James J. Data storewidth accelerator
US20040042506A1 (en) * 2000-10-03 2004-03-04 Realtime Data, Llc System and method for data feed acceleration and encryption
US20060184696A1 (en) * 1999-03-11 2006-08-17 Fallon James J System and methods for accelerated data storage and retrieval
US20060262844A1 (en) * 2005-05-17 2006-11-23 Douglas Chin Input filtering in a video encoder
US20070043939A1 (en) * 2000-02-03 2007-02-22 Realtime Data Llc Systems and methods for accelerated loading of operating systems and application programs
US20070067483A1 (en) * 1999-03-11 2007-03-22 Realtime Data Llc System and methods for accelerated data storage and retrieval
US20070109156A1 (en) * 1998-12-11 2007-05-17 Fallon James J Data compression system and methods
US20080306977A1 (en) * 2007-06-06 2008-12-11 International Business Machines Corporation System, method and program product for backing up data
US20110271011A1 (en) * 2010-04-30 2011-11-03 Microsoft Corporation Efficient encoding of structured data
US8054879B2 (en) 2001-02-13 2011-11-08 Realtime Data Llc Bandwidth sensitive data compression and decompression
US20120158896A1 (en) * 2010-12-17 2012-06-21 Canon Kabushiki Kaisha Transmission apparatus and transmission method
US20120203746A1 (en) * 2005-07-26 2012-08-09 International Business Machines Corporation System and method for adaptively collecting performance and event information
US20130290615A1 (en) * 2010-10-22 2013-10-31 Indra Networks, Inc. Compression and decompression of data at high speed in solid state storage
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US9143546B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc System and method for data feed acceleration and encryption

Families Citing this family (79)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7139743B2 (en) 2000-04-07 2006-11-21 Washington University Associative database scanning and information retrieval using FPGA devices
DE10037004B4 (en) * 2000-07-29 2004-01-15 Sms Demag Ag Roll stand for belt edge-oriented shifting of the intermediate rolls in a 6-roll stand
DE10300545B4 (en) * 2003-01-09 2010-10-07 Siemens Ag Device, method, storage medium and data structure for the identification and storage of data
EP2511787B1 (en) 2003-05-23 2017-09-20 IP Reservoir, LLC Data decompression and search using FPGA devices
US10572824B2 (en) 2003-05-23 2020-02-25 Ip Reservoir, Llc System and method for low latency multi-functional pipeline with correlation logic and selectively activated/deactivated pipelined data processing engines
US7831491B2 (en) * 2003-11-05 2010-11-09 Chicago Mercantile Exchange Inc. Market data message format
US20050096999A1 (en) 2003-11-05 2005-05-05 Chicago Mercantile Exchange Trade engine processing of mass quote messages and resulting production of market data
US7394410B1 (en) 2004-02-13 2008-07-01 Samplify Systems, Inc. Enhanced data converters using compression and decompression
US7088276B1 (en) * 2004-02-13 2006-08-08 Samplify Systems Llc Enhanced data converters using compression and decompression
US7071852B1 (en) * 2004-02-13 2006-07-04 Samplify Systems Llc Enhanced test and measurement instruments using compression and decompression
US8327026B1 (en) * 2004-07-01 2012-12-04 Hewlett-Packard Development Company, L.P. Method and system for selecting a data compression technique for data transfer through a data network
US20070103421A1 (en) * 2004-11-05 2007-05-10 Nec Corporation Liquid-crystal display, projector system, portable terminal unit, and method of driving liquid-crystal display
US8423673B2 (en) * 2005-03-14 2013-04-16 Citrix Systems, Inc. Method and apparatus for updating a graphical display in a distributed processing environment using compression
US8521752B2 (en) * 2005-06-03 2013-08-27 Osr Open Systems Resources, Inc. Systems and methods for arbitrary data transformations
US8379841B2 (en) * 2006-03-23 2013-02-19 Exegy Incorporated Method and system for high throughput blockwise independent encryption/decryption
US7921046B2 (en) 2006-06-19 2011-04-05 Exegy Incorporated High speed processing of financial information using FPGA devices
US7840482B2 (en) 2006-06-19 2010-11-23 Exegy Incorporated Method and system for high speed options pricing
US7512748B1 (en) 2006-08-17 2009-03-31 Osr Open Systems Resources, Inc. Managing lock rankings
US8539228B1 (en) 2006-08-24 2013-09-17 Osr Open Systems Resources, Inc. Managing access to a resource
US8326819B2 (en) 2006-11-13 2012-12-04 Exegy Incorporated Method and system for high performance data metatagging and data indexing using coprocessors
US8630512B2 (en) * 2007-01-25 2014-01-14 Skyfire Labs, Inc. Dynamic client-server video tiling streaming
US8024433B2 (en) 2007-04-24 2011-09-20 Osr Open Systems Resources, Inc. Managing application resources
US7949693B1 (en) 2007-08-23 2011-05-24 Osr Open Systems Resources, Inc. Log-structured host data storage
WO2009029842A1 (en) 2007-08-31 2009-03-05 Exegy Incorporated Method and apparatus for hardware-accelerated encryption/decryption
US20090180248A1 (en) * 2008-01-10 2009-07-16 Karsten Roth Combination Drive
US10229453B2 (en) 2008-01-11 2019-03-12 Ip Reservoir, Llc Method and system for low latency basket calculation
ES2665750T3 (en) * 2008-10-06 2018-04-27 Shop Vac Corporation Vacuum cleaner set with entry through removable tank
CA3184014A1 (en) 2008-12-15 2010-07-08 Exegy Incorporated Method and apparatus for high-speed processing of financial market depth data
US20100318276A1 (en) * 2009-06-10 2010-12-16 Zhengbai Liu Control Strategy For A Diesel Engine During Lean-Rich Modulation
US8174414B2 (en) * 2010-04-13 2012-05-08 Research In Motion Limited Methods and devices for load balancing in parallel entropy coding and decoding
US8576100B2 (en) * 2010-07-14 2013-11-05 Certicom Corp. Parallel entropy encoder and parallel entropy decoder
US10037568B2 (en) 2010-12-09 2018-07-31 Ip Reservoir, Llc Method and apparatus for managing orders in financial markets
JP5712609B2 (en) * 2010-12-24 2015-05-07 富士通株式会社 Data processing apparatus and data recording method
CA2847360C (en) * 2011-08-30 2020-03-24 Allure Energy, Inc. Resource manager, system, and method for communicating resource management information for smart energy and media resources
US11184623B2 (en) 2011-09-26 2021-11-23 Texas Instruments Incorporated Method and system for lossless coding mode in video coding
US8903874B2 (en) 2011-11-03 2014-12-02 Osr Open Systems Resources, Inc. File system directory attribute correction
WO2013072765A2 (en) * 2011-11-18 2013-05-23 Dialogic Networks (Israel) Ltd. Method and apparatus for compressing communication packets
US9047243B2 (en) 2011-12-14 2015-06-02 Ip Reservoir, Llc Method and apparatus for low latency data distribution
US8788712B2 (en) 2012-01-06 2014-07-22 International Business Machines Corporation Compression block input/output reduction
US10650452B2 (en) 2012-03-27 2020-05-12 Ip Reservoir, Llc Offload processing of data packets
US9990393B2 (en) 2012-03-27 2018-06-05 Ip Reservoir, Llc Intelligent feed switch
US10121196B2 (en) 2012-03-27 2018-11-06 Ip Reservoir, Llc Offload processing of data packets containing financial market data
US11436672B2 (en) 2012-03-27 2022-09-06 Exegy Incorporated Intelligent switch for processing financial market data
US9374585B2 (en) * 2012-12-19 2016-06-21 Qualcomm Incorporated Low-delay buffering model in video coding
KR101978178B1 (en) * 2013-05-24 2019-05-15 삼성전자주식회사 Apparatus and method for processing ultrasonic data
US9274978B2 (en) 2013-06-10 2016-03-01 Western Digital Technologies, Inc. Migration of encrypted data for data storage systems
US9432338B2 (en) * 2013-10-23 2016-08-30 Google Inc. Secure communications using adaptive data compression
US9830329B2 (en) 2014-01-15 2017-11-28 W. Anthony Mason Methods and systems for data storage
US9503422B2 (en) 2014-05-09 2016-11-22 Saudi Arabian Oil Company Apparatus, systems, platforms, and methods for securing communication data exchanges between multiple networks for industrial and non-industrial applications
WO2015200760A1 (en) * 2014-06-26 2015-12-30 Sviral, Inc. Parllel decompressing of executables for accelerating the launch and performance.
US9300320B2 (en) * 2014-06-27 2016-03-29 Qualcomm Incorporated System and method for dictionary-based cache-line level code compression for on-chip memories using gradual bit removal
US9513913B2 (en) * 2014-07-22 2016-12-06 Intel Corporation SM4 acceleration processors, methods, systems, and instructions
US9467279B2 (en) 2014-09-26 2016-10-11 Intel Corporation Instructions and logic to provide SIMD SM4 cryptographic block cipher functionality
US20160173895A1 (en) * 2014-12-12 2016-06-16 Stmicroelectronics (Grenoble 2) Sas Method and device for storing and reading data, particularly video data, in storage blocks
US9385749B1 (en) 2015-03-06 2016-07-05 Oracle International Corporation Dynamic data compression selection
CN105204781B (en) * 2015-09-28 2019-04-12 华为技术有限公司 Compression method, device and equipment
US11288739B2 (en) 2015-10-12 2022-03-29 Chicago Mercantile Exchange Inc. Central limit order book automatic triangulation system
US11164248B2 (en) 2015-10-12 2021-11-02 Chicago Mercantile Exchange Inc. Multi-modal trade execution with smart order routing
US10346043B2 (en) 2015-12-28 2019-07-09 Pure Storage, Inc. Adaptive computing for data compression
US10013170B1 (en) * 2016-03-31 2018-07-03 EMC IP Holding Company LLC Intelligent data compression
US10897655B2 (en) * 2016-04-13 2021-01-19 Sony Corporation AV server and AV server system
US10972125B2 (en) * 2016-06-20 2021-04-06 Anacode Labs, Inc. Storage access interface to an encoded storage system
US11704682B2 (en) * 2016-07-06 2023-07-18 Chicago Mercantile Exchange Inc. Pre-processing financial market data prior to machine learning training
KR102566997B1 (en) * 2016-08-25 2023-08-14 삼성전자주식회사 Timing controller and display driving device comprising the same
US10133505B1 (en) * 2016-09-29 2018-11-20 EMC IP Holding Company LLC Cooperative host and data storage system services for compression and encryption
WO2018119035A1 (en) 2016-12-22 2018-06-28 Ip Reservoir, Llc Pipelines for hardware-accelerated machine learning
US10963295B2 (en) * 2017-09-08 2021-03-30 Oracle International Corporation Hardware accelerated data processing operations for storage data
US10585819B2 (en) 2018-03-05 2020-03-10 Samsung Electronics Co., Ltd. SSD architecture for FPGA based acceleration
KR102619954B1 (en) * 2018-03-29 2024-01-02 삼성전자주식회사 Method for processing data and electronic device for supporting the same
CN108520053B (en) * 2018-04-04 2020-03-31 东北大学 Big data query method based on data distribution
US11874782B1 (en) * 2018-07-20 2024-01-16 Robert Gezelter Fast mass storage access for digital computers
US10630312B1 (en) * 2019-01-31 2020-04-21 International Business Machines Corporation General-purpose processor instruction to perform compression/decompression operations
US10831497B2 (en) 2019-01-31 2020-11-10 International Business Machines Corporation Compression/decompression instruction specifying a history buffer to be used in the compression/decompression of data
US10944423B2 (en) 2019-03-14 2021-03-09 International Business Machines Corporation Verifying the correctness of a deflate compression accelerator
TWI695264B (en) * 2019-05-20 2020-06-01 慧榮科技股份有限公司 A data storage device and a data processing method
US20210127125A1 (en) * 2019-10-23 2021-04-29 Facebook Technologies, Llc Reducing size and power consumption for frame buffers using lossy compression
US11204713B1 (en) * 2020-05-28 2021-12-21 EMC IP Holding Company LLC Techniques for selection of a data reduction technique when performing data replication
US12093258B2 (en) 2020-12-14 2024-09-17 Samsung Electronics Co., Ltd. Storage device adapter to accelerate database temporary table processing
US12014047B2 (en) * 2022-08-24 2024-06-18 Red Hat, Inc. Stream based compressibility with auto-feedback

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4593324A (en) * 1981-04-14 1986-06-03 Fuji Xerox Co., Ltd. Image data storing device
US5604824A (en) * 1994-09-22 1997-02-18 Houston Advanced Research Center Method and apparatus for compression and decompression of documents and the like using splines and spline-wavelets
US5612788A (en) * 1993-07-30 1997-03-18 Sony Corporation Video data compression apparatus for recording and reproducing compressed video data at their various compressed data rates
US5819215A (en) * 1995-10-13 1998-10-06 Dobson; Kurt Method and apparatus for wavelet based data compression having adaptive bit rate control for compression of digital audio or other sensory data
US5832126A (en) * 1995-07-07 1998-11-03 Oki Data Corporation Method and apparatus for compressing mixed text and image data
US6590609B1 (en) * 1997-02-21 2003-07-08 Hitachi, Ltd. Image signal recording system
US20030142874A1 (en) * 1994-09-21 2003-07-31 Schwartz Edward L. Context generation

Family Cites Families (484)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US622886A (en) * 1899-04-11 Grinding-wheel
US3490690A (en) 1964-10-26 1970-01-20 Ibm Data reduction system
US3394352A (en) 1965-07-22 1968-07-23 Electronic Image Systems Corp Method of and apparatus for code communication
US4021782A (en) 1974-01-07 1977-05-03 Hoerning John S Data compaction system and apparatus
US4032893A (en) 1976-01-23 1977-06-28 Sperry Rand Corporation Reconfigurable data bus
US4054951A (en) 1976-06-30 1977-10-18 International Business Machines Corporation Data expansion apparatus
US4127518A (en) 1977-06-16 1978-11-28 Coy David Howard Novel derivatives of gamma-endorphins, intermediates therefor, and compositions and methods employing said derivatives
US4394774A (en) 1978-12-15 1983-07-19 Compression Labs, Inc. Digital video compression system and methods utilizing scene adaptive coding with rate buffer feedback
US4302775A (en) 1978-12-15 1981-11-24 Compression Labs, Inc. Digital video compression system and methods utilizing scene adaptive coding with rate buffer feedback
EP0164677B1 (en) 1980-02-04 1989-10-18 Texas Instruments Incorporated Speech synthesis system
US4360840A (en) 1980-05-13 1982-11-23 Am International, Inc. Real time data compression/decompression scheme for facsimile transmission system
US4386416A (en) 1980-06-02 1983-05-31 Mostek Corporation Data compression, encryption, and in-line transmission system
US4325085A (en) 1980-06-09 1982-04-13 Digital Communications Corporation Method and apparatus for adaptive facsimile compression using a two dimensional maximum likelihood predictor
US4464650A (en) 1981-08-10 1984-08-07 Sperry Corporation Apparatus and method for compressing data signals and restoring the compressed data signals
US4494108A (en) 1981-11-09 1985-01-15 International Business Machines Corporation Adaptive source modeling for data file compression within bounded memory
US4499499A (en) 1982-12-29 1985-02-12 International Business Machines Corporation Method for identification and compression of facsimile symbols in text processing systems
US4574351A (en) 1983-03-03 1986-03-04 International Business Machines Corporation Apparatus for compressing and buffering data
US4814746A (en) 1983-06-01 1989-03-21 International Business Machines Corporation Data compression method
US5045848A (en) 1984-04-10 1991-09-03 Fnn Method of encoding market data and transmitting by radio to a plurality of receivers
JPS60256860A (en) 1984-06-01 1985-12-18 Hitachi Ltd Logical integration circuit
GB8416496D0 (en) 1984-06-28 1984-08-01 King R A Encoding method
US4956808A (en) 1985-01-07 1990-09-11 International Business Machines Corporation Real time data transformation and transmission overlapping device
US5128963A (en) 1985-01-31 1992-07-07 Sony Corporation 3-mode PCM/DPCM/APCM maximizing dynamic range
GB2172127B (en) 1985-03-06 1988-10-12 Ferranti Plc Data compression system
US4646061A (en) 1985-03-13 1987-02-24 Racal Data Communications Inc. Data communication with modified Huffman coding
US4626829A (en) 1985-08-19 1986-12-02 Intelligent Storage Inc. Data compression using run length encoding and statistical encoding
US4748638A (en) 1985-10-30 1988-05-31 Microcom, Inc. Data telecommunications system and method for transmitting compressed data
US5027376A (en) 1985-10-30 1991-06-25 Microcom Systems, Inc. Data telecommunications system and method for transmitting compressed data
US4682150A (en) 1985-12-09 1987-07-21 Ncr Corporation Data compression method and apparatus
US4745559A (en) 1985-12-27 1988-05-17 Reuters Limited Method and system for dynamically controlling the content of a local receiver data base from a transmitted data base in an information retrieval communication network
US4750135A (en) 1986-05-01 1988-06-07 Reuters Limited Method for dynamically creating a receiver definable local trading instrument displayable record from a remotely transmitted trading instrument common data stream
US5247646A (en) 1986-05-15 1993-09-21 Aquidneck Systems International, Inc. Compressed data optical disk storage system
US4730348A (en) * 1986-09-19 1988-03-08 Adaptive Computer Technologies Adaptive data compression system
US4813040A (en) 1986-10-31 1989-03-14 Futato Steven P Method and apparatus for transmitting digital data and real-time digitalized voice information over a communications channel
US4906995A (en) * 1986-12-12 1990-03-06 Sangamo Weston, Inc. Data compression apparatus and method for data recorder
JPH0815263B2 (en) 1986-12-12 1996-02-14 株式会社日立製作所 Data compression / decompression method
US4862167A (en) 1987-02-24 1989-08-29 Hayes Microcomputer Products, Inc. Adaptive data compression method and apparatus
JPS63250277A (en) 1987-03-20 1988-10-18 インターナシヨナル・ビジネス・マシーンズ・コーポレーシヨン Status input generator
US4965675A (en) 1987-05-15 1990-10-23 Canon Kabushiki Kaisha Method and apparatus for after-recording sound on a medium having pre-recorded video thereon
US4729020A (en) 1987-06-01 1988-03-01 Delta Information Systems System for formatting digital signals to be transmitted
DE3776157D1 (en) * 1987-06-04 1992-02-27 Walter Lukosz OPTICAL MODULATION AND MEASURING PROCESS.
US4866601A (en) 1987-09-24 1989-09-12 Ncr Corporation Digital data bus architecture for computer disk drive controller
US5079630A (en) 1987-10-05 1992-01-07 Intel Corporation Adaptive video compression system
US4876541A (en) 1987-10-15 1989-10-24 Data Compression Corporation Stem for dynamically compressing and decompressing electronic data
US4870415A (en) 1987-10-19 1989-09-26 Hewlett-Packard Company Data compression system with expansion protection
US4804959A (en) 1987-11-10 1989-02-14 International Business Machines Corporation Method and apparatus using multiple codes to increase storage capacity
US4888812A (en) 1987-12-18 1989-12-19 International Business Machines Corporation Document image processing system
US4890282A (en) 1988-03-08 1989-12-26 Network Equipment Technologies, Inc. Mixed mode compression for data transmission
US4897717A (en) 1988-03-30 1990-01-30 Starsignal, Inc. Computer-based video compression system
US4906991A (en) 1988-04-29 1990-03-06 Xerox Corporation Textual substitution data compression with finite length search windows
US5046027A (en) 1988-11-08 1991-09-03 Massachusetts General Hospital Apparatus and method for processing and displaying images in a digital procesor based system
US5179651A (en) 1988-11-08 1993-01-12 Massachusetts General Hospital Apparatus for retrieval and processing of selected archived images for display at workstation terminals
US5187793A (en) * 1989-01-09 1993-02-16 Intel Corporation Processor with hierarchal memory and using meta-instructions for software control of loading, unloading and execution of machine instructions stored in the cache
US5003307A (en) 1989-01-13 1991-03-26 Stac, Inc. Data compression apparatus with shift register search means
US5146221A (en) 1989-01-13 1992-09-08 Stac, Inc. Data compression apparatus and method
US5126739A (en) 1989-01-13 1992-06-30 Stac Electronics Data compression apparatus and method
US5016009A (en) 1989-01-13 1991-05-14 Stac, Inc. Data compression apparatus and method
US5353132A (en) 1989-02-06 1994-10-04 Canon Kabushiki Kaisha Image processing device
US4929946A (en) * 1989-02-09 1990-05-29 Storage Technology Corporation Adaptive data compression apparatus including run length encoding for a tape drive system
US5267333A (en) 1989-02-28 1993-11-30 Sharp Kabushiki Kaisha Image compressing apparatus and image coding synthesizing method
EP0418396B1 (en) 1989-03-16 1998-06-03 Fujitsu Limited Video/audio multiplex transmission system
US5113522A (en) * 1989-05-17 1992-05-12 International Business Machines Corporation Data processing system with system resource management for itself and for an associated alien processor
CA2020084C (en) 1989-06-29 1994-10-18 Kohei Iseda Voice coding/decoding system having selected coders and entropy coders
US5065447A (en) 1989-07-05 1991-11-12 Iterated Systems, Inc. Method and apparatus for processing digital data
IL91221A (en) * 1989-08-04 1995-03-30 Ibm Israel Method for the compression of binary text
US5121342A (en) 1989-08-28 1992-06-09 Network Communications Corporation Apparatus for analyzing communication networks
US5191431A (en) * 1989-08-29 1993-03-02 Canon Kabushiki Kaisha Recording apparatus having plural operating modes involving diverse signal compression rates and different apportioning of pilot signal recording area
US4988998A (en) * 1989-09-05 1991-01-29 Storage Technology Corporation Data compression system for successively applying at least two data compression methods to an input data stream
US5209220A (en) * 1989-10-05 1993-05-11 Olympus Optical Co., Ltd. Endoscope image data compressing apparatus
US5109433A (en) 1989-10-13 1992-04-28 Microsoft Corporation Compressing and decompressing text files
US5028922A (en) 1989-10-30 1991-07-02 Industrial Technology Research Institute Multiplexed encoder and decoder with address mark generation/check and precompensation circuits
US5097261A (en) * 1989-11-22 1992-03-17 International Business Machines Corporation Data compression for recording on a record medium
US5109226A (en) 1989-11-22 1992-04-28 International Business Machines Corporation Parallel processors sequentially encoding/decoding compaction maintaining format compatibility
GB9001312D0 (en) 1990-01-19 1990-03-21 Hewlett Packard Ltd Storage of compressed data
GB9001335D0 (en) 1990-01-19 1990-03-21 Hewlett Packard Ltd Data storage on tape
US5483470A (en) * 1990-03-06 1996-01-09 At&T Corp. Timing verification by successive approximation
US5270832A (en) 1990-03-14 1993-12-14 C-Cube Microsystems System for compression and decompression of video data using discrete cosine transform and coding techniques
US5103306A (en) 1990-03-28 1992-04-07 Transitions Research Corporation Digital image compression employing a resolution gradient
US5045852A (en) 1990-03-30 1991-09-03 International Business Machines Corporation Dynamic model selection during data compression
US5091782A (en) * 1990-04-09 1992-02-25 General Instrument Corporation Apparatus and method for adaptively compressing successive blocks of digital video
US5410671A (en) 1990-05-01 1995-04-25 Cyrix Corporation Data compression/decompression processor
US5309555A (en) * 1990-05-15 1994-05-03 International Business Machines Corporation Realtime communication of hand drawn images in a multiprogramming window environment
US5237675A (en) 1990-06-04 1993-08-17 Maxtor Corporation Apparatus and method for efficient organization of compressed data on a hard disk utilizing an estimated compression factor
US5167034A (en) 1990-06-18 1992-11-24 International Business Machines Corporation Data integrity for compaction devices
US5049881A (en) * 1990-06-18 1991-09-17 Intersecting Concepts, Inc. Apparatus and method for very high data rate-compression incorporating lossless data compression and expansion utilizing a hashing technique
US5247638A (en) 1990-06-18 1993-09-21 Storage Technology Corporation Apparatus for compressing data in a dynamically mapped virtual data storage subsystem
US5307497A (en) * 1990-06-25 1994-04-26 International Business Machines Corp. Disk operating system loadable from read only memory using installable file system interface
US5226176A (en) 1990-08-20 1993-07-06 Microsystems, Inc. System for selectively aborting operation or waiting to load required data based upon user response to non-availability of network load device
JPH04102201A (en) 1990-08-21 1992-04-03 Tokico Ltd Magnetic disk device
US5379757A (en) * 1990-08-28 1995-01-10 Olympus Optical Co. Ltd. Method of compressing endoscope image data based on image characteristics
US5115309A (en) 1990-09-10 1992-05-19 At&T Bell Laboratories Method and apparatus for dynamic channel bandwidth allocation among multiple parallel video coders
US5227893A (en) 1990-10-31 1993-07-13 International Business Machines Corporation Pseudo-bar code control of image transmission
GB2251097B (en) 1990-12-08 1995-05-10 Dowty Information Systems An adaptive data compression system
US5237460A (en) 1990-12-14 1993-08-17 Ceram, Inc. Storage of compressed data on random access storage devices
US5627995A (en) 1990-12-14 1997-05-06 Alfred P. Gnadinger Data compression and decompression using memory spaces of more than one size
ES2101730T3 (en) 1990-12-28 1997-07-16 Canon Kk APPARATUS FOR IMAGE CODING, WITH OPTIMIZATION OF THE GENERATED CODE.
US5132992A (en) 1991-01-07 1992-07-21 Paul Yurt Audio and video transmission and receiving system
JPH04241576A (en) 1991-01-14 1992-08-28 Matsushita Graphic Commun Syst Inc Image encoder
US5249053A (en) 1991-02-05 1993-09-28 Dycam Inc. Filmless digital camera with selective image compression
US5150430A (en) 1991-03-15 1992-09-22 The Board Of Trustees Of The Leland Stanford Junior University Lossless data compression circuit and method
CA2065578C (en) * 1991-04-22 1999-02-23 David W. Carr Packet-based data compression method
US5289580A (en) 1991-05-10 1994-02-22 Unisys Corporation Programmable multiple I/O interface controller
US5212742A (en) 1991-05-24 1993-05-18 Apple Computer, Inc. Method and apparatus for encoding/decoding image data
US5263168A (en) 1991-06-03 1993-11-16 Motorola, Inc. Circuitry for automatically entering and terminating an initialization mode in a data processing system in response to a control signal
US5341440A (en) 1991-07-12 1994-08-23 Earl Joseph G Method and apparatus for increasing information compressibility
US5159336A (en) 1991-08-13 1992-10-27 Iomega Corporation Tape controller with data compression and error correction sharing a common buffer
US5414850A (en) 1991-08-23 1995-05-09 Stac Electronics, Inc. System for transparently compressing data files in a computer system
JPH0561951A (en) 1991-08-30 1993-03-12 Fujitsu Ltd Image processor
DE4229710B4 (en) 1991-09-09 2008-06-05 Samsung Electronics Co., Ltd. Digital audio data storage system and digital audio system equipped therewith
US5455943A (en) 1992-10-08 1995-10-03 Salient Software, Inc. Method and apparatus for finding longest and closest matching string in history buffer prior to current string
US5155484A (en) 1991-09-13 1992-10-13 Salient Software, Inc. Fast data compressor with direct lookup table indexing into history buffer
US5373290A (en) 1991-09-25 1994-12-13 Hewlett-Packard Corporation Apparatus and method for managing multiple dictionaries in content addressable memory based data compression
US5243341A (en) 1992-06-01 1993-09-07 Hewlett Packard Company Lempel-Ziv compression scheme with enhanced adapation
US5175543A (en) 1991-09-25 1992-12-29 Hewlett-Packard Company Dictionary reset performance enhancement for data compression applications
US5619995A (en) 1991-11-12 1997-04-15 Lobodzinski; Suave M. Motion video transformation system and method
US5293576A (en) 1991-11-21 1994-03-08 Motorola, Inc. Command authentication process
KR960006761B1 (en) * 1991-12-07 1996-05-23 삼성전자주식회사 Transform coding & decoding method incorporating adpatively selecting transform method
US5396228A (en) * 1992-01-16 1995-03-07 Mobile Telecommunications Technologies Methods and apparatus for compressing and decompressing paging data
FR2687259B1 (en) 1992-02-11 1994-05-06 Ouest Standard Telematique Sa DATA COMPRESSION METHOD FOR PROTOCOL DATA UNIT TRANSMISSION SYSTEM, DECOMPRESSION METHOD, AND CORRESPONDING DEVICE.
GB2264838B (en) 1992-02-21 1995-08-30 Samsung Electronics Co Ltd Video recording apparatus
US5355498A (en) 1992-02-25 1994-10-11 Sun Microsystems, Inc. Method and apparatus for booting a computer system without loading a device driver into memory
US5406278A (en) * 1992-02-28 1995-04-11 Intersecting Concepts, Inc. Method and apparatus for data compression having an improved matching algorithm which utilizes a parallel hashing technique
US5379036A (en) * 1992-04-01 1995-01-03 Storer; James A. Method and apparatus for data compression
US5287420A (en) 1992-04-08 1994-02-15 Supermac Technology Method for image compression on a personal computer
US5243348A (en) 1992-04-27 1993-09-07 Motorola, Inc. Partitioned digital encoder and method for encoding bit groups in parallel
US5408542A (en) 1992-05-12 1995-04-18 Apple Computer, Inc. Method and apparatus for real-time lossless compression and decompression of image data
IL105638A0 (en) 1992-05-13 1993-09-22 Southwest Bell Tech Resources Storage controlling system and method for transferring information
US5615287A (en) 1994-12-02 1997-03-25 The Regents Of The University Of California Image compression technique
GB2268667B (en) 1992-06-24 1995-11-08 Sony Broadcast & Communication Serial data decoding
GB2268666B (en) * 1992-06-24 1996-03-20 Sony Broadcast & Communication Serial data decoding
AU4653593A (en) 1992-06-25 1994-01-24 Teledata Solutions, Inc. Call distributor
US5671355A (en) 1992-06-26 1997-09-23 Predacomm, Inc. Reconfigurable network interface apparatus and method
JPH0628108A (en) 1992-07-09 1994-02-04 Hitachi Ltd Data storage system
US5802290A (en) 1992-07-29 1998-09-01 Virtual Computer Corporation Computer network of distributed virtual computers which are EAC reconfigurable in response to instruction to be executed
US5475388A (en) 1992-08-17 1995-12-12 Ricoh Corporation Method and apparatus for using finite state machines to perform channel modulation and error correction and entropy coding
US5611024A (en) * 1992-08-28 1997-03-11 Compaq Computer Corporation Data compression of bit map images
US5403639A (en) * 1992-09-02 1995-04-04 Storage Technology Corporation File server having snapshot application data groups
US5406279A (en) * 1992-09-02 1995-04-11 Cirrus Logic, Inc. General purpose, hash-based technique for single-pass lossless data compression
US5479587A (en) 1992-09-03 1995-12-26 Hewlett-Packard Company Page printer having adaptive data compression for memory minimization
US5836003A (en) 1993-08-26 1998-11-10 Visnet Ltd. Methods and means for image and voice compression
US5590306A (en) 1992-09-08 1996-12-31 Fuji Photo Film Co., Ltd. Memory card management system for writing data with usage and recording codes made significant
US5394534A (en) 1992-09-11 1995-02-28 International Business Machines Corporation Data compression/decompression and storage of compressed and uncompressed data on a same removable data storage medium
US5357614A (en) 1992-09-17 1994-10-18 Rexon/Tecmar, Inc. Data compression controller
GB2271252A (en) 1992-10-03 1994-04-06 Ibm Data compression in a computer workstation
US5437020A (en) 1992-10-03 1995-07-25 Intel Corporation Method and circuitry for detecting lost sectors of data in a solid state memory disk
US5557749A (en) 1992-10-15 1996-09-17 Intel Corporation System for automatically compressing and decompressing data for sender and receiver processes upon determination of a common compression/decompression method understood by both sender and receiver processes
CA2108833A1 (en) 1992-10-22 1994-04-23 Masanori Ishii File compression processor
EP0595406A1 (en) 1992-10-26 1994-05-04 Koninklijke Philips Electronics N.V. Radio device with signal compression
US5740395A (en) 1992-10-30 1998-04-14 Intel Corporation Method and apparatus for cleaning up a solid state memory disk storing floating sector data
US5479633A (en) 1992-10-30 1995-12-26 Intel Corporation Method of controlling clean-up of a solid state memory disk storing floating sector data
US5535369A (en) 1992-10-30 1996-07-09 Intel Corporation Method for allocating memory in a solid state memory disk
US5400401A (en) * 1992-10-30 1995-03-21 Scientific Atlanta, Inc. System and method for transmitting a plurality of digital services
US5822781A (en) 1992-10-30 1998-10-13 Intel Corporation Sector-based storage device emulator having variable-sized sector
US5991515A (en) 1992-11-10 1999-11-23 Adobe Systems Incorporated Method and apparatus for compressing and decompressing data prior to display
US5638498A (en) 1992-11-10 1997-06-10 Adobe Systems Incorporated Method and apparatus for reducing storage requirements for display data
US5539865A (en) 1992-11-10 1996-07-23 Adobe Systems, Inc. Method and apparatus for processing data for a visual-output device with reduced buffer memory requirements
US5542071A (en) 1992-11-13 1996-07-30 Video Associates Labs, Inc. System for determining communication speed of parallel printer port of computer by using start timer and stop timer commands within data combined with embedded strobe
US5367629A (en) 1992-12-18 1994-11-22 Sharevision Technology, Inc. Digital video compression system utilizing vector adaptive transform
US5467087A (en) 1992-12-18 1995-11-14 Apple Computer, Inc. High speed lossless data compression system
US5455576A (en) 1992-12-23 1995-10-03 Hewlett Packard Corporation Apparatus and methods for Lempel Ziv data compression with improved management of multiple dictionaries in content addressable memory
US5546395A (en) 1993-01-08 1996-08-13 Multi-Tech Systems, Inc. Dynamic selection of compression rate for a voice compression algorithm in a voice over data modem
US5887115A (en) * 1993-01-13 1999-03-23 Hitachi America, Ltd. Method and apparatus for implementing a video tape recorder for recording digital video signals having either a fixed or variable data transmission rate
US5544286A (en) 1993-01-29 1996-08-06 Microsoft Corporation Digital video data compression technique
KR100276427B1 (en) 1993-01-30 2000-12-15 윤종용 Device for compression and decompression of image data
US5583500A (en) 1993-02-10 1996-12-10 Ricoh Corporation Method and apparatus for parallel encoding and decoding of data
US5717394A (en) * 1993-02-10 1998-02-10 Ricoh Company Ltd. Method and apparatus for encoding and decoding data
US5381145A (en) 1993-02-10 1995-01-10 Ricoh Corporation Method and apparatus for parallel decoding and encoding of data
US5555407A (en) 1993-02-17 1996-09-10 Home Information Services, Inc. Method of and apparatus for reduction of bandwidth requirements in the provision of electronic information and transaction services through communication networks
US5586285A (en) 1993-02-19 1996-12-17 Intel Corporation Method and circuitry for increasing reserve memory in a solid state memory disk
US5533051A (en) 1993-03-12 1996-07-02 The James Group Method for data compression
US5420639A (en) * 1993-04-01 1995-05-30 Scientific-Atlanta, Inc. Rate adaptive huffman coding
US5389922A (en) * 1993-04-13 1995-02-14 Hewlett-Packard Company Compression using small dictionaries with applications to network packets
JP2505980B2 (en) * 1993-04-16 1996-06-12 インターナショナル・ビジネス・マシーンズ・コーポレイション Static dictionary creation method and computer execution system
US5794229A (en) 1993-04-16 1998-08-11 Sybase, Inc. Database system with methodology for storing a database table by vertically partitioning all columns of the table
US5918225A (en) 1993-04-16 1999-06-29 Sybase, Inc. SQL-based database system with improved indexing methodology
US5542031A (en) 1993-04-30 1996-07-30 Douglass; Clay S. Halftone computer imager
US5354315A (en) * 1993-06-04 1994-10-11 Intermedics, Inc. Cardiac stimulator with data converter for cardiac signal
US5768629A (en) 1993-06-24 1998-06-16 Discovision Associates Token-based adaptive video processing arrangement
CH686984A5 (en) 1993-09-07 1996-08-15 Max Hugentobler Electronic Uebersetzungsgeraet.
US5610657A (en) 1993-09-14 1997-03-11 Envistech Inc. Video compression using an iterative error data coding method
JP2972501B2 (en) 1993-09-20 1999-11-08 富士通株式会社 I / O subsystem and exclusive control method in I / O subsystem
US5452287A (en) 1993-09-20 1995-09-19 Motorola, Inc. Method of negotiation of protocols, classes, and options in computer and communication networks providing mixed packet, frame, cell, and circuit services
EP0651314A1 (en) 1993-10-27 1995-05-03 International Business Machines Corporation An apparatus and method for thermally protecting a processing device
JP2932920B2 (en) 1993-11-30 1999-08-09 富士ゼロックス株式会社 Information storage device
US5454107A (en) 1993-11-30 1995-09-26 Vlsi Technologies Cache memory support in an integrated memory system
JP3161189B2 (en) 1993-12-03 2001-04-25 株式会社日立製作所 Storage system
JPH07205496A (en) 1994-01-14 1995-08-08 Oki Electric Ind Co Ltd Page printer and method for data compression
US5488364A (en) 1994-02-28 1996-01-30 Sam H. Eulmi Recursive data compression
US5488365A (en) 1994-03-01 1996-01-30 Hewlett-Packard Company Method and apparatus for compressing and decompressing short blocks of data
US5563961A (en) 1994-03-03 1996-10-08 Radius Inc. Video data compression method and system which measures compressed data storage time to optimize compression rate
US5629732A (en) * 1994-03-29 1997-05-13 The Trustees Of Columbia University In The City Of New York Viewer controllable on-demand multimedia service
US5805834A (en) 1994-03-30 1998-09-08 Zilog, Inc. Hot reconfigurable parallel bus bridging circuit
CN1157653C (en) 1994-04-22 2004-07-14 索尼公司 Device and method for transmitting data, and device and method for recording data
US5635632A (en) 1994-04-26 1997-06-03 Cytec Technology Corp. Settling process analysis device and method
US5506872A (en) * 1994-04-26 1996-04-09 At&T Corp. Dynamic compression-rate selection arrangement
US5546475A (en) 1994-04-29 1996-08-13 International Business Machines Corporation Produce recognition system
US5574952A (en) 1994-05-11 1996-11-12 International Business Machines Corporation Data storage system and method for operating a disk controller including allocating disk space for compressed data
DE19517509C2 (en) * 1994-05-13 1997-05-15 Hitachi Ltd Inclined track playback device with tracking control for fast playback of digital information signals from magnetic tapes
US6031937A (en) 1994-05-19 2000-02-29 Next Software, Inc. Method and apparatus for video compression using block and wavelet techniques
US5486826A (en) * 1994-05-19 1996-01-23 Ps Venture 1 Llc Method and apparatus for iterative compression of digital data
US5506844A (en) * 1994-05-20 1996-04-09 Compression Labs, Inc. Method for configuring a statistical multiplexer to dynamically allocate communication channel bandwidth
US5838996A (en) 1994-05-31 1998-11-17 International Business Machines Corporation System for determining presence of hardware decompression, selectively enabling hardware-based and software-based decompression, and conditioning the hardware when hardware decompression is available
US6195391B1 (en) 1994-05-31 2001-02-27 International Business Machines Corporation Hybrid video compression/decompression system
US5581715A (en) 1994-06-22 1996-12-03 Oak Technologies, Inc. IDE/ATA CD drive controller having a digital signal processor interface, dynamic random access memory, data error detection and correction, and a host interface
US5767898A (en) 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
US5987432A (en) 1994-06-29 1999-11-16 Reuters, Ltd. Fault-tolerant central ticker plant system for distributing financial market data
EP0770246A4 (en) 1994-07-14 1998-01-14 Johnson Grace Company Method and apparatus for compressing images
US5561421A (en) 1994-07-28 1996-10-01 International Business Machines Corporation Access method data compression with system-built generic dictionaries
US5535311A (en) 1994-07-28 1996-07-09 Hewlett-Packard Company Method and apparatus for image-type determination to enable choice of an optimum data compression procedure
US5574953A (en) 1994-08-19 1996-11-12 Hewlett-Packard Company Storing compressed data in non-contiguous memory
FR2724074A1 (en) 1994-08-31 1996-03-01 Philips Electronics Nv DIGITAL COMPRESSED SOUND RECORDER.
US5553160A (en) 1994-09-01 1996-09-03 Intel Corporation Method and apparatus for dynamically selecting an image compression process based on image size and color resolution
US5586264A (en) 1994-09-08 1996-12-17 Ibm Corporation Video optimized media streamer with cache management
US5883975A (en) * 1994-09-12 1999-03-16 Nippon Steel Corporation Compression and decompression methods on two-dimensional image data
JP3240495B2 (en) 1994-09-14 2001-12-17 エー・アイ・ソフト株式会社 Lossless data encoding method and device, and decompression device
US6195465B1 (en) * 1994-09-21 2001-02-27 Ricoh Company, Ltd. Method and apparatus for compression using reversible wavelet transforms and an embedded codestream
US5867602A (en) * 1994-09-21 1999-02-02 Ricoh Corporation Reversible wavelet transform and embedded codestream manipulation
US5765027A (en) 1994-09-26 1998-06-09 Toshiba American Information Systems, Inc. Network controller which enables the local processor to have greater access to at least one memory device than the host computer in response to a control signal
US5561824A (en) 1994-10-04 1996-10-01 International Business Machines Corporation Storage management of data for ensuring communication of minimal length data
US5635932A (en) 1994-10-17 1997-06-03 Fujitsu Limited Lempel-ziv compression with expulsion of dictionary buffer matches
JPH08116534A (en) 1994-10-18 1996-05-07 Seiko Epson Corp Image data coder, its method, image data encoder and its method
US5630092A (en) 1994-10-20 1997-05-13 International Business Machines System and method for transferring compressed and uncompressed data between storage systems
US5671413A (en) 1994-10-31 1997-09-23 Intel Corporation Method and apparatus for providing basic input/output services in a computer
US5652795A (en) 1994-11-14 1997-07-29 Hughes Electronics Method and apparatus for an adapter card providing conditional access in a communication system
US5649032A (en) 1994-11-14 1997-07-15 David Sarnoff Research Center, Inc. System for automatically aligning images to form a mosaic image
US7190284B1 (en) * 1994-11-16 2007-03-13 Dye Thomas A Selective lossless, lossy, or no compression of data based on address range, data type, and/or requesting agent
US6170047B1 (en) 1994-11-16 2001-01-02 Interactive Silicon, Inc. System and method for managing system memory and/or non-volatile memory using a memory controller with integrated compression and decompression capabilities
US6002411A (en) 1994-11-16 1999-12-14 Interactive Silicon, Inc. Integrated video and memory controller with data processing and graphical processing capabilities
KR100209877B1 (en) 1994-11-26 1999-07-15 윤종용 Variable length coding encoder and decoder using multiple huffman table
US6215904B1 (en) 1994-11-30 2001-04-10 Xerox Corporation Apparatus and method for selecting encoding schemes based upon image content
US5684478A (en) 1994-12-06 1997-11-04 Cennoid Technologies, Inc. Method and apparatus for adaptive data compression
US5642506A (en) 1994-12-14 1997-06-24 International Business Machines Corporation Method and apparatus for initializing a multiprocessor system
US5613069A (en) * 1994-12-16 1997-03-18 Tony Walker Non-blocking packet switching network with dynamic routing codes having incoming packets diverted and temporarily stored in processor inputs when network ouput is not available
EP0718751A3 (en) 1994-12-23 1997-02-12 Ibm Electronic circuit apparatus employing small disk drive with reconfigurable interface
JP2831602B2 (en) 1995-01-13 1998-12-02 富士通株式会社 Compressed data management device and compressed data management method
US5870036A (en) * 1995-02-24 1999-02-09 International Business Machines Corporation Adaptive multiple dictionary data compression
JP3426385B2 (en) 1995-03-09 2003-07-14 富士通株式会社 Disk controller
JP3302246B2 (en) 1995-03-14 2002-07-15 株式会社リコー Encoding device
US5668737A (en) 1995-03-22 1997-09-16 Pixel Magic, Inc. High-speed data processor and coding method
US5627534A (en) * 1995-03-23 1997-05-06 International Business Machines Corporation Dual stage compression of bit mapped image data using refined run length and LZ compression
JP3749752B2 (en) 1995-03-24 2006-03-01 アイティーティー・マニュファクチャリング・エンタープライジズ・インコーポレーテッド Block adaptive differential pulse code modulation system
US5655138A (en) 1995-04-11 1997-08-05 Elonex I. P. Holdings Apparatus and method for peripheral device control with integrated data compression
US5884269A (en) 1995-04-17 1999-03-16 Merging Technologies Lossless compression/decompression of digital audio data
US5778411A (en) 1995-05-16 1998-07-07 Symbios, Inc. Method for virtual to physical mapping in a mapped compressed virtual storage subsystem
US5724475A (en) 1995-05-18 1998-03-03 Kirsten; Jeff P. Compressed digital video reload and playback system
US5692159A (en) 1995-05-19 1997-11-25 Digital Equipment Corporation Configurable digital signal interface using field programmable gate array to reformat data
US5841979A (en) 1995-05-25 1998-11-24 Information Highway Media Corp. Enhanced delivery of audio data
US5623701A (en) 1995-06-06 1997-04-22 International Business Machines Corporation Data compression method and structure for a direct access storage device
US6219754B1 (en) 1995-06-07 2001-04-17 Advanced Micro Devices Inc. Processor with decompressed video bus
US5537658A (en) 1995-06-07 1996-07-16 International Business Machines Corporation Distributed directory method and structure for direct access storage device (DASD) data compression
JPH0969951A (en) * 1995-06-20 1997-03-11 Ricoh Co Ltd Encoding method and decoding method
KR100224815B1 (en) * 1995-06-23 1999-10-15 윤종용 Data compression and expansion method
US5917438A (en) 1995-06-30 1999-06-29 Victor Company Of Japan, Ltd. Data storing and outputting apparatus
US5729228A (en) * 1995-07-06 1998-03-17 International Business Machines Corp. Parallel compression and decompression using a cooperative dictionary
US5666560A (en) 1995-08-03 1997-09-09 International Business Machines Corporation Storage method and hierarchical padding structure for direct access storage device (DASD) data compression
US5864342A (en) * 1995-08-04 1999-01-26 Microsoft Corporation Method and system for rendering graphical objects to image chunks
US5793371A (en) * 1995-08-04 1998-08-11 Sun Microsystems, Inc. Method and apparatus for geometric compression of three-dimensional graphics data
US6195125B1 (en) 1995-08-11 2001-02-27 Canon Kabushiki Kaisha Pixel shifting image sensor with a different number of images sensed in each mode
US5825830A (en) 1995-08-17 1998-10-20 Kopf; David A. Method and apparatus for the compression of audio, video or other data
JP3407838B2 (en) 1995-09-05 2003-05-19 ソニー株式会社 Video on demand system
US5657452A (en) 1995-09-08 1997-08-12 U.S. Robotics Corp. Transparent support of protocol and data compression features for data communication
US5907801A (en) 1995-09-22 1999-05-25 At&T Wireless Services, Inc. Apparatus and method for optimizing wireless financial transactions
US5764774A (en) 1995-09-25 1998-06-09 Intermec Corporation Source data compression and decompression in code symbol printing and decoding
TW439380B (en) 1995-10-09 2001-06-07 Hitachi Ltd Terminal apparatus
US6058459A (en) 1996-08-26 2000-05-02 Stmicroelectronics, Inc. Video/audio decompression/compression device including an arbiter and method for accessing a shared memory
US5799110A (en) 1995-11-09 1998-08-25 Utah State University Foundation Hierarchical adaptive multistage vector quantization
US5909557A (en) 1995-11-20 1999-06-01 Lucent Technologies Inc. Integrated circuit with programmable bus configuration
US5812883A (en) 1995-11-22 1998-09-22 Mitsubishi Chemical America, Inc. System for reading and storing formatting information after formatting a first storage medium and using the stored formatting information to format a second storage medium
US5696927A (en) 1995-12-21 1997-12-09 Advanced Micro Devices, Inc. Memory paging system and method including compressed page mapping hierarchy
US5847762A (en) 1995-12-27 1998-12-08 Thomson Consumer Electronics, Inc. MPEG system which decompresses and then recompresses MPEG video data before storing said recompressed MPEG video data into memory
US5686916A (en) 1995-12-28 1997-11-11 Philips Electronics North America Corp. Multi-code-book variable length decoder
US5784572A (en) 1995-12-29 1998-07-21 Lsi Logic Corporation Method and apparatus for compressing video and voice signals according to different standards
US5671389A (en) 1996-01-11 1997-09-23 Quantum Corporation Adaptive compression caching for tape recording
US6021433A (en) 1996-01-26 2000-02-01 Wireless Internet, Inc. System and method for transmission of data
JP3277792B2 (en) * 1996-01-31 2002-04-22 株式会社日立製作所 Data compression method and apparatus
US6618728B1 (en) 1996-01-31 2003-09-09 Electronic Data Systems Corporation Multi-process compression
JP3258552B2 (en) * 1996-02-08 2002-02-18 富士通株式会社 Data compression device and data decompression device
US5818369A (en) 1996-03-07 1998-10-06 Pegasus Imaging Corporation Rapid entropy coding for data compression or decompression
JP3305190B2 (en) 1996-03-11 2002-07-22 富士通株式会社 Data compression device and data decompression device
US5774715A (en) 1996-03-27 1998-06-30 Sun Microsystems, Inc. File system level compression using holes
US5809337A (en) 1996-03-29 1998-09-15 Intel Corporation Mass storage devices utilizing high speed serial communications
US5987590A (en) 1996-04-02 1999-11-16 Texas Instruments Incorporated PC circuits, systems and methods
WO1997040630A1 (en) 1996-04-18 1997-10-30 Nokia Mobile Phones Ltd. Video data encoder and decoder
US5742773A (en) 1996-04-18 1998-04-21 Microsoft Corporation Method and system for audio compression negotiation for multiple channels
US5839100A (en) 1996-04-22 1998-11-17 Wegener; Albert William Lossless and loss-limited compression of sampled data signals
US5864678A (en) 1996-05-08 1999-01-26 Apple Computer, Inc. System for detecting and reporting data flow imbalance between computers using grab rate outflow rate arrival rate and play rate
US5719862A (en) * 1996-05-14 1998-02-17 Pericom Semiconductor Corp. Packet-based dynamic de-skewing for network switch with local or central clock
JPH09307726A (en) 1996-05-17 1997-11-28 Oki Data:Kk Image compression and restoring device
FI962381A (en) 1996-06-07 1997-12-08 Nokia Telecommunications Oy Compressing data on a communication connection
US5654703A (en) 1996-06-17 1997-08-05 Hewlett-Packard Company Parallel data compression and decompression
US5974387A (en) 1996-06-19 1999-10-26 Yamaha Corporation Audio recompression from higher rates for karaoke, video games, and other applications
US5825424A (en) 1996-06-19 1998-10-20 Thomson Consumer Electronics, Inc. MPEG system which decompresses and recompresses image data before storing image data in a memory and in accordance with a resolution of a display device
US5818530A (en) 1996-06-19 1998-10-06 Thomson Consumer Electronics, Inc. MPEG compatible decoder including a dual stage data reduction network
US6115384A (en) 1996-06-20 2000-09-05 Fourelle Systems, Inc Gateway architecture for data communication bandwidth-constrained and charge-by-use networks
US6026217A (en) * 1996-06-21 2000-02-15 Digital Equipment Corporation Method and apparatus for eliminating the transpose buffer during a decomposed forward or inverse 2-dimensional discrete cosine transform through operand decomposition storage and retrieval
EP0978051A1 (en) 1996-06-21 2000-02-09 Mirage Technologies, Inc. Dynamically reconfigurable hardware system for real-time control of processes
US6222886B1 (en) * 1996-06-24 2001-04-24 Kabushiki Kaisha Toshiba Compression based reduced memory video decoder
US5889961A (en) 1996-06-27 1999-03-30 International Business Machines Corporation Disk drive having program to be executed by a second processor stored in a first processor's ROM in a compressed form
US5974471A (en) 1996-07-19 1999-10-26 Advanced Micro Devices, Inc. Computer system having distributed compression and decompression logic for compressed data movement
JPH1051642A (en) 1996-07-31 1998-02-20 Fuji Xerox Co Ltd Image processor
JP3859815B2 (en) * 1996-08-02 2006-12-20 シャープ株式会社 Compressed information storage device
US5951623A (en) 1996-08-06 1999-09-14 Reynar; Jeffrey C. Lempel- Ziv data compression technique utilizing a dictionary pre-filled with frequent letter combinations, words and/or phrases
US5936616A (en) 1996-08-07 1999-08-10 Microsoft Corporation Method and system for accessing and displaying a compressed display image in a computer system
US6134631A (en) 1996-08-19 2000-10-17 Hyundai Electronics America, Inc. Non-volatile memory with embedded programmable controller
US5850565A (en) 1996-08-26 1998-12-15 Novell, Inc. Data compression method and apparatus
US5812789A (en) 1996-08-26 1998-09-22 Stmicroelectronics, Inc. Video and/or audio decompression and/or compression device that shares a memory interface
JP3276860B2 (en) 1996-09-02 2002-04-22 富士通株式会社 Data compression / decompression method
US5768445A (en) 1996-09-13 1998-06-16 Silicon Graphics, Inc. Compression and decompression scheme performed on shared workstation memory by media coprocessor
US5748904A (en) 1996-09-13 1998-05-05 Silicon Integrated Systems Corp. Method and system for segment encoded graphic data compression
US5835788A (en) 1996-09-18 1998-11-10 Electronics For Imaging System for transferring input/output data independently through an input/output bus interface in response to programmable instructions stored in a program memory
US5982723A (en) 1996-09-30 1999-11-09 Laser Dynamics, Inc. Data recording and reproducing method for multi-layered optical disk system
TW360823B (en) 1996-09-30 1999-06-11 Hitachi Ltd Data processor and graphic processor
US6175856B1 (en) 1996-09-30 2001-01-16 Apple Computer, Inc. Method and apparatus for dynamic selection of compression processing during teleconference call initiation
DE19644193C2 (en) 1996-10-24 2001-04-19 Bosch Gmbh Robert Integrated overload protection device with temperature sensor
US5956487A (en) 1996-10-25 1999-09-21 Hewlett-Packard Company Embedding web access mechanism in an appliance for user interface functions including a web server and web browser
WO1999008186A1 (en) 1997-08-06 1999-02-18 Macronix International Co., Ltd. Fault-tolerant architecture for in-circuit programming
US5974235A (en) 1996-10-31 1999-10-26 Sensormatic Electronics Corporation Apparatus having flexible capabilities for analysis of video information
US5861920A (en) * 1996-11-08 1999-01-19 Hughes Electronics Corporation Hierarchical low latency video compression
US5870087A (en) 1996-11-13 1999-02-09 Lsi Logic Corporation MPEG decoder system and method having a unified memory for transport decode and system controller functions
US6185625B1 (en) 1996-12-20 2001-02-06 Intel Corporation Scaling proxy server sending to the client a graphical user interface for establishing object encoding preferences after receiving the client's request for the object
US5982937A (en) 1996-12-24 1999-11-09 Electronics For Imaging, Inc. Apparatus and method for hybrid compression of raster data
US5987022A (en) 1996-12-27 1999-11-16 Motorola, Inc. Method for transmitting multiple-protocol packetized data
US6141053A (en) 1997-01-03 2000-10-31 Saukkonen; Jukka I. Method of optimizing bandwidth for transmitting compressed video data streams
US5757852A (en) 1997-01-24 1998-05-26 Western Atlas International, Inc. Method for compression of high resolution seismic data
US5964842A (en) 1997-01-31 1999-10-12 Network Computing Devices, Inc. Method and apparatus for scaling data compression based on system capacity
US6078958A (en) 1997-01-31 2000-06-20 Hughes Electronics Corporation System for allocating available bandwidth of a concentrated media output
US6317714B1 (en) * 1997-02-04 2001-11-13 Microsoft Corporation Controller and associated mechanical characters operable for continuously performing received control data while engaging in bidirectional communications over a single communications channel
US6452933B1 (en) 1997-02-07 2002-09-17 Lucent Technologies Inc. Fair queuing system with adaptive bandwidth redistribution
US5938737A (en) 1997-02-14 1999-08-17 Stanford Telecommunications, Inc. Internet upstream request compression
US6073232A (en) 1997-02-25 2000-06-06 International Business Machines Corporation Method for minimizing a computer's initial program load time after a system reset or a power-on using non-volatile storage
US5832443A (en) 1997-02-25 1998-11-03 Alaris, Inc. Method and apparatus for adaptive audio compression and decompression
US5960465A (en) 1997-02-27 1999-09-28 Novell, Inc. Apparatus and method for directly accessing compressed data utilizing a compressed memory address translation unit and compression descriptor table
US6169241B1 (en) * 1997-03-03 2001-01-02 Yamaha Corporation Sound source with free compression and expansion of voice independently of pitch
JP4091990B2 (en) 1997-03-07 2008-05-28 インテリジェント・コンプレッション・テクノロジーズ Data coding network
FR2760872B1 (en) * 1997-03-17 2000-06-09 Alsthom Cge Alcatel METHOD FOR OPTIMIZING THE COMPRESSION OF IMAGE DATA, WITH AUTOMATIC SELECTION OF COMPRESSION CONDITIONS
US6094634A (en) 1997-03-26 2000-07-25 Fujitsu Limited Data compressing apparatus, data decompressing apparatus, data compressing method, data decompressing method, and program recording medium
US5909559A (en) 1997-04-04 1999-06-01 Texas Instruments Incorporated Bus bridge device including data bus of first width for a first processor, memory controller, arbiter circuit and second processor having a different second data width
US5978483A (en) 1997-04-07 1999-11-02 Inkel Corporation Securely encrypted remote keyless entry system
US5886655A (en) * 1997-04-09 1999-03-23 Hewlett-Packard Company Arithmetic coding context model that accelerates adaptation for small amounts of data
US5818368A (en) 1997-04-18 1998-10-06 Premier Research, Llc Method and apparatus for lossless digital data compression
US5943692A (en) 1997-04-30 1999-08-24 International Business Machines Corporation Mobile client computer system with flash memory management utilizing a virtual address map and variable length data
US5990884A (en) 1997-05-02 1999-11-23 Sony Corporation Control of multimedia information with interface specification stored on multimedia component
US6000009A (en) 1997-05-06 1999-12-07 International Business Machines Corporation Method and apparatus for allocation of disk memory space for compressed data records
US5920326A (en) 1997-05-30 1999-07-06 Hewlett Packard Company Caching and coherency control of multiple geometry accelerators in a computer graphics system
TW338132B (en) 1997-06-28 1998-08-11 United Microelectronics Corp The adaptive selecting method for memory access priority control in MPEG processor
US5915079A (en) 1997-06-17 1999-06-22 Hewlett-Packard Company Multi-path data processing pipeline
US6198842B1 (en) 1997-06-19 2001-03-06 International Business Machines Corporation Multi-spectral image compression with bounded loss
US5923860A (en) 1997-06-25 1999-07-13 Compaq Computer Corp. Apparatus, method and system for remote peripheral component interconnect bus using accelerated graphics port logic circuits
US6014694A (en) 1997-06-26 2000-01-11 Citrix Systems, Inc. System for adaptive video/audio transport over a network
US6097520A (en) 1997-06-30 2000-08-01 Microsoft Corporation Remote control receiver and method of operation
US6028725A (en) 1997-06-30 2000-02-22 Emc Corporation Method and apparatus for increasing disc drive performance
US6092123A (en) 1997-07-17 2000-07-18 International Business Machines Corporation Method and apparatus for changing functions of a hardware device using two or more communication channels
US6003115A (en) 1997-07-29 1999-12-14 Quarterdeck Corporation Method and apparatus for predictive loading of a cache
US6879266B1 (en) 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
US5996033A (en) 1997-09-04 1999-11-30 Chiu-Hao; Cheng Data compression device comprising input connector for connecting to game player system, output connector for connecting to memory card, and virtual memory page switch
US6032148A (en) 1997-09-15 2000-02-29 Hewlett-Packard Company Multilevel storage system with hybrid data compression
US6091777A (en) * 1997-09-18 2000-07-18 Cubic Video Technologies, Inc. Continuously adaptive digital video compression system and method for a web streamer
US5874907A (en) 1997-09-19 1999-02-23 International Business Machines Corporation Method and apparatus for providing improved data compression efficiency for an adaptive data compressor
US6032197A (en) 1997-09-25 2000-02-29 Microsoft Corporation Data packet header compression for unidirectional transmission
US6097845A (en) 1997-10-21 2000-08-01 Canon Kabushiki Kaisha Image discriminator
JP3755697B2 (en) 1997-10-31 2006-03-15 日本ビクター株式会社 Broadcast receiving apparatus and method thereof
US6098114A (en) 1997-11-14 2000-08-01 3Ware Disk array system for processing and tracking the completion of I/O requests
US6138164A (en) 1997-11-14 2000-10-24 E-Parcel, Llc System for minimizing screen refresh time using selectable compression speeds
US6008743A (en) 1997-11-19 1999-12-28 International Business Machines Corporation Method and apparatus for switching between data compression modes
US6489902B2 (en) 1997-12-02 2002-12-03 Hughes Electronics Corporation Data compression for use with a communications channel
US5955976A (en) * 1997-12-02 1999-09-21 Hughes Electronics Corporation Data compression for use with a communications channel
JPH11184703A (en) 1997-12-19 1999-07-09 Nec Corp Information processor and boot method
US6105130A (en) 1997-12-23 2000-08-15 Adaptec, Inc. Method for selectively booting from a desired peripheral device
US6279045B1 (en) 1997-12-29 2001-08-21 Kawasaki Steel Corporation Multimedia interface having a multimedia processor and a field programmable gate array
EP0928070A3 (en) 1997-12-29 2000-11-08 Phone.Com Inc. Compression of documents with markup language that preserves syntactical structure
US5968149A (en) 1998-01-07 1999-10-19 International Business Machines Corporation Tandem operation of input/output data compression modules
US6175650B1 (en) 1998-01-26 2001-01-16 Xerox Corporation Adaptive quantization compatible with the JPEG baseline sequential mode
US5945933A (en) 1998-01-27 1999-08-31 Infit Ltd. Adaptive packet compression apparatus and method
US6038346A (en) 1998-01-29 2000-03-14 Seiko Espoo Corporation Runs of adaptive pixel patterns (RAPP) for lossless image compression
US6442659B1 (en) 1998-02-17 2002-08-27 Emc Corporation Raid-type storage system and technique
US6070179A (en) 1998-02-20 2000-05-30 International Business Machines Corporation Method and system for compressing unicode data within a data processing system
US6075470A (en) 1998-02-26 2000-06-13 Research In Motion Limited Block-wise adaptive statistical data compressor
KR100257046B1 (en) 1998-03-03 2000-05-15 윤종용 An intelligent input/output controller for interface function switching
US6225922B1 (en) 1998-03-16 2001-05-01 Hewlett-Packard Company System and method for compressing data using adaptive field encoding
US6661839B1 (en) 1998-03-24 2003-12-09 Advantest Corporation Method and device for compressing and expanding data pattern
US6244514B1 (en) 1998-04-20 2001-06-12 Ayao Wada Smart card for storage and retrieval of digitally compressed color images
KR100283243B1 (en) 1998-05-11 2001-03-02 구자홍 How to boot the operating system
US6145020A (en) 1998-05-14 2000-11-07 Advanced Technology Materials, Inc. Microcontroller incorporating an enhanced peripheral controller for automatic updating the configuration date of multiple peripherals by using a ferroelectric memory array
US6421387B1 (en) 1998-05-15 2002-07-16 North Carolina State University Methods and systems for forward error correction based loss recovery for interactive video transmission
US6226667B1 (en) 1998-05-26 2001-05-01 International Business Machines Corporation Method and apparatus for preloading data in a distributed data processing system
US6243829B1 (en) 1998-05-27 2001-06-05 Hewlett-Packard Company Memory controller supporting redundant synchronous memories
JP4060442B2 (en) * 1998-05-28 2008-03-12 富士通株式会社 Memory device
US6606413B1 (en) 1998-06-01 2003-08-12 Trestle Acquisition Corp. Compression packaged image transmission for telemicroscopy
US6230223B1 (en) 1998-06-01 2001-05-08 Compaq Computer Corporation Dual purpose apparatus method and system for accelerated graphics or second memory interface
US6198850B1 (en) 1998-06-12 2001-03-06 Xerox Corporation System and method for segmentation dependent lossy and lossless compression for higher quality
US6862278B1 (en) 1998-06-18 2005-03-01 Microsoft Corporation System and method using a packetized encoded bitstream for parallel compression and decompression
US6513113B1 (en) * 1998-06-19 2003-01-28 Ricoh Company, Ltd. Electronic instrument adapted to be selectively booted either from externally-connectable storage unit or from internal nonvolatile rewritable memory
US6711709B1 (en) * 1998-06-24 2004-03-23 Unisys Corporation Integrated block checking system for rapid file transfer of compressed data
US5956490A (en) 1998-06-30 1999-09-21 Motorola, Inc. Method, client device, server and computer readable medium for specifying and negotiating compression of uniform resource identifiers
US6237054B1 (en) 1998-09-14 2001-05-22 Advanced Micro Devices, Inc. Network interface unit including a microcontroller having multiple configurable logic blocks, with a test/program bus for performing a plurality of selected functions
US6529633B1 (en) * 1998-09-16 2003-03-04 Texas Instruments Incorporated Parallel difference coding method for lossless compression and real time decompression
US6192155B1 (en) 1998-09-16 2001-02-20 Xerox Corporation Systems and methods for reducing boundary artifacts in hybrid compression
US6963608B1 (en) 1998-10-02 2005-11-08 General Instrument Corporation Method and apparatus for providing rate control in a video encoder
US6182125B1 (en) * 1998-10-13 2001-01-30 3Com Corporation Methods for determining sendable information content based on a determined network latency
US6330622B1 (en) 1998-10-23 2001-12-11 Intel Corporation Direct processor access via an external multi-purpose interface
US6272627B1 (en) 1998-10-30 2001-08-07 Ati International Srl Method and apparatus for booting up a computing system with enhanced graphics
US6192082B1 (en) * 1998-11-13 2001-02-20 Compaq Computer Corporation Digital television data format conversion with automatic parity detection
US6282641B1 (en) 1998-11-18 2001-08-28 Phoenix Technologies Ltd. System for reconfiguring a boot device by swapping the logical device number of a user selected boot drive to a currently configured boot drive
US6708220B1 (en) 1998-11-19 2004-03-16 X/Net Associates, Inc. System and method for in-stream data compression
US6624761B2 (en) 1998-12-11 2003-09-23 Realtime Data, Llc Content independent data compression method and system
US6195024B1 (en) * 1998-12-11 2001-02-27 Realtime Data, Llc Content independent data compression method and system
US6404931B1 (en) 1998-12-14 2002-06-11 Microsoft Corporation Code book construction for variable to variable length entropy encoding
US6272628B1 (en) 1998-12-14 2001-08-07 International Business Machines Corporation Boot code verification and recovery
US6300888B1 (en) 1998-12-14 2001-10-09 Microsoft Corporation Entrophy code mode switching for frequency-domain audio coding
US6434695B1 (en) 1998-12-23 2002-08-13 Apple Computer, Inc. Computer operating system using compressed ROM image in RAM
US6661845B1 (en) 1999-01-14 2003-12-09 Vianix, Lc Data compression system and method
US6539438B1 (en) 1999-01-15 2003-03-25 Quickflex Inc. Reconfigurable computing system and method and apparatus employing same
US6487640B1 (en) 1999-01-19 2002-11-26 International Business Machines Corporation Memory access request reordering to reduce memory access latency
US6463509B1 (en) 1999-01-26 2002-10-08 Motive Power, Inc. Preloading data in a cache memory according to user-specified preload criteria
US6356589B1 (en) 1999-01-28 2002-03-12 International Business Machines Corporation Sharing reference data between multiple encoders parallel encoding a sequence of video frames
US6208273B1 (en) 1999-01-29 2001-03-27 Interactive Silicon, Inc. System and method for performing scalable embedded parallel data compression
US6885319B2 (en) * 1999-01-29 2005-04-26 Quickshift, Inc. System and method for generating optimally compressed data from a plurality of data compression/decompression engines implementing different data compression algorithms
US6822589B1 (en) 1999-01-29 2004-11-23 Quickshift, Inc. System and method for performing scalable embedded parallel data decompression
US6819271B2 (en) 1999-01-29 2004-11-16 Quickshift, Inc. Parallel compression and decompression system and method having multiple parallel compression and decompression engines
US6145069A (en) 1999-01-29 2000-11-07 Interactive Silicon, Inc. Parallel decompression and compression system and method for improving storage density and access speed for non-volatile memory and embedded memory devices
US20010054131A1 (en) 1999-01-29 2001-12-20 Alvarez Manuel J. System and method for perfoming scalable embedded parallel data compression
US7129860B2 (en) 1999-01-29 2006-10-31 Quickshift, Inc. System and method for performing scalable embedded parallel data decompression
US6601104B1 (en) * 1999-03-11 2003-07-29 Realtime Data Llc System and methods for accelerated data storage and retrieval
US6604158B1 (en) 1999-03-11 2003-08-05 Realtime Data, Llc System and methods for accelerated data storage and retrieval
US6185659B1 (en) 1999-03-23 2001-02-06 Storage Technology Corporation Adapting resource use to improve performance in a caching memory system
US6317818B1 (en) 1999-03-30 2001-11-13 Microsoft Corporation Pre-fetching of pages prior to a hard page fault sequence
US6633968B2 (en) 1999-03-30 2003-10-14 Microsoft Corporation Pre-fetching of pages prior to a hard page fault sequence
US6609223B1 (en) 1999-04-06 2003-08-19 Kencast, Inc. Method for packet-level fec encoding, in which on a source packet-by-source packet basis, the error correction contributions of a source packet to a plurality of wildcard packets are computed, and the source packet is transmitted thereafter
US6345307B1 (en) * 1999-04-30 2002-02-05 General Instrument Corporation Method and apparatus for compressing hypertext transfer protocol (HTTP) messages
US7007099B1 (en) 1999-05-03 2006-02-28 Lucent Technologies Inc. High speed multi-port serial-to-PCI bus interface
US6308311B1 (en) 1999-05-14 2001-10-23 Xilinx, Inc. Method for reconfiguring a field programmable gate array from a host
US6952409B2 (en) 1999-05-17 2005-10-04 Jolitz Lynne G Accelerator system and method
US6597812B1 (en) 1999-05-28 2003-07-22 Realtime Data, Llc System and method for lossless data compression and decompression
US6459429B1 (en) 1999-06-14 2002-10-01 Sun Microsystems, Inc. Segmenting compressed graphics data for parallel decompression and rendering
US6449682B1 (en) 1999-06-18 2002-09-10 Phoenix Technologies Ltd. System and method for inserting one or more files onto mass storage
US6356937B1 (en) 1999-07-06 2002-03-12 David Montville Interoperable full-featured web-based and client-side e-mail system
JP3812928B2 (en) 1999-07-14 2006-08-23 株式会社日立製作所 External storage device and information processing system
US6539456B2 (en) * 1999-10-13 2003-03-25 Intel Corporation Hardware acceleration of boot-up utilizing a non-volatile disk cache
US6768749B1 (en) 1999-10-14 2004-07-27 Cisco Technology, Inc. Dual-channel communications protocol providing enhanced capabilities for modems
US6851047B1 (en) 1999-10-15 2005-02-01 Xilinx, Inc. Configuration in a configurable system on a chip
US6532121B1 (en) * 1999-10-25 2003-03-11 Hewlett-Packard Company Compression algorithm with embedded meta-data for partial record operation augmented with expansion joints
US6449658B1 (en) 1999-11-18 2002-09-10 Quikcat.Com, Inc. Method and apparatus for accelerating data through communication networks
US6792151B1 (en) 1999-11-24 2004-09-14 General Electric Company Image data compression employing optimal subregion compression
US6452602B1 (en) 1999-12-13 2002-09-17 Ati International Srl Method and apparatus for storing compressed data
US6565468B2 (en) * 1999-12-21 2003-05-20 The Gates Corporation Tensioner with damping mechanism
EP1247228A4 (en) 1999-12-23 2003-03-12 Concept Shopping Inc Techniques for optimizing promotion delivery
IL150556A0 (en) 2000-01-03 2003-02-12 Efeckta Technologies Corp Efficient and lossless conversion for transmission or storage of data
US20030191876A1 (en) 2000-02-03 2003-10-09 Fallon James J. Data storewidth accelerator
US20010047473A1 (en) 2000-02-03 2001-11-29 Realtime Data, Llc Systems and methods for computer initialization
US6388584B1 (en) 2000-03-16 2002-05-14 Lucent Technologies Inc. Method and apparatus for data compression of network packets
US6392567B2 (en) 2000-03-31 2002-05-21 Fijitsu Limited Apparatus for repeatedly compressing a data string and a method thereof
US6523102B1 (en) 2000-04-14 2003-02-18 Interactive Silicon, Inc. Parallel compression/decompression system and method for implementation of in-memory compressed cache improving storage density and access speed for industry standard memory subsystems and in-line memory modules
US7089391B2 (en) 2000-04-14 2006-08-08 Quickshift, Inc. Managing a codec engine for memory compression/decompression operations using a data movement engine
US7043563B2 (en) 2000-04-17 2006-05-09 Circadence Corporation Method and system for redirection to arbitrary front-ends in a communication system
US6731814B2 (en) 2000-05-01 2004-05-04 Xerox Corporation Method for compressing digital documents with control of image quality and compression rate
US6310563B1 (en) 2000-05-12 2001-10-30 International Business Machines Corporation Method and apparatus for enhanced decompressor parsing
US6856651B2 (en) * 2000-07-25 2005-02-15 Peribit Networks, Inc. System and method for incremental and continuous data compression
KR100566175B1 (en) * 2000-08-16 2006-03-29 에프. 호프만-라 로슈 아게 Novel aminocyclohexane derivatives
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US9143546B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc System and method for data feed acceleration and encryption
US7417568B2 (en) 2000-10-03 2008-08-26 Realtime Data Llc System and method for data feed acceleration and encryption
US7319667B1 (en) 2000-11-15 2008-01-15 Cisco Technology, Inc. Communication system with priority data compression
DE60144364D1 (en) 2000-12-14 2011-05-19 Sumitomo Rubber Ind Device and method for tire identification and device and method for road condition evaluation
US6888893B2 (en) 2001-01-05 2005-05-03 Microsoft Corporation System and process for broadcast and communication with very low bit-rate bi-level or sketch video
US6670894B2 (en) * 2001-02-05 2003-12-30 Carsten Mehring System and method for keyboard independent touch typing
US7386046B2 (en) 2001-02-13 2008-06-10 Realtime Data Llc Bandwidth sensitive data compression and decompression
US6606040B2 (en) 2001-02-13 2003-08-12 Mosaid Technologies, Inc. Method and apparatus for adaptive data compression
US7069342B1 (en) 2001-03-01 2006-06-27 Cisco Technology, Inc. Communication system with content-based data compression
US20030030575A1 (en) * 2001-05-07 2003-02-13 Harmonic Data Systems Ltd. Lossless data compression
US7024460B2 (en) 2001-07-31 2006-04-04 Bytemobile, Inc. Service-based compression of content within a network communication system
WO2002093358A1 (en) * 2001-05-17 2002-11-21 Cyber Operations, Llc System and method for encoding and decoding data files
US6756922B2 (en) 2001-05-21 2004-06-29 International Business Machines Corporation Method and system for compression of a set of mostly similar strings allowing fast retrieval
US6909745B1 (en) 2001-06-05 2005-06-21 At&T Corp. Content adaptive video encoder
US6704840B2 (en) * 2001-06-19 2004-03-09 Intel Corporation Computer system and method of computer initialization with caching of option BIOS
US7565441B2 (en) 2001-07-23 2009-07-21 Romanik Philip B Image transfer and archival system
TW576531U (en) * 2001-08-10 2004-02-11 Shu-Yi Chian Control circuit of multimedia keyboard
US6650261B2 (en) 2001-09-06 2003-11-18 Xerox Corporation Sliding window compression method utilizing defined match locations
US6577254B2 (en) 2001-11-14 2003-06-10 Hewlett-Packard Development Company, L.P. Data compression/decompression system
JP3778087B2 (en) * 2002-01-18 2006-05-24 富士ゼロックス株式会社 Data encoding apparatus and data decoding apparatus
US6944740B2 (en) 2002-03-27 2005-09-13 International Business Machines Corporation Method for performing compressed I/O with memory expansion technology
US6813689B2 (en) 2002-03-29 2004-11-02 Emc Corporation Communications architecture for a high throughput storage processor employing extensive I/O parallelization
EP2348640B1 (en) 2002-10-05 2020-07-15 QUALCOMM Incorporated Systematic encoding of chain reaction codes
DE102005022925B4 (en) 2005-05-13 2012-02-09 T-Mobile International Ag & Co. Kg Generation of a spatial traffic database in a radio network
US7102544B1 (en) 2005-05-31 2006-09-05 Altera Corporation Method and system for improving memory interface data integrity in PLDs

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4593324A (en) * 1981-04-14 1986-06-03 Fuji Xerox Co., Ltd. Image data storing device
US5612788A (en) * 1993-07-30 1997-03-18 Sony Corporation Video data compression apparatus for recording and reproducing compressed video data at their various compressed data rates
US20030142874A1 (en) * 1994-09-21 2003-07-31 Schwartz Edward L. Context generation
US5604824A (en) * 1994-09-22 1997-02-18 Houston Advanced Research Center Method and apparatus for compression and decompression of documents and the like using splines and spline-wavelets
US5832126A (en) * 1995-07-07 1998-11-03 Oki Data Corporation Method and apparatus for compressing mixed text and image data
US5819215A (en) * 1995-10-13 1998-10-06 Dobson; Kurt Method and apparatus for wavelet based data compression having adaptive bit rate control for compression of digital audio or other sensory data
US6590609B1 (en) * 1997-02-21 2003-07-08 Hitachi, Ltd. Image signal recording system

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8643513B2 (en) 1998-12-11 2014-02-04 Realtime Data Llc Data compression systems and methods
US10033405B2 (en) 1998-12-11 2018-07-24 Realtime Data Llc Data compression systems and method
US8502707B2 (en) 1998-12-11 2013-08-06 Realtime Data, Llc Data compression systems and methods
US8717203B2 (en) 1998-12-11 2014-05-06 Realtime Data, Llc Data compression systems and methods
US8933825B2 (en) 1998-12-11 2015-01-13 Realtime Data Llc Data compression systems and methods
US9054728B2 (en) 1998-12-11 2015-06-09 Realtime Data, Llc Data compression systems and methods
US7714747B2 (en) 1998-12-11 2010-05-11 Realtime Data Llc Data compression systems and methods
US20070109156A1 (en) * 1998-12-11 2007-05-17 Fallon James J Data compression system and methods
US9116908B2 (en) 1999-03-11 2015-08-25 Realtime Data Llc System and methods for accelerated data storage and retrieval
US8756332B2 (en) 1999-03-11 2014-06-17 Realtime Data Llc System and methods for accelerated data storage and retrieval
US20060184696A1 (en) * 1999-03-11 2006-08-17 Fallon James J System and methods for accelerated data storage and retrieval
US8504710B2 (en) 1999-03-11 2013-08-06 Realtime Data Llc System and methods for accelerated data storage and retrieval
US20070067483A1 (en) * 1999-03-11 2007-03-22 Realtime Data Llc System and methods for accelerated data storage and retrieval
US8275897B2 (en) 1999-03-11 2012-09-25 Realtime Data, Llc System and methods for accelerated data storage and retrieval
US10019458B2 (en) 1999-03-11 2018-07-10 Realtime Data Llc System and methods for accelerated data storage and retrieval
US8719438B2 (en) 1999-03-11 2014-05-06 Realtime Data Llc System and methods for accelerated data storage and retrieval
US8090936B2 (en) 2000-02-03 2012-01-03 Realtime Data, Llc Systems and methods for accelerated loading of operating systems and application programs
US8112619B2 (en) 2000-02-03 2012-02-07 Realtime Data Llc Systems and methods for accelerated loading of operating systems and application programs
US20030191876A1 (en) * 2000-02-03 2003-10-09 Fallon James J. Data storewidth accelerator
US8880862B2 (en) 2000-02-03 2014-11-04 Realtime Data, Llc Systems and methods for accelerated loading of operating systems and application programs
US20070043939A1 (en) * 2000-02-03 2007-02-22 Realtime Data Llc Systems and methods for accelerated loading of operating systems and application programs
US20070083746A1 (en) * 2000-02-03 2007-04-12 Realtime Data Llc Systems and methods for accelerated loading of operating systems and application programs
US9792128B2 (en) 2000-02-03 2017-10-17 Realtime Data, Llc System and method for electrical boot-device-reset signals
US9141992B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc Data feed acceleration
US20070174209A1 (en) * 2000-10-03 2007-07-26 Realtime Data Llc System and method for data feed acceleration and encryption
US10419021B2 (en) 2000-10-03 2019-09-17 Realtime Data, Llc Systems and methods of data compression
US10284225B2 (en) 2000-10-03 2019-05-07 Realtime Data, Llc Systems and methods for data compression
US8692695B2 (en) 2000-10-03 2014-04-08 Realtime Data, Llc Methods for encoding and decoding data
US20040042506A1 (en) * 2000-10-03 2004-03-04 Realtime Data, Llc System and method for data feed acceleration and encryption
US8717204B2 (en) 2000-10-03 2014-05-06 Realtime Data Llc Methods for encoding and decoding data
US9967368B2 (en) 2000-10-03 2018-05-08 Realtime Data Llc Systems and methods for data block decompression
US8723701B2 (en) 2000-10-03 2014-05-13 Realtime Data Llc Methods for encoding and decoding data
US8742958B2 (en) 2000-10-03 2014-06-03 Realtime Data Llc Methods for encoding and decoding data
US9859919B2 (en) 2000-10-03 2018-01-02 Realtime Data Llc System and method for data compression
US9667751B2 (en) 2000-10-03 2017-05-30 Realtime Data, Llc Data feed acceleration
US9143546B2 (en) 2000-10-03 2015-09-22 Realtime Data Llc System and method for data feed acceleration and encryption
US7777651B2 (en) 2000-10-03 2010-08-17 Realtime Data Llc System and method for data feed acceleration and encryption
US8073047B2 (en) 2001-02-13 2011-12-06 Realtime Data, Llc Bandwidth sensitive data compression and decompression
US8929442B2 (en) 2001-02-13 2015-01-06 Realtime Data, Llc System and methods for video and audio data distribution
US8553759B2 (en) 2001-02-13 2013-10-08 Realtime Data, Llc Bandwidth sensitive data compression and decompression
US8934535B2 (en) 2001-02-13 2015-01-13 Realtime Data Llc Systems and methods for video and audio data storage and distribution
US10212417B2 (en) 2001-02-13 2019-02-19 Realtime Adaptive Streaming Llc Asymmetric data decompression systems
US8054879B2 (en) 2001-02-13 2011-11-08 Realtime Data Llc Bandwidth sensitive data compression and decompression
US9769477B2 (en) 2001-02-13 2017-09-19 Realtime Adaptive Streaming, LLC Video data compression systems
US8867610B2 (en) 2001-02-13 2014-10-21 Realtime Data Llc System and methods for video and audio data distribution
US9762907B2 (en) 2001-02-13 2017-09-12 Realtime Adaptive Streaming, LLC System and methods for video and audio data distribution
US20060262844A1 (en) * 2005-05-17 2006-11-23 Douglas Chin Input filtering in a video encoder
US20120203746A1 (en) * 2005-07-26 2012-08-09 International Business Machines Corporation System and method for adaptively collecting performance and event information
US9292407B2 (en) 2005-07-26 2016-03-22 International Business Machines Corporation System and method for adaptively collecting performance and event information
US8645573B2 (en) * 2005-07-26 2014-02-04 International Business Machines Corporation System and method for adaptively collecting performance and event information
JP2008305404A (en) * 2007-06-06 2008-12-18 Internatl Business Mach Corp <Ibm> System, method and program product for backing up data
US8874518B2 (en) * 2007-06-06 2014-10-28 International Business Machines Corporation System, method and program product for backing up data
US9413857B2 (en) 2007-06-06 2016-08-09 International Business Machines Corporation System, method and program product for backing up data
US20080306977A1 (en) * 2007-06-06 2008-12-11 International Business Machines Corporation System, method and program product for backing up data
US11169890B2 (en) 2007-06-06 2021-11-09 International Business Machines Corporation System, method and program product for backing up data
US8751687B2 (en) * 2010-04-30 2014-06-10 Microsoft Corporation Efficient encoding of structured data
US20110271011A1 (en) * 2010-04-30 2011-11-03 Microsoft Corporation Efficient encoding of structured data
US20130290615A1 (en) * 2010-10-22 2013-10-31 Indra Networks, Inc. Compression and decompression of data at high speed in solid state storage
US9940230B2 (en) * 2010-10-22 2018-04-10 Cnex Labs, Inc. Compression and decompression of data at high speed in solid state storage
US20120158896A1 (en) * 2010-12-17 2012-06-21 Canon Kabushiki Kaisha Transmission apparatus and transmission method
US8949372B2 (en) * 2010-12-17 2015-02-03 Canon Kabushiki Kaisha Transmission apparatus and transmission method

Also Published As

Publication number Publication date
US20060184696A1 (en) 2006-08-17
US6604158B1 (en) 2003-08-05
US20100318684A1 (en) 2010-12-16
US8275897B2 (en) 2012-09-25
US20150113182A1 (en) 2015-04-23
US7395345B2 (en) 2008-07-01
US20060195601A1 (en) 2006-08-31
US20060015650A1 (en) 2006-01-19

Similar Documents

Publication Publication Date Title
US6604158B1 (en) System and methods for accelerated data storage and retrieval
US10019458B2 (en) System and methods for accelerated data storage and retrieval
US8717203B2 (en) Data compression systems and methods

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION