WO2001055904A1 - Systeme et procede pour la compression de donnees en continu - Google Patents

Systeme et procede pour la compression de donnees en continu Download PDF

Info

Publication number
WO2001055904A1
WO2001055904A1 PCT/US1999/027467 US9927467W WO0155904A1 WO 2001055904 A1 WO2001055904 A1 WO 2001055904A1 US 9927467 W US9927467 W US 9927467W WO 0155904 A1 WO0155904 A1 WO 0155904A1
Authority
WO
WIPO (PCT)
Prior art keywords
data set
server
compression
data
database
Prior art date
Application number
PCT/US1999/027467
Other languages
English (en)
Other versions
WO2001055904A9 (fr
Inventor
Gregg Olin
Original Assignee
X/Net Associates, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by X/Net Associates, Inc. filed Critical X/Net Associates, Inc.
Priority to PCT/US1999/027467 priority Critical patent/WO2001055904A1/fr
Priority to AU2000263332A priority patent/AU2000263332A1/en
Publication of WO2001055904A1 publication Critical patent/WO2001055904A1/fr
Publication of WO2001055904A9 publication Critical patent/WO2001055904A9/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04—Protocols for data compression, e.g. ROHC

Definitions

  • Data requests made to a server can often result in a relatively large amount of data sent back to the user.
  • a data set is extraordinarily large, it is preferred that the data be compressed before being sent in order to decrease the transfer time, particularly when data transfer is taking place over a modem.
  • data compression is useful in many contexts, the process of compressing data takes time. Indeed, where a relatively small amount of data is to be transferred, the compression process can take more time than it would take to simply transfer the data uncompressed.
  • a method for heuristic in- stream data compression which comprises the steps of: (i) determining the mass of a selected data set to be transmitted in uncompressed form, upon each transmission from a server to an input device, (ii) projecting the mass of the data set in compressed form, (iii) determining the transfer rate of the data set umcompressed, in real-time between the input device and the server, (iv) determining the connection time required to move the data set in compressed and uncompressed form; (v) estimating the time required at the server to compress the data set, (vi) estimating the time required at the input device to uncompress the data set; and (vii) comparing the connection time required to move the data set in compressed form at step (iv) to the sum of the connection time required to move the data set in uncompressed form, the time at the server to compress the data set, and the time at the input device to uncompress the data set.
  • a method for compressing a data set comprises the steps of: (i) requesting a data set from a server to be sent to a user, (ii) determining the size of the data set to be sent, (iii) if the size of the data set is greater than or equal to a selected size, compressing the data set, (iv) assigning a compression flag to the compressed data set, (v) sending the compression flag and compressed data set to the user, (vi) inspecting the data set for compression, (vii) uncompressing the data set; and (viii) processing the data set.
  • a method for compressing a data set which comprises the steps of: (i) requesting a data set from a server to be sent to a user, (ii) determining the size of the data set to be sent, (iii) if the size of the data set is less than a selected size, assigning an uncompressed flag to the data set, (iv) sending the uncompressed flag and data set to the user, (v) inspecting the data set for compression; and (vi) processing the data set.
  • a further object of the present invention is to enhance data transfer between a user and server.
  • Yet another object of the present invention is to improve the speed and quality of data transfer.
  • Still another object of the present invention is to provide a durable, reliable system for the rapid transfer of data between a user and server simply, efficiently and economically.
  • Yet a further object of the present invention is to enhance data transfer over the Internet.
  • Another object of the present invention is to provide a system and method for optimizing the speed of data transfer over a wide range of data set sizes.
  • FIG. 1 is a schematic showing a system and method for in-stream data compression according to one aspect of the present invention
  • FIG. 2 is a schematic showing a system and method for in-stream data compression according to another aspect of the present invention
  • FIG. 4 is a flow diagram showing a compression handling process from the server's perspective in accordance with the present invention.
  • FIG. 5 is a schematic illustrating a MetaSage server according to one aspect of the present invention.
  • the system comprises a computer-based input device 20, a server 30 having heuristic compression decision logic, and a communications infrastructure 40 linking the input device to the server.
  • a database 50 desirably linked to the server maintains workstation and network performance data.
  • An applications database 60 linked to a database server 70 houses selected data sought by a user.
  • the present invention provides heuristically driven, in-stream data compression that, in effect, rides on the server platform. This not only allows compression of the content relevant to the particular application, e.g., business, but also data compression in real-time for continuously changing data sets and, more particularly, of the desired content.
  • the input device is preferably a conventional desktop computer 21, laptop or the like for operation on a 32-bit wintel platform with a TCP/IP connection to the server.
  • the device includes a display monitor 22, a communications modem 23, e.g., conventional, Internet compatible, and a mouse 24, keyboard 25 and/or other mode of input.
  • the device is suitable for interactive connection to and communications with server 30, e.g., 32-bit, platform independent via JAVA, for sending and receiving data sets over the Internet, an Intranet, an Extranet or the like.
  • server is reponsible for delivering a dynamically assembled set of objects which, when assembled by the input device, presents the user with a user-specific interface.
  • the input device is preferably linked to the server over a traditional communications network 41 which includes traditional wire-based, fiber optic, wireless and/or like connections such as a land-based telephone system, satellite or other conventional telecommunications network.
  • a traditional communications network 41 which includes traditional wire-based, fiber optic, wireless and/or like connections such as a land-based telephone system, satellite or other conventional telecommunications network.
  • Their structure and function are considered well-known to those skilled in the art and further description is believed unnecessary for purposes of illustrating the present invention.
  • server 30 e.g., a MetaSage Server
  • server 30 preferably enlists an applications operating system which handles all common user needs, e.g., in the context of business applications, vertical business application development, deployment, and maintenance.
  • an N-tier, distributed, client/server architecture has been found particularly well- suited for business to business applications.
  • Representative functions include management, rules, security, access, user profiles, and communications. This arrangement is considered particularly well-suited to wide area network environments, lending suitability to a wide variety of enterprise architectures.
  • the server enlists a novel architecture which includes system boundary 31, cartridge space 32, and system object space 33 components.
  • This system boundary houses server database 34 and database manager 35, both being linked to system core 36.
  • the server of this embodiment provide and manage four major portals.
  • the first is a user access or main portal 37.
  • This portal allows any user software to be created or modified for communication with server 30 via TCP IP and sockets. In this manner, the user need not continuously update his/her equipment with each advance in communications protocol or equipment.
  • the user access portal is suitable for user systems that are browser-based, a component, and/or an application.
  • the system core communicates with this portal through a user manager 38 housed within system boundary 31.
  • the fourth and last portal 44 is for remote system administration.
  • This portal permits the server and its vertical business applications to be monitored and modified remotely.
  • the server also allows dynamic upgrading and updating of its vertical business applications, without user interruption.
  • Typical vertical business application processes and functions are as follows: (i) profiles such as system administrator, groups and users, (ii) security including system process and function, and application process and function, and finally (iii) workflow including management rules, business rules and process milestones.
  • profiles such as system administrator, groups and users
  • security including system process and function
  • application process and function and finally
  • workflow including management rules, business rules and process milestones.
  • the foregoing applications are preferably accessible through alternate delivery channels including: Internet, automated banking machines, call centre, IVR, kiosks and remote access for roving residential mortgage lenders, within the spirit and scope of the present invention.
  • Real-time applications processing is also desirable, i.e., not only updating ATB's mainframe system and printing requirements, but also changing to operational controls such as new operators on a real-time basis.
  • the present invention advantageously utilizes heuristic compression decision logic to effect in-stream data compression.
  • the mass of a selected data set to be transmitted in uncompressed form is determined.
  • the mass of the data set in compressed form is also determined.
  • the transfer rate of the uncompressed data set in real-time between the input device and the server is computed.
  • the connection time required to move the data set in compressed and uncompressed form is calculated.
  • the time required at the server to compress the data set is then estimated as well as the time required at the input device to uncompress the data set.
  • the connection time required to move the data set in compressed form is compared to the sum of the connection time required to move the data set in uncompressed form, the time at the server to compress the data set, and the time at the input device to uncompress the data set.
  • a configurable value is selected which corresponds to the size of the data set where compression should begin. This value is set manually and is determined by observing and comparing the transfer time with the size of the data set to be transferred. When the value is met or exceeded, data compression software is initiated.
  • According to another aspect of the present invention is a method for compressing a data set passing from a server to a user. Initially, a request is made to send the data set from the server to the user. The size of the data set to be sent is then determined. If the size of the data set is greater than or equal to a selected size, then the data set is compressed and a compression flag is assigned to the compressed data set. The compression flag and compressed data set are to the user. The data set is, in turn, inspected for compression, uncompressed, and processed.
  • an uncompressed flag is assigned to the data set.
  • the uncompressed flag and data set are then sent to the user, inspected for compression, and processed.
  • the uncompressed data set is sent to the user, inspected for compression, and processed.
  • the present invention advantageously provides automatic compression of a data set transacted within a selected application upon operations between the user and application.
  • Heuristically based in-stream data compression is provided that, in effect, rides on the server platform. This not only allows compression of the content relevant to the particular application, but also data compression in real-time for continuously changing data sets and, more particularly, of the desired content.
  • complex data sets e.g., spread sheets, can be delivered to a user at least 3.6 times faster than conventional data compression technology.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un système et un procédé pour la compression d'un fichier. Le procédé selon l'invention comprend les étapes suivantes : (i) demande d'envoi à un utilisateur d'un fichier provenant d'un serveur, (ii) détermination de la taille du fichier à envoyer, (iii) compression du fichier, (iv) affectation d'une marque de compression au fichier comprimé, (v) envoi de la marque de compression et du fichier comprimé à l'utilisateur, (vi) inspection du fichier pour voir s'il est comprimé, (vii) décompression du fichier et (viii) traitement du fichier. Selon un autre mode de réalisation de l'invention, après détermination de la taille du fichier à envoyer, une marque de non-compression est affectée au fichier, la marque de non-compression et le fichier sont envoyés à l'utilisateur, le fichier est inspecté pour voir s'il est comprimé et le fichier est traité. Selon encore un autre mode de réalisation de l'invention, après détermination de la taille du fichier à envoyer, le fichier non comprimé est envoyé à l'utilisateur, le fichier est inspecté pour voir s'il est comprimé et le fichier est traité.
PCT/US1999/027467 2000-01-31 2000-01-31 Systeme et procede pour la compression de donnees en continu WO2001055904A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/US1999/027467 WO2001055904A1 (fr) 2000-01-31 2000-01-31 Systeme et procede pour la compression de donnees en continu
AU2000263332A AU2000263332A1 (en) 2000-01-31 2000-01-31 System and method for in-stream data compression

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US1999/027467 WO2001055904A1 (fr) 2000-01-31 2000-01-31 Systeme et procede pour la compression de donnees en continu

Publications (2)

Publication Number Publication Date
WO2001055904A1 true WO2001055904A1 (fr) 2001-08-02
WO2001055904A9 WO2001055904A9 (fr) 2002-08-29

Family

ID=22274099

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/027467 WO2001055904A1 (fr) 2000-01-31 2000-01-31 Systeme et procede pour la compression de donnees en continu

Country Status (2)

Country Link
AU (1) AU2000263332A1 (fr)
WO (1) WO2001055904A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1424779A1 (fr) * 2002-11-26 2004-06-02 BMC Software, Inc. Selectif compression de données pour une transmission de données sur le web
WO2007000493A1 (fr) * 2005-06-29 2007-01-04 Ascia Oy Agencement de compression de donnees
EP1916797A1 (fr) * 2005-07-29 2008-04-30 Huawei Technologies Co., Ltd. Procede de transmission de message de protocole d'authentification d'autorisation et de comptabilite

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6125209A (en) * 1997-04-04 2000-09-26 Sony United Kingdom Limited Database accessing method and apparatus

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6125209A (en) * 1997-04-04 2000-09-26 Sony United Kingdom Limited Database accessing method and apparatus

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1424779A1 (fr) * 2002-11-26 2004-06-02 BMC Software, Inc. Selectif compression de données pour une transmission de données sur le web
WO2007000493A1 (fr) * 2005-06-29 2007-01-04 Ascia Oy Agencement de compression de donnees
EP1916797A1 (fr) * 2005-07-29 2008-04-30 Huawei Technologies Co., Ltd. Procede de transmission de message de protocole d'authentification d'autorisation et de comptabilite
EP1916797A4 (fr) * 2005-07-29 2008-08-13 Huawei Tech Co Ltd Procede de transmission de message de protocole d'authentification d'autorisation et de comptabilite

Also Published As

Publication number Publication date
WO2001055904A9 (fr) 2002-08-29
AU2000263332A1 (en) 2001-08-07

Similar Documents

Publication Publication Date Title
US6708220B1 (en) System and method for in-stream data compression
US6859798B1 (en) Intelligence server system
US7113993B1 (en) Technique for handling server session requests in a system having a plurality of servers
US6304904B1 (en) Method and apparatus for collecting page-level performance statistics from a network device
US7836178B1 (en) Technique for limiting access to the resources of a system
US6480894B1 (en) System and method for maintaining a state for a user session using a web system
US7356589B2 (en) Content collection
US6883081B2 (en) Storage management software bridges
US5956489A (en) Transaction replication system and method for supporting replicated transaction-based services
US8271689B2 (en) System and method for partial data compression and data transfer
US20030135611A1 (en) Self-monitoring service system with improved user administration and user access control
US6892228B1 (en) System and method for on-line service creation
US20100057935A1 (en) Record medium with a load distribution program recorded thereon, load distribution method, and load distribution apparatus
US7366739B2 (en) Data storage system
WO1996030847A1 (fr) Technique et equipement pour le traitement de transactions dans un systeme reparti de gestion de base de donnees
US20040024900A1 (en) Method and system for enhancing streaming operation in a distributed communication system
US7149800B2 (en) Auditing computer systems components in a network
EP0919912B1 (fr) Système de flux de travail à serveur multiple
US7107291B2 (en) Information system and data access method
US20060195579A1 (en) Method and system for managing server load to execute transactions of an application program on multiple servers
US20230367484A1 (en) Automated tuning of a quality of service setting for a distributed storage system based on internal monitoring
US8782372B2 (en) Method, system and program product for storing downloadable content on a plurality of enterprise storage system (ESS) cells
US9563482B2 (en) Method for imposing policy modification constraints
US20030140100A1 (en) System and method for URL response caching and filtering in servlets and application servers
WO2001055904A1 (fr) Systeme et procede pour la compression de donnees en continu

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: C2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C2

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

COP Corrected version of pamphlet

Free format text: PAGES 1/5-5/5, DRAWINGS, REPLACED BY NEW PAGES 1/5-5/5; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase