WO2006061316A2 - Transferring data between system and storage in a shared buffer - Google Patents

Transferring data between system and storage in a shared buffer Download PDF

Info

Publication number
WO2006061316A2
WO2006061316A2 PCT/EP2005/056040 EP2005056040W WO2006061316A2 WO 2006061316 A2 WO2006061316 A2 WO 2006061316A2 EP 2005056040 W EP2005056040 W EP 2005056040W WO 2006061316 A2 WO2006061316 A2 WO 2006061316A2
Authority
WO
WIPO (PCT)
Prior art keywords
buffer
header
offset
application
component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/EP2005/056040
Other languages
English (en)
French (fr)
Other versions
WO2006061316A3 (en
Inventor
Matthew Joseph Anglin
Avishai Haim Hochberg
John Viksne
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IBM United Kingdom Ltd
International Business Machines Corp
Original Assignee
IBM United Kingdom Ltd
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IBM United Kingdom Ltd, International Business Machines Corp filed Critical IBM United Kingdom Ltd
Priority to EP05817138A priority Critical patent/EP1839148A2/en
Priority to JP2007544873A priority patent/JP4965456B2/ja
Publication of WO2006061316A2 publication Critical patent/WO2006061316A2/en
Publication of WO2006061316A3 publication Critical patent/WO2006061316A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G06F15/163—Interprocessor communication
    • G06F15/167—Interprocessor communication using a common memory, e.g. mailbox
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F15/00—Digital computers in general; Data processing equipment in general
    • G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
    • G06F15/163—Interprocessor communication
    • G06F15/173—Interprocessor communication using an interconnection network, e.g. matrix, shuffle, pyramid, star, snowflake
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication

Definitions

  • the present invention relates to a method, system, and program for transferring data between system and storage in a shared buffer.
  • a client system may backup data in a storage device and coordinate the backup with a backup server.
  • the International Business Machines (“IBM"®) Tivoli® Storage Manager product provides software for a client and server systems to backup client data.
  • IBM and Tivoli are registered trademarks of IBM) .
  • the client machine may include multiple program components that process data being transferred between an application in the client and a storage device. Each component reads data from a buffer used by a previous component and then performs a memory copy operation to copy the data to a buffer allocated to the component. As part of processing the data as the data is being passed among the component allocated buffers, the program components may add header information to the data.
  • a program component may read the data from a previous component's buffer, process the data, add a new header to the data, and then write this data and new header to the buffer allocated to the component. The next program component in the chain of components processing the data may do the same.
  • an application requests a buffer from a component.
  • the component allocates a buffer and returns to the application a first offset in the buffer for application data and a second offset in the buffer for a first header.
  • the application writes the application data at the first offset in the buffer; and writes the first header at the second offset in the buffer.
  • a second header is written to a third offset in the buffer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Systems (AREA)
  • Memory System (AREA)
  • Memory System Of A Hierarchy Structure (AREA)
PCT/EP2005/056040 2004-12-10 2005-11-17 Transferring data between system and storage in a shared buffer Ceased WO2006061316A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP05817138A EP1839148A2 (en) 2004-12-10 2005-11-17 Transferring data between system and storage in a shared buffer
JP2007544873A JP4965456B2 (ja) 2004-12-10 2005-11-17 システムと共有バッファ内のストレージとの間でデータを転送する方法、システム、及びコンピュータ・プログラム（システムと共有バッファ内ストレージとの間のデータ転送）

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/009,937 2004-12-10
US11/009,937 US7590777B2 (en) 2004-12-10 2004-12-10 Transferring data between system and storage in a shared buffer

Publications (2)

Publication Number Publication Date
WO2006061316A2 true WO2006061316A2 (en) 2006-06-15
WO2006061316A3 WO2006061316A3 (en) 2006-09-21

Family

ID=36578273

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2005/056040 Ceased WO2006061316A2 (en) 2004-12-10 2005-11-17 Transferring data between system and storage in a shared buffer

Country Status (6)

Country Link
US (1) US7590777B2 (enExample)
EP (1) EP1839148A2 (enExample)
JP (1) JP4965456B2 (enExample)
KR (1) KR100998299B1 (enExample)
CN (1) CN100583048C (enExample)
WO (1) WO2006061316A2 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010532536A (ja) * 2007-06-30 2010-10-07 マイクロソフト コーポレーション デジタルメディア処理用インターフェース

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011121168A1 (en) * 2010-03-31 2011-10-06 Nokia Corporation System and method for allocating buffers
US10380012B2 (en) 2016-04-22 2019-08-13 Samsung Electronics Co., Ltd. Buffer mapping scheme involving pre-allocation of memory
US10375168B2 (en) * 2016-05-31 2019-08-06 Veritas Technologies Llc Throughput in openfabrics environments
KR20250148120A (ko) * 2024-04-05 2025-10-14 한화비전 주식회사 메모리 관리 장치 및 방법

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0294499B1 (en) * 1987-06-09 1992-08-26 International Business Machines Corporation Control scheme for segmented buffers based on a shared reference count
US5161156A (en) * 1990-02-02 1992-11-03 International Business Machines Corporation Multiprocessing packet switching connection system having provision for error correction and recovery
US5265207A (en) * 1990-10-03 1993-11-23 Thinking Machines Corporation Parallel computer system including arrangement for transferring messages from a source processor to selected ones of a plurality of destination processors and combining responses
US5212772A (en) * 1991-02-11 1993-05-18 Gigatrend Incorporated System for storing data in backup tape device
US5535197A (en) * 1991-09-26 1996-07-09 Ipc Information Systems, Inc. Shared buffer switching module
US5276878A (en) * 1992-10-07 1994-01-04 International Business Machines Corporation Method and system for task memory management in a multi-tasking data processing system
US5673381A (en) * 1994-05-27 1997-09-30 Cheyenne Software International Sales Corp. System and parallel streaming and data stripping to back-up a network
US5490168A (en) 1994-07-08 1996-02-06 Motorola, Inc. Method and system for automatic optimization of data throughput using variable packet length and code parameters
US5745685A (en) * 1995-12-29 1998-04-28 Mci Communications Corporation Protocol extension in NSPP using an acknowledgment bit
US5897661A (en) * 1997-02-25 1999-04-27 International Business Machines Corporation Logical volume manager and method having enhanced update capability with dynamic allocation of storage and minimal storage of metadata information
US6038604A (en) * 1997-08-26 2000-03-14 International Business Machines Corporation Method and apparatus for efficient communications using active messages
US6044079A (en) * 1997-10-03 2000-03-28 International Business Machines Corporation Statistical packet discard
US6038606A (en) * 1997-11-25 2000-03-14 International Business Machines Corp. Method and apparatus for scheduling packet acknowledgements
US6397308B1 (en) * 1998-12-31 2002-05-28 Emc Corporation Apparatus and method for differential backup and restoration of data in a computer storage system
US7107395B1 (en) * 1998-12-31 2006-09-12 Emc Corporation Apparatus and methods for operating a computer storage system
US6490168B1 (en) * 1999-09-27 2002-12-03 Motorola, Inc. Interconnection of circuit substrates on different planes in electronic module
US6765922B1 (en) * 2000-09-08 2004-07-20 Hewlett-Packard Development Company, L.P. Speculative transmit for system area network latency reduction
US6801960B1 (en) 2000-09-28 2004-10-05 Emc Corporation Switch-based acceleration of computer data storage employing aggregations of disk arrays
US20040073724A1 (en) * 2000-10-03 2004-04-15 Adaptec, Inc. Network stack layer interface
EP1405175B1 (en) * 2001-06-29 2006-09-27 Koninklijke Philips Electronics N.V. Multiprocessor system and method for operating a multiprocessor system
US20040039891A1 (en) * 2001-08-31 2004-02-26 Arkivio, Inc. Optimizing storage capacity utilization based upon data storage costs
US7269168B2 (en) * 2002-07-31 2007-09-11 Brocade Communications Systems, Inc. Host bus adaptor-based virtualization switch
US7117324B2 (en) * 2002-10-18 2006-10-03 International Business Machines Corporation Simultaneous data backup in a computer system
JP4186602B2 (ja) * 2002-12-04 2008-11-26 株式会社日立製作所 ジャーナルログを利用した更新データ書込方法
US7461131B2 (en) * 2003-03-07 2008-12-02 International Business Machines Corporation Use of virtual targets for preparing and servicing requests for server-free data transfer operations
US7512135B2 (en) 2004-12-10 2009-03-31 International Business Machines Corporation Method for transferring data among a logical layer, physical layer, and storage device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
KRIEGER 0 ET AL.: "THE ALLOC STREAM FACILITY A REDESIGN OF APPLICATION-LEVEL STREAM I/O", COMPUTER, vol. 27, no. 3, 1 March 1994 (1994-03-01), pages 75 - 82

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010532536A (ja) * 2007-06-30 2010-10-07 マイクロソフト コーポレーション デジタルメディア処理用インターフェース
US8612643B2 (en) 2007-06-30 2013-12-17 Microsoft Corporation Interfaces for digital media processing
US9043504B2 (en) 2007-06-30 2015-05-26 Microsoft Technology Licensing, Llc Interfaces for digital media processing

Also Published As

Publication number Publication date
EP1839148A2 (en) 2007-10-03
WO2006061316A3 (en) 2006-09-21
JP4965456B2 (ja) 2012-07-04
US20060126653A1 (en) 2006-06-15
KR20070094742A (ko) 2007-09-21
US7590777B2 (en) 2009-09-15
KR100998299B1 (ko) 2010-12-06
CN100583048C (zh) 2010-01-20
JP2008523485A (ja) 2008-07-03
CN101073062A (zh) 2007-11-14

Similar Documents

Publication Publication Date Title
JP4303688B2 (ja) データアクセス応答システムおよびデータアクセス応答システムへのアクセス方法
US7275123B2 (en) Method and apparatus for providing peer-to-peer data transfer within a computing environment
US7617372B1 (en) Avoiding copy on first write
EP0130349A2 (en) A method for the replacement of blocks of information and its use in a data processing system
US8024524B2 (en) Method, system, and program for an adaptor to read and write to system memory
US20050060443A1 (en) Method, system, and program for processing packets
US7707337B2 (en) Object-based storage device with low process load and control method thereof
US7512135B2 (en) Method for transferring data among a logical layer, physical layer, and storage device
US9971520B2 (en) Processing read and write requests
US20060004983A1 (en) Method, system, and program for managing memory options for devices
US7155492B2 (en) Method and system for caching network data
CN117873921B (zh) 一种基于远程直接内存访问的队列页表管理方法及装置
US7451259B2 (en) Method and apparatus for providing peer-to-peer data transfer within a computing environment
US7590777B2 (en) Transferring data between system and storage in a shared buffer
US6842843B1 (en) Digital data storage subsystem including arrangement for increasing cache memory addressability
US6918023B2 (en) Method, system, and computer program product for invalidating pretranslations for dynamic memory removal
US7421536B2 (en) Access control method, disk control unit and storage apparatus
US7284075B2 (en) Inbound packet placement in host memory
JP2008523485A5 (enExample)
US20060277326A1 (en) Data transfer system and method
CN119493748B (zh) 一种数据处理装置、方法及相关设备
TW200809597A (en) Method and system for device to request and operate an external buffer provided from the host
KR100825724B1 (ko) 직접접속방식을 적용하는 고속 전송이 가능한ＰＭＥＭ（ＰＣＩ Ｍｅｍｏｒｙ）를 이용한 객체 기반저장시스템 및 그 시스템에서의 전송 방법
CN115421904A (zh) 管理内存的方法及装置、电子设备及可读存储介质

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KN KP KR KZ LC LK LR LS LT LU LV LY MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2007544873

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 200580042164.X

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020077013199

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2005817138

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2005817138

Country of ref document: EP