FR2840086A1 - Synchronisation of master and slave servers includes creation of file extraction enabling use of low flow rate asynchronous link - Google Patents

Synchronisation of master and slave servers includes creation of file extraction enabling use of low flow rate asynchronous link Download PDF

Info

Publication number
FR2840086A1
FR2840086A1 FR0206453A FR0206453A FR2840086A1 FR 2840086 A1 FR2840086 A1 FR 2840086A1 FR 0206453 A FR0206453 A FR 0206453A FR 0206453 A FR0206453 A FR 0206453A FR 2840086 A1 FR2840086 A1 FR 2840086A1
Authority
FR
France
Prior art keywords
slave
master
synchronisation
objects
file server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
FR0206453A
Other languages
French (fr)
Other versions
FR2840086B3 (en
Inventor
Jean Paul Smets
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to FR0206453A priority Critical patent/FR2840086B3/en
Publication of FR2840086A1 publication Critical patent/FR2840086A1/en
Application granted granted Critical
Publication of FR2840086B3 publication Critical patent/FR2840086B3/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/273—Asynchronous replication or reconciliation

Abstract

The synchronisation procedure links a master object database (4) and a slave object database (1). A slave synchronisation device communicates and SQL request and an XLS style sheet by asynchronous network at low flow rate to a master synchronisation device. This creates in the file server an extraction of objects which can be imported into the slave database. The synchronisation procedure operates with a master object database (4) connected by a fast network to a master synchronisation device (5), and a slave object database (1) connected by a fast network to a slave synchronisation device (2). The slave synchronisation device (2) is connected by a fast network to a slave file server (3). The master synchronisation device (5) is connected by a fast network to a file server (6). The synchronisation procedure includes an initialisation stage, in which the slave synchronisation device communicates and SQL request and a n XLS style sheet by asynchronous network at low flow rate to the master synchronisation device. This creates in the file server an extraction of objects corresponding to the SQL request in XML file format converted by the XLS file sheet. The slave synchronisation device (2) remotely loads the files created in the master device into the slave file server, and then imports the XML files into the slave database.

Description

le dispositif de cache utilise comme memoire de stockage temporaire unthe cache device uses as temporary storage memory a

disque dur.Hard disk.

La presente invention concerne un procede de synchronisation selective d'un systeme de  The present invention relates to a method for selective synchronization of a

bases de donnees d'objets.object databases.

I1 existe aujourd'hui des procedes de synchronisation globale d'un systeme de bases de  There are today methods of global synchronization of a database system.

donnees d'objets interconnectees par un dispositif de transmission rapide de donnees.  data of objects interconnected by a rapid data transmission device.

Parmi ceux- ci, le pro cede de synchronisation en ma^tre- es clave tel qu' il e st mis en oeuvre par exemple dans le systeme ZEO (marque deposee) fonctionne selon le principe suivant: - une base de donnees d'objets ma^tre recoit de facon synchrone des requites de lecture et d'ecriture d'objets provenant d'une pluralite de bases de donnees d'objets esclaves connectees a celle-ci par un dispositif de transmission rapide de donnees; - chaque base de donnees d'objets esclave connectee a la base de donnees d'objets  Among these, the synchronization process in slave masters as it is implemented for example in the ZEO system (registered trademark) works according to the following principle: - an object database master receives synchronously requests for reading and writing of objects from a plurality of databases of slave objects connected thereto by a rapid data transmission device; - each slave object database connected to the object database

centrale conserve une copie des derniers objets lus dans une memoire cache.  central keeps a copy of the last objects read in a cache memory.

Ce procede de synchronisation aboutit a copier ['ensemble des objets de la base de donnees d'objets ma^tre sur chacune des bases de donnees d'objets esclaves auxquelles elle est connectee. Ce procede ne permet pas de ne copier qutune partie des objets ou qu'une partie des attribute des objets de la base de donnees ma^tre sur chacune des bases de donnees d'objets esclaves auxquelles elle est connectee. Ce procede necessite un dispositif de transmission de donnees rapide et fiable, et n'est done pas adapte a une mise en oeuvre sur une pluralite de bases de donnees d'objets interconnectees par un dispositif de transmission de donnees rents ou peu gables. Ce procede ne permet pas de synchroniser une pluralite de bases de donnees d'objets a une autre pluralite de bases de donnees d'objets sans passer par  This synchronization process results in copying the set of objects from the master object database to each of the slave object databases to which it is connected. This process does not make it possible to copy only part of the objects or only part of the attributes of the objects of the master database on each of the databases of slave objects to which it is connected. This method requires a fast and reliable data transmission device, and is therefore not suitable for use on a plurality of databases of objects interconnected by a data transmission device or not very manageable. This method does not allow synchronization of a plurality of object databases to another plurality of object databases without going through

une base de donnees d'objets ma^tre centrale et unique.  a central and unique master object database.

L'invention vise a remedier a ces inconvenients en creant un procede de synchronisation selective d'objets mis en oeuvre par un dispositif de synchronisation associe a chaque base  The invention aims to remedy these drawbacks by creating a method for selective synchronization of objects implemented by a synchronization device associated with each base.

de donnees d'objets.object data.

L'invention a done pour objet un procede de synchronisation du type precise caracterise par la possibilite pour chaque base de donnees d'objets du systeme de jouer le r81e de base de donnees d'objets ma^tre, par ['association a chaque base de donnees d'objets d'un dispositif permettant de selectionner dans le processus de synchronisation une partie des objets ou une partie des attribute de chaque objet, par la mise en oeuvre d'un procede asynchrone de lecture I ecriture d'objets compatible avec un dispositif de transmission de donnees peu fiable ou lent, par la transmission d'une requete entre la base de donnees d'objets esclave et la base de donnees maitre pour selectionner une partie des objets et par la transmission d'un filtre entre la base de donnees d'objets esclave et la base de donnees ma^tre pour  The subject of the invention is therefore a synchronization method of the precise type characterized by the possibility for each object database of the system to play the role of master object database, by [association with each base of object data of a device making it possible to select in the synchronization process a part of the objects or a part of the attributes of each object, by the implementation of an asynchronous reading process I writing of objects compatible with a unreliable or slow data transmission device, by transmitting a request between the slave object database and the master database to select a part of the objects and by transmitting a filter between the slave object data and the master database for

selectionner une partie des attribute des objets.  select part of the attributes of the objects.

Pe la sorte, le procede de synchronisation n'aboutit pas a copier ['ensemble des objets et ltensemble des attribute d'objets sur chaque base de donnees d'objets et ne necessite pas de  In this way, the synchronization process does not result in copying the set of objects and all the attributes of objects on each database of objects and does not require

dispositif de transmission de donntes rapide ou gable.  rapid or gable data transmission device.

Le procede de synchronisation selon ['invention peut aussi comporter une ou plusieurs des caracteristiques su*antes: - le pro cede de lecture / ecriture asynchrone comp orte une etape de chi ffrement I dechiff ement des objets; - le procede de lecture / ecriture asynchrone comporte une etape de compression de donnees; - le procede de lecture / ecriture asynchrone comporte une etape de conversion de format  The synchronization method according to the invention can also include one or more of the following characteristics: - the asynchronous reading / writing process includes a step of deciphering I deciphering objects; - the asynchronous read / write method includes a data compression step; - the asynchronous read / write process includes a format conversion step

de donnees.of data.

L'invention sera mieux comprise a ['aide de la description qui va suivre, donnee  The invention will be better understood with the aid of the description which follows, given

uniquement a titre d'exemple et faite en se referent au dessin annexe.  by way of example only and made with reference to the accompanying drawing.

Le procede de synchronisation selon ['invention est mis en oeuvre sur un systeme represente a la figure 1 et qui comporte une base de donnees d'objets ma^tre (4) connectee par reseau rapide a un dispositif de synchronisation ma^'tre (5) et une base de donnees d'objets esclave (1) connectee par reseau rapide a un dispositif de synchronisation esclave (2) . Le dispositif de synchronisation esclave (2) est connecte par reseau rapide a un serveur de fichiers esclave (3). Le dispositif de synchronisation ma^tre (5) est connecte par reseau  The synchronization method according to the invention is implemented on a system represented in FIG. 1 and which comprises a master object database (4) connected by fast network to a master synchronization device ( 5) and a slave object database (1) connected by fast network to a slave synchronization device (2). The slave synchronization device (2) is connected by fast network to a slave file server (3). The master synchronization device (5) is connected by network

rapide a un serveur de fichiers (6).  fast to a file server (6).

Le procede de synchronisation selective mis en oeuvre par les dispositifs de synchronisation du systeme decrit precedemment comporte une etape d'initialisation. Lors de cette etape, le dispositif de synchronisation esclave (2) communique par reseau asynchrone a teas debit une requ8te SQL et une feuille de style XSL au dispositif de synchronisation maitre (5). Le dispositif de synchronisation ma^tre (5) cree dans le serveur de fichiers une extraction des objets de la base de donnees d'objets ma^tre (6) correspondent a ladite requete SQL sous forme de fichiers XML convertis par ladite feuille de style XSL. Le dispositif de synchronisation esclave (2) telecharge dans le serveur de fichiers esclave (3) le repertoire cree sur le serveur de fichiers maitre (6) et utilise les protocole RSYNC et SSH (marque deposee) pour comprimer et chiffrer les donnees echangees. Le dispositif de synchronisation esclave (2) importe les fichiers XML telecharges dans la base de donnees d'objets esclave (1) en effectuant une conversion de  The selective synchronization process implemented by the synchronization devices of the system described above comprises an initialization step. During this step, the slave synchronization device (2) communicates by an asynchronous network at teas debit an SQL request and an XSL style sheet to the master synchronization device (5). The master synchronization device (5) creates in the file server an extraction of the objects from the master object database (6) corresponding to said SQL request in the form of XML files converted by said style sheet. XSL. The slave synchronization device (2) downloads into the slave file server (3) the directory created on the master file server (6) and uses the RSYNC and SSH (registered trademark) protocols to compress and encrypt the data exchanged. The slave synchronization device (2) imports the downloaded XML files into the slave object database (1) by performing a conversion of

fichiers inverse en fonction de ladite feuille de style XSL.  reverse files based on said XSL stylesheet.

Une fois ltetape d'initialisation effectuee, une etape de synchronisation est repetee de facon periodique. Le dispositif de synchronisation esclave (2) exporte sous forme de fichier XML stockes dans le serveur de fichiers esclave (3) ['ensemble des objets importes lors *une precedente etape en appliquant la feuille de style XSL transmise lors de l'etape d'initialisation. Le dispositif de synchronisation esclave (2) teletransmet les fichiers crees dans le serveur de fichiers esclave (3) vers un repertoire cree sur le serveur de fichiers ma^tre (6) en utilisant les protocole RSYNC et SSH (marque deposee) pour comprimer et chiffrer les donnees echangees. Le dispositif de synchronisation maitre (5) calcule la difference entre les fichiers XML extraits et convertis lors d'une etape precedente et les fichiers teletransmis par le dispositif de synchronisation esclave (2). Le dispositif de synchronisation maitre (5) modifie la base de donnees d'objets ma^tre (4) en appliquant une conversion de fichiers inverse desdits fichiers de difference calcules. Le dispositif de synchronisation ma^'tre (5) cree dans le serveur de fichiers ma^tre (6) une extraction des objets de la base de donnees d'objets ma^tre (6) correspondent a ladite requete SQL sous forme de fichiers XML convertis par ladite feuille de style XSL. Le dispositif de synchronisation esclave (2) telecharge dans le serveur de fichiers esclave (3) le repertoire cree sur le serveur de fichiers ma^tre (6) et utilise les protocoles RSYNC et SSH (marque deposee) pour comprimer et chiffrer les donnees echangees. Le dispositif de synchronisation esclave (2) calcule la difference entre les fichiers XML extraits et convertis lors d'une etape precedente et les fichiers telecharges depuis le serveur de fichiers maitre (6). Le dispositif de synchronisation esclave {2) modifie la base de donnees d'objets esclave (l) en appliquant une conversion inverse de format aux fichiers de difference  Once the initialization step has been carried out, a synchronization step is repeated periodically. The slave synchronization device (2) exports in the form of an XML file stored in the slave file server (3) ['all the objects imported during * a previous step by applying the XSL style sheet transmitted during the step of initialization. The slave synchronization device (2) transmits the files created in the slave file server (3) to a directory created on the master file server (6) using the RSYNC and SSH (trademark) protocols to compress and encrypt the data exchanged. The master synchronization device (5) calculates the difference between the XML files extracted and converted during a previous step and the files teletransmitted by the slave synchronization device (2). The master synchronization device (5) modifies the master object database (4) by applying a reverse file conversion of said calculated difference files. The master synchronization device (5) creates in the master file server (6) an extraction of the objects from the master object database (6) corresponding to said SQL request in the form of files XML converted by said XSL stylesheet. The slave synchronization device (2) downloads into the slave file server (3) the directory created on the master file server (6) and uses the RSYNC and SSH (registered trademark) protocols to compress and encrypt the data exchanged . The slave synchronization device (2) calculates the difference between the XML files extracted and converted during a previous step and the files downloaded from the master file server (6). The slave synchronization device {2) modifies the slave object database (l) by applying a reverse format conversion to the difference files

calcules en fonction de ladite feuille de style XSL.  calculated according to said XSL style sheet.

Il apparait clairement qu'un procede de synchronisation selective d'un systeme de bases de donnees d'objets selon ['invention remedie aux inconvenients des procedes de  It is clear that a method of selective synchronization of an object database system according to the invention remedies the drawbacks of the

synchronisation ma^tre-esclave classiques.  classic master-slave synchronization.

En effet, le procede de synchronisation mis en oeuvre par un dispositif de synchronisation associe a chaque base de donnees d'objets permet de synchroniser de facon selective un systeme de base de donnees d'objets interconnectees par un dispositif de transmission de donnees asynchrone a teas debit et permet a chaque base de donnees d'objets de jouer le  Indeed, the synchronization method implemented by a synchronization device associated with each object database makes it possible to selectively synchronize a database system of objects interconnected by an asynchronous data transmission device at teas throughput and allows each object database to play the

role de ma^'tre.role of master.

Claims (4)

REVENDICATIONS 1. Procide de synchronisation ma^tre-esclave d'un systene de bases de donnees d'objets caracterise en ce qutil consiste dans une etape d'initialisation a transmettre une requete de selection d'objets et un filtre de selection d'attributs et a echanger dans une etape de synchronisation les mises a jour des attribute filtres des objets selectionnes dans chaque  1. Master-slave synchronization process of an object database system characterized in that it consists of an initialization step in transmitting an object selection request and an attribute selection filter and to exchange in a synchronization step the updates of attribute filters of the objects selected in each base de donnees *objets lors de ladite etape d'initialisation.  database * objects during said initialization step. 2. Procede selon la revendication la revendication 1, caracterise par une etape de conversion de format de donnees lors de l'echange des mises a jour des attribute filtres  2. Method according to claim claim 1, characterized by a data format conversion step when exchanging updates of attribute filters des objets selectionnes.selected objects. 3. Procede selon la revendication la revendication 1 ou 2, caracterise par une etape de compression de donnees lors de l'echange des mises a jour des attribute filtres des objets selectionnes.  3. Method according to claim claim 1 or 2, characterized by a data compression step when exchanging updates of attribute filters of selected objects. 4. Procede selon l'une quelconque des revendications 1 a 3, caracterise par une etape de  4. Method according to any one of claims 1 to 3, characterized by a step of chiffrement de donnees lors de l'echange des mises a jour des attribute filtres des objets  data encryption when exchanging object attribute filter updates
FR0206453A 2002-05-27 2002-05-27 METHOD FOR SELECTIVE SYNCHRONIZATION OF AN OBJECT DATABASE SYSTEM Expired - Fee Related FR2840086B3 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
FR0206453A FR2840086B3 (en) 2002-05-27 2002-05-27 METHOD FOR SELECTIVE SYNCHRONIZATION OF AN OBJECT DATABASE SYSTEM

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR0206453A FR2840086B3 (en) 2002-05-27 2002-05-27 METHOD FOR SELECTIVE SYNCHRONIZATION OF AN OBJECT DATABASE SYSTEM

Publications (2)

Publication Number Publication Date
FR2840086A1 true FR2840086A1 (en) 2003-11-28
FR2840086B3 FR2840086B3 (en) 2004-11-12

Family

ID=29415119

Family Applications (1)

Application Number Title Priority Date Filing Date
FR0206453A Expired - Fee Related FR2840086B3 (en) 2002-05-27 2002-05-27 METHOD FOR SELECTIVE SYNCHRONIZATION OF AN OBJECT DATABASE SYSTEM

Country Status (1)

Country Link
FR (1) FR2840086B3 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007005788A2 (en) 2005-07-01 2007-01-11 Microsoft Corporation Query based synchronization

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007005788A2 (en) 2005-07-01 2007-01-11 Microsoft Corporation Query based synchronization
EP1899868A2 (en) * 2005-07-01 2008-03-19 Microsoft Corporation Query based synchronization
EP1899868A4 (en) * 2005-07-01 2009-07-15 Microsoft Corp Query based synchronization

Also Published As

Publication number Publication date
FR2840086B3 (en) 2004-11-12

Similar Documents

Publication Publication Date Title
Ramasubramanian et al. Cimbiosys: A platform for content-based partial replication
US11507594B2 (en) Bulk data distribution system
WO2006016282A3 (en) Media indexer
JP2009525534A (en) Scalable file replication and web-based access
WO2006127258A3 (en) Acquisition, management and synchronization of podcasts
EP2533160A1 (en) Method, system and apparatus for data synchronization between databases
CN101697169A (en) Method, device and system for data synchronization between source database and destination database
WO2008095125A2 (en) Synchronization framework for occasionally connected applications
CN102272751B (en) Data integrity in a database environment through background synchronization
CN110008194A (en) A kind of rapid file acquisition methods based on block chain and interspace file system IPFS
JP2007280388A5 (en)
JP2005509950A (en) Fingerprint database update method, client and server
CN111026808A (en) Heterogeneous database synchronization system and synchronization method based on domestic environment
US11055313B2 (en) Free world replication protocol for key-value store
CN112073240B (en) Blue-green deployment system and method based on registration center component and storage medium
CN106156227A (en) A kind of data transmission method and device
FR2840086A1 (en) Synchronisation of master and slave servers includes creation of file extraction enabling use of low flow rate asynchronous link
Avioz The Names Mephibosheth and Ishbosheth Reconsidered
Lerner At the forge: Redis
CN105446981B (en) Map of website generation method, access method and device
Tugores et al. Mining online social networks with Python to study urban mobility
CN105824916A (en) System and method for synchronizing data
Rungsawang et al. PageRank computation using PC cluster
CN113542822B (en) Image file transmission method and device
Purnama et al. Rsync and Rdiff implementation on Moodle's backup and restore feature for course synchronization over the network

Legal Events

Date Code Title Description
ST Notification of lapse

Effective date: 20060131

RN Application for restoration
FC Favourable decision of inpi director general on an application for restauration.
FC Favourable decision of inpi director general on an application for restauration.