CN102024005B - Issuance system and method of information item set directories - Google Patents
Issuance system and method of information item set directories Download PDFInfo
- Publication number
- CN102024005B CN102024005B CN200910196048.3A CN200910196048A CN102024005B CN 102024005 B CN102024005 B CN 102024005B CN 200910196048 A CN200910196048 A CN 200910196048A CN 102024005 B CN102024005 B CN 102024005B
- Authority
- CN
- China
- Prior art keywords
- renewal
- catalogue
- information project
- memory module
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000004891 communication Methods 0.000 claims abstract description 19
- 230000006835 compression Effects 0.000 claims description 54
- 238000007906 compression Methods 0.000 claims description 54
- 230000008569 process Effects 0.000 claims description 25
- 238000003860 storage Methods 0.000 claims description 18
- 230000000379 polymerizing effect Effects 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 5
- 230000033228 biological regulation Effects 0.000 claims description 4
- 230000006837 decompression Effects 0.000 claims description 4
- 230000009977 dual effect Effects 0.000 claims description 2
- 230000004048 modification Effects 0.000 abstract description 3
- 238000012986 modification Methods 0.000 abstract description 3
- 230000015572 biosynthetic process Effects 0.000 description 8
- 238000013507 mapping Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000002776 aggregation Effects 0.000 description 2
- 238000004220 aggregation Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000000151 deposition Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000006116 polymerization reaction Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 239000012467 final product Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000008929 regeneration Effects 0.000 description 1
- 238000011069 regeneration method Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an issuance system and an issuance method of information item set directories, which can synchronize the information item set directories of a server and a client. The technical scheme comprises that: the client interacts with a directory issuance server by a communication channel, downloads the issuance directories from the server to a local position and establishes a local duplicate, while keeping synchronization with the update status of the issuance directories. In addition, the issuance directories modification operations are uploaded to the directory issuance server by the client and ordered by sequence; the issued directories stored in the memory module of a directory database are sequentially updated; and the successful updated operations are stamped with an update stamp and recorded into the memory module of an update log database.
Description
Technical field
The present invention relates to computer system, relate in particular to a kind of system and method for the project set catalogue that releases news.
Background technology
RSS (simple and easy information fusion) is by the site information distribution technology that extensively adopts on the present internet; It allows the information project of a plurality of information issue sources that the user will select to be aggregated to a unified conventional directory tree; As access entry, let the user pass through the information of this unified access entry retrieval from different information distribution sites.
Because what RSS adopted is conventional directory tree, so there are a series of problems of being brought by conventional tree directory structure in RSS:
(1) project can only belong under the catalogue;
The searching route of (2) fixing;
(3) the classification mode combination causes the path branches blast;
(4) can not retrieve project according to the project particular attribute-value
In the patented claim in open day on April 9th, 2008 that the applicant submitted on July 20th, 2007, publication number CN101158949, denomination of invention " based on the file items ranking of set and the method and system of retrieval " technical scheme of project set catalogue has for information about been proposed, in order to solve four above-mentioned problems.It is the patented claim of PCT/CN2009/072520, denomination of invention " polymerization of information project catalog aggregator and system " that the applicant has submitted application number to June 30 in 2009; The logical scheme of aggregation information project set catalogue has been proposed in this patented claim; But do not propose how to pass through network issued information project set catalogue, this makes that the realizability of scheme is not strong.
Summary of the invention
The objective of the invention is to address the above problem, a kind of delivery system of information project catalog aggregator is provided, make server and client side's information project catalog aggregator be able to synchronously, strengthened the realizability of information project catalog aggregator relevant programme.
Another object of the present invention is to provide a kind of dissemination method of information project catalog aggregator.
Technical scheme of the present invention is: the present invention has disclosed a kind of delivery system of information project catalog aggregator, comprising:
The catalogue publisher server further comprises:
The catalog data base memory module is used for storage and comprises: the information project catalog aggregator that is published, the corresponding renewal of this catalogue are stabbed;
Upgrade the log database memory module, be used for the each successful renewal operation of the information project catalog aggregator that is published stamped to upgrade stabbing, and it is stored as a more new record;
Upload the renewal assembly; Connect the catalog data base memory module and upgrade log database memory module and catalog data base compression snapshot memory module; Client is updated to the catalog data base memory module to the renewal operation of the information project catalog aggregator that is published and the information of the renewal operation of success is saved to upgrade the log database memory module, and when the renewal number of operations of the success of current accumulative total surpasses predetermined threshold value, generate one and compress snapshot and be saved to catalog data base and compress the snapshot memory module with the current content of catalog data base memory module;
Catalog data base compression snapshot memory module connects to upload and upgrades assembly and down loading updating assembly, is used for the compression snapshot of the content of storage directory database storing module;
The down loading updating assembly; Connect and upgrade log database memory module and catalog data base compression snapshot memory module; Utilize the more new record and the catalog data base that upgrade in the log database memory module to compress the compression snapshot in the snapshot memory module, the fit end upgrades the copy of the information project catalog aggregator that is published of client;
The server end communications component is used for establishing a communications link with client, fulfils the task of carrying out data transmit-receive with client;
Client, mutual through communication channel and this catalogue publisher server, further comprise:
The local directory memory module is used for comprising in client stores: the copy of the information project catalog aggregator that is published, the renewal that this copy is corresponding are stabbed;
Snapshot is downloaded and is upgraded Synchronization Component, connects the local directory memory module, utilizes the renewal daily record of catalogue publisher server or utilizes the copy of the information project catalog aggregator that is published of the compression snapshot update client of catalogue publisher server;
Updating task generates and submits to assembly, operates generating updating task and being committed to the catalogue publisher server according to the user;
Client communication component establishes a communications link with the catalogue publisher server, fulfils the task of carrying out data transmit-receive with server.
According to an embodiment of the delivery system of information project catalog aggregator of the present invention, this catalog data base memory module further comprises:
Information project set storage unit is the attribute regulation of the set membership between other information project set, this information project set in its sign of each information project set record in the information project catalog aggregator, this information project set and the information project catalog aggregator and the satellite information of other this information project set;
The information project storage unit, the information project set that it identifies for each information project record in the information project catalog aggregator, this information project is subordinate to, attribute and the attribute value of correspondence and the satellite information of other this information project that this information project has;
Upgrade and stab the unit, the renewal of record catalog data base memory module institute canned data project set catalogue is stabbed.
According to an embodiment of the delivery system of information project catalog aggregator of the present invention, upgrade many records that have the following information of record in the log database memory module: upgrade stamp, object type, sign, action type, operating parameter.
According to an embodiment of the delivery system of information project catalog aggregator of the present invention, this delivery system also comprises:
Retrieval component connects the local directory memory module, is used for doing search operaqtion at the information project catalog aggregator of client.
According to an embodiment of the delivery system of information project catalog aggregator of the present invention, this delivery system also comprises:
The catalogue polymerizing component connects the local directory memory module, is used for the information project catalog aggregator of client is done converging operation.
The present invention has also disclosed a kind of dissemination method of information project catalog aggregator, and dissemination method comprises that client uploads the process of upgrading operation and client downloads server issue catalogue upgrading the process of local directory copy,
Client is uploaded the process of upgrading operation and is further comprised:
Operating user interface according to client generates a updating task;
This updating task is committed to server;
Server is according to this updating task that receives; Many that comprise according to this task are upgraded the operation informations corresponding issue catalogue of this task of update service device successively; And when upgrading successfully, unit of increase is stabbed in the renewal of catalogue at every turn; And this is upgraded operation information stamp catalogue renewal this moment and stab to be saved to and upgrade daily record and form a more new record, upgrade daily record and stab through upgrading that to issue catalogue related with server;
If the successful renewal number of operations of the current accumulative total that this catalogue is corresponding surpasses predetermined threshold value, should issue catalogue and do a compression of reduced overall generation snapshot, and should count zero clearing;
Client downloads server issue catalogue further comprises with the process of upgrading the local directory copy:
The current update mode of client-requested querying server issue catalogue comprises the renewal stamp scope that the current renewal of server issue catalogue is stabbed and upgraded daily record;
After the renewal that server is issued catalogue is stabbed and the renewal scope of stabbing of upgrading daily record stabs relatively with the renewal of the local directory copy of client, the down loading updating daily record with download in the compression snapshot dual mode a kind of mode of selection and upgrade the local directory copy.
According to an embodiment of the dissemination method of information project catalog aggregator of the present invention, the more new record that upgrades in the daily record comprises: upgrade stamp, object type, sign, action type, operating parameter.
Embodiment according to the dissemination method of information project catalog aggregator of the present invention; After the renewal scope of stabbing that the renewal that server is issued catalogue is stabbed and this catalogue is upgraded daily record was stabbed relatively with the renewal of the local directory copy of client, the step of down loading updating local directory copy comprised that further three kinds of situation of branch carry out the catalogue renewal:
If the renewal of local directory copy is stabbed the renewal equal server issue catalogue and stabbed, upgrade the comparison of stamp after then waiting for one preset period again;
Old renewal in server issue catalogue is stabbed and required renewal operates in the renewal stamp scope of upgrading daily record if the renewal of local directory copy is stabbed, and then downloads required renewal daily record, the sequential update local directory copy that stabs according to the renewal of upgrading daily record again;
Old renewal in server issue catalogue is stabbed and required renewal is operated in the renewal stamp scope of not upgrading daily record if the renewal of local directory copy is stabbed, and then downloads compression snapshot and decompression to rebuild the local directory copy.
The present invention contrasts prior art has following beneficial effect: technical scheme of the present invention is that client is passed through communication channel and the catalogue publisher server is mutual; Issue catalogue on the server is downloaded to client terminal local set up local replica, and keep synchronously with issue catalogue update mode.In addition; Client will be uploaded to the catalogue publisher server for the retouching operation of issue catalogue; Upgrade to be kept at the catalogue that is published in the catalog data base memory module through ordering according to the order of sequence, and the renewal operation of success stamped to upgrade to stab to be recorded in upgrade in the log database memory module.
Description of drawings
Fig. 1 is the structural representation of embodiment of the delivery system of information project catalog aggregator of the present invention.
Fig. 2 is the structural representation of catalogue publisher server of the present invention.
Fig. 3 is the structural representation of client of the present invention.
Fig. 4 is the synoptic diagram of catalog data base memory module of the present invention.
Fig. 5 is the synoptic diagram of renewal log database memory module of the present invention.
Fig. 6 is that client of the present invention is uploaded the synoptic diagram that upgrades operation.
Fig. 7 is that client downloads server issue catalogue of the present invention is to upgrade the synoptic diagram of local directory copy.
Embodiment
Below in conjunction with accompanying drawing and embodiment the present invention is done further description.
Before introducing embodiments of the invention, need be to the explanation that makes an explanation of technical term involved in the present invention and technical background.
The information project catalog aggregator is the object that delivery system of the present invention need be handled.Information project is defined as and can be used as a logic integral body handled and showed the user on computer system information structure.File in the file system is a representative instance of information project, but does not have only file to be only information project.For example in the relational database to be recorded in physically be as the storage of the part of database file; But it can be used as in logic that an integral body is handled and shows to the user, so the record in the relational database also can be an example of information project.For example the envelope Email in this type of mail transmission/reception software of Outlook also is to store in the mailbox file as a part again, handle and show but also can be used as an integral body in logic, so Email also can be an example of information project.
Information project is gathered the set on the mathematical meaning of being made up of n information project, and n is the integer more than or equal to 0.In practical application, an information project set can comprise a plurality of information projects.
The information project catalog aggregator then is the information structure that is made up of through set membership n information project set, and n is the integer more than or equal to 0.The notion that superset closes is defined as: close if appointed information project set A is the superset of information project set B, then all information projects of comprising of B are also comprised by A, can claim that conversely B is the subclass of A.
Information project often comes unique representative with a sign in actual treatment, and for example a file in the operating system adopts unique file path to represent, and the page or leaf of throwing the net of one in the internet can be represented with unique URL.As long as designing the information project of suitable grammar rule any kind can come to identify uniquely with a text-string; So what store in the information project set in the practical application is the sign of representative information project body rather than the information itself that information project comprises; Therefore an information project set can comprise multiple information project, and an information project catalog aggregator can be used for management from the various types of information projects of a plurality of information sources.For example: an information project catalog aggregator is set on a PC is used to manage all kinds of local files and Email, simultaneously also can be with the wide range of information projects that comprises webpage of this directory management from different web sites on the internet.
The delivery system of information project catalog aggregator
See also Fig. 1 below, Fig. 1 shows the basic framework of the delivery system of information project catalog aggregator.Delivery system comprises two parts: catalogue publisher server and client.On the one hand, client is mutual through communication channel and catalogue publisher server, and the issue catalogue on the catalogue publisher server is downloaded to client, sets up local replica, and keeps upgrading synchronously with the issue catalogue.On the other hand, client will be uploaded to the catalogue publisher server to the retouching operation of issue catalogue, get into the updating task formation, upgrade being published catalogue in order, and the renewal operation of success stamped to upgrade to stab to be recorded in upgrade in the log database.
Fig. 2 shows the structure of catalogue publisher server.The catalogue publisher server comprises following module: catalog data base memory module 10, renewal log database memory module 11, catalog data base compress snapshot memory module 12, upload and upgrade assembly 13, down loading updating assembly 14 and server end communications component 15.Annexation between these modules is: server end communications component 15 connects uploads renewal assembly 13 and down loading updating assembly 14.Upload renewal assembly 13 and connect catalog data base memory module 10, renewal log database memory module 11, catalog data base compression snapshot memory module 12 respectively.Down loading updating assembly 14 connects renewal log database memory module 11 and catalog data base compression snapshot memory module 12 respectively.
A catalogue publisher server can be managed the renewal and the issue of a plurality of catalogues simultaneously.Needing independently for an independent catalogue, a cover compresses the data storage that snapshot memory module 12 constitutes by catalog data base memory module 10, renewal log database memory module 11 and catalog data base.This case subsequent content as no specified otherwise all be directed against be the issue catalogue situation.Catalog data base memory module 10 is used to store the information project catalog aggregator that is published and issues required and catalogue contact itself other information closely, and for example: the corresponding renewal of catalogue is stabbed.Angle from actual treatment; In an information project catalog aggregator, there are two kinds of objects; A kind of is the information project set, needs information recorded to have: the satellite information of the set membership in the sign of information project set, this information project set and the catalogue between the out of Memory project set, the attribute regulation of this information project set and other this information project set; Another kind is an information project; Need information recorded to have: the sign of information project, the information project set that this information project is subordinate in the information project catalog aggregator, attribute and the attribute value of correspondence and the satellite information of other this information project that this information project has.Fig. 4 shows the logical constitution of catalog data base memory module 10.According to above-mentioned analysis; Catalog data base memory module 10 will comprise two at least from seeing in logic; One be used for writing down each information project set of catalogue be called for information about that 100, one of storage unit of information project set are used for writing down each information project of catalogue be called information project storage unit 102 for information about.The data structure in the catalog data base in the actual realization is not represented in certain this division, only representes the formation in logic of the data component of catalog data base memory module.Consider the update mode that needs record issue catalogue in addition, catalog data base memory module 10 of the present invention has also increased the renewal of record renewal stamp information and has stabbed unit 104.Upgrade to stab and be used for characterizing the order status that catalogue is updated; In realization, upgrading stamp can be a natural number variable; To the once successful renewal operation of the every work of catalogue of catalog data base memory module 10 storages; Upgrade stabbing simultaneously increases by one immediately, and subsequently this information of upgrading operation is recorded in and upgrades the renewal of being adopted in the daily record data library module 11 and stab the renewal of catalogue that must be when executing this operation and stab in full accord.
Can be divided into to the renewal of information project set with to the renewal of information project according to the object difference that is directed against for the renewal of catalogue operation.Renewal operation to the information project set can be divided into again: increase an information project set; Delete an information project set; Revise existing in a catalogue information project set sign, it with catalogue in set membership, its attribute between the out of Memory project set stipulate and other satellite informations.Renewal operation to information project has: in catalogue, increase an information project (membership of the information project set in this information project and the catalogue promptly is set); Project of deletion from catalogue (promptly removing the membership between information project is gathered arbitrarily in this project and the catalogue); Revise an information project in the catalogue sign, it is in catalogue and the membership of information project set, attribute value and other satellite informations that it has.According to the common ground that upgrades operation; No matter once upgrade operation to information project set or information project; No matter carry out the renewal of which kind of content, can be with comprising: the type of upgating object, the sign of upgating object, upgrade operation types, a record upgrading fields such as the required several parameters of operation representes.Fig. 5 shows the data of upgrading log database memory module 11 and constitutes.For example article one of the renewal log database memory module 11 of Fig. 5 storage more new record be: upgrade stab be 101, the upgating object type is information project set, upgating object be designated " archives " (in actual treatment, often adopt one consistent with information project set intension and in this information project catalog aggregator scope unique name be referred to as the sign that information project is gathered, adopt this processing mode here just), action type is information such as modification and each operating parameter value.The renewal that only runs succeeded operation just can be recorded in to be upgraded in the daily record, and more the renewal of new record is stabbed and must stabbed consistent with the renewal of the catalog data base memory module 10 in the moment that executes this operation.For just in the synchronous process of client directory copy and server issue catalogue inquiry upgrade the more new record that stabs in certain section scope, in the actual treatment often more new record be stored in by the mode of upgrading the stamp order and upgrade in the log database memory module 11.
In realization owing to receive the restriction of server physical storage capacity allocation; And client and server adopt daily record to upgrade the constraint of the aspects such as time performance of synchronizing process; Often need be for upgrading the upper limit that log database memory module 11 be provided with a capacity, promptly multipotency holds more new record of how many bars.When upgrading log database memory module 11 and reaching maximum size, as new renewal operation information send to just need eliminate when preserving the oldest some more new record just upgrade and stab a minimum batch record to prevent to upgrade the restriction that log database memory module 11 exceeds capacity.And the update mode that may cause the client directory copy like this exceeds the coverage of upgrading daily record; Just adopt the renewal daily record can't make client directory copy and server issue catalogue become consistent update mode synchronously, this programme adopts the compression snapshot to solve this problem.The compression snapshot refers to the information that catalog data base memory module 10 is preserved here and does an as a whole information compressed storage that obtains through the lossless compress process.Owing to the content of catalog data base memory module 10 can change along with a series of renewals operations subsequently, so be referred to as to compress snapshot to the compression memory of the content of the catalog data base memory module 10 that on certain time point, obtains.Obviously; Utilize the compression snapshot can recover to obtain the entirety of corresponding time point catalog data base memory module 10, so when the update mode of client directory copy exceeds the scope that the renewal daily record of server this issue catalogue can cover, just can pass through decompress(ion) reconstruction client directory copy by the up-to-date compression snapshot of the direct download of client through decompression procedure.In actual treatment, consider and wholely upload the time performance problem of upgrading operating process and from the angle of conserve storage; Can not every execution once upgrade operation and just generate a compression snapshot, mode is that one of regeneration compresses snapshot after accumulative total is carried out the renewal operation of some preferably.Upgrade increment counter so can be provided with one, initial value is set to 0, and the renewal operational counter that every execution is once successful adds 1, when count value arrives predetermined threshold value, generates one and compresses snapshot and with counter O reset.Along with the issue catalogue is brought in constant renewal in, a series of compression snapshots will be generated and will be stored in the catalog data base compression snapshot memory module 12 like this.See that from access logic compression snapshot memory module 12 can be organized these compression snapshots according to stack architexture, the promptly new snapshot that produces is placed in stack top, and old compression snapshot is more near at the bottom of the stack.The purpose of doing like this is when client-requested is downloaded up-to-date compression snapshot, can find up-to-date compression snapshot rapidly through stack top.Old compression snapshot is not eliminated immediately in compression snapshot memory module 12; This is because old compression snapshot possibly be in by in the process of a plurality of client downloads, because these clients newer compression snapshot when beginning to propose to download the compression snapshot request does not also produce.So compression snapshot of storage or be up-to-date in the compression snapshot memory module 12; It is the old compression snapshot that is in the state of being downloaded; In case the snapshot that detects certain Geju City just can be with its deletion from compression snapshot memory module 12 not by client downloads.
On the basis of three above-mentioned memory modules, uploading the function of upgrading assembly 13 is catalog data base memory module 10, renewal log database memory module 11 and the catalog data base compression snapshot memory module 12 that client is write server to the renewal operation of issue catalogue.The function of down loading updating assembly 14 is fit ends, makes client the catalogue of server issue is downloaded to client and generates a copy at client terminal local, and keep the synchronous of update mode with server issue catalogue.Particularly, the copy that adopts the more new record that upgrades in the log database memory module 11 and the compression snapshot in the catalog data base compression snapshot memory module 12 to upgrade the issue catalogue of client according to the update mode of this locality issue catalogue copy exactly.
Fig. 3 shows the detailed structure of client.Client comprises following assembly: local directory memory module 20, snapshot are downloaded and are upgraded Synchronization Component 21, updating task generation and submit assembly 22, client communication component 23, catalog search assembly 24 (optional) and catalogue polymerizing component 25 (optional) to.Annexation between these assemblies is: client communication component 23 connects updating task respectively and generates and submit to assembly 22 and snapshot to download and renewal Synchronization Component 21.Local directory memory module 20 connects the snapshot download respectively and upgrades Synchronization Component 21, retrieval component 24 and catalogue polymerizing component 25.
Local directory memory module 20 is used for stabbing in the renewal of the copy of client storage server issue catalogue, this copy correspondence, and its data constitute consistent with the catalog data base memory module 10 of server, referring to Fig. 4.Snapshot is downloaded and is upgraded the process that Synchronization Component 21 is used for downloading from the catalogue publisher server issue catalogue, utilizes the renewal daily record of catalogue publisher server or utilizes the copy of the information project catalog aggregator that is published of the compression snapshot update client of catalogue publisher server.And updating task generates and submit to assembly 22 to be used for client is committed to the process of catalogue publisher server to the retouching operation of issue catalogue, is to operate according to the user to generate updating task and be committed to the catalogue publisher server.Client communication component 23 is responsible for establishing a communications link with the catalogue publisher server, fulfils the task of carrying out data transmit-receive with server.
Client also comprises optional retrieval component 24, is used for doing search operaqtion at the information project catalog aggregator of client.The content of concrete search operaqtion is in the application of CN101158949 at applicant's publication number.
Client also comprises optional catalogue polymerizing component 25, is used for the information project catalog aggregator of client is done converging operation.The catalogue polymerization does not relate to the mutual of server and client side, and the international application no that its particular content applicant applied on June 30th, 2009 is open during the PCT of PCT/CN2009/072520 applies for.Particularly, the step that catalogue polymerizing component 25 is realized is: the first step is provided with the catalogue of initial results catalogue for being made up of 0 information project set, i.e. empty list.Second step was provided with n the priority between source information project set catalogue according to actual needs, and in this order n source information project set directory group is made into formation, and n is more than or equal to 1.The 3rd step; Judge whether formation is empty; If formation is object information project set catalogue empty then that end process the most finally obtains the current results catalogue, if formation non-NULL then get the head of the queue element as the current source information project set catalogue that will handle, and the head of the queue element would be made team's operation.In the 4th step, source information project set catalogue and the current results information project catalog aggregator that will work as pre-treatment aggregate into new object information project set catalogue (as next round-robin current results information project catalog aggregator), turn back to for the 3rd step then.Wherein the 4th step was a core, and its concrete operations are one by one each project set the source information project set catalogue to be mapped in the object information project set catalogue according to predefined mapping ruler according to a definite sequence from root set beginning.At every turn independently in the map operation, the project set that is being processed in the source information project set catalogue is called the source information project set, and the source information project set is mapped to project set corresponding in the result list and is called the destination item set.Have two kinds of possibility situation for each map operation: a kind of situation is according to existing unique destination item set and source item set corresponding in the predefine mapping ruler current results catalogue, then writing down these mapping relations; Another kind of situation is in the current results catalogue, not have the destination item set corresponding with the source item set according to the predefine mapping ruler; Then in result list, create corresponding that a new project set is gathered as destination item and source item is gathered; The superset of new destination item set closes to be appointed as source item and to be integrated into superset in the source directory and to close and be mapped to destination item set corresponding in the result list, and writes down this mapping relations.In order to reach the catalogue regulation of aggregation information project: the source item set comprises be subordinate to directly that project becomes the destination item set directly be subordinate to project.
In practical implementation, need in result list, find the intension unique destination item set consistent, and the project that directly is subordinate in the source item set is converged in the destination item set with it for a source item set.Judge the intension of destination item set gathers with source item whether consistent standard is exactly the predefine mapping ruler.For example in practical application, all got the title of representing its intension for each information project set; Be used for depositing the set of video information items purpose information project and be named as " video "; The information project set that is used for depositing the audio-frequency information project is named as " audio frequency " or the like, then in a catalog aggregator, can not have two project sets of the same name.Therefore can predefine mapping ruler of the same name, promptly in result list, find project set with source item set same names as corresponding destination item set, and it directly is subordinate to project converges in the destination item set.If in the current results catalogue, do not find the project set of same names; Then being illustrated in does not have the consistent project set of intension and source item set in the current results catalogue, need then to create in the result list that a new project set adopts identical title and the project that directly is subordinate to that source item is gathered converges wherein.
The whole structure of doing generation like this is the project that the consistent information project set from a plurality of intensions of multiple source information project catalog aggregator comprises to be converged in the unified project set in the result list go, just can be with these from different information sources but the information project that belongs to same intension is done as a whole the retrieval in result list.
Client is uploaded the process of upgrading operation
Fig. 6 shows client and uploads the process of upgrading operation.This process mainly is by the updating task generation of client and submits to uploading in assembly 22 and the catalogue publisher server to upgrade assembly 13 cooperation completion.At first; Updating task by client generates and submits to assembly 22 to transform updating task of generation (updating task can be regarded the renewal sequence of operation of being made up of many renewal operations as) according to the users'interfaces service data, and the updating task of redispatching is to server.In each issue catalogue of server end corresponding updating task formation is arranged all.Server receives after the updating task that client sends that to put it into corresponding updating task rear of queue etc. pending.Other has the updating task handling procedure to take out updating task from the head of updating task formation successively; According in the updating task many upgrade the issue catalogue that sequence of operation updates stored in catalog data base memory module 10, and after each successful renewal operation, the renewal stamp of correspondence is added one.Subsequently the renewal that runs succeeded in updating task operation is stamped corresponding renewal according to new sequences more and stab, and be recorded in and upgrade in the daily record (be stored in and upgrade log database memory module 11) (promptly writing the step of upgrading daily record).(possible information has: which upgrades to operate and runs succeeded server in the updating task to client loopback updating task execution result after writing the renewal daily record; Which upgrades operation is carried out failure etc.); Client is carried out some processing to the result after receiving execution result, for example: eject prompting frame and inform which renewal operation failure of user.
Behind loopback updating task execution result, this updating task is upgraded the increment accumulative total of stabbing to catalog data base and is got into a renewal increment counter.When this counter surpasses pre-set threshold; Empty counter; And catalog data base memory module 10 current contents are done generate a compression snapshot after the reduced overall, will compress snapshot again and be pressed into the stack top that catalog data base compresses the stack architexture of snapshot memory module 12.
Client downloads server issue catalogue is to upgrade the process of local directory copy
Fig. 7 shows the process of client downloads server issue catalogue.This process is by the snapshot download of the down loading updating assembly 14 of catalogue publisher server and client and upgrades 21 common cooperations of Synchronization Component and accomplish.At first; Client is created a timer; Timer triggers update mode inspection flow process at interval according to certain hour: the current update mode of client-requested catalogue publisher server inquiry corresponding issue catalogue; Scope (latest update of promptly upgrading the more new record in the log database memory module 11 is stabbed and the oldest renewal stamp) is stabbed in the renewal that comprises the current renewal stamp of issue catalogue (being the renewal stamp in the catalog data base memory module 10), renewal log record; Update mode with itself and local directory copy compares again, and three kinds of following situation are arranged.The 1st kind of situation is that the local directory copy upgrades the renewal stamp that stamp equals server issue catalogue, and just both update modes are consistent, then return timer program, carry out the update mode inspection after waiting for a period of time again.The 2nd kind of situation is that local directory copy ratio is issued old (that is old renewal stamp in the issue catalogue is stabbed in the renewal of local directory copy) of catalogue and required more new increment daily record (takes to upgrade stamp way relatively) equally in the recording interval of renewal log database memory module 11; Then download required more new increment daily record; The sequential update local directory copy that stabs according to the renewal of upgrading journal entry again, consistent until the update mode of the issue catalogue of the update mode of local directory copy when before checking.Consider that client issue catalogue when carrying out above-mentioned flow process may meet with new renewal (maybe be from other clients, also maybe from this client), so flow process forwards the inquiry of the update mode of issue catalogue to subsequently.The 3rd kind of situation is that the local directory copy is issued the old but required more new increment daily record of catalogue not in the recording interval of upgrading log database memory module 11 (this situation comprises a kind of special situation: client is not also set up the situation of local directory copy) than server.In this case, client can't use the renewal daily record to upgrade the local directory copy, therefore needs to download the compression snapshot that up-to-date server is issued the database of catalogue, and decompression is to rebuild the local directory copy.Always be placed on the top of the stack architexture of catalog data base compression snapshot memory module 12 at the compression snapshot of the catalog data base of the up-to-date establishment of catalogue publisher server, when the up-to-date catalogue compression snapshot of client-requested, only need compression snapshot with stack top send client to and get final product.Consider that non-up-to-date compression snapshot also possibly be in the state of being downloaded, so non-stack top compression snapshot is adopted the mechanism of progressively eliminating.
For the ease of understanding; For the differentiation of above-mentioned 3 kinds of situation is exemplified below: suppose to adopt the natural number sequence number to stab as upgrading; It is 216 that the renewal of the issue catalogue on the existing server is stabbed; The renewal stamp scope of the renewal daily record that it is corresponding is 101 to 216 (according to the explanation that stab renewal this case front, can know that the renewal of current issue catalogue is stabbed inevitable consistent with the renewal stamp upper limit of upgrading daily record).If it is 216 that the renewal of certain client terminal local catalogue copy is stabbed, can know that through stabbing contrast the update mode of client local directory copy is consistent with the issue catalogue with the renewal of server issue catalogue, this is described the 1st kind of situation of epimere just.If the renewal of client terminal local catalogue copy is stabbed within 100 to 215 scopes (promptly more than or equal to 100; And be less than or equal to 215); More do not wait with the renewal stamp of issue catalogue; To upgrade subsequently and stab and to add 1 and (add 1 purpose and be the lower limit that the renewal of obtaining required incremental update record is stabbed; For example to stab be 100 in the renewal of client terminal local catalogue copy, and the required renewal stamp scope that is used for upgrading the renewal log record of local directory copy is 101 to 216) again with upgrade daily record and upgrade the stamp scope and relatively obtain and said the 2nd kind of result that situation is complementary of epimere.If the renewal of client terminal local catalogue copy is stabbed less than 100; Can confirm relatively that through same method the update mode of client terminal local catalogue copy both had been not equal to the update mode of server issue catalogue, and also this described the 3rd kind of situation of epimere just in upgrading the scope that daily record covered not.
The foregoing description provides to those of ordinary skills and realizes or use of the present invention; Those of ordinary skills can be under the situation that does not break away from invention thought of the present invention; The foregoing description is made various modifications or variation; Thereby protection scope of the present invention do not limit by the foregoing description, and should be the maximum magnitude that meets the inventive features that claims mention.
Claims (7)
1. the delivery system of an information project catalog aggregator comprises:
The catalogue publisher server further comprises:
The catalog data base memory module is used for storage and comprises: the information project catalog aggregator that is published, the corresponding renewal of this catalogue are stabbed;
Upgrade the log database memory module, be used for the each successful renewal operation of the information project catalog aggregator that is published stamped to upgrade stabbing, and it is stored as a more new record;
Upload the renewal assembly; Connect the catalog data base memory module and upgrade log database memory module and catalog data base compression snapshot memory module; Client is updated to the catalog data base memory module to the renewal operation of the information project catalog aggregator that is published and the information of the renewal operation of success is saved to upgrade the log database memory module, and when the renewal number of operations of the success of current accumulative total surpasses predetermined threshold value, generate one and compress snapshot and be saved to catalog data base and compress the snapshot memory module with the current content of catalog data base memory module;
Catalog data base compression snapshot memory module connects to upload and upgrades assembly and down loading updating assembly, is used for the compression snapshot of the content of storage directory database storing module;
The down loading updating assembly; Connect and upgrade log database memory module and catalog data base compression snapshot memory module; Utilize the more new record and the catalog data base that upgrade in the log database memory module to compress the compression snapshot in the snapshot memory module, the fit end upgrades the copy of the information project catalog aggregator that is published of client;
The server end communications component is used for establishing a communications link with client, fulfils the task of carrying out data transmit-receive with client;
Client, mutual through communication channel and this catalogue publisher server, further comprise:
The local directory memory module is used for comprising in client stores: the copy of the information project catalog aggregator that is published, the renewal that this copy is corresponding are stabbed;
Snapshot is downloaded and is upgraded Synchronization Component, connects the local directory memory module, utilizes the renewal daily record of catalogue publisher server or utilizes the copy of the information project catalog aggregator that is published of the compression snapshot update client of catalogue publisher server;
Updating task generates and submits to assembly, operates generating updating task and being committed to the catalogue publisher server according to the user;
Client communication component establishes a communications link with the catalogue publisher server, fulfils the task of carrying out data transmit-receive with server.
2. the delivery system of information project catalog aggregator according to claim 1 is characterized in that, this catalog data base memory module further comprises:
Information project set storage unit is the attribute regulation of the set membership between other information project set, this information project set in its sign of each information project set record in the information project catalog aggregator, this information project set and the information project catalog aggregator and the satellite information of other this information project set;
The information project storage unit, the information project set that it identifies for each information project record in the information project catalog aggregator, this information project is subordinate to, attribute and the attribute value of correspondence and the satellite information of other this information project that this information project has;
Upgrade and stab the unit, the renewal of record catalog data base memory module institute canned data project set catalogue is stabbed.
3. the delivery system of information project catalog aggregator according to claim 1 is characterized in that, upgrades many records that have the following information of record in the log database memory module: upgrade stamp, object type, sign, action type, operating parameter.
4. the delivery system of information project catalog aggregator according to claim 1 is characterized in that, this delivery system also comprises:
Retrieval component connects the local directory memory module, is used for doing search operaqtion at the information project catalog aggregator of client.
5. the delivery system of information project catalog aggregator according to claim 1 is characterized in that, this delivery system also comprises:
The catalogue polymerizing component connects the local directory memory module, is used for the information project catalog aggregator of client is done converging operation.
6. the dissemination method of an information project catalog aggregator, dissemination method comprise that client uploads the process of upgrading operation and client downloads server issue catalogue upgrading the process of local directory copy,
Client is uploaded the process of upgrading operation and is further comprised:
Operating user interface according to client generates a updating task;
This updating task is committed to server;
Server is according to this updating task that receives; Many that comprise according to this task are upgraded the operation informations corresponding issue catalogue of this task of update service device successively; And when upgrading successfully, unit of increase is stabbed in the renewal of catalogue at every turn; And this is upgraded operation information stamp catalogue renewal this moment and stab to be saved to and upgrade daily record and form a more new record, upgrade daily record and stab through upgrading that to issue catalogue related with server;
If the successful renewal number of operations of the current accumulative total that this catalogue is corresponding surpasses predetermined threshold value, should issue catalogue and do a compression of reduced overall generation snapshot, and the successful renewal number of operations zero clearing of the current accumulative total that this catalogue is corresponding;
Client downloads server issue catalogue further comprises with the process of upgrading the local directory copy:
The current update mode of client-requested querying server issue catalogue comprises the renewal stamp scope that the current renewal of server issue catalogue is stabbed and upgraded daily record;
The renewal that server is issued catalogue is stabbed and the renewal of upgrading daily record stab scope and the renewal of the local directory copy of client stab compare after; Select a kind of mode to upgrade the local directory copy in the down loading updating daily record with downloading in the compression snapshot dual mode, wherein divide three kinds of situation to carry out catalogue and upgrade:
If the renewal of local directory copy is stabbed the renewal equal server issue catalogue and stabbed, upgrade the comparison of stamp after then waiting for one preset period again;
Old renewal in server issue catalogue is stabbed and required renewal operates in the renewal stamp scope of upgrading daily record if the renewal of local directory copy is stabbed, and then downloads required renewal daily record, the sequential update local directory copy that stabs according to the renewal of upgrading daily record again;
Old renewal in server issue catalogue is stabbed and required renewal is operated in the renewal stamp scope of not upgrading daily record if the renewal of local directory copy is stabbed, and then downloads compression snapshot and decompression to rebuild the local directory copy.
7. the dissemination method of information project catalog aggregator according to claim 6 is characterized in that, the more new record that upgrades in the daily record comprises: upgrade stamp, object type, sign, action type, operating parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910196048.3A CN102024005B (en) | 2009-09-22 | 2009-09-22 | Issuance system and method of information item set directories |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910196048.3A CN102024005B (en) | 2009-09-22 | 2009-09-22 | Issuance system and method of information item set directories |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102024005A CN102024005A (en) | 2011-04-20 |
| CN102024005B true CN102024005B (en) | 2012-11-07 |
Family
ID=43865308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910196048.3A Expired - Fee Related CN102024005B (en) | 2009-09-22 | 2009-09-22 | Issuance system and method of information item set directories |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102024005B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103064833B (en) * | 2011-10-18 | 2016-03-16 | 阿里巴巴集团控股有限公司 | A kind of method and system of Clean Up Database historical data |
| CN103491113B (en) * | 2012-06-11 | 2018-06-08 | 腾讯科技（深圳）有限公司 | A kind of synchronous method, the apparatus and system of information fusion file |
| CN103092745B (en) * | 2013-01-22 | 2016-04-13 | 中兴通讯股份有限公司 | The control method of system journal record and device |
| CN104424314B (en) * | 2013-09-06 | 2019-06-11 | Sap欧洲公司 | Column-shaped table wide area information server is operated |
| CN104639592B (en) * | 2013-11-15 | 2018-09-28 | 华为技术有限公司 | Information synchronization method and system and cloud storage gateway between cloud storage gateway |
| US11003740B2 (en) * | 2013-12-31 | 2021-05-11 | International Business Machines Corporation | Preventing partial change set deployments in content management systems |
| CN106656522A (en) * | 2015-10-28 | 2017-05-10 | 中国移动通信集团公司 | Data calculation method and system of cross-data center |
| CN108280080B (en) * | 2017-01-06 | 2022-02-22 | 阿里巴巴集团控股有限公司 | Data synchronization method and device and electronic equipment |
| CN108228694B (en) * | 2017-06-30 | 2024-10-22 | 勤智数码科技股份有限公司 | Directory generation method based on refined data item |
| CN109582431A (en) * | 2018-12-25 | 2019-04-05 | 杭州达现科技有限公司 | A kind of the catalogue update method and device of display interface |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040167941A1 (en) * | 2001-09-28 | 2004-08-26 | Anand Prahlad | System and method for archiving objects in an information store |
| CN101146111A (en) * | 2007-10-19 | 2008-03-19 | 深圳市迅雷网络技术有限公司 | A file download method and device |
| CN101197700A (en) * | 2006-12-05 | 2008-06-11 | 阿里巴巴公司 | Method and system for providing log service |
-
2009
- 2009-09-22 CN CN200910196048.3A patent/CN102024005B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040167941A1 (en) * | 2001-09-28 | 2004-08-26 | Anand Prahlad | System and method for archiving objects in an information store |
| US20070033237A1 (en) * | 2001-09-28 | 2007-02-08 | Anand Prahlad | System and method for archiving objects in an information store |
| CN101197700A (en) * | 2006-12-05 | 2008-06-11 | 阿里巴巴公司 | Method and system for providing log service |
| CN101146111A (en) * | 2007-10-19 | 2008-03-19 | 深圳市迅雷网络技术有限公司 | A file download method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102024005A (en) | 2011-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102024005B (en) | Issuance system and method of information item set directories | |
| CN102917020B (en) | A kind of method of mobile terminal based on packet and operation system data syn-chronization | |
| CN103020315B (en) | A kind of mass small documents storage means based on master-salve distributed file system | |
| CN102880531B (en) | Database backup system and backup method and slave database server of database backup system | |
| US7805416B1 (en) | File system query and method of use | |
| EP2281242B1 (en) | Managing storage of individually accessible data units | |
| CN101866305B (en) | Continuous data protection method and system supporting data inquiry and quick recovery | |
| US7783615B1 (en) | Apparatus and method for building a file system index | |
| CN103023982B (en) | Low-latency metadata access method of cloud storage client | |
| US8135763B1 (en) | Apparatus and method for maintaining a file system index | |
| US10866955B2 (en) | Storing multi-level metadata in database systems | |
| CN103605698A (en) | Cloud database system used for distributed heterogeneous data resource integration | |
| CN102857570A (en) | Cloud synchronized method of files and cloud storage server | |
| CN102882985A (en) | File sharing method based on cloud storage | |
| CN102193917A (en) | Method and device for processing and querying data | |
| CN101923571B (en) | Method and device for managing terminal data logging | |
| CN102880663A (en) | Optimization of a partially deduplicated file | |
| CN103678494A (en) | Method and device for client side and server side data synchronization | |
| CN103154943A (en) | Enterprise-based searching of new and updated data | |
| WO2020172614A1 (en) | Multi-level metadata in database systems | |
| CN105099780A (en) | Automatic file publishing or upgrading method and system thereof | |
| CN101594256A (en) | Disaster recovery method, device and system | |
| CN109144785A (en) | Method and apparatus for Backup Data | |
| CN104838379A (en) | Database synchronization | |
| CN103353901A (en) | Orderly table data management method and system based on Hadoop distributed file system (HDFS) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121107 Termination date: 20150922 |
|
| EXPY | Termination of patent right or utility model |