CN109218340A - A kind of online data citation system - Google Patents

A kind of online data citation system Download PDF

Info

Publication number
CN109218340A
CN109218340A CN201710512937.0A CN201710512937A CN109218340A CN 109218340 A CN109218340 A CN 109218340A CN 201710512937 A CN201710512937 A CN 201710512937A CN 109218340 A CN109218340 A CN 109218340A
Authority
CN
China
Prior art keywords
data
server
metadata
node
total
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710512937.0A
Other languages
Chinese (zh)
Inventor
张�杰
赵俊超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Cloud Education Information Technology Co Ltd
Original Assignee
Shanghai Cloud Education Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Cloud Education Information Technology Co Ltd filed Critical Shanghai Cloud Education Information Technology Co Ltd
Priority to CN201710512937.0A priority Critical patent/CN109218340A/en
Publication of CN109218340A publication Critical patent/CN109218340A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

The invention discloses a kind of online datas to be cited system, including a director server and multiple node servers, the director server include total storage device and total monitoring device, and the node server includes node storage device and monitoring nodes device;When total monitoring device receives the synchronization request of node server transmission, the catalogue and metadata of more new data guarantee two places information unification;The directory information that director server saves includes the source of data, version number and description metadata;When total monitoring device receives the inquiry and retrieval request of user, local directory is retrieved, data information is returned into user.The present invention may be implemented the consistency of director server and each node server data metadata and be cited identifier access corresponding data source by data.

Description

A kind of online data citation system
Technical field
The present invention relates to a kind of system, specifically a kind of online data is cited system.
Background technique
It is synchronous that metadata can be realized between server by data interaction, and metadata may be implemented in monitoring device Actively and passively synchronize.
User can be cited identifier by data, access data source on the internet.
Here term " data citation " refers to the data quoted in paper, is cited identifier, Yong Huke by data Data source to be accessed on the internet.
Here term " server " refers to the data storage cell with metadata for storing data.Institute in this application The director server and node server stated are exactly the data storage cell for realizing data citation.
The metadata information of other side's data can be obtained by monitoring device interaction between server, realize data more Place as it can be seen that and metadata it is consistent.
When one server data metadata updates, by monitoring device and the interaction of other servers, other are synchronized The data metadata information of server.
Server periodically passes through monitoring device, synchronizes the data metadata information of each server.
Summary of the invention
The purpose of the present invention is to provide a kind of online datas to be cited system, to solve mentioned above in the background art ask Topic.
To achieve the above object, the invention provides the following technical scheme:
A kind of online data citation system, including a director server and multiple node servers, the director server include total Storage device and total monitoring device, the node server include node storage device and monitoring nodes device;Total monitoring When device receives the synchronization request of node server transmission, the catalogue and metadata of more new data guarantee two places metadata letter Breath is unified;The directory information that director server saves includes the source of data, version number and description metadata;Total monitoring device connects When receiving the inquiry and retrieval request of user, local directory is retrieved, data information is returned into user;Total monitoring device receives When the data access request of user, monitoring nodes device where user's request is forwarded to data according to local directory information;Institute When stating total monitoring device and receiving the request of user, monitoring nodes device issues metadata synchronization request where to data, will save Total storage device and more new directory is written in the metadata that point server returns;Version updating occurs for the data of the node server When, Directory Synchronization request is sent to total monitoring device, by catalogue and metadata updates;The monitoring nodes device receives total clothes When the synchronization request of business device, metadata is returned into director server and more new directory.
As a further solution of the present invention: the director server periodic synchronization data are cited node server metadata.
As a further solution of the present invention: the data metadata that the director server has been cited will not take with node The deletion for device data of being engaged in and delete, data citation director server, which can save, is currently cited the metadata of versions of data.
As further scheme of the invention: when the director server stops the write-in to total storage device, The director server stops receiving data from outside.
Compared with prior art, the beneficial effects of the present invention are: director server and each node clothes may be implemented in the present invention Be engaged in device data metadata consistency and by data be cited identifier access corresponding data source.
Detailed description of the invention
Fig. 1 is that online data is cited system interior joint server to director server update metadata information flow chart.
Fig. 2 is that director server periodically actively updates metadata information flow chart in online data citation system.
Fig. 3 is that data are cited product process figure in online data citation system.
Fig. 4 is that data are cited browsing process figure in online data citation system.
Fig. 5 is the structural schematic diagram that online data is cited system.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
Please refer to Fig. 1~5, in the embodiment of the present invention, a kind of online data is cited system, including a director server and more A node server, the director server include total storage device and total monitoring device, and the node server includes that node is deposited Storage device and monitoring nodes device;When total monitoring device receives the synchronization request of node server transmission, more new data Catalogue and metadata, guarantee two places information unification;Director server save directory information include data source, version number and Description metadata;When total monitoring device receives the inquiry and retrieval request of user, local directory is retrieved, data information is returned Back to user;When total monitoring device receives the data access request of user, user is requested to forward according to local directory information Monitoring nodes device where to data;When total monitoring device receives the request of user, monitoring nodes dress where to data Sending data synchronization request is set, total storage device is written in the metadata that node server is returned;The number of the node server When according to version updating occurs, Directory Synchronization request is sent to total monitoring device, by catalogue and metadata updates;The monitoring nodes When device receives the synchronization request of director server, metadata is returned into director server.
The director server periodic synchronization data are cited node server metadata.
The data that the director server has been cited will not be deleted with the deletion of node server data, data citation Director server can save the metadata for being currently cited versions of data.
When the director server stops the write-in to total storage device, the director server stops receiving from outside Data.
The process of the execution of master and slave node is described with reference to the accompanying drawing.
1. node server updates metadata information process to director server:
See Fig. 1, which, which is node server, updates metadata information process to director server:
When data citation node server generates update, request is issued to data citation director server, if data citation is total Server is normal, requests successfully, and the data metadata of update is sent to director server by node server, and director server is by first number Disk is written according to updating, and more new directory, process terminate;
When data are cited under director server abnormal conditions, then the flag bit that marks the data metadata of new version whether normally to update Abnormal, then whether the monitoring device of starter node server, periodic test director server restore normal.
In the case where data are cited director server abnormal conditions, if there is data update again, because of labeled exception, number Whether according to only can be in local update with metadata, and it be normal to continue cyclic check director server.
When periodic test to director server restores normal, by data metadata, normally whether label is set as normal Afterwards, local data metadata information is updated to director server.
2. data citation director server periodically actively updates metadata information process
See Fig. 2, each node server under normal circumstances, director server periodically to each monitoring nodes device send metadata updates Data metadata information is returned to director server by request, each node server, and director server updates local metadata and catalogue Information, and the time for marking abnormal data last time to update.
Under node server abnormal conditions, director server marks abnormal data, and maintaining the latest update time is upper one It is secondary to update the normal time, until next subnormal update.
Under node server abnormal conditions, director server label is abnormal, and more frequently being periodic test node takes Whether business device is normal.
3. data are cited product process
See Fig. 3, when user issues data citation request, data citation node server receives request, and takes to total node Business device sends request, and by data metadata and citation information write-in director server disk, final data is cited director server and generates Data citation identifier simultaneously returns to user;
4. data are cited browsing process
Fig. 4 is seen, when user, which is cited identifier by data, accesses data, if data are the newest of node server corresponding data User is navigated to the data source of respective nodes server by version, director server;
When the data updated version of node server, director server is cited the version information in identifier according to data, User is navigated into the data source version that node server is saved when identifier generates.
It is obvious to a person skilled in the art that invention is not limited to the details of the above exemplary embodiments, Er Qie In the case where without departing substantially from spirit or essential attributes of the invention, the present invention can be realized in other specific forms.Therefore, no matter From the point of view of which point, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the present invention is by appended power Benefit requires rather than above description limits, it is intended that all by what is fallen within the meaning and scope of the equivalent elements of the claims Variation is included within the present invention.Any reference signs in the claims should not be construed as limiting the involved claims.
In addition, it should be understood that although this specification is described in terms of embodiments, but not each embodiment is only wrapped Containing an independent technical solution, this description of the specification is merely for the sake of clarity, and those skilled in the art should It considers the specification as a whole, the technical solutions in the various embodiments may also be suitably combined, forms those skilled in the art The other embodiments being understood that.

Claims (4)

1. a kind of online data is cited system, which is characterized in that described total including a director server and multiple node servers Server includes total storage device and total monitoring device, and the node server includes node storage device and monitoring nodes dress It sets;When total monitoring device receives the synchronization request of node server transmission, the catalogue and metadata of more new data guarantee Two places information unification;The directory information that director server saves includes the source of data, version number and description metadata;Total monitoring When device receives the inquiry and retrieval request of user, local directory is retrieved, data information is returned into user;Total monitoring device When receiving the data access request of user, monitoring nodes where user's request is forwarded to data according to local directory information are filled It sets;When total monitoring device receives the request of user, monitoring nodes device issues data synchronization request where to data, will Total storage device, and more new directory is written in the metadata that node server returns;Version occurs for the data of the node server When update, Directory Synchronization request is sent to total monitoring device, by catalogue and metadata updates;The monitoring nodes device receives When the synchronization request of director server, metadata is returned into director server and more new directory.
2. online data according to claim 1 is cited system, which is characterized in that the director server periodic synchronization data It is cited node server metadata.
3. online data according to claim 1 is cited system, which is characterized in that the member that the director server has been cited Data will not be deleted with the deletion of node server metadata, and data citation director server, which can save, is currently cited data The metadata of version.
4. online data according to claim 1 is cited system, which is characterized in that when the director server stops to described When the write-in of total storage device, the director server stops receiving data from outside.
CN201710512937.0A 2017-06-29 2017-06-29 A kind of online data citation system Pending CN109218340A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710512937.0A CN109218340A (en) 2017-06-29 2017-06-29 A kind of online data citation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710512937.0A CN109218340A (en) 2017-06-29 2017-06-29 A kind of online data citation system

Publications (1)

Publication Number Publication Date
CN109218340A true CN109218340A (en) 2019-01-15

Family

ID=64960511

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710512937.0A Pending CN109218340A (en) 2017-06-29 2017-06-29 A kind of online data citation system

Country Status (1)

Country Link
CN (1) CN109218340A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493831A (en) * 2008-01-22 2009-07-29 图尼维齐公司 System and methods for the remote measurement of a person's biometric data in a controlled state by way of synchronized music, video and lyrics
CN102204218A (en) * 2011-05-31 2011-09-28 华为技术有限公司 Data processing method, buffer node, collaboration controller, and system
CN102307221A (en) * 2011-03-25 2012-01-04 国云科技股份有限公司 Cloud storage system and implementation method thereof
CN103605803A (en) * 2013-12-09 2014-02-26 中山爱科数字家庭产业孵化基地有限公司 Method for acquiring environmental-protection scientific and technological resources
US9116819B2 (en) * 2012-10-17 2015-08-25 Datadirect Networks, Inc. Reducing metadata in a write-anywhere storage system
CN106599308A (en) * 2016-12-29 2017-04-26 郭晓凤 Distributed metadata management method and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101493831A (en) * 2008-01-22 2009-07-29 图尼维齐公司 System and methods for the remote measurement of a person's biometric data in a controlled state by way of synchronized music, video and lyrics
CN102307221A (en) * 2011-03-25 2012-01-04 国云科技股份有限公司 Cloud storage system and implementation method thereof
CN102204218A (en) * 2011-05-31 2011-09-28 华为技术有限公司 Data processing method, buffer node, collaboration controller, and system
US9116819B2 (en) * 2012-10-17 2015-08-25 Datadirect Networks, Inc. Reducing metadata in a write-anywhere storage system
CN103605803A (en) * 2013-12-09 2014-02-26 中山爱科数字家庭产业孵化基地有限公司 Method for acquiring environmental-protection scientific and technological resources
CN106599308A (en) * 2016-12-29 2017-04-26 郭晓凤 Distributed metadata management method and system

Similar Documents

Publication Publication Date Title
CN104281506A (en) Data maintenance method and system for file system
US6516327B1 (en) System and method for synchronizing data in multiple databases
CN103955486B (en) Distribution service and its data update, the method for data query
US8458181B2 (en) Distributed free block map for a clustered redirect-on-write file system
EP2596425B1 (en) Membership tracking and data eviction in mobile middleware scenarios
CN103530362B (en) A kind of computer data reading/writing method for many copies distributed system
CN103379159B (en) A kind of method that distributed Web station data synchronizes
CN104156361B (en) A kind of method and system for realizing data syn-chronization
US10726042B2 (en) Replication control using eventually consistent meta-data
CN104021200B (en) The method of data synchronization and device of a kind of database
CN106055698A (en) Data migration method, agent node and database instance
CN103701913B (en) Data synchronization method and device
US10235251B2 (en) Distributed disaster recovery file sync server system
CN109783193A (en) A kind of mirror image file management method that can be multiplexed in multiple domain cloud platform
CN104104739A (en) Data synchronization method for metadata service cluster of cloud storage system
CN105959420A (en) Multi-client metadata synchronous update method and device
CN107302569A (en) A kind of security monitoring Data acquisition and storage method of facing cloud platform
US8756194B1 (en) Cloud-based data replication for web applications with replica identifier reassignment feature
US20160275085A1 (en) Methods for facilitating a nosql database with integrated management and devices thereof
CN109271367A (en) Distributed file system multinode snapshot rollback method and system
CN108762982A (en) A kind of database restoring method, apparatus and system
CN107249045B (en) Portable endoscope multi-modal information synchronous storage method and system
WO2015094195A1 (en) Transaction query engine
US9870402B2 (en) Distributed storage device, storage node, data providing method, and medium
CN109218340A (en) A kind of online data citation system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190115