CN109325025A

CN109325025A - A kind of restructural integrated approach of multi-source heterogeneous platform

Info

Publication number: CN109325025A
Application number: CN201810858683.2A
Authority: CN
Inventors: 张彩霞; 胡绍林; 王向东; 王新东
Original assignee: Foshan University
Current assignee: Foshan University
Priority date: 2018-07-31
Filing date: 2018-07-31
Publication date: 2019-02-12

Abstract

The invention discloses a kind of multi-source heterogeneous restructural integrated approaches of platform, it is characterised in that: includes the following steps S1, introduces a global distributed directory Hash table；S2, file or the pathname of catalogue are subjected to Hash calculating, obtain the global distributed directory Hash table component where its higher level's catalogue；S3, it is searched in global distributed directory Hash table according to pathname, obtains unique identifier of corresponding component；S4, unique identifier is subjected to consistency hash algorithm, searched on the consistency Hash ring that meta data server is constituted apart from nearest node；S5, the node is mapped on meta data server.The present invention is divided by using based on address directory with the two-stage mapping mechanism of consistency hash algorithm management name space, improves the scalability of system and the dynamic for adapting to data increases, and brings less expense.

Description

A kind of restructural integrated approach of multi-source heterogeneous platform

Technical field

The present invention relates to multi-source data management method, especially a kind of restructural integrated approach of multi-source heterogeneous platform.

Background technique

In multi-source data service, the critical issue of data management is how to divide and map multi-data source name space letter Breath.The division of name space will have adaptivity and scalability, and the dynamic that can adapt to data increases, and brings less Expense.

Summary of the invention

In order to overcome the deficiencies in the prior art described above, the present invention provides a kind of adaptive and expansible novel multi-sources The restructural integrated approach of heterogeneous platform.

The technical solution adopted by the present invention to solve the technical problems are as follows:

A kind of restructural integrated approach of multi-source heterogeneous platform, it is characterised in that: include the following steps

S1, a global distributed directory Hash table is introduced；

S2, file or the pathname of catalogue are subjected to Hash calculating, the distributed mesh of the overall situation where obtaining its higher level's catalogue Record Hash table component；

S3, it is searched in global distributed directory Hash table according to pathname, obtains unique mark of corresponding component Symbol；

S4, unique identifier is subjected to consistency hash algorithm, in the consistency that meta data server is constituted It searches on Hash ring apart from nearest node；

S5, the node is mapped on meta data server.

Further, method pathname Hash calculated in the step S2 are as follows: sequence S=si | i=0 ..., n-1 }, The mark Wi of node si is calculated as follows: Wi=hash (Wi-1+si), wherein W0=hash (s0)；I=0 ..., n-1.

Further, the global distributed directory Hash table component U are as follows: { Wi, si, Wi-1, F }, as i=0, W0, S0,0,0 }, correspondence is construed to: { mark, node, preceding mark, node type }.

Further, the mark Ni of the node si is calculated as follows: Ni=hash (Ni-1+si), wherein N0=hash (s0)； I=0 ..., n-1；Nn-1 is first searched, is not as a result found then for sky, otherwise searches sequence Nn-2, recurrence is until finding or directly Until N0；If find as a result, if the corresponding inquiry of result mark；After finding the mark of node, in next step in the node In subsequent node search have terminal node identify node, recursion method search, with the node be preposition node node whether There is terminal node mark, have, finds；No person's recurrence terminates inquiry until finding.

Bring beneficial effect of the present invention has:

The present invention is divided and the two-stage mapping mechanism of consistency hash algorithm management name by using based on address directory Space, improves the scalability of system and the dynamic for adapting to data increases, and brings less expense.

Detailed description of the invention

With reference to the accompanying drawing and specific embodiment the invention will be further described,

Fig. 1 is division and mapping schematic diagram of the invention.

Specific embodiment

It is a kind of multi-source heterogeneous restructural integrated approach of platform of the invention shown in referring to Fig.1, it is characterised in that: including Following steps

S1, a global distributed directory Hash table is introduced；

S5, the node is mapped on meta data server.

The main realizing route name of above method can search for, and pathname introductory path can search for, and solve multi-source heterogeneous number Path in can computational problem.

After having the design of above-mentioned lookup, a large amount of data to import arrangement, path can search for just having with computing system For corresponding function.

It should be noted that described above is presently preferred embodiments of the present invention, the invention is not limited to above-mentioned Embodiment all should belong to protection scope of the present invention as long as it reaches technical effect of the invention with identical means.

Claims

1. a kind of restructural integrated approach of multi-source heterogeneous platform, it is characterised in that: include the following steps

S1, a global distributed directory Hash table is introduced；

S2, file or the pathname of catalogue are subjected to Hash calculating, obtain the global distributed directory where its higher level's catalogue Hash table component；

S3, it is searched in global distributed directory Hash table according to pathname, obtains unique identifier of corresponding component；

S4, unique identifier is subjected to consistency hash algorithm, in the consistency Hash ring that meta data server is constituted Upper lookup is apart from nearest node；

S5, the node is mapped on meta data server.

2. a kind of multi-source heterogeneous restructural integrated approach of platform according to claim 1, it is characterised in that: the step S2 In method that pathname Hash is calculated are as follows: sequence S={ s i | i=0 ..., n-1 }, the mark Wi of node s i are calculated such as Under: Wi=hash (Wi-1+s i), wherein W0=hash (s0)；I=0 ..., n-1.

3. a kind of multi-source heterogeneous restructural integrated approach of platform according to claim 2, it is characterised in that: described global point Cloth catalogue Hash table component U are as follows: { Wi, s i, Wi-1, F }, as i=0, { W0, s0,0,0 }, correspondence is construed to: mark, Node, preceding mark, node type }.

4. a kind of multi-source heterogeneous restructural integrated approach of platform according to claim 3, it is characterised in that: the node s The mark Ni of i calculates as follows: Ni=hash (Ni-1+s i), wherein N0=hash (s0)；I=0 ..., n-1；First search Nn- 1, it is not as a result found then for sky, otherwise searches sequence Nn-2, recurrence is until finding or until N0；If find as a result, The then mark of the corresponding inquiry of result；After finding the mark of node, search in the subsequent node of the node has terminal node in next step The node of point identification, recursion method are searched, and whether have terminal node mark with the node that the node is preposition node, have, look for It arrives；No person's recurrence terminates inquiry until finding.