CN109325025A

CN109325025A - A Reconfigurable Integration Method for Multi-source Heterogeneous Platforms

Info

Publication number: CN109325025A
Application number: CN201810858683.2A
Authority: CN
Inventors: 张彩霞; 胡绍林; 王向东; 王新东
Original assignee: Foshan University
Current assignee: Foshan University
Priority date: 2018-07-31
Filing date: 2018-07-31
Publication date: 2019-02-12

Abstract

The invention discloses a kind of multi-source heterogeneous restructural integrated approaches of platform, it is characterised in that: includes the following steps S1, introduces a global distributed directory Hash table；S2, file or the pathname of catalogue are subjected to Hash calculating, obtain the global distributed directory Hash table component where its higher level's catalogue；S3, it is searched in global distributed directory Hash table according to pathname, obtains unique identifier of corresponding component；S4, unique identifier is subjected to consistency hash algorithm, searched on the consistency Hash ring that meta data server is constituted apart from nearest node；S5, the node is mapped on meta data server.The present invention is divided by using based on address directory with the two-stage mapping mechanism of consistency hash algorithm management name space, improves the scalability of system and the dynamic for adapting to data increases, and brings less expense.

Description

A kind of restructural integrated approach of multi-source heterogeneous platform

Technical field

The present invention relates to multi-source data management method, especially a kind of restructural integrated approach of multi-source heterogeneous platform.

Background technique

In multi-source data service, the critical issue of data management is how to divide and map multi-data source name space letter Breath.The division of name space will have adaptivity and scalability, and the dynamic that can adapt to data increases, and brings less Expense.

Summary of the invention

In order to overcome the deficiencies in the prior art described above, the present invention provides a kind of adaptive and expansible novel multi-sources The restructural integrated approach of heterogeneous platform.

The technical solution adopted by the present invention to solve the technical problems are as follows:

A kind of restructural integrated approach of multi-source heterogeneous platform, it is characterised in that: include the following steps

S1, a global distributed directory Hash table is introduced；

S2, file or the pathname of catalogue are subjected to Hash calculating, the distributed mesh of the overall situation where obtaining its higher level's catalogue Record Hash table component；

S3, it is searched in global distributed directory Hash table according to pathname, obtains unique mark of corresponding component Symbol；

S4, unique identifier is subjected to consistency hash algorithm, in the consistency that meta data server is constituted It searches on Hash ring apart from nearest node；

S5, the node is mapped on meta data server.

Further, method pathname Hash calculated in the step S2 are as follows: sequence S=si | i=0 ..., n-1 }, The mark Wi of node si is calculated as follows: Wi=hash (Wi-1+si), wherein W0=hash (s0)；I=0 ..., n-1.

Further, the global distributed directory Hash table component U are as follows: { Wi, si, Wi-1, F }, as i=0, W0, S0,0,0 }, correspondence is construed to: { mark, node, preceding mark, node type }.

Further, the mark Ni of the node si is calculated as follows: Ni=hash (Ni-1+si), wherein N0=hash (s0)； I=0 ..., n-1；Nn-1 is first searched, is not as a result found then for sky, otherwise searches sequence Nn-2, recurrence is until finding or directly Until N0；If find as a result, if the corresponding inquiry of result mark；After finding the mark of node, in next step in the node In subsequent node search have terminal node identify node, recursion method search, with the node be preposition node node whether There is terminal node mark, have, finds；No person's recurrence terminates inquiry until finding.

Bring beneficial effect of the present invention has:

The present invention is divided and the two-stage mapping mechanism of consistency hash algorithm management name by using based on address directory Space, improves the scalability of system and the dynamic for adapting to data increases, and brings less expense.

Detailed description of the invention

With reference to the accompanying drawing and specific embodiment the invention will be further described,

Fig. 1 is division and mapping schematic diagram of the invention.

Specific embodiment

It is a kind of multi-source heterogeneous restructural integrated approach of platform of the invention shown in referring to Fig.1, it is characterised in that: including Following steps

S1, a global distributed directory Hash table is introduced；

S5, the node is mapped on meta data server.

The main realizing route name of above method can search for, and pathname introductory path can search for, and solve multi-source heterogeneous number Path in can computational problem.

After having the design of above-mentioned lookup, a large amount of data to import arrangement, path can search for just having with computing system For corresponding function.

It should be noted that described above is presently preferred embodiments of the present invention, the invention is not limited to above-mentioned Embodiment all should belong to protection scope of the present invention as long as it reaches technical effect of the invention with identical means.

Claims

1. a multi-source heterogeneous platform reconfigurable integration method is characterized in that: comprise the following steps

S1. Introduce a global distributed directory Hash table;

S2. Perform Hash calculation on the path name of the file or directory, and obtain the Hash table value of the global distributed directory where its parent directory is located;

S3. Search in the global distributed directory Hash table according to the path name to obtain the unique identifier of the corresponding component;

S4, perform a consistent Hash algorithm on the unique identifier, and search for the nearest node on the consistent Hash ring formed by the metadata server;

S5. Map the node to the metadata server.

2. The method for reconfigurable integration of multi-source heterogeneous platforms according to claim 1, wherein the method for calculating the pathname Hash in the step S2 is: the sequence S={s i|i=0, ...,n-1}, the identifier Wi of node si, calculated as follows: Wi=hash(Wi-1+s i), where W0=hash(s0); i=0,...,n-1.

3. The method for reconfigurable integration of multi-source heterogeneous platforms according to claim 2, wherein: the globally distributed directory Hash table component U is: {Wi, si, Wi-1, F}, When i=0, {W0, s0, 0, 0}, correspondingly interpreted as: {identity, node, pre-identity, node type}.

4. The method for reconfigurable integration of multi-source heterogeneous platforms according to claim 3, characterized in that: the identifier Ni of the node si is calculated as follows: Ni=hash(Ni-1+s i), wherein N0= hash(s0); i=0,...,n-1; first find Nn-1, if the result is not empty, find it, otherwise find the sequence Nn-2, recurse until found or until N0; if the result is found, then The result corresponds to the identifier of the query; after finding the identifier of the node, the next step is to find the node with the identifier of the terminal node in the subsequent nodes of the node, and the recursive method is used to find out whether the node with this node as the front node has the identifier of the terminal node, if so found; otherwise, recurse until found, ending the query.