CN110377584A - A kind of access method and device of the data structure edition compatibility based on metadata - Google Patents
A kind of access method and device of the data structure edition compatibility based on metadata Download PDFInfo
- Publication number
- CN110377584A CN110377584A CN201910547633.7A CN201910547633A CN110377584A CN 110377584 A CN110377584 A CN 110377584A CN 201910547633 A CN201910547633 A CN 201910547633A CN 110377584 A CN110377584 A CN 110377584A
- Authority
- CN
- China
- Prior art keywords
- data structure
- structure information
- data
- version number
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/217—Database tuning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/219—Managing data history or versioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The access method of the invention discloses a kind of data structure edition compatibility based on metadata, specifically includes the following steps: S1, by processing module being compared the data structure information after variation with pre-stored data structure information；S2, processing module obtain the data payload value after changing, and judge whether load value is more than threshold value, if being not above threshold value, data acquisition module obtains the data structure information changed, by version number storage into data structure information file；S3, version number in data structure information file is parsed by parsing module, and validation verification is carried out to the content of data structure information；The identification function of newly-increased data, the safety of enhancing data acquisition are realized in interface of the present invention；The read-write that data are carried out with the corresponding version number of data structure information, not only may be implemented the old and new's edition compatibility, also can guarantee the efficiency of reading and writing data.
Description
Technical field
The invention belongs to compatible data system access techniques fields, and in particular to the data structure version based on metadata is simultaneous
The access method and device of appearance.
Background technique
Storage system refers to various storage equipment, control unit and the management information in computer by storage program and data
System composed by the equipment and Processing Algorithm of scheduling.As storing data is more and more, the memory space of storage system is also got over
Come bigger.
All clients will first pass through main system to the access of storage system, as the capacity of storage system constantly increases
Greatly, the client terminal quantity of connection is more and more, and the performance of main system can be easy to appear congestion at the bottleneck of entire storage system,
Influence the read or write speed of entire storage system；Once data structure generates variation, due to not including different editions in storage file
Data structure information, only data content, thus the program of new version when reading the data of early version can complex, need
It writes a large amount of code and carries out edition compatibility, for this purpose, it is proposed that a kind of data structure edition compatibility based on metadata is deposited
Method and device is taken, to solve the problems, such as to mention in above-mentioned background technique.
Summary of the invention
The access method and device of the purpose of the present invention is to provide a kind of data structure edition compatibility based on metadata,
To solve the problems mentioned in the above background technology.
To achieve the above object, the invention provides the following technical scheme: a kind of data structure version based on metadata is simultaneous
The access method of appearance, specifically includes the following steps:
S1, client are used to provide a user the interface of access cloud storage system, identify access in identification module
After the legal identity of interface, the data structure information after variation is made with pre-stored data structure information by processing module
Comparison；
S2, processing module obtain the data payload value after changing, and judge whether load value is more than threshold value, if being not above
Threshold value, data acquisition module obtain the data structure information changed, and according to the data structure information of variation, processing module, which calculates, to be become
The corresponding version number of dynamic data structure information, by version number storage into data structure information file；
S3, the version number in the data structure information file for needing to read is parsed by parsing module, judges field class
Whether type and field value then according to version number search corresponding data structure information, and data structure information is deposited with matching
In cloud storage system.
Preferably, the processing module carries out list to the keyword of pre-stored data, includes preparatory in the list
The location information of the data of storage in the metadata, and corresponding data structure information is read for parsing module.
Preferably, after the identification module receives the ID signal of access interface, it is immediately transmitted to data feedback interface
The ID signal of circuit, the access interface that identification matching module transfers the ID data of storage and identification module receives is matched
Afterwards, that is, the identification to access interface is completed, is otherwise failed for the identification of access interface.
Preferably, the data structure information of the variation is data structure information that is newly-increased, deleting and modify.Preferably,
The step S3 finds the corresponding data structure information of the version number, and the reading of data is carried out according to the data structure information
It writes, if not finding the corresponding data structure information of the version number, the read-write without data.
A kind of access device of the data structure edition compatibility based on metadata, comprising: identification module is used to know
Whether the identity of not access interface is legal；
Processing module is used to compare the data structure information after changing with pre-stored data structure information,
And the data payload value after changing is obtained, and judge whether load value is more than threshold value；
Data acquisition module is used to obtain the data structure information of variation, according to the data structure information of variation, processing
Module calculates the corresponding version number of data structure information changed, by version number storage into data structure information file；
Parsing module is used to parse the version number in the data structure information file for needing to read, judges field class
Type and field value whether with matching, corresponding data structure information is then searched according to version number.
Compared with prior art, the beneficial effects of the present invention are: a kind of data knot based on metadata provided by the invention
The access method and device of structure edition compatibility realize the identification function of newly-increased data, enhancing data acquisition in interface of the present invention
Safety；The read-write that data are carried out with the corresponding version number of data structure information, not only may be implemented the old and new's edition compatibility,
It can guarantee the efficiency of reading and writing data；Processing module of the present invention, data structure information after being used to change with it is pre-stored
Data structure information compares, and obtains the data payload value after changing, and judge whether load value is more than threshold value, reduces first number
Occur the probability of load overload according to server, improves the processing speed of metadata.
Detailed description of the invention
Fig. 1 is the access method flow diagram of the data structure edition compatibility based on metadata.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Referring to Fig. 1, embodiment is as follows:
A kind of access method of the data structure edition compatibility based on metadata, specifically includes the following steps:
S1, client are used to provide a user the interface of access cloud storage system, identify access in identification module
After the legal identity of interface, the data structure information after variation is made with pre-stored data structure information by processing module
Comparison；
S2, processing module obtain the data payload value after changing, and judge whether load value is more than threshold value, if being not above
Threshold value, data acquisition module obtain the data structure information changed, and according to the data structure information of variation, processing module, which calculates, to be become
The corresponding version number of dynamic data structure information, by version number storage into data structure information file；
S3, the version number in the data structure information file for needing to read is parsed by parsing module, judges field class
Whether type and field value then according to version number search corresponding data structure information, and data structure information is deposited with matching
In cloud storage system.
Specifically, the processing module carries out list to the keyword of pre-stored data, it include preparatory in the list
The location information of the data of storage in the metadata, and corresponding data structure information is read for parsing module.
Specifically, being immediately transmitted to data feedback interface after the identification module receives the ID signal of access interface
The ID signal of circuit, the access interface that identification matching module transfers the ID data of storage and identification module receives is matched
Afterwards, that is, the identification to access interface is completed, is otherwise failed for the identification of access interface.
Specifically, the data structure information of the variation is data structure information that is newly-increased, deleting and modify.Specifically,
The step S3 finds the corresponding data structure information of the version number, and the reading of data is carried out according to the data structure information
It writes, if not finding the corresponding data structure information of the version number, the read-write without data.
A kind of access device of the data structure edition compatibility based on metadata, comprising: identification module is used to know
Whether the identity of not access interface is legal；
Processing module is used to compare the data structure information after changing with pre-stored data structure information,
And the data payload value after changing is obtained, and judge whether load value is more than threshold value；
Data acquisition module is used to obtain the data structure information of variation, according to the data structure information of variation, processing
Module calculates the corresponding version number of data structure information changed, by version number storage into data structure information file；
Parsing module is used to parse the version number in the data structure information file for needing to read, judges field class
Type and field value whether with matching, corresponding data structure information is then searched according to version number.
In conclusion compared with prior art, the identification function of newly-increased data is realized in interface of the present invention, enhance data
The safety of acquisition；The read-write that data are carried out with the corresponding version number of data structure information, it is simultaneous not only to may be implemented new early version
Hold, also can guarantee the efficiency of reading and writing data；Processing module of the present invention, be used for by change after data structure information with deposit in advance
The data structure information of storage compares, and obtains the data payload value after changing, and judge whether load value is more than threshold value, reduces
There is the probability of load overload in meta data server, improves the processing speed of metadata.
Finally, it should be noted that the foregoing is only a preferred embodiment of the present invention, it is not intended to restrict the invention,
Although the present invention is described in detail referring to the foregoing embodiments, for those skilled in the art, still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features,
All within the spirits and principles of the present invention, any modification, equivalent replacement, improvement and so on should be included in of the invention
Within protection scope.
Claims (6)
1. a kind of access method of the data structure edition compatibility based on metadata, which is characterized in that specifically includes the following steps:
S1, client are used to provide a user the interface of access cloud storage system, identify access interface in identification module
Legal identity after, the data structure information after variation is opposed with pre-stored data structure information by processing module
Than；
S2, processing module obtain the data payload value after changing, and judge whether load value is more than threshold value, if being not above threshold
Value, data acquisition module obtain the data structure information changed, and according to the data structure information of variation, processing module, which calculates, to be changed
The corresponding version number of data structure information, by the version number storage into data structure information file；
S3, the version number needed in the data structure information file that reads is parsed by parsing module, judge field type and
Whether field value then according to version number searches corresponding data structure information, and by data structure information there are cloud with matching
Storage system.
2. a kind of access method of data structure edition compatibility based on metadata according to claim 1, feature exist
In: the processing module carries out list to the keyword of pre-stored data, exists in the list comprising pre-stored data
Location information in metadata, and corresponding data structure information is read for parsing module.
3. a kind of access method of data structure edition compatibility based on metadata according to claim 1, feature exist
In: after the identification module receives the ID signal of access interface, it is immediately transmitted to data feedback interface circuit, identification matching
After the ID signal for the access interface that ID data and the identification module of module calls storage receive is matched, that is, complete pair
Otherwise the identification of access interface fails for the identification of access interface.
4. a kind of access method of data structure edition compatibility based on metadata according to claim 1, feature exist
In: the data structure information of the variation is data structure information that is newly-increased, deleting and modify.
5. a kind of access method of data structure edition compatibility based on metadata according to claim 1, feature exist
In: the step S3 finds the corresponding data structure information of the version number, carries out data according to the data structure information
Read-write, if not finding the corresponding data structure information of the version number, the read-write without data.
6. a kind of access device of the data structure edition compatibility based on metadata, it is characterised in that: include: identification mould
Block, whether the identity of access interface is legal for identification；
Processing module is used to compare the data structure information after changing with pre-stored data structure information, and obtains
The data payload value after changing is taken, and judges whether load value is more than threshold value；
Data acquisition module is used to obtain the data structure information of variation, according to the data structure information of variation, processing module
The corresponding version number of data structure information changed is calculated, by version number storage into data structure information file；
Parsing module is used to parse the version number needed in the data structure information file that reads, judge field type and
Field value whether with matching, corresponding data structure information is then searched according to version number.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910547633.7A CN110377584A (en) | 2019-06-24 | 2019-06-24 | A kind of access method and device of the data structure edition compatibility based on metadata |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910547633.7A CN110377584A (en) | 2019-06-24 | 2019-06-24 | A kind of access method and device of the data structure edition compatibility based on metadata |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110377584A true CN110377584A (en) | 2019-10-25 |
Family
ID=68249146
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910547633.7A Pending CN110377584A (en) | 2019-06-24 | 2019-06-24 | A kind of access method and device of the data structure edition compatibility based on metadata |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110377584A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113778329A (en) * | 2021-06-30 | 2021-12-10 | 济南浪潮数据技术有限公司 | Data aggregation method, device, equipment and computer readable storage medium |
-
2019
- 2019-06-24 CN CN201910547633.7A patent/CN110377584A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113778329A (en) * | 2021-06-30 | 2021-12-10 | 济南浪潮数据技术有限公司 | Data aggregation method, device, equipment and computer readable storage medium |
| CN113778329B (en) * | 2021-06-30 | 2023-12-22 | 济南浪潮数据技术有限公司 | Data aggregation method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6785674B2 (en) | System and method for structuring data in a computer system | |
| US7765215B2 (en) | System and method for providing a trustworthy inverted index to enable searching of records | |
| CN104699718B (en) | Method and apparatus for being rapidly introduced into business datum | |
| CN106874348B (en) | File storage and index method and device and file reading method | |
| CN111444196B (en) | Method, device and equipment for generating Hash of global state in block chain type account book | |
| US20100161780A1 (en) | Hot data management method based on hit counter | |
| CN112286963B (en) | Block chain terminal data credible query system and implementation method thereof | |
| US20200301944A1 (en) | Method and apparatus for storing off-chain data | |
| CN102456076A (en) | System and method for mass fragment data aggregation | |
| CN111539206B (en) | Method, device, equipment and storage medium for determining sensitive information | |
| CN110532529A (en) | A kind of recognition methods of file type and device | |
| CN105677579B (en) | Data access method in caching system and system | |
| CN103188267A (en) | Protocol analyzing method based on DFA (Deterministic Finite Automaton) | |
| CN109388614A (en) | A kind of method, system and the equipment of catalogue file number quota | |
| CN103310008B (en) | A kind of cloud control server and its file index method | |
| CN114647698A (en) | Data synchronization method and device and computer storage medium | |
| CN112416880A (en) | Method and device for optimizing storage performance of mass small files based on real-time merging | |
| CN110413711A (en) | A kind of variance data acquisition methods and its storage medium | |
| CN109033295A (en) | The merging method and device of super large data set | |
| CN110222046B (en) | List data processing method, device, server and storage medium | |
| CN115988001A (en) | Consensus voting processing method, device, equipment and medium for block chain system | |
| CN110377584A (en) | A kind of access method and device of the data structure edition compatibility based on metadata | |
| CN108073709B (en) | Data recording operation method, device, equipment and storage medium | |
| CN107077509B (en) | Method, device and equipment for improving browsing experience | |
| CN106250440B (en) | Document management method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20191025 |