CN102222102A - Structuralized data storage method based on metadata - Google Patents

Abstract

The invention provides a structuralized data storage method based on metadata, which comprises the following steps: (1) setting up a metadata model, and setting a statement division rule of structuralized data storage; (2) storing data, and classifying and storing structuralized data indexes in statements in a database according to the statement division rule; and (3) during retrieving the data, positioning the statements of the structuralized data indexes according to the statement division rule, and then retrieving the data in the corresponding statements through the structuralized data indexes. By adopting the structuralized data storage method based on the metadata, mass data can be processed, and the retrieving efficiency is high.

Description

Structural data storage means based on metadata

Technical field:

The present invention relates to the Content Management field, specifically is a kind of structural data storage means based on metadata.

Background technology:

In the epoch of current information explosion, information is all increasing every day with surprising rapidity.There is statistics to show, reaches 61% from the annual speed that increases of the data in the transaction, and the annual growth rate of other various information even surpass 92%.And the behind of information explosion, the huge challenge that we face is how to store, manage and utilize these information in an orderly manner, content can be divided into structural data, unstructured data according to the retrieval view, and structural data comprises relational data database data, structured data file.

For structural data, because based on bivariate table or two-dimentional file, therefore retrieval is comparatively convenient, uses morely, and present unstructured data generally is to change into structural data to store.Existing structural data storage means based on metadata generally can't be handled mass data, so when data volume was big, effectiveness of retrieval was low.

Summary of the invention:

The technical matters that the present invention will solve is, overcomes the defective of prior art, provides a kind of and can handle mass data, the structural data storage means based on metadata that recall precision is high.

Technical solution of the present invention is, a kind of structural data storage means based on metadata is provided, and it may further comprise the steps:

(1), creates the metadata schema and the submeter rule of setting structure data storage;

(2), carry out data storage, the structural data index is stored in each table in the database according to the submeter rule classification;

(3), when carrying out data retrieval, navigate to earlier the table at this structural data index place, according to the submeter rule again in pairing table by these these data of structural data indexed search.

Adopt this structural data storage means based on metadata, system can carry out the submeter storage according to the rule of setting to the data of structural data in database automatically, like this when running into mass data, the structural data indexed data amount in each database that can guarantee can not exceed the load of server, can be used for storing the data of magnanimity, and during retrieval, navigate to the table at this structural data index place earlier, in pairing table, pass through these these data of structural data indexed search again.The data retrieved amount is few, and recall precision is higher.

Embodiment:

The present invention is further detailed explanation below in conjunction with embodiment.

The invention provides a kind of structural data storage means based on metadata, it may further comprise the steps:

(1), creates the metadata schema and the submeter rule of setting structure data storage; Described submeter rule is set by the developer as requested, as: by year, month etc. rule carry out branch year or divide moon storage data.

(2), carry out data storage, the structural data index is stored in each table in the database according to the submeter rule classification;

The structural data storage is to rely on the structural data index, and the structural data index can be per year or monthly carried out submeter and store,

(3), when carrying out data retrieval, navigate to earlier the table at this structural data index place, according to the submeter rule again in pairing table by these these data of structural data indexed search.

Provide a specific embodiment below and illustrate,

As: domestic certain the accounting event every day 200W of bank pen, nearly 500W opens image, and every image all has an index record in database, will produce index record more than 100,000,000 every month like this, in some months data storage to a table, the pressure of database is unable to stand like this.

So when tame bank carries out data storage, be provided with the submeter rule of monthly carrying out submeter, when storing like this, divide a moon storage to the some months data, one month data storage is in a table, guaranteed to have only 100,000,000 data in every table, when retrieving like this,, in the table in this month, retrieve then earlier according to the table that finds this month month, reduce the pressure of database, improved recall precision.

Claims (1)

1. structural data storage means based on metadata, it is characterized in that: it may further comprise the steps:

(1), creates the metadata schema and the submeter rule of setting structure data storage;

(2), carry out data storage, the structural data index is stored in each table in the database according to the submeter rule classification;

(3), when carrying out data retrieval, navigate to earlier the table at this structural data index place, according to the submeter rule again in pairing table by these these data of structural data indexed search.