CN107229713A - A kind of object storage method and device - Google Patents
A kind of object storage method and device Download PDFInfo
- Publication number
- CN107229713A CN107229713A CN201710392920.6A CN201710392920A CN107229713A CN 107229713 A CN107229713 A CN 107229713A CN 201710392920 A CN201710392920 A CN 201710392920A CN 107229713 A CN107229713 A CN 107229713A
- Authority
- CN
- China
- Prior art keywords
- field
- data file
- metadata
- related information
- incidence relation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
Abstract
The invention discloses a kind of object storage method and device, this method includes:At least two data files are obtained, at least two data file has incidence relation;Judge whether to need at least two data file being stored in object storage system;If so, at least two data file to be created as to the object in object storage system, each object includes the incidence relation that is stored with object data and metadata, the metadata.Due to the incidence relation between object is stored in metadata, so, when user needs to retrieve, searches object, without relying on any third party system or instrument, just energy quick-searching improves the recall precision in object storage system with this to related any object.
Description
Technical field
The present invention relates to field of storage, more particularly to a kind of object storage method and device.
Background technology
With the fast development of Internet era big data technology, information digitalization process increasingly accelerates, substantial amounts of structure
Change and unstructured data explosive growth at an unprecedented rate, this to collect, stored and analysis mining data
The demand of value is greatly increased.Based on this, a kind of new storage system --- object storage system arises at the historic moment.Deposited in object
In storage system, each data file be referred to as it is separate between an object, each object, it is unrelated.
However, because data file derives from real production and living, and the data produced in the production and living of reality are literary
Various relevances are all there are between part, so using object storage system data storage, be user search, access with
And file is updated the data, introduce extra complexity.For example:In the media asset management system of radio, TV and film industries, the matchmaker of a program
Money material includes:The high code video file of program, low code video file, one or more audio file, subtitle file, these numbers
According to file Yi Dan after storage to object storage system, the relevance between data file will disappear with the objectification of data,
User searches, accesses and update the data file, it is necessary to build third party system outside object storage system to deposit for convenience
The incidence relation between each data file is stored up, usually using relevant database.However, building third party system in addition, no
Only waste of resource, and be unfavorable for user's quick-searching to the object needed.
The content of the invention
In order to solve the above technical problems, the embodiments of the invention provide a kind of object storage method and device, technical scheme
It is as follows:
A kind of object storage method, including:
At least two data files are obtained, at least two data file has incidence relation;
Judge whether to need at least two data file being stored in object storage system;
If so, at least two data file is created as to the object in object storage system, each object bag
Include the incidence relation that is stored with object data and metadata, the metadata.
Preferably, the incidence relation includes related information and associate reference information, the related information including described in extremely
The mark of each data file in few two data files, in addition to source data file, the association reference information includes storage
The mark of the source data file of the related information, the source data file is any number at least two data file
According to file;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file,
The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object
The association reference information that is stored with the related information, the metadata of each related object and the storage association
The title of the metadata fields of information.
Preferably, in addition to:
Related information read requests are received, the related information read requests carry the first object identity;
Judge whether there is the field of entitled first field in metadata corresponding with first object identity, it is described
First field is used to store the related information;
When it is determined that during field with entitled first field, the content of first field is read, to obtain the pass
Join information;
The related information is returned to user;
When it is determined that during field without entitled first field, judging metadata corresponding with first object identity
In whether have entitled second field field;
When it is determined that during field with entitled second field, the content of second field is read, to obtain source object
Mark, and return to the step of performing the content for reading first field;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object
Field.
Preferably, in addition to:
Incidence relation removal request is received, the incidence relation removal request carries the second object identity;
Judge whether there is the field of entitled first field in metadata corresponding with second object identity;
When it is determined that during field with entitled first field, judgement has the related of the incidence relation to the second object
In object, storage the association reference information whether be all deleted;
When it is determined that the association reference information is all deleted, the related information stored in second object is deleted;
When it is determined that during field without entitled first field, deleting metadata corresponding with second object identity
The association reference information of middle storage.
Preferably, in addition to:
Object removal request is received, the object removal request carries the 3rd object identity;
Judge whether there is entitled first field or the second field in metadata corresponding with the 3rd object identity
Field;
If it is not, deleting the 3rd object corresponding with the 3rd object identity.
Preferably, in addition to:
Judge whether it is in need store into the object storage system, the new data file and described at least two
Data file has incidence relation;
If so, the mark of the new data file is added in the metadata fields for storing the related information, and
The mark of the source object of the related information will be stored and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The related information that preferably, the incidence relation includes storing in related information, and the metadata of each object is,
Data file corresponding with the object has the mark of all data files of incidence relation, the data file and the object
Correspond.
A kind of object storage device, including:
Acquiring unit, for obtaining at least two data files, at least two data file has incidence relation;
First judging unit, for judging whether to need at least two data file being stored in object storage system
In;
Creating unit, for determining to need at least two data file being stored in pair when first judging unit
During as in storage system, at least two data file is created as to the object in object storage system, each object
Including object data and metadata, be stored with the incidence relation in the metadata.
Preferably, the incidence relation includes related information and associate reference information, the related information including described in extremely
The mark of each data file in few two data files, in addition to source data file, the association reference information includes storage
The mark of the source data file of the related information, the source data file is any number at least two data file
According to file;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file,
The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object
The association reference information that is stored with the related information, the metadata of each related object and the storage association
The title of the metadata fields of information.
Preferably, in addition to:
First receiving unit, for receiving related information read requests, the related information read requests carry first pair
As mark;
Second judging unit, for whether judging in corresponding with first object identity metadata with entitled the
The field of one field, first field is used to store the related information;
First reading unit, for determining during the field with entitled first field, to read when second judging unit
The content of first field is taken, to obtain the related information;
Returning unit, for returning to the related information to user;
3rd judging unit, for being determined when second judging unit during field without entitled first field,
Judge whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit, for determining during the field with entitled second field, to read when the 3rd judging unit
The content of second field is taken, to obtain source object mark, and return the step of performing the content for reading first field;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object
Field.
Preferably, in addition to:
Second receiving unit, for receiving incidence relation removal request, the incidence relation removal request carries second pair
As mark;
4th judging unit, for judging whether there is entitled institute in metadata corresponding with second object identity
State the field of the first field;
5th judging unit, for determining during the field with entitled first field, to sentence when the 4th judging unit
It is disconnected have with the second object in the related object of the incidence relation, whether the association reference information that stores all has been deleted
Remove;
First delete unit, for when the 5th judging unit determine it is described association reference information all be deleted when,
Delete the related information stored in second object;
Second deletes unit, for determining during the field without entitled first field, to delete when the 4th judging unit
The association reference information stored in metadata corresponding with second object identity.
Preferably, in addition to:
3rd receiving unit, for receiving object removal request, the object removal request carries the 3rd object identity;
6th judging unit, for whether judging in corresponding with the 3rd object identity metadata with entitled the
The field of one field or the second field;
3rd deletes unit, for determining do not have entitled first field or described when the 6th judging unit
During the field of the second field, the 3rd object corresponding with the 3rd object identity is deleted.
Preferably, in addition to:
7th judging unit, for determining whether that new data file needs to store into the object storage system,
The new data file has incidence relation with least two data file;
Adding device, for determining there is new data file to need to store to the object to deposit when the 7th judging unit
When in storage system, the mark of the new data file is added in the metadata fields for storing the related information, and will
Store the mark of the source object of the related information and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The related information that preferably, the incidence relation includes storing in related information, and the metadata of each object is,
Data file corresponding with the object has the mark of all data files of incidence relation, the data file and the object
Correspond.
The technical scheme that the embodiment of the present invention is provided, it would be desirable to which at least two data files are stored in object storage system
When in system, at least two data file is created as to the object in object storage system, wherein, the metadata in object is deposited
Contain the incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, look into
When looking for a partner in marriage, without relying on any third party system or instrument, just energy quick-searching is improved to related any object with this
The recall precision of object storage system.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also
To obtain other accompanying drawings according to these accompanying drawings.
A kind of a kind of schematic flow sheet for object storage method that Fig. 1 is provided by the embodiment of the present invention;
A kind of another schematic flow sheet for object storage method that Fig. 2 is provided by the embodiment of the present invention;
A kind of a kind of structural representation for object storage device that Fig. 3 is provided by the embodiment of the present invention;
A kind of another structural representation for object storage device that Fig. 4 is provided by the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this
Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example is applied, the scope of protection of the invention is belonged to.
Term " first ", " second ", " the 3rd " " in description and claims of this specification and above-mentioned accompanying drawing
The (if present)s such as four " are for distinguishing similar object, without for describing specific order or precedence.It should manage
The data that solution is so used can be exchanged in the appropriate case, so as to embodiments of the invention described herein, for example can be with
Order in addition to those for illustrating or describing herein is implemented.In addition, term " comprising " and " having " and their times
What is deformed, it is intended that covering is non-exclusive to be included, for example, contain the process of series of steps or unit, method, system,
Product or equipment are not necessarily limited to those steps clearly listed or unit, but may include not list clearly or for
The intrinsic other steps of these processes, method, product or equipment or unit.
Referring to Fig. 1, a kind of implementation process figure for the object storage method that Fig. 1 provides for the embodiment of the present application, the side
Method includes:
Step S101, at least two data files of acquisition, at least two data file have incidence relation;
The data file of the present embodiment both can be structural data can also unstructured data, wherein, structuring number
According to the data for referring to be realized come logical expression with bivariate table structure, such as Microsoft Excel, unstructured data refers to not side
Just under the data showed with two-dimentional logical table, the office documents of such as all formats, text, picture, standard generalized markup language
Subset X ML, HTML, all kinds of forms, image and audio/visual information etc..
There is at least two data files incidence relation to refer to when at least two data files are stored in object storage system
When in system, other objects can be found according to the object identity of any object, by the incidence relation.
Step S102, judge whether need at least two data file is stored in object storage system, if so,
Perform step S103;
Step S103, the object at least two data file being created as in object storage system, the object bag
Include the incidence relation that is stored with object data and metadata, the metadata.
The object information of each object is made up of two parts data in object storage system, and a part is metadata, separately
A part is object data, wherein, except some base attribute (such as size, uplink time, schools comprising the object in metadata
Test code etc.) outside the field of description, the field by User Defined and extension can be also included, therefore, the present embodiment is by incidence relation
It is stored in this.
The metadata of object is generally by multigroup { Key:Value } to composition, wherein Key is the title of metadata fields,
Value is the content that stores in the field.This characteristic is stored using object, the incidence relation between object object can be stored in
Metadata in.
The storage format of incidence relation in the metadata between object, can be deposited using semi-structured JSON formatted datas
Storage.
The technical scheme that the present embodiment is provided, it would be desirable to which at least two data files are stored in object storage system
When, at least two data file is created as to the object in object storage system, wherein, the metadata in object is stored with
The incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, search pair
As when, without relying on any third party system or instrument, just can quick-searching to correlation any object, object is improved with this
The recall precision of storage system.
Referring to Fig. 2, another implementation process figure for the object storage method that Fig. 2 provides for the embodiment of the present application, described
Method includes:
Step S201, at least two data files of acquisition;
At least two data file has incidence relation, and the incidence relation includes related information and associates reference letter
Breath, the related information includes the mark of each data file in addition to source data file, and the association reference information includes depositing
Store up the mark of the source data file of the related information.
In practical application, according to business needs, attribute information can also be included in related information, attribute information can be pair
The type of elephant or other information relevant with business.
In addition, according to business needs, incidence relation can only include what is stored in related information, the metadata of each object
Related information is, data file corresponding with the object have incidence relation all data files mark, data text
Part is corresponded with the object.
The source data file is any data file at least two data file, wherein, data file mark
It can be data file ID to know, in object storage, i.e. data file identification object ID, unique in the overall situation.
Step S202, judge whether need at least two data file is stored in object storage system, if so,
Step S203 is performed, otherwise terminates flow;
Step S203, the object being created as at least two data file in object storage system;
Each object includes object data and metadata, and the object includes source object and related object, the source
Object is corresponding with the source data file, the related object and a pair of the data file 1 in addition to the source data file
Should, be stored with the related information in the metadata of the source object, is stored in the metadata of each related object
State the title of the metadata fields of association reference information and the storage related information.
Create because each metadata of object is by one group of { Key:Value } to composition, therefore, stored in object
In metadata, specific name can be carried out to the field name for the metadata for storing incidence relation, so as to quick-searching to association
Relation.Such as, the field name of two kinds of metadata is defined, is respectively:AssociationInfo and AssociationRef, i.e.
In the object of storage incidence relation, metadata fields AssociationInfo={ " AssociationInfo " is defined:<
Value>As the metadata of storage related information, define metadata fields AssociationRef=
{“AssociationRef”:<Value>It is used as the metadata of storage association reference information.
Below by taking the program material of broadcasting and TV media resource system as an example, the metadata fields to storing related information
AssociationInfo and the metadata fields AssociationRef of storage association reference information are illustrated, due to one
Individual program material covers multiple material objects, so the metadata fields AssociationInfo of storage related information can be adopted
Use JSON forms:
Wherein, AssociationInfo is the title of the field of metadata, and ObjectName is Key, represents related object
ID, and corresponding Value values be "<Bucket>/ XXX_XXX.avi ", ObjectType represent the type of related object, value
For " high ", it is high encoded video to represent file.
It should be noted that according to actual business needs, must need not be wrapped in metadata fields AssociationInfo
Type containing related object, but including at least the ID of each related object.
Storage association reference information metadata fields AssociationRef be:
{“AssociationRef”:“<Bucket>/ XXX_XXX.avi ", " MetaDataField ":
“AssociationInfo”}
Wherein, AssociationRef is Key, and Value values are:“<Bucket>/ XXX_XXX.avi ", is closed for storage
Join the source object ID of information.MetaDataField is Key, and Value values are " AssociationInfo ", represents storage association letter
The title of the metadata fields of breath.
Step S201- steps S203 reality is illustrated with the electronic information in medical industry for patient below
It is existing:
Assuming that the information of each patient includes:Electronic health record, multiple medical imaging picture, inspection or results of laboratory test and base
Because and analysis result totally four kinds of medical record informations.
When four kinds of medical record informations are stored in object storage system, every kind of medical record information is an object.In order to incite somebody to action
Four objects constitute an object coherent group, to realize quick-searching of the user to four kinds of objects, take preset strategy to determine certain
One electronic health record is source object, and stores related information in the metadata fields AssociationInfo of source object, simultaneously
The storage association reference information in the metadata fields AssociationRef of three other related objects, when user inputs four
During any object mark in individual object, can according to the related information stored in metadata corresponding with the object identity or
Associate reference information, determine any object associated in object coherent group.
Wherein, preset strategy can be by the minimum medical record information of the number of characters of ID in four kinds of medical record informations in practical application
It is defined as source object, related information is the ID of each related object in object coherent group, and association reference information is storage related information
Source object ID and metadata fields title.
Step S204, reception related information read requests, the related information read requests carry the first object identity;
Whether there is entitled first field in step S205, judgement metadata corresponding with first object identity
Field, if so, performing step S206, otherwise performs step S208;
First field is used to store related information.
When be stored with the first field related information when, illustrate the first object identity be source object mark.
Step S206, the content for reading first field, to obtain the related information;
Step S207, to user return to the related information;
Whether there is entitled second field in step S208, judgement metadata corresponding with first object identity
Field, if so, performing step S209, otherwise terminates flow;
Step S209, the content for reading second field, to obtain source object mark, and return to execution step S206;
Second field, which is used to store in association reference information, the metadata of the source object, has the first field.
Step S204- steps S209 is accomplished that to be enumerated to related information, when user or operation system needs acquisition pass
When joining information, realized by above-mentioned steps.
Step S210, determine whether that new data file needs to store into the object storage system, it is described new
Data file has incidence relation with least two data file, if so, performing step S211;
Step S211, identifying the new data file added to the metadata fields for storing the related information
In, and the mark of the source object of target association reference information and the title of metadata fields are added to the metadata of new object
In;
Wherein, the new object is corresponding with the new data file.
Step S210- steps S211 is accomplished that the addition to incidence relation, when needs are added in object storage system
, it is necessary to create the new related information of new object and source object during new object (being subsequently referred to as new object), and should
New related information is added in related information, the metadata in new object is separately also updated, so that first number of new object
The mark for the source object for preserving related information according to pointing to.
Step S212, reception incidence relation removal request, the incidence relation removal request carry the second object identity;
Whether there is entitled first word in step S213, judgement metadata corresponding with second object identity
The field of section, if so, performing step S214, otherwise performs step S216;
Step S214, judgement have in the object of the incidence relation with the second object, the reference information that associates that stores is
It is no to be all deleted, if so, performing step S215, otherwise terminate flow;
The related information stored in step S215, deletion metadata corresponding with second object identity;
When having the field of entitled first field in metadata corresponding with the second object identity, show the second object
For source object, after the related information in deleting source object, it can continue to select an object from related object as new
Source object, and create the incidence relation of new source object and the related object in addition to new source object.
The association reference information stored in step S216, deletion metadata corresponding with second object identity.
Step S212- steps S216 is accomplished that the deletion to incidence relation, and the main thought being related to is that deletion contains the
Association reference information in the object of two fields, and delete in addition to itself, it is not associated and draws by other any object
The related information of object.If asking to be stored with the first field in the object deleted, and there are other in addition to itself
Object refer to related information by the second field, then the related information of the object can not be deleted.When by the related information phase
After related information in all objects closed is all deleted, then delete the object.
Step S217, reception object removal request, the object removal request carry the 3rd object identity;
It is whether in step S218, judgement metadata corresponding with the 3rd object identity with entitled first field
Or second field field;
Step S219, if it is not, deleting corresponding with the 3rd object identity the 3rd object.
Step S217- steps S219 is accomplished that the deletion to object in object storage system, is deleted receiving object
After request, judge to be whether the word with entitled first field or the second field in metadata corresponding with the 3rd object identity
Section, failure is deleted if so, then returning, and points out to store relevant in the reason for user or operation system delete failure, such as object
Information or association reference information, if it is not, then directly deleting object from object storage system.
It should be noted that being walked for what step S204- steps S209 was realized to the enumerating of related information, step S210-
What rapid S211 was realized realize to the addition of incidence relation, step S212- steps S216 to incidence relation deletion and step
Can be independently real between these schemes that object is deleted from object storage system that S217- steps S219 is realized, each scheme
Apply, without with absolute adduction relationship and execution sequence.
In practical application:
1) object created in step S201- steps S203 in object storage, tool are realized by creating incidence relation interface
Body, create incidence relation interface as follows:
Create_AssociationInfo (AssociationInfoMetaData, Array<ObjectID>);
Wherein, first parameter AssociationInfoMetaData is the content of related information, second parameter be with
The ID arrays of the related all objects of this related information.During practical application, acquiescence can use first in the ID arrays of object
Object is as source object, and the metadata that remaining object in related information, ID arrays is stored using the metadata of source object is deposited
Storage association reference information, preserves the source object mark for pointing to storage related information.
2) realized by enumerating related information interface and related information is enumerated in step S204- steps S209, specifically,
Enumerate related information interface as follows:
Get_AssociationInfo(ObjectID);
Wherein, parameter ObjectID is the first object identity.
3) addition in step S210- steps S211 to new related information is realized by adding new related information interface,
Specifically, new related information interface is added as follows:
Add_AssociationInfo(AssociationInfoMetaData,SrcObjectID,DstObjectID);
Wherein, first parameter AssociationInfoMetaData is the mark of new data file, second parameter
SrcObjectID is the mark of new object, and the 3rd parameter DstObjectID is the mark of source object.
4) deletions of the step S212- steps S216 to related information, specifically, institute are realized by deleting related information interface
State deletion related information interface as follows:
Delete_AssociationInfo(ObjectID);
Wherein, interface parameters ObjectID is the second object identity.
5) realize in step S217- steps S219 and object deleted from object storage system have by deleting object interface
Body, the deletion object interface is as follows:
Drop_Object(ObjectID);
Wherein, ObjectID is the 3rd object identity.
The technical scheme that the present embodiment is provided, it would be desirable to which at least two data files are stored in object storage system
When, at least two data file is created as to the object in object storage system, wherein, the metadata in object is stored with
The incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, search pair
As when, without relying on any third party system or instrument, just can quick-searching to correlation any object, object is improved with this
The recall precision of storage system.In addition, can also quickly be realized to incidence relation based on the incidence relation being stored in metadata
Enumerate, delete and add.
Referring to Fig. 3, a kind of structural representation for the object storage device that Fig. 3 provides for the embodiment of the present application, the device
The implementation procedure of method in the corresponding embodiment of course of work reference picture 1 of each unit in structural representation, the device includes:
Acquiring unit 301, for obtaining at least two data files, there is at least two data file association to close
System;
First judging unit 302, object storage is stored in for judging whether to need by least two data file
In system;
Creating unit 303, for determining to need to store at least two data file when first judging unit
When in object storage system, at least two data file is created as to the object in object storage system, it is each described
Object includes the incidence relation that is stored with object data and metadata, the metadata.
The technical scheme that the present embodiment is provided, will need at least two data files being stored in object by acquiring unit
When in storage system, at least two data file is created as by object storage system by the first judging unit and creating unit
Object in system, wherein, the metadata in object is stored with the incidence relation.Due to the incidence relation between object being stored in
In metadata, so,, just can be quick without relying on any third party system or instrument when user needs to retrieve, searches object
Any object of correlation is retrieved, the recall precision of object storage system is improved with this.
Referring to Fig. 4, a kind of structural representation for the object storage device that Fig. 4 provides for the embodiment of the present application, the device
The implementation procedure of method in the corresponding embodiment of course of work reference picture 2 of each unit in structural representation, the device includes:
Acquiring unit 401, for obtaining at least two data files, there is at least two data file association to close
System;
First judging unit 402, object storage is stored in for judging whether to need by least two data file
In system;
Creating unit 403, for determining to need to store at least two data file when first judging unit
When in object storage system, at least two data file is created as to the object in object storage system, it is each described
Object includes the incidence relation that is stored with object data and metadata, the metadata.
Wherein, the incidence relation includes related information and associate reference information, the related information including described at least
The mark of each data file in two data files, in addition to source data file, the association reference information includes storage institute
The mark of the source data file of related information is stated, the source data file is any data at least two data file
File;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file,
The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object
The association reference information that is stored with the related information, the metadata of each related object and the storage association
The title of the metadata fields of information;Or,
The incidence relation includes related information, and the related information each stored in the metadata of object is and this pair
As corresponding data file has a mark of all data files of incidence relation, a pair of the data file and the object 1
Should.
First receiving unit 404, for receiving related information read requests, the related information read requests carry first
Object identity;
Second judging unit 405, for judging whether there is title in metadata corresponding with first object identity
For the field of the first field, first field is used to store the related information;
First reading unit 406, for being determined when second judging unit during field with entitled first field,
The content of first field is read, to obtain the related information;
Returning unit 407, for returning to the related information to user;
3rd judging unit 408, for being determined when second judging unit during field with entitled first field,
Judge whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit 409, for being determined when the 3rd judging unit during field with entitled second field,
The content of second field is read, to obtain source object mark, and the step for performing the content for reading first field is returned to
Suddenly;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object
Field;
Second receiving unit 410, for receiving incidence relation removal request, the incidence relation removal request carries second
Object identity;
4th judging unit 411, for judging whether there is title in metadata corresponding with second object identity
For the field of first field;
5th judging unit 412, for being determined when the 4th judging unit during field with entitled first field,
Judge and the second object has in the related object of the incidence relation, whether the association reference information that stores all has been deleted
Remove;
First deletes unit 413, for determining that the association reference information has all been deleted when the 5th judging unit
When, delete the related information stored in second object;
Second deletes unit 414, for determining during the field without entitled first field, to delete when the 4th judging unit
Except the association reference information stored in metadata corresponding with second object identity;
3rd receiving unit 415, for receiving object removal request, the object removal request carries the 3rd object mark
Know;
6th judging unit 416, for judging whether there is title in metadata corresponding with the 3rd object identity
For the first field or the field of the second field;
3rd deletes unit 417, for determining without entitled first field when the 6th judging unit or
During the field of second field, the 3rd object corresponding with the 3rd object identity is deleted;
7th judging unit 418, for determining whether that new data file needs to store to the object storage system
In, the new data file has incidence relation with least two data file;
Adding device 419, for determining there is new data file to need to store to described right when the 7th judging unit
During as in storage system, the mark of the new data file is added in the metadata fields for storing the related information,
And the mark of source object and the title of metadata fields of the related information will be stored added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The technical scheme that the present embodiment is provided, will need at least two data files being stored in object by acquiring unit
When in storage system, at least two data file is created as by object storage system by the first judging unit and creating unit
Object in system, wherein, the metadata in object is stored with the incidence relation.Due to the incidence relation between object being stored in
In metadata, so,, just can be quick without relying on any third party system or instrument when user needs to retrieve, searches object
Any object of correlation is retrieved, the recall precision of object storage system is improved with this.In addition, based on the first receiving unit,
Second judging unit, the first reading unit and returning unit can also be realized quickly to be enumerated to related information, is judged by the 3rd
Unit, the second reading unit, the second receiving unit, the 4th judging unit, the 5th judging unit etc. can also be realized quickly to association
Enumerating, delete and adding for relation, user is improved to object storage system access efficiency with this.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms be used merely to by
One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation
Between there is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering including for nonexcludability, so that process, method, article or equipment including a series of key elements not only include that
A little key elements, but also other key elements including being not expressly set out, or also include be this process, method, article or
The intrinsic key element of equipment.The embodiment of each in this specification is described by the way of progressive, what each embodiment was stressed
All be between the difference with other embodiment, each embodiment identical similar portion mutually referring to.
The foregoing description of the disclosed embodiments, enables professional and technical personnel in the field to realize or use the application.
A variety of modifications to these embodiments will be apparent for those skilled in the art, as defined herein
General Principle can in other embodiments be realized in the case where not departing from spirit herein or scope.Therefore, the application
The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one
The most wide scope caused.
Claims (14)
1. a kind of object storage method, it is characterised in that including:
At least two data files are obtained, at least two data file has incidence relation;
Judge whether to need at least two data file being stored in object storage system;
If so, at least two data file to be created as to the object in object storage system, each object includes pair
Be stored with the incidence relation in image data and metadata, the metadata.
2. according to the method described in claim 1, it is characterised in that the incidence relation includes related information and associates reference letter
Breath, the related information includes the mark of each data file at least two data file, in addition to source data file,
The association reference information includes the mark for storing the source data file of the related information, the source data file for it is described extremely
Any data file in few two data files;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, described
Related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object described
The association reference information that is stored with related information, the metadata of each related object and the storage related information
Metadata fields title.
3. method according to claim 2, it is characterised in that also include:
Related information read requests are received, the related information read requests carry the first object identity;
Judge whether there is the field of entitled first field, described first in metadata corresponding with first object identity
Field is used to store the related information;
When it is determined that during field with entitled first field, reading the content of first field, being believed with obtaining the association
Breath;
The related information is returned to user;
When it is determined that during field without entitled first field, judging to be in metadata corresponding with first object identity
The no field with entitled second field;
When it is determined that during field with entitled second field, read the content of second field, to obtain source object mark,
And return to the step of performing the content for reading first field;
Second field, which is used to store, has first word in the association reference information, the metadata of the source object
Section.
4. method according to claim 3, it is characterised in that also include:
Incidence relation removal request is received, the incidence relation removal request carries the second object identity;
Judge whether there is the field of entitled first field in metadata corresponding with second object identity;
When it is determined that during field with entitled first field, judging the related object that there is the incidence relation with the second object
In, storage the association reference information whether be all deleted;
When it is determined that the association reference information is all deleted, the related information stored in second object is deleted;
When it is determined that during field without entitled first field, deleting and being deposited in metadata corresponding with second object identity
The association reference information of storage.
5. method according to claim 3, it is characterised in that also include:
Object removal request is received, the object removal request carries the 3rd object identity;
Judge whether there is the word of entitled first field or the second field in metadata corresponding with the 3rd object identity
Section;
If it is not, deleting the 3rd object corresponding with the 3rd object identity.
6. method according to claim 2, it is characterised in that also include:
Determine whether that new data file needs to store into the object storage system, the new data file with it is described
At least two data files have incidence relation;
If so, the mark of the new data file is added in the metadata fields for storing the related information, and it will deposit
Store up the mark of the source object of the related information and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
7. according to the method described in claim 1, it is characterised in that the incidence relation includes related information, and each object
Metadata in the related information that stores is, data file corresponding with the object has all data files of incidence relation
Mark, the data file is corresponded with the object.
8. a kind of object storage device, it is characterised in that including:
Acquiring unit, for obtaining at least two data files, at least two data file has incidence relation;
First judging unit, for judging whether to need at least two data file being stored in object storage system;
Creating unit, for determining that at least two data file is stored in object and deposited by needs when first judging unit
When in storage system, at least two data file is created as to the object in object storage system, each object includes
Be stored with the incidence relation in object data and metadata, the metadata.
9. device according to claim 8, it is characterised in that the incidence relation includes related information and associates reference letter
Breath, the related information includes the mark of each data file at least two data file, in addition to source data file,
The association reference information includes the mark for storing the source data file of the related information, the source data file for it is described extremely
Any data file in few two data files;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, described
Related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object described
The association reference information that is stored with related information, the metadata of each related object and the storage related information
Metadata fields title.
10. device according to claim 9, it is characterised in that also include:
First receiving unit, for receiving related information read requests, the related information read requests carry the first object mark
Know;
Second judging unit, for judging whether there is entitled first word in metadata corresponding with first object identity
The field of section, first field is used to store the related information;
First reading unit, for determining during the field with entitled first field, to read institute when second judging unit
The content of the first field is stated, to obtain the related information;
Returning unit, for returning to the related information to user;
3rd judging unit, for determining during the field without entitled first field, to judge when second judging unit
Whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit, for determining during the field with entitled second field, to read institute when the 3rd judging unit
The content of the second field is stated, to obtain source object mark, and return the step of performing the content for reading first field;
Second field, which is used to store, has first word in the association reference information, the metadata of the source object
Section.
11. device according to claim 10, it is characterised in that also include:
Second receiving unit, for receiving incidence relation removal request, the incidence relation removal request carries the second object mark
Know;
4th judging unit, for whether judging in corresponding with second object identity metadata with entitled described the
The field of one field;
5th judging unit, for when the 4th judging unit determine with entitled first field field when, judge with
Whether the association reference information that the second object has in the related object of the incidence relation, store all has been deleted;
First deletes unit, for when the 5th judging unit determines that the association reference information is all deleted, deleting
The related information stored in second object;
Second deletes unit, for determining during the field without entitled first field, to delete and institute when the 4th judging unit
State the association reference information stored in the corresponding metadata of the second object identity.
12. device according to claim 10, it is characterised in that also include:
3rd receiving unit, for receiving object removal request, the object removal request carries the 3rd object identity;
6th judging unit, for judging whether there is entitled first word in metadata corresponding with the 3rd object identity
The field of section or the second field;
3rd deletes unit, for determining do not have entitled first field or described second when the 6th judging unit
During the field of field, the 3rd object corresponding with the 3rd object identity is deleted.
13. device according to claim 9, it is characterised in that also include:
7th judging unit, it is described for determining whether that new data file needs to store into the object storage system
New data file has incidence relation with least two data file;
Adding device, for determining there is new data file to need to store to object storage system when the 7th judging unit
When in system, the mark of the new data file is added in the metadata fields for storing the related information, and will storage
The mark of the source object of the related information and the title of metadata fields are added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
14. device according to claim 8, it is characterised in that the incidence relation includes related information, and each object
Metadata in the related information that stores is, data file corresponding with the object has all data files of incidence relation
Mark, the data file is corresponded with the object.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710392920.6A CN107229713A (en) | 2017-05-27 | 2017-05-27 | A kind of object storage method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710392920.6A CN107229713A (en) | 2017-05-27 | 2017-05-27 | A kind of object storage method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107229713A true CN107229713A (en) | 2017-10-03 |
Family
ID=59933430
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710392920.6A Pending CN107229713A (en) | 2017-05-27 | 2017-05-27 | A kind of object storage method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107229713A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110598053A (en) * | 2019-08-16 | 2019-12-20 | 上海爱数信息技术股份有限公司 | Metadata management method and management system based on object tree |
CN116150093A (en) * | 2023-03-04 | 2023-05-23 | 北京大道云行科技有限公司 | Method for realizing object storage enumeration of objects and electronic equipment |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103902656A (en) * | 2005-04-21 | 2014-07-02 | 雅虎公司 | Media object metadata association and ranking |
CN104981802A (en) * | 2013-02-27 | 2015-10-14 | 日立数据系统有限公司 | Content class for object storage indexing system |
CN106202367A (en) * | 2016-07-07 | 2016-12-07 | 腾讯科技(深圳)有限公司 | A kind of processing method and processing device of object information |
EP3159796A1 (en) * | 2015-09-21 | 2017-04-26 | Zerto Ltd. | System and method for generating backups of a protected system from a recovery system |
-
2017
- 2017-05-27 CN CN201710392920.6A patent/CN107229713A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103902656A (en) * | 2005-04-21 | 2014-07-02 | 雅虎公司 | Media object metadata association and ranking |
CN104981802A (en) * | 2013-02-27 | 2015-10-14 | 日立数据系统有限公司 | Content class for object storage indexing system |
EP3159796A1 (en) * | 2015-09-21 | 2017-04-26 | Zerto Ltd. | System and method for generating backups of a protected system from a recovery system |
CN106202367A (en) * | 2016-07-07 | 2016-12-07 | 腾讯科技(深圳)有限公司 | A kind of processing method and processing device of object information |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110598053A (en) * | 2019-08-16 | 2019-12-20 | 上海爱数信息技术股份有限公司 | Metadata management method and management system based on object tree |
CN116150093A (en) * | 2023-03-04 | 2023-05-23 | 北京大道云行科技有限公司 | Method for realizing object storage enumeration of objects and electronic equipment |
CN116150093B (en) * | 2023-03-04 | 2023-11-03 | 北京大道云行科技有限公司 | Method for realizing object storage enumeration of objects and electronic equipment |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9298702B1 (en) | Systems and methods for pairing of a semantic network and a natural language processing information extraction system | |
US7765236B2 (en) | Extracting data content items using template matching | |
US6985950B1 (en) | System for creating a space-efficient document categorizer for training and testing of automatic categorization engines | |
US7225407B2 (en) | Resource browser sessions search | |
US7962514B2 (en) | Attaching and displaying annotations to changing data views | |
US20040015514A1 (en) | Method and system for managing data objects | |
US8626792B2 (en) | Hierarchical structured abstract data organization system | |
CA2790421C (en) | Indexing and searching employing virtual documents | |
KR20080071213A (en) | System and method for research information service based on semantic web | |
CN104317897A (en) | Visual label topic map-based pilot method of digital library | |
Terveen et al. | Finding and visualizing inter-site clan graphs | |
CN1841377A (en) | Crawling databases for information | |
CN107229713A (en) | A kind of object storage method and device | |
CN112765601B (en) | Website homepage structure monitoring method based on cloud | |
Charles et al. | Achieving interoperability between the CARARE schema for monuments and sites and the Europeana Data Model | |
US20040122809A1 (en) | Information augmentation method | |
US20120109965A1 (en) | System for automatic semantic-based mining | |
Perry et al. | Discovering similar resources by content part-linking | |
Foo et al. | A hypermedia database to manage World-Wide-Web documents | |
Matsumura et al. | Discovering emerging topics from WWW | |
Moftah et al. | Methods to access structured and semi-structured data in bioinformatics databases: A perspective | |
Shen | Data discovery, reuse, and integration: the perspectives of natural resources and environmental scientists | |
Wu | The semantic retrieval system for learning resources based on subject knowledge ontology | |
Berwick et al. | Research Priorities for the World Wide Web | |
Divya et al. | Ontology based search result optimisation using singular matrix |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
AD01 | Patent right deemed abandoned |
Effective date of abandoning: 20220111 |
|
AD01 | Patent right deemed abandoned |