CN107229713A - A kind of object storage method and device - Google Patents

A kind of object storage method and device Download PDF

Info

Publication number
CN107229713A
CN107229713A CN201710392920.6A CN201710392920A CN107229713A CN 107229713 A CN107229713 A CN 107229713A CN 201710392920 A CN201710392920 A CN 201710392920A CN 107229713 A CN107229713 A CN 107229713A
Authority
CN
China
Prior art keywords
field
data file
metadata
related information
incidence relation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710392920.6A
Other languages
Chinese (zh)
Inventor
王守能
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Consonance Zsplat (beijing) Technology Development Co Ltd
Original Assignee
Consonance Zsplat (beijing) Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Consonance Zsplat (beijing) Technology Development Co Ltd filed Critical Consonance Zsplat (beijing) Technology Development Co Ltd
Priority to CN201710392920.6A priority Critical patent/CN107229713A/en
Publication of CN107229713A publication Critical patent/CN107229713A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G06F16/164File meta data generation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata

Abstract

The invention discloses a kind of object storage method and device, this method includes:At least two data files are obtained, at least two data file has incidence relation;Judge whether to need at least two data file being stored in object storage system;If so, at least two data file to be created as to the object in object storage system, each object includes the incidence relation that is stored with object data and metadata, the metadata.Due to the incidence relation between object is stored in metadata, so, when user needs to retrieve, searches object, without relying on any third party system or instrument, just energy quick-searching improves the recall precision in object storage system with this to related any object.

Description

A kind of object storage method and device
Technical field
The present invention relates to field of storage, more particularly to a kind of object storage method and device.
Background technology
With the fast development of Internet era big data technology, information digitalization process increasingly accelerates, substantial amounts of structure Change and unstructured data explosive growth at an unprecedented rate, this to collect, stored and analysis mining data The demand of value is greatly increased.Based on this, a kind of new storage system --- object storage system arises at the historic moment.Deposited in object In storage system, each data file be referred to as it is separate between an object, each object, it is unrelated.
However, because data file derives from real production and living, and the data produced in the production and living of reality are literary Various relevances are all there are between part, so using object storage system data storage, be user search, access with And file is updated the data, introduce extra complexity.For example:In the media asset management system of radio, TV and film industries, the matchmaker of a program Money material includes:The high code video file of program, low code video file, one or more audio file, subtitle file, these numbers According to file Yi Dan after storage to object storage system, the relevance between data file will disappear with the objectification of data, User searches, accesses and update the data file, it is necessary to build third party system outside object storage system to deposit for convenience The incidence relation between each data file is stored up, usually using relevant database.However, building third party system in addition, no Only waste of resource, and be unfavorable for user's quick-searching to the object needed.
The content of the invention
In order to solve the above technical problems, the embodiments of the invention provide a kind of object storage method and device, technical scheme It is as follows:
A kind of object storage method, including:
At least two data files are obtained, at least two data file has incidence relation;
Judge whether to need at least two data file being stored in object storage system;
If so, at least two data file is created as to the object in object storage system, each object bag Include the incidence relation that is stored with object data and metadata, the metadata.
Preferably, the incidence relation includes related information and associate reference information, the related information including described in extremely The mark of each data file in few two data files, in addition to source data file, the association reference information includes storage The mark of the source data file of the related information, the source data file is any number at least two data file According to file;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object The association reference information that is stored with the related information, the metadata of each related object and the storage association The title of the metadata fields of information.
Preferably, in addition to:
Related information read requests are received, the related information read requests carry the first object identity;
Judge whether there is the field of entitled first field in metadata corresponding with first object identity, it is described First field is used to store the related information;
When it is determined that during field with entitled first field, the content of first field is read, to obtain the pass Join information;
The related information is returned to user;
When it is determined that during field without entitled first field, judging metadata corresponding with first object identity In whether have entitled second field field;
When it is determined that during field with entitled second field, the content of second field is read, to obtain source object Mark, and return to the step of performing the content for reading first field;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object Field.
Preferably, in addition to:
Incidence relation removal request is received, the incidence relation removal request carries the second object identity;
Judge whether there is the field of entitled first field in metadata corresponding with second object identity;
When it is determined that during field with entitled first field, judgement has the related of the incidence relation to the second object In object, storage the association reference information whether be all deleted;
When it is determined that the association reference information is all deleted, the related information stored in second object is deleted;
When it is determined that during field without entitled first field, deleting metadata corresponding with second object identity The association reference information of middle storage.
Preferably, in addition to:
Object removal request is received, the object removal request carries the 3rd object identity;
Judge whether there is entitled first field or the second field in metadata corresponding with the 3rd object identity Field;
If it is not, deleting the 3rd object corresponding with the 3rd object identity.
Preferably, in addition to:
Judge whether it is in need store into the object storage system, the new data file and described at least two Data file has incidence relation;
If so, the mark of the new data file is added in the metadata fields for storing the related information, and The mark of the source object of the related information will be stored and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The related information that preferably, the incidence relation includes storing in related information, and the metadata of each object is, Data file corresponding with the object has the mark of all data files of incidence relation, the data file and the object Correspond.
A kind of object storage device, including:
Acquiring unit, for obtaining at least two data files, at least two data file has incidence relation;
First judging unit, for judging whether to need at least two data file being stored in object storage system In;
Creating unit, for determining to need at least two data file being stored in pair when first judging unit During as in storage system, at least two data file is created as to the object in object storage system, each object Including object data and metadata, be stored with the incidence relation in the metadata.
Preferably, the incidence relation includes related information and associate reference information, the related information including described in extremely The mark of each data file in few two data files, in addition to source data file, the association reference information includes storage The mark of the source data file of the related information, the source data file is any number at least two data file According to file;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object The association reference information that is stored with the related information, the metadata of each related object and the storage association The title of the metadata fields of information.
Preferably, in addition to:
First receiving unit, for receiving related information read requests, the related information read requests carry first pair As mark;
Second judging unit, for whether judging in corresponding with first object identity metadata with entitled the The field of one field, first field is used to store the related information;
First reading unit, for determining during the field with entitled first field, to read when second judging unit The content of first field is taken, to obtain the related information;
Returning unit, for returning to the related information to user;
3rd judging unit, for being determined when second judging unit during field without entitled first field, Judge whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit, for determining during the field with entitled second field, to read when the 3rd judging unit The content of second field is taken, to obtain source object mark, and return the step of performing the content for reading first field;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object Field.
Preferably, in addition to:
Second receiving unit, for receiving incidence relation removal request, the incidence relation removal request carries second pair As mark;
4th judging unit, for judging whether there is entitled institute in metadata corresponding with second object identity State the field of the first field;
5th judging unit, for determining during the field with entitled first field, to sentence when the 4th judging unit It is disconnected have with the second object in the related object of the incidence relation, whether the association reference information that stores all has been deleted Remove;
First delete unit, for when the 5th judging unit determine it is described association reference information all be deleted when, Delete the related information stored in second object;
Second deletes unit, for determining during the field without entitled first field, to delete when the 4th judging unit The association reference information stored in metadata corresponding with second object identity.
Preferably, in addition to:
3rd receiving unit, for receiving object removal request, the object removal request carries the 3rd object identity;
6th judging unit, for whether judging in corresponding with the 3rd object identity metadata with entitled the The field of one field or the second field;
3rd deletes unit, for determining do not have entitled first field or described when the 6th judging unit During the field of the second field, the 3rd object corresponding with the 3rd object identity is deleted.
Preferably, in addition to:
7th judging unit, for determining whether that new data file needs to store into the object storage system, The new data file has incidence relation with least two data file;
Adding device, for determining there is new data file to need to store to the object to deposit when the 7th judging unit When in storage system, the mark of the new data file is added in the metadata fields for storing the related information, and will Store the mark of the source object of the related information and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The related information that preferably, the incidence relation includes storing in related information, and the metadata of each object is, Data file corresponding with the object has the mark of all data files of incidence relation, the data file and the object Correspond.
The technical scheme that the embodiment of the present invention is provided, it would be desirable to which at least two data files are stored in object storage system When in system, at least two data file is created as to the object in object storage system, wherein, the metadata in object is deposited Contain the incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, look into When looking for a partner in marriage, without relying on any third party system or instrument, just energy quick-searching is improved to related any object with this The recall precision of object storage system.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, without having to pay creative labor, may be used also To obtain other accompanying drawings according to these accompanying drawings.
A kind of a kind of schematic flow sheet for object storage method that Fig. 1 is provided by the embodiment of the present invention;
A kind of another schematic flow sheet for object storage method that Fig. 2 is provided by the embodiment of the present invention;
A kind of a kind of structural representation for object storage device that Fig. 3 is provided by the embodiment of the present invention;
A kind of another structural representation for object storage device that Fig. 4 is provided by the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this Embodiment in invention, the every other reality that those of ordinary skill in the art are obtained under the premise of creative work is not made Example is applied, the scope of protection of the invention is belonged to.
Term " first ", " second ", " the 3rd " " in description and claims of this specification and above-mentioned accompanying drawing The (if present)s such as four " are for distinguishing similar object, without for describing specific order or precedence.It should manage The data that solution is so used can be exchanged in the appropriate case, so as to embodiments of the invention described herein, for example can be with Order in addition to those for illustrating or describing herein is implemented.In addition, term " comprising " and " having " and their times What is deformed, it is intended that covering is non-exclusive to be included, for example, contain the process of series of steps or unit, method, system, Product or equipment are not necessarily limited to those steps clearly listed or unit, but may include not list clearly or for The intrinsic other steps of these processes, method, product or equipment or unit.
Referring to Fig. 1, a kind of implementation process figure for the object storage method that Fig. 1 provides for the embodiment of the present application, the side Method includes:
Step S101, at least two data files of acquisition, at least two data file have incidence relation;
The data file of the present embodiment both can be structural data can also unstructured data, wherein, structuring number According to the data for referring to be realized come logical expression with bivariate table structure, such as Microsoft Excel, unstructured data refers to not side Just under the data showed with two-dimentional logical table, the office documents of such as all formats, text, picture, standard generalized markup language Subset X ML, HTML, all kinds of forms, image and audio/visual information etc..
There is at least two data files incidence relation to refer to when at least two data files are stored in object storage system When in system, other objects can be found according to the object identity of any object, by the incidence relation.
Step S102, judge whether need at least two data file is stored in object storage system, if so, Perform step S103;
Step S103, the object at least two data file being created as in object storage system, the object bag Include the incidence relation that is stored with object data and metadata, the metadata.
The object information of each object is made up of two parts data in object storage system, and a part is metadata, separately A part is object data, wherein, except some base attribute (such as size, uplink time, schools comprising the object in metadata Test code etc.) outside the field of description, the field by User Defined and extension can be also included, therefore, the present embodiment is by incidence relation It is stored in this.
The metadata of object is generally by multigroup { Key:Value } to composition, wherein Key is the title of metadata fields, Value is the content that stores in the field.This characteristic is stored using object, the incidence relation between object object can be stored in Metadata in.
The storage format of incidence relation in the metadata between object, can be deposited using semi-structured JSON formatted datas Storage.
The technical scheme that the present embodiment is provided, it would be desirable to which at least two data files are stored in object storage system When, at least two data file is created as to the object in object storage system, wherein, the metadata in object is stored with The incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, search pair As when, without relying on any third party system or instrument, just can quick-searching to correlation any object, object is improved with this The recall precision of storage system.
Referring to Fig. 2, another implementation process figure for the object storage method that Fig. 2 provides for the embodiment of the present application, described Method includes:
Step S201, at least two data files of acquisition;
At least two data file has incidence relation, and the incidence relation includes related information and associates reference letter Breath, the related information includes the mark of each data file in addition to source data file, and the association reference information includes depositing Store up the mark of the source data file of the related information.
In practical application, according to business needs, attribute information can also be included in related information, attribute information can be pair The type of elephant or other information relevant with business.
In addition, according to business needs, incidence relation can only include what is stored in related information, the metadata of each object Related information is, data file corresponding with the object have incidence relation all data files mark, data text Part is corresponded with the object.
The source data file is any data file at least two data file, wherein, data file mark It can be data file ID to know, in object storage, i.e. data file identification object ID, unique in the overall situation.
Step S202, judge whether need at least two data file is stored in object storage system, if so, Step S203 is performed, otherwise terminates flow;
Step S203, the object being created as at least two data file in object storage system;
Each object includes object data and metadata, and the object includes source object and related object, the source Object is corresponding with the source data file, the related object and a pair of the data file 1 in addition to the source data file Should, be stored with the related information in the metadata of the source object, is stored in the metadata of each related object State the title of the metadata fields of association reference information and the storage related information.
Create because each metadata of object is by one group of { Key:Value } to composition, therefore, stored in object In metadata, specific name can be carried out to the field name for the metadata for storing incidence relation, so as to quick-searching to association Relation.Such as, the field name of two kinds of metadata is defined, is respectively:AssociationInfo and AssociationRef, i.e. In the object of storage incidence relation, metadata fields AssociationInfo={ " AssociationInfo " is defined:< Value>As the metadata of storage related information, define metadata fields AssociationRef= {“AssociationRef”:<Value>It is used as the metadata of storage association reference information.
Below by taking the program material of broadcasting and TV media resource system as an example, the metadata fields to storing related information AssociationInfo and the metadata fields AssociationRef of storage association reference information are illustrated, due to one Individual program material covers multiple material objects, so the metadata fields AssociationInfo of storage related information can be adopted Use JSON forms:
Wherein, AssociationInfo is the title of the field of metadata, and ObjectName is Key, represents related object ID, and corresponding Value values be "<Bucket>/ XXX_XXX.avi ", ObjectType represent the type of related object, value For " high ", it is high encoded video to represent file.
It should be noted that according to actual business needs, must need not be wrapped in metadata fields AssociationInfo Type containing related object, but including at least the ID of each related object.
Storage association reference information metadata fields AssociationRef be:
{“AssociationRef”:“<Bucket>/ XXX_XXX.avi ", " MetaDataField ": “AssociationInfo”}
Wherein, AssociationRef is Key, and Value values are:“<Bucket>/ XXX_XXX.avi ", is closed for storage Join the source object ID of information.MetaDataField is Key, and Value values are " AssociationInfo ", represents storage association letter The title of the metadata fields of breath.
Step S201- steps S203 reality is illustrated with the electronic information in medical industry for patient below It is existing:
Assuming that the information of each patient includes:Electronic health record, multiple medical imaging picture, inspection or results of laboratory test and base Because and analysis result totally four kinds of medical record informations.
When four kinds of medical record informations are stored in object storage system, every kind of medical record information is an object.In order to incite somebody to action Four objects constitute an object coherent group, to realize quick-searching of the user to four kinds of objects, take preset strategy to determine certain One electronic health record is source object, and stores related information in the metadata fields AssociationInfo of source object, simultaneously The storage association reference information in the metadata fields AssociationRef of three other related objects, when user inputs four During any object mark in individual object, can according to the related information stored in metadata corresponding with the object identity or Associate reference information, determine any object associated in object coherent group.
Wherein, preset strategy can be by the minimum medical record information of the number of characters of ID in four kinds of medical record informations in practical application It is defined as source object, related information is the ID of each related object in object coherent group, and association reference information is storage related information Source object ID and metadata fields title.
Step S204, reception related information read requests, the related information read requests carry the first object identity;
Whether there is entitled first field in step S205, judgement metadata corresponding with first object identity Field, if so, performing step S206, otherwise performs step S208;
First field is used to store related information.
When be stored with the first field related information when, illustrate the first object identity be source object mark.
Step S206, the content for reading first field, to obtain the related information;
Step S207, to user return to the related information;
Whether there is entitled second field in step S208, judgement metadata corresponding with first object identity Field, if so, performing step S209, otherwise terminates flow;
Step S209, the content for reading second field, to obtain source object mark, and return to execution step S206;
Second field, which is used to store in association reference information, the metadata of the source object, has the first field.
Step S204- steps S209 is accomplished that to be enumerated to related information, when user or operation system needs acquisition pass When joining information, realized by above-mentioned steps.
Step S210, determine whether that new data file needs to store into the object storage system, it is described new Data file has incidence relation with least two data file, if so, performing step S211;
Step S211, identifying the new data file added to the metadata fields for storing the related information In, and the mark of the source object of target association reference information and the title of metadata fields are added to the metadata of new object In;
Wherein, the new object is corresponding with the new data file.
Step S210- steps S211 is accomplished that the addition to incidence relation, when needs are added in object storage system , it is necessary to create the new related information of new object and source object during new object (being subsequently referred to as new object), and should New related information is added in related information, the metadata in new object is separately also updated, so that first number of new object The mark for the source object for preserving related information according to pointing to.
Step S212, reception incidence relation removal request, the incidence relation removal request carry the second object identity;
Whether there is entitled first word in step S213, judgement metadata corresponding with second object identity The field of section, if so, performing step S214, otherwise performs step S216;
Step S214, judgement have in the object of the incidence relation with the second object, the reference information that associates that stores is It is no to be all deleted, if so, performing step S215, otherwise terminate flow;
The related information stored in step S215, deletion metadata corresponding with second object identity;
When having the field of entitled first field in metadata corresponding with the second object identity, show the second object For source object, after the related information in deleting source object, it can continue to select an object from related object as new Source object, and create the incidence relation of new source object and the related object in addition to new source object.
The association reference information stored in step S216, deletion metadata corresponding with second object identity.
Step S212- steps S216 is accomplished that the deletion to incidence relation, and the main thought being related to is that deletion contains the Association reference information in the object of two fields, and delete in addition to itself, it is not associated and draws by other any object The related information of object.If asking to be stored with the first field in the object deleted, and there are other in addition to itself Object refer to related information by the second field, then the related information of the object can not be deleted.When by the related information phase After related information in all objects closed is all deleted, then delete the object.
Step S217, reception object removal request, the object removal request carry the 3rd object identity;
It is whether in step S218, judgement metadata corresponding with the 3rd object identity with entitled first field Or second field field;
Step S219, if it is not, deleting corresponding with the 3rd object identity the 3rd object.
Step S217- steps S219 is accomplished that the deletion to object in object storage system, is deleted receiving object After request, judge to be whether the word with entitled first field or the second field in metadata corresponding with the 3rd object identity Section, failure is deleted if so, then returning, and points out to store relevant in the reason for user or operation system delete failure, such as object Information or association reference information, if it is not, then directly deleting object from object storage system.
It should be noted that being walked for what step S204- steps S209 was realized to the enumerating of related information, step S210- What rapid S211 was realized realize to the addition of incidence relation, step S212- steps S216 to incidence relation deletion and step Can be independently real between these schemes that object is deleted from object storage system that S217- steps S219 is realized, each scheme Apply, without with absolute adduction relationship and execution sequence.
In practical application:
1) object created in step S201- steps S203 in object storage, tool are realized by creating incidence relation interface Body, create incidence relation interface as follows:
Create_AssociationInfo (AssociationInfoMetaData, Array<ObjectID>);
Wherein, first parameter AssociationInfoMetaData is the content of related information, second parameter be with The ID arrays of the related all objects of this related information.During practical application, acquiescence can use first in the ID arrays of object Object is as source object, and the metadata that remaining object in related information, ID arrays is stored using the metadata of source object is deposited Storage association reference information, preserves the source object mark for pointing to storage related information.
2) realized by enumerating related information interface and related information is enumerated in step S204- steps S209, specifically, Enumerate related information interface as follows:
Get_AssociationInfo(ObjectID);
Wherein, parameter ObjectID is the first object identity.
3) addition in step S210- steps S211 to new related information is realized by adding new related information interface, Specifically, new related information interface is added as follows:
Add_AssociationInfo(AssociationInfoMetaData,SrcObjectID,DstObjectID);
Wherein, first parameter AssociationInfoMetaData is the mark of new data file, second parameter SrcObjectID is the mark of new object, and the 3rd parameter DstObjectID is the mark of source object.
4) deletions of the step S212- steps S216 to related information, specifically, institute are realized by deleting related information interface State deletion related information interface as follows:
Delete_AssociationInfo(ObjectID);
Wherein, interface parameters ObjectID is the second object identity.
5) realize in step S217- steps S219 and object deleted from object storage system have by deleting object interface Body, the deletion object interface is as follows:
Drop_Object(ObjectID);
Wherein, ObjectID is the 3rd object identity.
The technical scheme that the present embodiment is provided, it would be desirable to which at least two data files are stored in object storage system When, at least two data file is created as to the object in object storage system, wherein, the metadata in object is stored with The incidence relation.Due to the incidence relation between object is stored in metadata, so, need to retrieve as user, search pair As when, without relying on any third party system or instrument, just can quick-searching to correlation any object, object is improved with this The recall precision of storage system.In addition, can also quickly be realized to incidence relation based on the incidence relation being stored in metadata Enumerate, delete and add.
Referring to Fig. 3, a kind of structural representation for the object storage device that Fig. 3 provides for the embodiment of the present application, the device The implementation procedure of method in the corresponding embodiment of course of work reference picture 1 of each unit in structural representation, the device includes:
Acquiring unit 301, for obtaining at least two data files, there is at least two data file association to close System;
First judging unit 302, object storage is stored in for judging whether to need by least two data file In system;
Creating unit 303, for determining to need to store at least two data file when first judging unit When in object storage system, at least two data file is created as to the object in object storage system, it is each described Object includes the incidence relation that is stored with object data and metadata, the metadata.
The technical scheme that the present embodiment is provided, will need at least two data files being stored in object by acquiring unit When in storage system, at least two data file is created as by object storage system by the first judging unit and creating unit Object in system, wherein, the metadata in object is stored with the incidence relation.Due to the incidence relation between object being stored in In metadata, so,, just can be quick without relying on any third party system or instrument when user needs to retrieve, searches object Any object of correlation is retrieved, the recall precision of object storage system is improved with this.
Referring to Fig. 4, a kind of structural representation for the object storage device that Fig. 4 provides for the embodiment of the present application, the device The implementation procedure of method in the corresponding embodiment of course of work reference picture 2 of each unit in structural representation, the device includes:
Acquiring unit 401, for obtaining at least two data files, there is at least two data file association to close System;
First judging unit 402, object storage is stored in for judging whether to need by least two data file In system;
Creating unit 403, for determining to need to store at least two data file when first judging unit When in object storage system, at least two data file is created as to the object in object storage system, it is each described Object includes the incidence relation that is stored with object data and metadata, the metadata.
Wherein, the incidence relation includes related information and associate reference information, the related information including described at least The mark of each data file in two data files, in addition to source data file, the association reference information includes storage institute The mark of the source data file of related information is stated, the source data file is any data at least two data file File;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, The related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object The association reference information that is stored with the related information, the metadata of each related object and the storage association The title of the metadata fields of information;Or,
The incidence relation includes related information, and the related information each stored in the metadata of object is and this pair As corresponding data file has a mark of all data files of incidence relation, a pair of the data file and the object 1 Should.
First receiving unit 404, for receiving related information read requests, the related information read requests carry first Object identity;
Second judging unit 405, for judging whether there is title in metadata corresponding with first object identity For the field of the first field, first field is used to store the related information;
First reading unit 406, for being determined when second judging unit during field with entitled first field, The content of first field is read, to obtain the related information;
Returning unit 407, for returning to the related information to user;
3rd judging unit 408, for being determined when second judging unit during field with entitled first field, Judge whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit 409, for being determined when the 3rd judging unit during field with entitled second field, The content of second field is read, to obtain source object mark, and the step for performing the content for reading first field is returned to Suddenly;
Second field, which is used to store, has described first in the association reference information, the metadata of the source object Field;
Second receiving unit 410, for receiving incidence relation removal request, the incidence relation removal request carries second Object identity;
4th judging unit 411, for judging whether there is title in metadata corresponding with second object identity For the field of first field;
5th judging unit 412, for being determined when the 4th judging unit during field with entitled first field, Judge and the second object has in the related object of the incidence relation, whether the association reference information that stores all has been deleted Remove;
First deletes unit 413, for determining that the association reference information has all been deleted when the 5th judging unit When, delete the related information stored in second object;
Second deletes unit 414, for determining during the field without entitled first field, to delete when the 4th judging unit Except the association reference information stored in metadata corresponding with second object identity;
3rd receiving unit 415, for receiving object removal request, the object removal request carries the 3rd object mark Know;
6th judging unit 416, for judging whether there is title in metadata corresponding with the 3rd object identity For the first field or the field of the second field;
3rd deletes unit 417, for determining without entitled first field when the 6th judging unit or During the field of second field, the 3rd object corresponding with the 3rd object identity is deleted;
7th judging unit 418, for determining whether that new data file needs to store to the object storage system In, the new data file has incidence relation with least two data file;
Adding device 419, for determining there is new data file to need to store to described right when the 7th judging unit During as in storage system, the mark of the new data file is added in the metadata fields for storing the related information, And the mark of source object and the title of metadata fields of the related information will be stored added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
The technical scheme that the present embodiment is provided, will need at least two data files being stored in object by acquiring unit When in storage system, at least two data file is created as by object storage system by the first judging unit and creating unit Object in system, wherein, the metadata in object is stored with the incidence relation.Due to the incidence relation between object being stored in In metadata, so,, just can be quick without relying on any third party system or instrument when user needs to retrieve, searches object Any object of correlation is retrieved, the recall precision of object storage system is improved with this.In addition, based on the first receiving unit, Second judging unit, the first reading unit and returning unit can also be realized quickly to be enumerated to related information, is judged by the 3rd Unit, the second reading unit, the second receiving unit, the 4th judging unit, the 5th judging unit etc. can also be realized quickly to association Enumerating, delete and adding for relation, user is improved to object storage system access efficiency with this.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms be used merely to by One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation Between there is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant meaning Covering including for nonexcludability, so that process, method, article or equipment including a series of key elements not only include that A little key elements, but also other key elements including being not expressly set out, or also include be this process, method, article or The intrinsic key element of equipment.The embodiment of each in this specification is described by the way of progressive, what each embodiment was stressed All be between the difference with other embodiment, each embodiment identical similar portion mutually referring to.
The foregoing description of the disclosed embodiments, enables professional and technical personnel in the field to realize or use the application. A variety of modifications to these embodiments will be apparent for those skilled in the art, as defined herein General Principle can in other embodiments be realized in the case where not departing from spirit herein or scope.Therefore, the application The embodiments shown herein is not intended to be limited to, and is to fit to and principles disclosed herein and features of novelty phase one The most wide scope caused.

Claims (14)

1. a kind of object storage method, it is characterised in that including:
At least two data files are obtained, at least two data file has incidence relation;
Judge whether to need at least two data file being stored in object storage system;
If so, at least two data file to be created as to the object in object storage system, each object includes pair Be stored with the incidence relation in image data and metadata, the metadata.
2. according to the method described in claim 1, it is characterised in that the incidence relation includes related information and associates reference letter Breath, the related information includes the mark of each data file at least two data file, in addition to source data file, The association reference information includes the mark for storing the source data file of the related information, the source data file for it is described extremely Any data file in few two data files;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, described Related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object described The association reference information that is stored with related information, the metadata of each related object and the storage related information Metadata fields title.
3. method according to claim 2, it is characterised in that also include:
Related information read requests are received, the related information read requests carry the first object identity;
Judge whether there is the field of entitled first field, described first in metadata corresponding with first object identity Field is used to store the related information;
When it is determined that during field with entitled first field, reading the content of first field, being believed with obtaining the association Breath;
The related information is returned to user;
When it is determined that during field without entitled first field, judging to be in metadata corresponding with first object identity The no field with entitled second field;
When it is determined that during field with entitled second field, read the content of second field, to obtain source object mark, And return to the step of performing the content for reading first field;
Second field, which is used to store, has first word in the association reference information, the metadata of the source object Section.
4. method according to claim 3, it is characterised in that also include:
Incidence relation removal request is received, the incidence relation removal request carries the second object identity;
Judge whether there is the field of entitled first field in metadata corresponding with second object identity;
When it is determined that during field with entitled first field, judging the related object that there is the incidence relation with the second object In, storage the association reference information whether be all deleted;
When it is determined that the association reference information is all deleted, the related information stored in second object is deleted;
When it is determined that during field without entitled first field, deleting and being deposited in metadata corresponding with second object identity The association reference information of storage.
5. method according to claim 3, it is characterised in that also include:
Object removal request is received, the object removal request carries the 3rd object identity;
Judge whether there is the word of entitled first field or the second field in metadata corresponding with the 3rd object identity Section;
If it is not, deleting the 3rd object corresponding with the 3rd object identity.
6. method according to claim 2, it is characterised in that also include:
Determine whether that new data file needs to store into the object storage system, the new data file with it is described At least two data files have incidence relation;
If so, the mark of the new data file is added in the metadata fields for storing the related information, and it will deposit Store up the mark of the source object of the related information and the title of metadata fields is added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
7. according to the method described in claim 1, it is characterised in that the incidence relation includes related information, and each object Metadata in the related information that stores is, data file corresponding with the object has all data files of incidence relation Mark, the data file is corresponded with the object.
8. a kind of object storage device, it is characterised in that including:
Acquiring unit, for obtaining at least two data files, at least two data file has incidence relation;
First judging unit, for judging whether to need at least two data file being stored in object storage system;
Creating unit, for determining that at least two data file is stored in object and deposited by needs when first judging unit When in storage system, at least two data file is created as to the object in object storage system, each object includes Be stored with the incidence relation in object data and metadata, the metadata.
9. device according to claim 8, it is characterised in that the incidence relation includes related information and associates reference letter Breath, the related information includes the mark of each data file at least two data file, in addition to source data file, The association reference information includes the mark for storing the source data file of the related information, the source data file for it is described extremely Any data file in few two data files;
Correspondingly, the object includes source object and related object, and the source object is corresponding with the source data file, described Related object is corresponded with the data file in addition to the source data file, is stored with the metadata of the source object described The association reference information that is stored with related information, the metadata of each related object and the storage related information Metadata fields title.
10. device according to claim 9, it is characterised in that also include:
First receiving unit, for receiving related information read requests, the related information read requests carry the first object mark Know;
Second judging unit, for judging whether there is entitled first word in metadata corresponding with first object identity The field of section, first field is used to store the related information;
First reading unit, for determining during the field with entitled first field, to read institute when second judging unit The content of the first field is stated, to obtain the related information;
Returning unit, for returning to the related information to user;
3rd judging unit, for determining during the field without entitled first field, to judge when second judging unit Whether there is the field of entitled second field in metadata corresponding with first object identity;
Second reading unit, for determining during the field with entitled second field, to read institute when the 3rd judging unit The content of the second field is stated, to obtain source object mark, and return the step of performing the content for reading first field;
Second field, which is used to store, has first word in the association reference information, the metadata of the source object Section.
11. device according to claim 10, it is characterised in that also include:
Second receiving unit, for receiving incidence relation removal request, the incidence relation removal request carries the second object mark Know;
4th judging unit, for whether judging in corresponding with second object identity metadata with entitled described the The field of one field;
5th judging unit, for when the 4th judging unit determine with entitled first field field when, judge with Whether the association reference information that the second object has in the related object of the incidence relation, store all has been deleted;
First deletes unit, for when the 5th judging unit determines that the association reference information is all deleted, deleting The related information stored in second object;
Second deletes unit, for determining during the field without entitled first field, to delete and institute when the 4th judging unit State the association reference information stored in the corresponding metadata of the second object identity.
12. device according to claim 10, it is characterised in that also include:
3rd receiving unit, for receiving object removal request, the object removal request carries the 3rd object identity;
6th judging unit, for judging whether there is entitled first word in metadata corresponding with the 3rd object identity The field of section or the second field;
3rd deletes unit, for determining do not have entitled first field or described second when the 6th judging unit During the field of field, the 3rd object corresponding with the 3rd object identity is deleted.
13. device according to claim 9, it is characterised in that also include:
7th judging unit, it is described for determining whether that new data file needs to store into the object storage system New data file has incidence relation with least two data file;
Adding device, for determining there is new data file to need to store to object storage system when the 7th judging unit When in system, the mark of the new data file is added in the metadata fields for storing the related information, and will storage The mark of the source object of the related information and the title of metadata fields are added in the metadata of new object;
Wherein, the new object is corresponding with the new data file.
14. device according to claim 8, it is characterised in that the incidence relation includes related information, and each object Metadata in the related information that stores is, data file corresponding with the object has all data files of incidence relation Mark, the data file is corresponded with the object.
CN201710392920.6A 2017-05-27 2017-05-27 A kind of object storage method and device Pending CN107229713A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710392920.6A CN107229713A (en) 2017-05-27 2017-05-27 A kind of object storage method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710392920.6A CN107229713A (en) 2017-05-27 2017-05-27 A kind of object storage method and device

Publications (1)

Publication Number Publication Date
CN107229713A true CN107229713A (en) 2017-10-03

Family

ID=59933430

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710392920.6A Pending CN107229713A (en) 2017-05-27 2017-05-27 A kind of object storage method and device

Country Status (1)

Country Link
CN (1) CN107229713A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110598053A (en) * 2019-08-16 2019-12-20 上海爱数信息技术股份有限公司 Metadata management method and management system based on object tree
CN116150093A (en) * 2023-03-04 2023-05-23 北京大道云行科技有限公司 Method for realizing object storage enumeration of objects and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902656A (en) * 2005-04-21 2014-07-02 雅虎公司 Media object metadata association and ranking
CN104981802A (en) * 2013-02-27 2015-10-14 日立数据系统有限公司 Content class for object storage indexing system
CN106202367A (en) * 2016-07-07 2016-12-07 腾讯科技(深圳)有限公司 A kind of processing method and processing device of object information
EP3159796A1 (en) * 2015-09-21 2017-04-26 Zerto Ltd. System and method for generating backups of a protected system from a recovery system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902656A (en) * 2005-04-21 2014-07-02 雅虎公司 Media object metadata association and ranking
CN104981802A (en) * 2013-02-27 2015-10-14 日立数据系统有限公司 Content class for object storage indexing system
EP3159796A1 (en) * 2015-09-21 2017-04-26 Zerto Ltd. System and method for generating backups of a protected system from a recovery system
CN106202367A (en) * 2016-07-07 2016-12-07 腾讯科技(深圳)有限公司 A kind of processing method and processing device of object information

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110598053A (en) * 2019-08-16 2019-12-20 上海爱数信息技术股份有限公司 Metadata management method and management system based on object tree
CN116150093A (en) * 2023-03-04 2023-05-23 北京大道云行科技有限公司 Method for realizing object storage enumeration of objects and electronic equipment
CN116150093B (en) * 2023-03-04 2023-11-03 北京大道云行科技有限公司 Method for realizing object storage enumeration of objects and electronic equipment

Similar Documents

Publication Publication Date Title
US9298702B1 (en) Systems and methods for pairing of a semantic network and a natural language processing information extraction system
US7765236B2 (en) Extracting data content items using template matching
US6985950B1 (en) System for creating a space-efficient document categorizer for training and testing of automatic categorization engines
US7225407B2 (en) Resource browser sessions search
US7962514B2 (en) Attaching and displaying annotations to changing data views
US20040015514A1 (en) Method and system for managing data objects
US8626792B2 (en) Hierarchical structured abstract data organization system
CA2790421C (en) Indexing and searching employing virtual documents
KR20080071213A (en) System and method for research information service based on semantic web
CN104317897A (en) Visual label topic map-based pilot method of digital library
Terveen et al. Finding and visualizing inter-site clan graphs
CN1841377A (en) Crawling databases for information
CN107229713A (en) A kind of object storage method and device
CN112765601B (en) Website homepage structure monitoring method based on cloud
Charles et al. Achieving interoperability between the CARARE schema for monuments and sites and the Europeana Data Model
US20040122809A1 (en) Information augmentation method
US20120109965A1 (en) System for automatic semantic-based mining
Perry et al. Discovering similar resources by content part-linking
Foo et al. A hypermedia database to manage World-Wide-Web documents
Matsumura et al. Discovering emerging topics from WWW
Moftah et al. Methods to access structured and semi-structured data in bioinformatics databases: A perspective
Shen Data discovery, reuse, and integration: the perspectives of natural resources and environmental scientists
Wu The semantic retrieval system for learning resources based on subject knowledge ontology
Berwick et al. Research Priorities for the World Wide Web
Divya et al. Ontology based search result optimisation using singular matrix

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20220111

AD01 Patent right deemed abandoned