CN106933555A - A kind of data framework system - Google Patents

A kind of data framework system Download PDF

Info

Publication number
CN106933555A
CN106933555A CN201511024468.5A CN201511024468A CN106933555A CN 106933555 A CN106933555 A CN 106933555A CN 201511024468 A CN201511024468 A CN 201511024468A CN 106933555 A CN106933555 A CN 106933555A
Authority
CN
China
Prior art keywords
data
file
access
framework system
storage layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201511024468.5A
Other languages
Chinese (zh)
Other versions
CN106933555B (en
Inventor
王枫
戴希铨
王瑜
张志亮
徐威鸿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Advanced Research Institute of CAS
Original Assignee
Shanghai Advanced Research Institute of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Advanced Research Institute of CAS filed Critical Shanghai Advanced Research Institute of CAS
Priority to CN201511024468.5A priority Critical patent/CN106933555B/en
Publication of CN106933555A publication Critical patent/CN106933555A/en
Application granted granted Critical
Publication of CN106933555B publication Critical patent/CN106933555B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/20Software design
    • G06F8/22Procedural
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/71Version control; Configuration management

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention provides a kind of data framework system, including:Data storage layer, for providing data basic access interface, the organizational form of the storage of data and setting data on disk;Data access layer, loose coupling realizes the organizational form of data access, setting data in internal memory in the data storage layer, the interface for combining the data storage layer.Realize the Javascript API totally 54 for supporting the functions such as data retrieval, data access, data storage, data syn-chronization/shared and data recovery, the runtime environment of data framework is realized by Node-Webkit simultaneously, the mixing application and development based on Web technologies is supported, the obvious reduction of application and development difficulty and workload is thus brought.Only need to provide the user data management function under many equipment by doing data processing using front-end technology such as HTML, CSS, development difficulty is small compared with traditional file manager application, and can simultaneously operate on the platforms such as Linux, Android, save more than 50% code development workload.

Description

A kind of data framework system
Technical field
The present invention relates to field of data storage, more particularly to a kind of data framework system.
Background technology
1.Git
Git is a free, the distributed version control system increased income, and any small or big project is efficiently processed for agility, Can effectively, the treatment of high speed manages from very little to very big Item version.Git is Linus Torvalds to help manage The Version Control software of the open source code that reason linux kernel is developed and developed.Torvalds take up exploitation Git be for BitKeeper is substituted as a kind of transition scheme, is always what linux kernel developer used in the whole world before the latter Main source code instrument.Some people in open source code community think that the licensing of BitKeeper is not appropriate for open source code community Work, therefore Torvalds determine set about study the more flexible version control system of licensing.Although initial Git's opens Hair is the process in order to aid in linux kernel to develop, we have found that also being used in a lot of other free software projects Git.
Git is distributed version control system, and it does not have the concept of central server (although can be built in one in actual development Central server), complete historical record is all preserved in each development machines, but it has local code warehouse and remote code storehouse The concept in storehouse, and multiple remote warehouses can be followed the trail of.
Git can very fast set up branch and merge branch, and the ability with powerful tracking branch and hand-over branch.It is each Individual project should all have a working directory (Working directory), can be oneself to build a catalogue, then this catalogue The code of the inside Git manages (using git init orders and git add orders), it is also possible to by git clone orders from other Place clone one project come to automatically generate a working directory.File in working directory is exactly when pre-editing and modification File, if the catalogue that newly-established catalogue or new clone come, the file in working directory is exactly the newest shape of the project State.Git be locally preserve all of historical record and branch record, these contents all in the .git catalogues of working directory, Referred to as ware-house here (local repository).During old version when hand-over branch or before checking, the text in working directory Part changes (this is only emphasis, and work need not switch catalogue, and the file in catalogue can automatically switch) automatically.Text in working directory Part has three kinds of states:It has been changed that, kept in (stage), had been filed on.Amended file can first add staging area, once Submitted to together after end-of-job.
Still code storage can be put on everybody server that can access in real work, do it is actual in it is genuinely convinced Business device is used.After having worked on the local machine, warehouse is pushed on server using git push orders, changes a place After changing a machine, it is only necessary to which git clone can once, again obtain all of code (comprising all of historical record and branch) Work on.Server failure is also out of question, because preserving complete code storage on the machine of each work, From without worrying that code is lost.Also it doesn't matter not to have network, can submit (git commit) in the same old way on the local machine, because It is whole warehouse just on the machine of oneself, when there is network, push once just can be with.
Git has the concept of remote warehouse (remote repository), and can manage many remote warehouses, and remote warehouse can To be server, or others' personal computer (but typically no people so uses), each remote warehouse has one Brief name and an address, that remote warehouse alias for most starting clone codes are often defaulted as origin, oneself addition Remote warehouse can arbitrarily specify alias, certain all of remote warehouse can arbitrarily change alias.Can be from remote warehouse Obtain code (git fetch orders or git pull orders), it is also possible to which the code of oneself is pushed to remote warehouse, and (git push are ordered Order is, it is necessary to write permission).
Git is also one in addition to the version control management for code development, in itself based on content addressed distributed field system System, but there are a large amount of extra storage overheads as file system in itself in Git.
2.FUSE(Filesystem in Userspace)
User's space file system (Filesystem in Userspace, abbreviation FUSE) refers to the file realized in User space completely System, current Linux is supported by kernel module to this, and some file system such as ZFS, glusterfs and luster use FUSE Realize.
FUSE is a file system framework for user's space, and by FUSE, programmer can realize file system in User space, And do not need the support of superuser.Including three modules:Kernel module, user's space storehouse and mount instruments.
As shown in figure 1, Fig. 1 is shown as the system framework schematic diagram of FUSE in the prior art.Kernel module realize one it is complete The framework of whole file system, but concrete operations are not carried out (by programmer in user's space realization), and user's space storehouse is to programmer DLL is provided, programmer by realize fuse_operations that FUSE is provided or fuse_ll_operations all or File system is realized in part operation.
User data in current operation system is by file system organization and manages, with extensive, data-driven application Explosive increase, and more and more Intelligent mobile equipments appearance, traditional file systemses management data mode in some aspects Demand can not be met.First, traditional file systemses manage data in the way of file, and the management to data self-information is only wrapped A small amount of information such as size, establishment/access time is included, cannot be from file system when being managed in application development, organizing data The more valuable information of data are obtained, causes the data retrieval of complexity, access to be greatly limited.To one kind of this problem Processing mode is that more more valuable information in data are given application program to manage, but causes data to be employed journey again simultaneously Sequence package isolation, operating system and other application program can not obtain data and its information.On the other hand, traditional file systemses are not Can treatment storage synchronization on different devices between user data with it is shared, the physical isolation problem of data needs also exist for applying journey Sequence treatment.Finally, other module coupling degrees are high with operating system for current major part file system, depend on certain hardware device class Type, and the interface for externally providing also is not quite similar, largely increased file system and cross-platform operation and applies journey in itself The difficulty of the Cross-border congestion management of sequence.Accordingly, it would be desirable to a kind of new data organization and management framework meets application developer Existing demand.
The content of the invention
The shortcoming of prior art, existing for solving it is an object of the invention to provide a kind of data framework system in view of the above Traditional file systemses manage data in the way of file in having technology, and the management to data self-information only includes size, establishment/visit Ask a small amount of information such as time, being managed in application development, tissue data when cannot obtain that data are more to be had from file system The information of value, causes the data retrieval of complexity, access to be greatly limited;More more valuable information in data are handed over Managed to application program, but cause data to be employed program package isolation again simultaneously, operating system and other application program can not Obtain data and its information.Traditional file systemses can not process storage synchronization on different devices between user data with it is shared, The physical isolation problem of data needs also exist for application program treatment;Other module coupling degrees of most of file system and operating system are high, Certain hardware device type is depended on, and the interface for externally providing also is not quite similar, and largely increased file system sheet The problem of the difficulty of the Cross-border congestion management of the cross-platform operation of body and application program.
In order to achieve the above objects and other related objects, the present invention provides a kind of data framework system, including:Data storage layer, For providing data basic access interface, the organizational form of the storage of data and setting data on disk;Data access layer, pine The data storage layer is coupled in, the interface for combining the data storage layer realizes data access, setting data in internal memory Organizational form.
In one embodiment of the invention, the data storage layer includes user's space file system, for controlling to minimize data The time of Version Control in operation, and ensure the uniformity of data in system components.
In one embodiment of the invention, the user's space file system includes:
Version control module, the version control function for realizing the data framework system;
File attribute expansion module, for basic document attribute extension to be formed the file attribute after extension.
In one embodiment of the invention, the file attribute after the extension includes music, document, contact person, video and picture.
In one embodiment of the invention, the user's space file system also includes:
Index module, for being indexed to file according to type and version after send to the file attribute expansion module.
In one embodiment of the invention, the data access layer includes system service module, for being carried in the form of system service For data access service.
In one embodiment of the invention, the system service module includes:Service acquisition module, provides for superior equipment Or obtain service;API module for reading and writing, data are directly accessed for the data framework system.
In one embodiment of the invention, the service acquisition module includes data sharing unit, data recovery unit, data inspection Cable elements and data synchronisation unit.
In one embodiment of the invention, the API module for reading and writing includes:JavaScript API, for support based on JavaScript, The web front end technological development application program of HTML, CSS, and the data access API of data framework system offer is provided;Text Part system API, for directly reading and writing data by the data storage layer.
In one embodiment of the invention, the data access layer also includes RDF data storehouse, for data storage richness information.
As described above, a kind of data framework system of the invention, has the advantages that:
Realize for supporting the functions such as data retrieval, data access, data storage, data syn-chronization/shared and data recovery Javascript API totally 54, while the runtime environment of data framework is realized by Node-Webkit, support to be based on Web skills The mixing application and development of art, thus brings the obvious reduction of application and development difficulty and workload.Only need to use HTML, CSS The user data management function under many equipment is provided by doing data processing etc. front-end technology, with traditional file manager application It is small compared to development difficulty, and can operate in simultaneously on the platforms such as Linux, Android, the code for saving more than 50% is opened Hair workload.
Brief description of the drawings
Fig. 1 is shown as the system framework schematic diagram of FUSE in the prior art.
Fig. 2 is shown as the systematic square frame schematic diagram of an embodiment of data framework system of the present invention.
Fig. 3 is shown as file attribute extension schematic diagram in data framework system of the present invention.
Specific embodiment
Embodiments of the present invention are illustrated below by way of specific instantiation, those skilled in the art can be as disclosed by this specification Content understand other advantages of the invention and effect easily.The present invention can also add by way of a different and different embodiment To implement or apply, the various details in this specification can also be based on different viewpoints and application, without departing from essence of the invention Various modifications or alterations are carried out under god.It should be noted that, in the case where not conflicting, the feature in following examples and embodiment Can be mutually combined.
It should be noted that the diagram provided in following examples only illustrates basic conception of the invention in a schematic way, scheme then Component count, shape and size when only display is with relevant component in the present invention rather than according to actual implementation in formula are drawn, in fact The kenel of each component, quantity and ratio can be a kind of random change when border is implemented, and its assembly layout kenel be likely to it is more multiple It is miscellaneous.
Referring to Fig. 2 to Fig. 3.As shown in Fig. 2 Fig. 2 is shown as the systematic square frame of an embodiment of data framework system of the present invention Schematic diagram.The present invention provides a kind of data framework system, including:Data storage layer, for provide data basic access interface, The organizational form of the storage of data and setting data on disk;Data access layer, loose coupling is used in the data storage layer The organizational form of data access, setting data in internal memory is realized with reference to the interface of the data storage layer.
Further, the data storage layer includes user's space file system, in the present embodiment, the user's space file system System is developed in linux system based on Ext4 systems.Time for controlling Version Control in minimum data manipulation, and Ensure the uniformity of data in system components.As shown in figure 3, Fig. 3 is shown as file attribute in data framework system of the present invention Extension schematic diagram.The user's space file system includes:Version control module, the version for realizing the data framework system This control function;File attribute expansion module, for basic document attribute extension to be formed the file attribute after extension.In this hair In a bright preferred embodiment, the file attribute after the extension includes music, document, contact person, video and picture.In order to Facilitating data access layer called data accumulation layer information, the user's space file system also includes:Index module, for basis Type and version send to the file attribute expansion module after being indexed to file.
Further, the data access layer includes system service module, for providing data access clothes in the form of system service Business.The system service module includes:Service acquisition module, provides or obtains service for superior equipment;API reads and writes mould Block, data are directly accessed for the data framework system.In a preferred embodiment, the service acquisition module bag Include data sharing unit, data recovery unit, data retrieval unit and data synchronisation unit.The API module for reading and writing includes: JavaScript API, for supporting the web front end technological development application program based on JavaScript, HTML, CSS, and adjust The data access API provided with data framework system;File system api, for directly reading and writing number by the data storage layer According to.The data access layer also includes RDF data storehouse, for data storage richness information.
It is divided into two-layer in data framework design overall, from down to up respectively data storage layer and data access layer.Pine between two-layer Coupling, lower floor provides data basic access interface, and efficient, abundant data access function is realized in upper strata using layer interface is stored. Data storage layer is responsible for the storage of data, determines organizational form of the data on disk, it is necessary to the problem for solving includes metadata Storage, data load storage, offer Edition Control Strategy, old version storage, data directory storage etc..Data access layer is born Blame the access of data, determine organizational form of the data in internal memory, it is necessary to the problem for solving include data retrieval, data access, Data syn-chronization, data sharing, data recovery etc., and provide universal data access API to application layer.
Data storage and access is all very high to space, time performance requirement, and data framework aims to provide more abundant, complicated work( Energy.In design data storage layer is placed on to the maximum basic function of performance impact, the space time performance of storage is primarily upon, Storage operation is realized using operating system Floor layer Technology;Complicated function is placed on data access layer, is mainly visited from developer's data Ask that demand angle does data complex process, flexible and efficient exploitation is done in the part using front-end technology.Data storage and data access Two-layer can respective independent operating, data storage layer can be directly compatible with the file operation of existing application, and data access layer can be transported Row is on other file system.Data storage layer is based on Ext4 system development user's space file system in linux system, On the one hand the time overhead that Version Control is brought in minimum data manipulation, is easier to ensure that number in system components on the other hand According to uniformity.The function of extension mainly includes adding version control function, adds in the operate interface of user control file system Enter the Version Control bottom function based on git, but the not function such as including data syn-chronization, and for music, video and other two enter The solution of the systems such as big file references Git-annex is made to carry out Version Control;Also include extended file attributes informational function, Data are accessed based on metadata query, the extended attribute provided using Ext4 file system is supported.Further, data access layer Based on Node-webkit runtime environments, data access service is provided in the form of system service.Other application process has two kinds Mode accesses data, and one is to obtain data retrieval, data syn-chronization, data sharing, data recovery by inter-process communication mechanisms Service, another way is that the file system api for directly being provided by data storage layer reads and writes data (compatible non-HTML5 applications). The function of support includes search function, and data retrieval can support that various complicated, hazy conditions are inquired about.According to data retrieval demand, Using RDF canonical representation data;Additionally include multi-equipment environment data access, including data syn-chronization, data sharing and data Recover function, the version control function that these functions are provided using the user control file system of data storage layer is real according to demand The data access mode of existing Different Strategies.Further, data framework system provides unified JavaScriptAPI to upper strata, uses To support based on web front end technological development application programs such as JavaScript, HTML, CSS, and call data framework system The data access API of offer.Carry out doing application and development based on the data framework system, it is possible to use system-level multi-equipment environment The function such as lower data syn-chronization, shared, data recovery, and do data retrieval, developer using the data specifying-information of various dimensions Only need to consider mathematical logic treatment and regardless of data access problem.
Wherein, data storage layer concrete methods of realizing is as follows:
Data framework realizes four functions in many equipment aspects:Data retrieval, data syn-chronization, data sharing, data recovery.This A little processes are needed to solve the problems, such as the data collision under many equipment automatically, and the problem is processed by Version Control.Data storage layer base In FUSE and Libgit2 storehouses development of user space file system.
Version Control basic function is realized, according to FUSE framework general principles, custom file system accesses operate interface and adds Git Bottom operation.Increase Object files and Ref files in file system, realize the foundation in subscriber data file git warehouses.
The automatic commit operations of the operations such as file access, read-write, metadata modification are realized in the file system interface of FUSE, Realize preservation, modification and the union operation of branch.
For data syn-chronization, data sharing and data recovery function, accumulation layer basic function interface is called by data access layer real It is existing.
Space performance of the optimization based on Git file system, the old version deleting mechanism of flexible design, metadata storage in ext4 In file structure, stored rather than in unique file mode
Time performance of the optimization based on Git file system, for Git with the memory mechanism that content is index, seeks efficient number According to indexing means, upper strata inquiry data speed is improved.
The storage mode of Git back plan files is changed, is directly changed using RDF data storehouse Levelgragh in data storage layer Git rear ends store, and so can all have significantly performance boost with omitted data library component, space or time on upper strata.
Data storage layer provides multiple API as a user control file system to upper strata.Its API includes two parts, A part is the standard interface that FUSE is provided, and standard interface being capable of compatible other file system interfaces.By changing standard interface Realization, the function such as Version Control is completed, so for existing application program, it is not necessary to change the i.e. compatible number of code According to accumulation layer file system.Part II is the distinctive interface of data storage layer file system, there is provided the function outside standard interface, Such as synchronous, it is peculiar that application program or system program based on the exploitation of data storage layer file system can directly invoke this document system API functions.
Data access layer concrete methods of realizing is as follows:
In data access layer, the present invention is included using RDF data storehouse Levelgragh data storages, the main data types being related to Music, document, contact person, video, picture.Current these data types can substantially meet demand used in everyday, but If designed only around this few major class data design will be caused not possess sustainable developability.At the same time, it is desirable to data type energy With more scalability.Therefore, it is fixed in processing data type, it is contemplated that some general character of all resources are extracted One type on basis of justice and the attribute on basis.On this basis, any specific data type can regard type of foundation as Extension.It is base attributes by the attribute definition common to these data types, the attribute of every kind of data type is all based on base The extension of attribute.Its relation is as shown in Figure 2.So design makes data represent with more readability, also allows for managing and safeguards, The addition and deletion of data type can be more prone to.After the definition of data type is separated with data manipulation, this point was being developed It is reflected more clearly in journey.So design can also flexibly realize Extended-type.Increase new data type if desired, Only vocabulary need to be described the data that type inherits RDF, then the distinctive descriptor of respective extension type.Specific extension class The visible following form of type.
The attribute of foundation class is as shown in table 1:
The basic generic attribute of table 1
Attribute Type Description
URI string The unique mark of data
createTime date The creation time of data
lastModifyTime date The data Last modification time
lastAccessTime date Data last time access time
createDev string Create the device number of data
lastModifyDev string The device number of Last modification data
lastAccessDev string Last time accesses the device number of data
filename string Filename
postfix string File suffixes name
category string Data type name
size integer Size of data
path string Data path
tags string Data label
The attribute as shown in table 2 of music type
The music type extended attribute of table 2
Attribute Type Description
bit_rate string The bit rate of audio file
frequency Integer The frequency of audio file
track string The track name of audio file
TDRC string Data last time access time
APIC string The front cover data of music file
TALB string Album name
TPE1 string The singer of music
TXXX string The author of music
TIT2 string The title of music
COMM string The label title of music
The attribute as shown in table 3 of Doctype
The Doctype extended attribute of table 3
Attribute Type Description
project string The affiliated project name of document
The attribute as shown in table 4 of video type
The video type extended attribute of table 4
Attribute Type Description
format_long_name string Video file format name
width Integer Video pictures width
height Integer Video pictures are highly
display_aspect_ratio string Video pictures ratio
pix_fmt string Pixel size
duration string Video length
major_brand string Decoder title
minor_version string Decoder version
compatible_brands string Decoder label
The attribute as shown in table 5 of picture/mb-type
The picture/mb-type extended attribute of table 5
Attribute Type Description
location string Video file format name
The attribute as shown in table 6 of Doctype
The contact type extended attribute of table 6
Attribute Type Description
lastname string Video file format name
firstname Integer Video pictures width
email Integer Video pictures are highly
pnone string Video pictures ratio
Data access layer is based on RDF for developer provides data access function, and the exploitation of data access layer is based on data storage layer The API for being provided carries out bottom data and calls.The Web language API that developer directly invokes data access layer offer is applied Exploitation, and the realization of data storage layer need not be concerned about.Data storage layer is designed realization based on Libgit2 storehouses, its data Information is stored in the form of blob, therefore when data access layer calls newly-built or modification is related API, it is necessary to adjust Data storage layer interface is used, corresponding data is write to file system, i.e., stored in corresponding Blob with it to bottom and write data. The read-write of data storage layer data is all carried out by object of Blob.Data storage layer provides the API of generation URI, to data Access layer is called.In newdata, data storage layer generates the URI of unique identification data, then data access layer passes through URI Carry out data access.File system in the present invention only obtains data without path concepts by the URI of unique mark.Pass through After data access layer changes metadata or data, the corresponding data of data storage layer are also required to be changed, and should be according to data Latest edition update data storage.
In sum, it is divided into data storage layer and data access layer by the management of data, and respectively in solution data storage layer Data store organisation, data storage method, old version storage, data information memory the problems such as, and in data access layer Data message representation, the interface problem between data access and two-layer, data framework system are provided for application developer Under multi-equipment environment, complete user data tissue rwan management solution RWAN.
In the present invention, data storage layer is responsible for the storage control of data, completes data syn-chronization, recovers and sharing functionality, including The realization of versions of data control, and the user's space file system for introducing version control function exploitation;Data access layer, is responsible for Access to data is controlled, and the rich information to data is stored, and the interface of data storage layer is called downwards to the number of storage The operation such as change according to additions and deletions are carried out, upwards for developer provides development interface, developer is fast developed data application.
The data storage layer is combined Libgit2 with user's space file system FUSE, constructs new file system.This article Part system provides existing file system general API, compatible existing file operation;The spy for adding versions of data control function is also provided There is API, complete versions of data and control peculiar function
The data access layer uses the rich information of RDF graph data database storing so that the relation between information can be stored completely And without structure limitation, and can be any many data specifying-informations of each data storage;User can also be by certain data Any description information retrieval data.
Data framework system has web access characteristic, and user can be by any one computer that can be interconnected with data, services By browser access data application.And the data store organisation in Libgit2 is changed, original system can preserve two number evidences:Work Area's data and Git object block data storages, this wastes memory space significantly.In the data storage layer of notebook data framework, only The data in Git object blocks are preserved, without data are carried out with additional copy, nearly 50% memory space is saved.Modification Libgit2 In data retrieval mechanism, original system carries out data retrieval and access by the path of data;And in notebook data framework, data No longer stored in the way of path, the retrieval of data is carried out only by unique identifier URI, therefore changed Libgit2 In data retrieval logic, make to carry out the access of data by URI.The present invention is based on richness of the RDF data storehouse to data Information is designed, and builds foundation class table base, stores the general attribute of each data type, and each based on the extension of foundation class table The particular attribute of individual data type.So that data type has stronger scalability, database also has stronger scalability. Developer only needs to use the web front end development languages such as JavaScript, Html5 and CSS, just can easily develop complexity Data application, complete complicated functional requirement.
In sum, a kind of data framework system of the invention, realizes for supporting data retrieval, data access, data to deposit The Javascript API totally 54 of the functions such as storage, data syn-chronization/shared and data recovery, while ring during the operation of data framework Realize that thus mixing application and development of the support based on Web technologies bring application and development difficulty and work by Node-Webkit in border The obvious reduction that work is measured.Only need to provide the user under many equipment by doing data processing using front-end technology such as HTML, CSS Data management function, development difficulty is small compared with traditional file manager application, and can operate in simultaneously Linux, On the platforms such as Android, more than 50% code development workload is saved.So, the present invention effectively overcomes prior art In various shortcoming and have high industrial utilization.
The above-described embodiments merely illustrate the principles and effects of the present invention, not for the limitation present invention.It is any to be familiar with this skill The personage of art all can carry out modifications and changes under without prejudice to spirit and scope of the invention to above-described embodiment.Therefore, such as Those of ordinary skill in the art completed under without departing from disclosed spirit and technological thought all etc. Effect modifications and changes, should be covered by claim of the invention.

Claims (10)

1. a kind of data framework system, it is characterised in that including:
Data storage layer, for providing data basic access interface, the organizational form of the storage of data and setting data on disk;
Data access layer, loose coupling in the data storage layer, the interface for combining the data storage layer realize data access, Organizational form of the setting data in internal memory.
2. data framework system according to claim 1, it is characterised in that the data storage layer includes user's space text Part system, for controlling the time of Version Control in minimum data manipulation, and ensures the uniformity of data in system components.
3. data framework system according to claim 2, it is characterised in that the user's space file system includes:
Version control module, the version control function for realizing the data framework system;
File attribute expansion module, for basic document attribute extension to be formed the file attribute after extension.
4. data framework system according to claim 3, it is characterised in that the file attribute after the extension include music, Document, contact person, video and picture.
5. data framework system according to claim 3, it is characterised in that the user's space file system also includes:
Index module, for being indexed to file according to type and version after send to the file attribute expansion module.
6. data framework system according to claim 1, it is characterised in that the data access layer includes system service mould Block, for providing data access service in the form of system service.
7. data framework system according to claim 6, it is characterised in that the system service module includes:
Service acquisition module, provides or obtains service for superior equipment;
API module for reading and writing, data are directly accessed for the data framework system.
8. data framework system according to claim 7, it is characterised in that the service acquisition module includes data sharing Unit, data recovery unit, data retrieval unit and data synchronisation unit.
9. data framework system according to claim 7, it is characterised in that the API module for reading and writing includes:
JavaScript API, for supporting the web front end technological development application program based on JavaScript, HTML, CSS, And the data access API of data framework system offer is provided;
File system api, for directly reading and writing data by the data storage layer.
10. data framework system according to claim 6, it is characterised in that the data access layer also includes RDF numbers According to storehouse, for data storage richness information.
CN201511024468.5A 2015-12-30 2015-12-30 Data framework system Active CN106933555B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201511024468.5A CN106933555B (en) 2015-12-30 2015-12-30 Data framework system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511024468.5A CN106933555B (en) 2015-12-30 2015-12-30 Data framework system

Publications (2)

Publication Number Publication Date
CN106933555A true CN106933555A (en) 2017-07-07
CN106933555B CN106933555B (en) 2020-06-16

Family

ID=59442615

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511024468.5A Active CN106933555B (en) 2015-12-30 2015-12-30 Data framework system

Country Status (1)

Country Link
CN (1) CN106933555B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108509788A (en) * 2018-03-29 2018-09-07 广东欧珀移动通信有限公司 Information sharing method and device, computer readable storage medium, terminal
CN110018857A (en) * 2018-01-05 2019-07-16 武汉斗鱼网络科技有限公司 Application component Hua Zhong branch automatic management method, storage medium, device and method
CN111158796A (en) * 2019-12-25 2020-05-15 中国航空工业集团公司西安飞机设计研究所 Data processing method of hydraulic control software
US11900152B1 (en) * 2021-03-30 2024-02-13 Amazon Technologies, Inc. Controlled automatic updates to disk image layers with compatibility verification

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101526906A (en) * 2008-03-07 2009-09-09 上海汇和信息技术有限公司 Management system for running maintenance services
CN104219534A (en) * 2014-08-27 2014-12-17 烽火通信科技股份有限公司 System and method for implementing cloud storage agency by using Linux set top box
CN104391697A (en) * 2014-11-11 2015-03-04 百度在线网络技术(北京)有限公司 System and method for managing cloud resources of application program
CN104573068A (en) * 2015-01-23 2015-04-29 四川中科腾信科技有限公司 Information processing method based on megadata

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101526906A (en) * 2008-03-07 2009-09-09 上海汇和信息技术有限公司 Management system for running maintenance services
CN104219534A (en) * 2014-08-27 2014-12-17 烽火通信科技股份有限公司 System and method for implementing cloud storage agency by using Linux set top box
CN104391697A (en) * 2014-11-11 2015-03-04 百度在线网络技术(北京)有限公司 System and method for managing cloud resources of application program
CN104573068A (en) * 2015-01-23 2015-04-29 四川中科腾信科技有限公司 Information processing method based on megadata

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110018857A (en) * 2018-01-05 2019-07-16 武汉斗鱼网络科技有限公司 Application component Hua Zhong branch automatic management method, storage medium, device and method
CN110018857B (en) * 2018-01-05 2022-08-16 武汉斗鱼网络科技有限公司 Method, storage medium, device and method for automatically managing branches in application modularization
CN108509788A (en) * 2018-03-29 2018-09-07 广东欧珀移动通信有限公司 Information sharing method and device, computer readable storage medium, terminal
CN108509788B (en) * 2018-03-29 2021-03-23 Oppo广东移动通信有限公司 Information sharing method and device, computer readable storage medium and terminal
CN111158796A (en) * 2019-12-25 2020-05-15 中国航空工业集团公司西安飞机设计研究所 Data processing method of hydraulic control software
CN111158796B (en) * 2019-12-25 2023-05-23 中国航空工业集团公司西安飞机设计研究所 Data processing method of hydraulic control software
US11900152B1 (en) * 2021-03-30 2024-02-13 Amazon Technologies, Inc. Controlled automatic updates to disk image layers with compatibility verification

Also Published As

Publication number Publication date
CN106933555B (en) 2020-06-16

Similar Documents

Publication Publication Date Title
US11740877B2 (en) Application authoring using web-of-sheets data model
JP3939923B2 (en) Knowledge supply device with logical hyperlink
CA2587462C (en) System and method for an immutable identification scheme in a large-scale computer system
US8954480B2 (en) End-to-end interoperability and workflows from building architecture design to one or more simulations
CN100498763C (en) Method for processing data using application program
CN101421726B (en) Occasionally-connected application server
CN102200977B (en) Method and system for extending database table under multi-tenant environment
US8918429B2 (en) Database versioning system
CN101546259B (en) Object-relation mapping system supporting model extension in runtime, and method thereof
Soares et al. Nested composite nodes and version control in an open hypermedia system
CN105630865A (en) N-BIT compressed versioned column data array for in-memory columnar stores
US10685006B2 (en) Content management system and method for synchronizing content translations
CN103544306A (en) Multi-language display supporting method and device of website
US9922100B2 (en) Systems and methods for facilitating the development of an application that accesses data
CN106933555A (en) A kind of data framework system
US20070050428A1 (en) Method and system for version control of composite design objects
US20080306994A1 (en) Method and System for Processing User-Defined Object Based on Object Storage
Brocco Delta-State JSON CRDT: Putting Collaboration on Solid Ground
Cobbs Persistence Programming: Are we doing this right?
TWI484358B (en) Migration system and method of database and computer readable medium thereof
Reschke et al. Towards version control in object-based systems
Sladić et al. Handling structured data in the Alfresco system
Lenahan Document-Oriented Persistence with CouchDB
Majchrzak et al. Offline-provisioning and Synchronization of Content for Mobile Webapps.
Hsieh et al. A method for web application data migration based on RESTful API: A case study of ezScrum

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant