CN101038590A - Space data clustered storage system and data searching method - Google Patents

Space data clustered storage system and data searching method Download PDF

Info

Publication number
CN101038590A
CN101038590A CN 200710051866 CN200710051866A CN101038590A CN 101038590 A CN101038590 A CN 101038590A CN 200710051866 CN200710051866 CN 200710051866 CN 200710051866 A CN200710051866 A CN 200710051866A CN 101038590 A CN101038590 A CN 101038590A
Authority
CN
China
Prior art keywords
space
spatial
data
memory device
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200710051866
Other languages
Chinese (zh)
Other versions
CN100481086C (en
Inventor
喻占武
郑胜
李忠民
潘少明
李锐
胡滨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan University WHU
Original Assignee
Wuhan University WHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan University WHU filed Critical Wuhan University WHU
Priority to CNB2007100518665A priority Critical patent/CN100481086C/en
Publication of CN101038590A publication Critical patent/CN101038590A/en
Application granted granted Critical
Publication of CN100481086C publication Critical patent/CN100481086C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention belongs to the communication technology field in particular it relates to a spatial data cluster storage system and data query method thereof. The provided spatial data cluster storage system comprises a space utilization user terminal for providing the interface service to the space application access system, a space object manager for translating, editing and analyzing the space query statement, decomposing the query task, and managing the space object storage equipment cluster, a space object storage equipment cluster having a plurality of space object storage equipments for storing mass space data with TB or TB above grade storage capacity and supplying parallel data transmission and query processing capacity, wherein the space object storage equipment is responsible for realizing a storage having a database concept, supplying the space data object granularity access and space query and index capacity. The invention provides a space data storage and management scheme with low-cost, high-performance, strong-usability and high-expandability.

Description

A kind of spatial data cluster storage system and data enquire method thereof
Technical field
The invention belongs to communication technical field, particularly a kind of spatial data cluster storage system and data enquire method thereof.
Background technology
Spatial data is carried out reasonable use can boost productivity with management, this has become scientist, managerial personnel and commercial expert's common recognition, but among the human lives 80% data all the mass property of the relevant spatial data that causes with spatial data and spatial data are compared the complex structure that self has, are concerned that features such as complexity make people more and more recognize the singularity and the importance of spatial data storage and management each other with other forms of data.In recent years, along with the exploitation of notion such as digital earth and digital city and system prototype, spatial data new development trend occurred in storage and management aspect.Be example for example to make up the digital earth system, 1 meter resolution image covers Guangdong Province, the data of nearly 1TB, and Guangdong is only 1/53 of China, if set up the digital earth of China, only image data just has 53TB, and this is moment just also, the dynamic data of multidate, its capacity even can be up to the PB level.The qualitative change that the growth of massive spatial data will be caused by quantitative change has proposed new challenge to the storage and management of spatial data.Along with TB level and even PB level spatial database more and more frequently occur in use in the space, this quantitative change of spatial data makes the handling property of spatial database and extendability become the matter of utmost importance that solves the large space application solution that presses for.Present solution, provide high-performance and extensibility by parallel database, but parallel database costs an arm and a leg, complex structure and difficult management, though parallel database has had the history of two more than ten years, but still can not obtain promoting, effective replacement scheme does not appear in existing communication technical field as yet.
Summary of the invention
The object of the invention is to solve the prior art deficiency, and the storage administration scheme of massive spatial data is provided.
For achieving the above object, spatial data cluster storage system provided by the invention comprises following ingredient: comprise following ingredient, the space applications client is used to the space to use connecting system interface service is provided; The spatial object manager is used for compiling, analytic space query statement, decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided;
Described spatial object memory device cluster is made up of a plurality of spatial object memory devices, and the spatial object memory device is used to realize having the storage of database consciousness, and the access visit of spatial data object granularity is provided, and the ability of space querying processing and index is provided.
And the spatial object storage organization in the spatial object memory device comprises picture ID, length, attribute number, attribute vector, attribute offset vector and property value.
And the space applications client is made up of space application interface, target buffer district manager and remote procedure call.
And the spatial object manager is divided device, spatial object catalogue storehouse and remote procedure call by space querying statement resolver, query optimizer, spatial data and is formed.
And, spatial object memory device cluster is made up of a plurality of spatial object memory devices, the built-in support of spatial object memory device, and concurrent control, daily record and the recovery management of supporting database system and index mechanism function to OO Spatial Data Model.
And, the built-in object oriented programming model of spatial object memory device comprises the abstract data model that point, line, surface and complex geometry body are provided, at the mapping of showing the collection object in the spatial object memory device based on the spatial data table realization of object relationship modelling, the tuple in the table is mapped as the space storage object.
The present invention also provides the data enquire method of above-mentioned spatial data cluster storage system, its process is: the space is used connecting system the space applications client is issued in request, the space applications client is passed to the spatial object manager with query requests by RPC mechanism, the spatial object manager is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device in the spatial object memory device cluster, each spatial object memory device with parallel transmission as a result to the spatial object manager, spatial object manager arrangement Query Result is submitted to the space applications client, and the space applications client is back to the space again and uses.
The present invention is based on object storage equipment and Cluster Theory thereof and constructed spatial data cluster storage system (Geospace Object Store, GOS), and the organizational form of implementation space data in object storage equipment, a kind of spatial data storage and management scheme with low cost, high-performance, high availability and enhanced scalability is provided.Spatial data cluster storage system of the present invention can adapt to the development trend that spatial data magnanimity increases, introduced the good characteristic that object storage has, follow intelligent with the networked application trend of memory device, solved the storage administration problem of massive spatial data from the architecture angle of storage.And having designed the data organizational structure of storage space data, by EXPANDING DISPLAY AREA memory device user object, made it have the space semanteme and come the implementation space storage object, is the data storage optimal morphology of this class formation complicated type of spatial data.The present invention also provides the data enquire method of spatial data cluster storage system, solved the user and extracted the demand of data from spatial data cluster storage system, and is perfect in storing the process of extracting data into.
Description of drawings
Fig. 1 is space data cluster memory system architecture figure among the present invention;
Fig. 2 is the data query processing flow chart of system among the present invention;
Fig. 3 is an embodiment of the invention space applications client structural drawing;
Fig. 4 is an Object Manager structural drawing in space in the embodiment of the invention;
Fig. 5 is an object storage equipment structure chart in space in the embodiment of the invention;
Fig. 6 is a spatial object storage organization of the present invention.
Embodiment
Referring to accompanying drawing 1, spatial data cluster storage system provided by the invention comprises following ingredient: space applications client 1 is used to the space to use connecting system interface service is provided; Spatial object manager 2 is used for compiling, analytic space query statement (generally adopting space S QL statement), decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster 3 is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided.Described spatial object memory device cluster 3 is by a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) form, the spatial object memory device is used to realize having the storage of database consciousness, the access visit of spatial data object granularity is provided, the ability of space querying processing and index is provided.Setting up network between the above each several part connects, if adopt gigabit switch when specifically implementing, the spatial object memory device number n that can be provided with in the described spatial object memory device cluster 3 is 10, and 10,000,000,000 switches can provide up to a hundred contacts, the corresponding raising of the number that can be provided with.Technical scheme of the present invention is primarily aimed at the storage administration of TB level~PB level massive spatial data, but the data volume of higher level also can adopt the method.
(Object-based Storage is a new focus of field of storage research OBS), is called follow-on storage system by people, has characteristics such as high-performance, high expansion, high available and high safety in object-based storage.Object storage comes from the intelligent and networked idea of development of memory device, fully merge the advantage of NAS (network additive storage device) and two kinds of storage modes of SAN (storage area network), in memory device, utilize the processing power of innernal CPU directly to support the storage of structuring data, to reduce the operating load of server, improve the availability of system.Memory device is primitive with the storage object and is equipment interface with the object that storage object is a variable length, can enlarge dynamically and dwindle, and object interface has the feature of file interface and piece interface.These features that memory device has have caused the change of memory system architecture, on the one hand be that the management of storage system such as file system or Database Systems function are repartitioned on server and memory device, make the upper strata more concentrate on the management of data manipulation, storage administration work is moved down on the memory device, improve the efficient of upper layer data operational processes; Because the data sharing of object granularity is provided, data path is separated with the control path on the other hand, make a plurality of object storage equipment can form cluster storage system, the storage space and the parallel data transmission mechanism of magnanimity is provided.The storage of the elongated data of object storage support and dwindle dynamically and enlarge characteristic is fit to the storage of the data of this class formation complicated type of spatial data, and the extensibility that has simultaneously, high performance characteristics can adapt to the needs that the magnanimity of spatial data increases.
Thought based on object storage is utilize memory device intelligent, make the part management function of data storage move down into memory device, change memory interface simultaneously, making what manage on the memory device no longer is data block and file, but the storage object with file and piece feature, storage device interface develops into the storage object interface from traditional file or piece.The change of interface, make upper layer application more semantic information can be transferred on the memory device, help the better organization space of memory device,, also make upper layer application more processing capacity can be transferred on the memory device simultaneously for upper layer application provides better service.Use for reference the thought of object storage, the present invention does following expansion: the space semantic information is transferred on the memory device, made that storage object is the spatial object with space semantic information; Utilization based on object storage equipment (OSD) have intelligent, partial function on the database server is transferred to based on the object storage equipment, make that the function of database server is repartitioned, database server is absorbed in the optimization process work of space querying; The extensibility characteristics of utilizing object storage system to have, the cluster storage of implementation space object provides parallel spatial data query processing ability, solves the storage problem and the treatment effeciency problem of massive spatial data.Technical scheme of the present invention is a kind of new massive spatial data storage administration thinking: set up the storage system with database consciousness, memory device no longer is the container of blocks of data, also can be used to provide some functions that satisfy upper layer data storehouse needs.And the spatial object memory device provides the access visit of spatial data object granularity rather than piece granularity, provides space querying to handle and the ability of index on memory device, makes the more close data of data processing work, has reduced the volume of transmitted data of network.
Referring to Fig. 2, the data enquire method that the invention provides spatial data cluster storage system is provided, spatial data query processing process was made up of following several steps, connecting system is used in the space will ask (Query) to issue space applications client 1, space applications client 1 is passed to spatial object manager 2 with query requests by RPC mechanism, spatial object manager 2 is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device (sosd1 in the spatial object manager cluster 3, sosd2 ... sosdn), each spatial object memory device (sosd1, sosd2 ... sosdn) executed in parallel inquiry plan, with result (Result) parallel transmission to spatial object manager 2, spatial object manager 2 arrangement Query Results are submitted to space applications client 1, and space applications client 1 is returned Query Result to space again and used connecting system.During concrete enforcement, if require inquiry response speed, also can be by spatial object memory device (sosd1, sosd2 ... sosdn) result is directly transferred to space applications client 1, transmit and carry out loopback without spatial object manager 2.
In Fig. 3,4,5, provide the formation of spatial data cluster storage system each several part so that implement by level according to present technique field custom:
Referring to Fig. 3, the space applications client 1 in the embodiment of the invention mainly comprises: space application interface, target buffer district manager, remote procedure call.Space applications client 1 mainly is responsible for the space and uses (as GIS etc.) and provide addressing space data cluster storage system interface, its space application interface part that space querying is committed to spatial object manager 2 and receive Query Result data from spatial object manager 2 and return to the space and use.Space applications client 1 provides a page cache management mechanism, its target buffer district manager partial buffer comprises the Query Result page that obtains and the agency who serves as the local spatial application process from spatial object manager 2, local spatial is used space applications client 1 is issued in the space querying request, space applications client 1 sends to spatial object manager 2 by RPC with request, obtains Query Result and returns to the space application.Can realize by improving Shore server during space applications client 1 concrete enforcement, SVAS among the Shore server (the interpolation service end of shore) is embodied as a space querying statement resolver (when the space querying statement adopts SQL statement, corresponding employing GSQL server), its remote procedure call part provides an interface that transmits SQL statement for the rear end.The rear end is meant the spatial object storage administration part of being made up of spatial object manager 2 and spatial object memory device cluster 3 herein.Indicate: the used shore of the present invention is a kind of present this area project of increasing income commonly used, can be referring to http://www.cs.wisc.edu/shore/ when specifically implementing.
Referring to Fig. 4, the spatial object manager 2 in the embodiment of the invention mainly comprises: GSQL resolver, query optimizer, spatial data are divided device, spatial object catalogue storehouse and remote procedure call.Connect and to carry out the information transmission because set up network in the system between the each several part, each several part all is provided with corresponding remote procedure call part and is connected the realization part with network when therefore implementing, and can adopt widely used TCP/IP network.In order in system, to carry out data processing, spatial object manager 2 is repartitioned the function in the Data Base Management System of Object Oriented, the memory management functions that moves down data utilizes the intelligent processing capacity of spatial object memory device cluster 3 and object interface characteristic that the execution of query processing is transferred on the memory device to spatial object memory device cluster 3 simultaneously.Spatial object manager 2 is transferred to spatial object memory device (sosd1, sosd2 with the storage administration of database server, execution, transaction management and the concurrent control function of inquiry ... sosdn) on, the 2 main decomposition of being responsible for query compiler and inquiry plan of spatial object manager, and the record space object is at a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) directory information that go up to distribute is for the formulation of space querying plan provides global information.
The request that spatial object manager 2 receives from the user, by the GSQL resolver query processing operation is decomposed a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) go up executed in parallel, its processing procedure is as follows: spatial object manager 2 receives the query requests that space applications client 1 sends, and gives query optimizer enforcement grammatical analysis, semantic test, query optimization (generating optimum execution planning) and code and generates (generation executable code).Query optimizer compares various implementation strategies, has both considered the size of degree of parallelism, also investigates the traffic and I/O expense, and makes full use of the spatial object data partition information of a plurality of spatial object memory devices, finally selects the inquiry planning of minimum cost for use.During concrete enforcement, query optimizer can be realized based on Opt++, by Opt++ the GSQL statement with space predicate and abstract data types such as point, line and face is compiled, and the realization query requests is decomposed, generate a plurality of son requests, send the son request by the bottom communication subsystem to relevant spatial object memory device at last.The bottom communication subsystem adopts Sun PRC to realize.Indicate: Opt++ is an OO non-linear optimization storehouse, concrete enforcement can referring to http://csmr.ca.sandia.gov/opt++/.SUN RPC is the open far call storehouse of SUN company, has become remote procedure call and has realized a kind of generally acknowledged embodiment.
The spatial object information bank, the global information of space object distribution on the record space object storage device clusters 3, the spatial object memory device IP address of depositing as spatial object name, object ID number, object and the information such as length of object, the attribute information of each field and the abstract data type information of point, line and face etc. in the table relation information that is formed by a plurality of spatial objects, the table, the spatial object information bank is realized by LDAP server.Indicate: LDAP is a LDAP, and LDAP server is generally built-in support in operating system, can directly build.
Spatial data is divided device, the space object is established (sosd1, sosd2 in a plurality of spatial object storages in the tables of data of implementation space ... sosdn) data that are equipped with are divided, when specifically implementing, the present invention can realize the several data partitioning algorithm, hash algorithm Hash and wheel at general property are algorithm Round-robin, and have realized based on Hibert curve data partitioning algorithm at the geometric attribute of spatial data.
Spatial object memory device cluster 3 in the embodiment of the invention is by a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) adopt trunking mode to realize.Referring to Fig. 5, can be realized by the OSD expansion structure when spatial object memory device is specifically implemented: object interface and object storage management are the parts that has been realized by OSD equipment, through expanding in the support that realizes on the memory device transaction management (concurrent being controlled in the transaction management realized, is one of functional module of transaction management), daily record and the recovery management and the spatial index mechanism of Database Systems.Can realize by the Storage Manager that transforms shore during concrete enforcement, the object storage service module that the volume management among the Storage Manager replaces with among the OSD is realized, keep its transaction management, daily record and recovery management and B +And R *Index mechanism.Spatial object memory device cluster 3 receives the fill order of spatial object manager 2, search and whether have the required spatial object of query processing in the target buffer district, there is then direct processing and result is submitted to spatial object manager 2, otherwise handle according to reading required object data on the object ID slave unit.Carry out the space querying processing procedure, utilizing spatial object memory device (sosd1, sosd2 ... sosdn) B that provides on +And R *The execution efficient that index mechanism improves space selection, space projection, the space connects and grouping etc. operated.Son request executive's interface is the function library that space querying is carried out, and provides space selection, space projection, space to connect and block functions.Storage medium is the lowermost layer of spatial object memory device, mainly refers to magnetic sheet or tape.
In OSD, basic storage class is a user object, user object is a container of depositing user data, used user object all is to leave (partition object) in the zone object in by grouping, zone object is responsible for the safety management of addressing, Disk Quotas management and user object, and each user object only belongs to a zone object.For the ease of user object is carried out the operation of quick indexing and a plurality of user objects, under the zone object, can set up a plurality of collection objects (collection object), the user object under the zone object is further divided into groups.Collection object is a logical concept, does not refer to the gathering of one group of user object physically, but realizes the set of a plurality of user objects by pointer.According to this hierarchical structure feature of OSD, the present invention is mapped as collection object with the spatial data table, and the spatial data tuple in the table is mapped as spatial object.Spatial object is by user object among the expansion OSD, make its tool space semanteme, it realizes implementing in two steps, at first set up the meta object district, the organization definition and the description of the data type of support deposited in the meta object district, the organization definition that comprises master datas such as int, float, char, string and point, line, surface and these abstract space data types of complex geometry body, the table schema of going back parking space data relationship table simultaneously.The spatial data type is abideed by the OGC standard and is realized.These meta objects also carry out unique identification by OID.In second step, according to the T10/OSD draft, basic storage unit user object is a structureless data block in OSD object storage equipment, and in spatial object memory device of the present invention, basic storage unit is the spatial object that structure is arranged.Indicate: OGC, The Open GeospatialConsortium; T10/OSD refers to the OSD standard of T10 technical committee, referring to Http:// www.t10.org/
Referring to Fig. 6, the storage organization of the spatial object in the object storage equipment of design space of the present invention comprises: OID, length, attribute number, attribute vector, attribute offset vector, property value.OID is the ID of object, in SOSD, carry out the visit in space according to the OID of object, length is represented the memory length of whole spatial object, the number of attribute number parking space object properties, the OID of each attribute type of attribute vector parking space object, the attribute offset vector is deposited the start offset position of each property value, the value of each attribute in the parking space object of property value memory block.

Claims (7)

1. spatial data cluster storage system is characterized in that: comprise following ingredient, the space applications client is used to the space to use connecting system interface service is provided; The spatial object manager is used for compiling, analytic space query statement, decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided;
Described spatial object memory device cluster is made up of a plurality of spatial object memory devices, and the spatial object memory device is used to realize having the storage of database consciousness, and the access visit of spatial data object granularity is provided, and the ability of space querying processing and index is provided.
2. spatial data cluster storage system as claimed in claim 1 is characterized in that: the spatial object storage organization in the spatial object memory device comprises picture ID, length, attribute number, attribute vector, attribute offset vector and property value.
3. spatial data cluster storage system as claimed in claim 1 or 2 is characterized in that: the space applications client is made up of space application interface, target buffer district manager and remote procedure call.
4. spatial data cluster storage system as claimed in claim 1 or 2 is characterized in that: the spatial object manager is divided device, spatial object catalogue storehouse and remote procedure call by space querying statement resolver, query optimizer, spatial data and is formed.
5. spatial data cluster storage system as claimed in claim 1 or 2, it is characterized in that: the built-in support of spatial object memory device, and concurrent control, daily record and the recovery management of supporting database system and index mechanism function OO Spatial Data Model.
6. spatial data cluster storage system as claimed in claim 5, it is characterized in that: the built-in object oriented programming model of spatial object memory device comprises the abstract data model that point, line, surface and complex geometry body are provided, at the mapping of showing the collection object in the spatial object memory device based on the spatial data table realization of object relationship modelling, the tuple in the table is mapped as the space storage object.
7. the data enquire method of a spatial data cluster storage system as claimed in claim 1 or 2, it is characterized in that: the space is used connecting system the space applications client is issued in request, the space applications client is passed to the spatial object manager with query requests by RPC mechanism, the spatial object manager is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device cluster, a plurality of spatial object memory device executed in parallel inquiry plans of spatial object memory device cluster, with parallel transmission as a result to the spatial object manager, spatial object manager arrangement Query Result is submitted to the space applications client, and the space applications client is back to the space again and uses.
CNB2007100518665A 2007-04-13 2007-04-13 Space data clustered storage system and data searching method Expired - Fee Related CN100481086C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2007100518665A CN100481086C (en) 2007-04-13 2007-04-13 Space data clustered storage system and data searching method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2007100518665A CN100481086C (en) 2007-04-13 2007-04-13 Space data clustered storage system and data searching method

Publications (2)

Publication Number Publication Date
CN101038590A true CN101038590A (en) 2007-09-19
CN100481086C CN100481086C (en) 2009-04-22

Family

ID=38889493

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2007100518665A Expired - Fee Related CN100481086C (en) 2007-04-13 2007-04-13 Space data clustered storage system and data searching method

Country Status (1)

Country Link
CN (1) CN100481086C (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102073742A (en) * 2011-01-31 2011-05-25 清华大学 Mass object storage system and running method thereof
CN102445707A (en) * 2010-10-04 2012-05-09 王子影 Earthquake precursor data compression storage and decompression technology
CN102521386A (en) * 2011-12-22 2012-06-27 清华大学 Method for grouping space metadata based on cluster storage
CN103154935A (en) * 2010-10-11 2013-06-12 惠普发展公司,有限责任合伙企业 System and method for querying a data stream
CN103279546A (en) * 2013-05-13 2013-09-04 清华大学 Graph data query method
CN103279543A (en) * 2013-05-13 2013-09-04 清华大学 Path mode inquiring system for massive image data
CN104158875A (en) * 2014-08-12 2014-11-19 上海新储集成电路有限公司 Method and system for sharing and reducing tasks of data center server
CN104216984A (en) * 2014-09-02 2014-12-17 上海新储集成电路有限公司 Data inquiry method
CN104239469A (en) * 2014-09-03 2014-12-24 河海大学 Space data connecting operation-oriented distributed data accessing method
CN104571946A (en) * 2014-11-28 2015-04-29 中国科学院上海微系统与信息技术研究所 Memory device supporting quick query of logical circuit and access method of memory device
CN104704484A (en) * 2012-10-18 2015-06-10 惠普发展公司,有限责任合伙企业 Communicating tuples in message
CN106156328A (en) * 2016-07-06 2016-11-23 中国银行股份有限公司 A kind of bank's running log data monitoring method and system
WO2017118335A1 (en) * 2016-01-07 2017-07-13 阿里巴巴集团控股有限公司 Mapping method and device
CN107911461A (en) * 2017-11-24 2018-04-13 网宿科技股份有限公司 Object processing method, storage server and cloud storage system in cloud storage system
CN112579570A (en) * 2020-12-16 2021-03-30 中国辐射防护研究院 Nuclear environment data storage method and device
WO2022170544A1 (en) * 2021-02-10 2022-08-18 Alibaba Group Holding Limited Using object properties for facilitating object storage

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102445707A (en) * 2010-10-04 2012-05-09 王子影 Earthquake precursor data compression storage and decompression technology
CN103154935A (en) * 2010-10-11 2013-06-12 惠普发展公司,有限责任合伙企业 System and method for querying a data stream
CN103154935B (en) * 2010-10-11 2016-08-24 惠普发展公司,有限责任合伙企业 For inquiring about the system and method for data stream
CN102073742A (en) * 2011-01-31 2011-05-25 清华大学 Mass object storage system and running method thereof
CN102521386A (en) * 2011-12-22 2012-06-27 清华大学 Method for grouping space metadata based on cluster storage
CN102521386B (en) * 2011-12-22 2013-07-10 清华大学 Method for grouping space metadata based on cluster storage
CN104704484A (en) * 2012-10-18 2015-06-10 惠普发展公司,有限责任合伙企业 Communicating tuples in message
CN103279543A (en) * 2013-05-13 2013-09-04 清华大学 Path mode inquiring system for massive image data
CN103279546A (en) * 2013-05-13 2013-09-04 清华大学 Graph data query method
CN103279546B (en) * 2013-05-13 2017-03-01 清华大学 Graph data query method
CN103279543B (en) * 2013-05-13 2017-05-17 清华大学 Path mode inquiring system for massive image data
CN104158875B (en) * 2014-08-12 2018-04-20 上海新储集成电路有限公司 It is a kind of to share the method and system for mitigating data center server task
CN104158875A (en) * 2014-08-12 2014-11-19 上海新储集成电路有限公司 Method and system for sharing and reducing tasks of data center server
CN104216984B (en) * 2014-09-02 2017-08-25 上海新储集成电路有限公司 Data query method
CN104216984A (en) * 2014-09-02 2014-12-17 上海新储集成电路有限公司 Data inquiry method
CN104239469A (en) * 2014-09-03 2014-12-24 河海大学 Space data connecting operation-oriented distributed data accessing method
CN104239469B (en) * 2014-09-03 2017-09-19 河海大学 A kind of distributed data access method of space-oriented data cube computation operation
CN104571946B (en) * 2014-11-28 2017-06-27 中国科学院上海微系统与信息技术研究所 A kind of storage arrangement and its access method for supporting logic circuit quick search
CN104571946A (en) * 2014-11-28 2015-04-29 中国科学院上海微系统与信息技术研究所 Memory device supporting quick query of logical circuit and access method of memory device
WO2017118335A1 (en) * 2016-01-07 2017-07-13 阿里巴巴集团控股有限公司 Mapping method and device
CN106156328A (en) * 2016-07-06 2016-11-23 中国银行股份有限公司 A kind of bank's running log data monitoring method and system
CN106156328B (en) * 2016-07-06 2019-05-07 中国银行股份有限公司 A kind of bank's running log data monitoring method and system
CN107911461A (en) * 2017-11-24 2018-04-13 网宿科技股份有限公司 Object processing method, storage server and cloud storage system in cloud storage system
CN107911461B (en) * 2017-11-24 2021-05-07 网宿科技股份有限公司 Object processing method in cloud storage system, storage server and cloud storage system
CN112579570A (en) * 2020-12-16 2021-03-30 中国辐射防护研究院 Nuclear environment data storage method and device
CN112579570B (en) * 2020-12-16 2023-06-23 中国辐射防护研究院 Nuclear environment data storage method and device
WO2022170544A1 (en) * 2021-02-10 2022-08-18 Alibaba Group Holding Limited Using object properties for facilitating object storage

Also Published As

Publication number Publication date
CN100481086C (en) 2009-04-22

Similar Documents

Publication Publication Date Title
CN100481086C (en) Space data clustered storage system and data searching method
US11093466B2 (en) Incremental out-of-place updates for index structures
Liao et al. Multi-dimensional index on hadoop distributed file system
Karun et al. A review on hadoop—HDFS infrastructure extensions
US9501550B2 (en) OLAP query processing method oriented to database and HADOOP hybrid platform
Ma et al. Query processing of massive trajectory data based on mapreduce
WO2013155752A1 (en) Database and hadoop hybrid platform-oriented olap query processing method
CN103067461B (en) A kind of metadata management system of file and metadata management method
WO2013155751A1 (en) Concurrent-olap-oriented database query processing method
US20230046216A1 (en) Data management system and method of controlling
CN107895046B (en) Heterogeneous data integration platform
CN114647716B (en) System suitable for generalized data warehouse
CN105354250A (en) Data storage method and device for cloud storage
CN102012946A (en) High-efficiency safety monitoring video/image data storage method
CN1547137A (en) Mass file management system and method based on database
CN102945270B (en) Parallel distribution type network public opinion data management method and system
Rammer et al. Atlas: A distributed file system for spatiotemporal data
Ding et al. A hybrid search engine framework for the internet of things
Voisard et al. Geospatial information extraction: Querying or quarrying?
CN1797397A (en) Real time database management system for automatic system of electric power, and implementation method
Chi et al. Cloud storage of massive remote sensing data based on distributed file system
Ma et al. Implementation of a Federated Large-Scale Remote Sensing Data Sharing Platform
Gong et al. Object-oriented and integrated spatial data model for managing image, DEM, and vector data
Guo et al. Cymo: a storage model with query-aware indexing for spatio-temporal big data
Park et al. KV-CSD: A Hardware-Accelerated Key-Value Store for Data-Intensive Applications

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090422

Termination date: 20100413