CN101038590A - Space data clustered storage system and data searching method - Google Patents
Space data clustered storage system and data searching method Download PDFInfo
- Publication number
- CN101038590A CN101038590A CN 200710051866 CN200710051866A CN101038590A CN 101038590 A CN101038590 A CN 101038590A CN 200710051866 CN200710051866 CN 200710051866 CN 200710051866 A CN200710051866 A CN 200710051866A CN 101038590 A CN101038590 A CN 101038590A
- Authority
- CN
- China
- Prior art keywords
- space
- spatial
- data
- memory device
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention belongs to the communication technology field in particular it relates to a spatial data cluster storage system and data query method thereof. The provided spatial data cluster storage system comprises a space utilization user terminal for providing the interface service to the space application access system, a space object manager for translating, editing and analyzing the space query statement, decomposing the query task, and managing the space object storage equipment cluster, a space object storage equipment cluster having a plurality of space object storage equipments for storing mass space data with TB or TB above grade storage capacity and supplying parallel data transmission and query processing capacity, wherein the space object storage equipment is responsible for realizing a storage having a database concept, supplying the space data object granularity access and space query and index capacity. The invention provides a space data storage and management scheme with low-cost, high-performance, strong-usability and high-expandability.
Description
Technical field
The invention belongs to communication technical field, particularly a kind of spatial data cluster storage system and data enquire method thereof.
Background technology
Spatial data is carried out reasonable use can boost productivity with management, this has become scientist, managerial personnel and commercial expert's common recognition, but among the human lives 80% data all the mass property of the relevant spatial data that causes with spatial data and spatial data are compared the complex structure that self has, are concerned that features such as complexity make people more and more recognize the singularity and the importance of spatial data storage and management each other with other forms of data.In recent years, along with the exploitation of notion such as digital earth and digital city and system prototype, spatial data new development trend occurred in storage and management aspect.Be example for example to make up the digital earth system, 1 meter resolution image covers Guangdong Province, the data of nearly 1TB, and Guangdong is only 1/53 of China, if set up the digital earth of China, only image data just has 53TB, and this is moment just also, the dynamic data of multidate, its capacity even can be up to the PB level.The qualitative change that the growth of massive spatial data will be caused by quantitative change has proposed new challenge to the storage and management of spatial data.Along with TB level and even PB level spatial database more and more frequently occur in use in the space, this quantitative change of spatial data makes the handling property of spatial database and extendability become the matter of utmost importance that solves the large space application solution that presses for.Present solution, provide high-performance and extensibility by parallel database, but parallel database costs an arm and a leg, complex structure and difficult management, though parallel database has had the history of two more than ten years, but still can not obtain promoting, effective replacement scheme does not appear in existing communication technical field as yet.
Summary of the invention
The object of the invention is to solve the prior art deficiency, and the storage administration scheme of massive spatial data is provided.
For achieving the above object, spatial data cluster storage system provided by the invention comprises following ingredient: comprise following ingredient, the space applications client is used to the space to use connecting system interface service is provided; The spatial object manager is used for compiling, analytic space query statement, decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided;
Described spatial object memory device cluster is made up of a plurality of spatial object memory devices, and the spatial object memory device is used to realize having the storage of database consciousness, and the access visit of spatial data object granularity is provided, and the ability of space querying processing and index is provided.
And the spatial object storage organization in the spatial object memory device comprises picture ID, length, attribute number, attribute vector, attribute offset vector and property value.
And the space applications client is made up of space application interface, target buffer district manager and remote procedure call.
And the spatial object manager is divided device, spatial object catalogue storehouse and remote procedure call by space querying statement resolver, query optimizer, spatial data and is formed.
And, spatial object memory device cluster is made up of a plurality of spatial object memory devices, the built-in support of spatial object memory device, and concurrent control, daily record and the recovery management of supporting database system and index mechanism function to OO Spatial Data Model.
And, the built-in object oriented programming model of spatial object memory device comprises the abstract data model that point, line, surface and complex geometry body are provided, at the mapping of showing the collection object in the spatial object memory device based on the spatial data table realization of object relationship modelling, the tuple in the table is mapped as the space storage object.
The present invention also provides the data enquire method of above-mentioned spatial data cluster storage system, its process is: the space is used connecting system the space applications client is issued in request, the space applications client is passed to the spatial object manager with query requests by RPC mechanism, the spatial object manager is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device in the spatial object memory device cluster, each spatial object memory device with parallel transmission as a result to the spatial object manager, spatial object manager arrangement Query Result is submitted to the space applications client, and the space applications client is back to the space again and uses.
The present invention is based on object storage equipment and Cluster Theory thereof and constructed spatial data cluster storage system (Geospace Object Store, GOS), and the organizational form of implementation space data in object storage equipment, a kind of spatial data storage and management scheme with low cost, high-performance, high availability and enhanced scalability is provided.Spatial data cluster storage system of the present invention can adapt to the development trend that spatial data magnanimity increases, introduced the good characteristic that object storage has, follow intelligent with the networked application trend of memory device, solved the storage administration problem of massive spatial data from the architecture angle of storage.And having designed the data organizational structure of storage space data, by EXPANDING DISPLAY AREA memory device user object, made it have the space semanteme and come the implementation space storage object, is the data storage optimal morphology of this class formation complicated type of spatial data.The present invention also provides the data enquire method of spatial data cluster storage system, solved the user and extracted the demand of data from spatial data cluster storage system, and is perfect in storing the process of extracting data into.
Description of drawings
Fig. 1 is space data cluster memory system architecture figure among the present invention;
Fig. 2 is the data query processing flow chart of system among the present invention;
Fig. 3 is an embodiment of the invention space applications client structural drawing;
Fig. 4 is an Object Manager structural drawing in space in the embodiment of the invention;
Fig. 5 is an object storage equipment structure chart in space in the embodiment of the invention;
Fig. 6 is a spatial object storage organization of the present invention.
Embodiment
Referring to accompanying drawing 1, spatial data cluster storage system provided by the invention comprises following ingredient: space applications client 1 is used to the space to use connecting system interface service is provided; Spatial object manager 2 is used for compiling, analytic space query statement (generally adopting space S QL statement), decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster 3 is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided.Described spatial object memory device cluster 3 is by a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) form, the spatial object memory device is used to realize having the storage of database consciousness, the access visit of spatial data object granularity is provided, the ability of space querying processing and index is provided.Setting up network between the above each several part connects, if adopt gigabit switch when specifically implementing, the spatial object memory device number n that can be provided with in the described spatial object memory device cluster 3 is 10, and 10,000,000,000 switches can provide up to a hundred contacts, the corresponding raising of the number that can be provided with.Technical scheme of the present invention is primarily aimed at the storage administration of TB level~PB level massive spatial data, but the data volume of higher level also can adopt the method.
(Object-based Storage is a new focus of field of storage research OBS), is called follow-on storage system by people, has characteristics such as high-performance, high expansion, high available and high safety in object-based storage.Object storage comes from the intelligent and networked idea of development of memory device, fully merge the advantage of NAS (network additive storage device) and two kinds of storage modes of SAN (storage area network), in memory device, utilize the processing power of innernal CPU directly to support the storage of structuring data, to reduce the operating load of server, improve the availability of system.Memory device is primitive with the storage object and is equipment interface with the object that storage object is a variable length, can enlarge dynamically and dwindle, and object interface has the feature of file interface and piece interface.These features that memory device has have caused the change of memory system architecture, on the one hand be that the management of storage system such as file system or Database Systems function are repartitioned on server and memory device, make the upper strata more concentrate on the management of data manipulation, storage administration work is moved down on the memory device, improve the efficient of upper layer data operational processes; Because the data sharing of object granularity is provided, data path is separated with the control path on the other hand, make a plurality of object storage equipment can form cluster storage system, the storage space and the parallel data transmission mechanism of magnanimity is provided.The storage of the elongated data of object storage support and dwindle dynamically and enlarge characteristic is fit to the storage of the data of this class formation complicated type of spatial data, and the extensibility that has simultaneously, high performance characteristics can adapt to the needs that the magnanimity of spatial data increases.
Thought based on object storage is utilize memory device intelligent, make the part management function of data storage move down into memory device, change memory interface simultaneously, making what manage on the memory device no longer is data block and file, but the storage object with file and piece feature, storage device interface develops into the storage object interface from traditional file or piece.The change of interface, make upper layer application more semantic information can be transferred on the memory device, help the better organization space of memory device,, also make upper layer application more processing capacity can be transferred on the memory device simultaneously for upper layer application provides better service.Use for reference the thought of object storage, the present invention does following expansion: the space semantic information is transferred on the memory device, made that storage object is the spatial object with space semantic information; Utilization based on object storage equipment (OSD) have intelligent, partial function on the database server is transferred to based on the object storage equipment, make that the function of database server is repartitioned, database server is absorbed in the optimization process work of space querying; The extensibility characteristics of utilizing object storage system to have, the cluster storage of implementation space object provides parallel spatial data query processing ability, solves the storage problem and the treatment effeciency problem of massive spatial data.Technical scheme of the present invention is a kind of new massive spatial data storage administration thinking: set up the storage system with database consciousness, memory device no longer is the container of blocks of data, also can be used to provide some functions that satisfy upper layer data storehouse needs.And the spatial object memory device provides the access visit of spatial data object granularity rather than piece granularity, provides space querying to handle and the ability of index on memory device, makes the more close data of data processing work, has reduced the volume of transmitted data of network.
Referring to Fig. 2, the data enquire method that the invention provides spatial data cluster storage system is provided, spatial data query processing process was made up of following several steps, connecting system is used in the space will ask (Query) to issue space applications client 1, space applications client 1 is passed to spatial object manager 2 with query requests by RPC mechanism, spatial object manager 2 is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device (sosd1 in the spatial object manager cluster 3, sosd2 ... sosdn), each spatial object memory device (sosd1, sosd2 ... sosdn) executed in parallel inquiry plan, with result (Result) parallel transmission to spatial object manager 2, spatial object manager 2 arrangement Query Results are submitted to space applications client 1, and space applications client 1 is returned Query Result to space again and used connecting system.During concrete enforcement, if require inquiry response speed, also can be by spatial object memory device (sosd1, sosd2 ... sosdn) result is directly transferred to space applications client 1, transmit and carry out loopback without spatial object manager 2.
In Fig. 3,4,5, provide the formation of spatial data cluster storage system each several part so that implement by level according to present technique field custom:
Referring to Fig. 3, the space applications client 1 in the embodiment of the invention mainly comprises: space application interface, target buffer district manager, remote procedure call.Space applications client 1 mainly is responsible for the space and uses (as GIS etc.) and provide addressing space data cluster storage system interface, its space application interface part that space querying is committed to spatial object manager 2 and receive Query Result data from spatial object manager 2 and return to the space and use.Space applications client 1 provides a page cache management mechanism, its target buffer district manager partial buffer comprises the Query Result page that obtains and the agency who serves as the local spatial application process from spatial object manager 2, local spatial is used space applications client 1 is issued in the space querying request, space applications client 1 sends to spatial object manager 2 by RPC with request, obtains Query Result and returns to the space application.Can realize by improving Shore server during space applications client 1 concrete enforcement, SVAS among the Shore server (the interpolation service end of shore) is embodied as a space querying statement resolver (when the space querying statement adopts SQL statement, corresponding employing GSQL server), its remote procedure call part provides an interface that transmits SQL statement for the rear end.The rear end is meant the spatial object storage administration part of being made up of spatial object manager 2 and spatial object memory device cluster 3 herein.Indicate: the used shore of the present invention is a kind of present this area project of increasing income commonly used, can be referring to http://www.cs.wisc.edu/shore/ when specifically implementing.
Referring to Fig. 4, the spatial object manager 2 in the embodiment of the invention mainly comprises: GSQL resolver, query optimizer, spatial data are divided device, spatial object catalogue storehouse and remote procedure call.Connect and to carry out the information transmission because set up network in the system between the each several part, each several part all is provided with corresponding remote procedure call part and is connected the realization part with network when therefore implementing, and can adopt widely used TCP/IP network.In order in system, to carry out data processing, spatial object manager 2 is repartitioned the function in the Data Base Management System of Object Oriented, the memory management functions that moves down data utilizes the intelligent processing capacity of spatial object memory device cluster 3 and object interface characteristic that the execution of query processing is transferred on the memory device to spatial object memory device cluster 3 simultaneously.Spatial object manager 2 is transferred to spatial object memory device (sosd1, sosd2 with the storage administration of database server, execution, transaction management and the concurrent control function of inquiry ... sosdn) on, the 2 main decomposition of being responsible for query compiler and inquiry plan of spatial object manager, and the record space object is at a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) directory information that go up to distribute is for the formulation of space querying plan provides global information.
The request that spatial object manager 2 receives from the user, by the GSQL resolver query processing operation is decomposed a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) go up executed in parallel, its processing procedure is as follows: spatial object manager 2 receives the query requests that space applications client 1 sends, and gives query optimizer enforcement grammatical analysis, semantic test, query optimization (generating optimum execution planning) and code and generates (generation executable code).Query optimizer compares various implementation strategies, has both considered the size of degree of parallelism, also investigates the traffic and I/O expense, and makes full use of the spatial object data partition information of a plurality of spatial object memory devices, finally selects the inquiry planning of minimum cost for use.During concrete enforcement, query optimizer can be realized based on Opt++, by Opt++ the GSQL statement with space predicate and abstract data types such as point, line and face is compiled, and the realization query requests is decomposed, generate a plurality of son requests, send the son request by the bottom communication subsystem to relevant spatial object memory device at last.The bottom communication subsystem adopts Sun PRC to realize.Indicate: Opt++ is an OO non-linear optimization storehouse, concrete enforcement can referring to http://csmr.ca.sandia.gov/opt++/.SUN RPC is the open far call storehouse of SUN company, has become remote procedure call and has realized a kind of generally acknowledged embodiment.
The spatial object information bank, the global information of space object distribution on the record space object storage device clusters 3, the spatial object memory device IP address of depositing as spatial object name, object ID number, object and the information such as length of object, the attribute information of each field and the abstract data type information of point, line and face etc. in the table relation information that is formed by a plurality of spatial objects, the table, the spatial object information bank is realized by LDAP server.Indicate: LDAP is a LDAP, and LDAP server is generally built-in support in operating system, can directly build.
Spatial data is divided device, the space object is established (sosd1, sosd2 in a plurality of spatial object storages in the tables of data of implementation space ... sosdn) data that are equipped with are divided, when specifically implementing, the present invention can realize the several data partitioning algorithm, hash algorithm Hash and wheel at general property are algorithm Round-robin, and have realized based on Hibert curve data partitioning algorithm at the geometric attribute of spatial data.
Spatial object memory device cluster 3 in the embodiment of the invention is by a plurality of spatial object memory device (sosd1, sosd2 ... sosdn) adopt trunking mode to realize.Referring to Fig. 5, can be realized by the OSD expansion structure when spatial object memory device is specifically implemented: object interface and object storage management are the parts that has been realized by OSD equipment, through expanding in the support that realizes on the memory device transaction management (concurrent being controlled in the transaction management realized, is one of functional module of transaction management), daily record and the recovery management and the spatial index mechanism of Database Systems.Can realize by the Storage Manager that transforms shore during concrete enforcement, the object storage service module that the volume management among the Storage Manager replaces with among the OSD is realized, keep its transaction management, daily record and recovery management and B
+And R
*Index mechanism.Spatial object memory device cluster 3 receives the fill order of spatial object manager 2, search and whether have the required spatial object of query processing in the target buffer district, there is then direct processing and result is submitted to spatial object manager 2, otherwise handle according to reading required object data on the object ID slave unit.Carry out the space querying processing procedure, utilizing spatial object memory device (sosd1, sosd2 ... sosdn) B that provides on
+And R
*The execution efficient that index mechanism improves space selection, space projection, the space connects and grouping etc. operated.Son request executive's interface is the function library that space querying is carried out, and provides space selection, space projection, space to connect and block functions.Storage medium is the lowermost layer of spatial object memory device, mainly refers to magnetic sheet or tape.
In OSD, basic storage class is a user object, user object is a container of depositing user data, used user object all is to leave (partition object) in the zone object in by grouping, zone object is responsible for the safety management of addressing, Disk Quotas management and user object, and each user object only belongs to a zone object.For the ease of user object is carried out the operation of quick indexing and a plurality of user objects, under the zone object, can set up a plurality of collection objects (collection object), the user object under the zone object is further divided into groups.Collection object is a logical concept, does not refer to the gathering of one group of user object physically, but realizes the set of a plurality of user objects by pointer.According to this hierarchical structure feature of OSD, the present invention is mapped as collection object with the spatial data table, and the spatial data tuple in the table is mapped as spatial object.Spatial object is by user object among the expansion OSD, make its tool space semanteme, it realizes implementing in two steps, at first set up the meta object district, the organization definition and the description of the data type of support deposited in the meta object district, the organization definition that comprises master datas such as int, float, char, string and point, line, surface and these abstract space data types of complex geometry body, the table schema of going back parking space data relationship table simultaneously.The spatial data type is abideed by the OGC standard and is realized.These meta objects also carry out unique identification by OID.In second step, according to the T10/OSD draft, basic storage unit user object is a structureless data block in OSD object storage equipment, and in spatial object memory device of the present invention, basic storage unit is the spatial object that structure is arranged.Indicate: OGC, The Open GeospatialConsortium; T10/OSD refers to the OSD standard of T10 technical committee, referring to
Http:// www.t10.org/
Referring to Fig. 6, the storage organization of the spatial object in the object storage equipment of design space of the present invention comprises: OID, length, attribute number, attribute vector, attribute offset vector, property value.OID is the ID of object, in SOSD, carry out the visit in space according to the OID of object, length is represented the memory length of whole spatial object, the number of attribute number parking space object properties, the OID of each attribute type of attribute vector parking space object, the attribute offset vector is deposited the start offset position of each property value, the value of each attribute in the parking space object of property value memory block.
Claims (7)
1. spatial data cluster storage system is characterized in that: comprise following ingredient, the space applications client is used to the space to use connecting system interface service is provided; The spatial object manager is used for compiling, analytic space query statement, decomposition query task and management spatial object memory device cluster; Spatial object memory device cluster is used for the storage of TB level or the above massive spatial data of TB level, and parallel data transmission and parallel query processing ability is provided;
Described spatial object memory device cluster is made up of a plurality of spatial object memory devices, and the spatial object memory device is used to realize having the storage of database consciousness, and the access visit of spatial data object granularity is provided, and the ability of space querying processing and index is provided.
2. spatial data cluster storage system as claimed in claim 1 is characterized in that: the spatial object storage organization in the spatial object memory device comprises picture ID, length, attribute number, attribute vector, attribute offset vector and property value.
3. spatial data cluster storage system as claimed in claim 1 or 2 is characterized in that: the space applications client is made up of space application interface, target buffer district manager and remote procedure call.
4. spatial data cluster storage system as claimed in claim 1 or 2 is characterized in that: the spatial object manager is divided device, spatial object catalogue storehouse and remote procedure call by space querying statement resolver, query optimizer, spatial data and is formed.
5. spatial data cluster storage system as claimed in claim 1 or 2, it is characterized in that: the built-in support of spatial object memory device, and concurrent control, daily record and the recovery management of supporting database system and index mechanism function OO Spatial Data Model.
6. spatial data cluster storage system as claimed in claim 5, it is characterized in that: the built-in object oriented programming model of spatial object memory device comprises the abstract data model that point, line, surface and complex geometry body are provided, at the mapping of showing the collection object in the spatial object memory device based on the spatial data table realization of object relationship modelling, the tuple in the table is mapped as the space storage object.
7. the data enquire method of a spatial data cluster storage system as claimed in claim 1 or 2, it is characterized in that: the space is used connecting system the space applications client is issued in request, the space applications client is passed to the spatial object manager with query requests by RPC mechanism, the spatial object manager is responsible for resolving and the compiled query request, formulate inquiry plan and be distributed to spatial object memory device cluster, a plurality of spatial object memory device executed in parallel inquiry plans of spatial object memory device cluster, with parallel transmission as a result to the spatial object manager, spatial object manager arrangement Query Result is submitted to the space applications client, and the space applications client is back to the space again and uses.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2007100518665A CN100481086C (en) | 2007-04-13 | 2007-04-13 | Space data clustered storage system and data searching method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CNB2007100518665A CN100481086C (en) | 2007-04-13 | 2007-04-13 | Space data clustered storage system and data searching method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101038590A true CN101038590A (en) | 2007-09-19 |
CN100481086C CN100481086C (en) | 2009-04-22 |
Family
ID=38889493
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CNB2007100518665A Expired - Fee Related CN100481086C (en) | 2007-04-13 | 2007-04-13 | Space data clustered storage system and data searching method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN100481086C (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102073742A (en) * | 2011-01-31 | 2011-05-25 | 清华大学 | Mass object storage system and running method thereof |
CN102445707A (en) * | 2010-10-04 | 2012-05-09 | 王子影 | Earthquake precursor data compression storage and decompression technology |
CN102521386A (en) * | 2011-12-22 | 2012-06-27 | 清华大学 | Method for grouping space metadata based on cluster storage |
CN103154935A (en) * | 2010-10-11 | 2013-06-12 | 惠普发展公司,有限责任合伙企业 | System and method for querying a data stream |
CN103279546A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Graph data query method |
CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
CN104158875A (en) * | 2014-08-12 | 2014-11-19 | 上海新储集成电路有限公司 | Method and system for sharing and reducing tasks of data center server |
CN104216984A (en) * | 2014-09-02 | 2014-12-17 | 上海新储集成电路有限公司 | Data inquiry method |
CN104239469A (en) * | 2014-09-03 | 2014-12-24 | 河海大学 | Space data connecting operation-oriented distributed data accessing method |
CN104571946A (en) * | 2014-11-28 | 2015-04-29 | 中国科学院上海微系统与信息技术研究所 | Memory device supporting quick query of logical circuit and access method of memory device |
CN104704484A (en) * | 2012-10-18 | 2015-06-10 | 惠普发展公司,有限责任合伙企业 | Communicating tuples in message |
CN106156328A (en) * | 2016-07-06 | 2016-11-23 | 中国银行股份有限公司 | A kind of bank's running log data monitoring method and system |
WO2017118335A1 (en) * | 2016-01-07 | 2017-07-13 | 阿里巴巴集团控股有限公司 | Mapping method and device |
CN107911461A (en) * | 2017-11-24 | 2018-04-13 | 网宿科技股份有限公司 | Object processing method, storage server and cloud storage system in cloud storage system |
CN112579570A (en) * | 2020-12-16 | 2021-03-30 | 中国辐射防护研究院 | Nuclear environment data storage method and device |
WO2022170544A1 (en) * | 2021-02-10 | 2022-08-18 | Alibaba Group Holding Limited | Using object properties for facilitating object storage |
-
2007
- 2007-04-13 CN CNB2007100518665A patent/CN100481086C/en not_active Expired - Fee Related
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102445707A (en) * | 2010-10-04 | 2012-05-09 | 王子影 | Earthquake precursor data compression storage and decompression technology |
CN103154935A (en) * | 2010-10-11 | 2013-06-12 | 惠普发展公司,有限责任合伙企业 | System and method for querying a data stream |
CN103154935B (en) * | 2010-10-11 | 2016-08-24 | 惠普发展公司,有限责任合伙企业 | For inquiring about the system and method for data stream |
CN102073742A (en) * | 2011-01-31 | 2011-05-25 | 清华大学 | Mass object storage system and running method thereof |
CN102521386A (en) * | 2011-12-22 | 2012-06-27 | 清华大学 | Method for grouping space metadata based on cluster storage |
CN102521386B (en) * | 2011-12-22 | 2013-07-10 | 清华大学 | Method for grouping space metadata based on cluster storage |
CN104704484A (en) * | 2012-10-18 | 2015-06-10 | 惠普发展公司,有限责任合伙企业 | Communicating tuples in message |
CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
CN103279546A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Graph data query method |
CN103279546B (en) * | 2013-05-13 | 2017-03-01 | 清华大学 | Graph data query method |
CN103279543B (en) * | 2013-05-13 | 2017-05-17 | 清华大学 | Path mode inquiring system for massive image data |
CN104158875B (en) * | 2014-08-12 | 2018-04-20 | 上海新储集成电路有限公司 | It is a kind of to share the method and system for mitigating data center server task |
CN104158875A (en) * | 2014-08-12 | 2014-11-19 | 上海新储集成电路有限公司 | Method and system for sharing and reducing tasks of data center server |
CN104216984B (en) * | 2014-09-02 | 2017-08-25 | 上海新储集成电路有限公司 | Data query method |
CN104216984A (en) * | 2014-09-02 | 2014-12-17 | 上海新储集成电路有限公司 | Data inquiry method |
CN104239469A (en) * | 2014-09-03 | 2014-12-24 | 河海大学 | Space data connecting operation-oriented distributed data accessing method |
CN104239469B (en) * | 2014-09-03 | 2017-09-19 | 河海大学 | A kind of distributed data access method of space-oriented data cube computation operation |
CN104571946B (en) * | 2014-11-28 | 2017-06-27 | 中国科学院上海微系统与信息技术研究所 | A kind of storage arrangement and its access method for supporting logic circuit quick search |
CN104571946A (en) * | 2014-11-28 | 2015-04-29 | 中国科学院上海微系统与信息技术研究所 | Memory device supporting quick query of logical circuit and access method of memory device |
WO2017118335A1 (en) * | 2016-01-07 | 2017-07-13 | 阿里巴巴集团控股有限公司 | Mapping method and device |
CN106156328A (en) * | 2016-07-06 | 2016-11-23 | 中国银行股份有限公司 | A kind of bank's running log data monitoring method and system |
CN106156328B (en) * | 2016-07-06 | 2019-05-07 | 中国银行股份有限公司 | A kind of bank's running log data monitoring method and system |
CN107911461A (en) * | 2017-11-24 | 2018-04-13 | 网宿科技股份有限公司 | Object processing method, storage server and cloud storage system in cloud storage system |
CN107911461B (en) * | 2017-11-24 | 2021-05-07 | 网宿科技股份有限公司 | Object processing method in cloud storage system, storage server and cloud storage system |
CN112579570A (en) * | 2020-12-16 | 2021-03-30 | 中国辐射防护研究院 | Nuclear environment data storage method and device |
CN112579570B (en) * | 2020-12-16 | 2023-06-23 | 中国辐射防护研究院 | Nuclear environment data storage method and device |
WO2022170544A1 (en) * | 2021-02-10 | 2022-08-18 | Alibaba Group Holding Limited | Using object properties for facilitating object storage |
Also Published As
Publication number | Publication date |
---|---|
CN100481086C (en) | 2009-04-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN100481086C (en) | Space data clustered storage system and data searching method | |
US11093466B2 (en) | Incremental out-of-place updates for index structures | |
Liao et al. | Multi-dimensional index on hadoop distributed file system | |
Karun et al. | A review on hadoop—HDFS infrastructure extensions | |
US9501550B2 (en) | OLAP query processing method oriented to database and HADOOP hybrid platform | |
Ma et al. | Query processing of massive trajectory data based on mapreduce | |
WO2013155752A1 (en) | Database and hadoop hybrid platform-oriented olap query processing method | |
CN103067461B (en) | A kind of metadata management system of file and metadata management method | |
WO2013155751A1 (en) | Concurrent-olap-oriented database query processing method | |
US20230046216A1 (en) | Data management system and method of controlling | |
CN107895046B (en) | Heterogeneous data integration platform | |
CN114647716B (en) | System suitable for generalized data warehouse | |
CN105354250A (en) | Data storage method and device for cloud storage | |
CN102012946A (en) | High-efficiency safety monitoring video/image data storage method | |
CN1547137A (en) | Mass file management system and method based on database | |
CN102945270B (en) | Parallel distribution type network public opinion data management method and system | |
Rammer et al. | Atlas: A distributed file system for spatiotemporal data | |
Ding et al. | A hybrid search engine framework for the internet of things | |
Voisard et al. | Geospatial information extraction: Querying or quarrying? | |
CN1797397A (en) | Real time database management system for automatic system of electric power, and implementation method | |
Chi et al. | Cloud storage of massive remote sensing data based on distributed file system | |
Ma et al. | Implementation of a Federated Large-Scale Remote Sensing Data Sharing Platform | |
Gong et al. | Object-oriented and integrated spatial data model for managing image, DEM, and vector data | |
Guo et al. | Cymo: a storage model with query-aware indexing for spatio-temporal big data | |
Park et al. | KV-CSD: A Hardware-Accelerated Key-Value Store for Data-Intensive Applications |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
C17 | Cessation of patent right | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090422 Termination date: 20100413 |