CN114020750A - Mass data read-write system and method based on distributed storage - Google Patents

Mass data read-write system and method based on distributed storage Download PDF

Info

Publication number
CN114020750A
CN114020750A CN202111317987.6A CN202111317987A CN114020750A CN 114020750 A CN114020750 A CN 114020750A CN 202111317987 A CN202111317987 A CN 202111317987A CN 114020750 A CN114020750 A CN 114020750A
Authority
CN
China
Prior art keywords
data
information
hbase database
row key
distributed storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111317987.6A
Other languages
Chinese (zh)
Inventor
王一鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Heading Data Intelligence Co Ltd
Original Assignee
Heading Data Intelligence Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Heading Data Intelligence Co Ltd filed Critical Heading Data Intelligence Co Ltd
Priority to CN202111317987.6A priority Critical patent/CN114020750A/en
Publication of CN114020750A publication Critical patent/CN114020750A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2219Large Object storage; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures
    • G06F16/2255Hash tables
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention relates to a mass data read-write method and a mass data read-write system based on distributed storage, wherein the method comprises the following steps: acquiring the acquired data of the high-precision map, and storing the acquired data into an Hbase database; constructing a row key of the Hbase database according to the time information, the equipment information and the spatial information of the acquired data; storing description information of acquired data in an elastic search database, and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier; and matching the data reading and writing request of the user with the data index, and executing corresponding reading and writing operation on the matched data in the Hbase database. According to the invention, data and indexes are respectively stored, and then the interworking between Hbase and the elastic search is realized through a line key, so that the problem of insufficient performance in a high-concurrency read-write scene is solved.

Description

Mass data read-write system and method based on distributed storage
Technical Field
The invention belongs to the technical field of high-precision maps and big data processing, and particularly relates to a method and a system for keeping the road network data range of an electronic horizon line to be minimized.
Background
Drawing of a high-precision crowdsourcing map requires efficient writing and reading of collected data of a large number of automobiles. Due to the fact that single automobile is high in uploading frequency and large in quantity of automobiles, distributed real-time writing can better meet the data freshness degree than timed batch writing; when data is read, the data reading needs to be dispersed to a plurality of machines due to the high concurrent reading task, and load balancing is realized. The invention provides a distributed read-write processing system device.
The existing collected data is stored in a relational database, all read-write tasks need to be regulated and controlled by a database main node, all client requests need the main node to spend resources for maintaining connection, and when a high-concurrency read-write scene exists, a large resource pressure is caused on the server main node.
Disclosure of Invention
In order to solve the problem of insufficient resources of a server main node under the condition of large concurrent reading and writing, a first aspect of the invention provides a mass data reading and writing method based on distributed storage, which comprises the following steps: acquiring the acquired data of the high-precision map, and storing the acquired data into an Hbase database; constructing a row key of the Hbase database according to the time information, the equipment information and the spatial information of the acquired data; storing description information of acquired data in an elastic search database, and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier; and matching the data reading and writing request of the user with the data index, and executing corresponding reading and writing operation on the matched data in the Hbase database.
In some embodiments of the invention, said building a data index from said description information and a universally unique identifier comprises: when a concurrent write task exceeds a throughput threshold of an elastic search cluster, the concurrent write task is distributed evenly across different nodes of the elastic search cluster.
In some embodiments of the present invention, the matching the data read-write request of the user with the data index, and performing corresponding read-write operation on the data in the matched Hbase database includes: matching the data reading request of the user with the data index to obtain one or more row key sets meeting the conditions; and sending a query request to the Hbase database by the user through the one or more row key sets meeting the conditions, and returning the matched data to the user by the Hbase database.
Further, the user sends a query request to the Hbase database through the Thift interface.
In some embodiments of the present invention, the constructing the row key of the Hbase database according to the time information, the device information, and the spatial information of the collected data includes: analyzing the collected data; carrying out tile segmentation on the analyzed data to obtain a tile number of each tile; and constructing a row key according to the tile number, the time information and the equipment information.
Furthermore, the prefix of the space information is used as the prefix of the row key, and the acquisition time and the acquisition equipment are used as suffixes.
In a second aspect of the present invention, a mass data read-write system based on distributed storage is provided, including: the acquisition module is used for acquiring the acquired data of the high-precision map and storing the acquired data into the Hbase database; the building module is used for building a row key of the Hbase database according to the time information, the equipment information and the spatial information of the collected data; the establishing module is used for storing the description information of the acquired data in an elastic search database and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier; and the matching module is used for matching the data reading and writing request of the user with the data index and executing corresponding reading and writing operation on the matched data in the Hbase database.
Furthermore, the construction module comprises an analysis unit, a segmentation unit and a construction unit, wherein the analysis unit is used for analyzing the acquired data; the dividing unit is used for carrying out tile division on the analyzed data to obtain the tile number of each tile; and the construction unit is used for constructing a row key according to the tile number, the time information and the equipment information.
In a third aspect of the present invention, there is provided an electronic device comprising: one or more processors; the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the mass data reading and writing method based on distributed storage provided by the first aspect of the present invention.
In a fourth aspect of the present invention, a computer-readable medium is provided, on which a computer program is stored, where the computer program, when executed by a processor, implements the mass data reading and writing method based on distributed storage provided in the first aspect of the present invention.
The invention has the beneficial effects that:
1. according to the method, the storage data and the index data are respectively stored in different distributed databases, so that the problem that the load of the main node is too high due to concurrent read-write tasks of the high-precision crowdsourcing map in the uploading process is solved;
2. according to the invention, data and indexes are respectively stored, and then the interworking between Hbase and the elastic search is realized through a rowkey, so that the matching problem of a high-distributed storage node and a distributed index node is solved;
3. a row key set constructed by time information, equipment information and space information distinguishes crowdsourcing data sources, and the problem of data inconsistency caused by row key repetition is avoided.
Drawings
Fig. 1 is a schematic basic flow chart of a mass data read-write method based on distributed storage according to some embodiments of the present invention;
fig. 2 is a schematic flowchart of a mass data read-write method based on distributed storage according to some embodiments of the present invention;
FIG. 3 is a timing diagram for data reading in some embodiments of the present invention;
fig. 4 is a schematic structural diagram of a mass data read-write system based on distributed storage in some embodiments of the present invention;
fig. 5 is a schematic structural diagram of an electronic device in some embodiments of the invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1 and fig. 2, in a first aspect of the present invention, a mass data read-write method based on distributed storage is provided, including: s100, acquiring the acquired data of the high-precision map, and storing the acquired data into an Hbase database; s200, establishing a row key of the Hbase database according to time information, equipment information and spatial information of the acquired data; s300, storing description information of the acquired data in an elastic search database, and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier; and S400, matching the data read-write request of the user with the data index, and executing corresponding read-write operation on the matched data in the Hbase database.
It is understood that HBase is a Hadoop database, often described as a sparse, distributed, persistent, multidimensional ordered mapping that indexes based on row keys (Rowkey), column keys, and timestamps, and is a randomly accessible platform for storing and retrieving data. The HBase query is typically queried by its Rowkey. The Hbase database or the elastic search database is a distributed database, which is usually deployed in a corresponding cluster (Hbase cluster or elastic search cluster); therefore, the HBase database or the elastic search database described above may also be understood as a corresponding cluster.
In step S200 of some embodiments of the present invention, on the premise that the Rowkey is not repeated, the data is hashed and stored, so as to avoid a server bottleneck of single-point hot writing caused by writing the data into the same database node in a high concurrency scenario; due to the adoption of the hbase distributed cluster, the task of writing data is balanced to different machines. In order to avoid the consistency problem of the row keys, the prefix of the space information is used as the prefix of the row keys, and the acquisition time and the acquisition equipment are used as suffixes. Specifically, the rowkey format of Hbase adopts a mode of 'space > time > acquisition equipment', prefixes of spatial indexes are used as rowkey prefixes, and acquisition time and acquisition equipment are used as suffixes and spliced together.
In view of this, the constructing the row key of the Hbase database according to the time information, the device information, and the spatial information of the collected data includes: analyzing the collected data; carrying out tile segmentation on the analyzed data to obtain a tile number of each tile; and constructing a row key according to the tile number, the time information and the equipment information.
Specifically, the step of constructing the row key of the Hbase database according to the time information, the device information and the spatial information of the collected data comprises:
s201, analyzing the acquired data, and dividing the data according to the longitude and latitude of each element and the NDS tile to obtain the serial number of the tile;
s202, hashing Tile (Tile) numbers by using hash, splicing acquisition time and acquisition equipment numbers, and constructing a rowkey;
s203, after the acquired data are subjected to structuring processing, rowkey is used as a row key value of hbase, and the data are stored into the hbase.
The tile is a square grid picture obtained by cutting a map within a certain range into a plurality of rows and columns according to a certain size and format and a zoom level or a scale, and the square grid picture after being cut is called a tile visually.
In S300 of some embodiments of the present invention, the creating a data index according to the description information and a Universally Unique Identifier (UUID) includes: when a concurrent write task exceeds a throughput threshold of an elastic search cluster, the concurrent write task is distributed evenly across different nodes of the elastic search cluster. The throughput threshold of an elastic search cluster can be understood as the maximum task load of a single or multiple nodes.
In step S400 in some embodiments of the present invention, the matching the data read/write request of the user with the data index, and performing corresponding read/write operation on the data in the matched Hbase database includes: s401, matching a data reading request of a user with a data index to obtain one or more row key sets meeting conditions; s402, the user sends a query request to the Hbase database through the one or more row key sets meeting the conditions, and the Hbase database returns the matched data to the user.
Specifically, using rowkey as uuid value of the elastic search, and using the rowkey and other data needing indexing as key value pair information, writing the rowkey into the elastic search; during query, the rowkey geometry meeting the conditions is queried in the elastic search through the index field; and reading the required structured data from the hbase through rowkey set.
Schematically, fig. 3 shows a timing chart of one data reading process in the above-described embodiment; the method specifically comprises the following steps: a client sends a query ES secondary index to an ES (elastic search) cluster, and the ES cluster returns a rowkey set meeting the conditions; the client is connected to the hbase through the Thift cluster, query is conducted according to the rowkey set, and the hbase finally returns the data set meeting the conditions to the client. It should be understood that the number of concurrent write tasks and concurrent read tasks is not limited in the present invention, i.e., the present invention can be used in one or more concurrent write tasks and concurrent read tasks.
Example 2
Referring to fig. 4, in a second aspect of the present invention, there is provided a mass data read-write system 1 based on distributed storage, including: the acquisition module 11 is used for acquiring the acquired data of the high-precision map and storing the acquired data into an Hbase database; the building module 12 is configured to build a row key of the Hbase database according to the time information, the device information, and the spatial information of the collected data; the establishing module 13 is used for storing the description information of the acquired data in an elastic search database, and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier; and the matching module 14 is configured to match the data read-write request of the user with the data index, and perform corresponding read-write operation on the data in the matched Hbase database.
Further, the building module 12 includes an analyzing unit, a dividing unit, and a building unit, where the analyzing unit is configured to analyze the collected data; the dividing unit is used for carrying out tile division on the analyzed data to obtain the tile number of each tile; and the construction unit is used for constructing a row key according to the tile number, the time information and the equipment information.
Example 3
Referring to fig. 5, in a third aspect of the present invention, there is provided an electronic apparatus comprising: one or more processors; storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to carry out the method of the first aspect of the invention.
The electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM502, and the RAM503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.
The following devices may be connected to the I/O interface 505 in general: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; a storage device 508 including, for example, a hard disk; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 5 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 5 may represent one device or may represent multiple devices as desired.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program, when executed by the processing device 501, performs the above-described functions defined in the methods of embodiments of the present disclosure. It should be noted that the computer readable medium described in the embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In embodiments of the present disclosure, however, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more computer programs which, when executed by the electronic device, cause the electronic device to:
computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, Python, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (10)

1. A mass data read-write method based on distributed storage is characterized in that,
acquiring the acquired data of the high-precision map, and storing the acquired data into an Hbase database;
constructing a row key of the Hbase database according to the time information, the equipment information and the spatial information of the acquired data;
storing description information of acquired data in an elastic search database, and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier;
and matching the data reading and writing request of the user with the data index, and executing corresponding reading and writing operation on the matched data in the Hbase database.
2. The mass data reading and writing method based on distributed storage according to claim 1, wherein the establishing of the data index according to the description information and the universal unique identifier comprises:
when a concurrent write task exceeds a throughput threshold of an elastic search cluster, the concurrent write task is distributed evenly across different nodes of the elastic search cluster.
3. The mass data read-write method based on distributed storage according to claim 1, wherein the matching of the data read-write request of the user with the data index and the corresponding read-write operation of the data in the matched Hbase database include:
matching the data reading request of the user with the data index to obtain one or more row key sets meeting the conditions;
and sending a query request to the Hbase database by the user through the one or more row key sets meeting the conditions, and returning the matched data to the user by the Hbase database.
4. The mass data read-write method based on distributed storage according to claim 3, further comprising: the user sends a query request to the Hbase database through the Thift interface.
5. The mass data read-write method based on distributed storage according to claim 1, wherein the constructing the row key of the Hbase database according to the time information, the device information and the spatial information of the collected data comprises:
analyzing the collected data;
carrying out tile segmentation on the analyzed data to obtain a tile number of each tile;
and constructing a row key according to the tile number, the time information and the equipment information.
6. The mass data read-write method based on distributed storage according to claim 5, wherein the row key is constructed by the following steps:
and taking the prefix of the spatial information as the prefix of a row key and taking the acquisition time and the acquisition equipment as suffixes.
7. A mass data read-write system based on distributed storage is characterized by comprising:
the acquisition module is used for acquiring the acquired data of the high-precision map and storing the acquired data into the Hbase database;
the building module is used for building a row key of the Hbase database according to the time information, the equipment information and the spatial information of the collected data;
the establishing module is used for storing the description information of the acquired data in an elastic search database and taking a row key of an Hbase database as a universal unique identifier; establishing a data index according to the description information and the universal unique identifier;
and the matching module is used for matching the data reading and writing request of the user with the data index and executing corresponding reading and writing operation on the matched data in the Hbase database.
8. The mass data reading and writing system based on distributed storage according to claim 7, wherein the building module comprises an analysis unit, a segmentation unit, and a building unit,
the analysis unit is used for analyzing the collected data;
the dividing unit is used for carrying out tile division on the analyzed data to obtain the tile number of each tile;
and the construction unit is used for constructing a row key according to the tile number, the time information and the equipment information.
9. An electronic device, comprising: one or more processors; storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the mass data read/write method based on distributed storage according to any one of claims 1 to 6.
10. A computer-readable medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the mass data reading and writing method based on distributed storage according to any one of claims 1 to 6.
CN202111317987.6A 2021-11-09 2021-11-09 Mass data read-write system and method based on distributed storage Pending CN114020750A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111317987.6A CN114020750A (en) 2021-11-09 2021-11-09 Mass data read-write system and method based on distributed storage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111317987.6A CN114020750A (en) 2021-11-09 2021-11-09 Mass data read-write system and method based on distributed storage

Publications (1)

Publication Number Publication Date
CN114020750A true CN114020750A (en) 2022-02-08

Family

ID=80062441

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111317987.6A Pending CN114020750A (en) 2021-11-09 2021-11-09 Mass data read-write system and method based on distributed storage

Country Status (1)

Country Link
CN (1) CN114020750A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114840612A (en) * 2022-05-09 2022-08-02 中国人民解放军军事科学院军事医学研究院 Massive meteorological element data storage and query method and system
CN118409716A (en) * 2024-07-02 2024-07-30 成都山莓科技有限公司 Data writing management method, device and medium based on server super fusion

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114840612A (en) * 2022-05-09 2022-08-02 中国人民解放军军事科学院军事医学研究院 Massive meteorological element data storage and query method and system
CN118409716A (en) * 2024-07-02 2024-07-30 成都山莓科技有限公司 Data writing management method, device and medium based on server super fusion

Similar Documents

Publication Publication Date Title
US9683852B2 (en) Dispatching map matching tasks by a cluster server
US10338958B1 (en) Stream adapter for batch-oriented processing frameworks
CN111258978B (en) Data storage method
CN114020750A (en) Mass data read-write system and method based on distributed storage
CN113704291A (en) Data query method and device, storage medium and electronic equipment
CN111950857A (en) Index system management method and device based on service indexes and electronic equipment
CN112099982B (en) Crash information positioning method and device, medium and electronic equipment
US20220156291A1 (en) Geospatial data analytics and visualization platform
CN111241137A (en) Data processing method and device, electronic equipment and storage medium
CN112307061A (en) Method and device for querying data
CN113722518A (en) Storage method, retrieval method, equipment and medium based on remote sensing image metadata
CN111488386B (en) Data query method and device
Ghosh et al. Aid*: a spatial index for visual exploration of geo-spatial data
CN116955413A (en) Data query method, device, medium and equipment based on online analysis processing
CN116243926A (en) Service processing method, device, medium and electronic equipment
CN116108233A (en) Data processing method, device, equipment and storage medium
CN113157695B (en) Data processing method and device, readable medium and electronic equipment
CN113886353B (en) Data configuration recommendation method and device for hierarchical storage management software and storage medium
CN113139258B (en) Road data processing method, device, equipment and storage medium
CN115221184A (en) Basic geographic data sending method, device, equipment and computer readable medium
CN110941683B (en) Method, device, medium and electronic equipment for acquiring object attribute information in space
CN114969114A (en) Water conservancy information rapid retrieval method, system and computer readable medium
CN113312331A (en) Data migration method, device, system, electronic equipment and computer readable medium
CN116820354B (en) Data storage method, data storage device and data storage system
KR20170085786A (en) System and method for storing data in big data platform

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination