CN114064707A - Data query method and device for data virtualization server and storage medium - Google Patents
Data query method and device for data virtualization server and storage medium Download PDFInfo
- Publication number
- CN114064707A CN114064707A CN202111406126.5A CN202111406126A CN114064707A CN 114064707 A CN114064707 A CN 114064707A CN 202111406126 A CN202111406126 A CN 202111406126A CN 114064707 A CN114064707 A CN 114064707A
- Authority
- CN
- China
- Prior art keywords
- data
- query
- layer
- source
- virtual table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24549—Run-time optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/907—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/541—Interprogram communication via adapters, e.g. between incompatible applications
Abstract
The invention discloses a data query method, a device and a storage medium based on a data virtualization technology, belonging to the technical field of information processing, wherein the method comprises the following steps: s1: based on a query request of a user, a query engine determines a query processing strategy and performance optimization measures; s2: inquiring whether a corresponding predefined virtual table exists in the data service layer, if so, performing step S3, if not, generating a corresponding temporary virtual table by the data service layer, and then performing step S3; s3: the data mapping layer realizes the mapping of the virtual table to the bottom data source through the encapsulation table; s4: the acquisition adapter acquires data in a bottom layer data source through an internal wrapper and realizes loading of wrapper table data. The invention can realize simple, effective and rapid automatic query of multi-source heterogeneous data.
Description
Technical Field
The present invention belongs to the technical field of information processing, and in particular, to a data query method, apparatus and storage medium based on a data virtualization technology.
Background
With the continuous and deep development of informatization, the data generation speed is increasing, the data volume needing to be processed expands rapidly, and with the arrival of a big data era, the related data are mostly multi-source heterogeneous data, and the data have the characteristics of large gauge, diversified data sources and difference of data structures, so that the data are difficult to process in reasonable time.
With the increasing importance of data asset value, the collection and application of data assets are the key points of attention in various industries, and the typical data collection modes in the current industry are as follows:
data federation mode
Data federation techniques provide the ability to provide an abstract data interface for data, providing a unified data integration view from a data consumer (application) perspective, making it appear that the data logic exists in one location, but the actual physical location may be in multiple data sources.
In large modern enterprises, it is almost inevitable that departments within an organization use different database management systems to store and search their vital data. Such diversity is caused by factors such as competition, evolving technology, mergers, acquisitions, geographical distribution, and inevitable dispersion in expansion. But only by combining the information in these systems will the enterprise realize the overall value of the data contained in these systems. A federated database system provides a powerful tool for combining information from multiple data sources, created through the federation of multiple heterogeneous data sources. The user can freely inquire the data stored at any position in the federal system without worrying about the position of the data, the SQL language type of the actual data source system or the storage capability.
In the data acquisition mode, a data source system needs to be connected in real time, a large amount of calculation is involved, and the load pressure of a final database is large.
(II) memory reflection mechanism
The memory reflection mechanism is to utilize program monitoring in a running environment (runtime) to obtain the running state of a program, call and data interfaces, find a service interface and an output structure between an end and a cloud, further develop simulation of a data interface, and quickly realize data acquisition and interoperation among various systems.
This model requires a lot of simulation operations on the source system, and more, it is necessary to know the information items corresponding to each system function, and detailed information of the underlying database cannot be known.
(III) Web crawler
The web crawler is a program for automatically extracting web pages, the web pages are crawled through the established link URL addresses, web page information is extracted, new URLs are continuously extracted from the current web pages and put into a queue in the process of capturing the web pages until certain stop conditions of the system are met.
The mode is only suitable for the B/S system, and meanwhile, the difficulty of information analysis is high, and the structure of various web pages needs to be known.
The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The invention aims to provide a data query method, a data query device and a storage medium based on a data virtualization technology, which can realize automatic query of various data, effectively and quickly query data in each system and are beneficial to discovery and understanding of the data. The invention can help companies to quickly analyze the distribution condition of the data assets in each business system, know the composition of various data assets and various related characteristics, help users to know the related information of the data assets, and further help better data management and application.
In order to achieve the above object, the present invention provides a data query method based on data virtualization technology, which is applied in a data virtualization layer between an application layer and a source data layer; the method comprises the following steps:
s1: based on a query request of a user, a query engine determines a query processing strategy and performance optimization measures;
s2: inquiring whether a corresponding predefined virtual table exists in the data service layer, if so, performing step S3, if not, generating a corresponding temporary virtual table by the data service layer, and then performing step S3;
s3: the data mapping layer realizes the mapping of the virtual table to the bottom data source through the encapsulation table;
s4: the acquisition adapter acquires data in a bottom layer data source through an internal wrapper and realizes loading of wrapper table data.
In an embodiment of the present invention, in the step S1, the query processing policy is that the system gives an execution scheme and a flow according to an access manner of the user query request to the target data; the performance optimization measure is to optimize the query process after the system determines the data access mode.
In an embodiment of the present invention, in step S2, the generating, by the data service layer, the corresponding temporary virtual table includes: and the metadata organization layer organizes related metadata required by query according to metadata information stored in the system to generate a corresponding temporary virtual table.
In an embodiment of the present invention, in the step S4, the wrapper is configured to implement query and modification operations of the data, where the wrapper encapsulates all metadata information corresponding to the underlying data source.
In one embodiment of the present invention, the information encapsulated in the encapsulator includes: network location information where the source table server is located; connection information of the database; name, creation time, owner information of the source table; definition information of the structure and the column of the source table; available primary foreign key information; the line number information is recorded.
The invention also provides a data query device based on the data virtualization technology, which is used in a data virtualization layer between an application layer and a source data layer, and the data query device comprises: the system comprises a query module, a virtual table module, a mapping module and an acquisition adapter;
the query module is used for determining a query processing strategy and a performance optimization measure by a query engine based on a query request of a user;
the virtual table module is used for inquiring whether a corresponding predefined virtual table exists in the data service layer or not, and if not, the data service layer generates a corresponding temporary virtual table;
the mapping module is used for realizing the mapping of the virtual table to the bottom data source through the encapsulation table in the data mapping layer;
the acquisition adapter is used for acquiring data in a bottom layer data source through an internal wrapper and realizing loading of wrapper table data.
In an embodiment of the present invention, in the query module, the query processing policy is that the system provides an execution scheme and a flow according to an access manner of a user query request to target data; the performance optimization measure is to optimize the query process after the system determines the data access mode.
In an embodiment of the present invention, in the mapping module, the metadata organization layer in the mapping module needs to organize relevant metadata required for query according to metadata information stored in the system, so as to generate a corresponding temporary virtual table.
In an embodiment of the present invention, the encapsulator can implement query and change operations of data, wherein the encapsulator encapsulates all metadata information corresponding to an underlying data source.
The present invention also provides a storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the steps of the data query method based on the data virtualization technology.
Compared with the prior art, the data query method, the data query device and the storage medium based on the data virtualization technology have the following advantages that: (1) compared to the data federation mode: the data federation mode needs to be connected with a data source system in real time and comprises a large amount of calculation, and the load pressure of the final database is large; the system constructed by the method is connected with a data source system, a large amount of calculation is not included at a source system end, data extraction is mainly performed, data calculation is realized in a multi-source heterogeneous data intelligent acquisition system, and the load pressure of a final database is much smaller than that of a data federal mode; (2) compared with the memory reflection mechanism: the memory reflection mechanism is more capable of knowing information items corresponding to each system function and cannot know detailed information of bottom data; (3) compared with web crawlers: the web crawler is only suitable for the B/S system, and meanwhile, the difficulty of information analysis is high, and the structures of various web pages need to be known; the system built by the method of the invention can collect various relational databases and NoSql databases, can also collect WebService, Word documents, spreadsheets and JSON format files, collects and packages different types of data sources into different collection adapters, and is called uniformly by a uniform adapter interface, so that the system is simpler and more convenient than a web crawler in the use level.
Drawings
FIG. 1 is a flow diagram of a data query method based on data virtualization technology according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a data query device based on a data virtualization technology according to an embodiment of the present invention.
Detailed Description
The following detailed description of the present invention is provided in conjunction with the accompanying drawings, but it should be understood that the scope of the present invention is not limited to the specific embodiments.
Throughout the specification and claims, unless explicitly stated otherwise, the word "comprise", or variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated element or component but not the exclusion of any other element or component.
In the invention, the query of the multi-source heterogeneous data is connected with the data of the bottom layer data source under the guidance of a data virtualization technology, so that the query and the change operation of the multi-source heterogeneous data can be carried out like a common database table.
As shown in fig. 1, a data query method based on data virtualization technology according to a preferred embodiment of the present invention is applied to a data virtualization layer between an application layer and a source data layer, provides an interface for querying data, and further provides a complete query engine, which relates to the data virtualization layer and the source data layer, wherein the data virtualization layer specifically includes a query corresponding layer, a data service layer, a metadata organizational layer and a data mapping layer.
The method specifically comprises the following steps:
s1: based on a user's query request, the query engine determines a query processing policy and performance optimization measures.
The determined query processing strategy is that the system gives an execution scheme and a flow according to the access mode of the user query request to the target data; the performance optimization measure is to optimize the query process after the system determines the data access mode so as to improve the query efficiency.
A variety of query processing strategies and performance optimization measures may be pre-deployed for optimizing queries entered by data consumers.
S2: the data service layer is inquired whether a corresponding predefined virtual table exists, if so, the step S3 is performed, if not, the data service layer generates a corresponding temporary virtual table, and then the step S3 is performed.
Specifically, when the data service layer does not predefine the virtual table corresponding to the query, the metadata organization layer needs to organize the relevant metadata required by the query according to the metadata information stored in the system, and generate the corresponding temporary virtual table.
The definition of the virtual table is established on an encapsulation table or other virtual tables, the virtual tables can be combined and nested, and the virtual table can be released as a data service after being defined.
S3: and the data mapping layer realizes the mapping of the virtual table to the bottom data source through the encapsulation table. Its purpose is to access the underlying data sources in the source data layer.
The encapsulation table is positioned in the data service layer, is generated after data in the bottom layer data source is imported, and can store the data in the bottom layer data source.
S4: the acquisition adapter acquires data in a bottom layer data source through an internal wrapper and realizes loading of wrapper table data.
The connection with a bottom layer data source (namely, external data resources of the system) is realized through the acquisition adapter, and related multi-source heterogeneous data is read and analyzed according to different data types of the external data source.
Specifically, a wrapper inside the acquisition adapter is used to implement query and change operations of the data, where the wrapper encapsulates all metadata information corresponding to the underlying data source, which is then stored in a metadata dictionary of the virtualization server. After establishing a connection with the source table, the encapsulator has generated, which can do query and change operations as well as the normal database table.
Wherein, the encapsulator includes information corresponding to a bottom layer data source in the source data layer, including: 1. network location information where the source table server is located; 2. connection information of the database (database driver, URL, user name, password, etc.); 3. name, creation time, owner information of the source table; 4. definition information of the structure and column of the source table (data type, whether primary key is available, whether null is available, etc.); 5. available primary foreign key information; 6. the line number information is recorded.
The encapsulator contains all the contents of the source tables, and the encapsulator and the corresponding source tables have a one-to-one correspondence relationship, so that all the information is unnecessary corresponding to data consumers, different scenes may need different rows and columns, a large table which needs a plurality of tables connected together may exist, and the data virtualization server meets the requirements by creating virtual tables on the encapsulator. Defining a virtual table means defining a mapping relation that defines the structure and how the contents of a virtual table are transformed into the contents of the virtual table. The definition of the mapping relationship may also be referred to as a definition process of the virtual table. The concept of a virtual table is very similar to that of a view in a common relational database. The change of the data of the source table can be realized by the adding, deleting, changing and checking operation of the virtual table.
Based on the same inventive concept, as shown in fig. 2, an embodiment further provides a data query apparatus based on a data virtualization technology, which is used in a data virtualization layer between an application layer and a source data layer, and provides an interface for querying data and a complete query engine. The data virtualization layer specifically comprises a query corresponding layer, a data service layer, a metadata organizational layer and a data mapping layer.
The data query device comprises a query module 1, a virtual table module 2, a mapping module 3 and a collection adapter 4.
And the query module 1 is used for determining a query processing strategy and a performance optimization measure by a query engine based on a query request of a user.
The determined query processing strategy is that the system gives an execution scheme and a flow according to the access mode of the user query request to the target data; the performance optimization measure is to optimize the query process after the system determines the data access mode so as to improve the query efficiency.
Various query processing strategies and performance optimization measures may be deployed for optimizing queries entered by data consumers.
The virtual table module 2 is configured to query whether a corresponding predefined virtual table exists in the data service layer, and if not, the data service layer generates a corresponding temporary virtual table.
Specifically, when the data service layer does not predefine the virtual table corresponding to the query, the metadata organization layer needs to organize the relevant metadata required by the query according to the metadata information stored in the system, and generate the corresponding temporary virtual table.
And the mapping module 3 is used for realizing the mapping of the virtual table to the bottom data source through the encapsulation table in the data mapping layer. Its purpose is to access the underlying data sources in the source data layer.
The encapsulation table is positioned in the data service layer, is generated after data in the bottom layer data source is imported, and can store the data in the bottom layer data source.
And the acquisition adapter 4 is used for acquiring data in a bottom layer data source through an internal wrapper and realizing loading of wrapper table data.
In the invention, the connection with a bottom layer data source (namely, a system external data resource) is realized through the acquisition adapter 4, and related multi-source heterogeneous data is read and analyzed according to the difference of the data types of the external data source.
In particular, the encapsulator inside the acquisition adapter 4 is used to implement query and change operations of the data. The encapsulator encapsulates all metadata information corresponding to the underlying data sources, which is then stored in a metadata dictionary of the virtualization server. After establishing a connection with the source table, the encapsulator has generated, which can do query and change operations as well as the normal database table.
Wherein, the encapsulator includes information corresponding to a bottom layer data source in the source data layer, including: 1. network location information where the source table server is located; 2. connection information of the database (database driver, URL, user name, password, etc.); 3. name, creation time, owner information of the source table; 4. definition information of the structure and column of the source table (data type, whether primary key is available, whether null is available, etc.); 5. available primary foreign key information; 6. the line number information is recorded.
The encapsulator contains all the contents of the source tables, and the encapsulator and the corresponding source tables have a one-to-one correspondence relationship, so that all the information is unnecessary corresponding to data consumers, different scenes may need different rows and columns, a large table which needs a plurality of tables connected together may exist, and the data virtualization server meets the requirements by creating virtual tables on the encapsulator. Defining a virtual table means defining a mapping relation that defines the structure and how the contents of a virtual table are transformed into the contents of the virtual table. The definition of the mapping relationship may also be referred to as a definition process of the virtual table. The concept of a virtual table is very similar to that of a view in a common relational database. The change of the data of the source table can be realized by the adding, deleting, changing and checking operation of the virtual table.
Based on the same inventive concept, an embodiment also provides a non-transitory computer readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the data query method based on the data virtualization technology according to the above embodiment.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description. It is not intended to limit the invention to the precise form disclosed, and obviously many modifications and variations are possible in light of the above teaching. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and its practical application to enable one skilled in the art to make and use various exemplary embodiments of the invention and various alternatives and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims and their equivalents.
Claims (10)
1. A data query method based on data virtualization technology is applied to a data virtualization layer between an application layer and a source data layer, and is characterized by comprising the following steps:
s1: based on a query request of a user, a query engine determines a query processing strategy and performance optimization measures;
s2: inquiring whether a corresponding predefined virtual table exists in the data service layer, if so, performing step S3, if not, generating a corresponding temporary virtual table by the data service layer, and then performing step S3;
s3: the data mapping layer realizes the mapping of the virtual table to the bottom data source through the encapsulation table;
s4: the acquisition adapter acquires data in a bottom layer data source through an internal wrapper and realizes loading of wrapper table data.
2. The data query method based on data virtualization technology as claimed in claim 1, wherein in step S1, the query processing policy is that the system gives an execution scheme and a flow according to the access mode of the user query request to the target data; the performance optimization measure is to optimize the query process after the system determines the data access mode.
3. The data query method based on data virtualization technology as claimed in claim 1, wherein in step S2, the data service layer generating the corresponding temporary virtual table includes: and the metadata organization layer organizes related metadata required by query according to metadata information stored in the system to generate a corresponding temporary virtual table.
4. The data query method based on data virtualization technology as claimed in claim 1, wherein in step S4, the wrapper is used to implement query and change operations of the data, wherein the wrapper encapsulates all metadata information corresponding to the underlying data source.
5. The data query method based on the data virtualization technology as claimed in claim 4, wherein the information encapsulated in the encapsulator includes: network location information where the source table server is located; connection information of the database; name, creation time, owner information of the source table; definition information of the structure and the column of the source table; available primary foreign key information; the line number information is recorded.
6. A data query apparatus based on data virtualization technology, which is used in a data virtualization layer between an application layer and a source data layer, the data query apparatus comprising: the system comprises a query module, a virtual table module, a mapping module and an acquisition adapter;
the query module is used for determining a query processing strategy and a performance optimization measure by a query engine based on a query request of a user;
the virtual table module is used for inquiring whether a corresponding predefined virtual table exists in the data service layer or not, and if not, the data service layer generates a corresponding temporary virtual table;
the mapping module is used for realizing the mapping of the virtual table to the bottom data source through the encapsulation table in the data mapping layer;
the acquisition adapter is used for acquiring data in a bottom layer data source through an internal wrapper and realizing loading of wrapper table data.
7. The data query device based on the data virtualization technology as claimed in claim 6, wherein in the query module, the query processing policy is to give an execution scheme and a flow for an access mode to the target data according to the user query request; the performance optimization measures can optimize the query process after determining the data access mode.
8. The data query device based on data virtualization technology as claimed in claim 6, wherein in the mapping module, the metadata organization layer needs to organize related metadata required by the query according to metadata information stored in the system, and generate a corresponding temporary virtual table.
9. The data query device based on data virtualization technology as claimed in claim 6, wherein the wrapper is capable of implementing query and change operations of data, wherein the wrapper encapsulates all metadata information corresponding to an underlying data source.
10. A storage medium having a computer program stored thereon, wherein the computer program, when being executed by a processor, implements the steps of the data query method based on the data virtualization technique according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111406126.5A CN114064707A (en) | 2021-11-24 | 2021-11-24 | Data query method and device for data virtualization server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111406126.5A CN114064707A (en) | 2021-11-24 | 2021-11-24 | Data query method and device for data virtualization server and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114064707A true CN114064707A (en) | 2022-02-18 |
Family
ID=80276714
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111406126.5A Pending CN114064707A (en) | 2021-11-24 | 2021-11-24 | Data query method and device for data virtualization server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114064707A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116401146A (en) * | 2023-01-16 | 2023-07-07 | 宁德时代(上海)智能科技有限公司 | Data interaction method and device, storage medium, server and vehicle |
-
2021
- 2021-11-24 CN CN202111406126.5A patent/CN114064707A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116401146A (en) * | 2023-01-16 | 2023-07-07 | 宁德时代(上海)智能科技有限公司 | Data interaction method and device, storage medium, server and vehicle |
| CN116401146B (en) * | 2023-01-16 | 2023-12-22 | 宁德时代(上海)智能科技有限公司 | Data interaction method and device, storage medium, server and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10725981B1 (en) | Analyzing big data | |
| US10585913B2 (en) | Apparatus and method for distributed query processing utilizing dynamically generated in-memory term maps | |
| JP6032467B2 (en) | Spatio-temporal data management system, spatio-temporal data management method, and program thereof | |
| US9747127B1 (en) | Worldwide distributed job and tasks computational model | |
| US9361320B1 (en) | Modeling big data | |
| KR101365464B1 (en) | Data management system and method using database middleware | |
| CN102270225B (en) | Data change daily record method for supervising and data change daily record supervising device | |
| US8862566B2 (en) | Systems and methods for intelligent parallel searching | |
| CN104516979A (en) | Data query method and data query system based on quadratic search | |
| CN103440288A (en) | Big data storage method and device | |
| CN104239377A (en) | Platform-crossing data retrieval method and device | |
| CN104182405A (en) | Method and device for connection query | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| Bakli et al. | HadoopTrajectory: a Hadoop spatiotemporal data processing extension | |
| CN105095247A (en) | Symbolic data analysis method and system | |
| CN104268298A (en) | Method for creating database index and inquiring data | |
| CN103092997A (en) | Linkage query system and linkage query method used for statement analysis | |
| Bakli et al. | A spatiotemporal algebra in Hadoop for moving objects | |
| CN105069101A (en) | Distributed index construction and search method | |
| CN114064707A (en) | Data query method and device for data virtualization server and storage medium | |
| CN113918605A (en) | Data query method, device, equipment and computer storage medium | |
| US11354313B2 (en) | Transforming a user-defined table function to a derived table in a database management system | |
| Masouleh et al. | Optimization of ETL process in data warehouse through a combination of parallelization and shared cache memory | |
| JP2011216029A (en) | Distributed memory database system, database server, data processing method, and program thereof | |
| CN113297252A (en) | Data query service method with mode being unaware |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |