CN110851495A - Heterogeneous source data processing method and device, storage medium and electronic equipment - Google Patents
Heterogeneous source data processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110851495A CN110851495A CN201911019822.3A CN201911019822A CN110851495A CN 110851495 A CN110851495 A CN 110851495A CN 201911019822 A CN201911019822 A CN 201911019822A CN 110851495 A CN110851495 A CN 110851495A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- original data
- query
- data file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Probability & Statistics with Applications (AREA)
- Mathematical Physics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Fuzzy Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the disclosure relates to a heterogeneous source data processing method and device, a computer readable storage medium and electronic equipment. The method comprises the following steps: acquiring original data files of various heterogeneous systems; analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file; and responding to the first query operation to acquire the data of the corresponding query from the standard data file and statistically analyzing the queried data. The embodiment of the disclosure can uniformly process the heterogeneous source data, so that the heterogeneous source data can be more conveniently integrated, uniform management of heterogeneous source data resources is realized, and time and labor cost are saved. The method can be used for carrying out query analysis on heterogeneous source data from multiple dimensions, can be directly used for statistics and analysis mining, and is more flexible to use.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of data processing, and in particular, to a heterogeneous source data processing method, a heterogeneous source data processing apparatus, a computer-readable storage medium for implementing the heterogeneous source data processing method, and an electronic device.
Background
With the development of big data related technology, more and more people pay attention to the huge economic value hidden under big data. Various heterogeneous data sources are urgently needed to be integrated, and the integrated data sources are provided for people engaged in big data analysis work, so that the data are analyzed and mined, and the greater value of the data is created.
However, the processing standards of the data of the various heterogeneous data sources are not uniform at present, which brings great difficulty and challenge to the integration work of the heterogeneous data sources.
Accordingly, there is a need to ameliorate one or more of the problems with the related art solutions described above.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the embodiments of the present disclosure is to provide a heterogeneous source data processing method, apparatus, computer-readable storage medium, and electronic device, thereby overcoming, at least to some extent, one or more of the problems due to the limitations and disadvantages of the related art.
According to a first aspect of the embodiments of the present disclosure, there is provided a heterogeneous source data processing method, including:
acquiring original data files of various heterogeneous systems;
analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file;
and responding to the first query operation to acquire the data of the corresponding query from the standard data file and statistically analyzing the queried data.
In an exemplary embodiment of the present disclosure, the method further comprises:
and when the original data file is analyzed and processed according to the preset business logic association rule, determining the business meaning of the original data stored in the standard data file according to the preset data description template.
In an exemplary embodiment of the present disclosure, the step of obtaining an original data file of each heterogeneous system includes:
responding a preset operation to display a query page, wherein the query page is used for indicating to query original data;
receiving a second query operation input on the query page, and displaying the obtained original data file in response to the second query operation; wherein the original data file comprises one or more of a file name, a file type, an upload time, a file source, and upload person information.
In an exemplary embodiment of the present disclosure, the method further comprises:
when the original data in the original data file is associated and stored according to a preset storage format to form a standard data file, the data storage process is completed at least through adding, deleting, dragging and dropping or storing operations.
In an exemplary embodiment of the present disclosure, the preset business logic association rule includes sub business logic association rules associated correspondingly with file types of different original data files; correspondingly, the step of analyzing and processing the original data file according to the preset business logic association rule comprises the following steps:
determining the file type of the original data file;
when the file type is determined to be a first type, processing the data of the original data file through a first sub-business logic association rule; the first sub-business logic association rule comprises business logic association rules of variables in data columns in the original data files and variables in the metadata system;
and when the file type is determined to be a second type, processing the data of the original data file through a second sub-business logic association rule, wherein the second sub-business logic association rule comprises a business logic association rule of variables in the table expression of the original data file and variables in the metadata system.
In an exemplary embodiment of the present disclosure, the first type is a CSV file type, and the second type is a report file type; and/or the standard data file comprises key data column identification used for identifying and distinguishing the key data columns.
In an exemplary embodiment of the present disclosure, the step of obtaining data of a corresponding query from the standard data file in response to a first query operation includes:
and acquiring a query result, wherein the query result comprises a task ID, a source file name, a description state, a file description starting time or a file description ending time.
According to a second aspect of the embodiments of the present disclosure, there is provided a heterogeneous source data processing apparatus, including:
the data acquisition module is used for acquiring original data files of various heterogeneous systems;
the data processing module is used for analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file;
and the data query module is used for responding to the first query operation to acquire the data corresponding to the query from the standard data file and statistically analyzing the queried data.
According to a third aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of the heterogeneous source data processing method described in any one of the above embodiments.
According to a fourth aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the steps of the heterogeneous source data processing method in any of the above embodiments via execution of the executable instructions.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the embodiment of the disclosure, by the method and the device for processing the heterogeneous source data, on one hand, the heterogeneous source data is uniformly processed, so that the heterogeneous source data can be more conveniently integrated, the uniform management of heterogeneous source data resources is realized, the security and the interpretability of original data in the process of integrating the heterogeneous source data resources are ensured, and the time and the labor cost are saved. On the other hand, the method can be used for carrying out query analysis on heterogeneous source data from multiple dimensions or multiple angles, can be directly used for statistics and analysis mining, and is more flexible to use.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
FIG. 1 illustrates a flow chart of a method for heterogeneous source data processing in an exemplary embodiment of the present disclosure;
FIG. 2 shows a schematic diagram of a heterogeneous source data processing apparatus in an exemplary embodiment of the present disclosure;
FIG. 3 illustrates a computer-readable storage medium in an exemplary embodiment of the disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In this example embodiment, a method for processing data of heterogeneous sources is first provided, and as shown in fig. 1, the method may include:
s101, acquiring original data files of various heterogeneous systems;
s102, analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file;
s103, responding to the first query operation, obtaining the data of the corresponding query from the standard data file, and statistically analyzing the queried data.
By the heterogeneous source data processing method, on one hand, heterogeneous source data are processed in a unified mode, so that the heterogeneous source data can be integrated more conveniently, unified management of heterogeneous source data resources is achieved, safety and interpretability of original data in the process of integrating the heterogeneous source data resources are guaranteed, and time and labor cost are saved. On the other hand, the method can be used for carrying out query analysis on heterogeneous source data from multiple dimensions or multiple angles, can be directly used for statistics and analysis mining, and is more flexible to use.
In an exemplary embodiment of the present disclosure, the method may further include: and when the original data file is analyzed and processed according to the preset business logic association rule, determining the business meaning of the original data stored in the standard data file according to the preset data description template. After the user analyzes and processes the heterogeneous source data, the processing result of the file can be saved as a template and used as a preset data description template for next data processing, so that the cost of processing repeated data is saved. In addition, template management functions can be constructed, such as deleting and modifying corresponding data description templates, which are not limited to the above, and the use is more flexible.
In an exemplary embodiment of the present disclosure, the step of obtaining the original data file of each heterogeneous system may include: responding a preset operation to display a query page, wherein the query page is used for indicating to query original data; receiving a second query operation input on the query page, and displaying the obtained original data file in response to the second query operation; wherein the original data file comprises one or more of a file name, a file type, an upload time, a file source, and upload person information. The basic information of the original data can be conveniently inquired in an inquiry page or by carrying out second inquiry operation, and data files in various formats can be previewed, such as files in formats of CsPro, Csv, Excel and the like, without limitation, a plurality of file records can be selected for subsequent data processing.
In addition, after the original data is inquired, the user can select a plurality of files in the term to delete the files and delete the file information. Optionally, after the deletion operation is performed, a restore operation may be performed to restore the deleted file.
Further, optionally, in an embodiment, the method may further include: when the original data in the original data file is associated and stored according to a preset storage format to form a standard data file, the data storage process is completed at least through adding, deleting, dragging and dropping or storing operations. And performing new adding, deleting, drag-and-drop or saving operation on the data to be stored according to actual needs to obtain a data file required by a user.
Further, optionally, in an embodiment, the preset service logic association rule includes a sub-service logic association rule associated with a file type of a different original data file; correspondingly, the step of analyzing and processing the original data file according to the preset business logic association rule comprises the following steps:
determining the file type of the original data file;
when the file type is determined to be a first type, processing the data of the original data file through a first sub-business logic association rule; the first sub-business logic association rule comprises business logic association rules of variables in data columns in the original data files and variables in the metadata system;
and when the file type is determined to be a second type, processing the data of the original data file through a second sub-business logic association rule, wherein the second sub-business logic association rule comprises a business logic association rule of variables in the table expression of the original data file and variables in the metadata system.
And when the original data files with different file types are analyzed and processed, the corresponding associated sub-business logic association rule is adopted to finally generate a standard data file and complete the processing of the heterogeneous source data file.
Further, optionally, in an embodiment, the first type may be a CSV file type, and the second type may be a report file type; and/or the standard data file can comprise key data column identification for identifying and distinguishing key data columns.
When the original data file is a CSV file, the user may directly establish the business logic association rule of the variables in the data column in the original data file and the variables in the metadata system. When the original data file is a report file, firstly, a business logic association rule of variables in a table and variables in a metadata system is established, and then a business logic association rule of variables in a data column in the original data file and variables in the metadata system is established. The data processing is completed in the above mode, and a standard data file is generated.
The standard data file may include a key data column identifier for identifying and distinguishing key data columns to distinguish key column information of different records, for example, the key data list formula may have functions of checking and marking key data columns of the data file, which facilitates subsequent data query and analysis.
Further, optionally, in an embodiment, the step of obtaining data of a corresponding query from the standard data file in response to the first query operation may include: and acquiring a query result, wherein the query result comprises a task ID, a source file name, a description state, a file description starting time or a file description ending time. The data processing state information of the original data file can be inquired in real time, so that a user can better know and control the data processing process.
It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc. Additionally, it will also be readily appreciated that the steps may be performed synchronously or asynchronously, e.g., among multiple modules/processes/threads.
Further, the present exemplary embodiment secondly provides a heterogeneous source data processing apparatus 100, as shown in fig. 2, the apparatus may include: the data acquisition module 101 is configured to acquire original data files of various heterogeneous systems; the data processing module 102 is configured to analyze and process the original data file according to a preset service logic association rule, so as to associate and store original data in the original data file according to a preset storage format to form a standard data file; and the data query module 103 is used for responding to the first query operation to obtain the data of the corresponding query from the standard data file and statistically analyzing the queried data.
Through the heterogeneous source data processing device, on one hand, heterogeneous source data are uniformly processed, so that the heterogeneous source data can be more conveniently integrated, the uniform management of heterogeneous source data resources is realized, the safety and the interpretability of original data in the process of integrating the heterogeneous source data resources are ensured, and the time and the labor cost are saved. On the other hand, the method can be used for carrying out query analysis on heterogeneous source data from multiple dimensions or multiple angles, can be directly used for statistics and analysis mining, and is more flexible to use.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units. The components shown as modules or units may or may not be physical units, i.e. may be located in one place or may also be distributed over a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood-disclosed scheme. One of ordinary skill in the art can understand and implement it without inventive effort.
Also provided in this example embodiment is a computer readable storage medium 200, as shown in fig. 3, on which a computer program is stored, which when executed by a processor implements the steps of the heterogeneous source data processing method in any of the above embodiments.
Through the computer readable storage medium for processing the heterogeneous source data, on one hand, the heterogeneous source data is uniformly processed, so that the heterogeneous source data can be more conveniently integrated, the uniform management of heterogeneous source data resources is realized, the safety and the interpretability of original data in the process of integrating the heterogeneous source data resources are ensured, and the time and the labor cost are saved. On the other hand, the method can be used for carrying out query analysis on heterogeneous source data from multiple dimensions or multiple angles, can be directly used for statistics and analysis mining, and is more flexible to use.
In an example, the program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
There is also provided in this example embodiment an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the steps of the heterogeneous source data processing method in any of the above embodiments via execution of the executable instructions.
Through the electronic device in the exemplary embodiment, on one hand, heterogeneous source data is uniformly processed, so that the heterogeneous source data can be more conveniently integrated, uniform management of heterogeneous source data resources is realized, the security and easy interpretability in the process of integrating the heterogeneous source data resources are ensured, and time and labor cost are saved. On the other hand, heterogeneous source data can be queried and analyzed from multiple dimensions and multiple angles (such as time sequences, subjects, regions, industries and the like), and the method can be directly used for statistics, analysis and mining and is more flexible to use. The openness, maintainability, scalability and high availability of the heterogeneous data resource integration process are ensured. The difficulty of understanding and operating data by statistical business personnel is reduced, more statistical business personnel are allowed to flexibly integrate any data in each data warehouse according to working requirements, and guarantee is provided for deeper and more comprehensive development of statistical data analysis and utilization.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, or a network device, etc.) to execute the above-mentioned heterogeneous source data processing method according to the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
Claims (10)
1. A heterogeneous source data processing method is characterized by comprising the following steps:
acquiring original data files of various heterogeneous systems;
analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file;
and responding to the first query operation to acquire the data of the corresponding query from the standard data file and statistically analyzing the queried data.
2. The data processing method of claim 1, further comprising:
and when the original data file is analyzed and processed according to the preset business logic association rule, determining the business meaning of the original data stored in the standard data file according to the preset data description template.
3. The data processing method of claim 1, wherein the step of obtaining the raw data file of each heterogeneous system comprises:
responding a preset operation to display a query page, wherein the query page is used for indicating to query original data;
receiving a second query operation input on the query page, and displaying the obtained original data file in response to the second query operation; wherein the original data file comprises one or more of a file name, a file type, an upload time, a file source, and upload person information.
4. The data processing method of claim 1, further comprising:
when the original data in the original data file is associated and stored according to a preset storage format to form a standard data file, the data storage process is completed at least through adding, deleting, dragging and dropping or storing operations.
5. The data processing method according to claim 1, wherein the preset business logic association rule comprises sub business logic association rules associated correspondingly with file types of different original data files; correspondingly, the step of analyzing and processing the original data file according to the preset business logic association rule comprises the following steps:
determining the file type of the original data file;
when the file type is determined to be a first type, processing the data of the original data file through a first sub-business logic association rule; the first sub-business logic association rule comprises business logic association rules of variables in data columns in the original data files and variables in the metadata system;
and when the file type is determined to be a second type, processing the data of the original data file through a second sub-business logic association rule, wherein the second sub-business logic association rule comprises a business logic association rule of variables in the table expression of the original data file and variables in the metadata system.
6. The data processing method of claim 5, wherein the first type is a CSV file type and the second type is a report file type; and/or the standard data file comprises key data column identification used for identifying and distinguishing the key data columns.
7. The data processing method of claim 1, wherein the step of obtaining data of the corresponding query from the standard data file in response to the first query operation comprises:
and acquiring a query result, wherein the query result comprises a task ID, a source file name, a description state, a file description starting time or a file description ending time.
8. A heterogeneous source data processing apparatus, the apparatus comprising:
the data acquisition module is used for acquiring original data files of various heterogeneous systems;
the data processing module is used for analyzing and processing the original data file according to a preset business logic association rule so as to associate and store the original data in the original data file according to a preset storage format to form a standard data file;
and the data query module is used for responding to the first query operation to acquire the data corresponding to the query from the standard data file and statistically analyzing the queried data.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for processing data of a heterogeneous source according to any one of claims 1 to 7.
10. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the steps of the heterogeneous source data processing method of any one of claims 1 to 7 via execution of the executable instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911019822.3A CN110851495A (en) | 2019-10-24 | 2019-10-24 | Heterogeneous source data processing method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911019822.3A CN110851495A (en) | 2019-10-24 | 2019-10-24 | Heterogeneous source data processing method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110851495A true CN110851495A (en) | 2020-02-28 |
Family
ID=69597206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911019822.3A Pending CN110851495A (en) | 2019-10-24 | 2019-10-24 | Heterogeneous source data processing method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110851495A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111427913A (en) * | 2020-03-19 | 2020-07-17 | 嘉兴太美医疗科技有限公司 | Data processing method, device, server, system and computer readable medium |
| CN111444276A (en) * | 2020-03-30 | 2020-07-24 | 北京锦鸿希电信息技术股份有限公司 | Data processing method, device and equipment |
| CN112231380A (en) * | 2020-10-20 | 2021-01-15 | 长城计算机软件与系统有限公司 | Method and system for comprehensively processing acquired data, storage medium and electronic equipment |
| CN112256682A (en) * | 2020-10-22 | 2021-01-22 | 佳都新太科技股份有限公司 | Data quality detection method and device for multi-dimensional heterogeneous data |
| CN112492000A (en) * | 2020-11-18 | 2021-03-12 | 中盈优创资讯科技有限公司 | Method and device for loading Internet of things access network rules |
| CN112966015A (en) * | 2021-02-01 | 2021-06-15 | 杭州博联智能科技股份有限公司 | Big data analysis processing and storage method, device, equipment and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101694665A (en) * | 2009-10-27 | 2010-04-14 | 中兴通讯股份有限公司 | Method and device for data query of heterogeneous data source |
| CN102571720A (en) * | 2010-12-27 | 2012-07-11 | 中国移动通信集团辽宁有限公司 | Method and device for processing heterogeneous information contents |
| CN103092980A (en) * | 2013-01-31 | 2013-05-08 | 中国科学院自动化研究所 | Method and system of data automatic conversion and storage |
| CN107368588A (en) * | 2017-07-24 | 2017-11-21 | 人教数字出版有限公司 | A kind of heterogeneous resource Homogeneous method and device |
| CN107436872A (en) * | 2016-05-25 | 2017-12-05 | 阿里巴巴集团控股有限公司 | A kind of processing method and processing device of isomeric data |
| CN108399256A (en) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | Heterogeneous database content synchronization method, device and middleware |
-
2019
- 2019-10-24 CN CN201911019822.3A patent/CN110851495A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101694665A (en) * | 2009-10-27 | 2010-04-14 | 中兴通讯股份有限公司 | Method and device for data query of heterogeneous data source |
| CN102571720A (en) * | 2010-12-27 | 2012-07-11 | 中国移动通信集团辽宁有限公司 | Method and device for processing heterogeneous information contents |
| CN103092980A (en) * | 2013-01-31 | 2013-05-08 | 中国科学院自动化研究所 | Method and system of data automatic conversion and storage |
| CN107436872A (en) * | 2016-05-25 | 2017-12-05 | 阿里巴巴集团控股有限公司 | A kind of processing method and processing device of isomeric data |
| CN107368588A (en) * | 2017-07-24 | 2017-11-21 | 人教数字出版有限公司 | A kind of heterogeneous resource Homogeneous method and device |
| CN108399256A (en) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | Heterogeneous database content synchronization method, device and middleware |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111427913A (en) * | 2020-03-19 | 2020-07-17 | 嘉兴太美医疗科技有限公司 | Data processing method, device, server, system and computer readable medium |
| CN111427913B (en) * | 2020-03-19 | 2023-07-25 | 上海太美星云数字科技有限公司 | Data processing method, device, server, system and computer readable medium |
| CN111444276A (en) * | 2020-03-30 | 2020-07-24 | 北京锦鸿希电信息技术股份有限公司 | Data processing method, device and equipment |
| CN112231380A (en) * | 2020-10-20 | 2021-01-15 | 长城计算机软件与系统有限公司 | Method and system for comprehensively processing acquired data, storage medium and electronic equipment |
| CN112256682A (en) * | 2020-10-22 | 2021-01-22 | 佳都新太科技股份有限公司 | Data quality detection method and device for multi-dimensional heterogeneous data |
| CN112256682B (en) * | 2020-10-22 | 2022-09-20 | 佳都科技集团股份有限公司 | Data quality detection method and device for multi-dimensional heterogeneous data |
| CN112492000A (en) * | 2020-11-18 | 2021-03-12 | 中盈优创资讯科技有限公司 | Method and device for loading Internet of things access network rules |
| CN112966015A (en) * | 2021-02-01 | 2021-06-15 | 杭州博联智能科技股份有限公司 | Big data analysis processing and storage method, device, equipment and medium |
| CN112966015B (en) * | 2021-02-01 | 2023-08-15 | 杭州博联智能科技股份有限公司 | Big data analysis processing and storing method, device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110851495A (en) | Heterogeneous source data processing method and device, storage medium and electronic equipment | |
| CN108874926B (en) | Mass data query method, device, computer equipment and storage medium | |
| CN109739717B (en) | Page data acquisition method and device and server | |
| CN109062780B (en) | Development method of automatic test case and terminal equipment | |
| CN109344170B (en) | Stream data processing method, system, electronic device and readable storage medium | |
| CN109446274B (en) | Method and device for managing BI metadata of big data platform | |
| US9940380B2 (en) | Automatic modeling of column and pivot table layout tabular data | |
| CN108829716B (en) | Conference agenda generation method and device for conference to be held | |
| CN112711581A (en) | Medical data verification method and device, electronic equipment and storage medium | |
| CN111126019A (en) | Report generation method and device based on mode customization and electronic equipment | |
| CN110990445A (en) | Data processing method, device, equipment and medium | |
| CN113688288A (en) | Data association analysis method and device, computer equipment and storage medium | |
| CN111552521A (en) | Application data reporting method, device, server and storage medium | |
| CN113836237A (en) | Method and device for auditing data operation of database | |
| CN112084111A (en) | Data processing method, system and device | |
| CN109684207B (en) | Method and device for packaging operation sequence, electronic equipment and storage medium | |
| CN108628909B (en) | Information pushing method and device | |
| CN111435326A (en) | Method and device for analyzing crash logs | |
| CN115981643A (en) | Configuration method, system, equipment and storage medium of business association component | |
| CN113722007A (en) | Configuration method, device and system of VPN branch equipment | |
| CN111897518A (en) | Method, device, equipment and storage medium for automatically executing business | |
| CN111178014A (en) | Method and device for processing business process | |
| CN111107154B (en) | Data reporting method and device | |
| US20120233224A1 (en) | Data processing | |
| CN114254081B (en) | Enterprise big data search system, method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200228 |
|
| RJ01 | Rejection of invention patent application after publication |