CN112448971A - Data analysis platform, data analysis method and storage medium - Google Patents
Data analysis platform, data analysis method and storage medium Download PDFInfo
- Publication number
- CN112448971A CN112448971A CN201910809468.8A CN201910809468A CN112448971A CN 112448971 A CN112448971 A CN 112448971A CN 201910809468 A CN201910809468 A CN 201910809468A CN 112448971 A CN112448971 A CN 112448971A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis
- layer
- parsing
- rule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 68
- 238000000034 method Methods 0.000 title claims abstract description 36
- 238000004458 analytical method Methods 0.000 claims abstract description 85
- 230000005540 biological transmission Effects 0.000 claims abstract description 9
- 238000012795 verification Methods 0.000 claims description 11
- 238000000354 decomposition reaction Methods 0.000 claims description 4
- 230000001172 regenerating effect Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 10
- 238000011161 development Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000012800 visualization Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/561—Adding application-functional data or data for application control, e.g. adding metadata
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the invention provides a data analysis platform, and belongs to the field of data processing. The platform includes: the WEB front end is used for acquiring data to be analyzed and configuration metadata and transmitting the data to the micro service layer; the micro service layer comprises a plurality of micro service modules, is used for generating an analysis rule for the data to be analyzed according to the configuration metadata and can realize data transmission with the WEB front end and the data analysis layer; and the data analysis layer is used for executing analysis processing according to the analysis rule and the data to be analyzed and transmitting the processed data to the micro service layer or the database. Meanwhile, a corresponding data analysis method is also provided. The embodiment of the invention aims to provide a data analysis platform and a data analysis method, which at least solve the problems of complicated coding, poor universality, non-standard analysis and the like in the existing data analysis configuration.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a data parsing platform, a data parsing method, and a corresponding storage medium.
Background
Data for industrial equipment exists in a variety of formats, with correspondingly different resolution protocols. How to ensure the standardized operation of various data analyses is always a pain point, and becomes a problem to be mainly solved by each internet of things platform. The technical means of the processing technical scheme in the prior art are as follows:
messages communicated by the devices are in a standardized data parsing format, such as the json format. But this approach is not conducive to bandwidth-sensitive and security-sensitive scenarios.
The message transmitted by the equipment adopts customized binary stream data, but the format analysis is difficult to understand in the mode, the format analysis can be realized only by carrying out specific coding on each format by research personnel, the requirement on the development personnel is high, and the code is difficult to be reused.
Disclosure of Invention
An object of embodiments of the present invention is to provide a data parsing platform and method, so as to solve at least the problems of complicated coding, poor generality, and non-standard parsing in the existing data parsing configuration.
To achieve the above object, in a first aspect of the present invention, there is provided a data parsing platform, including:
the WEB front end is used for acquiring data to be analyzed and configuration metadata and transmitting the data to the micro service layer;
the micro service layer comprises a plurality of micro service modules, is used for generating an analysis rule for the data to be analyzed according to the configuration metadata and can realize data transmission with the WEB front end and the data analysis layer; and
and the data analysis layer is used for analyzing the data to be analyzed according to the analysis rule and transmitting the processed data to the micro service layer or the database.
Optionally, the micro service layer includes the following micro service modules:
the storage module is used for caching the data to be analyzed before the analysis rule is generated;
the analysis rule generating module is used for generating the analysis rule;
and the data transmission module is used for transmitting data with the WEB front end and the data analysis layer.
Optionally, the microservice layer further includes one or two of the following microservice modules:
the analysis rule verification module is used for verifying the analysis rule;
and the data deployment module is used for responding to the instruction of the user and deploying the analysis rule to the data analysis layer.
Optionally, the data analysis platform further includes a message queue layer;
the message queue layer is used for message caching between the micro service layer and the data analysis layer and message caching inside the micro service layer.
In a second aspect of the present invention, there is also provided a data parsing method, including:
performing data definition on single data to form metadata;
acquiring the configuration of the metadata by a user, and analyzing the configuration into configuration metadata;
and generating an analysis rule according to the configuration metadata, wherein the analysis rule is used for analyzing the data to be analyzed.
Optionally, the data definition comes from a decomposition of a data parsing protocol.
Optionally, the generating a parsing rule according to the configuration metadata includes:
and generating a JAR packet by using the configuration metadata, wherein the JAR packet is used for analyzing the data to be analyzed.
Optionally, after the generating the parsing rule, the data parsing method further includes:
verifying the analysis rule;
and if the verification fails, regenerating the analysis rule or generating error information.
Optionally, after the generating the parsing rule, the data parsing method further includes:
and deploying the analysis rule, wherein the deploying comprises distributing the analysis rule to an analysis execution module, and the analysis execution module is used for executing analysis of the data to be analyzed.
In a third aspect of the present invention, there is also provided a machine-readable storage medium having stored thereon instructions which, when executed by a controller, are capable of causing the controller to perform the aforementioned data parsing method.
According to the technical scheme, the data analysis platform and the data analysis method are provided, the development convenience is improved through the WEB front end and the micro-service architecture, and the problems that the existing data analysis configuration is complex in coding, poor in universality, non-standard in analysis and the like are solved.
Additional features and advantages of embodiments of the invention will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the embodiments of the invention without limiting the embodiments of the invention. In the drawings:
FIG. 1 is an architecture diagram of a data parsing platform provided by an embodiment of the invention;
FIG. 2 is an architecture diagram of a data parsing platform provided in accordance with an alternative embodiment of the present invention;
FIG. 3 is a flow chart of a data parsing method provided by an embodiment of the invention;
fig. 4 is a schematic diagram of a data parsing flow provided in an alternative embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention refers to the accompanying drawings. It should be understood that the detailed description and specific examples, while indicating the present invention, are given by way of illustration and explanation only, not limitation.
In the embodiments of the present invention, unless otherwise specified, the use of directional terms such as "upper, lower, top, and bottom" is generally used with respect to the orientation shown in the drawings or the positional relationship of the components with respect to each other in the vertical, or gravitational direction.
Fig. 1 is an architecture diagram of a data parsing platform according to an embodiment of the present invention, as shown in fig. 1, the platform includes:
the WEB front end is used for acquiring data to be analyzed and configuration metadata and transmitting the data to the micro service layer;
the micro service layer comprises a plurality of micro service modules, is used for generating an analysis rule for the data to be analyzed according to the configuration metadata and can realize data transmission with the WEB front end and the data analysis layer; and
and the data analysis layer is used for analyzing the data to be analyzed according to the analysis rule and transmitting the processed data to the micro service layer or the database.
Therefore, the structure of the whole data analysis platform is clear and the data interaction between the modules is simplified through the layered design of each function. And the data analysis protocol is divided into data definitions, and when the data is required to be analyzed, the required logic module is configured through the micro-service module to form an analysis rule, so that the data to be analyzed is analyzed. The flexibility and the transportability of the configuration of the analysis rule are improved by flexibly configuring the definition rule of the original data analysis protocol during splitting and use, so that the convenience of development is improved, and the problems of complicated coding, poor universality, irregular analysis and the like in the conventional data analysis configuration are solved.
Specifically, the core architecture of the platform comprises a WEB front end, a micro service layer and a data analysis layer. The WEB front end realizes dragging type visual application by using SVG, and the micro service layer configures the transmitted metadata through the WEB front end to configure the analysis rules of each type and stores the analysis rules in a database; and when the data needs to be analyzed, sending the message to a data analysis layer, finding the analysis rule of the data from the database according to the type of the data needing to be analyzed in the message, and analyzing the data.
The processing scenarios among the above functional modules are as follows:
WEB front-end processing scenario: configuring analysis rules of various types into a database through metadata; and transmitting the original data to be analyzed to the micro-service, analyzing the metadata by the micro-service by using the analysis rule configured in the first step, and returning the analyzed data to the WEB front end.
The micro service layer processes the scene: receiving metadata transmitted by a WEB front end, and storing analysis rules of various types; the original data transmitted by the WEB front end is sent to a data analysis layer; and storing the data analyzed by the data analysis layer in a database.
Data analysis layer processing scenario: and the data analysis layer analyzes the original data according to the analysis data configuration rule stored in the micro service layer, and the analyzed data is put into a database.
In one embodiment of the invention, the platform comprises a WEB front end, a micro service layer and a data analysis layer, wherein functions in the micro service layer are realized by adopting a plurality of independent micro service modules, and each independent micro service module has respective functions and is matched with other micro service modules. Specifically, the micro service module in this embodiment is configured as follows: the micro-service layer at least comprises the following micro-service modules:
the storage module is used for caching the data to be analyzed before the analysis rule is generated;
the analysis rule generating module is used for generating the analysis rule;
and the data transmission module is used for transmitting data with the WEB front end and the data analysis layer.
In an alternative embodiment of the present invention, the microservice layer may include, in addition to the modules described above, the following modules,
the analysis rule verification module is used for verifying the analysis rule;
and the data deployment module is used for responding to the instruction of the user and deploying the analysis rule to the data analysis layer.
In an actual scene, the micro service module can be rewritten as required, and a new micro service module can be added to expand the micro service module. The micro-service architecture is adopted to realize the functions of the micro-service layer, so that the functional requirements are met, and the platform is favorable for independent and rapid deployment and expansion.
FIG. 2 is an architecture diagram of a data parsing platform according to another alternative embodiment of the present invention, as shown in FIG. 2, in an alternative embodiment of the present invention, the platform further includes a message queue layer; the message queue layer is used for message caching between the micro service layer and the data analysis layer; and message caching inside the microservice layer.
The message transmission in the platform is not necessarily real-time, and may be delayed or need to be buffered, and in some applications, asynchronous processing of the message may be required. At this time, the messages in the platform need to be buffered, so a message queue layer is set. The message queue layer is used for message caching between the micro service layer and the data analysis layer; and message caching inside the microservice layer. The message queue layer is preferably arranged between the microservice layer and the data parsing layer, because the generation or arrival time between the data to be parsed and the parsing rule is difficult to be simultaneous, and there always exists a precedence order. When one of the data arrives first, the data needs to be cached, and the data needs to be analyzed by adopting an analysis rule after the data arrives at the cache and the cache. The message queue layer processing scene comprises the following steps: and the message transmission between the micro service layer and the message queue is realized.
Through the data analysis platform provided by the embodiment, the data can be quickly analyzed, and the data analysis platform can be used in various development environments and has better processing speed and applicability.
Fig. 3 is a flowchart of a data parsing method according to an embodiment of the present invention, as shown in fig. 3: in an embodiment provided by the present invention, a data parsing method is further provided, where the method includes:
performing data definition on single data to form metadata;
acquiring the configuration of the metadata by a user, and analyzing the configuration into configuration metadata;
generating an analysis rule according to the configuration metadata; the analysis rule is used for analyzing the data to be analyzed.
Specifically, the data parsing protocol is divided into data definitions, which are equivalent to metadata (i.e. data describing data), and packaged into configurable logic modules, so that the definitions of each data are independent and modularized. When data analysis is needed, the required logic modules are configured according to the actual analysis requirement, that is, the required logic modules are selected and combined. The specific logic modules to be selected are determined according to the data to be analyzed, and may include some independent logic modules, such as an algorithm module and a data length module. And then, according to the configured logic modules and the incidence relation thereof, an analysis rule is formed so as to realize the analysis of the data to be analyzed.
In a specific implementation, the configurable logic module is preferably a component; the components at least comprise data attributes and corresponding parsing methods. The configurable logic module is implemented through the components, and the configurable logic module has the advantages of being good in adaptability, simple in development and mature in technology. At present, research and development personnel design a data analysis protocol through a specification corresponding to data and realize the data analysis protocol by writing codes. The original data parsing protocol is decomposed into definitions of each data and packaged into components (which may be called parts or controls in different compiling environments). Each data definition is distinguished by a unique ID, there may be different definition rules for each data definition, and each definition rule may be abstracted into components. In implementation, the data is defined by using the attributes in the components, and the data analysis method is defined by using the method in the components. A specific data can be defined by a component, which is packaged independently of each other, and selected at the time of user configuration. Analysis rules can be obtained through combination of the components, and therefore analysis of the data to be analyzed is achieved. If the parsing that defines a data definition may define an algorithm component and a data length component, etc., these components may be separate for selection at the time of user configuration.
Furthermore, the assembly is a visualization assembly and is suitable for visualization development. The visual development is that the application software is automatically generated by the visual development tool through operating interface elements such as menus, buttons, dialog boxes, edit boxes, radio boxes, check boxes, list boxes, scroll bars and the like on a graphical user interface provided by the visual development tool. The following describes the present embodiment by taking various formats of the visualization component as an example, and taking an SVG format as an example.
SVG codes are added into the components, so that the components can be displayed as vector/grid graphs in a WEB front-end environment. And selecting and associating the components through a drag operation on the graph. The analysis rule configured by the user is obtained by acquiring and analyzing the configuration information (the selection information and the association information) of the component, so that the analysis of the data to be analyzed is realized. The implementation mode adopting the visual assembly not only has the advantages of universality and portability, but also can be intuitively configured by using a dragging type operation, so that the development difficulty is reduced, the understanding of operators is facilitated, and the technical background requirement of a user is reduced.
In the above embodiments of the logic module, the component or the visualization component, the rules of the data definition each include an algorithm definition, an output format, a bit definition, a data name, a byte length, a byte order, and the like of the data. Each data definition rule is capable of parsing matching data, where matching refers to a matching relationship between data and data definition that exists in terms of length, algorithm, or name.
In one embodiment of the invention, the data definition is from a decomposition of a data parsing protocol. In the prior art, data analysis is mostly completed through a data analysis protocol. The data analysis protocol comprises a definition and analysis method for data, and although the data analysis function can be completed, the data analysis protocol as a whole cannot be rewritten and flexibly configured, and only can meet specific requirements. Through the decomposition of the data analysis protocol and the multiplexing of the data definition, the development workload can be reduced, the stability of data analysis can be ensured, and the risk caused by self development is avoided.
In an embodiment of the present invention, the generating a parsing rule according to the configuration metadata includes:
and generating a JAR packet by using the configuration metadata, wherein the JAR packet is used for analyzing the data to be analyzed.
The specific mode is as follows: and acquiring the configured logic module and the association thereof, wherein the acquisition can be configured by a user and acquired through a front-end interface. As mentioned above, the logic module contains data definitions, which correspond to metadata (i.e., data describing the data). Such metadata is parsed from the logic modules and may be referred to as configuration metadata because it is relevant to user configuration. The parsed configuration metadata is saved and compiled into a class file, where the main advantage of the class file is platform independent, which provides a binary form of service independent of the underlying host platform. Packaging the class file into a JAR package; one or more class files can be packaged by using jar commands, and the technical details can be referred to the description of the jar commands. The configured metadata can be obtained by calling the JAR package.
In an embodiment provided by the present invention, after the generating the parsing rule, the method further includes: verifying the analysis rule; and if the verification fails, regenerating the analysis rule or generating error information. If the verification is passed, analyzing the data to be analyzed by adopting the analysis rule: the verification here includes normative verification and availability verification, which are specifically as follows:
here, the generated parsing rule is verified normatively, and the method may be selected according to an actual scenario, and mainly verifies whether the message format verified by the configuration metadata and the raw data is correct, and further, only verifies whether the format of the message header is correct.
The verification here is mainly to verify the availability of the generated parsing rule. And analyzing the original data (to-be-analyzed data) according to an analysis rule generated by the configuration metadata, and returning the analyzed data to the user. And if the user judges that the analysis result is correct, the user can prove that the analysis rule can work normally.
In an embodiment provided by the present invention, after the generating the parsing rule, the method further includes: deploying the parsing rule, namely: and distributing the analysis rule to an analysis execution module, wherein the analysis execution module is used for executing analysis of the data to be analyzed.
The analysis rule is deployed, the final deployment of the deployment is carried out on a data analysis layer or other data analysis devices, and the deployment process is effective in real time. The main effect of this step is to deploy the generated JAR package to the service for direct invocation by other services to avoid repeated generation.
Fig. 4 is an analysis flow in an example provided by the present invention, so as to provide an understanding of the embodiment of the present invention, which is not limited thereto. As shown in fig. 4, it includes the following steps:
firstly, analyzing metadata service sends a data analysis protocol to be deployed to a message queue and modifies the state into a JAR packet to be generated;
secondly, the data analysis prepositive service acquires the content of the data analysis protocol from the message alignment, generates a JAR packet, stores the JAR packet in a machine of the data analysis prepositive service, and sends the message to a message queue.
Analyzing the content of the message queue obtained by the metadata service, obtaining the result of generating the JAR packet, and modifying the deployment state to finish JAR generation.
And fourthly, the user debugs the data analysis protocol on line, sends the original data (namely the data to be analyzed) to the data analysis preposed service, and the data analysis preposed service returns the analysis result.
And fifthly, clicking and deploying after the online debugging of the user is finished, calling the data analysis preposed service by the user service to trigger a deployment process, deploying the JAR packet to the storm cluster, and returning a deployment state to the message queue after the deployment is finished.
Sixthly, analyzing the metadata service to obtain the content of the message queue, and modifying the state to be the completion of the deployment.
Embodiments of the present invention also provide a machine-readable storage medium, on which instructions are stored, which, when executed by a controller, can cause the controller to perform the aforementioned data parsing method.
In the technical scheme of the embodiment of the invention, the data analysis protocol is mainly divided into analysis metadata, so that the analysis metadata has certain independence and configurability, and the flexibility and the portability of data analysis are realized.
While the embodiments of the present invention have been described in detail with reference to the accompanying drawings, the embodiments of the present invention are not limited to the details of the above embodiments, and various simple modifications can be made to the technical solution of the embodiments of the present invention within the technical idea of the embodiments of the present invention, and the simple modifications are within the scope of the embodiments of the present invention.
It should be noted that the various features described in the above embodiments may be combined in any suitable manner without departing from the scope of the invention. In order to avoid unnecessary repetition, the embodiments of the present invention will not be described separately for the various possible combinations.
Those skilled in the art will appreciate that all or part of the steps in the method for implementing the above embodiments may be implemented by a program, which is stored in a storage medium and includes several instructions to enable a single chip, a chip, or a processor (processor) to execute all or part of the steps in the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In addition, any combination of the various embodiments of the present invention is also possible, and the same should be considered as disclosed in the embodiments of the present invention as long as it does not depart from the spirit of the embodiments of the present invention.
Claims (10)
1. A data parsing platform, said platform comprising:
the WEB front end is used for acquiring data to be analyzed and configuration metadata and transmitting the data to the micro service layer;
the micro service layer comprises a plurality of micro service modules, is used for generating an analysis rule for the data to be analyzed according to the configuration metadata and can realize data transmission with the WEB front end and the data analysis layer; and
and the data analysis layer is used for analyzing the data to be analyzed according to the analysis rule and transmitting the processed data to the micro service layer or the database.
2. The data parsing platform of claim 1 wherein the microservice layer comprises the following microservice modules:
the storage module is used for caching the data to be analyzed before the analysis rule is generated;
the analysis rule generating module is used for generating the analysis rule;
and the data transmission module is used for transmitting data with the WEB front end and the data analysis layer.
3. The data parsing platform of claim 2 wherein the microservice layer further comprises one or both of the following microservice modules:
the analysis rule verification module is used for verifying the analysis rule;
and the data deployment module is used for responding to the instruction of the user and deploying the analysis rule to the data analysis layer.
4. The data parsing platform of any one of claims 1 to 3 wherein the data parsing platform further comprises a message queue layer;
the message queue layer is used for message caching between the micro service layer and the data analysis layer and message caching inside the micro service layer.
5. A method for data parsing, the method comprising:
performing data definition on single data to form metadata;
acquiring the configuration of the metadata by a user, and analyzing the configuration into configuration metadata;
and generating an analysis rule according to the configuration metadata, wherein the analysis rule is used for analyzing the data to be analyzed.
6. The data parsing method of claim 5 wherein said data definition is from a decomposition of a data parsing protocol.
7. The data parsing method of claim 5, wherein the generating parsing rules according to the configuration metadata comprises:
and generating a JAR packet by using the configuration metadata, wherein the JAR packet is used for analyzing the data to be analyzed.
8. The data parsing method of claim 5, wherein after the generating of the parsing rule, the data parsing method further comprises:
verifying the analysis rule;
and if the verification fails, regenerating the analysis rule or generating error information.
9. The data parsing method of claim 5, wherein after the generating of the parsing rule, the data parsing method further comprises:
and deploying the analysis rule, wherein the deploying comprises distributing the analysis rule to an analysis execution module, and the analysis execution module is used for executing analysis of the data to be analyzed.
10. A machine-readable storage medium having stored thereon instructions which, when executed by a controller, are capable of causing the controller to perform the data parsing method of any one of claims 5 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910809468.8A CN112448971B (en) | 2019-08-29 | 2019-08-29 | Data analysis platform, data analysis method and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910809468.8A CN112448971B (en) | 2019-08-29 | 2019-08-29 | Data analysis platform, data analysis method and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112448971A true CN112448971A (en) | 2021-03-05 |
| CN112448971B CN112448971B (en) | 2024-01-23 |
Family
ID=74741302
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910809468.8A Active CN112448971B (en) | 2019-08-29 | 2019-08-29 | Data analysis platform, data analysis method and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112448971B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050022207A1 (en) * | 2003-07-25 | 2005-01-27 | International Business Machines Corporation | Methods and apparatus for creation of parsing rules |
| CN1735091A (en) * | 2004-08-12 | 2006-02-15 | 大唐移动通信设备有限公司 | Protocol message analytic method and protocol message analytic system |
| US20070044069A1 (en) * | 2005-08-19 | 2007-02-22 | Sybase, Inc. | Development System with Methodology Providing Optimized Message Parsing and Handling |
| US8868576B1 (en) * | 2012-06-28 | 2014-10-21 | Emc Corporation | Storing files in a parallel computing system based on user-specified parser function |
| CN104966239A (en) * | 2015-06-30 | 2015-10-07 | 天津爱蔻科技有限公司 | Intelligent underwriting platform based on rule engine |
| CN105893052A (en) * | 2016-04-20 | 2016-08-24 | 中国银行股份有限公司 | War packet analyzer |
| CN106506605A (en) * | 2016-10-14 | 2017-03-15 | 华南理工大学 | A kind of SaaS application construction methods based on micro services framework |
| CN106709368A (en) * | 2016-12-15 | 2017-05-24 | 天津交控科技有限公司 | Data analysis method and device |
| CN106941501A (en) * | 2017-04-26 | 2017-07-11 | 田潇河 | A kind of data communications method and device |
| CN107704265A (en) * | 2017-09-30 | 2018-02-16 | 电子科技大学 | A kind of configurable rule generating method of service-oriented stream |
| CN108108288A (en) * | 2018-01-09 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of daily record data analytic method, device and equipment |
-
2019
- 2019-08-29 CN CN201910809468.8A patent/CN112448971B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050022207A1 (en) * | 2003-07-25 | 2005-01-27 | International Business Machines Corporation | Methods and apparatus for creation of parsing rules |
| CN1735091A (en) * | 2004-08-12 | 2006-02-15 | 大唐移动通信设备有限公司 | Protocol message analytic method and protocol message analytic system |
| US20070044069A1 (en) * | 2005-08-19 | 2007-02-22 | Sybase, Inc. | Development System with Methodology Providing Optimized Message Parsing and Handling |
| US8868576B1 (en) * | 2012-06-28 | 2014-10-21 | Emc Corporation | Storing files in a parallel computing system based on user-specified parser function |
| CN104966239A (en) * | 2015-06-30 | 2015-10-07 | 天津爱蔻科技有限公司 | Intelligent underwriting platform based on rule engine |
| CN105893052A (en) * | 2016-04-20 | 2016-08-24 | 中国银行股份有限公司 | War packet analyzer |
| CN106506605A (en) * | 2016-10-14 | 2017-03-15 | 华南理工大学 | A kind of SaaS application construction methods based on micro services framework |
| CN106709368A (en) * | 2016-12-15 | 2017-05-24 | 天津交控科技有限公司 | Data analysis method and device |
| CN106941501A (en) * | 2017-04-26 | 2017-07-11 | 田潇河 | A kind of data communications method and device |
| CN107704265A (en) * | 2017-09-30 | 2018-02-16 | 电子科技大学 | A kind of configurable rule generating method of service-oriented stream |
| CN108108288A (en) * | 2018-01-09 | 2018-06-01 | 北京奇艺世纪科技有限公司 | A kind of daily record data analytic method, device and equipment |
Non-Patent Citations (2)
| Title |
|---|
| 赵飞等: "元数据的数据解析技术及在卫星设计中的应用", 《航天器工程》 * |
| 赵飞等: "元数据的数据解析技术及在卫星设计中的应用", 《航天器工程》, no. 02, 15 March 2010 (2010-03-15) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112448971B (en) | 2024-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018006789A1 (en) | Parameter checking method and apparatus, and network management server and computer storage medium | |
| EP3217283B1 (en) | Multi-module compilation system, multi-module compilation method, and non-transitory computer-readable storage medium | |
| US8589521B2 (en) | Method for testing connectivity of software applications hosted on networked computers | |
| CN109660377B (en) | Unified configuration management method, service server and operation maintenance management platform | |
| CN111459889B (en) | Equipment data model generation method and device for Internet of things platform | |
| CN102724079B (en) | Method and system for auxiliary configuration of Ethernet equipment | |
| CN108306804A (en) | A kind of Ethercat main station controllers and its communication means and system | |
| CN109189758B (en) | Operation and maintenance flow design method, device and equipment, operation method, device and host | |
| CN111555915A (en) | Dynamic network element control system based on plug-in configuration | |
| CN110286939A (en) | Development approach, device, equipment and the storage medium of Software Development Kit | |
| CN105190530A (en) | Transmitting hardware-rendered graphical data | |
| US20140112142A1 (en) | Method of forwarding packet and apparatus thereof | |
| JP2011129121A (en) | Apparatus and system for integrally managing static analysis tool | |
| CN104731564A (en) | Generation method and device for system interface call records | |
| CN112448971A (en) | Data analysis platform, data analysis method and storage medium | |
| CN109033483A (en) | A kind of method, apparatus and system defining data relationship in YANG model | |
| CN116521217A (en) | Method, system and storage medium for rapidly configuring BSW based on AUTOSAR tool | |
| JP2008165342A (en) | Source code creating method, device and program | |
| CN109947435A (en) | The dispositions method and system of server cluster software environment | |
| CN113656152B (en) | Local simulation method, system, medium and electronic equipment based on container cloud environment | |
| CN107273398B (en) | Human interface system and method for operating the same | |
| JP2008140263A (en) | Unit test support device | |
| CN116056120A (en) | Operation and maintenance operation method, system and network equipment | |
| CN112565041B (en) | Hardware information configuration method, device and medium of FF field bus system | |
| CN105975695B (en) | The quantitative analysis method of ThingML model under Uncertain environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |