CN111026400A - Method and device for analyzing service data stream - Google Patents
Method and device for analyzing service data stream Download PDFInfo
- Publication number
- CN111026400A CN111026400A CN201911142450.3A CN201911142450A CN111026400A CN 111026400 A CN111026400 A CN 111026400A CN 201911142450 A CN201911142450 A CN 201911142450A CN 111026400 A CN111026400 A CN 111026400A
- Authority
- CN
- China
- Prior art keywords
- data stream
- logic
- parsing
- analysis
- service data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004458 analytical method Methods 0.000 claims abstract description 106
- 238000002347 injection Methods 0.000 claims description 3
- 239000007924 injection Substances 0.000 claims description 3
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 230000003287 optical effect Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000005206 flow analysis Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000000243 solution Substances 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/42—Syntactic analysis
- G06F8/427—Parsing
Abstract
The application provides a method and a device for analyzing a service data stream, wherein the method comprises the following steps: and acquiring the service data stream to be analyzed and the corresponding logic data stream. And analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed. And analyzing the service data stream to be analyzed by using a first analysis logic so as to generate a first analysis result. Therefore, the first analysis logic corresponding to the service data flow is determined according to the logic data flow to analyze the service data flow, so that different service data flows can be analyzed by adopting different first analysis logics, the analysis logic of the analysis program can be flexibly updated in real time, and the updating times of the analysis program can be reduced.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a method and an apparatus for analyzing a service data stream.
Background
In the operation process of the service system, the working record of the service system is recorded through the log, the log of the service system is collected and analyzed in real time, the problems of the service system can be found in time and processed in time, and currently, a distributed architecture and a real-time computing framework (such as a Flink processing framework and a Spark computing platform) are generally adopted to complete the collection and analysis of the log.
For different service requirements, the same log data needs to be stored in different formats, and correspondingly, different analysis programs need to be used for analyzing the logs, and manpower and time are consumed for development and maintenance of the analysis programs.
In the related art, the configuration related to analysis is updated by changing the configuration file, so that the analysis program is updated, repeated development of the analysis program is avoided, and the maintenance cost of the analysis program is reduced. However, in a distributed architecture, the storage and updating of configuration files cannot meet the usage requirements.
Disclosure of Invention
The embodiment of the application provides a method and a device for analyzing a service data stream, and a first analysis logic corresponding to the service data stream is determined by analyzing a logic data stream, so that the analysis logic of an analysis program can be updated in real time, and the number of times of restarting and updating the analysis program is reduced.
In a first aspect, an embodiment of the present application provides a method for parsing a service data stream, including the following steps: acquiring a service data stream to be analyzed and a corresponding logic data stream; analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed; and analyzing the service data stream to be analyzed by using the first analysis logic to generate a first analysis result.
Compared with the prior art, the method and the device have the advantages that the first analysis logic corresponding to the service data flow is determined according to the logic data flow to analyze the service data flow, so that different service data flows can be analyzed by adopting different first analysis logics, the analysis logic of the analysis program can be flexibly updated in real time, and the times of restarting and updating the analysis program are reduced.
Optionally, before the obtaining the service data stream to be analyzed, the method further includes: injecting the first parsing logic into the logical data stream.
Optionally, the analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed includes: and analyzing the logic data stream to generate an analysis operator of the first analysis logic.
Optionally, the parsing, by using the first parsing logic, the service data stream to be parsed to generate a first parsing result includes: and analyzing the service data stream to be analyzed by using the analysis operator to generate the first analysis result.
Optionally, after the parsing, by using the first parsing logic, the service data stream to be parsed to generate a first parsing result, the method further includes: determining a second analysis logic corresponding to the first analysis result from the logic data stream; and analyzing the first analysis result by using the second analysis logic to generate a second analysis result.
In a second aspect, an embodiment of the present application further provides an apparatus for parsing a service data stream, including: the acquisition module is used for acquiring the service data stream to be analyzed and the corresponding logic data stream; the first analysis module is used for analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed; and the second analysis module is used for analyzing the service data stream to be analyzed by using the first analysis logic so as to generate a first analysis result.
Optionally, the apparatus further comprises: an injection module to inject the first parsing logic into the logical data stream.
Optionally, the first parsing module is specifically configured to parse the logic data stream to generate a parsing operator of the first parsing logic.
Optionally, the second parsing module is specifically configured to parse the service data stream to be parsed by using the parsing operator, so as to generate the first parsing result.
Optionally, the apparatus further comprises: a determining module, configured to determine, from the logic data stream, a second parsing logic corresponding to the first parsing result; and the third analysis module is used for analyzing the first analysis result by using the second analysis logic so as to generate a second analysis result.
In a third aspect, an embodiment of the present application further provides a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium includes a stored program, and when the program runs, the apparatus where the non-transitory computer-readable storage medium is located is controlled to execute the method for parsing a service data stream.
In a fourth aspect, an embodiment of the present application further provides a computer device, including a memory and a processor, where the memory is used to store information including program instructions, and the processor is used to control execution of the program instructions, and the program instructions are loaded and executed by the processor to implement the above method for parsing a service data stream.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic flowchart of a method for parsing a service data stream according to an embodiment of the present application;
fig. 2 is a flowchart of an example of a method for parsing a service data stream according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another method for parsing a service data stream according to an embodiment of the present application;
fig. 4 is a schematic diagram illustrating a storage manner of a service data stream according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an apparatus for parsing a service data stream according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of another apparatus for parsing a service data stream according to an embodiment of the present application; and
FIG. 7 is a schematic structural diagram of an embodiment of a computer apparatus according to the present application.
Detailed Description
For better understanding of the technical solutions of the present application, the following detailed descriptions of the embodiments of the present application are provided with reference to the accompanying drawings.
It should be understood that the embodiments described are only a few embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the examples of this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Based on the foregoing description of the prior art, it can be known that, currently, a distributed architecture and a real-time computing framework (such as a Flink processing framework and a Spark computing platform) are usually adopted to complete the collection and analysis of logs, and in the related art, a configuration related to analysis is updated by changing a configuration file, so as to update an analysis program, but the storage of the configuration file has a problem, and after the configuration file is updated, the analysis logic of the distributed processing architecture such as Flink and the like needs to be restarted, which cannot meet the use requirement.
In order to solve the above problem, an embodiment of the present application provides a method for parsing a service data stream, and fig. 1 is a schematic flow chart of the method for parsing a service data stream according to the embodiment of the present application. As shown in fig. 1, the method includes:
step S101, acquiring a service data stream to be analyzed and a corresponding logic data stream.
The service data stream to be analyzed is a log continuously generated by the service system, and the log generated by the service system is analyzed in real time in a data stream mode in the embodiment of the application.
It should be noted that, in order to update the analysis program in real time, in the embodiment of the present application, the configuration file of the analysis program is updated by using a logical data stream, so as to implement real-time update of the analysis program.
One possible implementation manner is that before the service flow to be parsed is obtained, another data flow is created, the data flow does not store any data initially, and the first parsing logic is injected into the data flow in the form of data, so as to obtain a logic data flow.
Step S102, analyzing the logic data flow to determine a first analysis logic corresponding to the service data flow to be analyzed.
It will be appreciated that by parsing the data in the logical data stream, the first parsing logic can be parsed therefrom.
It should be noted that, in the analysis method for a service data stream provided in the embodiment of the present application, the service data stream is analyzed through an analysis operator. The analysis operator can realize the selection of the service data streams and the configuration of the analysis logic, and the control of the analysis logic of different service data streams is realized by setting parameters in the analysis operator.
That is, the logical data stream is analyzed to generate an analysis operator of the first analysis logic, specifically, a parameter value corresponding to the analysis operator of the first analysis logic. When the parameters of the analysis operator are updated, the analysis logic for analyzing the service data can be updated.
Step S103, using the first parsing logic to parse the service data stream to be parsed, so as to generate a first parsing result.
Specifically, the service data stream to be analyzed is analyzed by using an analysis operator to generate a first analysis result.
To sum up, the method for analyzing a service data stream provided in the embodiment of the present application obtains a service data stream to be analyzed and a corresponding logic data stream. And analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed. And analyzing the service data stream to be analyzed by using a first analysis logic so as to generate a first analysis result. Therefore, the first analysis logic corresponding to the service data flow is determined according to the logic data flow to analyze the service data flow, so that different service data flows can be analyzed by adopting different first analysis logics, the analysis logic of the analysis program can be flexibly updated in real time, and the updating times of the analysis program can be reduced.
In order to more clearly describe the parsing method of the service data stream provided in the embodiment of the present application, an example is described below.
Fig. 2 is a flowchart of an example of a method for parsing a service data stream according to an embodiment of the present application. As shown in fig. 2, while the service data stream is collected, a first parsing logic corresponding to the service data stream is injected into the logic data stream, the logic data stream is parsed to generate a logic operator of the first parsing logic, and the parsing process of the service data stream is controlled by using the parsing operator of the first parsing logic, so that the service data stream is parsed by using the first parsing logic, and a first parsing result is generated.
Based on the processing method of the business data stream, the embodiment of the application also provides a real-time business data stream analysis platform, log data of a business system are collected through Filebeat, the log data are converted into a data stream form through a Kafka queue to generate the business data stream, and the business data stream is analyzed in real time through a Flink stream type processing architecture, so that not only can a large amount of log data be analyzed in real time, but also the requirement of updating analysis logic in real time can be met, and the collection and analysis efficiency of the log data is greatly improved.
It can be understood that, when the total parsing logic corresponding to the service data stream is relatively complex, the total parsing logic may be injected into the logic data stream, and after the logic data stream is parsed, a plurality of parsing logics obtained after the total parsing logic is split may be generated. In order to implement more complex analysis of the service data stream to be analyzed, the embodiment of the present application further provides another analysis method of the service data stream. Fig. 3 is a schematic flow diagram of another analysis method for a service data stream according to an embodiment of the present application, and as shown in fig. 3, based on the method flow shown in fig. 1, after analyzing the service data stream to be analyzed by using a first analysis logic in step S103 to generate a first analysis result, the method further includes:
step S201, determining a second parsing logic corresponding to the first parsing result from the logic data stream.
In step S202, the first parsing result is parsed by using a second parsing logic to generate a second parsing result.
It should be noted that, in the embodiment of the present application, names and data of service data streams are stored in a form of key value pairs, and fig. 4 is a schematic diagram illustrating a storage manner of the service data streams provided in the embodiment of the present application. As shown in fig. 4, the name of each traffic data stream corresponds to data.
And analyzing the service data stream by using a first analysis logic, and replacing the data of the service data stream in the key value pair with the first analysis result after generating the first analysis result.
And then determining a second analysis logic corresponding to the first analysis result from the logic data stream, analyzing the first analysis result by using the second analysis logic, and replacing the first analysis result in the key value pair with the second analysis result after generating the second analysis result.
It can be understood that the first parsing logic and the second parsing logic are obtained by splitting the total parsing logic corresponding to the service data stream, and thus the second parsing result is the parsing result of the total parsing logic.
In addition, as shown in fig. 4, since service data streams generated by different service systems all need to be analyzed, in order to improve processing efficiency of the service data streams and enable each service data stream to be adapted to a logic data stream in the embodiment of the present application, a possible implementation manner is to determine a service system corresponding to an analysis logic according to the analysis logic, and further determine a corresponding service data stream. And injecting the analysis logic into the logic data stream corresponding to the service data stream to complete the adaptation of the service data stream and the logic data stream, thereby realizing the simultaneous analysis of different service data streams.
Therefore, the service data stream is analyzed more complexly.
In order to implement the foregoing embodiment, an embodiment of the present application further provides an apparatus for parsing a service data stream, and fig. 5 is a schematic structural diagram of the apparatus for parsing a service data stream provided in the embodiment of the present application, and as shown in fig. 5, the apparatus includes: an obtaining module 310, a first parsing module 320, and a second parsing module 330.
The obtaining module 310 is configured to obtain a service data stream to be analyzed and a corresponding logic data stream.
The first parsing module 320 is configured to parse the logic data stream to determine a first parsing logic corresponding to the service data stream to be parsed.
The second parsing module 330 is configured to parse the service data stream to be parsed by using the first parsing logic to generate a first parsing result.
Further, to generate the logical data stream, a possible implementation manner is that the apparatus further includes: an injection module 340 for injecting the first parsing logic into the logical data stream.
Further, in order to parse the service data stream, a possible implementation manner is that the first parsing module 320 is specifically configured to parse the logic data stream to generate a parsing operator of the first parsing logic. The second parsing module 330 is specifically configured to parse the service data stream to be parsed by using a parsing operator to generate a first parsing result.
It should be noted that the explanation of the foregoing embodiment of the method for analyzing a service data stream is also applicable to the apparatus for analyzing a service data stream of this embodiment, and details are not described here.
To sum up, the apparatus for parsing a service data stream provided in the embodiment of the present application obtains a service data stream to be parsed and a corresponding logic data stream. And analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed. And analyzing the service data stream to be analyzed by using a first analysis logic so as to generate a first analysis result. Therefore, the first analysis logic corresponding to the service data flow is determined according to the logic data flow to analyze the service data flow, so that different service data flows can be analyzed by adopting different first analysis logics, the analysis logic of the analysis program can be flexibly updated in real time, and the updating times of the analysis program can be reduced.
In order to implement the foregoing embodiment, an embodiment of the present application further provides another service data flow analysis device, fig. 6 is a schematic structural diagram of another service data flow analysis device provided in the embodiment of the present application, and based on the device structure shown in fig. 5, as shown in fig. 6, the device further includes: a determination module 410 and a third parsing module 420.
The determining module 410 is configured to determine, from the logic data stream, a second parsing logic corresponding to the first parsing result.
The third parsing module 420 is configured to parse the first parsing result using the second parsing logic to generate a second parsing result.
It should be noted that the explanation of the foregoing embodiment of the method for analyzing a service data stream is also applicable to the apparatus for analyzing a service data stream of this embodiment, and details are not described here.
Therefore, the service data stream is analyzed more complexly.
Fig. 7 is a schematic structural diagram of an embodiment of a computer device according to the present application, where the computer device may include a memory and a processor, the memory is used to store information including program instructions, and the processor is used to control execution of the program instructions, and the program instructions are loaded and executed by the processor to implement a method for parsing a service data stream according to the embodiment of the present application.
The computer device may be a server, for example: the cloud server, or the computer device may also be an electronic device, for example: the present invention relates to a smart device, and more particularly, to a smart device such as a smart phone, a smart watch, a Personal Computer (PC), a notebook Computer, or a tablet Computer.
FIG. 7 illustrates a block diagram of an exemplary computer device 52 suitable for use in implementing embodiments of the present application. The computer device 52 shown in fig. 7 is only an example and should not bring any limitation to the function and scope of use of the embodiments of the present application.
As shown in FIG. 7, computer device 52 is in the form of a general purpose computing device. The components of computer device 52 may include, but are not limited to: one or more processors or processing units 56, a system memory 78, and a bus 58 that couples various system components including the system memory 78 and the processing unit 56.
Computer device 52 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by computer device 52 and includes both volatile and nonvolatile media, removable and non-removable media.
The system Memory 78 may include computer system readable media in the form of volatile Memory, such as Random Access Memory (RAM) 70 and/or cache Memory 72. The computer device 52 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, the storage system 74 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, commonly referred to as a "hard drive"). Although not shown in FIG. 7, a disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a Compact disk Read Only memory (CD-ROM), a Digital versatile disk Read Only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 58 by one or more data media interfaces. Memory 78 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the application.
A program/utility 80 having a set (at least one) of program modules 82 may be stored, for example, in memory 78, such program modules 82 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 82 generally perform the functions and/or methodologies of the embodiments described herein.
The computer device 52 may also communicate with one or more external devices 54 (e.g., keyboard, pointing device, display 64, etc.), with one or more devices that enable a user to interact with the computer device 52, and/or with any devices (e.g., network card, modem, etc.) that enable the computer device 52 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 62. Also, computer device 52 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public Network such as the Internet) via Network adapter 60. As shown in FIG. 7, the network adapter 60 communicates with the other modules of the computer device 52 via the bus 58. It should be appreciated that although not shown in FIG. 7, other hardware and/or software modules may be used in conjunction with the computer device 52, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 56 executes programs stored in the system memory 78 to execute various functional applications and data processing, for example, implement the parsing method of the service data stream provided by the embodiment of the present application.
The embodiment of the present application further provides a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium includes a stored program, and when the program runs, the device where the non-transitory computer-readable storage medium is located is controlled to execute the method for parsing a service data stream provided in the embodiment of the present application.
The non-transitory computer readable storage medium described above may take any combination of one or more computer readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM) or flash Memory, an optical fiber, a portable compact disc Read Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, or the like, as well as conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of Network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
In the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing steps of a custom logic function or process, and alternate implementations are included within the scope of the preferred embodiment of the present application in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
It should be noted that the terminal according to the embodiments of the present application may include, but is not limited to, a Personal Computer (Personal Computer; hereinafter, referred to as PC), a Personal Digital Assistant (Personal Digital Assistant; hereinafter, referred to as PDA), a wireless handheld device, a Tablet Computer (Tablet Computer), a mobile phone, an MP3 player, an MP4 player, and the like.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a Processor (Processor) to execute some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.
Claims (10)
1. A method for parsing a service data stream, comprising:
acquiring a service data stream to be analyzed and a corresponding logic data stream;
analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed; and
and analyzing the service data stream to be analyzed by using the first analysis logic to generate a first analysis result.
2. The parsing method as claimed in claim 1, wherein before the obtaining the service data stream to be parsed, further comprising:
injecting the first parsing logic into the logical data stream.
3. The parsing method of claim 2, wherein the parsing the logic data stream to determine a first parsing logic corresponding to the service data stream to be parsed comprises:
and analyzing the logic data stream to generate an analysis operator of the first analysis logic.
4. The parsing method of claim 3, wherein the parsing the traffic data stream to be parsed using the first parsing logic to generate a first parsing result comprises:
and analyzing the service data stream to be analyzed by using the analysis operator to generate the first analysis result.
5. The parsing method of any one of claims 1-4, wherein after the parsing the traffic data stream to be parsed using the first parsing logic to generate a first parsing result, further comprising:
determining a second analysis logic corresponding to the first analysis result from the logic data stream;
and analyzing the first analysis result by using the second analysis logic to generate a second analysis result.
6. A device for parsing a service data stream, comprising:
the acquisition module is used for acquiring the service data stream to be analyzed and the corresponding logic data stream;
the first analysis module is used for analyzing the logic data stream to determine a first analysis logic corresponding to the service data stream to be analyzed; and
and the second analysis module is used for analyzing the service data stream to be analyzed by using the first analysis logic so as to generate a first analysis result.
7. The parsing apparatus of claim 6, wherein the apparatus further comprises:
an injection module to inject the first parsing logic into the logical data stream.
8. The parsing apparatus of claim 7,
the first parsing module is specifically configured to parse the logic data stream to generate a parsing operator of the first parsing logic.
9. A non-transitory computer-readable storage medium, comprising a stored program, wherein the program, when executed, controls an apparatus where the non-transitory computer-readable storage medium is located to perform the method for parsing a service data stream according to any one of claims 1 to 5.
10. A computer device comprising a memory for storing information including program instructions and a processor for controlling execution of the program instructions, characterized in that: the program instructions, when loaded and executed by a processor, implement the method of parsing a traffic data stream according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911142450.3A CN111026400A (en) | 2019-11-20 | 2019-11-20 | Method and device for analyzing service data stream |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911142450.3A CN111026400A (en) | 2019-11-20 | 2019-11-20 | Method and device for analyzing service data stream |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111026400A true CN111026400A (en) | 2020-04-17 |
Family
ID=70206267
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911142450.3A Pending CN111026400A (en) | 2019-11-20 | 2019-11-20 | Method and device for analyzing service data stream |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111026400A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112328551A (en) * | 2020-11-09 | 2021-02-05 | 医渡云（北京）技术有限公司 | Medical data analysis method, device, medium, and electronic device |
| CN112532450A (en) * | 2020-11-30 | 2021-03-19 | 安徽中科美络信息技术有限公司 | Dynamic updating method and system for data stream distribution process configuration |
| CN112596997A (en) * | 2020-12-29 | 2021-04-02 | 科技谷（厦门）信息技术有限公司 | Automatic flow control method based on Flink real-time calculation |
| CN115065536A (en) * | 2022-06-16 | 2022-09-16 | 北京天融信网络安全技术有限公司 | Network security data analyzer, analysis method, electronic device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106681781A (en) * | 2015-11-05 | 2017-05-17 | 腾讯科技（深圳）有限公司 | Implementation method and system for real-time computing service |
| US20170323045A1 (en) * | 2016-05-06 | 2017-11-09 | Baidu Usa Llc | Method and system for designing fpga based on hardware requirements defined in source code |
| CN108628605A (en) * | 2018-04-28 | 2018-10-09 | 百度在线网络技术（北京）有限公司 | Stream data processing method, device, server and medium |
| CN110471944A (en) * | 2018-05-11 | 2019-11-19 | 北京京东尚科信息技术有限公司 | Indicator-specific statistics method, system, equipment and storage medium |
-
2019
- 2019-11-20 CN CN201911142450.3A patent/CN111026400A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106681781A (en) * | 2015-11-05 | 2017-05-17 | 腾讯科技（深圳）有限公司 | Implementation method and system for real-time computing service |
| US20170323045A1 (en) * | 2016-05-06 | 2017-11-09 | Baidu Usa Llc | Method and system for designing fpga based on hardware requirements defined in source code |
| CN108628605A (en) * | 2018-04-28 | 2018-10-09 | 百度在线网络技术（北京）有限公司 | Stream data processing method, device, server and medium |
| CN110471944A (en) * | 2018-05-11 | 2019-11-19 | 北京京东尚科信息技术有限公司 | Indicator-specific statistics method, system, equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 李梓杨 等: ""基于流网络的Flink 平台弹性资源调度策略"" * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112328551A (en) * | 2020-11-09 | 2021-02-05 | 医渡云（北京）技术有限公司 | Medical data analysis method, device, medium, and electronic device |
| CN112532450A (en) * | 2020-11-30 | 2021-03-19 | 安徽中科美络信息技术有限公司 | Dynamic updating method and system for data stream distribution process configuration |
| CN112596997A (en) * | 2020-12-29 | 2021-04-02 | 科技谷（厦门）信息技术有限公司 | Automatic flow control method based on Flink real-time calculation |
| CN115065536A (en) * | 2022-06-16 | 2022-09-16 | 北京天融信网络安全技术有限公司 | Network security data analyzer, analysis method, electronic device and storage medium |
| CN115065536B (en) * | 2022-06-16 | 2023-08-25 | 北京天融信网络安全技术有限公司 | Network security data parser, parsing method, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111026400A (en) | Method and device for analyzing service data stream | |
| CN109002510B (en) | Dialogue processing method, device, equipment and medium | |
| CN109901834B (en) | Document page generation method, device, computer equipment and storage medium | |
| CN107506300B (en) | User interface testing method, device, server and storage medium | |
| CN109561117B (en) | Data acquisition method and device | |
| CN106844181B (en) | Method, system and mobile terminal for recording user behavior | |
| CN109873735B (en) | Performance test method and device for H5 page and computer equipment | |
| CN111221521A (en) | Method and device for generating log code, computer system and readable storage medium | |
| CN110781658B (en) | Resume analysis method, resume analysis device, electronic equipment and storage medium | |
| CN111813465B (en) | Information acquisition method, device, medium and equipment | |
| CN109885781B (en) | Mixed page unified browsing method, device, equipment and storage medium | |
| CN106372844B (en) | Schedule creating method and device | |
| US11934287B2 (en) | Method, electronic device and computer program product for processing data | |
| CN110222017B (en) | Real-time data processing method, device and equipment and computer readable storage medium | |
| CN115525292A (en) | Low code development method and device, readable storage medium and electronic equipment | |
| CN111111201A (en) | Skill creating method, skill creating device, skill creating server and skill creating medium based on game | |
| CN110377891B (en) | Method, device and equipment for generating event analysis article and computer readable storage medium | |
| CN109684207B (en) | Method and device for packaging operation sequence, electronic equipment and storage medium | |
| CN111443905B (en) | Service data processing method, device and system and electronic equipment | |
| CN111767111B (en) | Page data processing method and device, electronic equipment and storage medium | |
| CN112394920B (en) | Application software development method, platform and electronic equipment | |
| CN112416455B (en) | Data processing method, device, terminal and storage medium | |
| CN112506871B (en) | Automated task management and log management method, system, electronic device and medium | |
| CN110262856B (en) | Application program data acquisition method, device, terminal and storage medium | |
| CN115345142A (en) | Contract template generation method and device, computer-readable storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200417 |