CN110765010A - Online debugging method and device for visual development based on Flink - Google Patents
Online debugging method and device for visual development based on Flink Download PDFInfo
- Publication number
- CN110765010A CN110765010A CN201910959821.0A CN201910959821A CN110765010A CN 110765010 A CN110765010 A CN 110765010A CN 201910959821 A CN201910959821 A CN 201910959821A CN 110765010 A CN110765010 A CN 110765010A
- Authority
- CN
- China
- Prior art keywords
- data source
- file
- format
- debugging
- abstract
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000011161 development Methods 0.000 title claims abstract description 38
- 230000000007 visual effect Effects 0.000 title description 6
- 238000004088 simulation Methods 0.000 claims abstract description 81
- 238000004364 calculation method Methods 0.000 claims abstract description 57
- 238000006243 chemical reaction Methods 0.000 claims abstract description 22
- 238000001914 filtration Methods 0.000 claims abstract description 19
- 238000012986 modification Methods 0.000 claims description 9
- 230000004048 modification Effects 0.000 claims description 9
- 238000004806 packaging method and process Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 6
- 238000012216 screening Methods 0.000 claims description 5
- 238000012795 verification Methods 0.000 claims description 5
- 238000010276 construction Methods 0.000 claims description 4
- 238000012800 visualization Methods 0.000 description 11
- 230000009286 beneficial effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3628—Software debugging of optimised code
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/362—Software debugging
- G06F11/3644—Software debugging by instrumenting at runtime
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3664—Environments for testing or debugging software
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a method and a device for visualized development online debugging based on Flink, relates to the technical field of big data, and can improve the efficiency of development and debugging of a Flink program. The method comprises the following steps: presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data; acquiring a data source, performing format conversion according to the format of the data source file, and uploading the converted data source file to a server for storage; constructing abstract business logic based on a business logic file format, filtering effective data source files from a server according to set conditions in the abstract business logic, and outputting simulation result files or error feedback logs after performing simulation calculation; and debugging abstract service logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log. The device is applied with the method provided by the scheme.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a method and a device for online debugging of visual development based on Flink.
Background
With the rapid development of internet company business, the generated data is also well-blown, which requires real-time platform department to provide easy-to-use, stable and efficient real-time data service for business department, so that real-time computing business based on data is gradually increased in recent years and is used by more and more on-line, such as real-time recommendation business, double eleven sales real-time large screen display business, real-time fraud-resisting business, etc.
The field of big data real-time computation is often accompanied with various complex business requirements, corresponding Flink programs are very complex, and when the business requirements are complex and the task logic amount is huge, how to perform visual online task debugging becomes an urgent task.
Disclosure of Invention
The invention aims to provide a method and a device for visualized development online debugging based on Flink, which can improve the efficiency of development and debugging of a Flink program.
In order to achieve the above object, an aspect of the present invention provides a method for online debugging of visualization development based on Flink, including:
presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data;
acquiring a data source, performing format conversion according to the format of the data source file, and uploading the converted data source file to a server for storage;
constructing abstract business logic based on a business logic file format, filtering effective data source files from a server according to set conditions in the abstract business logic, and outputting simulation result files or error feedback logs after performing simulation calculation;
and debugging abstract service logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log.
Preferably, the method for acquiring a data source, performing format conversion according to the data source file format, and uploading the converted data source file to the server for storage includes:
acquiring a plurality of data sources, and respectively carrying out combined conversion on event time and event data in each data source according to a data source file format to correspondingly obtain a plurality of data source files;
verifying the data source file, and positioning the data source file with an error format to prompt modification;
and packaging the data source files passing the verification and uploading the data source files to a server for storage.
Preferably, the method for constructing an abstract service logic based on a service logic file format, filtering an effective data source file from a server according to a set condition in the abstract service logic, and outputting a simulation result file or an error feedback log after performing simulation calculation includes:
configuring a uniform debugging environment, and acquiring all required data source files from a server;
visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, wherein the abstract business logic file is provided with a plurality of calculation conditions or business conditions;
and filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
Preferably, the method for debugging abstract business logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log comprises the following steps:
when the simulation result file is output after simulation calculation, the calculation condition or the service condition set in the abstract service logic file can be adjusted reversely by referring to the simulation result file;
when the error feedback log is output after simulation calculation, the error codes in the abstract service logic file can be modified on line according to the error feedback log.
Optionally, the event time and the event data are distinguished and combined by separators, and the combined data source file is packaged in a CSV file format.
Compared with the prior art, the visualized development online debugging method based on Flink provided by the invention has the following beneficial effects:
the invention provides a method for online debugging of visualized development based on Flink, which comprises the steps of firstly presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data, executing format conversion on the data source according to the preset data source file format, outputting the data source file and uploading the data source file to a server, then constructing an abstract service logic by using a Flink visualized development technology and referring to the service logic file format, executing simulation calculation on an effective data source file based on a filter condition set in the abstract service logic, when the simulation result file is output by the simulation calculation, reversely adjusting the filter condition set in the abstract service logic file by referring to a simulation result file, or when an error feedback log is output by the simulation calculation, modifying error codes in the abstract service logic file online according to the error feedback log.
In conclusion, the Flink visualization development technology can reduce the development threshold of the model task and accelerate the development efficiency, and on the basis, the invention can further improve the development efficiency by debugging the abstract business logic on line and modifying the corresponding error codes.
Another aspect of the present invention provides a Flink-based online debugging device for visual development, to which the above-mentioned technical solution is applied, the method comprising:
the format setting unit is used for presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data;
the format conversion unit is used for acquiring a data source, executing format conversion according to the format of the data source file and uploading the converted data source file to the server for storage;
the processing unit is used for constructing an abstract service logic based on the service logic file format, filtering effective data source files from the server according to set conditions in the abstract service logic, executing simulation calculation and then outputting simulation result files or error feedback logs;
and the feedback output unit is used for debugging the abstract service logic on line or modifying the corresponding error code according to the simulation result file or the error feedback log.
Preferably, the format conversion unit includes:
the data acquisition module is used for acquiring a plurality of data sources, and respectively combining and converting the event time and the event data in each data source according to the data source file format to correspondingly obtain a plurality of data source files;
the data checking module is used for checking the data source file and positioning the data source file with the wrong format to prompt modification;
and the data uploading module is used for packaging and uploading the verified data source files to a server for storage.
Preferably, the processing unit includes:
the environment configuration module is used for configuring a uniform debugging environment and acquiring all required data source files from the server;
the business logic construction module is used for visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, and a plurality of calculation conditions or business conditions are set in the abstract business logic file;
and the screening calculation module is used for filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
Preferably, the point feedback output unit includes:
the reverse adjustment module is used for reversely adjusting the calculation conditions or the service conditions set in the abstract service logic file by referring to the simulation result file when the simulation result file is output after the simulation calculation;
and the code modification module is used for modifying the error codes in the abstract service logic file on line according to the error feedback log when the error feedback log is output after the simulation calculation.
Compared with the prior art, the beneficial effects of the visualized development online debugging device based on the Flink provided by the invention are the same as those of the visualized development online debugging method based on the Flink provided by the technical scheme, and the detailed description is omitted here.
A third aspect of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, executes the steps of the above-mentioned Flink-based visualization development online debugging method.
Compared with the prior art, the beneficial effect of the computer-readable storage medium provided by the invention is the same as that of the visualized development online debugging method based on Flink provided by the technical scheme, and the detailed description is omitted here.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flowchart of a method for online debugging of visualization development based on Flink in the first embodiment;
fig. 2 is a logic example diagram of a visualization development online debugging method based on Flink in the first embodiment.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
Referring to fig. 1, the present embodiment provides a method for online debugging of visualization development based on Flink, including:
presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data; acquiring a data source, performing format conversion according to the format of the data source file, and uploading the converted data source file to a server for storage; constructing abstract business logic based on a business logic file format, filtering effective data source files from a server according to set conditions in the abstract business logic, and outputting simulation result files or error feedback logs after performing simulation calculation; and debugging abstract service logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log.
In the visualized development online debugging method based on Flink provided by this embodiment, a data source file format and a service logic file format are preset first, wherein the data source comprises event time and event data, the format conversion is executed by the data source according to a preset data source file format, the data source file is output and uploaded to the server, then constructing abstract business logic by using a Flink visual development technology and referring to a business logic file format, executing simulation calculation on the effective data source file based on the filter condition set in the abstract business logic, and when the simulation calculation outputs a simulation result file, the filter conditions set in the abstract business logic file may be adjusted in reverse with reference to the simulation result file, alternatively, when the error feedback log is output by the simulation computation, the error code in the abstract business logic file can be modified online according to the error feedback log.
In summary, the Flink visualization development technology can reduce the development threshold of the model task and accelerate the development efficiency, and on the basis, the development efficiency can be further improved by debugging the abstract business logic on line and modifying the corresponding error code. In addition, compared with the existing debugging method that various Flink dependencies need to be configured, the online debugging scheme provided by the embodiment can remove the dependencies, avoid the occurrence of conflict problems, shield the difference between the debugging environment and the real environment by online debugging, and enable research and development personnel to perform task testing without perception.
Illustratively, the preset data source file format is "event time, event data", such as: "year-month-day, name, Sex, age, address", a preset service logic file format is an accumulation of a plurality of nodes, and generally includes a data source node, a filter node, a statistical node, and an output source node, where the filter node is provided with a plurality of filter conditions, such as "Sex: male, age: 20-40, address: beijing, finally calculating the number of people meeting the requirements of male, age 20-40 years and Beijing address in the data source through calculation and screening of statistical nodes, and outputting the number of people through an output source node.
It can be understood that the preset data source file format and the service logic file format are various, the embodiment does not limit the specific form thereof, and a user can autonomously set the specific form according to the service requirement in the specific implementation process.
In the above embodiment, the method for acquiring a data source, performing format conversion according to a data source file format, and uploading the converted data source file to a server for storage includes:
acquiring a plurality of data sources, and respectively carrying out combined conversion on event time and event data in each data source according to a data source file format to correspondingly obtain a plurality of data source files; verifying the data source file, and positioning the data source file with an error format to prompt modification; and packaging the data source files passing the verification and uploading the data source files to a server for storage.
In specific implementation, because the formats of the acquired multiple data sources are different, format conversion needs to be performed on the data sources according to a preset data source file format, for example, the acquired data sources "2019, 09, 25, name 1", "2019-09-22-03-25-00, name 2" and "09 month 25 in 2019 and 25 days in 2019 and name 3" are uniformly converted into data source files "2019-09-25, name 1", "2019-09-22, name 2" and "2019-09-25 and name 3" according to the preset data source file format, in order to ensure the validity of data, format verification needs to be further performed on the data source files, the data source files in an incorrect format are located, developers are prompted to modify manually, and finally the data source files passing the verification are uploaded to a packaging server for storage, for subsequent invocation. Therefore, through the application of the online debugging scheme, the data source file with the wrong format can be quickly modified, and the development process is accelerated.
Specifically, in the above embodiment, the method for constructing an abstract service logic based on a service logic file format, filtering an effective data source file from a server according to a set condition in the abstract service logic, and outputting a simulation result file or an error feedback log after performing simulation calculation includes:
configuring a uniform debugging environment, and acquiring all required data source files from a server; visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, wherein the abstract business logic file is provided with a plurality of calculation conditions or business conditions; and filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
When the method is concretely implemented, firstly, a uniform debugging environment is established, so that a model task developed based on a Flink visualization technology can be debugged in the environment, then all data source files required by the model task are obtained from a server, abstract business logic is constructed based on a business logic file format, wherein the construction modes comprise two modes, one mode is that nodes required by selection are directly and visually utilized from preset nodes, the other mode is that the nodes required by selection are manually edited and then used based on the selected preset nodes, abstract business logic files are correspondingly generated after the abstract business logic is constructed, the actual task logic of the model task can be reversely deduced by analyzing the abstract business logic files, finally, effective data source files and the abstract business logic files are used as input, simulation calculation is executed by taking event time as a limiting condition, and debugging results are output, for example, the method comprises the steps of inquiring the number of people of a single clothing category of a Beijing user in the double eleven whole days, wherein corresponding nodes sequentially comprise an input source node, an inquiry node, a filtering node, a counting node and an output source node under the scene, wherein the filtering node comprises a plurality of filtering conditions, for example, the number of people meeting the screening conditions is counted by the counting node, and the number of people output and counted by the output source node is counted by the counting node, wherein the corresponding conditions of a mouth field in a data source are Beijing, the corresponding conditions of a time field in the double eleven whole days are time ranges, and the corresponding conditions of a type field are clothing. The effective data source file is corresponding to 'ordering time data and ordering data of a user', the simulation result file is directly output through an output source node after debugging is successful, an error feedback log is output when debugging is failed, and the positioning of error codes in the model task is recorded in the error feedback log.
In addition, in order to expand the flexibility of the application of the online debugging scheme in this embodiment, the user may also select a local branch of the model task to debug, and the specific implementation process is not described herein again.
Specifically, the method for online debugging abstract service logic or modifying corresponding error codes according to the simulation result file or the error feedback log in the embodiment includes:
when the simulation result file is output after simulation calculation, the simulation result file can be displayed to the front end for downloading, correspondingly comprises a plurality of downloading formats, such as pages, texts, Execl and the like, and can also be used for reversely adjusting the calculation conditions or service conditions set in the abstract service logic file by referring to the simulation result file so as to obtain a more accurate simulation result file; when the error feedback log is output after the simulation calculation, the system can automatically check out the nodes containing the error codes so as to prompt a developer to modify the error codes on line according to the error feedback log.
Preferably, the event time and the event data in the above embodiments are distinguished and combined by separators, and the combined data source file is packaged in a CSV file format.
Referring to fig. 2, the implementation process may be summarized as that, a service program is written according to a specific service logic, a data source file is uploaded after writing, the data source file is in a CSV file format, the content of the data source file includes event time and event data, the data source file is analyzed by a background after triggering and debugging, and a service logic file is abstracted according to the service program, and at this time, the data source file and the service logic file are sent to a unified debugging environment. The method comprises the steps that an actual debugging process is carried out, a unified debugging environment has all data and dependence required by debugging, a system firstly creates a Flink execution environment in the debugging environment, then a task logic is generated through analysis according to a service logic file, then a program is executed through the simulated Flink environment, data are subjected to simulation calculation according to event time, an execution result is stored in a file, if the debugging is successful, the data are displayed according to the requirement, and if the debugging is failed, the system can automatically check nodes containing error codes. The method has the technical effects that a user does not need to care about the difference between the debugging environment and the online environment, a data source file is uploaded, and a result can be generated by clicking for debugging, so that the online visualization programming model of the Flink is perfected, and the problem of debugging of a service dependent time model in real-time visualization development is solved.
Example two
The embodiment provides a visualized development online debugging device based on Flink, which comprises:
the format setting unit is used for presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data;
the format conversion unit is used for acquiring a data source, executing format conversion according to the format of the data source file and uploading the converted data source file to the server for storage;
the processing unit is used for constructing an abstract service logic based on the service logic file format, filtering effective data source files from the server according to set conditions in the abstract service logic, executing simulation calculation and then outputting simulation result files or error feedback logs;
and the feedback output unit is used for debugging the abstract service logic on line or modifying the corresponding error code according to the simulation result file or the error feedback log.
Preferably, the format conversion unit includes:
the data acquisition module is used for acquiring a plurality of data sources, and respectively combining and converting the event time and the event data in each data source according to the data source file format to correspondingly obtain a plurality of data source files;
the data checking module is used for checking the data source file and positioning the data source file with the wrong format to prompt modification;
and the data uploading module is used for packaging and uploading the verified data source files to a server for storage.
Preferably, the processing unit includes:
the environment configuration module is used for configuring a uniform debugging environment and acquiring all required data source files from the server;
the business logic construction module is used for visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, and a plurality of calculation conditions or business conditions are set in the abstract business logic file;
and the screening calculation module is used for filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
Preferably, the point feedback output unit includes:
the reverse adjustment module is used for reversely adjusting the calculation conditions or the service conditions set in the abstract service logic file by referring to the simulation result file when the simulation result file is output after the simulation calculation;
and the code modification module is used for modifying the error codes in the abstract service logic file on line according to the error feedback log when the error feedback log is output after the simulation calculation.
Compared with the prior art, the beneficial effects of the visualized development online debugging device based on Flink provided by the embodiment are the same as those of the visualized development online debugging method based on Flink provided by the embodiment, and are not repeated herein.
EXAMPLE III
The embodiment provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the computer program executes the steps of the above-mentioned Flink-based visualization development online debugging method.
Compared with the prior art, the beneficial effect of the computer-readable storage medium provided by the embodiment is the same as that of the method for visually developing online debugging based on Flink provided by the above technical scheme, and details are not repeated here.
It will be understood by those skilled in the art that all or part of the steps in the method for implementing the invention may be implemented by hardware that is instructed to be associated with a program, the program may be stored in a computer-readable storage medium, and when the program is executed, the program includes the steps of the method of the embodiment, and the storage medium may be: ROM/RAM, magnetic disks, optical disks, memory cards, and the like.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. A visualized development online debugging method based on Flink is characterized by comprising the following steps:
presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data;
acquiring a data source, performing format conversion according to the format of the data source file, and uploading the converted data source file to a server for storage;
constructing abstract business logic based on a business logic file format, filtering effective data source files from a server according to set conditions in the abstract business logic, and outputting simulation result files or error feedback logs after performing simulation calculation;
and debugging abstract service logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log.
2. The method of claim 1, wherein the steps of obtaining a data source and performing format conversion according to the data source file format, and uploading the converted data source file to the server for storage comprise:
acquiring a plurality of data sources, and respectively carrying out combined conversion on event time and event data in each data source according to a data source file format to correspondingly obtain a plurality of data source files;
verifying the data source file, and positioning the data source file with an error format to prompt modification;
and packaging the data source files passing the verification and uploading the data source files to a server for storage.
3. The method according to claim 1, wherein the method for constructing an abstract service logic based on a service logic file format, filtering effective data source files from a server according to set conditions in the abstract service logic, and outputting simulation result files or error feedback logs after performing simulation calculation comprises:
configuring a uniform debugging environment, and acquiring all required data source files from a server;
visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, wherein the abstract business logic file is provided with a plurality of calculation conditions or business conditions;
and filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
4. The method of claim 3, wherein the method for debugging abstract business logic or modifying corresponding error codes on line according to the simulation result file or the error feedback log comprises:
when the simulation result file is output after simulation calculation, the calculation condition or the service condition set in the abstract service logic file can be adjusted reversely by referring to the simulation result file;
when the error feedback log is output after simulation calculation, the error codes in the abstract service logic file can be modified on line according to the error feedback log.
5. The method according to any one of claims 1-4, wherein the event time and the event data are combined by a delimiter distinction, and the combined data source file is encapsulated in CSV file format.
6. The visualized development online debugging device based on the Flink is characterized by comprising the following components:
the format setting unit is used for presetting a data source file format and a service logic file format, wherein the data source comprises event time and event data;
the format conversion unit is used for acquiring a data source, executing format conversion according to the format of the data source file and uploading the converted data source file to the server for storage;
the processing unit is used for constructing an abstract service logic based on the service logic file format, filtering effective data source files from the server according to set conditions in the abstract service logic, executing simulation calculation and then outputting simulation result files or error feedback logs;
and the feedback output unit is used for debugging the abstract service logic on line or modifying the corresponding error code according to the simulation result file or the error feedback log.
7. The apparatus of claim 6, wherein the format conversion unit comprises:
the data acquisition module is used for acquiring a plurality of data sources, and respectively combining and converting the event time and the event data in each data source according to the data source file format to correspondingly obtain a plurality of data source files;
the data checking module is used for checking the data source file and positioning the data source file with the wrong format to prompt modification;
and the data uploading module is used for packaging and uploading the verified data source files to a server for storage.
8. The apparatus of claim 6, wherein the processing unit comprises:
the environment configuration module is used for configuring a uniform debugging environment and acquiring all required data source files from the server;
the business logic construction module is used for visually selecting or editing abstract business logic based on a business logic file format to generate an abstract business logic file, and a plurality of calculation conditions or business conditions are set in the abstract business logic file;
and the screening calculation module is used for filtering effective data source files from all required data source files according to the calculation conditions or the service conditions, executing simulation calculation at event time to generate a debugging result, outputting an error feedback log when the debugging result fails, and outputting a simulation result file when the debugging result succeeds.
9. The apparatus of claim 8, wherein the point feedback output unit comprises:
the reverse adjustment module is used for reversely adjusting the calculation conditions or the service conditions set in the abstract service logic file by referring to the simulation result file when the simulation result file is output after the simulation calculation;
and the code modification module is used for modifying the error codes in the abstract service logic file on line according to the error feedback log when the error feedback log is output after the simulation calculation.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of the claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910959821.0A CN110765010B (en) | 2019-10-10 | 2019-10-10 | Method and device for online debugging visual development based on Flink |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910959821.0A CN110765010B (en) | 2019-10-10 | 2019-10-10 | Method and device for online debugging visual development based on Flink |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110765010A true CN110765010A (en) | 2020-02-07 |
| CN110765010B CN110765010B (en) | 2022-12-13 |
Family
ID=69331582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910959821.0A Active CN110765010B (en) | 2019-10-10 | 2019-10-10 | Method and device for online debugging visual development based on Flink |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110765010B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112765018A (en) * | 2021-01-12 | 2021-05-07 | 武汉光庭信息技术股份有限公司 | Instrument and meter debugging system and method |
| CN113010512A (en) * | 2021-02-24 | 2021-06-22 | 上海中通吉网络技术有限公司 | Real-time data processing method, platform and equipment based on Flink |
| CN113504912A (en) * | 2021-07-22 | 2021-10-15 | 浙江大华技术股份有限公司 | Real-time task processing method and device, storage medium and electronic device |
| CN113760739A (en) * | 2021-03-18 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | Data debugging method, device, medium, equipment and program product |
| CN113781068A (en) * | 2021-09-09 | 2021-12-10 | 平安科技（深圳）有限公司 | Online problem solving method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4876728A (en) * | 1985-06-04 | 1989-10-24 | Adept Technology, Inc. | Vision system for distinguishing touching parts |
| CN105739976A (en) * | 2016-01-26 | 2016-07-06 | 四川神州雅韵科技有限公司 | Method for rapidly generating Windows Phone applications in a visual manner |
-
2019
- 2019-10-10 CN CN201910959821.0A patent/CN110765010B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4876728A (en) * | 1985-06-04 | 1989-10-24 | Adept Technology, Inc. | Vision system for distinguishing touching parts |
| CN105739976A (en) * | 2016-01-26 | 2016-07-06 | 四川神州雅韵科技有限公司 | Method for rapidly generating Windows Phone applications in a visual manner |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112765018A (en) * | 2021-01-12 | 2021-05-07 | 武汉光庭信息技术股份有限公司 | Instrument and meter debugging system and method |
| CN112765018B (en) * | 2021-01-12 | 2022-09-13 | 武汉光庭信息技术股份有限公司 | Instrument and meter debugging system and method |
| CN113010512A (en) * | 2021-02-24 | 2021-06-22 | 上海中通吉网络技术有限公司 | Real-time data processing method, platform and equipment based on Flink |
| CN113760739A (en) * | 2021-03-18 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | Data debugging method, device, medium, equipment and program product |
| CN113504912A (en) * | 2021-07-22 | 2021-10-15 | 浙江大华技术股份有限公司 | Real-time task processing method and device, storage medium and electronic device |
| CN113781068A (en) * | 2021-09-09 | 2021-12-10 | 平安科技（深圳）有限公司 | Online problem solving method and device, electronic equipment and storage medium |
| CN113781068B (en) * | 2021-09-09 | 2024-05-14 | 平安科技（深圳）有限公司 | Online problem solving method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110765010B (en) | 2022-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110765010B (en) | Method and device for online debugging visual development based on Flink | |
| US8819642B2 (en) | Method and system for generating and processing black box test cases | |
| US9465718B2 (en) | Filter generation for load testing managed environments | |
| US7913229B2 (en) | Computer-implemented system for generating automated tests from a web application | |
| CN110471652B (en) | Task arrangement method, task arranger, task arrangement device and readable storage medium | |
| Zaidman et al. | Understanding Ajax applications by connecting client and server-side execution traces | |
| Roehm et al. | Monitoring user interactions for supporting failure reproduction | |
| CN108469955B (en) | Annotation-based Android injection framework implementation method | |
| JP2018500642A (en) | Debug graph | |
| CN111274120B (en) | Interface document verification method and device | |
| CN111708712A (en) | User behavior test case generation method, flow playback method and electronic equipment | |
| CN114297961A (en) | Chip test case processing method and related device | |
| CN113051262A (en) | Data quality inspection method, device, equipment and storage medium | |
| CN117493188A (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN111078529B (en) | Client writing module testing method and device and electronic equipment | |
| Lipka et al. | A method for semi-automated generation of test scenarios based on use cases | |
| US10579761B1 (en) | Method and system for reconstructing a graph presentation of a previously executed verification test | |
| WO2023160402A1 (en) | Data modeling method and apparatus, and device and storage medium | |
| US11892941B2 (en) | Self-learning application test automation | |
| CN117707917A (en) | Service testing method, device, medium and product | |
| CN114327416A (en) | Interface synchronization method and device applied to development branch and electronic equipment | |
| CN113342641A (en) | Automatic test method and system for HTTP service interface | |
| CN114185871A (en) | Data migration method, data migration device, medium, and electronic device | |
| CN113204330A (en) | Program development design method and system based on artificial intelligence | |
| CN113504912B (en) | Real-time task processing method and device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: No.1-1 Suning Avenue, Xuzhuang Software Park, Xuanwu District, Nanjing, Jiangsu Province, 210000 Patentee after: Jiangsu Suning cloud computing Co.,Ltd. Country or region after: China Address before: No.1-1 Suning Avenue, Xuzhuang Software Park, Xuanwu District, Nanjing, Jiangsu Province, 210000 Patentee before: Suning Cloud Computing Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240409 Address after: 210000, 1-5 story, Jinshan building, 8 Shanxi Road, Nanjing, Jiangsu. Patentee after: SUNING.COM Co.,Ltd. Country or region after: China Address before: No.1-1 Suning Avenue, Xuzhuang Software Park, Xuanwu District, Nanjing, Jiangsu Province, 210000 Patentee before: Jiangsu Suning cloud computing Co.,Ltd. Country or region before: China |