CN108920134B - Method and device for automatically generating design document - Google Patents
Method and device for automatically generating design document Download PDFInfo
- Publication number
- CN108920134B CN108920134B CN201810678071.5A CN201810678071A CN108920134B CN 108920134 B CN108920134 B CN 108920134B CN 201810678071 A CN201810678071 A CN 201810678071A CN 108920134 B CN108920134 B CN 108920134B
- Authority
- CN
- China
- Prior art keywords
- data
- document
- fields
- module
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
Abstract
The invention relates to the technical field of Internet, in particular to a method and a device for automatically generating a design document, which are applied to a client terminal, wherein the client terminal is provided with a management analysis tool, and the method comprises the following steps: reading a data mapping document, wherein the data mapping document comprises a plurality of data tables, data mapping information and a processing step of the data tables, further acquiring all fields of each data table in the data mapping document as source fields, identifying and classifying the data tables according to the processing step of each data table in the data mapping document to obtain a data table classification list, further merging the fields according to the source fields and the data table classification list to obtain a data model document, and finally executing operation according to an appointed operation list and a data model document sequence. Therefore, in the embodiment of the invention, other design documents are automatically generated, so that the data flow is more transparent, the development efficiency is improved, and the subsequent system maintenance is facilitated.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a method and a device for automatically generating a design document.
Background
In the system development process, designers are required to write a plurality of design documents, such as data model design, data integration interface design, job dependency configuration, database initialization script development and other design works, and the design works are respectively subjected to loop iteration, so that the consistency among the design documents is also required to be manually maintained, and errors are easy to occur. Furthermore, there is no detailed design management analysis tool in the prior art to automatically structure data processing design information, and automatic analysis on design documents, such as automatic checking of design quality, analysis of data impact, etc., is not possible. Therefore, it is necessary to provide a method for automatically generating other design documents according to the basic document so as to make the flow of data in the system more transparent, and at the same time, to make the processing path of each item of data clearly visible, so as to improve the development efficiency.
Disclosure of Invention
The invention aims to provide a method for automatically generating a design document, so that data flow is more transparent, and development efficiency is improved.
Another object of the present invention is to provide an apparatus for automatically generating a design document, so that data flow is more transparent and development efficiency is improved.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical solutions:
in a first aspect, an embodiment of the present invention provides a method for automatically generating a design document, which is applied to a client terminal, where the client terminal is installed with a management analysis tool, and the method includes: reading in a data mapping document, wherein the data mapping document comprises a plurality of data tables, data mapping information and a processing step of the data tables; acquiring all fields of each data table in the data mapping document as source fields; according to the processing steps of the data tables in the data mapping document and the data mapping information, identifying and classifying the data tables to obtain a data table classification list; merging fields according to the source fields and the data table classification list to obtain a data model document; and executing the operation according to the specified operation list and the data model document sequence.
In a second aspect, an embodiment of the present invention further provides an apparatus for automatically generating a design document, where the apparatus is applied to a client terminal, and the client terminal is installed with a management analysis tool, and the apparatus includes: the system comprises a reading module, a processing module and a processing module, wherein the reading module is used for reading a data mapping document, and the data mapping document comprises a plurality of data tables, data mapping information and processing steps of the data tables; the acquisition module is used for acquiring all fields of each data table in the data mapping document as source fields; the arrangement module is used for identifying and classifying the data tables according to the processing steps of the data tables in the data mapping document and the data mapping information to obtain a data table classification list; the merging module is used for merging the fields according to the source fields and the data table classification list to obtain a data model document; and the execution module is used for executing the operation according to the specified operation list and the data model document sequence.
The embodiment of the invention provides a method and a device for automatically generating a design document, which are applied to a client terminal, wherein the client terminal is provided with a management analysis tool, and the method comprises the following steps: reading a data mapping document, wherein the data mapping document comprises a plurality of data tables and a processing step of the data tables, further acquiring all fields of each data table in the data mapping document as source fields, identifying and classifying the data tables according to the processing step of each data table in the data mapping document and data mapping information to obtain a data table classification list, further merging the fields according to the source fields and the data table classification list to obtain a data model document, and finally executing operation according to an appointed operation list and a data model document sequence. Therefore, in the embodiment of the invention, the data model document is generated through processing steps of fields contained in the data tables and the data tables in the data mapping document, the job list is executed according to the dependency relationship contained in the data model document, and other design documents are automatically generated, so that the data flow is more transparent, and the development efficiency is improved.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
FIG. 1 is a flow chart illustrating a method for automatically generating a design document according to an embodiment of the present invention.
Fig. 2 is a schematic diagram illustrating functional modules of an apparatus for automatically generating a design document according to an embodiment of the present invention.
The figure is as follows: 100-means for automatically generating a design document; 110-a read-in module; 120-an acquisition module; 130-arrangement module; 140-a merging module; 150-an execution module; 160-a tracking module; 170-analysis module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present invention, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
In the system development process, for example, a bank system is developed, a designer is usually required to manually write a large number of design documents, such as data model design, data integration interface design and the like, and the design documents have relevance, so that the manual writing mode is easy to repeat, errors are easily caused, and the comprehensive analysis and data tracking of the design documents are inconvenient. Therefore, the embodiment of the invention provides a method for automatically generating a design document, namely, other design documents are automatically generated according to a basic document, on one hand, errors are not easy to occur, on the other hand, the flow direction of data can be made to be clearer and more transparent, data analysis and tracking are convenient to carry out, and the development efficiency is improved.
Referring to fig. 1, a flowchart of a method for automatically generating a design document according to an embodiment of the present invention is shown, where the method for automatically generating a design document according to an embodiment of the present invention is applied to a client terminal, and a management analysis tool is installed on the client terminal, and the management analysis tool is a software program installed in the client terminal. The method comprises the following steps:
step S110, reading a data mapping document, wherein the data mapping document comprises a plurality of data tables, data mapping information and processing steps of the data tables.
Specifically, the data mapping document includes basic information, for example, the data mapping document includes a plurality of data tables, data mapping information, and processing steps between the plurality of data tables, where each data table includes a plurality of fields, and the processing steps between the plurality of data tables are: how fields of one data table are processed to get fields of another data table.
Step S120, all fields of each data table in the data mapping document are obtained as source fields.
Specifically, since the data mapping document includes a plurality of data tables, fields of each data table are acquired as source fields, and the use positions of the fields are recorded, so that the source fields of the whole system can be analyzed conveniently. The specific way of acquiring the fields in the data table is as follows: and reading query fields like from, where, join, group and the like in the SQL language from the data mapping process information to acquire the specific content of each field in the data table.
Step S130, arranging the data tables according to the processing steps of the data tables in the data mapping document to obtain a data table classification list.
Specifically, because the data mapping document includes the processing steps of the data table, for example, how the data a is processed to obtain the data table B, how the data table B is processed to obtain the data table C, a dependency relationship is established among the data table a, the data table B, and the data table C. And then arranging the data tables according to the processing steps among the data tables to obtain a data table classification list, namely, integrating and arranging the data tables which are randomly arranged according to the dependency relationship among the data tables so as to facilitate the subsequent analysis.
And step S140, merging the fields according to the source fields and the data table classification list to obtain a data model document.
That is, all the source fields in the data mapping document are obtained and analyzed to obtain the data classification list, and then the fields are merged according to the source fields and the data classification list to obtain the data model document. Specifically, the data model document determines that a data model needs to be built for a certain type of table according to the data table classification list, and then forms the data model document. And if the data model of a certain table needs to be merged, if the A table needs 2 fields of the B table, the C table needs 3 fields of the B table, and no repeated fields exist between the fields, 5 fields of the B table are automatically identified, so that the data model of the B table needs to have 5 fields, and if the fields are repeated, the fields are automatically merged and removed.
And step S150, executing the operation according to the data model document sequence according to the appointed operation list.
Specifically, the job list is a target table list, when the job list is actually executed, a data mapping document is a job, and if a target table of the data mapping document is a, the target table is identified as a target table in a table classification list, and B, C, D tables which are dependent on the target table can be identified from the processing step and the mapping process of the data mapping document, and the three tables are identified as interface tables for the first time; if B is the target table of another data mapping document, then B will be adjusted to the target table, and A, B are all target tables in the final table classification list. Because each target table has a corresponding job, the job A can be identified to depend on the job B, the job B can also be identified to depend on other jobs, and the rest is done in sequence, a job dependence list of the target table A can be formed, the job B also has a job dependence list, and the job execution system executes the jobs one by one according to the job dependence list and the dependence relation. In the past, the operation dependency relationship is manually judged, and an operation dependency table is manually filled in. When a large number of jobs are available, the dependency is complex, and a manual operation is very easy to make mistakes, so that the job cannot go down due to the fact that a certain table which is relied on is not executed first, and even the case that the A depends on the B occurs, and the A and AB tables depend on each other in the job chain of the B occurs, and the problem can be solved only by redesigning the job chain. The scheme provided by the embodiment of the invention automatically identifies the dependency relationship without manual processing, and can find the dependency relationship in time if deadlock occurs, thereby improving the working efficiency.
Therefore, according to the method for automatically generating the design document provided by the embodiment of the invention, other design documents such as a data table classification list, a data model document, an operation dependency list and the like are automatically generated through the basic data mapping document, so that the execution of the program can be automatically realized. Meanwhile, the processing paths of all fields in the data tables can be conveniently tracked, and if the upstream data is changed, the influence on the subsequent operation flow is generated, the data flow is more transparent, and compared with the manual design of designers, the development efficiency and the development quality of the data processing system are improved.
Referring to fig. 2, a functional module diagram of an apparatus 100 for automatically generating a design document according to an embodiment of the present invention includes a reading module 110, an obtaining module 120, an arranging module 130, a merging module 140, an executing module 150, a tracking module 160, and an analyzing module 170.
The reading module 110 is configured to read a data mapping document, where the data mapping document includes a plurality of data tables and processing steps of the data tables.
In the embodiment of the present invention, step S110 may be executed by the read-in module 110.
An obtaining module 120, configured to obtain all fields of each data table in the data mapping document as source fields.
In the embodiment of the present invention, step S120 may be performed by the obtaining module 120.
And the arranging module 130 is configured to arrange the plurality of data tables according to the processing steps of the data tables in the data mapping document to obtain a data table classification list.
In the embodiment of the present invention, step S130 may be performed by the arranging module 130.
And the merging module 140 is configured to merge fields according to the source field and the data table classification list to obtain a data model document.
In the embodiment of the present invention, step S140 may be performed by the merging module 140.
And the execution module 150 is used for executing the jobs according to the data model document sequence according to the specified job list.
In the embodiment of the present invention, step S150 may be executed by the execution module 150.
A tracking module 160 for tracking the processing path of each field in the plurality of data tables.
And the analysis module 170 is used for analyzing the influence of the upstream data change on the job execution flow.
Since the method for automatically generating the design document is described in detail, it will not be described herein.
In summary, the method and apparatus for automatically generating a design document according to the embodiments of the present invention are applied to a client terminal, where the client terminal is installed with a management analysis tool, and the method includes: reading a data mapping document, wherein the data mapping document comprises a plurality of data tables and a processing step of the data tables, further acquiring all fields of each data table in the data mapping document as source fields, arranging the data tables according to the processing step of each data table in the data mapping document to obtain a data table classification list, further merging the fields according to the source fields and the data table classification list to obtain a data model document, and finally executing operation according to a specified operation list and a data model document sequence. Therefore, in the embodiment of the invention, the data model document is generated through processing steps of fields contained in the data tables and the data tables in the data mapping document, the job list is executed according to the dependency relationship contained in the data model document, and other design documents are automatically generated, so that the data flow is more transparent, and the development efficiency is improved.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. A method for automatically generating a design document, which is applied to a client terminal, wherein the client terminal is provided with a management analysis tool, and the method comprises the following steps:
reading in a data mapping document, wherein the data mapping document comprises a plurality of data tables, data mapping information and a processing step of the data tables;
acquiring all fields of each data table in the data mapping document as source fields;
identifying and classifying the data tables according to the processing steps of the data tables in the data mapping document and the data mapping information to obtain a data table classification list;
merging fields according to the source fields and the data table classification list to obtain a data model document;
and executing the operation according to the specified operation list and the data model document sequence.
2. The method of claim 1, wherein the step of deriving a data model document based on the source field and the data table sorted list merge field comprises:
and merging the fields according to the reference relations of the source fields contained in different data tables to obtain the data model document.
3. The method of claim 1, wherein the step of executing jobs in accordance with the data model document order in accordance with a specified job manifest comprises:
generating a job dependency list according to the dependency relationship in the data model document according to the specified job list;
and executing the operation according to the operation dependency list sequence.
4. The method of claim 1, wherein the method further comprises:
tracking a processing path for each field in the plurality of data tables.
5. The method of claim 1, wherein the method further comprises:
and analyzing the influence of the upstream data change on the operation execution flow.
6. An apparatus for automatically generating a design document, applied to a client terminal, the client terminal being installed with a management analysis tool, the apparatus comprising:
the system comprises a reading module, a processing module and a display module, wherein the reading module is used for reading a data mapping document, and the data mapping document comprises a plurality of data tables, data mapping information and processing steps of the data tables;
the acquisition module is used for acquiring all fields of each data table in the data mapping document as source fields;
the arrangement module is used for identifying and classifying the plurality of data tables according to the processing steps of the data tables in the data mapping document and the data mapping information to obtain a data table classification list;
the merging module is used for merging the fields according to the source fields and the data table classification list to obtain a data model document;
and the execution module is used for executing the operation according to the data model document sequence according to the specified operation list.
7. The apparatus of claim 6, wherein the merging module is specifically configured to: and merging the fields according to the reference relations of the source fields contained in different data tables to obtain the data model document.
8. The apparatus of claim 6, wherein the execution module is specifically configured to: generating a job dependency list according to the dependency relationship in the data model document according to the specified job list;
and executing the operation according to the operation dependency list sequence.
9. The apparatus of claim 6, wherein the apparatus further comprises:
and the tracking module is used for tracking the processing path of each field in the data tables.
10. The apparatus of claim 6, wherein the apparatus further comprises:
and the analysis module is used for analyzing the influence of the upstream data change on the operation execution flow.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810678071.5A CN108920134B (en) | 2018-06-27 | 2018-06-27 | Method and device for automatically generating design document |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810678071.5A CN108920134B (en) | 2018-06-27 | 2018-06-27 | Method and device for automatically generating design document |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108920134A CN108920134A (en) | 2018-11-30 |
| CN108920134B true CN108920134B (en) | 2022-05-20 |
Family
ID=64423835
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810678071.5A Active CN108920134B (en) | 2018-06-27 | 2018-06-27 | Method and device for automatically generating design document |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108920134B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109933571B (en) * | 2019-01-23 | 2023-07-21 | 平安科技（深圳）有限公司 | Database design document generation method, device and computer readable storage medium |
| CN111857984A (en) * | 2020-06-01 | 2020-10-30 | 北京文思海辉金信软件有限公司 | Job calling processing method and device in bank system and computer equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1764684A1 (en) * | 2005-09-01 | 2007-03-21 | Alcatel | Data structure and a method for creating a documentation of a program |
| CN101055522A (en) * | 2007-05-31 | 2007-10-17 | 杭州华三通信技术有限公司 | Method and device for automatically generating unit test sample |
| CN107704440A (en) * | 2017-10-26 | 2018-02-16 | 河海大学 | A kind of method for extracting XML file needed for the generation of database data automatic batch |
| CN108153897A (en) * | 2018-01-10 | 2018-06-12 | 中国银行股份有限公司 | A kind of PLSQL program codes generation method and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9984175B2 (en) * | 2015-09-30 | 2018-05-29 | International Business Machines Corporation | Mapping non-generic markup language elements to generic object-oriented programming language objects |
-
2018
- 2018-06-27 CN CN201810678071.5A patent/CN108920134B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1764684A1 (en) * | 2005-09-01 | 2007-03-21 | Alcatel | Data structure and a method for creating a documentation of a program |
| CN101055522A (en) * | 2007-05-31 | 2007-10-17 | 杭州华三通信技术有限公司 | Method and device for automatically generating unit test sample |
| CN107704440A (en) * | 2017-10-26 | 2018-02-16 | 河海大学 | A kind of method for extracting XML file needed for the generation of database data automatic batch |
| CN108153897A (en) * | 2018-01-10 | 2018-06-12 | 中国银行股份有限公司 | A kind of PLSQL program codes generation method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108920134A (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106649455B (en) | Standardized system classification and command set system for big data development | |
| CN106687952B (en) | Technology for similarity analysis and data enrichment by using knowledge source | |
| Chen et al. | Integrating spreadsheet data via accurate and low-effort extraction | |
| Souza et al. | Provenance data in the machine learning lifecycle in computational science and engineering | |
| Misirli et al. | Studying high impact fix-inducing changes | |
| Kusumasari | Data profiling for data quality improvement with OpenRefine | |
| CN111125116B (en) | Method and system for positioning code field in service table and corresponding code table | |
| Rizzi et al. | Cubeload: A parametric generator of realistic OLAP workloads | |
| Souza et al. | Workflow provenance in the lifecycle of scientific machine learning | |
| JP2012164211A (en) | Software similarity evaluation method | |
| Baecker | Enhancing program readability and comprehensibility with tools for program visualization | |
| Chatzidimitriou et al. | Npm-miner: An infrastructure for measuring the quality of the npm registry | |
| CN108920134B (en) | Method and device for automatically generating design document | |
| CN110750297B (en) | Python code reference information generation method based on program analysis and text analysis | |
| CN109656928B (en) | Method and device for obtaining relationships between tables | |
| Kruse et al. | Estimating Data Integration and Cleaning Effort. | |
| Garro et al. | A new low-luminosity globular cluster discovered in the Milky Way with the VVVX survey | |
| US8892951B2 (en) | Fault localization for data-centric programs | |
| CN113986908B (en) | Industrial equipment data processing method, device and equipment | |
| CN107402920B (en) | Method and device for determining correlation complexity of relational database table | |
| Rizk et al. | Diftong: a tool for validating big data workflows | |
| CN110647518B (en) | Data source fusion calculation method, component and device | |
| US20210124799A1 (en) | Generation and application of object notation deltas | |
| US20210124798A1 (en) | Merging delta object notation documents | |
| BAYKAL et al. | Performance analysis of classification algorithms of several data mining softwares |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |