CN106991196B - Universal data tracing method and system - Google Patents

Universal data tracing method and system Download PDF

Info

Publication number
CN106991196B
CN106991196B CN201710301806.8A CN201710301806A CN106991196B CN 106991196 B CN106991196 B CN 106991196B CN 201710301806 A CN201710301806 A CN 201710301806A CN 106991196 B CN106991196 B CN 106991196B
Authority
CN
China
Prior art keywords
data
source
tracing
composition
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710301806.8A
Other languages
Chinese (zh)
Other versions
CN106991196A (en
Inventor
韩伟
张茜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur General Software Co Ltd
Original Assignee
Inspur General Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur General Software Co Ltd filed Critical Inspur General Software Co Ltd
Priority to CN201710301806.8A priority Critical patent/CN106991196B/en
Publication of CN106991196A publication Critical patent/CN106991196A/en
Application granted granted Critical
Publication of CN106991196B publication Critical patent/CN106991196B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2457Query processing with adaptation to user needs
    • G06F16/24573Query processing with adaptation to user needs using data annotations, e.g. user-defined metadata
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Debugging And Monitoring (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a universal data tracing method and a universal data tracing system, which are implemented by configuring a data composition tracing module for tracing the data composition of target data, and circularly calling for multiple times to trace the data composition layer by layer; and the data source tracing module is configured for tracing the source data information and displaying the source data information. Compared with the prior art, the universal data tracing method and the universal data tracing system can realize the tracing of new module data, greatly reduce the workload of secondary development, have strong practicability and wide application range, and have good popularization and application values.

Description

Universal data tracing method and system
Technical Field
The invention relates to the technical field of computers, in particular to a universal data tracing method and a universal data tracing system.
Background
In the existing computer technology, the sources of data are various, and many times, a user needs to know and analyze the data, for example, a user of ERP software needs to remember the source of each data, and can intuitively and clearly know where the current data comes from and what kind of processing the data comes from by memorizing the data source, but the tracing mode has a large error, and meanwhile, because the data source and the composition are not fixed, the data tracing code needs to be maintained frequently.
Based on the above, a universal data tracing method and a universal data tracing system are provided, so that the composition of data and the specific information of source data can be conveniently and visually traced, and a user can greatly conveniently know and analyze the data.
Disclosure of Invention
The technical task of the invention is to provide a universal data tracing method and a universal data tracing system aiming at the defects.
A general data tracing method is realized by the following steps,
the configuration data composition tracing module is used for tracing the data composition of target data, circularly calling for multiple times and tracing the data composition layer by layer;
and the data source tracing module is configured for tracing the source data information and displaying the source data information.
The data composition tracing module describes the relevant information of the target data to be traced in a target data table, wherein the target data table comprises:
an identifying data source field, which is used for retrospectively classifying data;
and the unique internal code forming field is transmitted to the data forming tracing module for searching specific forms.
The related information of the data composition tracing module is described in an interface table, the data composition corresponding to the target data is displayed through the data composition tracing module, and the source data in the composition is traced step by step for multiple times according to requirements, and the implementation steps are as follows:
1) the data composition tracing module is used for describing different data composition interfaces, and presetting data to form an interface related program set, a class name, a method name and parameter information;
2) and selecting a data composition interface according to a data source, and transmitting composition internal code parameters to trace the specific data composition.
The specific process of the step 1) is as follows: firstly, presetting unique identification GUID of data to a target data table, selecting target data according to an interface, matching the GUID value of the target data with the target data table, and finding out a data source and a constituent internal code corresponding to the target data.
The specific process of the step 2) is as follows: the interface information is formed by the preset data to an interface table, the tracing data forming interface is selected according to the data source obtained from the target data table, the formed internal code is used as a parameter to be transmitted to the selected data forming interface, the data forming interface obtains the required information from all relevant tables of the source data and returns the required information after processing, and the data forming corresponding to the target data can be displayed.
If the source data still has the data structure in the data structure, the data structure trace back module continues to call the data structure interface to trace back the data structure again, namely: selecting certain data from the data composition to continue to be used as target data, acquiring the GUID (user identifier) of the data, repeating the steps 1) and 2) to further trace the data composition of the data, and repeating the steps for tracing the data composition for multiple times.
The data source tracing module describes preset unit information in a source data table, the preset unit information comprises unit internal codes, an interface program set, interface types, interface method names and interface parameter information, and detailed and specific source data tracing information is selected from data composition and displayed.
Corresponding to the preset unit, the data source tracing module describes a plurality of data source interfaces, and the process of tracing the data source based on the data source interfaces is as follows:
each source data in the data structure has a unit internal code field, and a preset unit is selected according to the unit internal code of the selected source data;
in the data composition, each piece of source data has an attribution document internal code as a unique identifier, the attribution document internal code is used as a parameter and is transmitted into a data source interface corresponding to a preset unit, and a series of processing is carried out to trace out specific information of the source data and display the specific information.
The specific process of data source tracing is as follows: different preset units are described in the source data table, preset units in the source data table are selected by acquiring code fields in the preset units of selected source data in data composition, code fields in attribution units of the selected source data in the data composition are acquired and transmitted into interfaces corresponding to the preset units as parameters, and the data source interfaces can display more comprehensive contents of the data source after finding out detailed information from a data source related table and processing the detailed information.
A universal data tracing system comprises a data composition tracing module, a data composition tracing module and a data composition tracing module, wherein the data composition tracing module is used for tracing the data composition of target data, and is circularly called for many times, and the data composition is traced layer by layer;
and the data source tracing module is used for tracing the source data information and displaying the source data information.
Compared with the prior art, the universal data tracing method and the universal data tracing system have the following beneficial effects:
the invention relates to a universal data tracing method and a system, which are beneficial to a user to quickly and intuitively know the problem of complicated business logic processing behind a simple number so as to know the corresponding business; the invention has good usability and expandability for developers, the developers can easily expand, the tracing of new module data is realized, the workload of secondary development is greatly reduced, the practicability is strong, the application range is wide, and the invention has good popularization and application values.
Drawings
FIG. 1 is a flow chart of the implementation of the present invention.
Detailed Description
The invention is further described with reference to the following figures and specific embodiments.
As shown in fig. 1, the present invention provides a general data tracing method, where a data formation interface is extremely large, which is convenient for tracing the data formation of target data, and can be called circularly for many times, and the data formation is traced layer by layer. The data source interface is greatly convenient for tracing the detailed information of the source data, and all information of the source data needing to be known can be easily displayed on the same module or across modules without entering the function or the module where the data source is located for checking.
The realization process is as follows,
the configuration data composition tracing module is used for tracing the data composition of target data, circularly calling for multiple times and tracing the data composition layer by layer;
and the data source tracing module is configured for tracing the source data information and displaying the source data information.
The data composition tracing module describes the relevant information of the target data to be traced in a target data table, wherein the target data table comprises:
an identifying data source field, which is used for retrospectively classifying data;
and the unique internal code forming field is transmitted to the data forming tracing module for searching specific forms.
The related information of the data composition tracing module is described in an interface table, the data composition corresponding to the target data is displayed through the data composition tracing module, and the source data in the composition is traced step by step for multiple times according to requirements, and the implementation steps are as follows:
1) the data composition tracing module is used for describing different data composition interfaces, and presetting data to form an interface related program set, a class name, a method name and parameter information;
2) and selecting a data composition interface according to a data source, and transmitting composition internal code parameters to trace the specific data composition.
The specific process of the step 1) is as follows: firstly, presetting unique identification GUID of data to a target data table, selecting target data according to an interface, matching the GUID value of the target data with the target data table, and finding out a data source and a constituent internal code corresponding to the target data.
The specific process of the step 2) is as follows: the interface information is formed by the preset data to an interface table, the tracing data forming interface is selected according to the data source obtained from the target data table, the formed internal code is used as a parameter to be transmitted to the selected data forming interface, the data forming interface obtains the required information from all relevant tables of the source data and returns the required information after processing, and the data forming corresponding to the target data can be displayed.
If the source data still has the data structure in the data structure, the data structure trace back module continues to call the data structure interface to trace back the data structure again, namely: selecting certain data from the data composition to continue to be used as target data, acquiring the GUID (user identifier) of the data, repeating the steps 1) and 2) to further trace the data composition of the data, and repeating the steps for tracing the data composition for multiple times.
The data source tracing module describes preset unit information in a source data table, the preset unit information comprises unit internal codes, an interface program set, interface types, interface method names and interface parameter information, and detailed and specific source data tracing information is selected from data composition and displayed.
Corresponding to the preset unit, the data source tracing module describes a plurality of data source interfaces, and the process of tracing the data source based on the data source interfaces is as follows:
each source data in the data structure has a unit internal code field, and a preset unit is selected according to the unit internal code of the selected source data;
in the data composition, each piece of source data has an attribution document internal code as a unique identifier, the attribution document internal code is used as a parameter and is transmitted into a data source interface corresponding to a preset unit, and a series of processing is carried out to trace out specific information of the source data and display the specific information.
The specific process of data source tracing is as follows: different preset units are described in the source data table, preset units in the source data table are selected by acquiring code fields in the preset units of selected source data in data composition, code fields in attribution units of the selected source data in the data composition are acquired and transmitted into interfaces corresponding to the preset units as parameters, and the data source interfaces can display more comprehensive contents of the data source after finding out detailed information from a data source related table and processing the detailed information.
In the invention, the TargetData table is used to record the basic information of the target data to be traced, especially the Source of the data and the composite field of the composition code. And acquiring the GUID value of the target data to be traced, matching the GUID field in the TargetData table, and further acquiring the corresponding Source and Complex field values. The TargetData table structure is as follows.
Figure BDA0001284409680000041
2. Recording basic information of a data constitution Interface by using an Interface table, matching a Source value in the Interface table according to the Source value acquired in TargetData, determining a data constitution Interface to be called, transmitting a composite value acquired in TargetData into the Interface as a main parameter, and determining a data constitution range to show the data constitution of target data. The Interface table structure is as follows:
Figure BDA0001284409680000042
Figure BDA0001284409680000051
3. selecting certain data of the data composition Interface as target data, acquiring a GUID value of the data composition Interface, matching the target data with the GUID in the targetData table again, acquiring a Source value and a composition value, further matching the Source value in the Interface table, and transmitting a composition parameter to the selected data composition Interface to finish the tracing of secondary composition, wherein if necessary, the three-time, four-time and five-time … … data composition tracing can be continuously realized until the target data does not have data composition any more.
4. And recording the information of the preset units by using a Source data table, acquiring the in-unit code DYNM of the source data in the data composition to select the preset units, acquiring the in-document code DJNM value of the source data in the data composition as a main parameter, and transmitting the main parameter into a data source interface to display more specific information of the source data. The SourceData table structure is as follows:
name (R) Field(s) Data type Remarks for note
Attribution module SSMK VARchar(4) Source data attribution module
Unit inner code DYNM VARchar(10) Main key, preset unit code
Unit numbering DYBH VARchar(40) Preset unit numbering
Unit name DYMC VARchar(100) Preset unit name
Program set Assembly VARchar(300) Program set information of source data interface
Class I Class VARchar(300) Class information of source data interface
Method of producing a composite material Method VARchar(300) Method information of source data interface
Parameter(s) Paramaters VARchar(1024) Parameter information of source data interface method
The invention is further explained by the following example of cross-module tracing data:
and (4) collecting a piece of data A from the network report document into the budget table sample, and tracing the data A in the budget table sample.
And acquiring data A from the interface to uniquely identify a GUID (GUID) ═ 80cae68b-70e3-4763-8ab2-8e1397907565 ', finding a Source of the data in TargetData (Source) ═ 3 ' according to the GUID value, and forming an inner code composite ═ 00000000000000000001 '.
2. Finding Interface information corresponding to a row with Source of 3 in an Interface table, where Assembly ═ genersoft.tb.pub.control ', Class ═ genersoft.tb.pub.control.tbzxsjgc',
Method=‘LCGC’,Parameters=‘[psCompose]::[psMode]’。
the reflection calls the interface method to enter the composite value, the main method is as follows:
Figure BDA0001284409680000052
Figure BDA0001284409680000061
Figure BDA0001284409680000071
3. the Method comprises the steps of tracing the data constitution of target data through data constitution interface calling, selecting a piece of source data B in a constitution interface, obtaining a unit inner code DYNM ═ RO 'and a document inner code DJNM ═ f2ddebfd-21c7-4db6-8042-0e2ce5c3e7 cc' of the source data B, determining a preset unit needing to be used in a sourceData table according to DYNM, obtaining interface information asset ═ GenersofRO.YWCL.FormConroller.dll ', Class ═ GenersofRO.YWCL.FormController.BillView', Method ═ View Bi ', Parameters ═ BillId: [ psMode ]', and transferring an DJNM value as a DJparameter interface. The data source interface is also called by reflection as the data forming interface, and the detailed information of the source data B in the network report module is acquired and returned to the budget interface for direct display.
A universal data tracing system comprises a data composition tracing module, a data composition tracing module and a data composition tracing module, wherein the data composition tracing module is used for tracing the data composition of target data, and is circularly called for many times, and the data composition is traced layer by layer;
and the data source tracing module is used for tracing the source data information and displaying the source data information.
The present invention can be easily implemented by those skilled in the art from the above detailed description. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the basis of the disclosed embodiments, a person skilled in the art can combine different technical features at will, thereby implementing different technical solutions.
In addition to the technical features described in the specification, the technology is known to those skilled in the art.

Claims (5)

1. A universal data tracing method is characterized in that the method is realized by the following steps,
the configuration data composition tracing module is used for tracing the data composition of target data, circularly calling for multiple times and tracing the data composition layer by layer;
the data source tracing module is configured and used for tracing source data information and displaying the source data information;
the data composition tracing module describes the relevant information of the target data to be traced in a target data table, wherein the target data table comprises:
an identifying data source field, which is used for retrospectively classifying data;
the unique internal code field is formed and is transmitted to the data forming and tracing module for searching specific forms;
the related information of the data composition tracing module is described in an interface table, the data composition corresponding to the target data is displayed through the data composition tracing module, and the source data in the composition is traced step by step for multiple times according to requirements, and the implementation steps are as follows:
1) the data composition tracing module is used for describing different data composition interfaces, and presetting data to form an interface related program set, a class name, a method name and parameter information;
2) selecting a data forming interface according to a data source, and transmitting a forming internal code parameter to trace a specific data forming;
the specific process of the step 1) is as follows: firstly, presetting unique identification GUID of data to a target data table, selecting target data according to an interface, matching the GUID value of the target data with the target data table, and finding out a data source and a constituent internal code corresponding to the target data;
the specific process of the step 2) is as follows: the interface information is formed by the preset data to an interface table, the tracing data forming interface is selected according to the data source obtained from the target data table, the formed internal code is used as a parameter to be transmitted to the selected data forming interface, the data forming interface obtains the required information from all relevant tables of the source data and returns the required information after processing, and the data forming corresponding to the target data can be displayed.
2. The method as claimed in claim 1, wherein when there is still data structure in the source data in the data structure, the data structure trace back module continues to call the data structure interface to trace back the data structure again, that is: selecting certain data from the data composition to continue to be used as target data, acquiring the GUID (user identifier) of the data, repeating the steps 1) and 2) to further trace the data composition of the data, and repeating the steps for tracing the data composition for multiple times.
3. The universal data tracing method according to claim 1, wherein the data source tracing module describes preset unit information in a source data table, the preset unit information includes unit internal code, interface program set, interface class, interface method name and interface parameter information, and a detailed and specific source data tracing information is selected and displayed in data composition.
4. The method according to claim 1, wherein the data source trace back module describes a plurality of data source interfaces corresponding to the preset unit, and the process of tracing back the data source based on the data source interfaces comprises:
each source data in the data structure has a unit internal code field, and a preset unit is selected according to the unit internal code of the selected source data;
in the data composition, each piece of source data has an attribution document internal code as a unique identifier, the attribution document internal code is used as a parameter and is transmitted into a data source interface corresponding to a preset unit, and a series of processing is carried out to trace out specific information of the source data and display the specific information.
5. The general data tracing method according to claim 4, wherein the specific process of data source tracing is as follows: different preset units are described in the source data table, preset units in the source data table are selected by acquiring code fields in the preset units of selected source data in data composition, code fields in attribution units of the selected source data in the data composition are acquired and transmitted into interfaces corresponding to the preset units as parameters, and the data source interfaces can display more comprehensive contents of the data source after finding out detailed information from a data source related table and processing the detailed information.
CN201710301806.8A 2017-05-02 2017-05-02 Universal data tracing method and system Active CN106991196B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710301806.8A CN106991196B (en) 2017-05-02 2017-05-02 Universal data tracing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710301806.8A CN106991196B (en) 2017-05-02 2017-05-02 Universal data tracing method and system

Publications (2)

Publication Number Publication Date
CN106991196A CN106991196A (en) 2017-07-28
CN106991196B true CN106991196B (en) 2020-05-05

Family

ID=59417241

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710301806.8A Active CN106991196B (en) 2017-05-02 2017-05-02 Universal data tracing method and system

Country Status (1)

Country Link
CN (1) CN106991196B (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108255988A (en) * 2017-12-28 2018-07-06 新智数字科技有限公司 The processing method and processing system of data
CN108874871B (en) * 2018-04-25 2020-08-07 中国科学院光电研究院 Real-time PNT service data tracing method and device
CN109101440B (en) * 2018-08-01 2023-08-04 浪潮软件集团有限公司 Method for processing trace data concurrent request based on JVM (Java virtual machine) cache
CN109471918B (en) * 2018-11-09 2020-11-10 医渡云(北京)技术有限公司 Intermediate field tracing method, device and medium
CN110008231B (en) * 2019-03-19 2021-04-27 福建省天奕网络科技有限公司 MySQL data backtracking method and storage medium
CN112988768B (en) * 2019-12-18 2024-01-26 中国电信股份有限公司 Method and device for realizing data tracing
CN112800290B (en) * 2021-03-17 2021-08-13 深圳赛动智造科技有限公司 Tracing data acquisition method, device and equipment
CN117094667A (en) * 2023-08-07 2023-11-21 山东浪潮数字商业科技有限公司 System and method for realizing universal traceability of various industries through flow configuration

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104573115A (en) * 2015-02-04 2015-04-29 新余兴邦信息产业有限公司 Method and system for achieving integration interface supporting operation of multi-type databases
CN105550220A (en) * 2015-12-03 2016-05-04 浪潮通用软件有限公司 Fetching method and apparatus for heterogeneous system
CN105677347A (en) * 2016-01-05 2016-06-15 浪潮通用软件有限公司 Method and device for processing data

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7774305B2 (en) * 2004-03-15 2010-08-10 Ramco Systems Limited System and method for auditing enterprise data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104573115A (en) * 2015-02-04 2015-04-29 新余兴邦信息产业有限公司 Method and system for achieving integration interface supporting operation of multi-type databases
CN105550220A (en) * 2015-12-03 2016-05-04 浪潮通用软件有限公司 Fetching method and apparatus for heterogeneous system
CN105677347A (en) * 2016-01-05 2016-06-15 浪潮通用软件有限公司 Method and device for processing data

Also Published As

Publication number Publication date
CN106991196A (en) 2017-07-28

Similar Documents

Publication Publication Date Title
CN106991196B (en) Universal data tracing method and system
CN108090073B (en) Configurable bill of material conversion method and device
CN111177134B (en) Data quality analysis method, device, terminal and medium suitable for mass data
CN112035667A (en) Knowledge graph display method and device and terminal equipment
CN110489481B (en) Data analysis method and device for industry data and data analysis server
CN101625738A (en) Method and device for generating context-aware universal workflow application
CN107015987B (en) Method and equipment for updating and searching database
CN106528511B (en) Form analysis method and device
CN102722537A (en) Database test data generation method and system thereof
CN109902117A (en) Operation system analysis method and device
CN111414410B (en) Data processing method, device, equipment and storage medium
CN111061733B (en) Data processing method, device, electronic equipment and computer readable storage medium
CN111737148A (en) Automatic regression testing method and device, computer equipment and storage medium
CN109947797B (en) Data inspection device and method
CN107291951B (en) Data processing method, device, storage medium and processor
CN110134721A (en) Data statistical approach, device and electronic equipment based on bitmap
CN116089417A (en) Information acquisition method, information acquisition device, storage medium and computer equipment
CN115543428A (en) Simulated data generation method and device based on strategy template
CN114862180A (en) Product quality data analysis feedback method and system based on full life cycle
CN112052257A (en) Service processing method, device and equipment
WO2016090352A1 (en) Customized synthetic data creation
CN110704523A (en) Data export method, device, equipment and computer readable storage medium
CN114201545B (en) Data processing method and device, terminal equipment and storage medium
CN114925145B (en) Data storage method and device, storage medium and electronic equipment
CN111143356A (en) Report retrieval method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200408

Address after: 250100 Ji'nan high tech Zone, Shandong, No. 1036 wave road

Applicant after: INSPUR GENERAL SOFTWARE Co.,Ltd.

Address before: 250100, No. 2877, fairway, Sun Town, Ji'nan hi tech Zone, Shandong

Applicant before: SHANDONG INSPUR GENESOFT INFORMATION TECHNOLOGY Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant