CN114297330A

CN114297330A - Data map generation method and device

Info

Publication number: CN114297330A
Application number: CN202111636590.3A
Authority: CN
Inventors: 王莉莉; 姜海涛; 陈权
Original assignee: Dms Corp
Current assignee: Dms Corp
Priority date: 2021-12-28
Filing date: 2021-12-28
Publication date: 2022-04-08

Abstract

A data map generating method includes defining data storage and work flow corresponding to actual service to form service module, defining relation data format of service module automatically, applying relation data format to service module data storage, carrying packed service data by main key to complete correlation of one or more service modules, using relation data format to determine correlation with other service modules when service module is executed, executing application of data and relation data format in service module based on service module to form and display relation map between current service module record and data storage and work flow corresponding to actual service.

Description

Data map generation method and device

Technical Field

The invention relates to the field of data management, in particular to a data map generation method and device.

Background

Large engineering projects produce large quantities of structured records and unstructured documents during the full lifecycle of investigatable, bidding, contract signing, contract execution, quality security, payment, alteration, settlement, and ending. The records and the documents generated by each service do not exist independently, most data have the requirements of mutual reference, mutual reading and mutual writing, and a user needs to record the interaction track, namely a data map, besides the requirement of realizing data interaction among different services. Generally, the interaction operation and the interaction track between the data are realized through code development, through statements such as database select and update, and all transaction log records and statistics are collected. If the user service changes, the code needs to be modified and deployed again, the period is long, the influence is large, a certain relation record is easy to lose, and the data map is incomplete and inaccurate.

Furthermore, on the one hand, due to the differences in understanding to the person skilled in the art; on the other hand, since the applicant has studied a great deal of literature and patents when making the present invention, but the disclosure is not limited thereto and the details and contents thereof are not listed in detail, it is by no means the present invention has these prior art features, but the present invention has all the features of the prior art, and the applicant reserves the right to increase the related prior art in the background.

Disclosure of Invention

The invention provides a data map generation method aiming at the defects of the prior art, which comprises the following steps of defining data storage and a working process corresponding to actual business to form business modules, automatically defining the relational data formats of the business modules, wherein the definition object of each relational data format at least comprises processing structured data and unstructured data and recording the relational data among the businesses, applying the relational data formats to the data storage of the business modules, bringing the packed business data in through a main key to complete the association of one or more business modules, determining the association with other business modules by using the relational data formats when executing the business modules, executing the application of the data and the relational data formats in the business modules based on the business modules, and forming and displaying all the relational maps among the records of the current business modules.

The method comprises the steps of associating the rest of associated primary keys generated in the later period of the workflow based on an initial primary key to realize automatic real-time updating of a relational data format, possibly generating new primary keys capable of being used for representing the business module by the subsequent workflow, possibly creating or updating and acquiring the primary keys in the later period of the workflow, and based on distinguishing the primary keys in the flow time sequence, determining the secondary expansion of a retrieval result based on the time sequence of a given retrieval element on the workflow when performing back retrieval by using a data map. For example, an initial main key a corresponds to three stored data a, B and c, in the development of a workflow, a main key B appears, which corresponds to three newly added stored data e, f and g, if a data map is used for reverse search by taking the stored data g as a search element in a later period, the main key B which is in the same time sequence with the stored data g is selected as a first-stage search result, e and f related to the main key B can also be displayed in the same stage, and simultaneously, the main key a and the stored data of the same stage can be displayed in a second stage based on the relationship between the main key B and the main key a or the stored data related to the key a. According to the scheme, a new primary key can be automatically generated along with the development of a business process for all processes of a business, the new primary key can be associated with the primary key at the front of the process, data storage appearing according to time sequence in the process can be associated according to the corresponding primary key, and the data structure is reserved while the business full-process data storage and the primary key are connected in series. In addition, for different process stages (such as an item establishing stage, a data changing stage, a contract stage, an implementation stage, etc.) of a project, different personnel may perform maintenance and management on workflow data, in the subsequent stages, data that a business data record may refer to and be synchronously updated to one or more previous workflow stages is generated, conventionally, associated data in the business data record is manually filled into corresponding workflow record fields, and in the subsequent retrieval of some data records in the business data record, due to different retrieval requirements (such as the requirement of retrieving a contract name, contract amount changing information, contract version time, etc.) provided by a user or a client, independent programming is often required to be performed according to the given retrieval requirements to capture relevant data in past information, the obtained result has no relationship with the previous workflow itself and other data in the workflow, the search structure is disordered and complicated, and the method cannot be well applied to subsequent data analysis. According to the scheme, the relation data format is automatically defined when the stored data of each corresponding workflow is generated, if one or more data in the prior workflow are used in the subsequent new workflow, the related data in the prior workflow can be directly imported into the data storage of the workflow by using the relation data format, the whole process is automatically completed, and manual association is not needed; meanwhile, when data reverse retrieval is performed subsequently, a plurality of retrievers described by the relational data format are directly packaged based on retrieval requirements, namely selectors, only one primary key value (such as a contract number) needs to be provided, so that the stored data which accord with the retrieval requirements and accord with the related relational data format in all the previous workflows can be obtained, the stored data are respectively kept associated with other data in the workflows and also kept associated with other workflows, and the retrieval results can be displayed to users in a hierarchical tiling visualization mode.

The relation data format for defining the structured data, the unstructured data and the business relation data is capable of associating each kind of data with the main key, so that when a data map is used for reverse retrieval in the later period, the structured and unstructured data and even the business relation data can be directly used for reverse retrieval, at least one main key directly associated with the data in the business module can be obtained, and all stored data of the same business as the retrieval element can be obtained through association of the main key with the main key in other flows in the business module. For example, when the search element is unstructured data of the video type, at least one pre-associated primary key is obtained by searching the value/name/extracting video content of the video file MD5, and a plurality of stored data of the same level can be obtained firstly based on the primary key, and then all data of the service module can be obtained secondly. Compared with the conventional means that only primary key values can be used for retrieval, or only the data can be displayed when the structured or unstructured data is used for retrieval instead of the association with other data, the scheme can realize the back check with data association based on any structured or unstructured data, so that the data management is more convenient, clear, rapid and direct.

The association of a plurality of business modules is based on the main key, so that even under the condition that one or a plurality of structured or unstructured data in another business module are referred to in other business modules, when the reverse search by using the data map is executed, the search results of the plurality of business modules based on one structured or unstructured data as a search element can not be obtained simultaneously, and the trouble of the attribute of the data for a user is caused. The method of packing the primary key adopted by the scheme can directly search all the stored data in the service module where the primary key directly associated with the retrieval element is located in the first level when the reverse retrieval is executed, and then obtain other service modules associated with the retrieval element based on the association of the primary key and other service modules.

The data map provided by the scheme can perform reverse retrieval based on any one or more structured or unstructured data, can display a plurality of associated stored data represented by the primary key in a level expansion mode, and can search the primary key of other business modules associated with the retrieval element in a primary key association mode. The whole set of data map is visual and operable, the main key is used as an expansion node, all the stored data associated with the main key and the main keys in other processes associated in the business module or the associated main keys in other business modules can be expanded and acquired by clicking, and the corresponding stored data can also be acquired by expanding the other main keys. The data map produced by the scheme realizes strong association of data in data management, can adopt independent data (including structured or unstructured data) of non-primary keys to carry out reverse retrieval, and can expand and display the retrieval result and stored data of the same level or associated primary keys according to the association with at least one primary key of at least one business module.

Preferably, the data storage form includes a plurality of data formats and data values, and the workflow at least stores business transaction approval process data corresponding to actual business.

The relation format data is generated based on business approval, each business approval process can be managed by different personnel, a plurality of main keys and data (including structured data and unstructured data) in various formats stored in a mode of being generalized depending on the main keys may exist in one business approval process, and the data of each business module are stored in such a way, so that a new business module which needs to be updated by utilizing the data stored in the previous business module in the follow-up generation can be conveniently used for searching the corresponding previous data field based on the determined data storage format, and the operations of direct reference, synchronization, updating, calculation and the like between the same-kind data of the previous business module and the new business module in the new business module can be realized without manual addition.

Preferably, when the relational data format of the service module is automatically defined, the service module is packaged into a data format definition, and the display form is the primary key of the service module data table.

The business module is packed based on the primary key, which is beneficial to using the representative primary key to frame and select relatively disordered structured data or unstructured data when defining the relation data format of the business module; here, packing the primary key in the formed data format definition based on the requirement (for example, the generation requirement of the subsequent new business process or the reverse retrieval requirement based on the data map) is equivalent to forming a selector capable of being associated with the corresponding primary key value in the previous business process and the related stored data thereof, and based on the selector, if the newly generated business process has at least one primary key which is the same as or related to the previous business process and is formed into the selector based on the requirement, the selector can be directly used for extracting the corresponding associated data from at least one associated previous business process and filling the corresponding associated data into the business process based on the relational data format definition.

Preferably, the processing flow of the relationship data between the structured data source and the unstructured data and the recording service is as follows: reading all structured data from the business of the relation connecting party, writing the edited and updated data into the corresponding attribute field in the business of the relation party, reading the unstructured document attachment of the relation party into the business and recording the business record relation at the two ends of the relation.

Based on the updating of the structured data and the unstructured data brought by the main key in the relation service and the main service, the updated data in the main service is associated with the same data in the relation service, so that when the reverse retrieval is carried out on the practical structured data or the unstructured data, the related stored data in the main service can be searched based on the association relation, and simultaneously, the same data in other associated services and other data having association with the same data can be searched.

Preferably, the data map is generated and presented in the form of a circle-line graph, wherein the points of each map represent a piece of business data.

The data map can be developed and visually presented in a user view according to levels, results can be displayed to the user according to visualization, developability and exhaustion based on requirements on user retrieval elements and reverse retrieval of the relational data format of the mode, association processes, association services, reference relations, updating relations and calculation relations of association data are clearly shown in a view mode, and the user can conveniently analyze a retrieval structure globally, locally and hierarchically to form better management on project data.

Preferably, a data map generating device is provided, which at least comprises a business module forming module, a relation data format defining module, a data processing component and a relation map forming module, wherein the business module forming module defines the business module based on the data storage and the work flow corresponding to the actual business, the relation data format defining module automatically defines the relation data format of the business module, the display form is the main key of the business module data table, the relation data format is applied to the business module data storage, and the data map module executes the application of data and the relation data format in the service module based on the service module to form and display all relation maps recorded by the current service module.

Preferably, the packaging of the service module into a relationship data format definition is implemented by a data processing component in the relationship definition module, and the processing flow is as follows: reading all structured data from the business of the relation connecting party, writing the edited and updated data into the corresponding attribute field in the business of the relation party, reading the unstructured document attachment of the relation party into the business and recording the business record relation at the two ends of the relation.

The invention has the advantages that:

the invention provides a new method for realizing the definition of the incidence relation of the service data, namely, the definition of the relation data format. The data format supports selection of other service data, records the incidence relation, controls the read-write trend of the data, completely records the interaction track among different services, and can automatically form a complete data map. In the actual business management, a plurality of business processes and a plurality of data are directly associated with each other, and the definition of the association relationship is integrated into the actual business operation through the relationship definition, so that manual tracking is avoided.

Drawings

FIG. 1 is a diagram of the protocol steps for a preferred embodiment of the present invention;

FIG. 2 is a pictorial illustration of data for a preferred embodiment provided by the present invention;

Detailed Description

This is explained in detail below with reference to fig. 1.

Example one

The invention provides a data map generation method, which is based on business module management, realizes management data and flow of each management object and business in the business module management process, records and tracks data such as flow change of different business data, version change, change of association relation (association ID number and association condition) with other business modules and the like. And storing the change data and the association relation of the tracking record in a database, and providing a full-path, complete-relation and traceable engineering data map through graphical display.

The method comprises the following steps:

1. defining a service module class: and defining data storage and a workflow corresponding to the actual business. Various data formats and data values are stored in the form, and business transaction approval process data corresponding to actual business are stored in the workflow. And combining the two to complete the definition of the service module. No matter the size of the service and the complexity, the data structure is defined as a service module data table structure.

The actual business is a work item, which at least has several processes of item generation, item process, stage state, stage result or problem result, and at least needs a work processing party, which can be a person or a program. At least one record document is generated in the business, and in fact, besides simple things, many or even a relatively large number of record documents are often generated. The work items are divided according to the size of the work, a plurality of work items can be in a parallel relation or in an inclusive relation, the items of the large project can comprise a plurality of sub-items according to different defined stage items, each sub-item can also be crossed or unrelated, a record document in one large project should comprise record documents of all the constituent sub-items, and data in the documents can be crossed, read, written and referred to.

Based on the management of service data and the analysis requirement of the whole large service, a large amount of service data needs to be stored, classified, extracted, written, analyzed and interacted, in the aspect of storing service data, the embodiment defines a service module as two blocks of data storage and workflow storage, the written object of data storage is a large amount of record document data generated in the service, for example, data such as numerical quantitative reports, data tables, analysis tables, arrangement tables, statistical tables and the like, or text documents, conference records, research reports, notification documents and the like which are set forth in a literal way, and program data record documents such as a function library, an encoding library, a basic program instruction library and the like may be included in the programming service. The objects stored in the workflow are data of the business object approval process, and specifically can be approval materials, approval comment reply letters, approval pass certificates, approval personnel information and the like.

In the data storage, the storage is performed according to a data format and a data value, the data format is a one-to-one coding table according to the attribute of each data, for example, if one data is data describing money amount, the attribute is money amount value, correspondingly, when the data is written into the storage, the coding of the data format represents money amount, and the data value only needs to input a numerical value without any unit.

2. Automatically defining a relational data format: and after the definition of the service module is finished, automatically defining the relation data format of the corresponding service module, packaging the service module into a data format definition, and displaying the data format definition in the form of a service module data table main key.

By database primary key is meant a column or combination of columns whose value uniquely identifies each row in the table and whose role is to enforce the physical integrity of the table. The primary key is used for the external key association of other tables, and the modification and deletion of the record. Creation of the primary key may be performed by defining PRIMARY KEY constraints when creating and modifying the table. The primary key is a unique identifier that can determine a record, for example, a record includes an identification number, a name, and an age, and then the identification card can be set as the primary key of the record. The relational data format refers to a data storage format, and is divided into a numeric type, a boolean type, a character type, and the like, the numeric type is a numeric value expressed according to a certain binary relation, such as a numeric value expression in a binary system, the boolean type is a type variable type of VB, C + + and the like in programming, and has two values of false and true, and the character type is a special character expressed by binary coding, such as latin letters and the like translated by referring to ASCII coding. The business module is packaged into a data format definition, the data format of the relation between the data in the business module is automatically defined to form a uniform data format definition, and all the data (storage data and workflow data) in the business module can be included in the data format definition.

3. A packaging relationship data format functional component: the definition object of each relational data format comprises a group of functional components: reading all structured data from the business of the relation connecting party, writing the edited and updated data into the corresponding attribute field in the business of the relation party, reading the unstructured document attachment of the relation party into the business and recording the business record relation at the two ends of the relation.

Structured data, i.e. row data, is stored in a database, and implemented data can be logically expressed by a two-dimensional table structure, and an unstructured database refers to a database whose field lengths are variable, and the records of each field can be composed of repeatable or non-repeatable subfields, such as data information including all forms of documents, texts, photos, graphics, sound waves, images and the like.

4. Application relationship data format: and applying the relational data format to the business module data storage, and bringing the packed business data into the main key to complete the association of one or more business modules. And the relation between the business modules of each business module is represented by a data format of an automatically generated relation type.

5. The business module executes: and the business module operates, stores the business data and determines the association with other business modules by using a relational data format. One business module supports the use of multiple relationship data. With the increasing of the service data, the content of the relationship data is increased, and the record of the data map is gradually expanded.

During normal operation of the business module, operations such as modification, update, increase and decrease of data stored in the business module can be generated, data of other related business modules can be referred in the process of data change, and the relevance between the business module and other business modules is determined through a relational data format. The relationship data is correspondingly expanded along with the continuous increase and change of the business data.

6. Establishing a data map: and displaying all the relation maps between the current business module records in a circle-line graph mode based on the application of the business module execution data and the relation data format in the business module. Each map point represents a piece of service data, and in the details of each map point, the detailed information of the service data is displayed.

The data map can be a visualized display form, wherein a circle (or a point form) represents one service data, other circles or points connected by surrounding radial lines represent associated service data of the selected service data, and the associated part is in a relational data format. The data map generated by the method can freely select the search items based on the requirements of users at the later stage, can directly search the data generating relevance in all processes based on the selected search items (the main key, the structured data and the unstructured data can be used as the search items) based on the relation data format which is automatically generated and associated in advance, and can be displayed on the data map in a visual mode according to the process items and the relevance relations, so that the data management is higher in intuitiveness, and the management efficiency and the effect are better.

Example two

The invention also provides a data map generation device, which is based on the business module management, realizes the management data and the flow of each management object and business in the business module management process, records and tracks the flow change of different business data, version change, the change of the association relation (association ID number and association condition) between other business modules and other data. And storing the change data and the association relation of the tracking record in a database, and providing a full-path, complete-relation and traceable engineering data map through graphical display. The data processing scheme adopted by the invention is substantially equal to the first embodiment, but in the first embodiment, an object of a certain step in the specific execution scheme is given a device meaning, and in the present embodiment, the data map generating device at least comprises a business module forming unit, a relation data format defining unit, a data processing component and a relation map forming unit. These units or components can be configured as separate data processing units in the device, such as a processor module which is responsible for specially calculating and processing single services, a control module which is responsible for specially allocating and storing resources and retrieving and classifying algorithms, and the like, and finally, the data map which is output to the outside and visualized can be output to the outside through screens of mobile devices, computers, televisions and other devices, and can also be output to the outside based on a paper platform.

The method comprises the following steps:

1. defining a service module class: the service module composition module defines data storage and a work flow corresponding to the actual service. Various data formats and data values are stored in the form, and business transaction approval process data corresponding to actual business are stored in the workflow. And combining the two to complete the definition of the service module. No matter the size of the service and the complexity, the data structure is defined as a service module data table structure.

2. Automatically defining a relational data format: after the business module is defined by the business module forming module, the relation data format defining module automatically defines the relation data format corresponding to the business module, the business module is packaged into a data format definition, and the display form is a business module data table main key.

3. A packaging relationship data format functional component: the definition object of each relation data format comprises a group of data processing components, reads all structured data from the business of the relation connecting party, writes the edited and updated data into the corresponding attribute field in the business of the relation party, reads the unstructured document attachment of the relation party into the business and records the business recording relation at the two ends of the relation.

6. Establishing a data map: and the relation map forming unit displays all relation maps recorded by the current business module in a circular-line graph mode based on the application of the business module execution data and the relation data format in the business module. Each map point represents a piece of service data, and in the details of each map point, the detailed information of the service data is displayed.

The data map can be a visualized display form, wherein a circle (or a point form) represents one service data, other circles or points connected by surrounding radial lines represent associated service data of the selected service data, and the associated part is in a relational data format.

In order to further explain the work flow of the modules, the functions and working modes of the business module are provided in another embodiment.

The business module forming module is used for creating a business process A, the business process A comprises a form and a workflow, the form comprises a plurality of attribute fields with different data types and lengths, and the corresponding data storage process is carried out. The workflow comprises a start step, an intermediate step, a conditional branch and an end step, and the process corresponds to the actual business approval process. The definition of the business module can be realized by defining the form and the work flow of the business flow.

After the business process configuration is released, the relational data format definition module automatically generates a 'relational definition' data structure type. The relationship definition may be stored in a data structure module. The relational data format definition module is a packaging module that defines a data format that contains specific relationships and functions: the name of the business process, the system ID of the business process and the unique identifier RecordID used for front-end display, and provides the functions of acquiring all other data field values according to the unique identifier and rewriting and updating source field values. The relational data format definition module will serve as an access connection object for any other business process that uses the business process data. The RecordID is a system-level unique service data identification.

And a service process B is configured according to the working process of the service module forming module and the coefficient data format defining module and the relation definition is carried out on the service process B. If the relation between the B service route (such as the start, intermediate step, conditional branch and end) and the A service flow has a reference/association/reading/writing relation, the relation definition data structure of the source A service flow is added in the B service route form, and the corresponding data attribute to be read or written is added in the B service form.

And 2 different business processes realize the determination of the incidence relation through relation definition. In the process of creating the business record of the business B, attribute fields special for the business B are manually input in a form of a business process B, data are defined by clicking the relation of the A, a data list of the A is displayed, proper associated data are selected, the selected record ID value of the A and other related data are automatically loaded into the form of the B, and data uniqueness and normalization are realized. If the data in A needs to be updated through B, the data in A needs to be modified and submitted in the form of B directly on the basis of the previous steps.

And the relation map forming module forms and displays all relation maps recorded by the current business module based on the application of the business module execution data and the relation data format in the business module. The resulting relational data is illustrated, for example, in fig. 2.

Based on the foregoing description, referring to fig. 2, it can be known that the business process a is a reference source of the business process B (for example, the reference relationship between the contract payment service 1 and the contract management service in the figure), and by looking at B or the data details of a, looking at the "data map", it can be seen that there is an arrow line link between a and B. In the actual business management, a plurality of business processes and a plurality of data are directly associated with each other, and the definition of the association relationship is integrated into the actual business operation through the relationship definition, so that manual tracking is avoided.

It should be noted that the above-mentioned embodiments are exemplary, and that those skilled in the art, having benefit of the present disclosure, may devise various arrangements that are within the scope of the present disclosure and that fall within the scope of the invention. It should be understood by those skilled in the art that the present specification and figures are illustrative only and are not limiting upon the claims. The scope of the invention is defined by the claims and their equivalents. The present description contains several inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", each indicating that the respective paragraph discloses a separate concept, the applicant reserves the right to submit divisional applications according to each inventive concept.

Claims

1. A data map generation method includes the following steps,

defining data storage and a work flow corresponding to actual business to form a business module, and automatically defining a relational data format of the business module;

each defined object of the relational data format at least comprises processing structured data and unstructured data and recording relational data among businesses;

applying the relational data format to the business module data storage, and bringing the packed business data into the main key to complete the association of one or more business modules;

and when the business module is executed, the relation data format is used for determining the association with other business modules, and based on the application of the business module execution data and the relation data format in the business module, all the relation maps between the business module execution data and the current business module record are formed and displayed.

2. The method of claim 1, wherein the data storage form comprises a plurality of data formats and data values, and the workflow at least stores business transaction approval process data corresponding to actual business.

3. A method according to claim 1 or 2, characterized in that in automatically defining the relational data format of said service modules, said service modules are packaged into a data format definition in the form of said service module data table primary key.

4. The method according to any one of claims 1 to 3, wherein the processing flow of the relationship data between the structured data source and the unstructured data and the recording service is as follows: reading all structured data from the business of the relation connecting party, writing the edited and updated data into the corresponding attribute field in the business of the relation party, reading the unstructured document attachment of the relation party into the business and recording the business record relation at the two ends of the relation.

5. The method of any one of claims 1 to 4, wherein the data map is generated and presented in the form of a circle-line graph, wherein the points of each map represent a piece of business data.

6. A data map generating device at least comprises a business module forming module, a relation data format defining module, a data processing component and a relation map forming module,

it is characterized in that the preparation method is characterized in that,

the business module forming module defines a business module based on data storage and a work flow corresponding to an actual business, the relational data format defining module automatically defines the relational data format of the business module, the display form is a business module data table main key, the relational data format is applied to business module data storage, packed business data is brought in through the main key, association of one or more business modules is completed, the business module operates, the business data is stored, association with other business modules is determined by using the relational data format, and the data map module executes application of the data and the relational data format in the business module based on the business module to form and display all relational maps recorded with the current business module.

7. The apparatus according to claim 6, wherein the data storage form comprises a plurality of data formats and data values, and the workflow stores at least business transaction approval process data corresponding to actual business.

8. The apparatus according to any one of claims 6 to 7, wherein when automatically defining the relational data format of the service module, the service module is packaged into a data format definition in the form of the primary key of the service module data table.

9. The apparatus according to any one of claims 6 to 8, wherein the packaging of the service module into a relationship data format definition is implemented by a data processing component in the relationship definition module, and the processing flow is as follows: reading all structured data from the business of the relation connecting party, writing the edited and updated data into the corresponding attribute field in the business of the relation party, reading the unstructured document attachment of the relation party into the business and recording the business record relation at the two ends of the relation.

10. The apparatus of any one of claims 6 to 9, wherein the data map is generated and presented in the form of a circle-line graph, wherein the points of each map represent a piece of business data.