CN112511493B - Service data message processing method and device, computer equipment and storage medium - Google Patents
Service data message processing method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN112511493B CN112511493B CN202011193314.XA CN202011193314A CN112511493B CN 112511493 B CN112511493 B CN 112511493B CN 202011193314 A CN202011193314 A CN 202011193314A CN 112511493 B CN112511493 B CN 112511493B
- Authority
- CN
- China
- Prior art keywords
- data
- service
- message
- attribute
- data model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The application relates to a method and a device for processing service data messages, computer equipment and a storage medium. The method comprises the following steps: and acquiring a service data message. And analyzing the service data message to obtain a message label item of the service data message. Searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the replication autonomous data model and a private data attribute of a corresponding business system; the master data model and each business system data model perform real-time synchronization of common data attributes. And processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model. By adopting the method, the service data processing efficiency can be improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for processing a service data packet, a computer device, and a storage medium.
Background
With the development of computer technology, more and more business systems appear in various industries. The business system refers to business links required by enterprises for positioning, roles played by all partners, and modes and contents of cooperation and transaction of interest relatives. In particular, the relevant workers can understand the construction of the business system from two levels, namely an industry value chain and an enterprise internal value chain, and the roles of the partners. At present, as shown in fig. 1, data redundancy, tedious access, non-uniform coding, asynchronous data and lack of consistency among various business systems such as a financial system, a purchasing system, a human resource system, an order system and an enterprise performance management system lead to low business data processing efficiency.
Disclosure of Invention
Therefore, it is necessary to provide a service data packet processing method, a device, a computer device and a storage medium capable of improving service data processing efficiency in view of the above technical problems.
A method for processing service data message, the method comprises:
acquiring a service data message;
analyzing the service data message to obtain a message label item of the service data message;
searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the replication autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes;
and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
In one embodiment, the method further comprises:
acquiring common data attributes shared among more than one service system, and constructing a main data model according to the common data attributes;
copying the master data model, and adding a private data attribute corresponding to a service system to each copied master data model to obtain service system data models respectively corresponding to the service systems;
synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model.
In one embodiment, the obtaining common data attributes shared among more than one business system and constructing a master data model according to the common data attributes includes:
acquiring a data attribute set corresponding to more than one service system;
determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system;
adjusting the candidate common data attribute according to the security parameter and the integrity parameter of the candidate common data attribute to obtain a common data attribute;
and constructing a main data model according to the common data attribute.
In one embodiment, the synchronizing, in real-time, the common data attribute of the master data model to each of the business system data models includes:
determining an updated common data attribute in response to an update operation for the common data attribute of the master data model;
synchronizing the updated common data attributes to each of the business system data models in real time;
the method further comprises the following steps:
and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
In one embodiment, the method further comprises:
when the service data message is acquired from a first service system, synchronizing service data corresponding to common data attributes in the service data message to a database corresponding to the master data model in real time;
and copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of a second service system through the main data model.
In one embodiment, the analyzing the service data packet to obtain the packet tag item of the service data packet includes:
acquiring a system identifier of each service system;
determining an interface message protocol of each service system according to the system identification;
and analyzing the service data message according to an interface message protocol of a service system corresponding to the service data message aiming at each service data message to obtain a message label item of the service data message.
A service data packet processing apparatus, the apparatus comprising:
the acquisition module is used for acquiring the service data message;
the analysis module is used for analyzing the service data message to obtain a message label item of the service data message;
the searching module is used for searching the business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the duplicated autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes;
and the processing module is used for processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program:
acquiring a service data message;
analyzing the service data message to obtain a message label item of the service data message;
searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the replication autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes;
and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a service data message;
analyzing the service data message to obtain a message label item of the service data message;
searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the duplicated autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes;
and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
The method, the device, the computer equipment and the storage medium for processing the service data message acquire the service data message. And analyzing the service data message to obtain a message label item of the service data message. And searching a business system data model with the message label item according to the message label item. Each data attribute of the business system data model corresponds to a message label item, and the data attributes comprise the common data attribute of the duplicated autonomous data model and the private data attribute of the corresponding business system. And the main data model and each service system data model perform real-time synchronization of common data attributes, so that the common data attributes of each service system data model are consistent with the common data attributes of the main data model. And processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model. Therefore, the business system data model to which the business data message belongs is directly determined by constructing the business system data model corresponding to the main data model and each business system and by the message label item. The mapping relation of data attributes is avoided to be set among all the service systems, the operation is simple, the data consistency is ensured, and therefore the service data processing efficiency is improved.
Drawings
FIG. 1 is a diagram illustrating data interaction between conventional business systems, according to one embodiment;
fig. 2 is an application scenario diagram of a service data packet processing method in an embodiment;
fig. 3 is a schematic flow chart of a service data packet processing method according to an embodiment;
FIG. 4 is a schematic diagram of business system data model construction in one embodiment;
FIG. 5 is a diagram illustrating the effect of the data model of the business system A in one embodiment;
FIG. 6 is a diagram illustrating a conventional business system data model construction, according to an embodiment;
FIG. 7 is a diagram illustrating message label entries for a master data model and a business system data model, in accordance with an embodiment;
FIG. 8 is a diagram of a master data model build in one embodiment;
FIG. 9 is a schematic diagram of data interactions of business systems based on a master data management system in one embodiment;
fig. 10 is a block diagram of a service data packet processing apparatus according to an embodiment;
fig. 11 is a block diagram of a service data packet processing apparatus according to another embodiment;
FIG. 12 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The service data message processing method provided by the present application may be applied to an application environment as shown in fig. 2. The application environment includes a server 202 running a master data management system and more than one server 204 running a business system. The server may be implemented as a stand-alone server or as a server cluster consisting of a plurality of servers. Those skilled in the art will understand that the application environment shown in fig. 2 is only a part of the scenario related to the present application, and does not constitute a limitation to the application environment of the present application.
The master data management system 202 obtains the service data message. The main data management system 202 parses the service data packet to obtain a packet tag item of the service data packet. The main data management system 202 searches a service system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message tag item, and the data attributes comprise the common data attribute of the replication autonomous data model and the private data attribute of the corresponding business system 204; the master data model performs real-time synchronization of the common data attributes with each of the business system data models. The master data management system 202 processes the service data packet in a packet processing manner of the service system 204 corresponding to the searched service system data model.
In an embodiment, as shown in fig. 3, a method for processing a service data packet is provided, which is described by taking the application of the method to the master data management system 202 in fig. 2 as an example, and includes the following steps:
s302, acquiring a service data message.
The service data is data related to corresponding service processing performed by the service system. The service data packet is packet data carrying service data.
In one embodiment, the master data management system may obtain the service data packet from more than one service system, and it is understood that the master data management system collects the service data from each service system. The master data management system can also obtain service data messages from local, and the master data management system can distribute service data to each service system.
S304, analyzing the service data message to obtain a message label item of the service data message.
Wherein, the message label item is a label symbol which uniquely identifies the service data message.
Specifically, the master data management system is preset with an interface message protocol corresponding to each service system, and the master data management system can analyze the service data message corresponding to the corresponding service system according to the interface message protocol corresponding to each service system to obtain a message tag item of the service data message.
S306, searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the copy autonomous data model and a private data attribute of a corresponding business system; the master data model and each business system data model perform real-time synchronization of common data attributes.
Wherein the data attribute is an attribute of data of the business system. The common data attribute is a data attribute commonly owned by the respective business systems. The private data attribute is a data attribute unique to each service system. The master data model is a data model constructed from common data attributes. The business system data model is a data model constructed by common data attributes and private data attributes.
Specifically, each common data attribute and private data attribute of the business system data model corresponds to a message tag item. After the main data management system obtains the message label item of the service data message, the main data management system can locally search the service system data model with the message label item according to the message label item. It can be understood that the master data management system can search the common data attribute and the private data attribute of the corresponding message tag item, and determine the service system data model to which the common data attribute and the private data attribute of the corresponding message tag item belong as the searched service system data model with the message tag item.
In one embodiment, the data attribute may specifically include at least one of an ID (identification), a name, a number, a password, a post, a card number, and the like.
And S308, processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
Specifically, each service system may have different message processing modes according to its service requirements. After the main data management system finds the service system data model corresponding to the service data message, the service system corresponding to the service system data model can be determined. Furthermore, the main data management system can process the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
In the method for processing the service data message, the service data message is acquired. And analyzing the service data message to obtain a message label item of the service data message. And searching a business system data model with the message label item according to the message label item. Each data attribute of the business system data model corresponds to a message label item, and the data attributes comprise the common data attribute of the duplicated autonomous data model and the private data attribute of the corresponding business system. And the main data model and each service system data model perform real-time synchronization of common data attributes, so that the common data attributes of each service system data model are consistent with the common data attributes of the main data model. And processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model. Therefore, the business system data model to which the business data message belongs is directly determined by constructing the business system data model corresponding to the main data model and each business system and by the message label item. The method avoids the setting of the mapping relation of the data attributes among the service systems, is simple to operate, and ensures the consistency of the data, thereby improving the processing efficiency of the service data.
In an embodiment, the method for processing a service data packet specifically further includes: acquiring common data attributes shared among more than one service system, and constructing a main data model according to the common data attributes; copying the master data model, adding a private data attribute corresponding to the service system to each copied master data model, and obtaining service system data models respectively corresponding to the service systems; and synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model.
Specifically, each service system corresponds to its own data attribute, and the master data management system may obtain the respective data attribute of each service system and determine a common data attribute shared between each service system. Further, the master data management system may obtain common data attributes shared between more than one business system and construct the master data model based on the common data attributes. The master data management system may determine a number of business systems and replicate an equal number of master data models based on the number of business systems. The master data management system may add a private data attribute of a corresponding service system to each copied master data model to obtain a service system data model corresponding to each service system. When the common data attribute in the main data model is updated, the main data management system can synchronize the common data attribute of the main data model to each service system data model in real time, and adds corresponding message label items for the common data attribute and the private data attribute in the service system data model.
In one embodiment, as shown in fig. 4, the master data management system may determine the a service system, the B service system, and the C service system, copy the master data model into three copies, and add the private data attribute of the a service system, the private data attribute of the B service system, and the private data attribute of the C service system, respectively, to obtain service system data models corresponding to the a service system, the B service system, and the C service system, respectively. And the common data attribute in each service system data model is synchronized with the common data attribute in the main data model in real time.
For example, as shown in fig. 5, the service system data model corresponding to the service system a is responsible for interfacing with the service system a, that is, the main data management system collects service data from the service system a through the common data attribute ID, name (Name), and Code (number) in the service system data model corresponding to the service system a and the private data attribute password of the service system a, or locally distributes the service data to the service system a.
In an embodiment, in a conventional model building manner, as shown in fig. 6, after the master data management system builds the master data model, it is necessary to additionally build a business system model corresponding to each business system, and it is also necessary to set a mapping relationship between the master data model and the business system model corresponding to each business system, which is cumbersome to operate and prone to error. In the present application, as shown in fig. 7, the master data management system may copy a number of master data models corresponding to each business system, and add private data attributes corresponding to each business system to the copied master data model to obtain a business system data model corresponding to each business system. Furthermore, the master data management system may define a message tag item for the service system data model corresponding to each service system, so that when distributing and collecting the service data, the master data management system may determine the service system data model corresponding to the service data directly according to the message tag item. Compared with the traditional model construction mode, the model construction mode is simple to operate and can avoid errors.
In the above embodiment, by copying the master data model and adding the private data attribute of the corresponding service system to each copied master data model, the private data attributes of each service system can be compatible in the master data management system, so that the private data attributes of each service system can be maintained in the master data management system, and the flexibility of the master data management system is improved. By synchronizing the common data attribute of the main data model to each service system data model in real time, when the common data attribute is updated, only the updating operation needs to be carried out in the main data model, and the maintenance cost of the main data management system is reduced. By adding corresponding message label items to the common data attribute and the private data attribute in the service system data model, the mapping relation between the main data model and each service system data model is avoided, and the data model is more convenient and efficient to construct.
In one embodiment, the step of obtaining common data attributes shared among more than one business system and constructing a master data model according to the common data attributes includes: acquiring a data attribute set corresponding to more than one service system; determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system; adjusting the candidate common data attributes according to the security parameters and the integrity parameters of the candidate common data attributes to obtain common data attributes; and constructing a master data model according to the common data attributes.
The security parameter is a parameter which characterizes the possibility that the candidate common data attribute carries sensitive information and security information. The integrity parameter is a parameter that characterizes the integrity of the candidate common data attributes.
Specifically, each business system corresponds to at least one data attribute. And regarding each service system, taking all the corresponding data attributes as a data attribute set. The main data management system can acquire the data attribute sets corresponding to more than one service systems respectively, intersect the data attribute sets corresponding to the service systems respectively, and determine the intersection part of the data attribute sets of the service systems as the candidate common data attributes shared among the more than one service systems. The master data management system may adjust the candidate common data attributes according to the security parameters and the integrity parameters of the candidate common data attributes, where the adjustment may specifically include at least one of addition, deletion, and modification, so as to obtain the common data attributes. Further, the master data management system may construct a master data model based on the common data attributes.
In one embodiment, the security parameter may specifically be a security score for each candidate common data attribute according to a security score table, and the security score for each candidate common data attribute is used as the security parameter. The integrity parameter can specifically perform integrity scoring on all the candidate common data attributes according to an integrity reference table, and the integrity scoring is used as the integrity parameter of all the candidate common data attributes.
In one embodiment, as shown in fig. 8, the data attribute set of the service system a is [ ID, name, code ], the data attribute set of the service system B is [ ID, name, code, station ], the data attribute set of the service system C is [ ID, name, code, card number ], and the intersection part of the data attribute sets of the service systems a, B, and C is [ ID, name, code ]. The main data management system can share [ ID, name, code ] among the service system A, the service system B and the service system C as a candidate common data attribute.
In the above embodiment, the intersection part of the data attribute sets of the service systems is determined as the candidate common data attribute shared among more than one service systems, so that the candidate common data attribute is more accurately selected. The candidate common data attributes are adjusted according to the security parameters and the integrity parameters of the candidate common data attributes to obtain the common data attributes, so that the accuracy of the common data attributes is improved, and the constructed main data model is more accurate.
In one embodiment, the step of synchronizing the common data attribute of the master data model to each service system data model in real time specifically includes: in response to an update operation for a common data attribute of the master data model, determining an updated common data attribute; the updated common data attributes are synchronized to each business system data model in real time.
Specifically, the administrator may trigger an update operation for the common data attributes of the master data model based on a setup interface for the common data attributes of the master data management system. The master data management system may determine an updated common data attribute in response to an update operation directed to the common data attribute of the master data model. Further, the master data management system may synchronize the updated common data attributes to each of the business system data models in real-time.
In an embodiment, the method for processing a service data packet specifically further includes: and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
Specifically, the administrator may trigger an update operation for the private data attributes of the business system data model based on a setting interface of the private data attributes of the master data management system. The master data management system can update the private data attributes of the corresponding business system data models aiming at the updating operation of the private data attributes of the business system data models. That is, maintaining private data attributes of the various business systems in the master data management system is supported.
In the embodiment, the updated common data attribute is determined and synchronized to each service system data model in real time, so that the updated common data attribute is prevented from being completely resynchronized to the service system data model, and the updating efficiency of the common data attribute of the service system data model is improved. And updating the private data attributes of the corresponding business system data models in response to the updating operation of the private data attributes of the business system data models so as to update the private data attributes of the business system data models in the master data management system.
In an embodiment, the method for processing a service data packet specifically further includes: when the service data message is acquired from the first service system, synchronizing the service data corresponding to the common data attribute in the service data message to a database corresponding to the master data model in real time; and copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of the second service system through the main data model.
Specifically, the source of the service data packet may specifically include acquisition from each service system and local generation according to each service system data model. The main data management system can judge the acquisition source of the service data message, and when the service data message is acquired from the first service system, the main data management system can synchronize the service data corresponding to the common data attribute in the service data message to the database corresponding to the main data model in real time. Further, the master data management system copies the business data corresponding to the common data attribute to a database corresponding to the business system data model of the second business system through the master data model.
In the embodiment, the service data corresponding to the common data attribute in the service data message collected from the first service system is synchronized to the database corresponding to the master data model in real time, so that the service data corresponding to the common data attribute of the master data model is updated conveniently. And copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of the second service system through the main data model. Therefore, the consistency of the business data corresponding to the common data attribute corresponding to each business system data model is maintained, and the processing efficiency of the business data is further improved.
In an embodiment, the step S304, that is, the step of parsing the service data packet and obtaining the packet tag item of the service data packet, specifically includes: acquiring a system identifier of each service system; determining an interface message protocol of each service system according to the system identification; and analyzing the service data message according to the interface message protocol of the service system corresponding to the service data message aiming at each service data message to obtain the message label item of the service data message.
Specifically, the system identifier is a symbol that uniquely identifies the service system, and each service system corresponds to its own system identifier. The main data management system is preset with interface message protocols corresponding to all the service systems. The master data management system can obtain the system identification of each service system and determine the interface message protocol of each service system according to the system identification. For each service data message, the main data management system can analyze the service data message according to the interface message protocol of the service system corresponding to the service data message, and obtain the message label item of the service data message.
In the above embodiment, the service data packet is parsed according to the interface packet protocol of the service system corresponding to the service data packet through the interface packet protocol of each service system, so as to ensure correct parsing of the service data packet, and further improve processing efficiency of the service data.
In one embodiment, as shown in fig. 9, each business system, such as the finance system, the purchasing system, the human resource system, the order system, and the enterprise performance management system, is responsible for distributing and collecting business data by constructing a business system data model corresponding to each business system in the master data management system and performing data interaction with the corresponding business system through the business system data model. And a uniform coding mode is provided, and data synchronization and data consistency are ensured. Compared with the traditional data interaction mode among all the service systems in the figure 1, the data interaction mode among all the service systems improves the service data processing efficiency.
It should be understood that although the various steps of fig. 3 are shown in order, these steps are not necessarily performed in order. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least some of the steps in fig. 3 may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatively with other steps or at least some of the sub-steps or stages of other steps.
In one embodiment, as shown in fig. 10, there is provided a service data packet processing apparatus 1000, including: an obtaining module 1001, an analyzing module 1002, a searching module 1003 and a processing module 1004, wherein:
an obtaining module 1001 is configured to obtain a service data packet.
The parsing module 1002 is configured to parse the service data packet to obtain a packet tag item of the service data packet.
The searching module 1003 is configured to search, according to the packet tag item, a service system data model having the packet tag item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the replication autonomous data model and a private data attribute of a corresponding business system; the master data model performs real-time synchronization of the common data attributes with each of the business system data models.
The processing module 1004 processes the service data message by using the message processing mode of the service system corresponding to the found service system data model.
In an embodiment, the obtaining module 1001 is further configured to synchronize, in real time, service data corresponding to common data attributes in service data packets to a database corresponding to a master data model when the service data packets are acquired from a first service system; and copying the service data corresponding to the common data attribute to a database corresponding to the service system data model of the second service system through the main data model.
In one embodiment, the parsing module 1002 is further configured to obtain a system identifier of each service system; determining an interface message protocol of each service system according to the system identification; and analyzing the service data message according to an interface message protocol of a service system corresponding to the service data message aiming at each service data message to obtain a message label item of the service data message.
Referring to fig. 11, in an embodiment, the service data packet processing apparatus 1000 further includes: a build module 1005, wherein:
a building module 1005, configured to obtain common data attributes shared among more than one service system, and build a master data model according to the common data attributes; copying the master data model, adding a private data attribute corresponding to the service system to each copied master data model, and obtaining service system data models respectively corresponding to the service systems; and synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model.
In one embodiment, the building module 1005 is further configured to obtain a data attribute set corresponding to each of more than one service system; determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system; adjusting the candidate common data attribute according to the security parameter and the integrity parameter of the candidate common data attribute to obtain a common data attribute; and constructing a master data model according to the common data attributes.
In one embodiment, the build module 1005 is further operable to determine an updated common data attribute in response to an update operation directed to the common data attribute of the master data model; synchronizing the updated common data attributes to each service system data model in real time; and in response to the updating operation aiming at the private data attribute of the business system data model, updating the private data attribute of the corresponding business system data model.
The service data message processing device acquires the service data message. And analyzing the service data message to obtain a message label item of the service data message. And searching a business system data model with the message label item according to the message label item. Each data attribute of the business system data model corresponds to a message label item, and the data attributes comprise the common data attribute of the duplicated autonomous data model and the private data attribute of the corresponding business system. And the main data model and each service system data model perform real-time synchronization of common data attributes, so that the common data attributes of each service system data model are consistent with the common data attributes of the main data model. And processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model. Therefore, the business system data model to which the business data message belongs is directly determined by constructing the business system data model corresponding to the main data model and each business system and by the message label item. The method avoids the setting of the mapping relation of the data attributes among the service systems, is simple to operate, and ensures the consistency of the data, thereby improving the processing efficiency of the service data.
For specific limitations of the service data packet processing apparatus, reference may be made to the above limitations on the service data packet processing method, which is not described herein again. All or part of each module in the service data message processing device can be realized by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be the server 202 of fig. 2 running the primary data management system, and its internal structure diagram may be as shown in fig. 12. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing service data message processing data. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a method of service data message processing.
It will be appreciated by those skilled in the art that the configuration shown in fig. 12 is a block diagram of only a portion of the configuration associated with the present application, and is not intended to limit the computing device to which the present application may be applied, and that a particular computing device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program: acquiring a service data message; analyzing the service data message to obtain a message label item of the service data message; searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the copy autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes; and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring common data attributes shared among more than one service system, and constructing a main data model according to the common data attributes; copying the master data model, adding a private data attribute corresponding to the service system to each copied master data model, and obtaining service system data models respectively corresponding to the service systems; and synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring a data attribute set corresponding to more than one service system; determining the intersection part of the data attribute sets of all the service systems as candidate shared data attributes shared among more than one service systems; adjusting the candidate common data attributes according to the security parameters and the integrity parameters of the candidate common data attributes to obtain common data attributes; and constructing a master data model according to the common data attributes.
In one embodiment, the processor, when executing the computer program, further performs the steps of: in response to an update operation directed to a common data attribute of the master data model, determining an updated common data attribute; synchronizing the updated common data attributes to each service system data model in real time; the method further comprises the following steps: and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
In one embodiment, the processor, when executing the computer program, further performs the steps of: when the service data message is acquired from the first service system, synchronizing the service data corresponding to the common data attribute in the service data message to a database corresponding to the main data model in real time; and copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of the second service system through the main data model.
In one embodiment, the processor when executing the computer program further performs the steps of: acquiring a system identifier of each service system; determining an interface message protocol of each service system according to the system identification; and analyzing the service data message according to the interface message protocol of the service system corresponding to the service data message aiming at each service data message to obtain the message label item of the service data message.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: acquiring a service data message; analyzing the service data message to obtain a message label item of the service data message; searching a business system data model with the message label item according to the message label item; each data attribute of the business system data model corresponds to a message label item, and the data attribute comprises a common data attribute of the replication autonomous data model and a private data attribute of a corresponding business system; the main data model and each service system data model carry out real-time synchronization of common data attributes; and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring common data attributes shared among more than one service system, and constructing a main data model according to the common data attributes; copying the master data model, adding a private data attribute corresponding to the service system to each copied master data model, and obtaining service system data models respectively corresponding to the service systems; and synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring data attribute sets corresponding to more than one service systems respectively; determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system; adjusting the candidate common data attribute according to the security parameter and the integrity parameter of the candidate common data attribute to obtain a common data attribute; and constructing a master data model according to the common data attributes.
In one embodiment, the computer program when executed by the processor further performs the steps of: in response to an update operation for a common data attribute of the master data model, determining an updated common data attribute; synchronizing the updated common data attributes to each service system data model in real time; and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
In one embodiment, the computer program when executed by the processor further performs the steps of: when the service data message is acquired from the first service system, synchronizing the service data corresponding to the common data attribute in the service data message to a database corresponding to the main data model in real time; and copying the service data corresponding to the common data attribute to a database corresponding to the service system data model of the second service system through the main data model.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring a system identifier of each service system; determining an interface message protocol of each service system according to the system identification; and analyzing the service data message according to an interface message protocol of a service system corresponding to the service data message aiming at each service data message to obtain a message label item of the service data message.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by hardware instructions of a computer program, which may be stored in a non-volatile computer-readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), rambus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A method for processing service data message is characterized in that the method comprises the following steps:
acquiring a data attribute set corresponding to more than one service system;
determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system;
adjusting the candidate common data attribute according to the security parameter and the integrity parameter of the candidate common data attribute to obtain a common data attribute;
constructing a main data model according to the common data attributes;
copying the master data model, and adding a private data attribute corresponding to a service system to each copied master data model to obtain service system data models respectively corresponding to the service systems;
synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model;
acquiring a service data message;
analyzing the service data message to obtain a message label item of the service data message;
searching a business system data model with the message label item according to the message label item;
and processing the service data message by adopting a message processing mode of the service system corresponding to the searched service system data model.
2. The method of claim 1, wherein synchronizing the common data attributes of the master data model to each of the business system data models in real-time comprises:
determining an updated common data attribute in response to an update operation for the common data attribute of the master data model;
synchronizing the updated common data attributes to each of the business system data models in real time;
the method further comprises the following steps:
and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
3. The method of claim 1, further comprising:
when the service data message is acquired from a first service system, synchronizing the service data corresponding to the common data attribute in the service data message to a database corresponding to the main data model in real time;
and copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of a second service system through the main data model.
4. The method according to any one of claims 1 to 3, wherein the parsing the service data packet to obtain a packet tag item of the service data packet comprises:
acquiring a system identifier of each service system;
determining an interface message protocol of each service system according to the system identification;
and analyzing the service data message according to an interface message protocol of a service system corresponding to the service data message aiming at each service data message to obtain a message label item of the service data message.
5. A service data packet processing apparatus, the apparatus comprising:
the construction module is used for acquiring data attribute sets corresponding to more than one service systems; determining the intersection part of the data attribute sets of each service system as a candidate common data attribute shared among more than one service system; adjusting the candidate common data attribute according to the security parameter and the integrity parameter of the candidate common data attribute to obtain a common data attribute; constructing a main data model according to the common data attributes; copying the master data model, and adding a private data attribute corresponding to a service system to each copied master data model to obtain service system data models respectively corresponding to the service systems; synchronizing the common data attribute of the main data model to each service system data model in real time, and adding corresponding message label items for the common data attribute and the private data attribute in the service system data model;
the acquisition module is used for acquiring the service data message;
the analysis module is used for analyzing the service data message to obtain a message label item of the service data message;
the searching module is used for searching the business system data model with the message label item according to the message label item;
and the processing module processes the service data message by adopting the message processing mode of the service system corresponding to the searched service system data model.
6. The apparatus of claim 5, wherein the build module is further configured to determine an updated common data attribute in response to an update operation for the common data attribute of the master data model; synchronizing the updated common data attributes to each of the business system data models in real-time; and updating the private data attributes of the corresponding business system data model in response to the updating operation aiming at the private data attributes of the business system data model.
7. The apparatus according to claim 5, wherein the obtaining module is further configured to synchronize, in real time, the service data corresponding to the common data attribute in the service data packet to the database corresponding to the master data model when the service data packet is acquired from a first service system; and copying the service data corresponding to the common data attribute to a database corresponding to a service system data model of a second service system through the main data model.
8. The apparatus according to any one of claims 5 to 7, wherein the parsing module is further configured to obtain a system identifier of each service system; determining an interface message protocol of each service system according to the system identification; and analyzing the service data message according to an interface message protocol of a service system corresponding to the service data message aiming at each service data message to obtain a message label item of the service data message.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 4 are implemented by the processor when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011193314.XA CN112511493B (en) | 2020-10-30 | 2020-10-30 | Service data message processing method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011193314.XA CN112511493B (en) | 2020-10-30 | 2020-10-30 | Service data message processing method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112511493A CN112511493A (en) | 2021-03-16 |
| CN112511493B true CN112511493B (en) | 2022-10-11 |
Family
ID=74956081
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011193314.XA Active CN112511493B (en) | 2020-10-30 | 2020-10-30 | Service data message processing method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112511493B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103399844A (en) * | 2013-08-16 | 2013-11-20 | 无锡城市云计算中心有限公司 | Report generation method and generation device |
| CN104052737A (en) * | 2014-05-19 | 2014-09-17 | 北京网康科技有限公司 | Network data message processing method and device |
| CN104361086A (en) * | 2014-11-14 | 2015-02-18 | 国电南瑞科技股份有限公司 | Data integration method for measurable asset entire life-cycle management system |
| CN108959439A (en) * | 2018-06-13 | 2018-12-07 | 百应科技（北京）有限公司 | A kind of data template generation method and system |
| US10803507B1 (en) * | 2015-11-23 | 2020-10-13 | Amazon Technologies, Inc. | System for generating output comparing attributes of items |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107402976B (en) * | 2017-07-03 | 2020-10-30 | 国网山东省电力公司经济技术研究院 | Power grid multi-source data fusion method and system based on multi-element heterogeneous model |
-
2020
- 2020-10-30 CN CN202011193314.XA patent/CN112511493B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103399844A (en) * | 2013-08-16 | 2013-11-20 | 无锡城市云计算中心有限公司 | Report generation method and generation device |
| CN104052737A (en) * | 2014-05-19 | 2014-09-17 | 北京网康科技有限公司 | Network data message processing method and device |
| CN104361086A (en) * | 2014-11-14 | 2015-02-18 | 国电南瑞科技股份有限公司 | Data integration method for measurable asset entire life-cycle management system |
| US10803507B1 (en) * | 2015-11-23 | 2020-10-13 | Amazon Technologies, Inc. | System for generating output comparing attributes of items |
| CN108959439A (en) * | 2018-06-13 | 2018-12-07 | 百应科技（北京）有限公司 | A kind of data template generation method and system |
Non-Patent Citations (1)
| Title |
|---|
| 综合网管系统MSTP网业务通道的设计和应用;蒋超;《广播与电视技术》;20170715(第07期);第66-73页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112511493A (en) | 2021-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11068449B2 (en) | Data migration method, apparatus, and storage medium | |
| CN108874644B (en) | Data monitoring method and device, computer equipment and storage medium | |
| US20210149663A1 (en) | Data processing method based on intelligent contract, device, and storage medium | |
| WO2020151181A1 (en) | Cross-platform data updating method and apparatus based on block chain, and computer device | |
| TW201737126A (en) | Method and device for executing data recovery operation | |
| CN106528871A (en) | Method for updating information of engineering data points in industrial control system on line | |
| CN111222089B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN111930850A (en) | Data verification method and device, computer equipment and storage medium | |
| CN112506702A (en) | Data center disaster tolerance method, device, equipment and storage medium | |
| CN111460474A (en) | Method and device for realizing decentralized prediction machine, storage and computer | |
| CN111737227A (en) | Data modification method and system | |
| CN110737719A (en) | Data synchronization method, device, equipment and computer readable storage medium | |
| CN113672692B (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN113420026A (en) | Database table structure changing method, device, equipment and storage medium | |
| CN109101232B (en) | Method, device, computer equipment and storage medium for product development | |
| CN112511493B (en) | Service data message processing method and device, computer equipment and storage medium | |
| CN113468143A (en) | Data migration method, system, computing device and storage medium | |
| CN111565173A (en) | Intelligent contract management method and device for block chain system and hardware equipment | |
| CN112199441A (en) | Data synchronization processing method, device, equipment and medium based on big data platform | |
| CN111522881A (en) | Service data processing method, device, server and storage medium | |
| CN111752838A (en) | Question checking method and device, server and storage medium | |
| CN116755699A (en) | Compiling processing method, compiling processing device, electronic equipment and storage medium | |
| CN114625751A (en) | Data tracing query method and device based on block chain | |
| CN116107801A (en) | Transaction processing method and related product | |
| Goncalves et al. | DottedDB: Anti-entropy without merkle trees, deletes without tombstones |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |