CN111782672B - Multi-field data management method and related device - Google Patents
Multi-field data management method and related device Download PDFInfo
- Publication number
- CN111782672B CN111782672B CN202010624003.8A CN202010624003A CN111782672B CN 111782672 B CN111782672 B CN 111782672B CN 202010624003 A CN202010624003 A CN 202010624003A CN 111782672 B CN111782672 B CN 111782672B
- Authority
- CN
- China
- Prior art keywords
- data
- domain
- management database
- configuration management
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to a multi-field data management method and a related device, belonging to the technical field of computers, and the method comprises the following steps: the field system establishes a data management model according to a model construction rule of a configuration management database; pushing the domain data corresponding to the data management model to the configuration management database to establish an incidence relation of the domain data of each domain system; subscribing target domain data to a configuration management database; when each domain system detects that the domain data of the domain system changes, the changed domain data is sent to the configuration management database, so that the configuration management database updates the changed domain data; and receiving target domain data pushed by a configuration management database, wherein the target domain data is the changed domain data updated in the configuration management database by a target domain system. Some embodiments of the present application may perform multi-domain data management based on blockchains. The embodiment of the application realizes reliable management of multi-field data and ensures the quality of the data.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a multi-domain data management method and a related apparatus.
Background
Currently, data management is usually performed based on a Configuration Management Database (CMDB), which is a fundamental stone of operation and maintenance data and stores the most core metadata of operation and maintenance, and a conventional CMDB includes a large and complete configuration item management, and all the initiation, change and status management of configuration items are operated in one database.
With the development of business, more and more data are provided in the configuration management database, the traditional configuration management database has unrealistic ways of maintaining all data, and data verification cannot be performed on each block because errors can occur during data entry, and in such a case, the data becomes more and more unreliable. Meanwhile, data processing does not have a set of complete configuration life cycle management, the configuration life cycle is easy to be confused in management due to the fact that the configuration life cycle is not supported by a process and a system, and the traditional data processing based on a configuration management database cannot be maintained for a long time. This is likely to cause data update exception, so that the data quality is increasingly poor.
Disclosure of Invention
The purpose of the application is to provide a multi-field data management scheme, so that reliable management of multi-field data is realized at least to a certain extent, and the quality of data is guaranteed.
According to an aspect of the present application, there is provided a multi-domain data management method, including:
the method comprises the following steps that a field system establishes a data management model according to a model construction rule of a configuration management database, wherein the field system is used for processing data of a preset field;
pushing the domain data corresponding to the data management model to the configuration management database so as to establish an incidence relation of the domain data of each domain system in the configuration management database;
subscribing target domain data to the configuration management database, wherein the target domain data correspond to a data management model of a target domain system;
when each domain system detects that the domain data of the domain system changes, the changed domain data is sent to the configuration management database, so that the configuration management database updates the changed domain data;
and receiving the target domain data pushed by the configuration management database, wherein the target domain data is the changed domain data updated in the configuration management database by the target domain system.
In an exemplary embodiment of the present application, the domain system establishes a data management model according to a model building rule of a configuration management database, including:
when a domain system requests access, the domain system acquires a model construction rule of the configuration management database, wherein the model construction rule indicates a hierarchical structure of the configuration management database, and the hierarchical structure comprises an example, a cluster and an application hierarchy;
establishing a data management model of the field system according to the model construction rule, wherein the data management model comprises an instance field, a cluster field and an application field;
and reporting the data of the data association model to the configuration management database to complete the establishment of the data management model.
In an exemplary embodiment of the present application, the pushing domain data corresponding to the data management model to the configuration management database to establish an association relationship between the domain data of each domain system in the configuration management database includes:
and pushing the domain data corresponding to the data management model to the configuration management database through a message queue so as to establish an incidence relation of each domain data in the configuration management database based on an object database, wherein the object database is connected with the configuration management database through the message queue.
In an exemplary embodiment of the present application, the establishing, based on the object database, an association relationship of each of the domain data in the configuration management database includes:
the object database acquires field data in the configuration management database, wherein the field data comprises instance data, cluster data and application data of a field system;
acquiring host data and a preset data relation mapping table provided by a configuration management database, wherein the host data is used for associating a resource server;
associating the host data with target instance data according to the preset data relation mapping table;
and associating target cluster information and target application information to the instance data associated with the host data according to the preset data relation mapping table to obtain the association relation of each field data.
In an exemplary embodiment of the present application, the associating the target cluster information and the target application information with the instance data associated with the host data to obtain an association relationship between the domain data includes:
a relation broad table with a host as a unit dimension is searched in a search server;
and after the target cluster information and the target application information are associated to the instance data associated with the host data, storing the obtained data association relation to the relation broad table.
In an exemplary embodiment of the present application, the sending the changed domain data to the configuration management database to enable the configuration management database to update the changed domain data includes:
obtaining expected change information received by a configuration management database, wherein the expected change information corresponds to the domain system of the changed domain data source;
acquiring the changed domain data acquired by the configuration management database, and acquiring the changed domain data reported by the domain system;
comparing the expected change information, the collected changed domain data and the changed domain data reported by the domain system, and verifying the collected changed domain data;
and updating the collected changed domain data in a configuration management database after the verification is passed.
In an exemplary embodiment of the present application, the method further comprises:
configuring a management database to obtain a business process, wherein the business process comprises specific operations on a plurality of target field systems;
and mapping the interface of the specific operation to an object of a preset flow control function in sequence so as to call the interface of the specific operation in sequence to complete the business flow based on the flow control function.
According to an aspect of the present application, there is provided a multi-domain data management apparatus, comprising:
the system comprises an establishing module, a data management module and a data management module, wherein the establishing module is used for establishing a data management model by a domain system according to a model establishing rule of a configuration management database, the domain system is used for processing data of a preset domain, and the number of the domain systems is at least two;
the pushing module is used for pushing the domain data corresponding to the data management model to the configuration management database so as to establish an incidence relation of the domain data of each domain system in the configuration management database;
the subscription module is used for subscribing target field data to the configuration management database, and the target field data corresponds to a data management model of a target field system;
the updating module is used for sending the changed domain data to the configuration management database when each domain system detects that the domain data of the domain system changes, so that the configuration management database updates the changed domain data;
a distribution module, configured to receive the target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated in the configuration management database by the target domain system.
According to an aspect of the present application, there is provided a computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the method of any of the above.
According to an aspect of the present application, there is provided an electronic device, comprising:
a processor; and
a memory for storing computer program instructions for the processor; wherein the processor is configured to perform any of the methods described above via execution of the computer program instructions.
According to the multi-field data management method and device, firstly, the preset field data can be reliably managed through the field system, then, the data management model is established according to the model building rule of the configuration management database, and the field system can be coupled with the configuration management database.
Secondly, the domain system can report the domain data corresponding to the data management model to the configuration management database, so that the data is managed by the configuration management database after being managed by the domain system, the coupling degree of the domain system and the configuration management database is reduced by an active reporting mode, the invasion degree of the domain system is reduced, and the reliability of the data is further ensured; meanwhile, configuration management can correlate the domain data of the system in each domain, and establish a correlation relationship, so that the data in each domain can be updated and changed in a correlated manner, and correlation acquisition can be carried out at the same time.
Then, the domain system may subscribe to the configuration management database for target domain data, the target domain data corresponding to a data management model of the target domain system; when each domain system detects that the domain data of the domain system changes, the changed domain data is sent to a configuration management database, so that the configuration management database updates the changed domain data; the domain system may receive target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated by the target domain system in the configuration management database. The low-coupling and full-flow cooperative management of data in each field through a neighborhood system and a configuration management database is realized, the reliability of data management is effectively ensured, and the data quality is ensured.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and together with the description, serve to explain the principles of the application. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 schematically shows a flow chart of a multi-domain data management method.
Fig. 2 schematically illustrates an application scenario example of a multi-domain data management method.
Fig. 3 schematically shows a flow chart of yet another multi-domain data management method.
Fig. 4 schematically shows a block diagram of a multi-domain data management apparatus.
Fig. 5 schematically shows an example block diagram of an electronic device for implementing the above-described multi-domain data management method.
Fig. 6 schematically illustrates a computer-readable storage medium for implementing the above-described multi-domain data management method.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the application. One skilled in the relevant art will recognize, however, that the subject matter of the present application can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and so forth. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present application.
Furthermore, the drawings are merely schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
In the exemplary embodiment, a multi-domain data management method is first provided, and the multi-domain data management method may be executed on a server, or may also be executed on a server cluster or a cloud server, and the like. Referring to fig. 1, the multi-domain data management method may include the steps of:
step S110, a data management model is established by a field system according to a model construction rule of a configuration management database, and the field system is used for processing data of a preset field;
step S120, pushing the domain data corresponding to the data management model to the configuration management database so as to establish an incidence relation of the domain data of each domain system in the configuration management database;
step S130, subscribing target domain data to the configuration management database, wherein the target domain data corresponds to a data management model of a target domain system;
step S140, when each domain system detects that the domain data changes, the changed domain data is sent to the configuration management database, so that the configuration management database updates the changed domain data;
step S150, receiving the target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated in the configuration management database by the target domain system.
In the multi-field data management method, firstly, the preset field data can be reliably managed through the field system, and then, the data management model is established according to the model construction rule of the configuration management database, so that the field system can be coupled with the configuration management database.
Secondly, the domain system can report the domain data corresponding to the data management model to the configuration management database, so that the data is managed by the configuration management database after being managed by the domain system, the coupling degree of the domain system and the configuration management database is reduced by an active reporting mode, the invasion degree of the domain system is reduced, and the reliability of the data is further ensured; meanwhile, configuration management can correlate the domain data of the system in each domain, and establish a correlation relationship, so that the data in each domain can be updated and changed in a correlated manner, and correlation acquisition can be carried out at the same time.
Then, the domain system may subscribe to the configuration management database for target domain data, the target domain data corresponding to a data management model of the target domain system; when each domain system detects that the domain data of the domain system changes, the changed domain data is sent to a configuration management database, so that the configuration management database updates the changed domain data; the domain system may receive target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated by the target domain system in the configuration management database. The low-coupling and full-flow cooperative management of data in each field through a neighborhood system and a configuration management database is realized, the reliability of data management is effectively ensured, and the data quality is ensured.
Hereinafter, each step in the above-described multi-domain data management method in the present exemplary embodiment will be explained and explained in detail with reference to the drawings.
In step S110, the domain system establishes a data management model according to the model construction rule of the configuration management database, the domain system being configured to process data of a predetermined domain.
In the present exemplary embodiment, referring to fig. 2, the domain system on the first server 201 may obtain the model building rule of the configuration management database on the second server 202, and then build the data management model according to the model building rule of the configuration management database. The system in each field may run on a first server 201, and the first server may be any terminal having the functions of executing program instructions and storing, such as a cloud server, a mobile phone, a computer, and the like; the configuration management database may run on the second server 202, which may be any terminal with a storage function, such as a mobile phone, a computer, etc.
The field system is a system for managing data of different professional fields, and the field system can manage the data of the relevant fields.
Specifically, when the domain system is built, the data management model of the domain system can be split according to the model building rule of the configuration management database CMDB (the model building rule can comprise a configuration management database instance, a cluster and an application three-layer structure), a configuration item of the configuration management database is formed, then the data of the data management model is reported to the configuration management database CMDB, and the model of the domain system can be built in the configuration management database.
The data management model can define the field data such as IT resources and the like required to be managed by systems in various fields, describe various information attributes of the IT resources, and further can quickly and clearly know the IT resource condition. Further, the data management model for establishing the domain system may be: an IT resource model (data management model) of each domain system is created according to a model construction rule of the configuration management database. For example, if the configuration management database data center is established on Mysql, creating an IT resource model of the system in each field may be expressed as creating a data Table; if the configuration management database data center is built on MongoDB, creating the resource model can be expressed as creating a data set collection.
The data management model builds rules for each resource object (it can be understood which information needs to be of interest for these resource objects and which fields are for tables in the database).
The system can be used for respectively processing data of corresponding fields by establishing a plurality of field systems, so that data maintenance is facilitated, the authority of data of professional fields is released, and the configuration management database can be used for managing the data of own related fields based on the field systems. The configuration management database can be accessed in subsequent steps according to the model building rules, so that the coupling of the various domain systems and the CMDB is realized.
In one embodiment of this example, the domain system builds the data management model according to model building rules of the configuration management database, including:
when a domain system requests access, the domain system acquires a model building rule of the configuration management database, wherein the model building rule indicates a hierarchical structure of the configuration management database, and the hierarchical structure comprises an example, a cluster and an application level;
establishing a data management model of the field system according to the model construction rule, wherein the data management model comprises an instance field, a cluster field and an application field;
and reporting the data of the data association model to the configuration management database to complete the establishment of the data management model.
The model building rule indicates a hierarchical structure of a configuration management database, wherein an instance can be a device identifier managed by a domain system, a cluster can be a set to which the instance belongs, and an application can be an application environment of the instance or the instance cluster. Therefore, the data association model can be established according to the hierarchical structure of the configuration management database, the reliability of data reporting to the configuration management database is ensured, the coupling degree of data reporting is reduced, and the model is defined and then only needs to be uploaded once.
In step S120, pushing domain data corresponding to the data management model to the configuration management database to establish an association relationship between the domain data of each domain system in the configuration management database.
In the embodiment of the present example, the association relationship defines an association relationship between the domain data, for example, an a application and a B cloud host are in an operating relationship, the a application runs on the B cloud host, the a cloud host runs a C application, and the like.
The domain system can report the domain data corresponding to the data management model to the configuration management database, so that the data is managed by the configuration management database after being managed by the individual domain system. The coupling degree of the domain system and the configuration management database is reduced in an active reporting mode, the invasion degree of the domain system is reduced, and the reliability of data is further ensured; meanwhile, configuration management can correlate the domain data of the system in each domain, and establish a correlation relationship, so that the data in each domain can be updated and changed in a correlated manner, and correlation acquisition can be carried out at the same time.
In an implementation manner of this example, pushing domain data corresponding to the data management model to the configuration management database to establish an association relationship between the domain data of each domain system in the configuration management database includes:
and pushing the domain data corresponding to the data management model to the configuration management database through a message queue so as to establish an incidence relation of each domain data in the configuration management database based on an object database, wherein the object database is connected with the configuration management database through the message queue.
The message queue may be a Kafka message queue. The message queue connects each domain system and the configuration management database.
The object database ODB is also called ObjectDatabase, and is a domain system, which can combine and correlate domain data.
For a large number of professional fields, when a large number of field systems are established, a large number of field data are available in the CMDB, and when the large number of field systems are faced, a method is needed for retrieving the field data so as to quickly eliminate obstacles. The troubleshooting can not meet the requirement, the object database ODB can realize the correlation of the field data, the reliability of data correlation searching is effectively ensured, and the troubleshooting reliability is ensured.
In an embodiment of this example, establishing, based on an object database, an association relationship of each of the domain data in the configuration management database includes:
the object database acquires field data in the configuration management database, wherein the field data comprises instance data, cluster data and application data of a field system;
acquiring host data and a preset data relation mapping table provided by a configuration management database, wherein the host data is used for associating a resource server;
associating the host data with target instance data according to the preset data relation mapping table;
and associating target cluster information and target application information to example data associated with the host data according to the preset data relation mapping table to obtain an association relation of each field data.
The association of the host data, the instance data, the cluster data and the application data is performed according to a preset data association relation mapping table, for example, association mapping relations among device identifications of systems in various fields are stored in the mapping table.
Therefore, the data in the related field can be processed by taking the host as the center, for example, the access of a database field system is realized, the database field system is related to the database instance through the provided host data, the cluster and the application are related on the instance, and the host can be related to the resource server (related to infrastructures such as a physical machine, a cabinet, a machine room and the like) through the IDC field system of the Internet data center. Hosts can be continually expanded in their associated or owned resources, such as the cabinet in which the host resides, the room in which the cabinet resides, the switch with which the machine is associated, and so forth.
On the level, all related dependency items (association relations) of the domain data of the system in each domain can be obtained to form an association topology, and when a production fault occurs on a line, such as a fault of a switch, the influence range of the technology and the service can be rapidly checked, so that a more complete fault solution is provided.
In an embodiment of this example, associating the target cluster information and the target application information with the instance data associated with the host data to obtain an association relationship between the domain data includes:
a relation broad table with a host as a unit dimension is searched in a search server;
and after the target cluster information and the target application information are associated to the instance data associated with the host data, storing the obtained data association relation to the relation broad table.
A search server such as the Elasticsearch is a distributed, highly extended, highly real-time search and data analysis engine. It can conveniently make a large amount of data have the capability of searching, analyzing and exploring.
In the case of many domain systems, there are a large number of configuration items (domain data) in the CMDB, and when facing these massive data, a method is needed to retrieve these data, so as to quickly eliminate the fault. The problem is far from enough for the obstacle elimination requirement, the problems can be effectively solved based on the object database ODB, specifically, a relation wide table with the host as the minimum dimension is established in the search server, and any configuration information (domain data) can be related to the host in the relation wide table, so that the retrieval speed can be increased for the structured data; for some unstructured data, a retrieval scoring mechanism (according to retrieval information, such as device IP) of the search server can be used for giving a plurality of recommended items, and the precision rate of fuzzy search is improved. For data association, the domain data can be automatically associated by searching the knowledge graph based on the knowledge graph of the big data, and the performance of data analysis and association retrieval can be improved.
In step S130, target domain data corresponding to a data management model of a target domain system is subscribed to the configuration management database.
In the embodiment of the present example, a certain domain system needs to consume domain data of another domain system (target domain system), and the domain data can be complemented by a message queue to a configuration management database in full or subscribing to the target domain data. The coordination of data in systems in various fields is realized through configuring a management database.
In step S140, when each of the domain systems detects that the domain data thereof is changed, the changed domain data is transmitted to the configuration management database, so that the configuration management database updates the changed domain data.
In the exemplary embodiment, when each domain system detects that its domain data is changed, that is, the domain data in the domain system is modified or updated, for example, device information is updated.
The domain system sends the changed domain data to the configuration management database so that the configuration management database updates the changed domain data. Automatic update management of domain data can be realized.
Wherein, the changed domain data is reported by the domain system according to the data management model.
In one embodiment of this example, sending the modified domain data to the configuration management database to cause the configuration management database to update the modified domain data comprises:
obtaining expected change information received by a configuration management database, wherein the expected change information corresponds to the domain system of the changed domain data source;
acquiring the changed domain data acquired by the configuration management database, and acquiring the changed domain data reported by the domain system;
comparing the expected change information, the collected changed domain data and the changed domain data reported by the domain system, and verifying the collected changed domain data;
and updating the collected changed domain data in a configuration management database after the verification is passed.
By carrying out cross comparison of three parts on the expected change information submitted by a user, the actually collected field data (collected changed field data) and the field data (changed field data) reported by the field system, the configuration change can be considered to be successful only when the three are consistent, if the three are inconsistent, the problem is definitely caused at a certain step in the change, and a professional can be informed to intervene to solve the problem of data inconsistency. In this way, the actual data of the domain system and the configuration management database CMDB do not interfere with each other, but the mutual data can check out where the opposite data is abnormal.
For example, based on the foregoing steps, when we access the host platform (domain system) of VMWare, the data management model of the domain data is determined with the domain expert of VMWare, and then the domain data is fully synchronized to the configuration management database CMDB once. And subsequent data change, wherein a change staff fills in a change list and change content in the work order system and executes the change after expected change information is synchronized to the CMDB. When the domain system detects the change of the domain data, the CMDB notifies the CMDB of the changed domain data in real time, and the CMDB compares the changed domain data with the previous expected change information while receiving the notification, and updates the domain data in the configuration management database after ensuring the accuracy of the data.
In step S150, the target domain data pushed by the configuration management database is received, where the target domain data is the changed domain data updated in the configuration management database by the target domain system.
In the embodiment of the present example, the CMDB pushes the target domain data to a specific topic of the message queue according to the subscription relationship after the target domain system updates the data, the topic is established according to the subscriber domain system, and then the message queue can push the updated target domain data to the subscriber domain system.
According to the embodiment of the application, low-coupling and full-flow cooperative management of data in various fields through the neighborhood system and the configuration management database is realized, the reliability of data management is effectively ensured, and the data quality is ensured.
In an embodiment of the present example, as shown with reference to fig. 3, the method further includes:
step S310, configuring a management database to obtain a business process, wherein the business process comprises specific operation on a plurality of target field systems;
step S320, sequentially mapping the interface of the specific operation to an object of a preset flow control function, so as to sequentially call the interface of the specific operation based on the flow control function to complete the business process.
In this way, in configuring lifecycle management, each step of operation in the business process can be embodied and encapsulated in the form of a process control function, and in this function, interfaces of systems in various fields can be called to complete corresponding operations (the corresponding interface can be called by mapping the interface as an object of the function). The flow management and control personnel only need to compile a flow in the service angle without knowing the internal implementation of the function. For example, the offline process of a host involves data changes in many fields (for example, multiple devices corresponding to neighborhood systems are sequentially offline), and the data changes in these fields are connected in series through a process control function to form a closed loop, so that the quality of data in the configuration management database can be further ensured.
In one embodiment, with continued reference to fig. 2, a first server 201 in which the domain systems are located is connected to form a block chain by using a second server 202 in which the management database is located as an intermediate node.
Further, the domain systems may obtain the model construction rule of the configuration management database shared by the second server 202 on the blockchain, and then the domain systems may establish the data management model according to the model construction rule of the configuration management database.
The first server 201 in which the domain systems are located may push the domain data corresponding to the data management model to the second server 202 in which the configuration management database is located, so as to establish an association relationship between the domain data of the domain systems in the configuration management database.
Each domain system subscribes to target domain data from the second server 202 through the first server 201 where the domain system is located, and the target domain data corresponds to a data management model of the target domain system.
When each domain system detects that the domain data changes, the changed domain data is sent to the second server 202 through the first server 201, so that the configuration management database updates the changed domain data
Each domain system receives target domain data pushed by the second server 202 through the first server 201 where the domain system is located, and the target domain data is changed domain data of the configuration management database update of the target domain system on the second server 202.
Therefore, the characteristics and the safety of data cannot be changed based on the block chain, and the reliability and the safety of multi-field data management are effectively ensured.
The application also provides a multi-field data management device. Referring to fig. 4, the multi-domain data management apparatus may include a setup module 410, a push module 420, a subscription module 430, an update module 440, and a distribution module 450. Wherein:
the building module 410 may be used for a domain system to build a data management model according to the model building rules of the configuration management database, the domain system being used for processing data of a predetermined domain;
the pushing module 420 may be configured to push domain data corresponding to the data management model to the configuration management database, so as to establish an association relationship between the domain data of each domain system in the configuration management database;
the subscription module 430 may be configured to subscribe to the configuration management database for target domain data corresponding to a data management model of a target domain system;
the updating module 440 may be configured to, when each of the domain systems detects that its domain data changes, send the changed domain data to the configuration management database, so that the configuration management database updates the changed domain data;
the distribution module 450 may be configured to receive the target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated by the target domain system in the configuration management database.
The specific details of each module in the multi-domain data management apparatus have been described in detail in the corresponding multi-domain data management method, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the application. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
Moreover, although the steps of the methods herein are depicted in the drawings in a particular order, this does not require or imply that the steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken into multiple step executions, etc.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which may be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.
In an exemplary embodiment of the present application, there is also provided an electronic device capable of implementing the above method.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
An electronic device 500 according to this embodiment of the invention is described below with reference to fig. 5. The electronic device 500 shown in fig. 5 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 5, the electronic device 500 is embodied in the form of a general purpose computing device. The components of the electronic device 500 may include, but are not limited to: the at least one processing unit 510, the at least one memory unit 520, and a bus 530 that couples various system components including the memory unit 520 and the processing unit 510.
Wherein the storage unit stores program code that is executable by the processing unit 510 to cause the processing unit 510 to perform steps according to various exemplary embodiments of the present invention as described in the above section "exemplary methods" of the present specification. For example, the processing unit 510 may perform the following as shown in fig. 1:
step S110, a data management model is established by a field system according to a model construction rule of a configuration management database, and the field system is used for processing data of a preset field;
step S120, pushing the domain data corresponding to the data management model to the configuration management database so as to establish an incidence relation of the domain data of each domain system in the configuration management database;
step S130, subscribing target domain data to the configuration management database, wherein the target domain data corresponds to a data management model of a target domain system;
step S140, when each domain system detects that the domain data changes, the changed domain data is sent to the configuration management database, so that the configuration management database updates the changed domain data;
step S150, receiving the target domain data pushed by the configuration management database, where the target domain data is the changed domain data updated in the configuration management database by the target domain system.
The memory unit 520 may include a readable medium in the form of a volatile memory unit, such as a random access memory unit (RAM)5201 and/or a cache memory unit 5202, and may further include a read only memory unit (ROM) 5203.
The electronic device 500 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a client to interact with the electronic device 500, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 500 to communicate with one or more other computing devices. Such communication may occur through input/output (I/O) interface 550, and may also include a display unit 540 coupled to input/output (I/O) interface 550. Also, the electronic device 500 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 560. As shown, the network adapter 560 communicates with the other modules of the electronic device 500 over the bus 530. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to make a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiments of the present application.
In an exemplary embodiment of the present application, referring to fig. 6, there is also provided a computer readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the above section "exemplary methods" of the present description, when said program product is run on the terminal device.
Referring to fig. 6, a program product 600 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this respect, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the client computing device, partly on the client device, as a stand-alone software package, partly on the client computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the client computing device over any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., over the internet using an internet service provider).
Furthermore, the above-described figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the invention, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
Claims (8)
1. A multi-domain data management method is characterized by comprising the following steps:
the method comprises the following steps that a field system establishes a data management model according to a model construction rule of a configuration management database, the field system is used for processing data of a preset field, and the number of the field systems is at least two;
pushing field data corresponding to the data management model to the configuration management database through a message queue so as to obtain the field data in the configuration management database based on an object database, wherein the field data comprises example data, cluster data and application data of a field system;
acquiring host data and a preset data relation mapping table provided by a configuration management database, wherein the host data is used for associating a resource server;
associating the host data with target instance data according to the preset data relation mapping table;
according to the preset data relation mapping table, associating target cluster information and target application information with instance data associated with the host data to obtain an association relation of each field data, wherein the object database is connected with the configuration management database through a message queue;
subscribing target domain data to the configuration management database, wherein the target domain data correspond to a data management model of a target domain system;
when each domain system detects that the domain data of the domain system changes, the changed domain data is sent to the configuration management database, so that the configuration management database updates the changed domain data;
and receiving the target domain data pushed by the configuration management database, wherein the target domain data is the changed domain data updated in the configuration management database by the target domain system.
2. The method of claim 1, wherein the domain system builds the data management model according to model building rules of the configuration management database, comprising:
when a domain system requests access, the domain system acquires a model construction rule of the configuration management database, wherein the model construction rule indicates a hierarchical structure of the configuration management database, and the hierarchical structure comprises an example, a cluster and an application hierarchy;
establishing a data management model of the field system according to the model construction rule, wherein the data management model comprises an instance field, a cluster field and an application field;
and reporting the data of the data management model to the configuration management database to complete the establishment of the data management model.
3. The method of claim 1, wherein associating target cluster information and target application information with instance data that has associated the host data comprises:
searching a relation broad table in the server by taking the host as a unit dimension;
and after associating the target cluster information and the target application information with the instance data associated with the host data, storing the obtained data association relation to the relation broad table.
4. The method of claim 1, wherein sending the modified domain data to the configuration management database to cause the configuration management database to update the modified domain data comprises:
obtaining expected change information received by a configuration management database, wherein the expected change information corresponds to the domain system of the changed domain data source;
acquiring the changed domain data acquired by the configuration management database, and acquiring the changed domain data reported by the domain system;
comparing the expected change information, the collected changed domain data and the changed domain data reported by the domain system, and verifying the collected changed domain data;
and when the verification is passed, updating the collected changed domain data in a configuration management database.
5. The method of claim 1, further comprising:
configuring a management database to obtain a business process, wherein the business process comprises specific operations on a plurality of target field systems;
and mapping the interface of the specific operation to an object of a preset flow control function in sequence so as to call the interface of the specific operation in sequence to complete the business flow based on the flow control function.
6. A multi-domain data management device, comprising:
the system comprises an establishing module, a data management module and a data management module, wherein the establishing module is used for establishing a data management model by a domain system according to a model establishing rule of a configuration management database, the domain system is used for processing data of a preset domain, and the number of the domain systems is at least two;
the pushing module is used for pushing the field data corresponding to the data management model to the configuration management database through a message queue so as to obtain the field data in the configuration management database based on an object database, wherein the field data comprises instance data, cluster data and application data of a field system; acquiring host data and a preset data relation mapping table provided by a configuration management database, wherein the host data is used for associating a resource server; associating the host data with target instance data according to the preset data relation mapping table; according to the preset data relation mapping table, associating target cluster information and target application information with instance data associated with the host data to obtain an association relation of each field data, wherein the object database is connected with the configuration management database through a message queue;
the subscription module is used for subscribing target field data to the configuration management database, and the target field data corresponds to a data management model of a target field system;
the updating module is used for sending the changed domain data to the configuration management database when each domain system detects that the domain data of the domain system changes, so that the configuration management database updates the changed domain data;
and the distribution module is used for receiving the target domain data pushed by the configuration management database, wherein the target domain data is the changed domain data updated in the configuration management database by the target domain system.
7. A computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the method of any of claims 1-5.
8. An electronic device, comprising:
a processor; and
a memory for storing computer program instructions for the processor; wherein the processor is configured to perform the method of any one of claims 1-5 via execution of the computer program instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010624003.8A CN111782672B (en) | 2020-06-30 | 2020-06-30 | Multi-field data management method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010624003.8A CN111782672B (en) | 2020-06-30 | 2020-06-30 | Multi-field data management method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111782672A CN111782672A (en) | 2020-10-16 |
| CN111782672B true CN111782672B (en) | 2022-09-27 |
Family
ID=72761372
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010624003.8A Active CN111782672B (en) | 2020-06-30 | 2020-06-30 | Multi-field data management method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111782672B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113297181A (en) * | 2021-06-11 | 2021-08-24 | 建信金融科技有限责任公司 | Configuration item management database, data processing method and device |
| CN113535680A (en) * | 2021-07-16 | 2021-10-22 | 国家电网有限公司 | Configuration management data processing system and method |
| CN113672203B (en) * | 2021-08-26 | 2022-04-08 | 优维科技(深圳)有限公司 | Model inheritance method for CMDB configuration management |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331538A (en) * | 2014-09-30 | 2015-02-04 | 中国人民解放军国防信息学院 | Information flow process modeling method and system based on mode assignment |
| CN106572173A (en) * | 2016-11-07 | 2017-04-19 | 网易无尾熊（杭州）科技有限公司 | Method, apparatus and system for updating configuration information |
| CN107015804A (en) * | 2017-03-29 | 2017-08-04 | 武汉大思想信息股份有限公司 | A kind of method and system by the quick exploration project of provisioning API |
| CN107895049A (en) * | 2017-12-05 | 2018-04-10 | 泰康保险集团股份有限公司 | Data processing method and device, computer-readable recording medium, electronic equipment |
| CN108733787A (en) * | 2018-05-11 | 2018-11-02 | 中国平安人寿保险股份有限公司 | Database operation method, device, electronic equipment and storage medium |
| CN110347659A (en) * | 2019-06-13 | 2019-10-18 | 阿里巴巴集团控股有限公司 | Data processing method and device, transaction data processing method and device |
| CN110990642A (en) * | 2019-12-05 | 2020-04-10 | 国网湖南省电力有限公司 | Graph database construction method for CMDB business model of power system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8806568B2 (en) * | 2011-07-11 | 2014-08-12 | International Business Machines Corporation | Automatic generation of user account policies based on configuration management database information |
| US10102258B2 (en) * | 2016-06-19 | 2018-10-16 | Data.World, Inc. | Collaborative dataset consolidation via distributed computer networks |
| US11100084B2 (en) * | 2017-05-05 | 2021-08-24 | Servicenow, Inc. | Configuration management identification rule testing |
-
2020
- 2020-06-30 CN CN202010624003.8A patent/CN111782672B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331538A (en) * | 2014-09-30 | 2015-02-04 | 中国人民解放军国防信息学院 | Information flow process modeling method and system based on mode assignment |
| CN106572173A (en) * | 2016-11-07 | 2017-04-19 | 网易无尾熊（杭州）科技有限公司 | Method, apparatus and system for updating configuration information |
| CN107015804A (en) * | 2017-03-29 | 2017-08-04 | 武汉大思想信息股份有限公司 | A kind of method and system by the quick exploration project of provisioning API |
| CN107895049A (en) * | 2017-12-05 | 2018-04-10 | 泰康保险集团股份有限公司 | Data processing method and device, computer-readable recording medium, electronic equipment |
| CN108733787A (en) * | 2018-05-11 | 2018-11-02 | 中国平安人寿保险股份有限公司 | Database operation method, device, electronic equipment and storage medium |
| CN110347659A (en) * | 2019-06-13 | 2019-10-18 | 阿里巴巴集团控股有限公司 | Data processing method and device, transaction data processing method and device |
| CN110990642A (en) * | 2019-12-05 | 2020-04-10 | 国网湖南省电力有限公司 | Graph database construction method for CMDB business model of power system |
Non-Patent Citations (1)
| Title |
|---|
| 云数据中心在航天试验任务领域智能运维一体化解决方案;陈洪雁 等;《微电子学与计算机》;20190531;第36卷(第5期);第33页-第37页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111782672A (en) | 2020-10-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11909604B2 (en) | Automatic provisioning of monitoring for containerized microservices | |
| CN111782672B (en) | Multi-field data management method and related device | |
| US20190303779A1 (en) | Digital worker management system | |
| CN113254466B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN111309550A (en) | Data acquisition method, system, equipment and storage medium of application program | |
| JP6325001B2 (en) | Method and system using recursive event listeners in nodes of hierarchical data structures | |
| CN112235130A (en) | Method and device for realizing operation and maintenance automation based on SDN network | |
| US20170048115A1 (en) | SDN Application Integration, Management and Control Method, System and Device | |
| CN113377626B (en) | Visual unified alarm method, device, equipment and medium based on service tree | |
| CN112148578A (en) | IT fault defect prediction method based on machine learning | |
| CN112306700A (en) | Abnormal RPC request diagnosis method and device | |
| EP3923155A2 (en) | Method and apparatus for processing snapshot, device, medium and product | |
| CN113590437A (en) | Alarm information processing method, device, equipment and medium | |
| CN111162938A (en) | Data processing system and method | |
| CN115514618A (en) | Alarm event processing method and device, electronic equipment and medium | |
| US20230229659A1 (en) | Estimating query execution performance using a sampled counter | |
| CN115982133A (en) | Data processing method and device | |
| CN114756301A (en) | Log processing method, device and system | |
| WO2023113847A1 (en) | Application programming interface (api) server for correlation engine and policy manager (cpe), method and computer program product | |
| CN112579402A (en) | Method and device for positioning faults of application system | |
| CN113297516A (en) | Customer interaction interface generation method and device and electronic equipment | |
| CN111858260A (en) | Information display method, device, equipment and medium | |
| CN117149587B (en) | Monitoring ledger management method, device, storage medium and equipment | |
| CN108459940A (en) | Application performance manages configuration information amending method, device and the electronic equipment of system | |
| CN112564953B (en) | Method, device and equipment for managing remote equipment of office |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |