CN113836372A - Configuration center data visualization method and system based on distributed service - Google Patents
Configuration center data visualization method and system based on distributed service Download PDFInfo
- Publication number
- CN113836372A CN113836372A CN202110988950.XA CN202110988950A CN113836372A CN 113836372 A CN113836372 A CN 113836372A CN 202110988950 A CN202110988950 A CN 202110988950A CN 113836372 A CN113836372 A CN 113836372A
- Authority
- CN
- China
- Prior art keywords
- configuration
- center
- information
- service
- template
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/904—Browsing; Visualisation therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/186—Templates
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a distributed service-based configuration center data visualization method and system, wherein the method comprises the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program to generate a uniform json format configuration template and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface and injecting the visual form interface into the configuration entity class. The method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.
Description
Technical Field
The invention relates to the technical field of data visualization, in particular to a configuration center data visualization method and system based on distributed services.
Background
Under the condition that distributed microservices are prevalent, the number of services and the configuration of programs (various microservices, server addresses and parameters) are increasing, and the traditional configuration file mode and database mode cannot meet the requirement of developers on configuration management, a plurality of distributed configuration center middleware such as nacos, zookeeper, apollo, springconfig and the like are generated, so that the configuration can be managed in a centralized manner, updated in real time and separated from applications. However, the conventional profile management method still has the following defects: poor readability, non-uniform configuration items, redundant configuration, and the like.
Disclosure of Invention
In order to solve the problems, the invention provides a configuration center data visualization method and system based on distributed services, which have the advantages of excellent readability, uniform configuration items and less redundant configuration.
The technical scheme of the invention is as follows:
a configuration center data visualization method based on distributed services comprises the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class.
The working principle of the technical scheme is as follows: the method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.
In a further technical solution, after the visualization form interface is injected into the configuration entity class, the method further includes a step of modifying configuration item data, including: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration.
After the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
In a further technical solution, before the configuration template is written into the configuration center, a step of data verification is further included, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center.
The accuracy and the non-repeatability of the configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center.
In a further technical solution, the source of the configuration information includes remote configuration information or local file configuration information, and when one of the two fails, the other source provides the configuration information instead.
The information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
The invention provides a data visualization system of a configuration center based on distributed service, which comprises an information writing module, a configuration center, configuration management service, a configuration entity and a plurality of service clusters, wherein the information writing module is used for acquiring data in a server, is based on program language annotation drive and describes configuration information in a configuration class; the service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center; the configuration center is used for receiving the configuration template; the configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
In a further technical solution, the visualization system further includes a configuration management module, configured to send configuration item primary key values and change values corresponding to configuration item data modified by a user to the configuration management service, and the configuration management service further includes a change processing module, configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
In a further technical scheme, the system further comprises a data verification module arranged between the configuration management component program and the configuration center.
The invention has the beneficial effects that:
1. compared with files using properties or yml and the like as suffixes in the prior art, the invention forms the configuration information into a uniform Json format configuration template, good readability and uniform configuration items, and writes the configuration templates into configuration centers which can include Nacos, zk, apollo and other distributed configuration centers, solving the problem of difficult configuration management such as non-uniform format and increased configuration items of configuration items, and generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity, the invention acquires the view parameters from the server, the method creates a view in a user interface, allows a user to modify configuration item data in the view interface, realizes the real-time effect of configuration data change on the distributed service, meanwhile, by using the distributed service architecture of the method, the operation and maintenance can manage the configuration of all the services only by maintaining one set of configuration, and the operation and maintenance difficulty is low;
2. after the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
3. The accuracy and the non-repeatability of configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center;
4. the information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
Drawings
Fig. 1 is a flowchart of a distributed service-based configuration center data visualization method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a distributed service-based configuration center data visualization system according to an embodiment of the present invention;
FIG. 3 is a flow chart of modifying configuration item data according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be further described with reference to the accompanying drawings.
Example (b):
a method for visualizing data of a configuration center based on distributed services, as shown in fig. 1, includes the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class. For example, the program language may be Java, Go language, etc., and the present invention is not limited thereto. For example, the configuration center may include nacos, a configuration information query interface corresponding to the configuration management service, a configuration item form information query interface, a configuration item form information editing interface, a configuration search interface, and may further include springconfig, a common configuration item storage interface corresponding to the configuration management service, a common configuration item deletion interface, a common configuration item editing interface, a common configuration item query interface, and may further include zookeep, a configuration form verification corresponding to the configuration management service, and may further include apollo, an operation log storage interface corresponding to the configuration management service, an operation log query interface, and the like. For example, the configuration template in the json format is corresponded and written according to the distributed configuration center type of the configuration center.
For example, the configuration template may be designed as follows, see tables 1, 2, 3:
TABLE 1 configuration parameter description
TABLE 2 configuration item optionSettings parameter description
TABLE 3 custom data Source customDataList parameter Specification
Parameter name | Description of the parameters | Type (B) |
value | Value of | string |
text | Displaying text | string |
The working principle of the technical scheme is as follows: the method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.
The beneficial effects of the above technical scheme are that: compared with files using properties or yml and the like as suffixes in the prior art, the invention forms the configuration information into a uniform Json format configuration template, good readability and uniform configuration items, and writes the configuration templates into configuration centers which can include Nacos, zk, apollo and other distributed configuration centers, solving the problem of difficult configuration management such as non-uniform format and increased configuration items of configuration items, and generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity, the invention acquires the view parameters from the server, the method creates a view in a user interface, allows a user to modify configuration item data in the view interface, realizes the real-time effect of configuration data change on the distributed service, meanwhile, by using the distributed service architecture of the method, the operation and maintenance can manage the configuration of all the services only by maintaining one set of configuration, and the operation and maintenance difficulty is low.
In another embodiment, after the visual form interface is injected into the configuration entity class, the method further includes the step of modifying the configuration item data, including: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration. After the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
In another embodiment, before the configuration template is written into the configuration center, the method further includes a step of data verification, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center. The accuracy and the non-repeatability of the configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center.
In further embodiments, the source of the configuration information comprises remote configuration information or local file configuration information, and when one of the two fails, the other source is replaced to provide the configuration information. The information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
Another aspect of the present invention provides a configuration center data visualization system based on distributed services, as shown in fig. 2, including an information writing module, a configuration center, a configuration management service, a configuration entity, and several service clusters. For example, service cluster a, service cluster B, service cluster C. The information writing module is used for acquiring data in the server, and describing configuration information in the configuration class based on the program language annotation drive. The service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center. The configuration center is used for receiving the configuration template. The configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
In another embodiment, the visualization system further includes a configuration management module, configured to send configuration item primary key values and change values corresponding to configuration item data modified by a user to the configuration management service, and the configuration management service further includes a change processing module, configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
In another embodiment, the system further comprises a data verification module arranged between the configuration management component program and the configuration center, so as to improve the accuracy and the non-repeatability of the configuration information written into the configuration center.
The above-mentioned embodiments only express the specific embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.
Claims (7)
1. A configuration center data visualization method based on distributed services is characterized by comprising the following steps:
requesting and starting a service;
describing configuration information in a configuration class based on a program language annotation drive;
scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center;
and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class.
2. The distributed service-based configuration center data visualization method according to claim 1, further comprising a step of modifying configuration item data after the visualization form interface is injected into the configuration entity class, comprising: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration.
3. The distributed service based configuration center data visualization method according to claim 1, further comprising a step of data verification before the configuration template is written into the configuration center, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center.
4. The method of claim 1, wherein the source of the configuration information comprises remote configuration information or local file configuration information, and when one of the remote configuration information and the local file configuration information fails, the other source is replaced with the remote configuration information to provide the configuration information.
5. A data visualization system of a configuration center based on distributed service is characterized by comprising an information writing module, a configuration center, configuration management service, a configuration entity and a plurality of service clusters, wherein the information writing module is used for acquiring data in a server, is driven based on program language annotation and describes configuration information in a configuration class; the service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center; the configuration center is used for receiving the configuration template; the configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
6. The system of claim 5, further comprising a configuration management module configured to send configuration item primary key values and changed values corresponding to configuration item data modified by a user to the configuration management service, wherein the configuration management service further comprises a change processing module configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
7. The distributed service based configuration center data visualization system as claimed in claim 5, further comprising a data verification module disposed between the configuration management component program and the configuration center.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110988950.XA CN113836372A (en) | 2021-08-26 | 2021-08-26 | Configuration center data visualization method and system based on distributed service |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110988950.XA CN113836372A (en) | 2021-08-26 | 2021-08-26 | Configuration center data visualization method and system based on distributed service |
Publications (1)
Publication Number | Publication Date |
---|---|
CN113836372A true CN113836372A (en) | 2021-12-24 |
Family
ID=78961382
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110988950.XA Pending CN113836372A (en) | 2021-08-26 | 2021-08-26 | Configuration center data visualization method and system based on distributed service |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113836372A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102255752A (en) * | 2011-06-30 | 2011-11-23 | 北京新媒传信科技有限公司 | Configuration management system and method of server cluster |
US20160149761A1 (en) * | 2014-11-26 | 2016-05-26 | Edgewater Networks, Inc. | Method and system for providing unified configuration information to disparate system software components |
CN109660377A (en) * | 2017-10-12 | 2019-04-19 | 中兴通讯股份有限公司 | Unified configuring management method, service server and operation and maintenance management platform |
CN109683953A (en) * | 2018-12-26 | 2019-04-26 | 苏州思必驰信息科技有限公司 | A kind of method and device carrying out configuration file processing based on visualization interface |
CN112118298A (en) * | 2020-09-03 | 2020-12-22 | 杭州海康威视数字技术股份有限公司 | Configuration management method and device for distributed service |
CN112363775A (en) * | 2020-11-11 | 2021-02-12 | 深圳力维智联技术有限公司 | Method, system and storage medium for dynamically modifying microservice configuration information |
-
2021
- 2021-08-26 CN CN202110988950.XA patent/CN113836372A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102255752A (en) * | 2011-06-30 | 2011-11-23 | 北京新媒传信科技有限公司 | Configuration management system and method of server cluster |
US20160149761A1 (en) * | 2014-11-26 | 2016-05-26 | Edgewater Networks, Inc. | Method and system for providing unified configuration information to disparate system software components |
CN109660377A (en) * | 2017-10-12 | 2019-04-19 | 中兴通讯股份有限公司 | Unified configuring management method, service server and operation and maintenance management platform |
CN109683953A (en) * | 2018-12-26 | 2019-04-26 | 苏州思必驰信息科技有限公司 | A kind of method and device carrying out configuration file processing based on visualization interface |
CN112118298A (en) * | 2020-09-03 | 2020-12-22 | 杭州海康威视数字技术股份有限公司 | Configuration management method and device for distributed service |
CN112363775A (en) * | 2020-11-11 | 2021-02-12 | 深圳力维智联技术有限公司 | Method, system and storage medium for dynamically modifying microservice configuration information |
Non-Patent Citations (1)
Title |
---|
空城1995: "Disconf原理和实践", pages 1 - 12, Retrieved from the Internet <URL:https://blog.csdn.net/fy_java1995/article/details/109237027> * |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Begoli et al. | Design principles for effective knowledge discovery from big data | |
US20050165865A1 (en) | Metadata journal for information technology systems | |
US9998450B2 (en) | Automatically generating certification documents | |
US20140250040A1 (en) | Correlating data from multiple business processes to a business process scenario | |
CN112181840B (en) | Method and device for determining database state, equipment and storage medium | |
CN111401029A (en) | Document version updating system and method based on document partition and collaborative editing | |
CN113204598A (en) | Data synchronization method, system and storage medium | |
CN111090803A (en) | Data processing method and device, electronic equipment and storage medium | |
US20180150543A1 (en) | Unified multiversioned processing of derived data | |
CN113836372A (en) | Configuration center data visualization method and system based on distributed service | |
CN114004587B (en) | Design system and method for automatic control of whole machine model | |
US20190356669A1 (en) | Access Control | |
CN114610803A (en) | Data processing method and device, electronic equipment and storage medium | |
CN111639478B (en) | Automatic data auditing method and system based on EXCEL document | |
US20210141791A1 (en) | Method and system for generating a hybrid data model | |
US11755572B1 (en) | Systems, methods, and apparatus for natural language queries and data visualizations | |
JP2005258591A (en) | Database access control system | |
CN115657901B (en) | Service changing method and device based on unified parameters | |
CN113779939B (en) | Document hot patch generation method, document hot patch application method and document hot patch Ding Zhuangzhi | |
US11232243B1 (en) | System and method for employing model repository | |
CN114756531A (en) | Data processing method and system based on script | |
CN114546982A (en) | Data processing method and device, computer readable medium and electronic equipment | |
CN115237986A (en) | Data dump method, device and storage medium | |
CN117649915A (en) | Medical record version control method, system, storage medium and equipment based on simulator | |
CN116860846A (en) | Non-invasive data extraction processing method and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |