CN113836372A - Configuration center data visualization method and system based on distributed service - Google Patents

Configuration center data visualization method and system based on distributed service Download PDF

Info

Publication number
CN113836372A
CN113836372A CN202110988950.XA CN202110988950A CN113836372A CN 113836372 A CN113836372 A CN 113836372A CN 202110988950 A CN202110988950 A CN 202110988950A CN 113836372 A CN113836372 A CN 113836372A
Authority
CN
China
Prior art keywords
configuration
center
information
service
template
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110988950.XA
Other languages
Chinese (zh)
Inventor
王沛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhenguan Shuzhi Technology Co ltd
Original Assignee
Beijing Zhenguan Shuzhi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhenguan Shuzhi Technology Co ltd filed Critical Beijing Zhenguan Shuzhi Technology Co ltd
Priority to CN202110988950.XA priority Critical patent/CN113836372A/en
Publication of CN113836372A publication Critical patent/CN113836372A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/904Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/186Templates

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a distributed service-based configuration center data visualization method and system, wherein the method comprises the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program to generate a uniform json format configuration template and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface and injecting the visual form interface into the configuration entity class. The method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.

Description

Configuration center data visualization method and system based on distributed service
Technical Field
The invention relates to the technical field of data visualization, in particular to a configuration center data visualization method and system based on distributed services.
Background
Under the condition that distributed microservices are prevalent, the number of services and the configuration of programs (various microservices, server addresses and parameters) are increasing, and the traditional configuration file mode and database mode cannot meet the requirement of developers on configuration management, a plurality of distributed configuration center middleware such as nacos, zookeeper, apollo, springconfig and the like are generated, so that the configuration can be managed in a centralized manner, updated in real time and separated from applications. However, the conventional profile management method still has the following defects: poor readability, non-uniform configuration items, redundant configuration, and the like.
Disclosure of Invention
In order to solve the problems, the invention provides a configuration center data visualization method and system based on distributed services, which have the advantages of excellent readability, uniform configuration items and less redundant configuration.
The technical scheme of the invention is as follows:
a configuration center data visualization method based on distributed services comprises the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class.
The working principle of the technical scheme is as follows: the method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.
In a further technical solution, after the visualization form interface is injected into the configuration entity class, the method further includes a step of modifying configuration item data, including: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration.
After the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
In a further technical solution, before the configuration template is written into the configuration center, a step of data verification is further included, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center.
The accuracy and the non-repeatability of the configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center.
In a further technical solution, the source of the configuration information includes remote configuration information or local file configuration information, and when one of the two fails, the other source provides the configuration information instead.
The information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
The invention provides a data visualization system of a configuration center based on distributed service, which comprises an information writing module, a configuration center, configuration management service, a configuration entity and a plurality of service clusters, wherein the information writing module is used for acquiring data in a server, is based on program language annotation drive and describes configuration information in a configuration class; the service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center; the configuration center is used for receiving the configuration template; the configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
In a further technical solution, the visualization system further includes a configuration management module, configured to send configuration item primary key values and change values corresponding to configuration item data modified by a user to the configuration management service, and the configuration management service further includes a change processing module, configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
In a further technical scheme, the system further comprises a data verification module arranged between the configuration management component program and the configuration center.
The invention has the beneficial effects that:
1. compared with files using properties or yml and the like as suffixes in the prior art, the invention forms the configuration information into a uniform Json format configuration template, good readability and uniform configuration items, and writes the configuration templates into configuration centers which can include Nacos, zk, apollo and other distributed configuration centers, solving the problem of difficult configuration management such as non-uniform format and increased configuration items of configuration items, and generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity, the invention acquires the view parameters from the server, the method creates a view in a user interface, allows a user to modify configuration item data in the view interface, realizes the real-time effect of configuration data change on the distributed service, meanwhile, by using the distributed service architecture of the method, the operation and maintenance can manage the configuration of all the services only by maintaining one set of configuration, and the operation and maintenance difficulty is low;
2. after the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
3. The accuracy and the non-repeatability of configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center;
4. the information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
Drawings
Fig. 1 is a flowchart of a distributed service-based configuration center data visualization method according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a distributed service-based configuration center data visualization system according to an embodiment of the present invention;
FIG. 3 is a flow chart of modifying configuration item data according to an embodiment of the present invention.
Detailed Description
The embodiments of the present invention will be further described with reference to the accompanying drawings.
Example (b):
a method for visualizing data of a configuration center based on distributed services, as shown in fig. 1, includes the following steps: requesting and starting a service; describing configuration information in a configuration class based on a program language annotation drive; scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center; and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class. For example, the program language may be Java, Go language, etc., and the present invention is not limited thereto. For example, the configuration center may include nacos, a configuration information query interface corresponding to the configuration management service, a configuration item form information query interface, a configuration item form information editing interface, a configuration search interface, and may further include springconfig, a common configuration item storage interface corresponding to the configuration management service, a common configuration item deletion interface, a common configuration item editing interface, a common configuration item query interface, and may further include zookeep, a configuration form verification corresponding to the configuration management service, and may further include apollo, an operation log storage interface corresponding to the configuration management service, an operation log query interface, and the like. For example, the configuration template in the json format is corresponded and written according to the distributed configuration center type of the configuration center.
For example, the configuration template may be designed as follows, see tables 1, 2, 3:
TABLE 1 configuration parameter description
Figure RE-GDA0003378165120000051
TABLE 2 configuration item optionSettings parameter description
Figure RE-GDA0003378165120000052
Figure RE-GDA0003378165120000061
Figure RE-GDA0003378165120000071
TABLE 3 custom data Source customDataList parameter Specification
Parameter name Description of the parameters Type (B)
value Value of string
text Displaying text string
The working principle of the technical scheme is as follows: the method forms the configuration information into a uniform Json-format configuration template, writes the configuration template into the configuration center, has excellent readability and uniform configuration items, generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity.
The beneficial effects of the above technical scheme are that: compared with files using properties or yml and the like as suffixes in the prior art, the invention forms the configuration information into a uniform Json format configuration template, good readability and uniform configuration items, and writes the configuration templates into configuration centers which can include Nacos, zk, apollo and other distributed configuration centers, solving the problem of difficult configuration management such as non-uniform format and increased configuration items of configuration items, and generates a visual form interface through the configuration management service and injects the visual form interface into the configuration entity, the invention acquires the view parameters from the server, the method creates a view in a user interface, allows a user to modify configuration item data in the view interface, realizes the real-time effect of configuration data change on the distributed service, meanwhile, by using the distributed service architecture of the method, the operation and maintenance can manage the configuration of all the services only by maintaining one set of configuration, and the operation and maintenance difficulty is low.
In another embodiment, after the visual form interface is injected into the configuration entity class, the method further includes the step of modifying the configuration item data, including: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration. After the visualization form interface is injected into the configuration entity class, the step of modifying the configuration item data is set, so that a user can modify the configuration item data in a view section, and the configuration data change can take effect on the distributed service in real time.
In another embodiment, before the configuration template is written into the configuration center, the method further includes a step of data verification, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center. The accuracy and the non-repeatability of the configuration information written into the configuration center are improved by the step of setting data verification before the configuration template is written into the configuration center.
In further embodiments, the source of the configuration information comprises remote configuration information or local file configuration information, and when one of the two fails, the other source is replaced to provide the configuration information. The information source is set as remote configuration information or local file configuration information, so that the normal operation of the service is ensured.
Another aspect of the present invention provides a configuration center data visualization system based on distributed services, as shown in fig. 2, including an information writing module, a configuration center, a configuration management service, a configuration entity, and several service clusters. For example, service cluster a, service cluster B, service cluster C. The information writing module is used for acquiring data in the server, and describing configuration information in the configuration class based on the program language annotation drive. The service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center. The configuration center is used for receiving the configuration template. The configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
In another embodiment, the visualization system further includes a configuration management module, configured to send configuration item primary key values and change values corresponding to configuration item data modified by a user to the configuration management service, and the configuration management service further includes a change processing module, configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
In another embodiment, the system further comprises a data verification module arranged between the configuration management component program and the configuration center, so as to improve the accuracy and the non-repeatability of the configuration information written into the configuration center.
The above-mentioned embodiments only express the specific embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention.

Claims (7)

1. A configuration center data visualization method based on distributed services is characterized by comprising the following steps:
requesting and starting a service;
describing configuration information in a configuration class based on a program language annotation drive;
scanning and analyzing the annotation through a configuration management component program, establishing a storage space of a json data structure in a storage medium, and generating a uniform json format configuration template from the analyzed annotation and writing the configuration template into a configuration center;
and analyzing the configuration information of the configuration center through a configuration management service, generating a visual form interface, injecting the visual form interface into a configuration entity class, and establishing a storage space which is suitable for the configuration entity class into which the configuration information is injected in a storage medium for storing the configuration entity class.
2. The distributed service-based configuration center data visualization method according to claim 1, further comprising a step of modifying configuration item data after the visualization form interface is injected into the configuration entity class, comprising: modifying the configuration item data through a visual interface by a user, and sending the configuration item primary key values and the change values to the configuration management service; the configuration management service receives the configuration change request, modifies the value of the configuration item corresponding to the configuration center, and then sends configuration item change information to the server; the server refreshes the configuration.
3. The distributed service based configuration center data visualization method according to claim 1, further comprising a step of data verification before the configuration template is written into the configuration center, including: judging whether the configuration information is legal or not; if not, the service is failed to start; if yes, judging whether the configuration center has current configuration information, if yes, analyzing the configuration information of the configuration center and injecting the configuration information into the configuration entity, and if not, writing the configuration template into the configuration center.
4. The method of claim 1, wherein the source of the configuration information comprises remote configuration information or local file configuration information, and when one of the remote configuration information and the local file configuration information fails, the other source is replaced with the remote configuration information to provide the configuration information.
5. A data visualization system of a configuration center based on distributed service is characterized by comprising an information writing module, a configuration center, configuration management service, a configuration entity and a plurality of service clusters, wherein the information writing module is used for acquiring data in a server, is driven based on program language annotation and describes configuration information in a configuration class; the service cluster comprises a configuration management component program, wherein the configuration management component program comprises an annotation scanning part, a configuration template generating part based on json format according to the annotation and a writing part for transmitting the configuration template to the configuration center; the configuration center is used for receiving the configuration template; the configuration management service comprises an analysis module for acquiring configuration information of the configuration template, a generation module for generating a visual form interface and an input module for injecting the visual form interface into the configuration entity; the configuration entity is configured to receive the visual form interface.
6. The system of claim 5, further comprising a configuration management module configured to send configuration item primary key values and changed values corresponding to configuration item data modified by a user to the configuration management service, wherein the configuration management service further comprises a change processing module configured to receive a configuration item change request, modify values of configuration items corresponding to the configuration center, and send configuration item change information to the server.
7. The distributed service based configuration center data visualization system as claimed in claim 5, further comprising a data verification module disposed between the configuration management component program and the configuration center.
CN202110988950.XA 2021-08-26 2021-08-26 Configuration center data visualization method and system based on distributed service Pending CN113836372A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110988950.XA CN113836372A (en) 2021-08-26 2021-08-26 Configuration center data visualization method and system based on distributed service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110988950.XA CN113836372A (en) 2021-08-26 2021-08-26 Configuration center data visualization method and system based on distributed service

Publications (1)

Publication Number Publication Date
CN113836372A true CN113836372A (en) 2021-12-24

Family

ID=78961382

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110988950.XA Pending CN113836372A (en) 2021-08-26 2021-08-26 Configuration center data visualization method and system based on distributed service

Country Status (1)

Country Link
CN (1) CN113836372A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102255752A (en) * 2011-06-30 2011-11-23 北京新媒传信科技有限公司 Configuration management system and method of server cluster
US20160149761A1 (en) * 2014-11-26 2016-05-26 Edgewater Networks, Inc. Method and system for providing unified configuration information to disparate system software components
CN109660377A (en) * 2017-10-12 2019-04-19 中兴通讯股份有限公司 Unified configuring management method, service server and operation and maintenance management platform
CN109683953A (en) * 2018-12-26 2019-04-26 苏州思必驰信息科技有限公司 A kind of method and device carrying out configuration file processing based on visualization interface
CN112118298A (en) * 2020-09-03 2020-12-22 杭州海康威视数字技术股份有限公司 Configuration management method and device for distributed service
CN112363775A (en) * 2020-11-11 2021-02-12 深圳力维智联技术有限公司 Method, system and storage medium for dynamically modifying microservice configuration information

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102255752A (en) * 2011-06-30 2011-11-23 北京新媒传信科技有限公司 Configuration management system and method of server cluster
US20160149761A1 (en) * 2014-11-26 2016-05-26 Edgewater Networks, Inc. Method and system for providing unified configuration information to disparate system software components
CN109660377A (en) * 2017-10-12 2019-04-19 中兴通讯股份有限公司 Unified configuring management method, service server and operation and maintenance management platform
CN109683953A (en) * 2018-12-26 2019-04-26 苏州思必驰信息科技有限公司 A kind of method and device carrying out configuration file processing based on visualization interface
CN112118298A (en) * 2020-09-03 2020-12-22 杭州海康威视数字技术股份有限公司 Configuration management method and device for distributed service
CN112363775A (en) * 2020-11-11 2021-02-12 深圳力维智联技术有限公司 Method, system and storage medium for dynamically modifying microservice configuration information

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
空城1995: "Disconf原理和实践", pages 1 - 12, Retrieved from the Internet <URL:https://blog.csdn.net/fy_java1995/article/details/109237027> *

Similar Documents

Publication Publication Date Title
Begoli et al. Design principles for effective knowledge discovery from big data
US20050165865A1 (en) Metadata journal for information technology systems
US9998450B2 (en) Automatically generating certification documents
US20140250040A1 (en) Correlating data from multiple business processes to a business process scenario
CN112181840B (en) Method and device for determining database state, equipment and storage medium
CN111401029A (en) Document version updating system and method based on document partition and collaborative editing
CN113204598A (en) Data synchronization method, system and storage medium
CN111090803A (en) Data processing method and device, electronic equipment and storage medium
US20180150543A1 (en) Unified multiversioned processing of derived data
CN113836372A (en) Configuration center data visualization method and system based on distributed service
CN114004587B (en) Design system and method for automatic control of whole machine model
US20190356669A1 (en) Access Control
CN114610803A (en) Data processing method and device, electronic equipment and storage medium
CN111639478B (en) Automatic data auditing method and system based on EXCEL document
US20210141791A1 (en) Method and system for generating a hybrid data model
US11755572B1 (en) Systems, methods, and apparatus for natural language queries and data visualizations
JP2005258591A (en) Database access control system
CN115657901B (en) Service changing method and device based on unified parameters
CN113779939B (en) Document hot patch generation method, document hot patch application method and document hot patch Ding Zhuangzhi
US11232243B1 (en) System and method for employing model repository
CN114756531A (en) Data processing method and system based on script
CN114546982A (en) Data processing method and device, computer readable medium and electronic equipment
CN115237986A (en) Data dump method, device and storage medium
CN117649915A (en) Medical record version control method, system, storage medium and equipment based on simulator
CN116860846A (en) Non-invasive data extraction processing method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination