CN111934932B - Internet architecture evaluation method and device - Google Patents

Internet architecture evaluation method and device Download PDF

Info

Publication number
CN111934932B
CN111934932B CN202010812038.4A CN202010812038A CN111934932B CN 111934932 B CN111934932 B CN 111934932B CN 202010812038 A CN202010812038 A CN 202010812038A CN 111934932 B CN111934932 B CN 111934932B
Authority
CN
China
Prior art keywords
evaluation
architecture
internet architecture
information
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010812038.4A
Other languages
Chinese (zh)
Other versions
CN111934932A (en
Inventor
迟爽
高建华
邓强
叶轮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202010812038.4A priority Critical patent/CN111934932B/en
Publication of CN111934932A publication Critical patent/CN111934932A/en
Application granted granted Critical
Publication of CN111934932B publication Critical patent/CN111934932B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/02Topology update or discovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/12Discovery or management of network topologies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/10Active monitoring, e.g. heartbeat, ping or trace-route
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/12Network monitoring probes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/70Admission control; Resource allocation
    • H04L47/82Miscellaneous aspects
    • H04L47/829Topology based

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Cardiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention provides an internet architecture evaluation method and device, wherein the internet architecture evaluation method comprises the following steps: receiving request data of a client; responding to the request data, and collecting each hop of information of the request data by utilizing a node probe in an internet architecture; generating a routing topology structure chart according to the information of each hop; and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model. The method and the device for evaluating the internet architecture provided by the invention realize effective evaluation on the internet by combining the full link monitoring technology.

Description

Internet architecture evaluation method and device
Technical Field
The invention relates to the technical field of computers, in particular to the technical field of computer software operation and maintenance, and specifically relates to an internet architecture evaluation method and device.
Background
With the popularization of internet application, in the face of the urgent requirements of high concurrency, high performance and high availability of internet application, the system is more and more complex due to explosive customer volume and business complexity, so that production faults frequently occur, the operation and maintenance pressure is increased day by day, and unprecedented impact is brought to the operation and maintenance mode in the prior art. In this case, the high-availability optimization project is answered, and the project is promoted by a uniform standard, so that how to accurately identify the weak points of the system and perform uniform high-availability evaluation standards on the system are the key points for solving the problem.
At present, the architecture evaluation industry with high availability has no unified standard, and the evaluation system for the architecture with high availability of the system on the market is still blank, and a system which combines the ecological situation status of the system with the evaluation with high availability is not provided. An intuitive, real-time, scientific system is needed to guide existing systems to perform highly available modification projects in the form of iterations and the like. On the other hand, the Internet nodes are large in deployment scale, various professional systems are involved, and a unified visual analysis view is lacked. As the logic complexity of applications increases, problem prevention advances. How to dynamically and flexibly identify the weak points of the system is imperative to propose a proposal of high-availability modification according to the high availability level of the system.
Disclosure of Invention
Aiming at the problems in the prior art, the method and the device for evaluating the internet architecture provided by the invention realize effective evaluation on the internet by combining the full link monitoring technology and have higher expandability.
In order to solve the technical problems, the invention provides the following technical scheme:
in a first aspect, the present invention provides an internet architecture evaluation method, including:
receiving request data of a client;
responding to the request data, and collecting each hop of information of the request data by utilizing a node probe in an internet architecture;
generating a routing topology structure chart according to the information of each hop;
and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
In one embodiment, the step of generating the evaluation model comprises:
determining the architecture type of the evaluation model according to the network access type, the application layer type and the data layer type;
determining the disaster recovery type of the evaluation model according to the distance between a plurality of databases in the internet architecture;
determining the operation type of the evaluation model according to the number of databases in the internet architecture;
and generating a plurality of evaluation models according to the architecture type, the disaster recovery type and the operation type, and determining an evaluation result corresponding to the evaluation models.
In an embodiment, the evaluating the internet architecture according to the routing topology structure diagram and a pre-generated evaluation model includes:
searching an evaluation model corresponding to the Internet architecture in the plurality of evaluation models;
and evaluating the Internet architecture according to the evaluation result corresponding to the corresponding evaluation model.
In an embodiment, the generating a routing topology structure diagram according to the information of each hop includes:
recording the parent-child node information of the request data according to the information of each hop;
and inputting the information of the parent and child nodes into a graph database to generate a routing topological structure graph.
In one embodiment, the parent-child node information is transmitted by a kafka message queue.
In a second aspect, the present invention provides an internet architecture evaluation apparatus, including:
a data receiving unit for receiving request data of a client;
the information collection unit is used for responding to the request data and collecting information of each hop of the request data by using a node probe in an internet architecture;
the structure chart generating unit is used for generating a routing topology structure chart according to the information of each hop;
and the architecture evaluation unit is used for evaluating the internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
In one embodiment, the internet architecture evaluation apparatus further includes a model generation unit configured to generate the evaluation model, and the model generation unit includes:
the architecture type determining module is used for determining the architecture type of the evaluation model according to the network access type, the application layer type and the data layer type;
the disaster tolerance type determining module is used for determining the disaster tolerance type of the evaluation model according to the distance between a plurality of databases in the internet architecture;
the operation type determining module is used for determining the operation type of the evaluation model according to the number of the databases in the internet architecture;
and the evaluation result determining module is used for generating a plurality of evaluation models according to the architecture type, the disaster recovery type and the operation type and determining the evaluation results corresponding to the evaluation models.
In one embodiment, the architecture evaluation unit includes:
the model searching module is used for searching an evaluation model corresponding to the internet architecture in the plurality of evaluation models;
the architecture evaluation module is used for evaluating the internet architecture according to the evaluation result corresponding to the corresponding evaluation model;
the structure diagram generating unit includes:
the node information recording module is used for recording the parent-child node information of the request data according to the information of each hop;
the structure chart generating module is used for inputting the information of the parent and child nodes into a graph database so as to generate a routing topology structure chart;
and the parent-child node information is transmitted by a kafka message queue.
In a third aspect, the present invention provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the internet architecture evaluation method when executing the computer program.
In a fourth aspect, the present invention provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the internet architecture evaluation method.
As can be seen from the above description, the method and apparatus for evaluating an internet architecture according to the embodiments of the present invention first receive request data of a client; responding to the request data, and collecting information of each hop of the request data by using a node probe in the Internet architecture; then generating a routing topology structure chart according to each hop information; and finally, evaluating the Internet architecture according to the routing topology structure chart and a pre-generated evaluation model. The invention realizes effective evaluation on the Internet and has higher expandability.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a first structural diagram of an internet architecture evaluation system according to an embodiment of the present application;
fig. 2 is a second structural diagram of an internet architecture evaluation system according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating an Internet architecture evaluation method according to an embodiment of the present invention;
FIG. 4 is a schematic flow chart illustrating the generation of an evaluation model according to an embodiment of the present invention;
FIG. 5 is a flowchart illustrating a step 400 according to an embodiment of the present invention;
FIG. 6 is a flowchart of step 300 in an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of an Internet architecture evaluation device in an embodiment of the present invention;
FIG. 8 is a flowchart illustrating an Internet architecture evaluation method according to an embodiment of the present invention;
fig. 9 is a first block diagram illustrating an internet architecture evaluation apparatus according to an embodiment of the present invention;
fig. 10 is a block diagram of a second structure of an internet architecture evaluation device according to an embodiment of the present invention;
FIG. 11 is a block diagram of a model generation unit according to an embodiment of the present invention;
FIG. 12 is a block diagram of the architecture evaluation unit according to an embodiment of the present invention;
FIG. 13 is a block diagram of a structure diagram generation unit in an embodiment of the present invention;
fig. 14 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without inventive step based on the embodiments of the present invention, are within the scope of protection of the present invention.
Referring to fig. 1, the system may be a server A1, where the server A1 may be in communication connection with a plurality of request data receiving terminals B1, and the server A1 may also be in communication connection with a plurality of databases, respectively, or as shown in fig. 2, the databases may also be arranged in the server A1. The request data receiving end B1 is configured to receive request data of a client. After receiving the request data, the server A1 sends the request data to the corresponding subsystem, evaluates the subsystem (internet architecture), and displays the evaluation result to the operation and maintenance personnel through the client C1.
It is understood that the client C1 may include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a Personal Digital Assistant (PDA), a vehicle-mounted device, a smart wearable device, and the like. Wherein, intelligence wearing equipment can include intelligent glasses, intelligent wrist-watch, intelligent bracelet etc..
In practical applications, the internet architecture evaluation part can be executed on the server A1 side of the content, i.e., the architecture shown in fig. 1 or fig. 2, or all operations can be completed in the client C1 device. The selection may be specifically performed according to the processing capability of the client device, the limitation of the user usage scenario, and the like. This is not a limitation of the present application. If all the operations are completed in the client device, the client device may further include a processor configured to perform operations such as processing an internet architecture evaluation result.
The client C1 device may have a communication module (i.e., a communication unit), and may be communicatively connected to a remote server to implement data transmission with the server. The server may include a server on the internet architecture evaluation side, and in other implementation scenarios, the server may also include a server on an intermediate platform, for example, a server on a third-party server platform that is communicatively linked to the internet architecture evaluation server. The server may comprise a single computer device, or may comprise a server cluster formed by a plurality of servers, or a server structure of a distributed device.
The server and client devices may communicate using any suitable network protocol, including network protocols not yet developed at the filing date of the present application. The network protocols may include, for example, TCP/IP protocol, UDP/IP protocol, HTTP protocol, HTTPS protocol, and the like. Of course, the network Protocol may also include, for example, an RPC Protocol (Remote Procedure Call Protocol) used above the above Protocol, a REST Protocol (Representational State Transfer Protocol), and the like.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
The embodiment of the present invention provides a specific implementation manner of an internet architecture evaluation method, and referring to fig. 3, the method specifically includes the following steps:
step 100: request data of a client is received.
Step 200: and responding to the request data, and collecting information of each hop of the request data by utilizing a node probe in the Internet architecture.
Specifically, a user initiates a request, the server initiates a call (if the server sets a subsystem, the call is initiated to the subsystem), and finally returns the call to the user, and each hop of information is fed back to the collector through the node probe. It will be appreciated that the node probe herein is a custom information gathering device. The Probe refers to a signal frame, namely a Probe Request, in the device communication process, and this type of message is specially used to Request signals around a terminal (a notebook, a smart phone, and other devices capable of connecting to a network), and then a device which emits the signals, such as a wireless router, a wireless AP, and other devices, replies with a Probe Response message.
Step 300: and generating a routing topology structure chart according to the information of each hop.
It is understood that the routing topology diagram in step 300 is also a network topology diagram, which refers to the physical layout of various devices such as computers connected to each other by transmission media, and refers to the geometric shapes formed during the interconnection process, which can represent the network configuration of network servers, workstations and the connections between each other. The network topology can be classified by shape, respectively: star, ring, bus, tree, bus/star, and mesh topologies. Here, a star topology is taken as an example, the star topology connects each node to a central node, presents a radial arrangement, and controls communication of the entire network through the central node. The bus type computer network topology structure is mainly to connect the surrounding nodes through a high-speed backbone cable. The ring-shaped computer network topological structure can circulate the information of node ending to form a closed ring-shaped line, thereby improving the integrity of single transmission. The tree-type computer network topological structure can ensure loop-free transmission between two nodes and ensure the convenience of expansion of the computer network topological structure. The mesh type computer network topological structure carries out mesh connection on lines among the nodes, and effectively improves the reliability of information transmission among the lines. In addition, according to the route topology structure diagram generated in step 300, the high availability problems such as single node, long-time consuming path and node, sudden throughput drop and the like can be identified, and further, the detection and optimization of the high availability architecture can be realized.
Step 400: and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
Specifically, the routing topology structure diagram obtained by detection is compared with the high-available architecture model to perform architecture evaluation.
As can be seen from the above description, the internet architecture evaluation method provided by the embodiment of the present invention first receives request data of a client; responding to the request data, and collecting information of each hop of the request data by using a node probe in the Internet architecture; then generating a routing topology structure chart according to each hop information; and finally, evaluating the Internet architecture according to the routing topology structure chart and a pre-generated evaluation model. The invention realizes effective evaluation on the Internet and has higher expandability.
In one embodiment, the internet architecture evaluation method further includes the following steps: generating the evaluation model, further, referring to fig. 4, the step of generating the evaluation model comprises:
step 501: determining the architecture type of the evaluation model according to the network access type, the application layer type and the data layer type;
step 502: determining the disaster recovery type of the evaluation model according to the distance between a plurality of databases in the internet architecture;
step 503: determining the operation type of the evaluation model according to the number of databases in the internet architecture;
step 504: and generating a plurality of evaluation models according to the architecture type, the disaster recovery type and the operation type, and determining an evaluation result corresponding to the evaluation models.
In step 501 to step 504, specifically, a plurality of evaluation models may be generated according to the following steps:
the method comprises the following steps: and according to the established allopatric dual-activity architecture model. The network layer satisfies the local and allopatric access of the network. The application layer meets the remote dual-activity, and the data layer fragments meet the dual-activity. The template may be used, may be created autonomously, or may be modified on the template.
Step two: and judging whether the request meets the IP of the Web server or the application server and whether the IP meets local and allopatric deployment, if so, continuing the following steps, otherwise, directly feeding back that the request does not meet the requirement, and marking that the Web layer does not meet the high-availability architecture.
Step three: and judging whether the dual activity of the application layer is met, namely the number of the Web servers or the application servers in the topological structure is more than one, if so, continuing the following steps, otherwise, directly feeding back that the mark that the application layer does not meet the high-availability architecture is not met, prompting that the application layer does not meet the high-availability architecture, and providing optimization according to the existing architecture.
Step four: and judging whether the data layer double activities are met, namely, the application servers are respectively connected to access the local databases, and the two databases are both main databases. If the condition is met, the different-place double-activity model is met, otherwise, the different-place double-activity model is not met, and different-place double-activity modification is carried out according to application requirements.
In one embodiment, referring to fig. 5, step 400 further comprises:
step 401: searching an evaluation model corresponding to the Internet architecture in the plurality of evaluation models;
step 402: and evaluating the Internet architecture according to the evaluation result corresponding to the corresponding evaluation model.
For step 401 and step 402, specifically, each feature in one column is explained with reference to the high availability model in table 1, and is sequentially compared with the topology structure diagram corresponding to the internet architecture, so as to evaluate the internet architecture.
TABLE 1
Figure BDA0002631343750000071
Figure BDA0002631343750000081
Referring to table 1, in a preferred embodiment, the highly available models can be classified into 5 classes, respectively: the different-place double-activity high-availability model, the multiple-activity access high-availability model, the same-city double-activity high-availability model, the same-city hot standby high-availability model and the different-place cold standby high-availability model respectively correspond to disaster recovery grades as follows: the remote double-activity high-availability model is grade 5, the multi-activity access high-availability model is grade 5, the same-city double-activity high-availability model is grade 4, the same-city hot standby is grade 4, and the remote cold standby high-availability model is grade 4. Here, the multi-active access high availability model is taken as an example, and is characterized in that: the capacity of providing business services in parallel is realized by utilizing the cooperative work of information systems deployed by multiple geographic nodes, and when the information systems of partial geographic nodes are in disasters or faults, the information systems deployed at other physical nodes can take over the business in time.
In one embodiment, referring to fig. 6, step 300 further comprises:
step 301: recording the parent-child node information of the request data according to the information of each hop;
step 302: and inputting the information of the parent and child nodes into a graph database to generate a routing topology structure graph.
In steps 301 and 302, the relationship of the request link is calculated through the relationship id of the parent-child node, and is put into the Neo4j graph database, the graph database is operated through the CQL language, and the routing topology structure diagram (network topology structure diagram) is directly generated without conversion by using the network natural characteristics of the graph database. It will be appreciated that the graph database Neo4j has data that is easy to represent links, and that it is very easy and fast to retrieve, traverse, and navigate through large amounts of linked data. Therefore, the collected data is stored in the graph database according to the nodes and the relations (edges), and can be directly extracted without conversion, so that the network topology structure is quickly formed.
In one embodiment, the parent-child node information is transmitted by a kafka message queue.
It is understood that Kafka is an open source stream processing platform, written in Scala and Java languages. Kafka is a high-throughput distributed publish-subscribe messaging system that can handle all the action flow data of a consumer in a web site. This action (web browsing, searching and other user actions) is a key factor in many social functions on the network. These data are typically addressed by handling logs and log aggregations due to throughput requirements. Kafka acts to unify online and offline message processing through the Hadoop parallel loading mechanism, and also to provide real-time messages through clustering.
The embodiment of the invention effectively solves the problem of high availability evaluation of heterogeneous application by combining full link monitoring according to the high availability evaluation level, has higher expandability and fills up the evaluation blank of a high availability architecture. For a single point of nodes, the hint does not meet the high availability criteria. On the other hand, the automatic drawing of the network topology solves the problem of system architecture change caused by rapid iterative change of the system. By establishing the high-availability architecture model, the high-availability architecture of the heterogeneous system is evaluated according to the model, the hidden danger of the system is found, and the availability of the system is improved.
To further illustrate the present solution, the present invention provides a specific application example of the internet architecture evaluation method, which specifically includes the following contents.
Referring to fig. 7, the present embodiment further provides an internet architecture evaluation system, which includes a data acquisition layer, a data middleware and an application layer, wherein the data acquisition layer is responsible for requesting tracking and collection, and the data middleware is used for data processing and full link aggregation analysis; and the application layer is responsible for automatic drawing of the topological graph and evaluation of the high-availability architecture.
Referring to fig. 8, the internet architecture evaluation method provided by the present embodiment specifically includes the following contents.
Step S1: and describing the result of each hop of the requested data by using the node probe, and recording the information of the parent node and the child node.
Step S2: the relationship of the request link is calculated by the parent-child relationship id.
Specifically, the collected node information is transmitted through a kafka message queue, the relationship of a request link is calculated through a parent-child node relationship id, the request link is placed into a Neo4j graph database, the graph database is operated through a CQL language, and a network topology structure graph is directly and automatically generated without conversion by using the network natural characteristics of the graph database.
And step S3: and performing aggregation analysis on the request data.
Specifically, based on customized log analysis and information acquired by combining a configuration management system cmdb, advanced analysis of the log is used for calculating an aggregation path, and high availability of the system is identified from a cluster, service and application level, so that an aggregation analysis link is realized.
Preferably, customized logs are collected to relieve system stress in the following three cases.
(1) The delay time exceeds 80% of the threshold value
(2) The execution system runs the timing task once a day in the low peak period.
(3) And actively starting a customized log collection switch and calling a collection interface.
And step S4: and generating a routing topological structure diagram.
Specifically, data extracted from the data center are automatically drawn by a full-link topology automatic drawing module to automatically draw a topological graph, and visual integration analysis is performed. Then, based on the link aggregation analysis method, the tracking information is processed for the second time, a set CMDB (Configuration Management Database (CMDB) is a logical Database, which contains the information of the full life cycle of the Configuration items and the relationship (including physical relationship, real-time communication relationship, non-real-time communication relationship and dependency relationship) between the Configuration items, the CMDB stores and manages various Configuration information of the devices in the enterprise IT architecture, which is closely linked with all service support and service delivery flows, supports the operation of the flows, exerts the value of the Configuration information, and depends on the related flows to ensure the accuracy of the data), the information of the link is analyzed and aggregated by the log, and the information of the link is integrated, logged, drilled down layer by layer and the like from the view points of application, cluster, node, service and the like by automatically drawing a topological graph, a visual unified interface of the system topology structure is provided, and the system related to the link can react quickly.
Step S5: and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
Specifically, an online real-time diagnosis platform is established, online analysis capabilities such as thread detection, jvm detection, methods and tracking are provided, and the online real-time diagnosis platform is packaged into a Web function integrated value holographic monitoring platform and is provided for developers to use online.
For example: take ex-situ double activities as an example. Referring to table 1, the disaster recovery class corresponds to class 5, specifically:
the method comprises the following steps: and establishing a remote double-live architecture model. The network layer of the architecture model meets the local and remote access of the network. The application layer meets the requirement of remote dual-activity, and the data layer fragments meet the requirement of dual-activity. The template may be used, may be created autonomously, or may be modified on the template.
Step two: and judging whether the client request corresponds to the IP (whether local deployment is satisfied) of the Web server or the application server, if so, continuing the following steps, otherwise, directly feeding back that the client request is not satisfied, and marking that the Web layer does not satisfy the high-availability architecture. It will be appreciated that when the client request corresponds to a displaced deployment, it is also necessary to determine whether the displaced Web server or application service satisfies the high availability architecture.
Step three: and judging whether the application layer double activity is met, namely the number of Web servers or application servers in the topological structure is more than one, if the condition is met, continuing the following steps, otherwise, directly feeding back that the mark of the application layer is not met and the high available architecture is not met, prompting that the application layer does not meet the high available architecture, and providing optimization according to the existing architecture.
Step four: and judging whether the data layer double activities are met, namely, the application servers are respectively connected to access the local databases, and the two databases are both main databases. If the condition is met, the different-place double-activity model is met, otherwise, the different-place double-activity model is not met, and different-place double-activity modification is carried out according to application requirements.
As can be seen from the above description, the internet architecture evaluation method provided by the embodiment of the present invention first receives request data of a client; responding to the request data, and collecting information of each hop of the request data by utilizing a node probe in the Internet architecture; then generating a routing topology structure chart according to the information of each hop; and finally, evaluating the Internet architecture according to the routing topology structure chart and a pre-generated evaluation model. The invention realizes effective evaluation on the internet, has higher expandability and particularly has the following beneficial effects:
(1) The full link monitoring and the high-availability architecture evaluation are combined, the application is transparent, and the end-to-end transaction analysis capability is realized. The system monitors the change of the application architecture by regularly monitoring the bottom layer based on the full link, collects system logs in batches at regular time, captures the architecture change caused by system changes such as automatic expansion and contraction capacity and the like, and realizes the construction and the feature identification of the topological relation.
(2) According to the high-availability architecture standard, the standard is unified, a high-availability architecture model is established, automatic high-availability evaluation is conducted on the existing heterogeneous system through comparing the model with the formed topological structure, a user-defined model is provided, certain expansibility is achieved, and the blank of the high-availability architecture evaluation is filled.
Based on the same inventive concept, the embodiment of the present application further provides an internet architecture evaluation apparatus, which can be used to implement the methods described in the above embodiments, such as the following embodiments. Because the principle of the internet architecture evaluation device for solving the problems is similar to the internet architecture evaluation method, the implementation of the internet architecture evaluation device can be implemented by referring to the internet architecture evaluation method, and repeated parts are not described again. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. While the system described in the embodiments below is preferably implemented in software, implementations in hardware, or a combination of software and hardware are also possible and contemplated.
An embodiment of the present invention provides a specific implementation of an internet architecture evaluation device capable of implementing an internet architecture evaluation method, and referring to fig. 9, the internet architecture evaluation device specifically includes the following contents:
a data receiving unit 10 for receiving request data of a client;
an information collecting unit 20, configured to collect, by using a node probe in an internet architecture, information of each hop of the request data in response to the request data;
a structure diagram generating unit 30, configured to generate a routing topology structure diagram according to the information of each hop;
and the architecture evaluation unit 40 is used for evaluating the internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
In an embodiment, referring to fig. 10, the internet architecture evaluation apparatus further includes a model generation unit 50 for generating the evaluation model, referring to fig. 11, where the model generation unit 50 includes:
an architecture type determining module 501, configured to determine an architecture type of the evaluation model according to a network access type, an application layer type, and a data layer type;
a disaster tolerance type determining module 502, configured to determine a disaster tolerance type of the evaluation model according to a distance between multiple databases in the internet architecture;
an operation type determining module 503, configured to determine an operation type of the evaluation model according to the number of databases in the internet architecture;
an evaluation result determining module 504, configured to generate a plurality of evaluation models according to the architecture type, the disaster recovery type, and the operation type, and determine an evaluation result corresponding to the evaluation model.
In one embodiment, referring to fig. 12, the architecture evaluation unit 40 includes:
a model searching module 401, configured to search for an evaluation model corresponding to the internet architecture from among the plurality of evaluation models;
a framework evaluation module 402, configured to evaluate the internet framework according to an evaluation result corresponding to the corresponding evaluation model;
referring to fig. 13, the structural diagram generating unit 30 includes:
a node information recording module 301, configured to record parent and child node information of the request data according to the information of each hop;
a structure diagram generating module 302, configured to input the parent-child node information into a graph database to generate a routing topology structure diagram;
and the parent-child node information is transmitted by a kafka message queue.
As can be seen from the above description, the internet architecture evaluation apparatus provided in the embodiment of the present invention first receives request data of a client; responding to the request data, and collecting information of each hop of the request data by using a node probe in the Internet architecture; then generating a routing topology structure chart according to the information of each hop; and finally, evaluating the Internet architecture according to the routing topology structure chart and a pre-generated evaluation model. The invention realizes effective evaluation on the internet, has higher expandability and particularly has the following beneficial effects:
(1) The full link monitoring and the high-availability architecture evaluation are combined, the application is transparent, and the end-to-end transaction analysis capability is realized. The system monitors the change of the application architecture by regularly monitoring the bottom layer based on the full link, collects system logs in batches at regular time, captures the architecture change caused by system changes such as automatic expansion and contraction capacity and the like, and realizes the construction and the feature identification of the topological relation.
(2) According to the high-availability architecture standard, the standard is unified, a high-availability architecture model is established, automatic high-availability evaluation is conducted on the existing heterogeneous system through comparing the model with the formed topological structure, a user-defined model is provided, certain expansibility is achieved, and the blank of the high-availability architecture evaluation is filled.
The apparatuses, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or implemented by a product with certain functions. A typical implementation device is an electronic device, which may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
In a typical example, the electronic device specifically includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the processor implements the steps of the internet architecture evaluation method, where the steps include:
step 100: receiving request data of a client;
step 200: responding to the request data, and collecting each hop of information of the request data by utilizing a node probe in an internet architecture;
step 300: generating a routing topology structure chart according to the information of each hop;
step 400: and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
Referring now to FIG. 14, shown is a schematic diagram of an electronic device suitable for use in implementing embodiments of the present application.
As shown in fig. 14, the electronic apparatus includes a Central Processing Unit (CPU) 601 which can perform various appropriate jobs and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage section 608 into a Random Access Memory (RAM)) 603. In the RAM603, various programs and data necessary for system operation are also stored. The CPU601, ROM602, and RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output portion 607 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that the computer program read out therefrom is mounted as necessary in the storage section 608.
In particular, according to an embodiment of the present invention, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, an embodiment of the present invention includes a computer-readable storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing the steps of the above-described internet architecture evaluation method, the steps including:
step 100: receiving request data of a client;
step 200: responding to the request data, and collecting each hop of information of the request data by utilizing a node probe in an internet architecture;
step 300: generating a routing topology structure chart according to the information of each hop;
step 400: and evaluating the Internet architecture according to the routing topology structure diagram and a pre-generated evaluation model.
In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the system embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for relevant points.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (8)

1. An internet architecture evaluation method is characterized by comprising the following steps:
receiving request data of a client;
responding to the request data, and collecting each hop of information of the request data by utilizing a node probe in an internet architecture;
generating a routing topology structure chart according to the information of each hop;
evaluating the internet architecture according to the routing topology structure diagram and a pre-generated evaluation model;
the evaluation model is generated by the following steps:
determining the architecture type of the evaluation model according to the network access type, the application layer type and the data layer type;
determining the disaster recovery type of the evaluation model according to the distance between a plurality of databases in the internet architecture;
determining the operation type of the evaluation model according to the number of databases in the internet architecture;
and generating a plurality of evaluation models according to the architecture type, the disaster recovery type and the operation type, and determining an evaluation result corresponding to the evaluation models.
2. The method according to claim 1, wherein the evaluating the internet architecture according to the routing topology structure diagram and a pre-generated evaluation model comprises:
searching an evaluation model corresponding to the Internet architecture in a plurality of evaluation models;
and evaluating the Internet architecture according to the evaluation result corresponding to the corresponding evaluation model.
3. The internet architecture evaluation method of claim 1, wherein the generating a routing topology structure diagram according to the information of each hop comprises:
recording the parent-child node information of the request data according to the information of each hop;
and inputting the information of the parent and child nodes into a graph database to generate a routing topological structure graph.
4. The internet architecture evaluation method of claim 3, wherein the parent-child node information is transmitted by a kafka message queue.
5. An internet architecture evaluation apparatus, comprising:
a data receiving unit for receiving request data of a client;
the information collection unit is used for responding to the request data and collecting information of each hop of the request data by using a node probe in an internet architecture;
the structure chart generating unit is used for generating a routing topology structure chart according to the information of each hop;
the architecture evaluation unit is used for evaluating the Internet architecture according to the routing topology structure chart and a pre-generated evaluation model;
a model generation unit for generating the evaluation model, the model generation unit including:
the architecture type determining module is used for determining the architecture type of the evaluation model according to the network access type, the application layer type and the data layer type;
the disaster tolerance type determining module is used for determining the disaster tolerance type of the evaluation model according to the distance between a plurality of databases in the internet architecture;
the operation type determining module is used for determining the operation type of the evaluation model according to the number of the databases in the internet architecture;
and the evaluation result determining module is used for generating a plurality of evaluation models according to the architecture type, the disaster recovery type and the operation type and determining the evaluation results corresponding to the evaluation models.
6. The internet architecture evaluation device of claim 5, wherein the architecture evaluation unit comprises:
the model searching module is used for searching an evaluation model corresponding to the Internet architecture in a plurality of evaluation models;
the architecture evaluation module is used for evaluating the internet architecture according to the evaluation result corresponding to the corresponding evaluation model;
the structure diagram generating unit includes:
the node information recording module is used for recording the parent-child node information of the request data according to the information of each hop;
the structure chart generation module is used for inputting the information of the parent and child nodes into a graph database so as to generate a routing topology structure chart;
and the parent-child node information is transmitted by a kafka message queue.
7. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the internet architecture evaluation method of any one of claims 1 to 4 are implemented when the program is executed by the processor.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the internet architecture assessment method according to any one of claims 1 to 4.
CN202010812038.4A 2020-08-13 2020-08-13 Internet architecture evaluation method and device Active CN111934932B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010812038.4A CN111934932B (en) 2020-08-13 2020-08-13 Internet architecture evaluation method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010812038.4A CN111934932B (en) 2020-08-13 2020-08-13 Internet architecture evaluation method and device

Publications (2)

Publication Number Publication Date
CN111934932A CN111934932A (en) 2020-11-13
CN111934932B true CN111934932B (en) 2022-10-18

Family

ID=73311510

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010812038.4A Active CN111934932B (en) 2020-08-13 2020-08-13 Internet architecture evaluation method and device

Country Status (1)

Country Link
CN (1) CN111934932B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114357044A (en) * 2021-12-28 2022-04-15 南威软件股份有限公司 Big data full life cycle management method, system and application based on-duty tracking

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106789253A (en) * 2016-12-23 2017-05-31 西安电子科技大学 A kind of elasticity of complex information network evaluates and optimizes method
CN107995646A (en) * 2017-11-29 2018-05-04 中国人民解放军陆军工程大学 A kind of system and method for the wireless network test assessment based on commercial analogue system
CN108197814A (en) * 2018-01-15 2018-06-22 华北电力科学研究院有限责任公司 A kind of electric power enterprise security of system evaluation method and system
CN108370370A (en) * 2015-12-14 2018-08-03 西门子股份公司 System and method for passively assessing industrial security boundary

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10439870B2 (en) * 2015-11-24 2019-10-08 International Business Machines Corporation Assessment and dynamic provisioning of computing resources for multi-tiered application

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108370370A (en) * 2015-12-14 2018-08-03 西门子股份公司 System and method for passively assessing industrial security boundary
CN106789253A (en) * 2016-12-23 2017-05-31 西安电子科技大学 A kind of elasticity of complex information network evaluates and optimizes method
CN107995646A (en) * 2017-11-29 2018-05-04 中国人民解放军陆军工程大学 A kind of system and method for the wireless network test assessment based on commercial analogue system
CN108197814A (en) * 2018-01-15 2018-06-22 华北电力科学研究院有限责任公司 A kind of electric power enterprise security of system evaluation method and system

Also Published As

Publication number Publication date
CN111934932A (en) 2020-11-13

Similar Documents

Publication Publication Date Title
US10878379B2 (en) Processing events generated by internet of things (IoT)
US11296961B2 (en) Simplified entity lifecycle management
US11288142B2 (en) Recovery strategy for a stream processing system
US10146592B2 (en) Managing resource allocation in a stream processing framework
US20190095478A1 (en) Information technology networked entity monitoring with automatic reliability scoring
CN102880503B (en) Data analysis system and data analysis method
US20170083368A1 (en) Maintaining throughput of a stream processing framework while increasing processing load
CN113987074A (en) Distributed service full-link monitoring method and device, electronic equipment and storage medium
CN106657192B (en) Method and equipment for presenting service calling information
US20230033804A1 (en) Information sharing chain generation method and apparatus, electronic device, and storage medium
US11263267B1 (en) Apparatuses, methods, and computer program products for generating interaction vectors within a multi-component system
CN106649033A (en) Web system health check method and device
CN103858121A (en) Method and system for making Web application obtain database change
CN112948397A (en) Data processing system, method, device and storage medium
CN111177237B (en) Data processing system, method and device
CN111934932B (en) Internet architecture evaluation method and device
CN115118574A (en) Data processing method, device and storage medium
CN111934793B (en) Internet architecture full link monitoring method and device
CN112506887A (en) Vehicle terminal CAN bus data processing method and device
US11294917B2 (en) Data attribution using frequent pattern analysis
CN113704486A (en) Map data construction method and device and map data query method and device
CN113722315A (en) Data generation method and device, electronic equipment and computer readable medium
CN112596974A (en) Full link monitoring method, device, equipment and storage medium
CN113762910A (en) Document monitoring method and device
CN113112285A (en) Data analysis method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant