CN113791964A - Service monitoring method based on four layers of transmission control protocol - Google Patents

Service monitoring method based on four layers of transmission control protocol Download PDF

Info

Publication number
CN113791964A
CN113791964A CN202111133160.XA CN202111133160A CN113791964A CN 113791964 A CN113791964 A CN 113791964A CN 202111133160 A CN202111133160 A CN 202111133160A CN 113791964 A CN113791964 A CN 113791964A
Authority
CN
China
Prior art keywords
service
connection
server
sampling
monitoring method
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111133160.XA
Other languages
Chinese (zh)
Inventor
赵芹昌
许峻川
刘春阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shouyue Technology Beijing Co Ltd
Original Assignee
Shouyue Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shouyue Technology Beijing Co Ltd filed Critical Shouyue Technology Beijing Co Ltd
Priority to CN202111133160.XA priority Critical patent/CN113791964A/en
Publication of CN113791964A publication Critical patent/CN113791964A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The invention provides a service monitoring method based on a transmission management protocol four-layer, which comprises the following steps: monitoring the four-layer connection data of the transmission management protocol of the service, screening out external connection, performing statistical analysis, and inquiring by relying on an operation and maintenance system of a configuration management database to obtain a service name; determining a service name according to a server port; sampling the server port every minute to obtain sampling data; analyzing the sampling data, and drawing a sampling graph for displaying; checking the history record in a user-defined manner, and analyzing and judging a service and server connection change curve of the sampling graph; and acquiring the service with potential problems according to the connection change curve, and positioning the problems. The sampling result is analyzed to judge the connection change curve of the service and the server, and the service with potential problems or the service of connection is found out, so that the problems are quickly positioned.

Description

Service monitoring method based on four layers of transmission control protocol
Technical Field
The invention relates to the field of network appointment, in particular to a service monitoring method based on a transmission control protocol four-layer.
Background
The network car booking platform has complex service flow and a plurality of service modules. Invoking links is very complicated, and the links are specifically divided into two categories: service-to-service calls, such as: the module A calls the module B; calls between services and components, such as: the module calls components such as Redis, MongoDB, MySQL, RocktMQ and the like.
For the calling problem, a quick and accurate monitoring tool is needed, so that when the link calling is abnormal, the problem can be positioned efficiently and quickly, and the fault can be solved. The problems of difficult positioning and complex calling chain exist in the prior art.
Disclosure of Invention
In view of the above, the present invention has been made to provide a transmission control protocol four-layer based service monitoring method that overcomes or at least partially solves the above-mentioned problems.
According to an aspect of the present invention, there is provided a service monitoring method based on four layers of a transmission control protocol, the monitoring method including:
monitoring the four-layer connection data of the transmission control protocol of the service, screening out external connection, performing statistical analysis, and inquiring by relying on an operation and maintenance system of a configuration management database to obtain a service name;
determining a service name according to a server port;
sampling the server port every minute to obtain sampling data;
analyzing the sampling data, and drawing a sampling graph for displaying;
checking the history record in a user-defined manner, and analyzing and judging a service and server connection change curve of the sampling graph;
and acquiring the service with potential problems according to the connection change curve, and positioning the problems.
Optionally, the server is configured to query the configuration management database operation and maintenance system, write the running service name and the IP into the server cache, and refresh the service name and the IP once a day.
Optionally, the client calls a tcp connection state of the operating system, obtains the tcp conditions of all external connections of the service, counts the sum of the number of the tcp connections at a frequency of once per minute, calls a server Redis database according to the IP in the tcp connection state to classify, and classifies external connection service components: redis, MongoDB, MySQL, RocktMQ;
and storing the obtained timestamp, the IP of the server, the transmission control protocol of the external connection service, the name of the connection server, the connection quantity and the like into a time sequence database.
Optionally, the monitoring method further includes: after data sampling, adopting the grafana to access a database for data display and query;
analysis was performed according to different angles: the server group, the service name group, the service IP and name, the IP of the target service, the connection state and the connection number;
and checking corresponding real-time information and historical information through multi-dimensional query, and positioning service problems.
The invention provides a service monitoring method based on a transmission control protocol four-layer, which comprises the following steps: monitoring the four-layer connection data of the transmission control protocol of the service, screening out external connection, performing statistical analysis, and inquiring by relying on an operation and maintenance system of a configuration management database to obtain a service name; determining a service name according to a server port; sampling the server port every minute to obtain sampling data; analyzing the sampling data, and drawing a sampling graph for displaying; checking the history record in a user-defined manner, and analyzing and judging a service and server connection change curve of the sampling graph; and acquiring the service with potential problems according to the connection change curve, and positioning the problems. The sampling result is analyzed to judge the connection change curve of the service and the server, and the service with potential problems or the service of connection is found out, so that the problems are quickly positioned.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating operation of components of a monitoring system in a service monitoring method based on four layers of a transmission control protocol according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a custom query presentation condition provided by an embodiment of the present invention;
FIG. 3 is a schematic diagram of a normal connection provided by an embodiment of the present invention;
FIG. 4 is a schematic diagram of a failed connection provided by an embodiment of the present invention;
FIG. 5 is a schematic view of an overall display page provided in an embodiment of the present invention;
fig. 6 is a diagram of information of an infiluxdb field according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The terms "comprises" and "comprising," and any variations thereof, in the present description and claims and drawings are intended to cover a non-exclusive inclusion, such as a list of steps or elements.
The technical solution of the present invention is further described in detail with reference to the accompanying drawings and embodiments.
As shown in fig. 1, the method is implemented through interaction of a client and a server.
The server side: and the operation and maintenance system inquires the configuration management database, writes the IP of the service and the corresponding service name into a Redis cache of the server, and executes refreshing once a day.
The server side inquires the configuration management database field: IP is key and the corresponding service name is value, and the key and the corresponding service name are written into Redis:
·Key:IP
value: redis, MongoDB, MySQL, RocktMQ, Server.
A client: the method comprises the following steps of writing codes by using Python to call a transmission control protocol connection state of an operating system, taking out all current externally connected transmission control protocol conditions of a business service, counting the sum of the number of the currently externally connected transmission control protocols at a frequency of once per minute, calling a server Redis database according to IP in the transmission control protocol state for classification, and classifying externally connected service components: redis, MongoDB, MySQL, RocktMQ, and others. And meanwhile, the obtained time stamp, the IP of the service, the transmission control protocol of the external connection service, the name of the connection service, the connection quantity and the like are stored in an Influxdb time sequence database.
The Influxdb write field information is shown in FIG. 6.
After data sampling, we use the grafana to access influxdb for data presentation and query, and can analyze according to different angles: the server group, the service name group, the service IP and name, the IP of the target service, the connection state and the connection number; corresponding real-time information and historical information can be checked through multi-dimensional query, and business problems can be located, such as: when the MySQL service is abnormal, a large amount of transmission control protocol connection is inevitably generated when the service is connected with the MySQL, and the MySQL service can be accurately judged to be abnormal without analyzing the log and checking the MySQL.
As shown in FIG. 2, detailed connection information for the various components of a business service connection is viewed in various dimensions: a service IP; a service name; a source IP; a target IP; a connected state.
As shown in fig. 3, the connection state tends to be smooth in the case of the normal state.
When the module calls the Redis, MongoDB, MySQL, rocktmq, and Server services to be abnormal, the connection state is queried, as shown in fig. 4, when the number of connections suddenly increases or suddenly decreases, the problem source is located, and fig. 5 can display the IP and port information of the specific connection Redis, MongoDB, MySQL, rockmq, and Server services, that is, which service has a problem.
Has the advantages that: the fault positioning accuracy is improved; the failure solving speed is accelerated.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (4)

1. A service monitoring method based on four layers of transmission control protocol is characterized in that the monitoring method comprises the following steps:
monitoring the four-layer connection data of the transmission control protocol of the service, screening out external connection, performing statistical analysis, and inquiring by relying on an operation and maintenance system of a configuration management database to obtain a service name;
determining a service name according to a server port;
sampling the server port every minute to obtain sampling data;
analyzing the sampling data, and drawing a sampling graph for displaying;
checking the history record in a user-defined manner, and analyzing and judging a service and server connection change curve of the sampling graph;
and acquiring the service with potential problems according to the connection change curve, and positioning the problems.
2. The TCP four-layer based service monitoring method according to claim 1, wherein the server is configured to query the configuration management database operation and maintenance system to write the running business name and IP into the server cache, and refresh the business name and IP once a day.
3. The service monitoring method based on the tcp four layer according to claim 1, wherein the client calls tcp connection status of the os, obtains tcp conditions of all external connections of the service currently, counts the sum of the number of the tcp conditions at a frequency of once per minute, calls a server Redis database according to IP in the tcp status for classification, and classifies external connection service components: redis, MongoDB, MySQL, RocktMQ;
and storing the obtained timestamp, the IP of the server, the transmission control protocol of the external connection service, the name of the connection server, the connection quantity and the like into a time sequence database.
4. The tcp four-layer based service monitoring method of claim 1, wherein the monitoring method further comprises: after data sampling, adopting the grafana to access a database for data display and query;
analysis was performed according to different angles: the server group, the service name group, the service IP and name, the IP of the target service, the connection state and the connection number;
and checking corresponding real-time information and historical information through multi-dimensional query, and positioning service problems.
CN202111133160.XA 2021-09-27 2021-09-27 Service monitoring method based on four layers of transmission control protocol Pending CN113791964A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111133160.XA CN113791964A (en) 2021-09-27 2021-09-27 Service monitoring method based on four layers of transmission control protocol

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111133160.XA CN113791964A (en) 2021-09-27 2021-09-27 Service monitoring method based on four layers of transmission control protocol

Publications (1)

Publication Number Publication Date
CN113791964A true CN113791964A (en) 2021-12-14

Family

ID=79184512

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111133160.XA Pending CN113791964A (en) 2021-09-27 2021-09-27 Service monitoring method based on four layers of transmission control protocol

Country Status (1)

Country Link
CN (1) CN113791964A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107864063A (en) * 2017-12-12 2018-03-30 北京奇艺世纪科技有限公司 A kind of abnormality monitoring method, device and electronic equipment
CN108173678A (en) * 2017-12-20 2018-06-15 北京奇艺世纪科技有限公司 Client data sending method, client connection method of displaying abnormal state and device
CN109510729A (en) * 2018-12-25 2019-03-22 上海新炬网络技术有限公司 A kind of implementation method based on CMDB and Netstat discovery applied topology relationship
CN110224899A (en) * 2019-06-28 2019-09-10 深圳前海微众银行股份有限公司 A kind of the call chain acquisition methods and device of TCP application
CN110855473A (en) * 2019-10-16 2020-02-28 平安科技(深圳)有限公司 Monitoring method, device, server and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107864063A (en) * 2017-12-12 2018-03-30 北京奇艺世纪科技有限公司 A kind of abnormality monitoring method, device and electronic equipment
CN108173678A (en) * 2017-12-20 2018-06-15 北京奇艺世纪科技有限公司 Client data sending method, client connection method of displaying abnormal state and device
CN109510729A (en) * 2018-12-25 2019-03-22 上海新炬网络技术有限公司 A kind of implementation method based on CMDB and Netstat discovery applied topology relationship
CN110224899A (en) * 2019-06-28 2019-09-10 深圳前海微众银行股份有限公司 A kind of the call chain acquisition methods and device of TCP application
CN110855473A (en) * 2019-10-16 2020-02-28 平安科技(深圳)有限公司 Monitoring method, device, server and storage medium

Similar Documents

Publication Publication Date Title
US11657309B2 (en) Behavior analysis and visualization for a computer infrastructure
CN110868336B (en) Data management method, device and computer readable storage medium
CN112801666B (en) Monitoring management method, system, medium and equipment based on enterprise service bus
CN111475370A (en) Operation and maintenance monitoring method, device and equipment based on data center and storage medium
CN109684160A (en) Database method for inspecting, device, equipment and computer readable storage medium
US11042525B2 (en) Extracting and labeling custom information from log messages
CN108599977B (en) System and method for monitoring system availability based on statistical method
US20220156134A1 (en) Automatically correlating phenomena detected in machine generated data to a tracked information technology change
CN104462606B (en) A kind of method that diagnostic process measure is determined based on daily record data
CN108989124A (en) Network failure finds method, electronic device and computer readable storage medium
US20220197879A1 (en) Methods and systems for aggregating and querying log messages
CN109034580A (en) A kind of information system holistic health degree appraisal procedure based on big data analysis
CN114201201A (en) Method, device and equipment for detecting abnormity of business system
CN112269727A (en) Monitoring and alarming method and system based on log information
CN110471912B (en) Employee attribute information verification method and device and terminal equipment
US20020026433A1 (en) Knowledge system and methods of business alerting and business analysis
US8626525B2 (en) Systems and methods for real-time monitoring and analysis of prescription claim rejections
CN113791964A (en) Service monitoring method based on four layers of transmission control protocol
CN105515192A (en) Monitoring and early warning system and method for power transmission and transformation equipment load data access electric power system
Maiga et al. An empirical study on the handling of crash reports in a large software company: An experience report
CN113472881B (en) Statistical method and device for online terminal equipment
CN114531338A (en) Monitoring alarm and tracing method and system based on call chain data
CN115185710A (en) Transaction interface time consumption counting and early warning method
CN113572628B (en) Data association method, device, computing equipment and computer storage medium
CN113961441A (en) Alarm event processing method, auditing method, device, equipment, medium and product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination