CN110806960B - Information processing method and device and terminal equipment - Google Patents
Information processing method and device and terminal equipment Download PDFInfo
- Publication number
- CN110806960B CN110806960B CN201911060584.0A CN201911060584A CN110806960B CN 110806960 B CN110806960 B CN 110806960B CN 201911060584 A CN201911060584 A CN 201911060584A CN 110806960 B CN110806960 B CN 110806960B
- Authority
- CN
- China
- Prior art keywords
- monitoring
- index
- service
- information
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 35
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000012544 monitoring process Methods 0.000 claims abstract description 378
- 238000012545 processing Methods 0.000 claims abstract description 64
- 238000000034 method Methods 0.000 claims abstract description 37
- 230000002159 abnormal effect Effects 0.000 claims description 19
- 230000005540 biological transmission Effects 0.000 claims description 18
- 238000005192 partition Methods 0.000 claims description 8
- 238000013461 design Methods 0.000 description 18
- 230000005856 abnormality Effects 0.000 description 7
- 238000013500 data storage Methods 0.000 description 5
- 238000004806 packaging method and process Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3068—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data format conversion
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention provides an information processing method, an information processing device and terminal equipment, wherein the method comprises the following steps: the method comprises the steps of obtaining monitoring information corresponding to a service to be monitored, wherein the monitoring information comprises a service monitoring index and corresponding monitoring data thereof, obtaining index types of the service monitoring index, carrying out storage format unification processing on the monitoring data corresponding to the service monitoring index according to the index types of the service monitoring index to obtain target monitoring information, pushing the target monitoring information into middleware of a second terminal, enabling the second terminal to obtain a client subscribing the target monitoring information, and sending the target monitoring information to the client.
Description
Technical Field
The embodiment of the invention relates to the technical field of computers, in particular to an information processing method, an information processing device and terminal equipment.
Background
With the development of computer technology, in order to facilitate the life of people, the types of services provided by enterprises or platforms are increasing.
In the prior art, in order to ensure that the service can normally run, service monitoring indexes are required to be configured for the service, the service monitoring indexes are monitored to obtain corresponding monitoring data, and the monitoring data are sent to a terminal needing the monitoring data, so that related personnel can determine whether the service monitoring indexes are abnormal or not according to the monitoring data stored by the terminal, namely, whether the service is abnormal or not is judged, and therefore the abnormality can be handled in time.
However, the inventors found that there are at least the following problems in the prior art: because the types of the monitoring data are more, the format is complex, the terminal can store the monitoring data after the terminal processes the monitoring data after directly sending the obtained monitoring data to the terminal, and the data storage efficiency is low.
Disclosure of Invention
The embodiment of the invention provides an information processing method, an information processing device and terminal equipment, which are used for solving the problem of low data storage efficiency in the prior art.
In a first aspect, an embodiment of the present invention provides an information processing method, including:
acquiring monitoring information corresponding to a service to be monitored, wherein the monitoring information comprises a service monitoring index and corresponding monitoring data thereof;
acquiring the index type of the service monitoring index;
according to the index type of the service monitoring index, carrying out storage format unified processing on the monitoring data corresponding to the service monitoring index to obtain target monitoring information;
and pushing the target monitoring information to middleware of the second terminal so that the second terminal obtains a client subscribed to the target monitoring information and sends the target monitoring information to the client.
In one possible design, the performing storage format unification processing on the monitoring data corresponding to the service monitoring index according to the index type of the service monitoring index to obtain target monitoring information includes:
classifying the service monitoring indexes to obtain a plurality of index sets, wherein the index sets comprise service monitoring indexes with the same index type;
and aiming at each index set, acquiring a standard storage format corresponding to the index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format, wherein the storage format unification processing comprises at least one of unit unification processing, file occupation space unification processing and precision unification processing.
In one possible design, the pushing the target monitoring information to the middleware of the second terminal includes:
packaging the monitoring data in the target monitoring information according to a preset JSON message format to obtain a plurality of JSON messages;
pushing the JSON message to the middleware.
In one possible design, after the pushing the data packet to the middleware, the method further includes:
acquiring a data transmission log, and acquiring a JSON node from the data transmission log;
acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete;
and if the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
In one possible design, after the obtaining the monitoring information corresponding to the service to be monitored, the method further includes:
acquiring a numerical interval corresponding to the service monitoring index;
and obtaining a monitoring result of the service monitoring index according to the monitoring data and the numerical interval corresponding to the service monitoring index, wherein the monitoring result comprises normal index and abnormal index.
In one possible design, the middleware includes a message queue and a message partition.
In one possible design, the pushing the target monitoring information to the middleware of the second terminal includes:
and acquiring target monitoring information corresponding to a preset core service, and taking the target monitoring information corresponding to the core service as core monitoring information.
And pushing the core monitoring information to a target message queue of a second terminal, wherein the target message queue is a message queue corresponding to the preset core service.
In a second aspect, an embodiment of the present invention provides an information processing apparatus including:
the information acquisition module is used for acquiring monitoring information corresponding to the service to be monitored, wherein the monitoring information comprises service monitoring indexes and corresponding monitoring data thereof;
the type acquisition module is used for acquiring the index type of the service monitoring index;
the information processing module is used for carrying out unified processing on storage formats of the monitoring data corresponding to the service monitoring indexes according to the index types of the service monitoring indexes to obtain target monitoring information;
and the information pushing module is used for pushing the target monitoring information to the middleware of the second terminal so as to enable the second terminal to acquire the client subscribing the target monitoring information and send the target monitoring information to the client.
In one possible design, the information processing module is specifically configured to:
classifying the service monitoring indexes to obtain a plurality of index sets, wherein the index sets comprise service monitoring indexes with the same index type;
and aiming at each index set, acquiring a standard storage format corresponding to the index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format, wherein the storage format unification processing comprises at least one of unit unification processing, file occupation space unification processing and precision unification processing.
In one possible design, the information pushing module is specifically configured to:
packaging the monitoring data in the target monitoring information according to a preset JSON message format to obtain a plurality of JSON messages;
pushing the JSON message to the middleware.
In one possible design, the information pushing module is further configured to: after the data message is pushed to the middleware, a data transmission log is obtained, and a JSON node is obtained from the data transmission log;
acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete;
and if the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
In one possible design, the information acquisition module is further configured to: after the monitoring information corresponding to the service to be monitored is obtained, a numerical interval corresponding to the service monitoring index is obtained;
and obtaining a monitoring result of the service monitoring index according to the monitoring data and the numerical interval corresponding to the service monitoring index, wherein the monitoring result comprises normal index and abnormal index.
In one possible design, the middleware includes a message queue and a message partition.
In one possible design, the information pushing module is specifically configured to:
acquiring target monitoring information corresponding to a preset core service, and taking the target monitoring information corresponding to the core service as core monitoring information;
and pushing the core monitoring information to a target message queue of a second terminal, wherein the target message queue is a message queue corresponding to the preset core service.
In a third aspect, an embodiment of the present invention provides a terminal device, including: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing computer-executable instructions stored in the memory causes the at least one processor to perform the information processing method of any one of the first aspects.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having stored therein computer-executable instructions, which when executed by a processor, implement the information processing method according to any one of the first aspects.
The embodiment of the invention provides an information processing method, a device and a terminal device, wherein the method performs storage format unification processing on monitoring data corresponding to a service monitoring index according to the index type corresponding to the service monitoring index, so that the storage format of the monitoring data is unified, and target monitoring information subjected to the storage format unification processing is pushed to a middleware of a second terminal, so that the middleware can timely send the target monitoring information to a client needing the monitoring data, the data transmission speed is improved, and the storage format unification processing is performed on the target monitoring information, so that the second terminal or the client can store the target monitoring information without processing the target monitoring information when storing the target monitoring information, and the data storage efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the invention, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.
FIG. 1 is a schematic diagram of an information processing system according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an information processing method according to an embodiment of the present invention;
FIG. 3 is a second flowchart of an information processing method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;
fig. 5 is a schematic hardware structure of a terminal device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented, for example, in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the prior art, in order to ensure that the service can normally run, corresponding service monitoring indexes are required to be configured, the service monitoring indexes are monitored to obtain corresponding monitoring data, and the monitoring data are sent to a terminal needing the monitoring data, so that related personnel can determine whether the service monitoring indexes are abnormal or not according to the monitoring data stored by the terminal, namely, judge whether the service is abnormal or not, so that the abnormality can be handled in time, but because the types of the monitoring data are more and the formats are complex, the terminal can store the obtained monitoring data after directly sending the monitoring data to the terminal, and the data storage efficiency is low.
Aiming at the problems in the prior art, the application provides an information processing method, an information processing device and a terminal device, the method is applied to a first terminal 101 in an information processing system shown in fig. 1, the first terminal 101 performs storage format unification processing on monitoring data corresponding to a service monitoring index according to an index type corresponding to the service monitoring index, so that the storage format of the monitoring data is unified, and target monitoring information subjected to the storage format unification processing is pushed to a middleware of a second terminal 102, so that the middleware can timely send the target monitoring information to a client 103 needing to monitor the data, the data transmission speed is improved, and the second terminal and the client can store the target monitoring information without processing the target monitoring information when storing the target monitoring information.
The technical scheme of the invention is described in detail below by specific examples. The following embodiments may be combined with each other, and some embodiments may not be repeated for the same or similar concepts or processes.
Fig. 2 is a flowchart of an information processing method according to an embodiment of the present invention, where the execution subject of the embodiment may be the first terminal in the embodiment shown in fig. 1, and the embodiment is not limited herein. As shown in fig. 2, the method of the present embodiment may include:
s201, monitoring information corresponding to the service to be monitored is obtained, wherein the monitoring information comprises service monitoring indexes and corresponding monitoring data.
In this embodiment, relevant monitoring software or equipment monitors a service to be monitored in real time or at regular time to obtain corresponding monitoring information, realize automatic collection of the monitoring information, and send the obtained monitoring information to the first terminal, where the monitoring information includes service monitoring indexes and monitoring data corresponding to the service monitoring indexes.
The service monitoring index corresponding to the service to be monitored is preset by related personnel according to actual requirements, for example, the service monitoring index comprises indexes such as operation occupied memory, access rate and the like.
The service to be monitored may be a service in a system based on a hybrid cloud platform architecture.
After the monitoring data corresponding to each service monitoring index is obtained, whether the service monitoring index is abnormal or not can be determined according to the monitoring data corresponding to the service monitoring index, and the specific process is as follows: and acquiring a numerical interval corresponding to the service monitoring index, and acquiring a monitoring result of the service monitoring index according to the monitoring data and the numerical interval corresponding to the service monitoring index, wherein the monitoring result comprises normal index and abnormal index.
In this embodiment, a numerical interval corresponding to a first service monitoring index is obtained, the first service monitoring index is any one service monitoring index of service monitoring indexes included in monitoring information, whether the first service monitoring index is abnormal or not is determined according to monitoring data corresponding to the first service monitoring index and the numerical interval, so that a monitoring result corresponding to the first service monitoring index is obtained, when the monitoring result is abnormal, alarm information can be timely generated and sent to a relevant terminal or a manager, so that the relevant person can timely solve problems existing in the service corresponding to the first service monitoring index according to the alarm information, whether the service monitoring index is abnormal or not is not required to be determined according to the monitoring data, the abnormality determination efficiency is improved, and the problem solving efficiency can be improved.
The numerical interval corresponding to the service monitoring index is determined according to the historical monitoring data corresponding to the service monitoring index, for example, a maximum value and a minimum value are determined according to the historical monitoring data, and the fluctuation range of the monitoring data corresponding to the service monitoring index is determined according to the minimum value and the maximum value, so that the numerical interval is obtained, and when the monitoring data is not in the numerical interval, the possibility that the monitoring data has a problem is high.
The specific process of determining whether the first service monitoring index is abnormal according to the monitoring data and the numerical interval corresponding to the first service monitoring index may be: counting the number of monitoring data which are not in the numerical value interval to obtain a first number, if the first number is larger than a first preset number, determining the monitoring result as an index abnormality, and if the first number is smaller than or equal to the first preset number, determining the monitoring result as an index abnormality.
In order to ensure the availability and accuracy of the monitoring data, when the first number is smaller than or equal to the first preset number, abnormal data in the monitoring data, namely, monitoring data which are not in the numerical value interval, can be removed.
S202, obtaining the index type of the service monitoring index.
In this embodiment, since the types of the service monitoring indicators are numerous, in order to facilitate the client to acquire, store and utilize the monitoring data, the storage format unification processing may be performed on the monitoring data of the same type, that is, the storage format unification processing may be performed on the monitoring data of the same type. When the storage format unification processing is performed on the monitoring data, the index type corresponding to the acquired service monitoring index is needed to be utilized.
When the index type of the service monitoring index is obtained, the index type corresponding to the service monitoring index can be obtained from a preset storage position or the index type corresponding to the service monitoring index can be directly included in the monitoring information.
And S203, performing storage format unified processing on the monitoring data corresponding to the service monitoring index according to the index type of the service monitoring index to obtain target monitoring information.
In this embodiment, according to the index type of each service monitoring index, storage format unification processing is performed on the monitoring data corresponding to the service monitoring index, so as to obtain target monitoring information, where the target monitoring information includes the service monitoring index and the monitoring data after the corresponding unification processing.
S204, pushing the target monitoring information to the middleware of the second terminal, so that the second terminal obtains the client subscribing the target monitoring information, and sending the target monitoring information to the client.
In this embodiment, the target monitoring information is pushed to the middleware of the second terminal, and after the middleware in the second terminal obtains the client subscribing the target monitoring information, the target monitoring information is sent to the client, so as to realize synchronization and sharing of data.
The middleware comprises a message partition and a message queue.
For non-core services, when pushing the target monitoring information to the middleware of the second terminal, the target monitoring information corresponding to the non-core service is actually pushed to a message partition in the KAFKA. And when the target monitoring information is pushed to the message partition, the target monitoring information can be realized by using a data transmission service (Data Transmission Service, DTS for short), so that the speed of data transmission can be improved, and a large amount of system resources are not required to be occupied in the transmission process.
In order to enable the second terminal to transmit monitoring data to the client in a push mode, the second terminal adopts MYSQL as a bridging data pool, flag bits corresponding to all service monitoring indexes are set in a MYSQL database, after the monitoring data corresponding to the service monitoring indexes are acquired, the flag bits corresponding to the service monitoring indexes are 1, otherwise, the flag bits are 0, and when target monitoring information is required to be transmitted to the client, KAFKA transmits the monitoring data to the client in a push mode through the MYSQL database.
For the core service, when pushing the target monitoring information to the middleware of the second terminal, the target monitoring information corresponding to the core service is actually pushed to the dedicated queue corresponding to the core service, and the specific process is as follows: and acquiring target monitoring information corresponding to the preset core service, and taking the target monitoring information corresponding to the core service as the core monitoring information. And pushing the core monitoring information to a target message queue of the second terminal, wherein the target message queue is a message queue corresponding to a preset core service.
In this embodiment, in obtaining the monitoring information corresponding to each service to be monitored, the target monitoring information corresponding to the preset core service is obtained from the monitoring information, and the target monitoring information is used as the core monitoring information, and the related component is called to push the core monitoring information into the target message queue, that is, into the dedicated message queue thereof, so that the client can consume the core monitoring information in time, thereby effectively ensuring the timeliness of the data and greatly improving the transmission speed.
The core service may be an important service set by related personnel according to actual requirements or a service with high real-time requirements.
Optionally, in order to timely find out that the core service has an abnormality and ensure the continuity of monitoring, a buried point can be set in the core service, a buried point log is collected, whether abnormal log information exists in the buried point log is detected, if the abnormal log information exists, alarm information is generated, and the alarm information is sent to a manager or a related terminal, wherein the alarm information comprises an identifier of the service with the abnormality, so that the manager can timely process the problem according to the alarm information.
Optionally, pushing the target monitoring information to the middleware of the second terminal includes:
and packaging the monitoring data in the target monitoring information according to a preset JSON message format to obtain a plurality of JSON messages. Pushing the JSON message to the middleware.
In this embodiment, after the target monitoring information is obtained, monitoring data corresponding to each service monitoring index in the target monitoring information may be encapsulated according to a preset JSON message format, a JSON message corresponding to each service monitoring index is generated, and the generated JSON message is transmitted to the middleware of the second terminal.
In order to ensure accuracy, integrity and continuity of the monitoring data, a data transfer log may be obtained and JSON nodes may be obtained from the data transfer log in the process of pushing the JSON message to the middleware of the second terminal. And acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete. If the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
In this embodiment, in the process of transmitting JSON messages to the second terminal, a corresponding data transmission log is generated, each JSON message is used as a JSON node, and accordingly, the data transmission log includes a plurality of JSON nodes, each JSON node further corresponds to a node message, a preset JSON message format is compared with a message format corresponding to the node message, whether the message format corresponding to the node message is complete is determined, if the message format of the node message is incomplete, it indicates that the monitoring data corresponding to the node message is abnormal, an abnormal breakpoint occurs, and the monitoring data corresponding to the node message needs to be retransmitted.
The node message is actually a JSON message.
Optionally, it may also be determined whether the monitoring data corresponding to the node packet is legal, if not, the monitoring data corresponding to the node needs to be retransmitted, and when determining whether the monitoring data is legal, it may be determined whether special characters exist in the monitoring data or whether the monitoring data is empty, for example, the monitoring data should be all digital characters, but if special characters such as # exist in the monitoring data corresponding to the node packet, it is determined that the monitoring data corresponding to the node packet is illegal and needs to be retransmitted.
Optionally, after determining the monitoring data corresponding to the node message to be retransmitted, the monitoring data may be retransmitted in batches or piece by piece.
According to the description, the storage format unification processing is performed on the monitoring data corresponding to the service monitoring index according to the index type corresponding to the service monitoring index, so that the storage format of the monitoring data is unified, and the target monitoring information subjected to the storage format unification processing is pushed to the middleware of the second terminal, so that the middleware can timely send the target monitoring information to the client needing to monitor the data, the data transmission speed is improved, and the storage format unification processing is performed on the target monitoring information, so that the second terminal or the client can store the target monitoring information without processing the target monitoring information when storing the target monitoring information, and the data storage efficiency is improved.
In order to facilitate client storage and use of the monitoring data, the storage format unification process may be performed on the same kind of monitoring data, and the process of performing the storage format unification process on the monitoring data is described in detail below with reference to a specific embodiment.
Fig. 3 is a flowchart second of a voice processing method according to an embodiment of the present invention, as shown in fig. 3, and details a specific implementation process of performing storage format unification processing on monitored data on the basis of the foregoing embodiment, as shown in fig. 3, where the method includes:
s301, acquiring monitoring information corresponding to a service to be monitored, wherein the monitoring information comprises a service monitoring index and corresponding monitoring data.
S302, obtaining the index type of the service monitoring index.
S301 to S302 are similar to S201 to S202 in the embodiment of fig. 2, and will not be described here again.
S303, classifying the service monitoring indexes to obtain a plurality of index sets, wherein the index sets comprise the service monitoring indexes with the same index type.
In this embodiment, the service monitoring indexes are classified according to the index types of each service monitoring index, and the service monitoring indexes with the same index type are used as one index set, that is, the index types of the service monitoring indexes included in one index set are the same.
When the service monitoring indexes are the same, the corresponding monitoring data are the same kind of data, and the monitoring data can be unified according to the same storage format.
S304, acquiring a standard storage format corresponding to each index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format, wherein the storage format unification processing comprises at least one of unit unification processing, file occupation space unification processing and precision unification processing.
In this embodiment, a standard storage format corresponding to a first index set is obtained and used as a first storage format, where the first index set is any one index set in each index set, and a storage format corresponding to the first index set is obtained, and the storage format corresponding to the first index set is actually a storage format corresponding to an index type of the first index set. And carrying out storage format unification processing on the first monitoring data corresponding to each service monitoring index in the first index set according to the standard of the first storage format, wherein the storage format unification processing comprises unit unification processing, file occupation space unification processing and precision unification processing.
Wherein the acquired monitoring data is actually in the form of a file, i.e. the acquired file actually contains the monitoring data. The storage format represents criteria for monitoring the storage of data, such as the accuracy of the storage, the units of storage, and the size of the file usage, i.e., the space taken up by the file.
The unit unification process refers to unifying the units of the first monitoring data to the units corresponding to the first storage format, for example, the units of the first monitoring data are seconds, the units of the first monitoring data are minutes, and the units corresponding to the first storage format are seconds.
The file occupation space unification process refers to unifying the storage space occupied by each first monitoring data, that is, unifying the storage space occupied by the first files containing the first monitoring data, for example, 100M of the storage space occupied by some first files, 200M of the storage space occupied by some first files, 150M of the file occupation space corresponding to the first storage format, and then unifying the space occupied by all the first files to 150M.
The precision unification process refers to unifying the precision of each first monitoring data, for example, the precision of some first monitoring data is two bits after the decimal point, the precision of some first monitoring data is three bits after the decimal point, the precision corresponding to the first storage format is two bits after the decimal point, and then the precision of all the first monitoring data needs to be unified to two bits after the decimal point.
Optionally, the storage format unifying processing further includes data format unifying processing, for example, unifying the data formats, that is, file types, of the first files containing the first monitoring data, for example, the data formats of some first files are in doc format, the data formats of some first files are in txt format, the data formats corresponding to the first storage formats are in doc format, and then the data formats of all first files need to be unified into doc format.
In this embodiment, after the storage format unification processing is performed on the monitoring data with the same index type, the storage format of the monitoring data can be unified, so that the second terminal and the client can directly acquire, store and utilize the monitoring data without processing the storage format of the monitoring data.
And S305, pushing the target monitoring information to the middleware of the second terminal so that the second terminal obtains the client subscribing the target monitoring information, and sending the target monitoring information to the client.
Here, S305 is similar to S204 in the embodiment of fig. 2, and a detailed description is omitted here.
Fig. 4 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention, and as shown in fig. 4, an information processing apparatus 400 according to the present embodiment may include: an information acquisition module 401, a type acquisition module 402, a type acquisition module 403, and an information push module 404.
The information obtaining module 401 is configured to obtain monitoring information corresponding to a service to be monitored, where the monitoring information includes a service monitoring index and corresponding monitoring data.
A type obtaining module 402, configured to obtain an index type of the service monitoring index.
The information processing module 403 is configured to perform storage format unified processing on the monitoring data corresponding to the service monitoring indicator according to the indicator type of the service monitoring indicator, so as to obtain target monitoring information.
The information pushing module 404 is configured to push the target monitoring information to the middleware of the second terminal, so that the second terminal obtains the client subscribed to the target monitoring information, and sends the target monitoring information to the client.
In one possible design, the information processing module is specifically configured to:
classifying the service monitoring indexes to obtain a plurality of index sets, wherein the index sets comprise service monitoring indexes with the same index type.
And aiming at each index set, acquiring a standard storage format corresponding to the index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format, wherein the storage format unification processing comprises at least one of unit unification processing, file occupation space unification processing and precision unification processing.
In one possible design, the information pushing module is specifically configured to:
and packaging the monitoring data in the target monitoring information according to a preset JSON message format to obtain a plurality of JSON messages.
Pushing the JSON message to the middleware.
In one possible design, the information push module is further configured to: after pushing the data message to the middleware, a data transfer log is obtained, and a JSON node is obtained from the data transfer log.
And acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete.
If the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
In one possible design, the information acquisition module is further configured to: after the monitoring information corresponding to the service to be monitored is obtained, a numerical interval corresponding to the service monitoring index is obtained.
And obtaining a monitoring result of the service monitoring index according to the monitoring data and the numerical interval corresponding to the service monitoring index, wherein the monitoring result comprises normal index and abnormal index.
In one possible design, the middleware includes a message queue and a message partition.
In one possible design, the information pushing module is specifically configured to:
and acquiring target monitoring information corresponding to the preset core service, and taking the target monitoring information corresponding to the core service as the core monitoring information.
And pushing the core monitoring information to a target message queue of the second terminal, wherein the target message queue is a message queue corresponding to a preset core service.
The information processing device provided by the embodiment of the present invention can implement the method of the above embodiment, and its implementation principle and technical effects are similar, and will not be described here again.
Fig. 5 is a schematic hardware structure of a terminal device according to an embodiment of the present invention. As shown in fig. 5, the terminal device 500 provided in this embodiment includes: at least one processor 501 and a memory 502. The processor 501 and the memory 502 are connected by a bus 503.
In a specific implementation, at least one processor 501 executes computer-executable instructions stored in a memory 502, so that at least one processor 501 executes the information processing method in the above method embodiment.
The specific implementation process of the processor 501 may refer to the above-mentioned method embodiment, and its implementation principle and technical effects are similar, and this embodiment will not be described herein again.
In the embodiment shown in fig. 5, it should be understood that the processor may be a central processing unit (english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution.
The memory may comprise high speed RAM memory or may further comprise non-volatile storage NVM, such as at least one disk memory.
The bus may be an industry standard architecture (Industry Standard Architecture, ISA) bus, an external device interconnect (Peripheral Component, PCI) bus, or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, the buses in the drawings of the present application are not limited to only one bus or one type of bus.
The embodiment of the invention also provides a computer readable storage medium, wherein computer execution instructions are stored in the computer readable storage medium, and when a processor executes the computer execution instructions, the information processing method of the method embodiment is realized.
The computer readable storage medium described above may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk. A readable storage medium can be any available medium that can be accessed by a general purpose or special purpose computer.
An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. In the alternative, the readable storage medium may be integral to the processor. The processor and the readable storage medium may reside in an application specific integrated circuit (Application Specific Integrated Circuits, ASIC for short). The processor and the readable storage medium may reside as discrete components in a device.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the method embodiments described above may be performed by hardware associated with program instructions. The foregoing program may be stored in a computer readable storage medium. The program, when executed, performs steps including the method embodiments described above; and the aforementioned storage medium includes: various media that can store program code, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the invention.
Claims (5)
1. An information processing method, characterized by comprising:
acquiring monitoring information corresponding to a service to be monitored, wherein the monitoring information comprises a service monitoring index and corresponding monitoring data thereof;
acquiring the index type of the service monitoring index;
classifying the service monitoring indexes to obtain a plurality of index sets, wherein each index set comprises service monitoring indexes with the same index type;
for each index set, acquiring a standard storage format corresponding to the index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format to obtain target monitoring information, wherein the storage format unification processing comprises unit unification processing, file occupation space unification processing and precision unification processing;
pushing the target monitoring information to a middleware of a second terminal, so that the second terminal obtains a client subscribing the target monitoring information, and sending the target monitoring information to the client, wherein the middleware comprises a message queue and a message partition;
the pushing the target monitoring information to the middleware of the second terminal comprises the following steps:
acquiring target monitoring information corresponding to a preset core service, and taking the target monitoring information corresponding to the core service as core monitoring information;
encapsulating the core monitoring information according to a preset JSON message format to obtain a plurality of JSON messages;
pushing the JSON message to a target message queue of a second terminal, wherein the target message queue is a message queue corresponding to the preset core service, so that the second terminal obtains a client subscribing the target monitoring information and sends the target monitoring information to the client;
after pushing the JSON message to the target message queue of the second terminal, the method further includes:
acquiring a data transmission log, and acquiring a JSON node from the data transmission log;
acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete;
and if the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
2. The method according to claim 1, further comprising, after the obtaining the monitoring information corresponding to the service to be monitored:
acquiring a numerical interval corresponding to the service monitoring index;
and obtaining a monitoring result of the service monitoring index according to the monitoring data and the numerical interval corresponding to the service monitoring index, wherein the monitoring result comprises normal index and abnormal index.
3. An information processing apparatus, characterized by comprising:
the information acquisition module is used for acquiring monitoring information corresponding to the service to be monitored, wherein the monitoring information comprises service monitoring indexes and corresponding monitoring data thereof;
the type acquisition module is used for acquiring the index type of the service monitoring index;
information processing module for
Classifying the service monitoring indexes to obtain a plurality of index sets, wherein each index set comprises service monitoring indexes with the same index type;
for each index set, acquiring a standard storage format corresponding to the index set, and carrying out storage format unification processing on monitoring data corresponding to each service monitoring index in the index set according to the standard storage format to obtain target monitoring information, wherein the storage format unification processing comprises unit unification processing, file occupation space unification processing and precision unification processing;
information pushing module for
Pushing the target monitoring information to a middleware of a second terminal, so that the second terminal obtains a client subscribing the target monitoring information, and sending the target monitoring information to the client, wherein the middleware comprises a message queue and a message partition;
the information pushing module is particularly used for
Acquiring target monitoring information corresponding to a preset core service, and taking the target monitoring information corresponding to the core service as core monitoring information;
encapsulating the core monitoring information according to a preset JSON message format to obtain a plurality of JSON messages;
pushing the JSON message to a target message queue of a second terminal, wherein the target message queue is a message queue corresponding to the preset core service, so that the second terminal obtains a client subscribing the target monitoring information and sends the target monitoring information to the client;
the information pushing module is also used for
After pushing the JSON message to a target message queue of a second terminal, acquiring a data transmission log, and acquiring a JSON node from the data transmission log;
acquiring a node message corresponding to the JSON node, and judging whether the message format of the node message is complete;
and if the message format of the node message is incomplete, retransmitting the monitoring data corresponding to the node message.
4. A terminal device, comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing computer-executable instructions stored in the memory causes the at least one processor to perform the information processing method of claim 1 or 2.
5. A computer-readable storage medium, in which computer-executable instructions are stored, which when executed by a processor, implement the information processing method according to claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911060584.0A CN110806960B (en) | 2019-11-01 | 2019-11-01 | Information processing method and device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911060584.0A CN110806960B (en) | 2019-11-01 | 2019-11-01 | Information processing method and device and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110806960A CN110806960A (en) | 2020-02-18 |
| CN110806960B true CN110806960B (en) | 2024-01-26 |
Family
ID=69500896
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911060584.0A Active CN110806960B (en) | 2019-11-01 | 2019-11-01 | Information processing method and device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110806960B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111432030B (en) * | 2020-04-17 | 2023-11-28 | 支付宝(杭州)信息技术有限公司 | Information release method, device, equipment and medium |
| CN113342606A (en) * | 2021-06-07 | 2021-09-03 | 平安证券股份有限公司 | Data monitoring method, device, equipment and storage medium based on message middleware |
| CN114168405A (en) * | 2021-11-17 | 2022-03-11 | 深圳市梦网科技发展有限公司 | Data monitoring method and device, terminal equipment and storage medium |
| CN115051979B (en) * | 2022-04-28 | 2023-09-19 | 福思(杭州)智能科技有限公司 | Monitoring data debugging system, method, vehicle and computer readable storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005235187A (en) * | 2004-01-23 | 2005-09-02 | Matsushita Electric Ind Co Ltd | Electronic business form system, electronic business form processing method, business form creation unit and business form processing unit |
| CN101453743A (en) * | 2008-10-31 | 2009-06-10 | 中国移动通信集团北京有限公司 | Real-time monitoring system, apparatus and method |
| CN107547589A (en) * | 2016-06-27 | 2018-01-05 | 腾讯科技（深圳）有限公司 | A kind of data acquisition treatment method and device |
| CN109040171A (en) * | 2018-06-14 | 2018-12-18 | 厦门理工学院 | A kind of emergency response system, method, equipment and storage medium |
| CN109409633A (en) * | 2018-08-23 | 2019-03-01 | 山东省城市商业银行合作联盟有限公司 | Business monitoring and Warning System |
| CN109582472A (en) * | 2018-10-19 | 2019-04-05 | 华为技术有限公司 | A kind of micro services processing method and equipment |
| CN110060118A (en) * | 2019-02-27 | 2019-07-26 | 浙江执御信息技术有限公司 | A kind of order is honoured an agreement full link method for real-time monitoring, device and computer equipment |
| WO2019184229A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method and apparatus for updating variable information, and computer device and storage medium |
| CN110321273A (en) * | 2019-07-09 | 2019-10-11 | 政采云有限公司 | A kind of business statistical method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9467500B2 (en) * | 2012-08-09 | 2016-10-11 | Rockwell Automation Technologies, Inc. | Remote industrial monitoring using a cloud infrastructure |
| CN106921754B (en) * | 2017-05-04 | 2020-07-28 | 泰康保险集团股份有限公司 | Load balancing method, device, medium and electronic equipment of cluster system |
| CN108984542A (en) * | 2017-05-31 | 2018-12-11 | 北京京东尚科信息技术有限公司 | Distribution type data collection method and system |
-
2019
- 2019-11-01 CN CN201911060584.0A patent/CN110806960B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2005235187A (en) * | 2004-01-23 | 2005-09-02 | Matsushita Electric Ind Co Ltd | Electronic business form system, electronic business form processing method, business form creation unit and business form processing unit |
| CN101453743A (en) * | 2008-10-31 | 2009-06-10 | 中国移动通信集团北京有限公司 | Real-time monitoring system, apparatus and method |
| CN107547589A (en) * | 2016-06-27 | 2018-01-05 | 腾讯科技（深圳）有限公司 | A kind of data acquisition treatment method and device |
| WO2019184229A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method and apparatus for updating variable information, and computer device and storage medium |
| CN109040171A (en) * | 2018-06-14 | 2018-12-18 | 厦门理工学院 | A kind of emergency response system, method, equipment and storage medium |
| CN109409633A (en) * | 2018-08-23 | 2019-03-01 | 山东省城市商业银行合作联盟有限公司 | Business monitoring and Warning System |
| CN109582472A (en) * | 2018-10-19 | 2019-04-05 | 华为技术有限公司 | A kind of micro services processing method and equipment |
| CN110060118A (en) * | 2019-02-27 | 2019-07-26 | 浙江执御信息技术有限公司 | A kind of order is honoured an agreement full link method for real-time monitoring, device and computer equipment |
| CN110321273A (en) * | 2019-07-09 | 2019-10-11 | 政采云有限公司 | A kind of business statistical method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110806960A (en) | 2020-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110806960B (en) | Information processing method and device and terminal equipment | |
| CN110213068B (en) | Message middleware monitoring method and related equipment | |
| CN109587008B (en) | Method, device and storage medium for detecting abnormal flow data | |
| CN111818136B (en) | Data processing method, device, electronic equipment and computer readable medium | |
| CN111459782B (en) | Method and device for monitoring service system, cloud platform system and server | |
| CN112311617A (en) | Configured data monitoring and alarming method and system | |
| WO2017112147A1 (en) | Selective measurement reporting from internet of things devices | |
| US8196151B1 (en) | Detecting queue problems using messages entering and leaving a queue during a time period | |
| CN109218407B (en) | Code management and control method based on log monitoring technology and terminal equipment | |
| CN103067184B (en) | The abnormality eliminating method of offline charging and system | |
| CN110971488A (en) | Data processing method, device, server and storage medium | |
| US9355506B2 (en) | Method for managing fault messages of a motor vehicle | |
| CN113407374A (en) | Fault processing method and device, fault processing equipment and storage medium | |
| CN115883340B (en) | HPLC (high Performance liquid chromatography) and HRF (high performance liquid chromatography) based dual-mode communication fault processing method and device | |
| CN111652681A (en) | Receipt processing method, server and computer readable storage medium | |
| CN115811483A (en) | Network state monitoring method and device, electronic equipment and storage medium | |
| CN114579416A (en) | Index determination method, device, server and medium | |
| CN113766363B (en) | Fault monitoring method and device and computing equipment | |
| CN112199207A (en) | Alarm information pushing method, device, system, equipment and medium | |
| CN116166701B (en) | Service data real-time early warning method, device, equipment and storage medium | |
| CN111339174A (en) | Data exchange method and device, readable storage medium and data exchange system | |
| CN113132431A (en) | Service monitoring method, service monitoring device, electronic device, and medium | |
| CN113517989B (en) | Resource charging method and device for IaaS cloud platform | |
| CN115174667B (en) | Big data pushing method, system and electronic equipment | |
| CN112491589B (en) | Object storage network early warning method, system, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |