WO2015090241A1 - 监控业务运行数据入库的方法和相关设备及系统 - Google Patents

监控业务运行数据入库的方法和相关设备及系统 Download PDF

Info

Publication number
WO2015090241A1
WO2015090241A1 PCT/CN2015/072272 CN2015072272W WO2015090241A1 WO 2015090241 A1 WO2015090241 A1 WO 2015090241A1 CN 2015072272 W CN2015072272 W CN 2015072272W WO 2015090241 A1 WO2015090241 A1 WO 2015090241A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
quality indicator
inbound
server
service
Prior art date
Application number
PCT/CN2015/072272
Other languages
English (en)
French (fr)
Inventor
周东祥
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Publication of WO2015090241A1 publication Critical patent/WO2015090241A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a method and a related device and system for monitoring service operation data storage.
  • An embodiment of the present invention provides a method for monitoring service operation data storage, which may include:
  • the data source server receives business operation data from the distributed service server
  • the service operation data storage quality abnormality alarm is executed, or is sent to the data monitoring center server for indicating The warehousing quality indicator data of the warehousing quality indicator, so that the data monitoring center server performs after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormality alarm condition Service operation data storage quality abnormal accident alarm processing.
  • Another aspect of the embodiments of the present invention provides a method for monitoring service operation data storage, including:
  • the data monitoring center server receives the inbound quality indicator data from the data source server;
  • the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormality alarm condition, performing the service operation data storage quality abnormality alarm processing, wherein the warehousing quality indicator is
  • the data source server is obtained by monitoring the localized inbound business operation data from the distributed business server.
  • a data source server including:
  • a receiving unit configured to receive service running data from a distributed service server
  • An warehousing unit configured to localize the received service running data into the database
  • the warehousing monitoring unit is configured to monitor the warehousing quality indicator of the service running data of the localized warehousing;
  • a processing unit configured to perform an alarm of an abnormality of the inbound quality of the service operation data, or send the data to the data monitoring center server, if the inbound quality indicator monitored by the inbound monitoring unit meets the preset abnormality of the inbound quality of the storage quality Instructing the inbound quality indicator data of the inbound quality indicator, so that the data monitoring center server determines that the inbound quality indicator indicated by the inbound quality indicator data meets a preset inbound quality abnormality alarm condition, Perform alarm processing for abnormal data in the operation of the data.
  • a data monitoring center server including:
  • a receiving unit configured to receive inbound quality indicator data from a data source server
  • the abnormal alarm processing unit is configured to perform an alarm processing for abnormality of the service operation data storage quality, if the storage quality indicator indicated by the storage quality indicator data meets the preset abnormality of the storage quality abnormality, wherein
  • the warehousing quality indicator is obtained by the data source server monitoring the localized warehousing service running data from the distributed service server.
  • Another aspect of the embodiments of the present invention provides a communication system, including:
  • the distributed service server is configured to send a service running number to the data source server. according to;
  • the data source server is configured to receive service running data from the distributed service server; perform localization and storage into the received service running data; and monitor the inbound quality indicator of the localized inbound storage service operation data; If the warehousing quality indicator meets the preset warehousing quality abnormality alarm condition, the service operation data storage quality abnormality alarm processing is performed; or the data monitoring center server is sent to indicate the input quality indicator
  • the library quality indicator data is configured to enable the data monitoring center server to perform an abnormality of the service operation data storage quality after determining that the storage quality indicator indicated by the storage quality indicator data meets the preset storage quality abnormal alarm condition Alarm processing.
  • Another aspect of the embodiments of the present invention provides a communication system, including:
  • a data monitoring center server a data source server, and a plurality of distributed business servers
  • the distributed service server is configured to send service running data to the data source server.
  • the data source server is configured to receive service running data from the distributed service server; perform localization and storage into the received service running data; and monitor the inbound quality indicator of the localized inbound storage service operation data; And sending, to the data monitoring center server, the inbound quality indicator data for indicating the inbound quality indicator;
  • the data monitoring center server is configured to perform an alarm processing of the abnormality of the service running data storage quality after determining that the storage quality indicator indicated by the storage quality indicator data meets the preset abnormality of the storage quality abnormality.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data inbound quality indicator, and determines the input indicated by the inbound quality indicator data. After the library quality indicator meets the preset warehousing quality abnormal alarm condition, the service operation data storage quality abnormality alarm processing is executed, which is beneficial to improve the quality of the localized warehousing business operation data, thereby facilitating the improvement of the warehousing big data warehouse. The quality of the business operations data.
  • FIG. 1 is a schematic flowchart of a method for monitoring service operation data storage in a database according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart diagram of another method for monitoring service operation data storage according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of another method for monitoring service operation data storage according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a network architecture according to an embodiment of the present disclosure.
  • FIG. 4 is a schematic flowchart of another method for monitoring service operation data storage according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of another network architecture according to an embodiment of the present invention.
  • FIG. 5-a is a schematic diagram of a data source server according to an embodiment of the present invention.
  • FIG. 5-b is a schematic diagram of another data source server according to an embodiment of the present invention.
  • 6-a is a schematic diagram of a data monitoring center server according to an embodiment of the present invention.
  • FIG. 6-b is a schematic diagram of another data monitoring center server according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of another data source server according to an embodiment of the present invention.
  • FIG. 8 is a schematic diagram of another data monitoring center server according to an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a communication system according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of another communication system according to an embodiment of the present invention.
  • the embodiments of the present invention provide a method for monitoring service operation data storage and related devices and systems, so as to improve the quality of the inbound operation data.
  • An embodiment of the present invention provides a method for monitoring service operation data storage, the method may include: receiving, by a first data source server, service operation data from a distributed service server; and localizing the received service operation data into the database The warehousing quality indicator of the service running data of the localized warehousing; if the warehousing quality indicator meets the preset warehousing quality abnormality alarm condition, the service operation data storage quality abnormality alarm is processed; Or sending, to the data monitoring center server, the inbound quality indicator data for indicating the inbound quality indicator, so that the data monitoring center server determines that the inbound quality indicator indicated by the inbound quality indicator data meets the pre After the abnormal alarm condition of the storage quality is set, the alarm of the abnormality of the service operation data storage quality is executed.
  • FIG. 1 is a schematic flowchart of a method for monitoring service operation data storage in a database according to an embodiment of the present invention. As shown in FIG. 1 , a method for monitoring service operation data storage in the embodiment of the present invention may include steps 101 to 104.
  • the first data source server receives service running data from the distributed service server.
  • the first data source server can receive business operational data of a plurality of distributed service servers under its jurisdiction. It can be understood that the product names of the distributed service servers may be different for different service scenarios. For example, for a game business scenario, the distributed service server may be referred to as a distributed game server, and the business operation data is a game operation. data. Other scenarios can be deduced by analogy.
  • the first data source server in the embodiment of the present invention can be regarded as a plurality of data source servers in the network. Any of them.
  • the solution of the embodiment of the present invention can be applied to, for example, inbound monitoring of business running big data, for example, it can be applied to inbound monitoring of game running big data.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and a data content type for describing a data content type of the service running data.
  • a timestamp such as sending a timestamp, generating a sending timestamp, etc.
  • a data content type for describing a data content type of the service running data.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the first data source server locally stores the received service running data into the database.
  • the first data source server may locally store the received service running data into the database according to a preset inbound protocol.
  • the preset warehousing protocol may be specified or sent to the first data source server by the data monitoring center server or the big data warehouse or other management node, and the preset warehousing protocol may involve a library table or the like.
  • the first data source server may monitor an inbound quality indicator of the localized inbound storage service operation data.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • the first data source server can monitor the localized warehousing process of the business operation data of different data content types under different data content versions.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, corresponding to the first data content type and the first data content version.
  • the business operation data wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the first data source server can monitor the inbound data of the localized inbound business within daily, hourly, or every 10 minutes or every minute or second or every other time. Library quality indicators.
  • the first data source server performs the service running data storage quality abnormality alarm processing; or sends the data monitoring center server to indicate the The warehousing quality indicator data of the warehousing quality indicator, so that the data monitoring center server performs the business operation after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormal alarm condition Data storage quality abnormal accident alarm processing.
  • the service running data storage quality abnormality alarm processing may include: sending an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the first data source server, and restarting The business runs the data warehousing application and/or reinstalls the business running data warehousing application and so on.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate. It is assumed that the first data source server receives 100 pieces of service running data, and only 95 pieces of service running data are stored in the database, so that the corresponding data localized inbound database integrity is 95%, and so on. Assuming that the first data source server has 95 business operations data stored in the database, and 94 business operation data are correctly stored, the corresponding data localization storage accuracy is 94/95, and so on.
  • the preset warehousing quality abnormality alarm condition may include, for example, the data localization warehousing integrity is less than the first threshold and/or the data localization warehousing accuracy is less than the second threshold.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the method for monitoring a service running data into a database includes: monitoring a transmission quality indicator of the service running data sent by the distributed service server that is transmitted by the network; wherein, if the transmission quality indicator meets a preset transmission quality abnormal alarm condition, performing a service operation data transmission quality The abnormality alarm is processed; or the transmission quality indicator data for indicating the transmission quality indicator is sent to the data monitoring center server, so that the data monitoring center server determines the transmission quality indicated by the transmission quality indicator data. After the indicator meets the preset transmission quality abnormal alarm condition, the service operation data transmission quality abnormality alarm processing can be performed.
  • the transmission quality indicator of the service running data sent by the distributed service server that is monitored by the monitoring network may include: sending, by the distributed service server, the network transmission The transmission delay and/or the packet loss rate of the service running data.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, 8 seconds, or other values or ranges.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm processing may include: sending a transmission quality abnormality alarm signal, generating a transmission quality abnormality alarm log, reconfiguring the distributed service server, and the first data.
  • the inbound quality indicator data may also carry time information such as an inbound time stamp.
  • the data monitoring center server may monitor a data dictionary change event published by the data dictionary management platform; according to the monitored data dictionary The change event determines the latest data content version and data content type for each time period. Further, the data monitoring center server determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data content type in the time period of the storage time stamp is determined Not the first data content type, the data monitoring center server may perform data dictionary abnormal accident alarm processing of the service running data.
  • the data source server after receiving the service running data from the distributed service server, the data source server locally stores the received service running data into the database; and monitors the localized inbound service.
  • the warehousing quality indicator of the running data if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, the service running data warehousing quality abnormality alarm processing is executed; or the data monitoring center server is sent to indicate the entry
  • the warehousing quality indicator data of the library quality indicator so that the data monitoring center server executes the business operation data after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormal alarm condition
  • the storage quality is abnormal.
  • the data source server monitors the localized inbound service running data to obtain the data storage quality indicator, and executes after determining that the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality abnormal alarm condition
  • the operation operation data storage quality abnormal accident alarm processing which is beneficial to improve the quality of the localized warehousing business operation data, and thus is beneficial to improving the quality of the business operation data of the warehousing big data warehouse.
  • An embodiment of the present invention provides a method for monitoring service operation data storage, the method may include: the data monitoring center server receives the inbound quality indicator data from the first data source server; if the inbound quality indicator data is indicated The warehousing quality indicator meets the preset warehousing quality abnormality alarm condition, and then performs the service operation data storage quality abnormality alarm processing, wherein the warehousing quality indicator is monitored and localized by the first data source server. Obtained from the business operation data of the distributed business server.
  • FIG. 2 is a schematic flowchart diagram of another method for monitoring service operation data storage in the embodiment of the present invention.
  • another method for monitoring service operation data storage in the embodiment of the present invention may include steps 201 to 202.
  • the data monitoring center server receives the inbound quality indicator data from the first data source server, where the inbound quality indicator is monitored by the first data source server and localized into the library. Obtained from the business operation data of the cloth business server.
  • the first data source server can receive service running data of a plurality of distributed service servers under its jurisdiction. It can be understood that the product names of the distributed service servers may be different for different business scenarios. For example, for a game business scenario, a distributed service server may be referred to as a distributed game server, and other scenarios may be deduced.
  • the first data source server can be considered as any one of a plurality of data source servers in the network.
  • the first data source server may receive the service running data from the distributed service server;
  • the service running data is localized into the database; monitoring the inbound quality indicator of the service running data of the localized inbound storage; if the inbound quality indicator meets the preset inbound quality abnormal alarm condition, the data is monitored
  • the central server sends the inbound quality indicator data for indicating the inbound quality indicator.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and a data content type for describing a data content type of the service running data.
  • a timestamp such as sending a timestamp, generating a sending timestamp, etc.
  • a data content type for describing a data content type of the service running data.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the first data source server may locally store the received service running data into the database according to a preset inbound protocol.
  • the preset warehousing protocol may be specified or sent to the first data source server by the data monitoring center server or the big data warehouse or other management node, and the preset warehousing protocol may involve a library table or the like.
  • the first data source server monitors the warehousing quality indicator of the localized warehousing the service running data, and includes: monitoring the localized warehousing of the localized warehousing the service running data. Integrity and/or data localization inbound accuracy. Of course, it is also possible to monitor other inbound quality indicators of the localized inbound business operations data.
  • the first data source server may monitor the localization and warehousing process of the service running data of different data content types under different data content versions.
  • the first data source server receives the service running data from the distributed service server, including: the first data source server receives the first data content from the distributed service server. And the service running data corresponding to the first data content version; wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the first data source server can monitor the inbound data of the localized inbound business within daily, hourly, or every 10 minutes or every minute or second or every other time. Library quality indicators.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate. It is assumed that the first data source server receives 100 pieces of service running data, and only 95 pieces of service running data are stored in the database, so that the corresponding data localized inbound database integrity is 95%, and so on. Suppose the first data source server has 95 business operation data stored in the database. Among them, 94 business operation data are correctly stored, and the corresponding data localization storage accuracy is 94/95, and so on.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the data monitoring center server performs the service running data storage quality abnormality alarm processing.
  • the service running data storage quality abnormality alarm processing may include: sending an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the first data source server, and restarting The business runs the data warehousing application and/or reinstalls the business running data warehousing application and so on.
  • the preset warehousing quality abnormality alarm condition may include, for example, the data localization warehousing integrity is less than the first threshold and/or the data localization warehousing accuracy is small.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the warehousing quality indicator includes data localization wareness integrity and/or data localization warehousing accuracy.
  • the warehousing quality indicator is an warehousing quality indicator corresponding to the first data content type and the first data content version.
  • the method for monitoring a service running data into the database may further include: the data monitoring center server receiving the transmission quality indicator data from the first data source server; if the storage quality indicator The transmission quality indicator indicated by the data conforms to a preset transmission quality abnormal alarm condition, and performs a service operation data transmission quality abnormality alarm processing, wherein the transmission quality indicator is monitored by the first data source server to monitor the distribution of the network transmission. Obtained by the business operation data sent by the service server.
  • the first data source server monitoring the transmission quality indicator of the service running data sent by the distributed service server that is transmitted by the network may include: monitoring the distributed service that is transmitted by the network The transmission delay and/or packet loss rate of the service running data sent by the server.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, 8 seconds, or other values or ranges.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm is generated.
  • the processing may include: sending a transmission quality abnormality alarm signal, generating a transmission quality abnormality alarm log, reconfiguring a distributed service server and a routing path of the first data source server, and/or rebuilding the distributed service server and the first data source The server's data transfer channel and so on.
  • the inbound quality indicator data may also carry time information such as an inbound time stamp.
  • the data monitoring center server may monitor a data dictionary change event issued by the data dictionary management platform; and determine a latest data content version and a data content type of each time period according to the monitored data dictionary change event. Further, the data monitoring center server determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data content type in the time period of the storage time stamp is determined Not the first data content type, the data monitoring center server may perform data dictionary abnormal accident alarm processing of the service running data.
  • the data monitoring center server receives the inbound quality indicator data from the first data source server; if the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality abnormality The alarm condition is executed, and the service running data storage quality abnormality alarm processing is performed, wherein the storage quality indicator is obtained by the first data source server monitoring the localized inbound service running data from the distributed service server.
  • the data source server monitors the process of localizing the inbound business operation data to obtain the data storage quality indicator, and reports the inbound quality indicator data of the indicated storage quality indicator to the data monitoring center server, and the data monitoring center server determines the location.
  • the service operation data storage quality abnormal accident alarm processing is executed, which is beneficial to improving the quality of the localized storage service operation data. In turn, it is beneficial to improve the quality of business operation data of the inbound big data warehouse.
  • FIG. 3-a is a schematic flowchart of another method for monitoring service operation data storage in the embodiment of the present invention.
  • FIG. 3 is a network architecture diagram of a method for monitoring service operation data storage in the embodiment of the present invention.
  • another method for monitoring service operation data storage in the embodiment of the present invention may include steps 301 to 306.
  • the data source server S1 receives business operation data from the distributed service server.
  • the data source server S1 can receive service running data of a plurality of distributed service servers under its jurisdiction. It can be understood that the product names of the distributed service servers may be different for different business scenarios. For example, for a game business scenario, a distributed service server may be referred to as a distributed game server, and other scenarios may be deduced.
  • the data source server S1 can be considered as any one of a plurality of data source servers in the network.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and data for describing a data content type of the service running data.
  • a timestamp such as sending a timestamp, generating a sending timestamp, etc.
  • data for describing a data content type of the service running data may be included in each service running data.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the data source server S1 monitors, by the network, a transmission quality indicator of the service running data sent by the distributed service server.
  • the data source server S1 performs the service operation data transmission quality abnormality alarm processing.
  • the monitoring network transmitting the transmission quality indicator of the service running data sent by the distributed service server may include: monitoring, by the network, the sending by the distributed service server The transmission delay and/or packet loss rate of the service running data.
  • the network may also monitor other transmission quality indicators of the service operation data sent by the distributed service server.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, and 8 seconds. Or other value or range.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm processing may include: transmitting a transmission quality abnormality alarm signal, generating a transmission quality abnormality alarm log, reconfiguring a distributed service server, and a data source.
  • the data source server S1 localizes the received service running data into the database.
  • the data source server S1 may localize the received service running data into the library according to a preset inbound protocol.
  • the preset warehousing protocol may be specified or sent to the data source server S1 by the data monitoring center server or the big data warehouse or other management node, and the preset warehousing protocol may involve a library table or the like.
  • the data source server S1 can monitor the inbound quality indicator of the service running data of the localized inbound storage.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • the data source server S1 can monitor the localization and warehousing process of the service running data of different data content types under different data content versions.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, corresponding to the first data content type and the first data content version.
  • the business operation data wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the data source server S1 can monitor the inbound storage of the localized inbound business operation data within daily, hourly or every 10 minutes or every minute or every second or every other time. Quality Index.
  • the data source server S1 performs the alarm processing of the service running data storage quality abnormality alarm if the storage quality indicator meets the preset abnormality of the storage quality abnormality alarm condition.
  • the service operation data storage quality abnormality alarm processing may include: issuing an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the data source server S1, and restarting the service. Run the data warehousing application and/or reinstall the business running data warehousing application and more.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate. It is assumed that the data source server S1 receives 100 service running data, and only 95 business running data are stored in the database, and the corresponding data localized storage integrity is 95%, and so on. Assume that the data source server S1 has 95 business operation data, and 94 business operation data is correctly stored in the database, and the corresponding data localization storage accuracy is 94/95, and so on.
  • the preset warehousing quality abnormality alarm condition may include, for example, the data localization warehousing integrity is less than the first threshold and/or the data localization warehousing accuracy is less than the second threshold.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the inbound quality indicator may also carry time information such as an inbound time stamp.
  • the data source server S1 may monitor a data dictionary change event issued by the data dictionary management platform; and determine a latest data content version and a data content type of each time period according to the monitored data dictionary change event. Further, the data source server S1 determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data content type in the time period of the storage time stamp is determined Not the first data content type, the data source server S1 can execute the data dictionary abnormality of the business operation data. Police handling.
  • the data source server after receiving the service running data from the distributed service server, the data source server locally stores the received service running data into the database; and monitors the localized inbound service.
  • the warehousing quality indicator of the running data if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, the service running data warehousing quality abnormality alarm is processed.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and executes the service operation data storage quality abnormality alarm after determining that the storage quality indicator meets the preset inbound quality abnormal alarm condition. Processing, which is beneficial to improve the quality of the business operation data of the localized warehousing, and thus to improve the quality of the business operation data of the warehousing big data warehouse.
  • FIG. 4-a is a schematic flowchart of another method for monitoring service operation data storage in the embodiment of the present invention.
  • FIG. 4 is a network architecture diagram of a method for monitoring service operation data storage in the embodiment of the present invention. As shown in FIG. 4-a, another method for monitoring service operation data storage in the embodiment of the present invention may include steps 401 to 408.
  • the data source server S1 receives the service running data from the distributed service server.
  • the data source server S1 can receive business operation data of a plurality of distributed service servers under its jurisdiction. It can be understood that the product names of the distributed service servers may be different for different business scenarios. For example, for a game business scenario, a distributed service server may be referred to as a distributed game server, and other scenarios may be deduced.
  • the data source server S1 can be considered as any one of a plurality of data source servers in the network.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and data for describing a data content type of the service running data.
  • a timestamp such as sending a timestamp, generating a sending timestamp, etc.
  • data for describing a data content type of the service running data may be included in each service running data.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the data source server S1 monitors, by the network, a transmission quality indicator of the service running data sent by the distributed service server.
  • the data source server S1 sends a data monitoring center server to indicate the transmission quality.
  • the transmission quality indicator data of the indicator is not limited to the transmission quality.
  • the data monitoring center server performs an alarm processing of the service operation data transmission quality abnormality alarm.
  • the monitoring network transmitting the transmission quality indicator of the service running data sent by the distributed service server may include: monitoring, by the network, the sending by the distributed service server The transmission delay and/or packet loss rate of the service running data.
  • the network may also monitor other transmission quality indicators of the service operation data sent by the distributed service server.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, 8 seconds, or other values or ranges.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm processing may include: transmitting a transmission quality abnormality alarm signal, generating a transmission quality abnormality alarm log, reconfiguring a distributed service server, and a data source.
  • the data source server S1 localizes the received service running data into the database.
  • the data source server S1 may follow a preset warehousing protocol (the preset warehousing protocol (which may involve a library table, etc.) may be used by a data monitoring center server or a big data warehouse or other
  • the management node specifies or delivers to the data source server S1) to localize the received business operation data into the database.
  • the data source server S1 monitors the inbound quality indicator of the service running data of the localized inbound storage.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate.
  • the data source server S1 can monitor the localization and warehousing process of the service running data of different data content types under different data content versions.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, corresponding to the first data content type and the first data content version.
  • the business operation data wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the data source server S1 can monitor the inbound storage of the localized inbound business operation data within daily, hourly or every 10 minutes or every minute or every second or every other time. Quality Index.
  • the data source server S1 sends the inbound quality indicator data for indicating the inbound quality indicator to the data monitoring center server.
  • the data monitoring center server performs an alarm processing of the abnormality of the service operation data storage quality.
  • the service operation data storage quality abnormality alarm processing may include: issuing an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the data source server S1, and restarting the service. Run the data warehousing application and/or reinstall the business running data warehousing application and more.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate. It is assumed that the data source server S1 receives 100 service running data, and only 95 business running data are stored in the database, and the corresponding data localized storage integrity is 95%, and so on. Assume that the data source server S1 has 95 business operation data, and 94 business operation data is correctly stored in the database, and the corresponding data localization storage accuracy is 94/95, and so on.
  • the preset warehousing quality abnormality alarm condition may include, for example, the data localization warehousing integrity is less than the first threshold and/or the data localization warehousing accuracy is less than the second threshold.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the inbound quality indicator data may also carry time information such as an inbound time stamp.
  • the data monitoring center server may monitor a data dictionary change event issued by the data dictionary management platform; and determine a latest data content version and a data content type of each time period according to the monitored data dictionary change event. Further, if the data monitoring center server determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data in the time period of the storage time stamp is determined, If the content type is not the first data content type, the data monitoring center server may perform data dictionary abnormal accident alarm processing of the service running data.
  • the data source server after receiving the service running data from the distributed service server, the data source server locally localizes the received service running data into the database; and monitors the localized storage operation of the service.
  • the warehousing quality indicator of the data sending the warehousing quality indicator data for indicating the warehousing quality indicator to the data monitoring center server, so that the data monitoring center server determines the input indicated by the warehousing quality indicator data
  • the alarm is processed for the abnormality of the service running data.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and after determining that the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality abnormal alarm condition
  • the alarm processing of the abnormality of the business operation data storage quality is performed, which is beneficial to improving the quality of the business operation data of the localized storage, thereby facilitating the improvement of the quality of the business operation data of the inbound large data warehouse.
  • the solution of the embodiment of the present invention can be applied to, for example, inbound monitoring of business running big data, for example, it can be applied to inbound monitoring of game running big data.
  • a distributed game server and a data source server in a plurality of distributed Internet Data Center (IDC) network nodes of a certain game can interactively play game data.
  • the data source server monitors the inbound storage of the game running data, and the data source server locally stores the received game running data into the database; monitors the inbound quality indicator of the localized inbound game running data; if the inbound quality indicator meets If the preset storage quality abnormal alarm condition is used, the game operation data storage quality abnormality alarm processing is executed; or the storage quality indicator data indicating the storage quality indicator is sent to the data monitoring center server to facilitate the data. After the monitoring center server determines that the storage quality indicator indicated by the storage quality indicator data meets the preset storage quality abnormal alarm condition, the alarm operation of the game operation data storage quality abnormality alarm is executed.
  • the data source server of the game big data can be deployed and distributed in each major network IDC node, and can be distributedly distributed based on the distributed characteristics of the network IDC.
  • the game data server and game server of the game big data can be deployed in the same network IDC local area network to prevent the transmission timeout and data loss risk that may occur across the network.
  • the data source server of the game big data is separately deployed from the game server, and the data generated by the game server can be input to the nearest data source server in an asynchronous manner.
  • the types of data source servers for game big data can vary.
  • a data source server for the status data related to the inbound game account can be divided into a data source server for the status data related to the inbound game account, a data source server for the inbound game payment income data, and a data source server for the player behavior log data in the inbound game.
  • the data storage medium of the data source server of the game big data is diverse and may not be of the same type, and the storage medium is, for example, a database and a file.
  • the spatial distribution of IDC network nodes in the data map of the metadata of the data source server of the game big data is often related to the operation of the game.
  • the new network game server area can be added to the IDC data source server.
  • the operation of the large area of the game server can also be correspondingly off the IDC data source server.
  • the data table of the data source server of the game big data the data table in the data dictionary, the data table structure, and the like Cloth is often associated with the operation of the game. For example, if you add a new online game version, the relevant server area can increase the IDC data source server close to it.
  • the operation of the large area of the game server will also be correspondingly off the IDC data source server.
  • the down frame refers to closing the game and not providing the download service.
  • the data content version of the data dictionary of the data source server of the game big data is related to the classification, test, grayscale, experience and other classification characteristics of the version of the game server.
  • the content version of the grayscale server is higher than the content version of the official server.
  • Big data for online games in the Internet industry usually has the following unique features:
  • the landing refers to the landing of the data
  • the data after landing refers to the persistent data
  • the data is generally placed on a hard disk or other persistent storage device, such as: a picture, a system log, and a page display. Data and data stored in a relational database, etc., landing data must have a fixed carrier, will not disappear instantly.
  • the solution proposed by the embodiment of the invention can be applied to the localization and storage monitoring of the game distributed big data, thereby facilitating the improvement of the data quality of the flow to the centralized big data warehouse and improving the availability and reliability thereof.
  • an embodiment of the present invention provides a data source server 500, which may include:
  • the receiving unit 510 is configured to receive service running data from the distributed service server.
  • the warehousing unit 520 is configured to localize the received service running data into the library.
  • the warehousing monitoring unit 530 is configured to monitor the warehousing of the service running data of the localized warehousing Quality Index.
  • the processing unit 540 is configured to: if the warehousing quality indicator monitored by the warehousing monitoring unit 530 meets the preset warehousing quality abnormal alarm condition, execute the service running data storage quality abnormality alarm processing; or send the data to the data monitoring center server Instructing the inbound quality indicator data of the inbound quality indicator, so that the data monitoring center server determines that the inbound quality indicator indicated by the inbound quality indicator data meets a preset inbound quality abnormality alarm condition, Perform alarm processing for abnormal data in the operation of the data.
  • the warehousing monitoring unit 530 is specifically configured to monitor data localization warehousing integrity and/or data localization warehousing accuracy of the localized warehousing service operation data.
  • the receiving unit 510 is specifically configured to receive, from the distributed service server, service running data corresponding to the first data content type and the first data content version; wherein the storage quality The indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the data source server 500 may further include: a transmission monitoring unit 550, configured to monitor, by the network, the transmission of the service running data sent by the distributed service server. Quality Index.
  • the processing unit 540 is further configured to: if the transmission quality indicator monitored by the transmission monitoring unit 550 meets the preset transmission quality abnormal alarm condition, perform a service operation data transmission quality abnormality alarm processing; or, to the data monitoring center server Transmitting transmission quality indicator data for indicating the transmission quality indicator, so that the data monitoring center server performs after determining that the transmission quality indicator indicated by the transmission quality indicator data meets a preset transmission quality abnormal alarm condition Service operation data transmission quality abnormality alarm processing.
  • the transmission monitoring unit 550 may be specifically configured to: monitor, by the network, a transmission delay and/or a packet loss rate of the service running data sent by the distributed service server.
  • the data source server 500 after receiving the service running data from the distributed service server, the data source server 500 locally registers the received service running data into the database; and monitors the localized warehousing service.
  • the warehousing quality indicator of the running data if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, the service running data warehousing quality abnormality alarm processing is executed; or the data monitoring center server is sent to indicate the entry
  • the warehousing quality indicator data of the library quality indicator so that the data monitoring center server executes the business operation data after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormal alarm condition
  • the storage quality is abnormal.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and after determining that the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality abnormal alarm condition
  • the alarm processing of the abnormality of the business operation data storage quality is performed, which is beneficial to improving the quality of the business operation data of the localized storage, thereby facilitating the improvement of the quality of the business operation data of the inbound large data warehouse.
  • an embodiment of the present invention provides a data monitoring center server 600, which may include:
  • the receiving unit 610 and the abnormality alarm processing unit 620 are configured to perform various functions.
  • the receiving unit 610 is configured to receive the inbound quality indicator data from the first data source server.
  • the abnormal alarm processing unit 620 is configured to perform an alarm processing for abnormality of the service operation data storage quality if the storage quality indicator indicated by the storage quality indicator data meets the preset abnormality of the storage quality abnormality, wherein The inbound quality indicator is obtained by the first data source server monitoring the localized inbound service running data from the distributed service server.
  • the warehousing quality indicator includes data localization wareness integrity and/or data localization warehousing accuracy.
  • the warehousing quality indicator is an warehousing quality indicator corresponding to the first data content type and the first data content version.
  • the receiving unit 610 is further configured to receive transmission quality indicator data from the first data source server;
  • the abnormal alarm processing unit 620 is further configured to: if the transmission quality indicator indicated by the inbound quality indicator data meets a preset transmission quality abnormal alarm condition, perform an abnormal operation of the service operation data transmission quality. Therefore, the alarm processing is obtained by the first data source server monitoring network transmitting the service running data sent by the distributed service server.
  • the transmission quality indicator includes a transmission delay and/or a packet loss rate.
  • the data monitoring center server 600 may further include: a monitoring unit 630 and a determining unit 640.
  • the monitoring unit 630 is configured to monitor a data dictionary change event issued by the data dictionary management platform
  • the determining unit 640 is configured to determine, according to the monitored data dictionary change event, the latest data content version and the data content type of each time period.
  • the inbound quality indicator data carries an inbound timestamp.
  • the abnormal alarm processing unit 620 is further configured to: if the determining unit determines that the latest data content version in the time period of the inbound time stamp is not the first data content version, and/or, if the determining unit determines the storage The latest data content type in the time period in which the time stamp belongs is not the first data content type, and the data dictionary abnormal accident alarm processing of the service running data is executed.
  • the data monitoring center server 600 receives the inbound quality indicator data from the first data source server; if the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality The abnormal alarm condition is executed, and the service running data storage quality abnormality alarm processing is performed, wherein the storage quality indicator is obtained by the first data source server monitoring the localized storage and service operation data from the distributed service server.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and reports the inbound quality indicator data of the indicated inbound quality indicator to the data monitoring center server, and the data monitoring center server can determine After the storage quality indicator indicated by the storage quality indicator data meets the preset storage quality abnormal alarm condition, the service operation data storage quality abnormal accident alarm processing is performed, which is beneficial to improving the localized storage service operation data. Quality, in turn, helps improve the quality of business operations data in the inbound big data warehouse.
  • FIG. 7 is a structural block diagram of a data source server 700 according to another embodiment of the present invention.
  • the data source server 700 can include at least one processor 701, at least one network interface 704 or other user interface 703, a memory 705, and at least one communication bus 702. Communication bus 702 is used to implement connection communication between these components.
  • the data source server 700 optionally includes a user interface 703, including: a display (eg, a touch screen, an LCD, a CRT, a Holographic or Projector, etc.), a pointing device (eg, a mouse, a trackball ( Trackball) touch panel or touch screen, etc., camera and/or sound pickup device, etc.
  • a display eg, a touch screen, an LCD, a CRT, a Holographic or Projector, etc.
  • a pointing device eg, a mouse, a trackball ( Trackball) touch panel or touch screen, etc.
  • camera and/or sound pickup device etc.
  • the memory 702 can include a read only memory and a random access memory and provides instructions and data to the processor 701. A portion of memory 702 may also include non-volatile random access memory or the like.
  • the memory 705 stores the following elements, executable modules or data structures, or a subset thereof, or their extended set:
  • Operating system 7051 including various system programs for implementing various basic services and processing hardware-based tasks;
  • the application module 7052 includes various applications for implementing various application services.
  • the application module 7052 includes, but is not limited to, a receiving unit 510, an inbound unit 520, an inbound monitoring unit 530, a processing unit 540, and/or a transmission monitoring unit 550, and the like.
  • the processor 701 receives service running data from the distributed service server by calling a program or instruction stored in the memory 705; localizing the received service running data into the database; monitoring the local The warehousing quality indicator of the service operation data in the warehousing; if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, the service operation data storage quality abnormality alarm processing is performed; or, the data monitoring is performed.
  • the central server sends the inbound quality indicator data for indicating the inbound quality indicator, so that the data monitoring center server determines that the inbound quality indicator indicated by the inbound quality indicator data meets the preset inbound quality After the abnormal alarm condition is executed, the service operation data storage quality abnormality alarm is processed.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and data for describing a data content type of the service running data.
  • Content type information a version of the data content used to describe the operational data of the business Data content version information.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the monitoring the inbound quality indicator of the service running data of the localized inbound storage comprises: monitoring data localization and storage integrity of the localized inbound storage service operation data. And/or data localization inbound accuracy. Of course, it is also possible to monitor other inbound quality indicators of the localized inbound business operations data.
  • the processor 701 can monitor the localization and warehousing process of the service running data of different data content types under different data content versions.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, corresponding to the first data content type and the first data content version.
  • the business operation data wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the processor 701 can monitor the quality of the inbound data of the localized inbound business operation within daily, hourly, or every 10 minutes or every minute or second or every other length of time. index.
  • the service running data quality abnormality alarm processing may include: sending an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the data source server 700, and restarting the service.
  • the monitoring, by the localization, the inbound quality indicator of the service running data includes: monitoring the localization and integrity of the data of the service running data of the localized inbound storage and / or data localization into the library accuracy rate. It is assumed that the processor 701 receives 100 pieces of service running data, and only 95 pieces of service running data are stored in the library, so that the corresponding data localized inbound database integrity is 95%, and so on. Suppose the processor 701 has 95 business operation data stored in the database, and 94 of the business operation data are correctly stored, the corresponding data localization storage accuracy is 94/95, and so on.
  • the preset storage quality abnormal alarm condition may be, for example, The method includes: the data localization storage integrity is less than the first threshold and/or the data localization storage accuracy is less than the second threshold.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the method for the processor 701 to monitor the service running data into the database may further include: monitoring, by the network, a transmission quality indicator of the service running data sent by the distributed service server; If the transmission quality indicator meets the preset transmission quality abnormal alarm condition, the service operation data transmission quality abnormality alarm processing is performed; or the transmission quality indicator data for indicating the transmission quality indicator is sent to the data monitoring center server. After the data monitoring center server determines that the transmission quality indicator indicated by the transmission quality indicator data meets the preset transmission quality abnormal alarm condition, the service operation data transmission quality abnormality alarm processing may be performed.
  • the processor 701, monitoring, by the network, the transmission quality indicator of the service running data sent by the distributed service server may include: monitoring, by the network, the sending by the distributed service server The transmission delay and/or packet loss rate of the service running data.
  • the network may also monitor other transmission quality indicators of the service operation data sent by the distributed service server.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, and 8 seconds. Or other value or range.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm processing may include: sending a transmission quality abnormality alarm alarm signal, generating a transmission quality abnormality alarm log, reconfiguring the distributed service server, and the data source server.
  • the inbound quality indicator data may also carry time information such as an inbound time stamp.
  • the data monitoring center server may monitor a data dictionary change event issued by the data dictionary management platform; and determine a latest data content version and a data content type of each time period according to the monitored data dictionary change event. Further, the data monitoring center server determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data content type in the time period of the storage time stamp is determined Not the first data content type, the data monitoring center server may perform data dictionary abnormal accident alarm processing of the service running data.
  • the data source server 700 after receiving the service running data from the distributed service server, the data source server 700 localizes the received service running data into the database; and monitors the localized warehousing service.
  • the warehousing quality indicator of the running data if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, the service running data warehousing quality abnormality alarm processing is executed; or the data monitoring center server is sent to indicate the entry
  • the warehousing quality indicator data of the library quality indicator so that the data monitoring center server executes the business operation data after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormal alarm condition
  • the storage quality is abnormal.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and performs the alarm processing of the abnormality of the business operation data storage quality according to the data storage quality indicator, which is beneficial to improve the localized storage.
  • the quality of business operations data which in turn helps improve the quality of business operations data in the inbound big data warehouse.
  • FIG. 8 is a structural block diagram of a data monitoring center server 800 according to another embodiment of the present invention.
  • the data monitoring center server 800 may include: at least one processor 801, at least one Network interface 804 or other user interface 803, memory 805, at least one communication bus 802. Communication bus 802 is used to implement connection communication between these components.
  • the data monitoring center server 800 optionally includes a user interface 803, including: a display (eg, a touch screen, an LCD, a CRT, a Holographic or a Projector, etc.), a pointing device (eg, a mouse, a trackball) (trackball) touch panel or touch screen, etc.), camera and/or sound pickup device, etc.
  • the memory 802 can include read only memory and random access memory and provides instructions and data to the processor 801. A portion of the memory 802 may also include a non-volatile random access memory or the like.
  • memory 805 stores elements, executable modules or data structures, or a subset thereof, or their extension set:
  • Operating system 8051 including various system programs for implementing various basic services and processing hardware-based tasks;
  • the application module 8052 includes various applications for implementing various application services.
  • the application module 8052 includes, but is not limited to, a monitoring unit 630, a determining unit 640, a receiving unit 610, and/or an abnormality alarm processing unit 620, and the like.
  • the processor 801 receives the inbound quality indicator data from the first data source server by calling the program or the instruction stored in the memory 805; if the inbound quality indicator indicated by the inbound quality indicator data meets If the preset storage quality abnormal alarm condition is executed, the service operation data storage quality abnormality alarm processing is performed, wherein the storage quality indicator is monitored by the first data source server and the localized storage is from the distributed service server. Business operations data is obtained.
  • the first data source server can receive service running data of a plurality of distributed service servers under its jurisdiction. It can be understood that the product names of the distributed service servers may be different for different business scenarios. For example, for a game business scenario, a distributed service server may be referred to as a distributed game server, and other scenarios may be deduced.
  • the first data source server can be considered as any one of a plurality of data source servers in the network.
  • the first data source server may receive the service running data from the distributed service server;
  • the business operation data is localized into the database; Controlling the warehousing quality indicator of the service running data of the localized warehousing; if the warehousing quality indicator meets the preset warehousing quality abnormal alarm condition, sending the warehousing quality indicator to the data monitoring center server Inbound quality indicator data.
  • each service running data may further carry a timestamp (such as sending a timestamp, generating a sending timestamp, etc.), and data for describing a data content type of the service running data.
  • a timestamp such as sending a timestamp, generating a sending timestamp, etc.
  • data for describing a data content type of the service running data may be included in each service running data.
  • the service running data may also carry the identification information (such as the Internet Protocol address, device identifier, etc.) of the self-distributed service server that sends the service running data.
  • the service running data may also carry other information, and no longer One by one example.
  • the first data source server may follow a preset warehousing protocol (the preset warehousing protocol (which may involve a library table, etc.) may be performed by a data monitoring center server or a big data warehouse or The other management node is specified or delivered to the first data source server to locally store the received business operation data into the database.
  • a preset warehousing protocol which may involve a library table, etc.
  • the other management node is specified or delivered to the first data source server to locally store the received business operation data into the database.
  • the first data source server monitors the warehousing quality indicator of the localized warehousing the service running data, and includes: monitoring the localized warehousing of the localized warehousing the service running data. Integrity and/or data localization inbound accuracy. Of course, it is also possible to monitor other inbound quality indicators of the localized inbound business operations data.
  • the first data source server may monitor the localization and warehousing process of the service running data of different data content types under different data content versions.
  • the first data source server receives the service running data from the distributed service server, including: the first data source server receives the first data content from the distributed service server. And the service running data corresponding to the first data content version; wherein the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the first data source server can monitor the inbound data of the localized inbound business within daily, hourly, or every 10 minutes or every minute or second or every other time. Library quality indicators.
  • the monitoring localization warehousing the number of business operations According to the warehousing quality indicators, the data localization warehousing integrity and/or data localization warehousing accuracy rate of the business operation data of the localization warehousing is monitored. It is assumed that the first data source server receives 100 pieces of service running data, and only 95 pieces of service running data are stored in the database, so that the corresponding data localized inbound database integrity is 95%, and so on. Suppose the first data source server has 95 business operation data stored in the database. Among them, 94 business operation data are correctly stored, and the corresponding data localization storage accuracy is 94/95, and so on.
  • the receiving, from the distributed service server, the service running data comprising: receiving, from the distributed service server, service running data corresponding to the first data content type and the first data content version.
  • the storage quality indicator is an inbound quality indicator corresponding to the first data content type and the first data content version.
  • the service running data storage quality abnormality alarm processing may include: sending an inbound quality abnormality alarm signal, generating an inbound quality abnormality alarm log, restarting the first data source server, and restarting Business operations data warehousing applications and / or reloading business operations data warehousing applications and so on.
  • the preset warehousing quality abnormality alarm condition may include, for example, the data localization warehousing integrity is less than the first threshold and/or the data localization warehousing accuracy is less than the second threshold.
  • the first threshold may be equal to, for example, 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the second threshold may for example be equal to 90%, 92%, 95%, 98%, 99% or other values or ranges.
  • the warehousing quality indicator includes data localization wareness integrity and/or data localization warehousing accuracy.
  • the warehousing quality indicator is an warehousing quality indicator corresponding to the first data content type and the first data content version.
  • the processor 801 may further receive the transmission quality indicator data from the first data source server; if the transmission quality indicator indicated by the inbound quality indicator data meets a preset transmission quality abnormality The alarm condition is executed, and the service operation data transmission quality abnormality alarm processing is performed, wherein the transmission quality indicator is obtained by the first data source server monitoring network transmitting the service operation data sent by the distributed service server.
  • the first data source server monitors, by the network, the transmission quality indicator of the service running data sent by the distributed service server, where the monitoring network transmits the distributed service server to send The transmission delay and/or packet loss rate of the service running data.
  • the network may also monitor other transmission quality indicators of the service operation data sent by the distributed service server.
  • the transmission delay of the service running data may be calculated according to the generated timestamp and the receiving timestamp of the service running data.
  • the packet loss rate of the service running data can be calculated according to the number of sent and the number of received data of the service running data.
  • each business operation data may further include information such as a data amount, a source address, a destination address, a data content type information, and/or a data content version information of the service operation data.
  • the preset transmission quality abnormality alarm condition may include, for example, the transmission delay of the service operation data is greater than a third threshold and/or the packet loss rate of the service operation data is greater than a fourth threshold.
  • the third threshold may be equal to, for example, 0.1 second, 1 second, 2 seconds, 3 seconds, 5 seconds, 8 seconds, or other values or ranges.
  • the fourth threshold may for example be equal to 10%, 8%, 5%, 1%, 0.5%, 0.1% or other values or ranges.
  • the service operation data transmission quality abnormality alarm processing may include: sending a transmission quality abnormality alarm signal, generating a transmission quality abnormality alarm log, reconfiguring the distributed service server, and the first data.
  • the inbound quality indicator data may also carry time information such as an inbound time stamp.
  • the data monitoring center server may monitor a data dictionary change event issued by the data dictionary management platform; and determine a latest data content version and a data content type of each time period according to the monitored data dictionary change event. Further, the data monitoring center server determines that the latest data content version in the time period of the storage time stamp is not the first data content version, and/or, if the latest data content type in the time period of the storage time stamp is determined Not the first data content type, the data monitoring center server may perform data dictionary abnormal accident alarm processing of the service running data.
  • the data monitoring center server 800 receives the inbound quality indicator data from the first data source server; if the inbound quality indicator is indicated by the inbound quality indicator data And the preset storage quality abnormal alarm condition, the service operation data storage quality abnormality alarm processing is executed, wherein the storage quality indicator is monitored by the first data source server and the localized storage is from the distributed service server.
  • the business runs the data and gets it.
  • the data source server monitors the process of localizing the inbound service running data to obtain the data storage quality indicator, and reports the inbound quality indicator data of the indicated inbound quality indicator to the data monitoring center server, and the data monitoring center server can
  • the library quality indicator performs the alarm processing of the abnormality of the business operation data storage quality, which is beneficial to improve the quality of the business operation data of the localized storage, thereby facilitating the improvement of the quality of the business operation data of the inbound large data warehouse.
  • an embodiment of the present invention further provides a communication system, which may include:
  • the distributed service server 920 is configured to send service running data to the first data source server.
  • a first data source server 910 configured to receive service running data from the distributed service server 910; localize the received service running data into the database; and monitor the inbound storage of the service running data of the localized inbound database
  • the quality indicator if the storage quality indicator meets the preset abnormality of the storage quality abnormality alarm, the service operation data storage quality abnormal accident alarm processing is performed; or, the data monitoring center server is sent to indicate the quality of the storage quality
  • the warehousing quality indicator data of the indicator so that the data monitoring center server performs the business operation data storage after determining that the warehousing quality indicator indicated by the warehousing quality indicator data meets the preset warehousing quality abnormal alarm condition Quality abnormality alarm handling.
  • the first data source server 910 of the embodiment may be any data source server mentioned in the embodiment, and the distributed service server 920 may be any distributed service server as mentioned in the embodiment.
  • an embodiment of the present invention further provides a communication system, which may include:
  • a data monitoring center server 1010 a data monitoring center server 1010, a first data source server 1020 and a plurality of distributed service servers 1030;
  • the distributed service server 1030 is configured to send service running data to the first data source server 1020.
  • the first data source server 1020 is configured to receive service running data from the distributed service server, perform localization into the received service running data, and monitor the inbound quality of the service running data in the localized inbound database.
  • the indicator sends the inbound quality indicator data for indicating the inbound quality indicator to the data monitoring center server.
  • the data monitoring center server 1010 is configured to perform an alarm processing for abnormality of the service operation data storage quality after determining that the storage quality indicator indicated by the storage quality indicator data meets the preset abnormality of the storage quality abnormality.
  • the first data source server 1020 of the embodiment may be any one of the data source servers mentioned in the embodiment, and the distributed service server 1030 may be any distributed service server as mentioned in the embodiment.
  • the data monitoring center server 1010 can be any of the data monitoring center servers mentioned in the embodiments.
  • the disclosed apparatus may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. You can choose some or all of them according to actual needs.
  • the unit is to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, and the like. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • Educational Administration (AREA)
  • Operations Research (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer And Data Communications (AREA)

Abstract

提供监控业务运行数据入库的方法和相关设备及系统。所述方法包括：数据源服务器接收来自分布式业务服务器的业务运行数据(101)；对接收到的业务运行数据进行本地化入库(102)；监控本地化入库业务运行数据的入库质量指标(103)；若入库质量指标符合预设的入库质量异常告警条件，执行业务运行数据入库质量异常事故告警处理，或向数据监控中心服务器发送用于指示入库质量指标的入库质量指标数据，以使数据监控中心服务器在确定入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理(104)。

Description

监控业务运行数据入库的方法和相关设备及系统
本申请要求于2013年12月18日提交中国专利局、申请号为201310699871.2、发明名称为“监控业务运行数据入库的方法和相关设备及系统”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本发明涉及计算机技术领域，具体涉及一种监控业务运行数据入库的方法和相关设备及系统。
背景技术
随着互联网技术的发展，基于互联网的应用越来越多，这些应用产生的业务运行数据也越来越多。例如，现有的很多互联网游戏产品，运行高峰期可能在分布式骨干网络中实时的产生大量的运行数据。例如，目前的一些大型多人在线游戏类型的个人计算机客户端游戏，每天就可能产生近TB级别的游戏运行数据。然而，基于如此大量的游戏运行数据的数据分析、数据挖掘和营销活动等相关的数据计算往往非常依赖集中式数据仓库，以保证分析广/深度和计算速度等。
发明内容
本发明实施例一方面提供一种监控业务运行数据入库的方法，可包括：
数据源服务器接收来自分布式业务服务器的业务运行数据；
对接收到的所述业务运行数据进行本地化入库；
监控本地化入库所述业务运行数据的入库质量指标；
若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，或者，向数据监控中心服务器发送用于指示 所述入库质量指标的入库质量指标数据，以使所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
本发明实施例另一方面提供一种监控业务运行数据入库的方法，包括：
数据监控中心服务器接收来自数据源服务器的入库质量指标数据；
若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述数据源服务器通过监控本地化入库来自分布式业务服务器的业务运行数据而得到。
本发明实施例另一方面提供一种数据源服务器，包括：
接收单元，用于接收来自分布式业务服务器的业务运行数据；
入库单元，用于对接收到的所述业务运行数据进行本地化入库；
入库监控单元，用于监控本地化入库所述业务运行数据的入库质量指标；
处理单元，用于若所述入库监控单元监控的入库质量指标符合预设的入库质量异常告警条件，执行业务运行数据入库质量异常事故告警处理，或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
本发明实施例另一方面提供一种数据监控中心服务器，包括：
接收单元，用于接收来自数据源服务器的入库质量指标数据；
异常告警处理单元，用于若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。
本发明实施例另一方面提供一种通信系统，包括：
数据源服务器和多个分布式业务服务器；
其中，所述分布式业务服务器，用于向所述数据源服务器发送业务运行数 据；
所述数据源服务器，用于接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以使所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
本发明实施例另一方面提供一种通信系统，包括：
数据监控中心服务器、数据源服务器和多个分布式业务服务器；
其中，所述分布式业务服务器，用于向所述数据源服务器发送业务运行数据；
所述数据源服务器，用于接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据；
所述数据监控中心服务器，用于在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
由上可见，本发明一些实施例的技术方案中，由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施 例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种监控业务运行数据入库的方法的流程示意图；
图2是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图；
图3-a是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图；
图3-b是本发明实施例提供的一种网络架构示意图；
图4-a是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图；
图4-b是本发明实施例提供的另一种网络架构示意图；
图5-a是本发明实施例提供的一种数据源服务器的示意图；
图5-b是本发明实施例提供的另一种数据源服务器的示意图；
图6-a是本发明实施例提供的一种数据监控中心服务器的示意图；
图6-b是本发明实施例提供的另一种数据监控中心服务器的示意图；
图7是本发明实施例提供的另一种数据源服务器的示意图；
图8是本发明实施例提供的另一种数据监控中心服务器的示意图；
图9是本发明实施例提供的一种通信系统的示意图；
图10是本发明实施例提供的另一种通信系统的示意图。
具体实施方式
本发明实施例提供监控业务运行数据入库的方法和相关设备及系统，以期提高入库业务运行数据的质量。
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分的实施例，而不是全部的实施例。基于本发 明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本发明保护的范围。
以下分别进行详细说明。
本发明的说明书和权利要求书及所述附图中的术语“第一”、“第二”、“第三”“第四”等(如果存在)是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本发明的实施例例如能够以除了在这里图示或描述的那些以外的顺序实施。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本发明实施例提供一种监控业务运行数据入库的方法，该方法可包括：第一数据源服务器接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库的所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
参见图1，图1是本发明实施例提供的一种监控业务运行数据入库的方法的流程示意图。如图1所示，本发明实施例提供的一种监控业务运行数据入库的方法可包括步骤101至步骤104。
101、第一数据源服务器接收来自分布式业务服务器的业务运行数据。
第一数据源服务器可接收其管辖的多个分布式业务服务器的业务运行数据。可以理解的是，对于不同的业务场景，分布式业务服务器的产品名称可能各不相同，例如，对于游戏业务场景而言，分布式业务服务器即可称分布式游戏服务器，业务运行数据即游戏运行数据。其它场景可以此类推。
本发明实施例中的第一数据源服务器可认为是网络中众多数据源服务器 当中的任意一个。
本发明实施例方案例如可应用于业务运行大数据的入库监控，例如可应用于游戏运行大数据的入库监控。
在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
102、第一数据源服务器对接收到的所述业务运行数据进行本地化入库。
在本发明的一些可能的实施方式中，第一数据源服务器可按照预设的入库协议对接收到的业务运行数据进行本地化入库。该预设的入库协议可以由数据监控中心服务器或大数据仓库或其它管理节点指定或下发给第一数据源服务器，该预设的入库协议可能涉及库表等。
103、第一数据源服务器可监控本地化入库所述业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
第一数据源服务器可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，第一数据源服务器可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入 库质量指标。
104、若所述入库质量指标符合预设的入库质量异常告警条件，则第一数据源服务器执行业务运行数据入库质量异常事故告警处理；或者向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启第一数据源服务器、重启业务运行数据入库应用和/或重新安装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设第一数据源服务器接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设第一数据源服务器入库了95条业务运行数据，其中正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，所述监控业务运行数据入库的方法还 可包括：监控网络传输的所述分布式业务服务器发送的所述业务运行数据的传输质量指标；其中，若所述传输质量指标符合预设的传输质量异常告警条件，则执行业务运行数据传输质量异常事故告警处理；或，向所述数据监控中心服务器发送用于指示所述传输质量指标的传输质量指标数据，以便于所述数据监控中心服务器在确定所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件之后，则可以执行业务运行数据传输质量异常事故告警处理。
在本发明的一些可能的实施方式中，所述监控网络传输的所述分布式业务服务器发送的所述业务运行数据的传输质量指标，可包括：监控网络传输的所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输的所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，业务运行数据传输质量异常事故告警处理，可以包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重新配置分布式业务服务器和第一数据源服务器的路由路径，和/或重建分布式业务服务器和第一数据源服务器的数据传输通道等等。
在本发明一些可能的实施方式中，所述入库质量指标数据中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据监控中心服务器可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典 变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据监控中心服务器若确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据监控中心服务器可执行业务运行数据的数据字典异常事故告警处理。
可以看出，本实施例中，数据源服务器在接收来自分布式业务服务器的业务运行数据之后；对接收到的所述业务运行数据进行本地化入库；并监控本地化入库的所述业务运行数据的入库质量指标；若入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
本发明实施例提供一种监控业务运行数据入库的方法，所述方法可包括：数据监控中心服务器接收来自第一数据源服务器的入库质量指标数据；若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。
请参见图2，图2是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图。如图2所示，本发明实施例提供的另一种监控业务运行数据入库的方法可包括步骤201至步骤202。
201、数据监控中心服务器接收来自第一数据源服务器的入库质量指标数据，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分 布式业务服务器的业务运行数据而得到。
其中，第一数据源服务器可接收其管辖的多个分布式业务服务器的业务运行数据。可以理解的是，对于不同的业务场景，分布式业务服务器的产品名称可能各不相同，例如，对于游戏业务场景而言，分布式业务服务器即可称分布式游戏服务器，其它场景可以此类推。其中，第一数据源服务器可认为是网络中众多数据源服务器当中的任意一个。
在本发明一些可能的实施方式中，在数据监控中心服务器接收来自第一数据源服务器的入库质量指标数据之前，第一数据源服务器可接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据。
在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
在本发明的一些可能的实施方式中，第一数据源服务器可按照预设的入库协议对接收到的业务运行数据进行本地化入库。该预设的入库协议可以由数据监控中心服务器或大数据仓库或其它管理节点指定或下发给第一数据源服务器，该预设的入库协议可能涉及库表等。
在本发明的一些可能的实施方式中，第一数据源服务器监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
其中，第一数据源服务器可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，第一数据源服务器接收来自分布式业务服务器的业务运行数据，包括：第一数据源服务器接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，第一数据源服务器可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设第一数据源服务器接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设第一数据源服务器入库了95条业务运行数据，其中，正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
202、若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则数据监控中心服务器执行业务运行数据入库质量异常事故告警处理。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启第一数据源服务器、重启业务运行数据入库应用和/或重新安装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小 于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述入库质量指标包括数据本地化入库完整度和/或数据本地化入库准确率。
在本发明的一些可能的实施方式中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，所述监控业务运行数据入库的方法还可进一步包括：数据监控中心服务器接收来自第一数据源服务器的传输质量指标数据；若所述入库质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件，执行业务运行数据传输质量异常事故告警处理，其中，所述传输质量指标由所述第一数据源服务器监控网络传输的所述分布式业务服务器发送的所述业务运行数据而得到。
在本发明的一些可能的实施方式中，第一数据源服务器监控网络传输的所述分布式业务服务器发送的所述业务运行数据的传输质量指标，可包括：监控网络传输的所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输的所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，业务运行数据传输质量异常事故告警 处理，可以包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重配置分布式业务服务器和第一数据源服务器的路由路径，和/或重建分布式业务服务器和第一数据源服务器的数据传输通道等等。
在本发明一些可能的实施方式中，所述入库质量指标数据中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据监控中心服务器可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据监控中心服务器若确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据监控中心服务器可执行业务运行数据的数据字典异常事故告警处理。
可以看出，本实施例中，数据监控中心服务器接收来自第一数据源服务器的入库质量指标数据；若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并向数据监控中心服务器上报指示的入库质量指标的入库质量指标数据，而数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
为便于更好的理解和实施本发明实施例，下面通过举例几个应用场景进行进一步介绍。
请参见图3-a和图3-b，图3-a是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图。图3-b是本发明实施例提供的可用于一种监控业务运行数据入库的方法的网络架构图。如图3-a所示，本发明实施例提供的另一种监控业务运行数据入库的方法可包括步骤301至306。
301、数据源服务器S1接收来自分布式业务服务器的业务运行数据。
其中，数据源服务器S1可接收其管辖的多个分布式业务服务器的业务运行数据。可以理解的是，对于不同的业务场景，分布式业务服务器的产品名称可能各不相同，例如，对于游戏业务场景而言，分布式业务服务器即可称分布式游戏服务器，其它场景可以此类推。其中，数据源服务器S1可认为是网络中众多数据源服务器当中的任意一个。
其中，在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
302、数据源服务器S1监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标。
303、若所述传输质量指标符合预设的传输质量异常告警条件，则数据源服务器S1执行业务运行数据传输质量异常事故告警处理。
在本发明的一些可能的实施方式中，所述监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标，可包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒 或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，所述业务运行数据传输质量异常事故告警处理可包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重配置分布式业务服务器和数据源服务器S1的路由路径，和/或重建分布式业务服务器和数据源服务器S1的数据传输通道等等。
304、数据源服务器S1对接收到的所述业务运行数据进行本地化入库。
在本发明的一些可能的实施方式中，数据源服务器S1可按照预设的入库协议对接收到的业务运行数据进行本地化入库。该预设的入库协议可以由数据监控中心服务器或大数据仓库或其它管理节点指定或下发给数据源服务器S1，该预设的入库协议可能涉及库表等。
305、数据源服务器S1可监控本地化入库所述业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
其中，数据源服务器S1可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，数据源服务器S1可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入库质量指标。
306、数据源服务器S1若监控到所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理。
可以理解，步骤302～303和步骤304～306之间没有必然的先后顺序。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启数据源服务器S1、重启业务运行数据入库应用和/或重新安装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设数据源服务器S1接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设数据源服务器S1入库了95条业务运行数据，其中正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明一些可能的实施方式中，所述入库质量指标中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据源服务器S1可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据源服务器S1若确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据源服务器S1可执行业务运行数据的数据字典异常事故告 警处理。
可以看出，本实施例中，数据源服务器在接收来自分布式业务服务器的业务运行数据之后；对接收到的所述业务运行数据进行本地化入库；并监控本地化入库的所述业务运行数据的入库质量指标；若入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并在确定入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
请参见图4-a和图4-b，图4-a是本发明实施例提供的另一种监控业务运行数据入库的方法的流程示意图。图4-b是本发明实施例提供的可用于一种监控业务运行数据入库的方法的网络架构图。如图4-a所示，本发明实施例提供的另一种监控业务运行数据入库的方法可包括步骤401至步骤408。
401、数据源服务器S1接收来自分布式业务服务器的业务运行数据。
数据源服务器S1可接收其管辖的多个分布式业务服务器的业务运行数据。可以理解的是，对于不同的业务场景，分布式业务服务器的产品名称可能各不相同，例如，对于游戏业务场景而言，分布式业务服务器即可称分布式游戏服务器，其它场景可以此类推。其中，数据源服务器S1可认为是网络中众多数据源服务器当中的任意一个。
其中，在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
402、数据源服务器S1监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标。
403、数据源服务器S1向数据监控中心服务器发送用于指示所述传输质量 指标的传输质量指标数据。
404、若所述传输质量指标符合预设的传输质量异常告警条件，则数据监控中心服务器执行业务运行数据传输质量异常事故告警处理。
在本发明的一些可能的实施方式中，所述监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标，可包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，所述业务运行数据传输质量异常事故告警处理可包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重配置分布式业务服务器和数据源服务器S1的路由路径，和/或重建分布式业务服务器和数据源服务器S1的数据传输通道等等。
405、数据源服务器S1对接收到的所述业务运行数据进行本地化入库。
在本发明的一些可能的实施方式中，数据源服务器S1可按照预设的入库协议(该预设的入库协议(可能涉及库表等)可以由数据监控中心服务器或大数据仓库或其它管理节点指定或下发给数据源服务器S1)对接收到的业务运行数据进行本地化入库。
406、数据源服务器S1监控本地化入库的所述业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
其中，数据源服务器S1可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，数据源服务器S1可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入库质量指标。
407、数据源服务器S1向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据。
408、若所述入库质量指标符合预设的入库质量异常告警条件，则数据监控中心服务器执行业务运行数据入库质量异常事故告警处理。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启数据源服务器S1、重启业务运行数据入库应用和/或重新安装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设数据源服务器S1接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设数据源服务器S1入库了95条业务运行数据，其中正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明一些可能的实施方式中，所述入库质量指标数据中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据监控中心服务器可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据监控中心服务器若确定出的所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据监控中心服务器可执行业务运行数据的数据字典异常事故告警处理。
可以看出，本实施例中，数据源服务器在接收来自分布式业务服务器的业务运行数据之后；对接收到的所述业务运行数据进行本地化入库；并监控本地化入库所述业务运行数据的入库质量指标；向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
本发明实施例方案例如可应用于业务运行大数据的入库监控，例如可应用于游戏运行大数据的入库监控。
下面通过一个具体的游戏应用场景为例进行举例介绍。
某一个游戏的多个分布式的互联网数据中心(IDC，Internet Data Center)网络节点中的分布式游戏服务器和数据源服务器可交互游戏运行数据。数据源服务器对游戏运行数据的入库进行相关监控，数据源服务器对接收到的游戏运行数据进行本地化入库；监控本地化入库游戏运行数据的入库质量指标；若入库质量指标符合预设的入库质量异常告警条件，则执行游戏运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行游戏运行数据入库质量异常事故告警处理。
下面简单介绍一下分布式网络游戏的数据源服务器的特点：
游戏大数据的数据源服务器可以部署分布在各个主要网络IDC节点，可基于网络IDC的分布式特点进行分布式部署。游戏大数据的数据源服务器与游戏服务器可在同一个网络IDC局域网络中就近部署，以防止跨网络可能带来的传输超时以及数据丢失风险。其中，游戏大数据的数据源服务器与游戏服务器分离部署，游戏服务器产生数据可以以异步的方式输入到就近的数据源服务器。游戏大数据的数据源服务器的种类可以多样。一般性的，可分为用于入库游戏帐号相关状态数据的数据源服务器、用于入库游戏付费收入数据的数据源服务器、用于入库游戏内玩家行为日志数据的数据源服务器等种类。游戏大数据的数据源服务器的数据存储介质是多样的，可以不是同一类型，存储介质例如是数据库和文件等。
游戏大数据的数据源服务器的元数据的数据地图中的IDC网络节点空间分布往往与游戏的运营相关。例如：新增网络游戏服务器大区就可以相应的增加与之就近的IDC的数据源服务器。同时，游戏服务器的大区的停止运营也可相应的下架与之就近的IDC的数据源服务器。类似的，对于游戏大数据的数据源服务器的元数据的数据字典中的数据表，数据表结构等数据协议变更空间分 布往往与游戏的运营相关。例如新增网络游戏版本，相关服务器大区可相应的增加与之就近的IDC的数据源服务器。同时，游戏服务器的大区的停止运营也会相应的下架与之就近的IDC的数据源服务器。其中，所述下架是指关闭游戏、不提供下载服务。
游戏大数据的数据源服务器的元数据的数据字典的数据内容版本与游戏服务器的版本的正式、测试、灰度、体验等分类特点相关。例如：灰度服务器的内容版本要高于正式服务器的内容版本。
互联网行业里网络游戏的大数据通常具有如下一下独有特点：
数据量大、数据实时产生、网络分布节点多(元数据的数据地图)、网络就近异步落地、数据协议的标准不统一(元数据的数据字典不统一)、数据存储介质多样(元数据的数据类型多样)、与游戏正常的运营紧密结合、数据内容分类多(如游戏状态数据(GAMEDB)、游戏日志数据(LOGDB)、支付数据等)。其中，所述落地指数据落地，落地后的数据即指被持久化的数据，这种数据一般放在硬盘或是其他的持久化存储设备里，例如：图片、系统日志、在页面上显示的数据以及保存在关系数据库里的数据等等，落地数据一定会有一个固定的载体，不会瞬时消失。
针对上面的分布式网络游戏的数据源服务器特点，目前，业界还没有统一的、标准化的、有效的监控方法。本发明实施例提出的方案可以应用于游戏分布式大数据的本地化入库监控，进而有利于尽量提高流转到集中大数据仓库的数据质量，提高其可用性和可靠性。
当然，其它大数据场景也可能具有类似特点。
为便于更好的实施本发明实施例的所述方案，下面还提供用于实施所述方案的相关装置。
参见图5-a，本发明实施例提供一种数据源服务器500，可以包括：
接收单元510、入库单元520、入库监控单元530和处理单元540。
接收单元510，用于接收来自分布式业务服务器的业务运行数据。
入库单元520，用于对接收到的所述业务运行数据进行本地化入库。
其中，入库监控单元530，用于监控本地化入库所述业务运行数据的入库 质量指标。
处理单元540，用于若入库监控单元530监控的入库质量指标符合预设的入库质量异常告警条件，执行业务运行数据入库质量异常事故告警处理；或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
在本发明的一些可能的实施方式中，入库监控单元530具体用于，监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。
在本发明的一些可能的实施方式中，接收单元510具体用于，接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
参见图5-b，在本发明的一些可能的实施方式中，数据源服务器500还可以包括：传输监控单元550，用于监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标。
其中，处理单元540还用于，若传输监控单元550监测的传输质量指标符合预设的传输质量异常告警条件，则执行业务运行数据传输质量异常事故告警处理；或，向所述数据监控中心服务器发送用于指示所述传输质量指标的传输质量指标数据，以便于所述数据监控中心服务器在确定所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件之后，则执行业务运行数据传输质量异常事故告警处理。
在本发明的一些可能的实施方式中，传输监控单元550可具体用于，监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。
可以理解的是，本实施例的数据源服务器500的各功能模块的功能可根据所述方法实施例中的方法具体实现，其具体实现过程可以参照所述方法实施例 的相关描述，此处不再赘述。
可以看出，本实施例中，数据源服务器500在接收来自分布式业务服务器的业务运行数据之后，对接收到的所述业务运行数据进行本地化入库；并监控本地化入库所述业务运行数据的入库质量指标；若入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
参见图6-a，本发明实施例提供一种数据监控中心服务器600可包括：
接收单元610和异常告警处理单元620。
接收单元610，用于接收来自第一数据源服务器的入库质量指标数据。
异常告警处理单元620，用于若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。
在本发明的一些可能的实施方式中，所述入库质量指标包括数据本地化入库完整度和/或数据本地化入库准确率。
在本发明的一些可能的实施方式中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，接收单元610还用于，接收来自第一数据源服务器的传输质量指标数据；
异常告警处理单元620还用于，若所述入库质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件，执行业务运行数据传输质量异常事 故告警处理，其中，所述传输质量指标由所述第一数据源服务器监控网络传输所述分布式业务服务器发送的所述业务运行数据而得到。
在本发明的一些可能的实施方式中，所述传输质量指标包括传输时延和/或丢包率。
参见图6-b，在本发明的一些可能的实施方式中，所述数据监控中心服务器600还可包括：监控单元630和确定单元640。
监控单元630，用于监控数据字典管理平台发布的数据字典变更事件；
确定单元640，用于根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。
在本发明的一些可能的实施方式中，所述入库质量指标数据中携带有入库时间戳。异常告警处理单元620还用于，若所述确定单元确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若所述确定单元确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，执行业务运行数据的数据字典异常事故告警处理。
可以理解的是，本实施例的数据监控中心服务器600的各功能模块的功能可根据所述方法实施例中的方法具体实现，其具体实现过程可以参照所述方法实施例的相关描述，此处不再赘述。
可以看出，本实施例中，数据监控中心服务器600接收来自第一数据源服务器的入库质量指标数据；若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并向数据监控中心服务器上报指示的入库质量指标的入库质量指标数据，而数据监控中心服务器可在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
参见图7，图7是本发明另一实施例提供的数据源服务器700的结构框图。
其中，数据源服务器700可以包括：至少一个处理器701，至少一个网络接口704或者其他用户接口703，存储器705，至少一个通信总线702。通信总线702用于实现这些组件之间的连接通信。其中，该数据源服务器700可选的包含用户接口703，包括：显示器(例如，触摸屏、LCD、CRT、全息成像(Holographic)或者投影(Projector)等)、点击设备(例如，鼠标，轨迹球(trackball)触感板或触摸屏等)、摄像头和/或拾音装置等。
其中，存储器702可以包括只读存储器和随机存取存储器，并向处理器701提供指令和数据。存储器702中的一部分还可以包括非易失性随机存取存储器等等。
在一些实施方式中，存储器705存储了如下的元素，可执行模块或者数据结构，或者他们的子集，或者他们的扩展集：
操作系统7051，包含各种系统程序，用于实现各种基础业务以及处理基于硬件的任务；
应用程序模块7052，包含各种应用程序，用于实现各种应用业务。
应用程序模块7052中包括但不限于接收单元510、入库单元520、入库监控单元530、处理单元540和/或传输监控单元550等。
在本发明的一些实施例中，通过调用存储器705存储的程序或指令，处理器701接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
其中，在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本 的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
在本发明的一些可能的实施方式中，所述监控本地化入库的所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
其中，处理器701可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，处理器701可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启数据源服务器700、重启业务运行数据入库应用和/或重装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设处理器701接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设处理器701入库了95条业务运行数据，其中正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可 以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，处理器701监控业务运行数据入库的方法还可包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标；其中，若所述传输质量指标符合预设的传输质量异常告警条件，则执行业务运行数据传输质量异常事故告警处理；或，向所述数据监控中心服务器发送用于指示所述传输质量指标的传输质量指标数据，以便于所述数据监控中心服务器在确定所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件之后，则可以执行业务运行数据传输质量异常事故告警处理。
在本发明的一些可能的实施方式中，处理器701监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标可包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒 或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，业务运行数据传输质量异常事故告警处理，可以包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重配置分布式业务服务器和数据源服务器700的路由路径，和/或重建分布式业务服务器和数据源服务器700的数据传输通道等等。
在本发明一些可能的实施方式中，所述入库质量指标数据中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据监控中心服务器可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据监控中心服务器若确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据监控中心服务器可执行业务运行数据的数据字典异常事故告警处理。
可以看出，本实施例中，数据源服务器700在接收来自分布式业务服务器的业务运行数据之后；对接收到的所述业务运行数据进行本地化入库；并监控本地化入库所述业务运行数据的入库质量指标；若入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并根据数据入库质量指标执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
参见图8，图8是本发明另一实施例提供的数据监控中心服务器800的结构框图。
其中，数据监控中心服务器800可以包括：至少一个处理器801，至少一个 网络接口804或者其他用户接口803，存储器805，至少一个通信总线802。通信总线802用于实现这些组件之间的连接通信。其中，该数据监控中心服务器800可选的包含用户接口803，包括：显示器(例如，触摸屏、LCD、CRT、全息成像(Holographic)或者投影(Projector)等)、点击设备(例如，鼠标，轨迹球(trackball)触感板或触摸屏等)、摄像头和/或拾音装置等。
其中，存储器802可以包括只读存储器和随机存取存储器，并向处理器801提供指令和数据。存储器802中的一部分还可以包括非易失性随机存取存储器等等。
在一些实施方式中，存储器805存储了如下的元素，可执行模块或者数据结构，或者他们的子集，或者他们的扩展集：
操作系统8051，包含各种系统程序，用于实现各种基础业务以及处理基于硬件的任务；
应用程序模块8052，包含各种应用程序，用于实现各种应用业务。
应用程序模块8052中包括但不限于监控单元630、确定单元640、接收单元610和/或异常告警处理单元620等。
在本发明实施例中，通过调用存储器805存储的程序或指令，处理器801接收来自第一数据源服务器的入库质量指标数据；若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。
其中，第一数据源服务器可接收其管辖的多个分布式业务服务器的业务运行数据。可以理解的是，对于不同的业务场景，分布式业务服务器的产品名称可能各不相同，例如，对于游戏业务场景而言，分布式业务服务器即可称分布式游戏服务器，其它场景可以此类推。其中，第一数据源服务器可认为是网络中众多数据源服务器当中的任意一个。
在本发明一些可能的实施方式中，在数据监控中心服务器接收来自第一数据源服务器的入库质量指标数据之前，第一数据源服务器可接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监 控本地化入库所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据。
其中，在本发明的一些可能的实施方式中，每条业务运行数据中还可以携带时间戳(如发送时间戳、产生发送时间戳等)、用于描述该业务运行数据的数据内容类型的数据内容类型信息、用于描述该业务运行数据的数据内容版本的数据内容版本信息。当然，业务运行数据还可携带发送该业务运行数据的自分布式业务服务器的标识信息(如网际协议地址、设备标识等)，当然业务运行数据中也还可携带其它一些信息，此处不再一一举例。
在本发明的一些可能的实施方式中，第一数据源服务器可按照预设的入库协议(该预设的入库协议(可能涉及库表等)可以由数据监控中心服务器或大数据仓库或其它管理节点指定或下发给第一数据源服务器)对接收到的业务运行数据进行本地化入库。
在本发明的一些可能的实施方式中，第一数据源服务器监控本地化入库所述业务运行数据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。当然，也还可监控本地化入库所述业务运行数据的其它入库质量指标。
其中，第一数据源服务器可以针对不同数据内容版本下的不同数据内容类型的业务运行数据的本地化入库过程进行监控。
举例来说，在本发明的一些可能的实施方式中，第一数据源服务器接收来自分布式业务服务器的业务运行数据，包括：第一数据源服务器接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在时间维度上，第一数据源服务器可监控在每天之内、每小时之内或每10分钟之内或每分钟或每秒或每个其它时长之内，本地化入库业务运行数据的入库质量指标。
在本发明的一些可能的实施方式中，所述监控本地化入库所述业务运行数 据的入库质量指标，包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。其中，假设第一数据源服务器接收到100条业务运行数据，其中只入库了95条业务运行数据，则可得出对应的数据本地化入库完整度为95％，以此类推。假设第一数据源服务器入库了95条业务运行数据，其中，正确入库了94条业务运行数据，则可得出对应的数据本地化入库准确度为94/95，以此类推。
在本发明的一些可能的实施方式中，所述接收来自分布式业务服务器的业务运行数据，包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，业务运行数据入库质量异常事故告警处理可以包括：发出入库质量异常事故告警信号、生成入库质量异常事故告警日志、重启第一数据源服务器、重启业务运行数据入库应用和/或重装业务运行数据入库应用等等。
在本发明的一些可能的实施方式中，预设的入库质量异常告警条件例如可以包括：数据本地化入库完整度小于第一阈值和/或数据本地化入库准确率小于第二阈值。其中，第一阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。第二阈值例如可等于90％、92％、95％、98％、99％或其它的值或范围。
在本发明的一些可能的实施方式中，所述入库质量指标包括数据本地化入库完整度和/或数据本地化入库准确率。
在本发明的一些可能的实施方式中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
在本发明的一些可能的实施方式中，处理器801还可接收来自第一数据源服务器的传输质量指标数据；若所述入库质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件，执行业务运行数据传输质量异常事故告警处理，其中，所述传输质量指标由所述第一数据源服务器监控网络传输所述分布式业务服务器发送的所述业务运行数据而得到。
在本发明的一些可能的实施方式中，第一数据源服务器监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标，可包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。当然也还可监控网络传输所述分布式业务服务器发送的所述业务运行数据的其它传输质量指标。其中，业务运行数据的传输时延可根据该业务运行数据的生成时间戳和接收时间戳计算得到。业务运行数据的丢包率可根据业务运行数据的发送条数和接收条数计算得到。此外，每条业务运行数据中还可包含该业务运行数据的数据量、源地址、目的地址、数据内容类型信息和/或数据内容版本信息等等信息。
在本发明的一些可能的实施方式中，预设的传输质量异常告警条件例如可以包括：业务运行数据的传输时延大于第三阈值和/或业务运行数据的丢包率大于第四阈值。其中，第三阈值例如可等于0.1秒、1秒、2秒、3秒、5秒、8秒或其它的值或范围。第四阈值例如可等于10％、8％、5％、1％、0.5％、0.1％或其它的值或范围。
在本发明的一些可能的实施方式中，业务运行数据传输质量异常事故告警处理，可以包括：发出传输质量异常事故告警信号、生成传输质量异常事故告警日志、重配置分布式业务服务器和第一数据源服务器的路由路径，和/或重建分布式业务服务器和第一数据源服务器的数据传输通道等等。
在本发明一些可能的实施方式中，所述入库质量指标数据中还可携带有入库时间戳等时间信息。在本发明的一些可能的实施方式中，数据监控中心服务器可监控数据字典管理平台发布的数据字典变更事件；根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。进一步的，数据监控中心服务器若确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，则数据监控中心服务器可执行业务运行数据的数据字典异常事故告警处理。
可以看出，本实施例中，数据监控中心服务器800接收来自第一数据源服务器的入库质量指标数据；若所述入库质量指标数据所指示的入库质量指标符 合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述第一数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。由于数据源服务器监控本地化入库业务运行数据的过程以得到数据入库质量指标，并向数据监控中心服务器上报指示的入库质量指标的入库质量指标数据，而数据监控中心服务器可根据入库质量指标执行业务运行数据入库质量异常事故告警处理，这有利于提高本地化入库的业务运行数据的质量，进而有利于提高入库大数据仓库的业务运行数据的质量。
参见图9，本发明实施例还提供一种通信系统，可包括：
第一数据源服务器910和多个分布式业务服务器920；
其中，分布式业务服务器920，用于向所述第一数据源服务器发送业务运行数据；
第一数据源服务器910，用于接收来自分布式业务服务器910的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库的所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以便于所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
其中，本实施例的第一数据源服务器910可如所述实施例提及的任意一种数据源服务器，分布式业务服务器920可如所述实施例提及的任意一种分布式业务服务器。
参见图10，本发明实施例还提供一种通信系统，可包括：
数据监控中心服务器1010、第一数据源服务器1020和多个分布式业务服务器1030；
其中，分布式业务服务器1030，用于向第一数据源服务器1020发送业务运行数据；
第一数据源服务器1020，用于接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库的所述业务运行数据的入库质量指标；向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据。
数据监控中心服务器1010，用于在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
其中，本实施例的第一数据源服务器1020可如所述实施例提及的任意一种数据源服务器，分布式业务服务器1030可如所述实施例提及的任意一种分布式业务服务器，数据监控中心服务器1010可如所述实施例提及的任意一种数据监控中心服务器。
需要说明的是，对于前述的各方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本发明并不受所描述的动作顺序的限制，因为依据本发明，某些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本发明所必须的。
在所述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。
在本申请所提供的几个实施例中，应该理解到，所揭露的装置，可通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部 单元来实现本实施例方案的目的。
另外，在本发明各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。所述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可为个人计算机、服务器或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (24)

  1. 一种监控业务运行数据入库的方法，其特征在于，包括：
    数据源服务器接收来自分布式业务服务器的业务运行数据；
    对接收到的所述业务运行数据进行本地化入库；
    监控本地化入库所述业务运行数据的入库质量指标；
    若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以使所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
  2. 根据权利要求1所述的方法，其特征在于，所述监控本地化入库所述业务运行数据的入库质量指标包括：监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。
  3. 根据权利要求1所述的方法，其特征在于，所述接收来自分布式业务服务器的业务运行数据包括：接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
  4. 根据权利要求1至3任一项所述的方法，其特征在于，
    所述方法还包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标；其中，若所述传输质量指标符合预设的传输质量异常告警条件，则执行业务运行数据传输质量异常事故告警处理；或向所述数据监控中心服务器发送用于指示所述传输质量指标的传输质量指标数据，以便于所述数据监控中心服务器在确定所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件之后，则执行业务运行数据传输质量异常事故告警处理。
  5. 根据权利要求4所述的方法，其特征在于，
    所述监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标，包括：监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输时延和/或丢包率。
  6. 一种监控业务运行数据入库的方法，其特征在于，包括：
    数据监控中心服务器接收来自数据源服务器的入库质量指标数据；
    若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述数据源服务器通过监控本地化入库来自分布式业务服务器的业务运行数据而得到。
  7. 根据权利要求6所述的方法，其特征在于，所述入库质量指标包括数据本地化入库完整度和/或数据本地化入库准确率。
  8. 根据权利要求7所述的方法，其特征在于，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
  9. 根据权利要求6所述的方法，其特征在于，
    所述方法还包括：
    接收来自所述数据源服务器的传输质量指标数据；
    若所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件，执行业务运行数据传输质量异常事故告警处理，其中，所述传输质量指标由所述数据源服务器通过监控网络传输所述分布式业务服务器发送的所述业务运行数据而得到。
  10. 根据权利要求9所述的方法，其特征在于，所述传输质量指标包括传输时延和/或丢包率。
  11. 根据权利要求8所述的方法，其特征在于，
    所述方法还包括：
    监控数据字典管理平台发布的数据字典变更事件；
    根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。
  12. 根据权利要求11所述的方法，其特征在于，
    所述入库质量指标数据中携带有入库时间戳；
    若所述确定所述入库时间戳所属时段内最新的数据内容版本并非第一数据内容版本，和/或，若确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，执行业务运行数据的数据字典异常事故告警处理。
  13. 一种数据源服务器，其特征在于，包括：
    接收单元，用于接收来自分布式业务服务器的业务运行数据；
    入库单元，用于对接收到的所述业务运行数据进行本地化入库；
    入库监控单元，用于监控本地化入库所述业务运行数据的入库质量指标；
    处理单元，用于若所述入库监控单元监控的入库质量指标符合预设的入库质量异常告警条件，执行业务运行数据入库质量异常事故告警处理，或向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以使所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
  14. 根据权利要求13所述的数据源服务器，其特征在于，所述入库监控单元具体用于，监控本地化入库所述业务运行数据的数据本地化入库完整度和/或数据本地化入库准确率。
  15. 根据权利要求13所述的数据源服务器，其特征在于，所述接收单元具体用于，接收来自分布式业务服务器的与第一数据内容类型和第一数据内容版本对应的业务运行数据；其中，所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
  16. 根据权利要求12至15任一项所述的数据源服务器，其特征在于，
    所述数据源服务器还包括：
    传输监控单元，用于监控网络传输所述分布式业务服务器发送的所述业务运行数据的传输质量指标；
    其中，所述处理单元还用于，若所述传输监控单元监测的传输质量指标符合预设的传输质量异常告警条件，则执行业务运行数据传输质量异常事故告警处理，或，向所述数据监控中心服务器发送用于指示所述传输质量指标的传输 质量指标数据，以便于所述数据监控中心服务器在确定所述传输质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件之后，则执行业务运行数据传输质量异常事故告警处理。
  17. 一种数据监控中心服务器，其特征在于，包括：
    接收单元，用于接收来自数据源服务器的入库质量指标数据；
    异常告警处理单元，用于若所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理，其中，所述入库质量指标由所述数据源服务器监控本地化入库来自分布式业务服务器的业务运行数据而得到。
  18. 根据权利要求17所述的数据监控中心服务器，其特征在于，所述入库质量指标包括数据本地化入库完整度和/或数据本地化入库准确率。
  19. 根据权利要求17所述的数据监控中心服务器，其特征在于，
    所述入库质量指标为与第一数据内容类型和第一数据内容版本对应的入库质量指标。
  20. 根据权利要求17所述的数据监控中心服务器，其特征在于，
    所述接收单元还用于，接收来自所述数据源服务器的传输质量指标数据；
    异常告警处理单元还用于，若所述入库质量指标数据所指示的传输质量指标符合预设的传输质量异常告警条件，执行业务运行数据传输质量异常事故告警处理，其中，所述传输质量指标由所述数据源服务器监控网络传输所述分布式业务服务器发送的所述业务运行数据而得到。
  21. 根据权利要求19所述的数据监控中心服务器，其特征在于，
    所述数据监控中心服务器还包括：
    监控单元，用于监控数据字典管理平台发布的数据字典变更事件；
    确定单元，用于根据监控到的数据字典变更事件确定各时段最新的数据内容版本和数据内容类型。
  22. 根据权利要求21所述的数据监控中心服务器，其特征在于，
    所述入库质量指标数据中携带有入库时间戳；
    异常告警处理单元还用于，若所述确定单元确定所述入库时间戳所属时段 内最新的数据内容版本并非第一数据内容版本，和/或，若所述确定单元确定所述入库时间戳所属时段内最新的数据内容类型并非第一数据内容类型，执行业务运行数据的数据字典异常事故告警处理。
  23. 一种通信系统，其特征在于，包括：
    数据源服务器和多个分布式业务服务器；
    其中，所述分布式业务服务器，用于向所述数据源服务器发送业务运行数据；
    所述数据源服务器，用于接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；若所述入库质量指标符合预设的入库质量异常告警条件，则执行业务运行数据入库质量异常事故告警处理；或者，向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据，以使所述数据监控中心服务器在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
  24. 一种通信系统，其特征在于，包括：
    数据监控中心服务器、数据源服务器和多个分布式业务服务器；
    其中，所述分布式业务服务器，用于向所述数据源服务器发送业务运行数据；
    所述数据源服务器，用于接收来自分布式业务服务器的业务运行数据；对接收到的所述业务运行数据进行本地化入库；监控本地化入库所述业务运行数据的入库质量指标；向数据监控中心服务器发送用于指示所述入库质量指标的入库质量指标数据；
    所述数据监控中心服务器，用于在确定所述入库质量指标数据所指示的入库质量指标符合预设的入库质量异常告警条件之后，执行业务运行数据入库质量异常事故告警处理。
PCT/CN2015/072272 2013-12-18 2015-02-05 监控业务运行数据入库的方法和相关设备及系统 WO2015090241A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310699871.2 2013-12-18
CN201310699871.2A CN104133829B (zh) 2013-12-18 2013-12-18 监控业务运行数据入库的方法和相关设备及系统

Publications (1)

Publication Number Publication Date
WO2015090241A1 true WO2015090241A1 (zh) 2015-06-25

Family

ID=51806507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/072272 WO2015090241A1 (zh) 2013-12-18 2015-02-05 监控业务运行数据入库的方法和相关设备及系统

Country Status (3)

Country Link
CN (1) CN104133829B (zh)
TW (1) TW201525714A (zh)
WO (1) WO2015090241A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110457175A (zh) * 2019-07-08 2019-11-15 阿里巴巴集团控股有限公司 业务数据处理方法、装置、电子设备及介质
CN112396349A (zh) * 2020-12-07 2021-02-23 国网物资有限公司 一种基于业务实体的数据质量监控方法
CN114465871A (zh) * 2021-12-20 2022-05-10 中盈优创资讯科技有限公司 一种5g告警处理系统镜像化分布式上云实现方法及装置
CN116383083A (zh) * 2023-04-23 2023-07-04 中航信移动科技有限公司 基于多接口连接的异常数据源确定方法及存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104133829B (zh) * 2013-12-18 2016-02-17 腾讯科技（深圳）有限公司 监控业务运行数据入库的方法和相关设备及系统
CN104135395B (zh) * 2014-03-10 2015-12-30 腾讯科技（深圳）有限公司 Idc网络中数据传输质量监控方法和系统
CN105069065A (zh) * 2015-07-29 2015-11-18 浪潮(北京)电子信息产业有限公司 一种文件监控方法及系统
CN109753401A (zh) * 2017-11-03 2019-05-14 中国电信股份有限公司 监控方法、采集端、管控端、监控系统及装置
CN109039819B (zh) * 2018-08-16 2019-12-17 深圳华锐金融技术股份有限公司 时延统计方法、装置、系统及存储介质
CN109542875B (zh) * 2018-11-20 2021-09-24 中国银行股份有限公司 一种配置文件的生成方法及装置
CN113626417A (zh) 2020-05-08 2021-11-09 台达电子工业股份有限公司 数据齐备度分析系统和数据齐备度分析方法
TWI781400B (zh) * 2020-05-08 2022-10-21 台達電子工業股份有限公司 資料齊備度分析系統和資料齊備度分析方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072123A (zh) * 2007-04-30 2007-11-14 张宇飞 服务器实时监控智能报警系统及其运行方法
US20100277307A1 (en) * 2009-05-01 2010-11-04 Cathy Horton Municipal Operations Monitoring and Alert System
CN101989283A (zh) * 2009-08-04 2011-03-23 中兴通讯股份有限公司 一种数据库性能的监控方法和装置
CN104133829A (zh) * 2013-12-18 2014-11-05 腾讯科技（深圳）有限公司 监控业务运行数据入库的方法和相关设备及系统

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101009582B (zh) * 2006-01-24 2012-05-09 电信科学技术仪表研究所 基于2m数据电路传输质量实时在线监测的方法与装置
CN101446914B (zh) * 2007-11-26 2011-01-19 阿里巴巴集团控股有限公司 一种数据库监控方法及装置
CN101478423A (zh) * 2008-12-12 2009-07-08 北京邮电大学 一种基于数据库的无刷新告警自动监测技术
CN102332035B (zh) * 2011-07-26 2013-05-15 昆明理工大学 一种在线状态监测系统的数据存储与处理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072123A (zh) * 2007-04-30 2007-11-14 张宇飞 服务器实时监控智能报警系统及其运行方法
US20100277307A1 (en) * 2009-05-01 2010-11-04 Cathy Horton Municipal Operations Monitoring and Alert System
CN101989283A (zh) * 2009-08-04 2011-03-23 中兴通讯股份有限公司 一种数据库性能的监控方法和装置
CN104133829A (zh) * 2013-12-18 2014-11-05 腾讯科技（深圳）有限公司 监控业务运行数据入库的方法和相关设备及系统

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110457175A (zh) * 2019-07-08 2019-11-15 阿里巴巴集团控股有限公司 业务数据处理方法、装置、电子设备及介质
CN112396349A (zh) * 2020-12-07 2021-02-23 国网物资有限公司 一种基于业务实体的数据质量监控方法
CN114465871A (zh) * 2021-12-20 2022-05-10 中盈优创资讯科技有限公司 一种5g告警处理系统镜像化分布式上云实现方法及装置
CN116383083A (zh) * 2023-04-23 2023-07-04 中航信移动科技有限公司 基于多接口连接的异常数据源确定方法及存储介质
CN116383083B (zh) * 2023-04-23 2024-01-12 中航信移动科技有限公司 基于多接口连接的异常数据源确定方法及存储介质

Also Published As

Publication number Publication date
CN104133829B (zh) 2016-02-17
CN104133829A (zh) 2014-11-05
TW201525714A (zh) 2015-07-01

Similar Documents

Publication Publication Date Title
WO2015090241A1 (zh) 监控业务运行数据入库的方法和相关设备及系统
US9747093B2 (en) Device driver aggregation in operating system deployment
US9369521B2 (en) Naming of distributed business transactions
CN103377077B (zh) 通过诱发延时来评估分布式计算服务的弹性的方法和系统
CN104657250A (zh) 一种对云主机进行性能监控的监控方法
US20160283352A1 (en) Virtualization of purpose-built devices
WO2017131774A1 (en) Log event summarization for distributed server system
JP6692000B2 (ja) リスク識別方法、リスク識別装置、クラウドリスク識別装置及びシステム
CN106815254B (zh) 一种数据处理方法和装置
CN105404581B (zh) 一种数据库的评测方法和装置
US10445167B1 (en) Automated method and system for diagnosing load performance issues
US20110172963A1 (en) Methods and Apparatus for Predicting the Performance of a Multi-Tier Computer Software System
CN107770161B (zh) 一种直播平台中防止刷礼物的方法及装置
KR102469441B1 (ko) 가상 게이트웨이 클러스터 전역 장애에 대한 모니터링 방법 및 장치
CN112737800A (zh) 服务节点故障定位方法、调用链生成方法及服务器
Xia et al. Adopting cloud computing to optimize spatial web portals for better performance to support Digital Earth and other global geospatial initiatives
TW201824018A (zh) 即時資料處理方法和裝置
US10282239B2 (en) Monitoring method
EP3329407A1 (en) Application centric network experience monitoring
US20180121329A1 (en) Uninstrumented code discovery
CN106790339A (zh) 元数据服务器、网络装置及自动资源管理方法
TWI579691B (zh) Method and System of IDC Computer Room Entity and Virtual Host Integration Management
CN104951391A (zh) 用于监视用户交互模式的方法、服务器以及代理
CN109766238B (zh) 基于session数的运维平台性能监控方法、装置及相关设备
US20160014010A1 (en) Performance Monitoring with Reduced Transmission of Information

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15729735

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 21.11.2016)

122 Ep: pct application non-entry in european phase

Ref document number: 15729735

Country of ref document: EP

Kind code of ref document: A1