CN113760628A - Method and device for monitoring data processing - Google Patents

Method and device for monitoring data processing Download PDF

Info

Publication number
CN113760628A
CN113760628A CN202010504966.4A CN202010504966A CN113760628A CN 113760628 A CN113760628 A CN 113760628A CN 202010504966 A CN202010504966 A CN 202010504966A CN 113760628 A CN113760628 A CN 113760628A
Authority
CN
China
Prior art keywords
data
time
service system
service
synchronization
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010504966.4A
Other languages
Chinese (zh)
Inventor
李政
邹德柱
王丹丹
戚依楠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Shangke Information Technology Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Original Assignee
Beijing Jingdong Shangke Information Technology Co Ltd
Beijing Wodong Tianjun Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Shangke Information Technology Co Ltd, Beijing Wodong Tianjun Information Technology Co Ltd filed Critical Beijing Jingdong Shangke Information Technology Co Ltd
Priority to CN202010504966.4A priority Critical patent/CN113760628A/en
Publication of CN113760628A publication Critical patent/CN113760628A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3051Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/32Monitoring with visual or acoustical indication of the functioning of the machine
    • G06F11/324Display of status information
    • G06F11/327Alarm or error message display

Abstract

The embodiment of the disclosure discloses a method and a device for monitoring data processing. One embodiment of the method comprises: acquiring preconfigured monitoring point information, wherein the monitoring point information comprises checking time, a contact way and a service system interface; in response to receiving the state synchronization message, recording a latest production time of the data in a data synchronization state table; in response to detecting that the current time reaches the check time, checking whether the latest production time is consistent with the current time; if not, alarm information is sent according to the contact way, and a service system is informed to carry out fault processing through a service system interface. The implementation mode monitors, alarms and automatically processes the timeliness of data from the service perspective, and when the specific data cannot be synchronized in time, alarms are given to all service system responsible persons, and related service systems are notified, so that the service systems can automatically execute a self-defined fault coping plan, and the service loss is reduced to the minimum.

Description

Method and device for monitoring data processing
Technical Field
The embodiment of the disclosure relates to the technical field of computers, in particular to a method and a device for monitoring data processing.
Background
For data decision-making type, data billboard type or execution type application depending on bottom layer big data, all the dependent service data are synchronized to foreground application after being offline calculated by a rear-end big data platform, so that whether the data can be timely synchronized according to time convention is crucial to the applications.
The monitoring of the timeliness of the service data is mainly processed by a big data computing platform at the rear end, the execution time length of a specific data computing task script is monitored in the big data computing platform, when the execution time length exceeds a limited time, a mail or a short message is sent to a responsible person of the task script for alarming, and the responsible person carries out fault processing after receiving the alarm.
In the prior art, data timeliness is monitored from the perspective of big data calculation tasks, but service data generated by the calculation tasks may be used by a plurality of service systems, the service systems correspond to different responsible persons and service forms, and different service forms define a plurality of important levels and data missing fault processing plans for different types of data.
When some data appears and the foreground application cannot be synchronized in time, the data script responsible person receiving the alarm cannot know which service systems using the data, cannot inform the service application responsible person in time and cannot evaluate the service influence. Meanwhile, the service system affected by the data loss cannot respond in time.
Disclosure of Invention
The embodiment of the disclosure provides a method and a device for monitoring data processing.
In a first aspect, an embodiment of the present disclosure provides a method for monitoring data processing, including: acquiring preconfigured monitoring point information, wherein the monitoring point information comprises checking time, a contact way and a service system interface; in response to receiving the state synchronization message, recording a latest production time of the data in a data synchronization state table; in response to detecting that the current time reaches the check time, checking whether the latest production time is consistent with the current time; if not, alarm information is sent according to the contact way, and a service system is informed to carry out fault processing through a service system interface.
In some embodiments, the monitoring point information further comprises: recheck the time interval; and the method further comprises: and if not, re-checking whether the latest production time in the data synchronization state table is consistent with the current time or not according to the re-checking time interval.
In some embodiments, the method further comprises: if the rechecking result is consistent, the synchronized information is sent according to the contact way, and the service system is informed to carry out recovery processing through the service system interface.
In some embodiments, the monitoring point information further comprises at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and sending alarm information according to the contact information comprises: generating alarm information according to at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and sending the generated alarm information according to the contact information.
In some embodiments, the check time is a periodic time.
In some embodiments, the fault handles at least one of: data display degradation, function degradation and data missing announcement issuing.
In a second aspect, an embodiment of the present disclosure provides an apparatus for monitoring data processing, including: the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire preconfigured monitoring point information, and the monitoring point information comprises check time, contact information and a service system interface; a recording unit configured to record a latest production time of the data in the data synchronization status table in response to receiving the status synchronization message; a checking unit configured to check whether the latest production time coincides with a current time in response to detecting that the current time reaches a checking time; and the notification unit is configured to send alarm information according to the contact information if the contact information is inconsistent with the fault information, and notify the service system of fault treatment through the service system interface.
In some embodiments, the monitoring point information further comprises: recheck the time interval; and the checking unit is further configured to: and if not, re-checking whether the latest production time in the data synchronization state table is consistent with the current time or not according to the re-checking time interval.
In some embodiments, the notification unit is further configured to: if the rechecking result is consistent, the synchronized information is sent according to the contact way, and the service system is informed to carry out recovery processing through the service system interface.
In some embodiments, the monitoring point information further comprises at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and the notification unit is further configured to: generating alarm information according to at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and sending the generated alarm information according to the contact information.
In some embodiments, the check time is a periodic time.
In some embodiments, the fault handles at least one of: data display degradation, function degradation and data missing announcement issuing.
In a third aspect, an embodiment of the present disclosure provides an electronic device for monitoring data processing, including: one or more processors; a storage device having one or more programs stored thereon which, when executed by one or more processors, cause the one or more processors to implement a method as in any one of the first aspects.
In a fourth aspect, embodiments of the disclosure provide a computer readable medium having a computer program stored thereon, wherein the program when executed by a processor implements a method as in any one of the first aspect.
The method and the device for monitoring data processing provided by the embodiment of the disclosure can report the data timeliness abnormity to the service responsible person at the first time from the perspective of the service system, and directly give the influence range, the processing plan and the emergency degree evaluation of the abnormity, so that the service responsible person can conveniently and timely placate the service terminal user, and the communication cost and the service loss are reduced. The data timeliness abnormity is directly notified to the service system in an interface mode, the execution of an abnormity processing plan is automatically completed, the user experience is enhanced, and the fault loss is reduced. The data production state is directly synchronized with an external monitoring system from a big data platform, and the correctness and timeliness of state data are ensured
Drawings
Other features, objects and advantages of the disclosure will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 is an exemplary system architecture diagram in which one embodiment of the present disclosure may be applied;
FIG. 2 is a flow diagram of one embodiment of a method for monitoring data processing according to the present disclosure;
3a, 3b are schematic diagrams of a process flow of a method for monitoring data processing according to the present disclosure;
FIG. 4 is a flow diagram of yet another embodiment of a method for monitoring data processing according to the present disclosure;
FIG. 5 is a schematic block diagram illustrating one embodiment of an apparatus for monitoring data processing according to the present disclosure;
FIG. 6 is a schematic block diagram of a computer system suitable for use with an electronic device implementing embodiments of the present disclosure.
Detailed Description
The present disclosure is described in further detail below with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that, in the present disclosure, the embodiments and features of the embodiments may be combined with each other without conflict. The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Exemplary System architecture to which embodiments of the disclosed method for monitoring data processing or apparatus for monitoring data processing apply.
As shown in fig. 1, the system architecture includes a big data platform 101, a monitoring server 102, and a business server 103. The big data platform 101, the monitoring server 102 and the business server 103 are connected through a wired network or a wireless network.
The big data platform 101 executes data analysis and calculation tasks, generates business data, and writes the business data into a data warehouse. The data synchronization service running on the big data platform 101 synchronizes the business data to the business application database of the business server 103. After the synchronization is successful, the data synchronization service sends a status synchronization message to the monitoring server 102, and the monitoring server 102 writes the data synchronization status data into the monitoring system database. The data monitoring service running on the monitoring server 102 verifies the timeliness of the service data according to the monitoring point information input by the service responsible person, and when the specific data does not reach the service application database according to the requirements set by the service responsible person, the monitoring server 102 simultaneously alarms the service responsible person and the service system, which is a processing logic executed by the service system in a preset data missing scene, such as data display or function degradation, data missing announcement and the like. At the moment, the service responsible person can also execute other fault plans and pacify the user in time.
It should be noted that the method for monitoring data processing provided by the embodiment of the present disclosure is generally performed by the monitoring server 102, and accordingly, the apparatus for monitoring data processing is generally disposed in the monitoring server 102.
It should be understood that the number of large data platforms, monitoring servers, business servers in fig. 1 is merely illustrative. Any number of big data platforms, monitoring servers and service servers can be provided according to the implementation requirements.
With continued reference to FIG. 2, a flow 200 of one embodiment of a method for monitoring data processing in accordance with the present disclosure is shown. The method for monitoring data processing comprises the following steps:
step 201, obtaining preconfigured monitoring point information.
In this embodiment, an execution main body (for example, the monitoring server shown in fig. 1) of the method for monitoring data processing may be managed by each service principal, the service principal configures the monitoring point information according to the dependence of the service system in charge of the service principal on the production data of the big data platform, and the monitoring point information is subsequently synchronized to the data monitoring service as a basis for monitoring the execution logic. An alternative data structure of the monitoring point information table is as follows, wherein check time, contact means, service system interface are optional. The check time can be set by three fields of push _ frequency, check _ day, and check _ time. The contact way can be the mobile phone number, the mailbox, the WeChat and the like of the service loader and is set through the manager and the partitions fields. The traffic system interface is specified by the check url field.
Figure BDA0002526206330000051
TABLE 1
Description of the meaning of each field:
■ system _ code: the system code to which the monitoring point belongs, and the related system information data structure is as follows:
serial number Name of field Type (B) Can be emptied Description of the invention Remarks for note
1 id bigint Whether or not Main key
2 system_code varchar(100) Whether or not System coding
3 system_name varchar(100) Whether or not Name of system
5 manaaer varchar(20) Whether or not Person in charge of business system
6 participants varchar(500) Is that Business system participant
7 opr_time datetime Is that Creation time
8 opr_user varchar(20) Is that Creators
TABLE 2
The data structure mainly records the responsible persons and the participators of each business system, and when the alarm needs to be given, the monitoring system can read contact ways such as a person mobile phone number, a mailbox and the like from the human resource system according to the account numbers of the responsible persons and the participators to send alarm information.
■ table _ name: business data table name needing monitoring
■ push _ frequency: recording the synchronous frequency of the data table service data
■ check _ day: specifying a specific data check date in the above-mentioned synchronization frequency cycle
■ check _ time: specifying a specific examination time point in the above examination date to the nearest minute
■ check step: time interval of next inspection after failure of inspection of monitoring point
■ level: the monitoring point monitors the importance level of the data
■ influece: description of influence range on service when monitoring data of monitoring point is missing
■ plan: the monitoring point monitors the content of the plan which needs to be executed by the service responsible person when the data is missing
■ check _ url: interface address for service system receiving data missing alarm or data missing recovery notice
■ warming _ switch: the alarm switch is turned off and does not send out alarm information
The only identification code of the monitoring point data is as follows: the design ensures that the system supports the same service data model corresponding to a plurality of service systems, and the same data model can support the requirements of a plurality of push cycles.
In response to receiving the status synchronization message, the latest production time of the data is recorded in the data synchronization status table, step 202.
In this embodiment, the business data is produced by the data analysis and calculation task in the big data platform, and after completion, the data is synchronized to the business application database by the data synchronization task. After the data synchronization is successful, the data synchronization task needs to write the synchronization state of the data into the database of the monitoring system, and the data structure of the data synchronization state table can be the following structure, wherein dt is the latest production time and is a must:
serial number Name of field Type (B) Can be emptied Description of the invention Remarks for note
1 id biaint Whether or not Main key
2 system_code varchar(50) Whether or not System coding Data sheet belonging system, associated system information sheet
3 table_name varchar(20) Whether or not Data table names
4 push_frequency tinyint Whether or not Push frequency 1: day 2: week 3: 4, 15 days: moon cake5: and 6, quarter: year of year
4 dt varchar(20) Whether or not Current account period of data
5 mtime datatime Is that Actual push time of data
TABLE 3
Description of the meaning of each field:
■ system _ code: coding of system to which data table belongs
■ table _ name: business data table name
■ push _ frequency: it is described which push cycle of the current traffic table the state is. This field exists because there are cases where there are multiple synchronization periods for a table in a service system
■ dt: when the current latest actual production time mark of the business data is synchronized once per month, for example, the field value of the state synchronization data of 10 months in 2019 is as follows: 2019-10
■ mtime: the actual synchronization completion time of the current latest data of the business table is accurate to seconds.
Step 203, in response to detecting that the current time reaches the check time, checking whether the latest production time is consistent with the current time.
In the present embodiment, assuming that the data is synchronized every day, the synchronization time point is 13 points, the settable check time is 13 points per day check, which is 5/29/2020, and when 13 points are reached, it is checked whether the value of dt in the data synchronization state table is 5/29/2020, and if so, the latest production time coincides with the current time. If the synchronization period is day, then the accuracy of the latest production time is day, as is the accuracy of the current time. If the synchronization period is weekly, the accuracy of the latest production time is weekly, and the accuracy of the current time is also weekly. Similarly, the synchronization can be performed according to the month or year.
And step 204, if the information is inconsistent, sending alarm information according to the contact information, and informing the service system of carrying out fault processing through the service system interface.
In this embodiment, the data monitoring service monitors the data synchronization state according to the monitoring point information set by the service responsible person, and sends alarm information to the service responsible person when the data is not synchronized in time (that is, the latest production time is inconsistent with the current time), where the alarm information includes: system name, table name, synchronization-required time point (i.e. check time), data importance level, synchronization failure influence range, synchronization failure processing plan, etc. The data importance level, the synchronization failure influence range and the synchronization failure processing plan are set through level, influence and plan fields in the table 1.
Meanwhile, the monitoring server will automatically call a fault handling interface (check _ url field in table 1) provided by the service system, and the interface parameters are:
1. system coding
2. Table name
3. Synchronous frequency period of data
4. Should synchronize the time points
5. Current data State (Normal or abnormal)
The service system performs customized service processing logic such as data degradation, data missing announcement and the like according to the parameters, and the monitoring server can also call the service side providing interface again by using the parameters after fault recovery, except that the current data state parameters are changed into a normal state, so that the service system executes fault recovery logic processing.
FIG. 3a is a flow chart of data production and data state synchronization work in a big data platform.
As shown in FIG. 3a, the failure of the big data platform in each step of data production, data synchronization and state synchronization is monitored and handled by the internal processing mechanism of the big data platform. Whether the process is successfully completed or not can be reflected in the data synchronization state table, after all processing of the big data platform is successfully completed, the state of the data table of the corresponding system in the data state table is updated to be the latest state data, if any node in the big data platform fails, the latest synchronization time of the data table of the corresponding system in the data synchronization state table does not change, and the alarm is given to the data synchronization state table until the data inspection time set by the service responsible person is reached so as to perform subsequent exception processing.
By combining the data synchronization state table data and the data state synchronization process, monitoring and alarming can be performed on the monitoring point information configured by the service responsible person, and the processing flow is shown in fig. 3 b. The data monitoring service monitors the data synchronization state according to the monitoring point set by the service responsible person, and sends alarm information to the service responsible person when the data is not synchronized in time, wherein the alarm information comprises: system name, table name, synchronization-required time point, data emergency degree grading, fault influence range, coping plan content and the like.
With further reference to FIG. 4, a flow 400 of yet another embodiment of a method for monitoring data processing is shown. The flow 400 of the method for monitoring data processing includes the steps of:
step 401, obtaining preconfigured monitoring point information.
In response to receiving the status synchronization message, a latest production time of the data is recorded in a data synchronization status table, step 402.
In response to detecting that the current time reaches the check time, it is checked whether the latest production time coincides with the current time, step 403.
And step 404, if the information is inconsistent, sending alarm information according to the contact information, and informing the service system to perform fault processing through the service system interface.
The steps 401 and 404 are substantially the same as the steps 201 and 204, and therefore, the description thereof is omitted.
Step 405, according to the recheck time interval, recheck whether the latest production time in the data synchronization status table is consistent with the current time.
In this embodiment, the check step field in table 1 sets the recheck interval. If a lack of synchronization is detected at a check time of a specified period, the check may be performed again at intervals (e.g., 60 seconds). Instead of waiting for the next day, the next month, etc.
And step 406, if the rechecking result is consistent, sending the synchronized information according to the contact way, and notifying the service system to perform recovery processing through the service system interface.
In this embodiment, if the data is checked to be synchronized, the service person in charge and the process when the service system is restored to the synchronized state can be notified at the same time.
As can be seen from fig. 4, compared to the embodiment corresponding to fig. 2, the flow 400 of the method for monitoring data processing in the present embodiment represents the step of rechecking synchronization. Therefore, the scheme described in the embodiment can detect the recovery of synchronization in time, so as to reduce the influence caused by out-of-synchronization.
With further reference to fig. 5, as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of an apparatus for monitoring data processing, which corresponds to the method embodiment shown in fig. 2, and which is particularly applicable to various electronic devices.
As shown in fig. 5, the apparatus 500 for monitoring data processing of the present embodiment includes: an acquisition unit 501, a recording unit 502, a checking unit 503, and a notification unit 504. The acquiring unit 501 is configured to acquire preconfigured monitoring point information, where the monitoring point information includes check time, a contact information, and a service system interface; a recording unit 502 configured to record a latest production time of the data in the data synchronization status table in response to receiving the status synchronization message; a checking unit 503 configured to check whether the latest production time coincides with the current time in response to detecting that the current time reaches the check time; and the notification unit 504 is configured to send alarm information according to the contact information if the information is inconsistent with the contact information, and notify the service system of performing fault processing through the service system interface.
In this embodiment, specific processes of the obtaining unit 501, the recording unit 502, the checking unit 503 and the notifying unit 504 of the apparatus 500 for monitoring data processing may refer to step 201, step 202, step 203 and step 204 in the corresponding embodiment of fig. 2.
In some optional implementations of this embodiment, the monitoring point information further includes: recheck the time interval; and the checking unit 503 is further configured to: and if not, re-checking whether the latest production time in the data synchronization state table is consistent with the current time or not according to the re-checking time interval.
In some optional implementations of this embodiment, the notification unit 504 is further configured to: if the rechecking result is consistent, the synchronized information is sent according to the contact way, and the service system is informed to carry out recovery processing through the service system interface.
In some optional implementations of this embodiment, the monitoring point information further includes at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and the notification unit 504 is further configured to: generating alarm information according to at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and sending the generated alarm information according to the contact information.
In some optional implementations of this embodiment, the check time is a periodic time.
In some optional implementations of this embodiment, the fault handling at least one of: data display degradation, function degradation and data missing announcement issuing.
Referring now to FIG. 6, a schematic diagram of an electronic device (e.g., the monitoring server of FIG. 1) 600 suitable for use in implementing embodiments of the present disclosure is shown. The monitoring server shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, electronic device 600 may include a processing means (e.g., central processing unit, graphics processor, etc.) 601 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM603, various programs and data necessary for the operation of the electronic apparatus 600 are also stored. The processing device 601, the ROM 602, and the RAM603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.
Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 600 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 6 may represent one device or may represent multiple devices as desired.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 609, or may be installed from the storage means 608, or may be installed from the ROM 602. The computer program, when executed by the processing device 601, performs the above-described functions defined in the methods of embodiments of the present disclosure. It should be noted that the computer readable medium described in the embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In embodiments of the present disclosure, however, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring preconfigured monitoring point information, wherein the monitoring point information comprises checking time, a contact way and a service system interface; in response to receiving the state synchronization message, recording a latest production time of the data in a data synchronization state table; in response to detecting that the current time reaches the check time, checking whether the latest production time is consistent with the current time; if not, alarm information is sent according to the contact way, and a service system is informed to carry out fault processing through a service system interface.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. The described units may also be provided in a processor, and may be described as: a processor includes an acquisition unit, a recording unit, a checking unit, and a notification unit. The names of these units do not in some cases constitute a limitation on the unit itself, and for example, the acquisition unit may also be described as a "unit that acquires preconfigured monitoring point information".
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is possible without departing from the inventive concept. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Claims (10)

1. A method for monitoring data processing, comprising:
acquiring preconfigured monitoring point information, wherein the monitoring point information comprises check time, a contact way and a service system interface;
in response to receiving the state synchronization message, recording a latest production time of the data in a data synchronization state table;
in response to detecting that the current time reaches the check time, checking whether the latest production time is consistent with the current time;
if not, alarm information is sent according to the contact information, and a service system is notified to carry out fault processing through the service system interface.
2. The method of claim 1, wherein the monitoring point information further comprises: recheck the time interval; and
the method further comprises the following steps:
and if not, re-checking whether the latest production time in the data synchronization state table is consistent with the current time or not according to the re-checking time interval.
3. The method of claim 2, further comprising:
if the rechecking result is consistent, the synchronized information is sent according to the contact way, and the service system is informed to carry out recovery processing through the service system interface.
4. The method of claim 1, the monitoring point information further comprising at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan; and
the sending alarm information according to the contact information comprises the following steps:
generating alarm information according to at least one of: data importance level, synchronization failure influence range and synchronization failure processing plan;
and sending the generated alarm information according to the contact information.
5. The method of any of claims 1-4, wherein the check time is a periodic time.
6. The method according to any one of claims 1-4, wherein the fault handles at least one of: data display degradation, function degradation and data missing announcement issuing.
7. An apparatus for monitoring data processing, comprising:
the system comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is configured to acquire preconfigured monitoring point information, and the monitoring point information comprises check time, contact information and a service system interface;
a recording unit configured to record a latest production time of the data in the data synchronization status table in response to receiving the status synchronization message;
a checking unit configured to check whether the latest production time coincides with a current time in response to detecting that the current time reaches the check time;
and the notification unit is configured to send alarm information according to the contact information and notify a service system to perform fault processing through the service system interface if the contact information is inconsistent with the contact information.
8. The apparatus of claim 7, wherein the monitoring point information further comprises: recheck the time interval; and
the checking unit is further configured to:
and if not, re-checking whether the latest production time in the data synchronization state table is consistent with the current time or not according to the re-checking time interval.
9. An electronic device for monitoring data processing, comprising:
one or more processors;
a storage device having one or more programs stored thereon,
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-6.
10. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of any one of claims 1-6.
CN202010504966.4A 2020-06-05 2020-06-05 Method and device for monitoring data processing Pending CN113760628A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010504966.4A CN113760628A (en) 2020-06-05 2020-06-05 Method and device for monitoring data processing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010504966.4A CN113760628A (en) 2020-06-05 2020-06-05 Method and device for monitoring data processing

Publications (1)

Publication Number Publication Date
CN113760628A true CN113760628A (en) 2021-12-07

Family

ID=78784932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010504966.4A Pending CN113760628A (en) 2020-06-05 2020-06-05 Method and device for monitoring data processing

Country Status (1)

Country Link
CN (1) CN113760628A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116401127A (en) * 2023-06-02 2023-07-07 梅州客商银行股份有限公司 Information system health state monitoring method and device and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116401127A (en) * 2023-06-02 2023-07-07 梅州客商银行股份有限公司 Information system health state monitoring method and device and electronic equipment
CN116401127B (en) * 2023-06-02 2023-10-31 梅州客商银行股份有限公司 Information system health state monitoring method and device and electronic equipment

Similar Documents

Publication Publication Date Title
US20180332162A1 (en) Mobile application for personal safety
US20160092944A1 (en) Proximity alerts for service resource availability
US9589454B2 (en) Method, apparatus and system for broadcasting an alarm for an alarm group
CN111931464A (en) Document editing method and device and electronic equipment
CN113760628A (en) Method and device for monitoring data processing
CN112860504A (en) Monitoring method and device, computer storage medium and electronic equipment
CN110737655B (en) Method and device for reporting data
CN110764838B (en) Service model loading method and system, electronic equipment and storage medium
CN112783730B (en) Interface monitoring method, device, medium and electronic equipment
CN115794953A (en) Data synchronization method, system, device and computer readable medium based on table data
CN111290873B (en) Fault processing method and device
CN114928603A (en) Client software upgrading method and device, electronic equipment and medium
CN114428815A (en) Data storage method and device, electronic equipment and computer readable medium
CN112445860A (en) Method and device for processing distributed transaction
CN111092758A (en) Method and device for reducing alarm and recovering false alarm and electronic equipment
CN112489236A (en) Attendance data processing method and device, server and storage medium
CN111310043B (en) Method and device for pushing information
CN115689444B (en) Logistics automatic monitoring method, device, equipment and medium based on historical cases
CN113819989B (en) Article packaging method, apparatus, electronic device and computer readable medium
CN114189816A (en) Information reminding method and device for content management, terminal and storage medium
CN112835739A (en) Downtime processing method and device
CN116319647A (en) Information notification, information processing method, information processing apparatus, computer device, and storage medium
CN117874108A (en) Method, apparatus and computer readable medium for performing data synchronization processing
CN113962782A (en) Order information processing method and device, electronic equipment and computer readable medium
CN114064494A (en) Data abnormity alarm method and device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination