CN110620701A - Data stream monitoring processing method, device, equipment and storage medium - Google Patents
Data stream monitoring processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110620701A CN110620701A CN201910863000.7A CN201910863000A CN110620701A CN 110620701 A CN110620701 A CN 110620701A CN 201910863000 A CN201910863000 A CN 201910863000A CN 110620701 A CN110620701 A CN 110620701A
- Authority
- CN
- China
- Prior art keywords
- data
- data acquisition
- acquisition end
- time
- reported
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 85
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 230000002159 abnormal effect Effects 0.000 claims abstract description 124
- 238000012545 processing Methods 0.000 claims abstract description 68
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000004364 calculation method Methods 0.000 claims description 44
- 230000015654 memory Effects 0.000 claims description 19
- 239000000126 substance Substances 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000003111 delayed effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000002349 favourable effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 230000002427 irreversible effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
Abstract
The application discloses a data stream monitoring processing method, a device, equipment and a storage medium, and relates to the technical field of data processing. The specific implementation scheme of the method comprises the following steps: acquiring the latest time of data reported by at least one first data acquisition terminal; determining a first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the latest time of reporting data by each first data acquisition end by taking the current time as a first reference time; the method has the beneficial characteristics that the problem that the time progress of the data stream cannot be normally advanced due to the abnormity of the data acquisition end can be effectively identified and solved.
Description
Technical Field
The present application relates to the field of data processing, and in particular, to a method, an apparatus, a device, and a storage medium for monitoring and processing a data stream.
Background
With the rapid development of data processing technology, streaming computing based on real-time data processing is widely popularized and applied. In the stream computing based on real-time data processing, the time schedule of the data stream can reflect the working conditions of a data source and the whole data acquisition/transmission system, and the normal promotion of the time schedule of the data stream is one of important factors for ensuring the normal operation of the stream computing.
In the related art, a common method for monitoring whether the time schedule of the data stream is abnormal is to monitor whether a data source is abnormal, and when it is determined that a certain data source is abnormal, a shielding process is performed on the abnormal data source to ensure the normal progress of the time schedule of the data stream.
However, only monitoring whether the data source is abnormal or not is difficult to identify other factors except the data source, which cause the abnormal advance of the data stream time schedule, and this is not favorable for ensuring the normal advance of the data stream time schedule, and thus the normal operation of the stream-based computation cannot be ensured.
Disclosure of Invention
The embodiment of the application provides a data stream monitoring processing method, a data stream monitoring processing device, data stream monitoring processing equipment and a storage medium, and aims to solve the problem that other factors causing the data stream time progress to be incapable of being normally advanced except a data source are difficult to identify in the related art.
In a first aspect, the present application provides a data flow monitoring processing method, where the method is applied to a data flow monitoring module, and the method includes:
acquiring the time of data reporting of at least one first data acquisition terminal;
determining a first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the data reporting time of each first data acquisition end by taking the current time as a first reference time;
and shielding the first abnormal data acquisition end.
According to the data reporting time of each first data acquisition end, whether the working state of each first data acquisition end is normal or not is determined, and the problem that the data flow time progress cannot be normally advanced due to the abnormality of the first data acquisition ends can be effectively identified and solved by determining and shielding the first abnormal data acquisition ends.
Further, the method further comprises:
acquiring reported data of each second data acquisition end which has reported data within a first preset time, wherein the reported data of any one second data acquisition end is the generation time of the latest data of a data source corresponding to the second data acquisition end;
and determining a second abnormal data acquisition end according to the reported data of each second data acquisition end, and shielding the second abnormal data acquisition end.
The method comprises the steps of obtaining reported data of each second data acquisition end in a normal working state, determining whether the reported data of each second data acquisition end influences the normal propulsion of the data flow time progress or not through the generation time of the latest data in the corresponding data source reported by the second data acquisition end, and further ensuring the normal propulsion of the data flow time progress and the normal running of flow type calculation through identifying and shielding second abnormal data acquisition ends.
Further, determining a second abnormal data acquisition end according to the reported data of each second data acquisition end includes:
determining the latest generation time as a second reference time in the reported data of all the second data acquisition terminals;
and determining a second data acquisition end of which the difference value between the reported data and the second reference time exceeds a second preset time length as the second abnormal data acquisition end according to the second reference time.
And determining whether the reported data of each second data acquisition end is delayed to exceed a preset time length, namely determining whether the generation time of the latest data in the data source corresponding to each second data acquisition end is delayed to exceed the preset time length, and realizing effective data flow time progress monitoring by shielding the second abnormal data acquisition end corresponding to the abnormal data source or the slow-progress data source.
Further, when the difference value between the reported data of a certain second data acquisition end and the second reference time exceeds the second preset time length and the reported data is 0, determining that the data source corresponding to the second data acquisition end is a new access data source, and not performing shielding processing on the second data acquisition end.
By identifying the newly accessed data source and not taking shielding measures on the second data acquisition end corresponding to the newly accessed data source, the problems that the monitoring error of the data flow is large and the flow type calculation effect is influenced because the newly accessed data source is judged to be an abnormal data source for shielding because the latest data is not generated temporarily can be effectively avoided.
Further, the method further comprises:
when the shielding time length of the first abnormal data acquisition end reaches a third preset time length, acquiring the reported data of the first abnormal data acquisition end again, and acquiring the time for reporting the data of the first abnormal data acquisition end;
and when the shielding time length of the second abnormal data acquisition end reaches a fourth preset time length, acquiring the reported data of the second abnormal data acquisition end again.
By adopting a dynamic shielding strategy, the monitoring effect of the data flow time progress can be effectively improved.
Further, acquiring the time for reporting data by at least one first data acquisition terminal includes:
acquiring a time progress monitoring instruction sent by a data flow calculation module;
and after the time progress monitoring instruction is obtained, obtaining the time of the data reported by at least one first data acquisition terminal.
And after the data flow time progress automatic propelling strategy is started, the data flow time progress monitoring is started, and unnecessary work expenses are reduced on the basis of providing effective data flow monitoring.
Further, the method further comprises:
and feeding back a data source mark of the unmasked second data acquisition end corresponding to the data source to the data stream calculation module, wherein the data source mark is used for the data stream calculation module to acquire the data of the data source for stream calculation.
The data source mark of the data acquisition end corresponding to the data source which is not shielded is fed back to the data stream calculation module, so that the data stream calculation module can acquire data in the data source with high real-time performance and normal working state to perform stream calculation, and normal operation of the stream calculation can be guaranteed.
In a second aspect, the present application provides a data flow monitoring processing apparatus, where the apparatus is applied to a data flow monitoring module, and the apparatus includes:
the first acquisition unit is used for acquiring the time of data reporting of at least one first data acquisition terminal;
the first processing unit is used for determining a first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end by taking the current time as a first reference time according to the data reporting time of each first data acquisition end;
and the second processing unit is used for shielding the first abnormal data acquisition end.
Further, the apparatus further comprises:
the second acquiring unit is used for acquiring the reported data of each second data acquisition end which has reported data within a first preset time length, wherein the reported data of any one second data acquisition end is the generation time of the latest data of the data source corresponding to the second data acquisition end;
and the third processing unit is used for determining a second abnormal data acquisition end according to the reported data of each second data acquisition end and shielding the second abnormal data acquisition end.
Further, the third processing unit includes:
the first processing subunit is configured to determine, in the reported data of all the second data acquisition terminals, that the latest generation time is a second reference time;
and the second processing subunit is configured to determine, according to the second reference time, that a second data acquisition end where a difference between the reported data and the second reference time exceeds a second preset time duration is the second abnormal data acquisition end.
Further, the second processing subunit is further configured to determine that the data source corresponding to a second data acquisition end is a new access data source when a difference between the reported data of the second data acquisition end and the second reference time exceeds the second preset time duration and the reported data is 0, and not perform shielding processing on the second data acquisition end.
Further, the apparatus further comprises:
a third obtaining unit, configured to obtain the reported data of the first abnormal data collecting end again when the shielding duration of the first abnormal data collecting end reaches a third preset duration, and obtain the time for the first abnormal data collecting end to report data;
and the fourth obtaining unit is used for obtaining the reported data of the second abnormal data collecting end again when the shielding time length of the second abnormal data collecting end reaches a fourth preset time length.
Further, the first obtaining unit includes:
the first acquisition subunit is used for acquiring the time schedule monitoring instruction sent by the data flow calculation module;
and the second obtaining subunit is configured to obtain the time of the data reported by the at least one first data collecting terminal after the time progress monitoring instruction is obtained.
Further, the apparatus further comprises:
and the fourth processing unit is configured to feed back, to the data stream calculation module, a data source flag of the data source corresponding to the unmasked second data acquisition end, and is used for the data stream calculation module to acquire the data of the data source for performing stream calculation.
In a third aspect, the present application provides an electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of the first aspects.
In a fourth aspect, the present application provides a non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any of the first aspects.
One embodiment in the above application has the following advantages or benefits: the problem that the data flow time progress cannot be normally advanced due to the abnormity of the data acquisition end can be effectively solved. The latest time for acquiring the reported data of at least one first data acquisition terminal is adopted; determining the first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the latest time of the data reported by each first data acquisition end by taking the current time as a first reference time; the technical means of shielding the first abnormal data acquisition end overcomes the problem that other factors causing the abnormal progress of the data stream time besides the data source are difficult to identify in the related technology.
Other effects of the above-described alternative will be described below with reference to specific embodiments.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
fig. 1 is a schematic flowchart of a data flow monitoring processing method according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another data flow monitoring processing method provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data flow monitoring processing apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of another data flow monitoring processing apparatus provided in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a data flow monitoring processing device according to an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The noun to which this application relates explains:
and (3) streaming calculation: the processing mode of real-time calculation of the data stream is to spread a large amount of data to each time point, continuously transmit small batches of data, then calculate the continuously flowing data in real time, and discard the data after the calculation is completed.
Data flow: an ordered data sequence.
URL: the uniform resource locator is a simple representation of the position and access method of the resource which can be obtained from the internet, and is a standard resource address of the internet.
Timestamp (timestamp): a complete, verifiable piece of data, usually a sequence of characters, that indicates that a piece of data existed before a particular time, uniquely identifies the time of the moment
The application scenario of the application is as follows: with the rapid development of data processing technology, the streaming calculation based on real-time data processing is widely popularized and applied, for example, the streaming calculation is widely applied in the fields of real-time transaction data statistics of financial systems, real-time traffic condition monitoring of traffic systems, real-time updating of user figures of recommendation systems, real-time monitoring of health conditions of online services and the like. In the stream computing based on real-time data processing, the time schedule of the data stream can reflect the working conditions of a data source and the whole data acquisition/transmission system, and the normal promotion of the time schedule of the data stream is one of important factors for ensuring the normal operation of the stream computing. In the related art, a common method for monitoring whether the time schedule of the data stream is abnormal is to monitor whether a data source is abnormal, and when it is determined that a certain data source is abnormal, a shielding process is performed on the abnormal data source to ensure the normal progress of the time schedule of the data stream.
However, only monitoring whether the data source is abnormal or not is difficult to identify other factors except the data source, which cause the abnormal advance of the data stream time schedule, and this is not favorable for ensuring the normal advance of the data stream time schedule, and thus the normal operation of the stream-based computation cannot be ensured.
The application provides a data stream monitoring processing method, device, equipment and storage medium, and aims to solve the technical problems.
Fig. 1 is a data flow monitoring processing method provided in an embodiment of the present application, where the method is applied to a data flow monitoring platform, and as shown in fig. 1, the method includes:
step 101, obtaining the latest time of data reported by at least one first data acquisition terminal.
In this embodiment, specifically, an execution main body of this embodiment is a data flow monitoring platform, a server or a controller that is disposed on the data flow monitoring platform, or other devices or apparatuses that can execute this embodiment, and this embodiment takes as an example that the execution main body is a processor that is disposed on the data flow monitoring platform for description.
The stream computation is a process of collecting data streams continuously generated in real time and performing real-time computation to quickly obtain a computation result, wherein the time schedule of the data streams can reflect the working conditions of a data source and the whole data acquisition/transmission system, and the normal promotion of the time schedule of the data streams is one of the conditions for ensuring the normal operation of the stream computation. The data source in the streaming calculation is a terminal for generating data in real time, and exemplarily, the data source is a search engine for processing millions of user queries per second, a financial system processor for processing a large amount of user transaction data per second, a traffic supervision platform for acquiring road traffic data in real time, and the like.
The data in the data source has a generation Time and a processed Time, the generation Time is an Event Time of the data, such as a Time when a user clicks a URL, and the processed Time is a Processing Time of the data, i.e. a Time processed by the processor. Due to some reasons (such as network delay), the processed time of the data may lag behind the generation time, and if the data stream time progress monitoring is performed according to the processed time of the data, there may be a problem that a monitoring error is large and the accuracy of the streaming computation is affected, for example, the number of times that a user clicks an advertisement within a certain time period needs to be counted, and due to the network delay, the generation time of the data and the processed time may be located in different time periods. Therefore, after acquiring the time progress monitoring instruction sent by the data flow calculation module, the data flow monitoring platform starts a data flow time progress automatic propulsion strategy and performs data flow time progress monitoring, specifically, the generation time of the data flow time progress automatic propulsion strategy is determined according to the timestamp carried by the data, the first data acquisition end is used for acquiring the generation time of the latest data in the corresponding data source and reporting the generation time of the latest data in the corresponding data source to the data flow monitoring platform, and the data flow monitoring platform acquires the time for reporting the data by at least one first data acquisition end while acquiring the reported data by at least one first data acquisition end. And monitoring the working state of each first data acquisition end according to the latest acquired data reporting time of each first data acquisition end.
Illustratively, 10 first data acquisition ends are arranged, the data stream monitoring platform acquires the latest time of data reported by the 10 first data acquisition ends, the latest time of the reported data is respectively 2:07, 2:10, 2:06, 2:11, 2:17, 00:12, 2:02, 2:09 and 2:15, and the current time of the data stream monitoring is 2: 20.
And 102, determining the first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end by taking the current time as a first reference time and according to the latest time of the data reported by each first data acquisition end.
In this embodiment, specifically, the current time for performing the data flow time schedule monitoring is the first reference time, because the first reference time is the current time, the latest time of the data reported by any one of the first data acquisition terminals may only be before the first reference time or be the first reference time. And judging whether each first data acquisition end reports data within a first preset time before the first reference time. When data which are not reported by the first data acquisition end within the first preset time length exist, the first data acquisition end fails to acquire the data within the first preset time length or fails to report the data, the data flow monitoring platform cannot normally acquire the generation time of the latest data in the data source corresponding to the first data acquisition end, the promotion of the time progress of the data flow is influenced, the continuous transmission and the continuous flow of the data flow are influenced, and therefore the first data acquisition end which does not report the data within the first preset time length is determined to be a first abnormal data acquisition end.
For example, the current time is 2:20, and the first preset time duration is 1 hour, the first data acquisition end that has not reported data in the time period of 1:20 to 2:20 is determined as the first abnormal data acquisition end, and then the first data acquisition end that has the latest time of reporting data of 00:12 is determined as the first abnormal data acquisition end.
And 103, shielding the first abnormal data acquisition end.
In this embodiment, specifically, because the data flow monitoring platform fails to obtain the reported data of the first abnormal data acquisition within the first preset time from the current time, the data may not be reported by the first abnormal data acquisition end within the first preset time from the current time, or the data may not be acquired within the first preset time from the current time, and the first abnormal data acquisition end affects normal progress of the data flow time, which may cause that the flow calculation cannot be normally performed, the first abnormal data acquisition end is shielded.
When a certain first data acquisition end is determined as a first abnormal data acquisition end, it is indicated that a data source corresponding to the first abnormal data acquisition end is in an uncontrollable state, and the data flow monitoring platform cannot acquire the generation time of the latest data of the data source, because the flow calculation has a high real-time requirement, after the first abnormal data acquisition end is shielded, a data source mark of the shielded first abnormal data acquisition end corresponding to the data source is fed back to the data flow calculation module, and the data flow calculation module is reminded of not acquiring the data of the data source for the flow calculation. Meanwhile, the data flow monitoring platform feeds back the abnormal information of the first data acquisition end to the data acquisition management system, and the abnormal information is used for the data acquisition management system to carry out investigation and maintenance on the operation condition of the first data acquisition end.
And after the shielding time length of the first abnormal data acquisition end reaches the preset time length, the shielding processing of the first abnormal data acquisition end is removed, and the reported data of the first data acquisition end and the latest time of the reported data are obtained again.
The embodiment obtains the latest time of the data reported by at least one first data acquisition terminal; determining the first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the latest time of the data reported by each first data acquisition end by taking the current time as a first reference time; and shielding the first abnormal data acquisition end. The method comprises the steps of determining whether each first data acquisition end reports data within a first preset time before the current time by obtaining the latest time of the data reported by each first data acquisition end, determining whether each first data acquisition end works normally, and shielding a first abnormal data acquisition end when determining that a certain first data acquisition end works abnormally. Compared with the prior art that whether each data source works normally is only judged, the embodiment monitors the working condition of the first data acquisition end, and can effectively solve the problems that the data flow monitoring platform cannot normally monitor the generation time of the latest data in the data source due to the fact that the data source works normally but the corresponding first data acquisition end is abnormal, the data flow time progress is advanced abnormally, and the flow type calculation cannot be performed normally.
Fig. 2 is a schematic flow chart of another data flow monitoring processing method according to an embodiment of the present application, and as shown in fig. 2, the method includes:
step 201, obtaining the latest time of data reported by at least one first data acquisition end, and determining a first abnormal data acquisition end and performing shielding processing according to the latest time of data reported by each first data acquisition end.
In this embodiment, specifically, the step can refer to steps 101-103 in fig. 1, which is not described again.
Step 202, obtaining the reported data of each second data acquisition end which has reported data within a first preset time, wherein the reported data of any one second data acquisition end is the generation time of the latest data in the data source corresponding to the second data acquisition end.
In this embodiment, specifically, the normal advancement of the data flow time schedule needs to satisfy both the normal work of the first data acquisition end that reports data and the normal work of the corresponding data source, and step 201 realizes the monitoring of the work condition of each first data acquisition end by acquiring the latest time of data reporting by each first data acquisition end. After the first abnormal data acquisition end is shielded, in order to ensure the normal progress of the data flow time, whether the data source works abnormally needs to be judged.
The method includes the steps of obtaining reported data of each second data acquisition end which has reported data within a first preset time length, namely obtaining reported data of each second data acquisition end with a normal working state, wherein the reported data of any one second data acquisition end is the generation time of latest data in a data source corresponding to the second data acquisition end. And determining the latest generation progress of the data in each data source by acquiring the generation time of the latest data in the data source reported by each second data acquisition terminal, and further determining whether each data source works abnormally. For example, by obtaining the latest transaction time in the financial system, obtaining the latest time of monitoring road condition data by the traffic supervision system, obtaining the latest time of clicking the URL by the user, obtaining the time of generating the latest service log, determining the latest generation progress of data in different data sources, and further determining whether each data source works abnormally.
Illustratively, the report data of 9 second data acquisition ends (the report data of 9 normal data acquisition ends) is acquired, that is, the generation time of the latest data in the data sources corresponding to the 9 second data acquisition ends is acquired, where the report data of the 9 second data acquisition ends are 00:01, 00:11, 2:00, 2:05, 1:35, 1:56, 2:10, 1:20, and 1:09, respectively.
And 203, determining a second abnormal data acquisition end according to the reported data of each second data acquisition end, and shielding the second abnormal data acquisition end.
In this embodiment, specifically, the latest generation time is determined as the second reference time in the reported data of all the second data acquisition terminals; and determining a second data acquisition end with the difference value between the reported data and the second reference time exceeding a second preset time length as a second abnormal data acquisition end according to the second reference time. In the generation time of the latest data in the data sources corresponding to all the second data acquisition ends, the latest generation time is equivalent to the water level of the data stream in the stream-oriented computation, the water level of the data stream has irreversible conversion, and in order to ensure the effective operation of the stream-oriented computation, the normal propulsion of the water level of the data stream, namely the normal propulsion of the time progress of the data stream, needs to be ensured. In order to guarantee timeliness and integrity of data, when time progress monitoring of the data flow is carried out, generation time which is at a second preset time interval with a second reference time is set as a low water level value, overdue data which is earlier than the low water level value is shielded, a data source with slow progress before the low water level value can be well screened out, and normal promotion of the time progress of the global data flow is guaranteed.
In all the reported data of the second data acquisition end, the latest generation time is determined to be a second reference time, and a data source without new data generation in a second preset time period may have an abnormal or delayed problem, at this time, the data flow monitoring platform cannot acquire the reported data of the second data acquisition end corresponding to the data source, which meets the real-time requirement, and cannot perform normal data flow time progress advancing according to the reported data of the second data acquisition end, so that a second abnormal data acquisition end of the second data acquisition end is determined, and the second abnormal data acquisition end is shielded.
For example, in the obtained 9 pieces of reported data of the second data acquisition ends, determining the latest generation time 2:10 as a second reference time, setting a second preset time duration to be 1 hour, determining whether the reported data of each second data acquisition end is located before 1:10, and when the reported data of the second data acquisition end is located before 1:10, indicating that a data source corresponding to the second data acquisition end is abnormal or lagged, and normal data flow time progress cannot be performed according to the reported data of the second data acquisition end, so that the second data acquisition end is determined to be a second abnormal data acquisition end, and thus the second data acquisition ends whose reported data are 00:01, 00:11, and 1:09 are determined to be a second abnormal data acquisition end and are subjected to shielding processing.
And when the difference value between the reported data of a certain second data acquisition end and the second reference time exceeds a second preset time length and the reported data is 0, determining that the data source corresponding to the second data acquisition end is a new access data source, and not shielding the second data acquisition end. And continuously acquiring the reported data of a second data acquisition end corresponding to the newly accessed data source, and if the reported data of the second data acquisition end is still 0 within a preset time length or is not 0 but the interval with a second reference time exceeds a second preset time length, still determining that the second data acquisition end is a second abnormal data acquisition end and carrying out shielding processing.
In order to ensure the monitoring effect of the data flow time progress, a dynamic shielding strategy is adopted, the reported data of the second abnormal data acquisition end is obtained again after the shielding time of the second abnormal data acquisition end reaches a set threshold, and whether the difference value between the reported data and the second reference time exceeds a second preset time is judged. Meanwhile, the data stream monitoring platform feeds back the data source mark of the second data acquisition end which is not shielded to the data stream calculation module, and the data source mark is used for the data stream calculation module to acquire the data of the data source for stream calculation.
In the embodiment, the latest time of data reported by at least one first data acquisition end is obtained, and the first abnormal data acquisition end is determined and shielded according to the latest time of data reported by each first data acquisition end; acquiring reported data of each second data acquisition end which has reported data within a first preset time, wherein the reported data of any one second data acquisition end is the generation time of the latest data in a data source corresponding to the second data acquisition end; and determining a second abnormal data acquisition end according to the reported data of each second data acquisition end, and shielding the second abnormal data acquisition end. According to the latest time of the data reported by each first data acquisition end, whether the data reported by each first data acquisition end is normal or not is determined, and the shielding processing of the first abnormal data acquisition end is realized by judging the working state of the first data acquisition end, so that the promotion of the time progress of the data flow is facilitated; the method comprises the steps of obtaining reported data of each second data acquisition end in a normal working state, judging whether the reported data of each second data acquisition end has a delay exceeding a preset time length or not, namely judging whether the generation time of the latest data of a data source corresponding to each second data acquisition end exceeds the preset time length or not, and shielding the second abnormal data acquisition end corresponding to an abnormal data source or a data source with a slow progress to realize effective data flow time progress monitoring, further ensuring the promotion of the data flow time progress and ensuring the normal running of flow calculation.
Fig. 3 is a schematic structural diagram of a data flow monitoring processing apparatus according to an embodiment of the present application, and as shown in fig. 3, the apparatus includes:
the first acquisition unit 1 is used for acquiring the time of data reporting of at least one first data acquisition terminal;
the first processing unit 2 is configured to determine, by taking the current time as a first reference time and according to the time when each first data acquisition end reports data, that a first data acquisition end that has not reported data within a first preset time length is a first abnormal data acquisition end;
and the second processing unit 3 is used for shielding the first abnormal data acquisition end.
The embodiment obtains the latest time of the data reported by at least one first data acquisition terminal; determining the first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the latest time of the data reported by each first data acquisition end by taking the current time as a first reference time; and shielding the first abnormal data acquisition end. The method comprises the steps of determining whether each first data acquisition end reports data within a first preset time before the current time by obtaining the latest time of the data reported by each first data acquisition end, determining whether each first data acquisition end works normally, and shielding a first abnormal data acquisition end when determining that a certain first data acquisition end works abnormally. Compared with the prior art that whether each data source works normally is only judged, the embodiment monitors the working condition of the first data acquisition end, and can effectively solve the problems that the data flow monitoring platform cannot normally monitor the generation time of the latest data in the data source due to the fact that the data source works normally but the corresponding first data acquisition end is abnormal, the data flow time progress is advanced abnormally, and the flow type calculation cannot be performed normally.
Fig. 4 is a schematic structural diagram of another data flow monitoring processing apparatus according to an embodiment of the present application, and based on fig. 3, as shown in fig. 4,
the device also includes:
the second obtaining unit 4 is configured to obtain the reported data of each second data acquisition end that has reported data within a first preset time period, where the reported data of any one second data acquisition end is the generation time of the latest data of the data source corresponding to the second data acquisition end;
and the third processing unit 5 is configured to determine a second abnormal data acquisition end according to the reported data of each second data acquisition end, and perform shielding processing on the second abnormal data acquisition end.
A third processing unit 5 comprising:
the first processing subunit 51 is configured to determine, in the reported data of all the second data acquisition terminals, the latest generation time as a second reference time;
and a second processing subunit 52, configured to determine, according to the second reference time, that the second data acquisition end where the difference between the reported data and the second reference time exceeds a second preset time length is a second abnormal data acquisition end.
The second processing subunit 52 is further configured to determine that the data source corresponding to a second data acquisition end is a newly accessed data source when a difference between the reported data of the second data acquisition end and the second reference time exceeds a second preset time duration and the reported data is 0, and not perform shielding processing on the second data acquisition end.
The device also includes:
the third obtaining unit 6 is configured to obtain the reported data of the first abnormal data collecting end again when the shielding duration of the first abnormal data collecting end reaches a third preset duration, and obtain the time for the first abnormal data collecting end to report the data;
and the fourth obtaining unit 7 is configured to obtain the report data of the second abnormal data collecting end again when the shielding duration of the second abnormal data collecting end reaches a fourth preset duration.
A first acquisition unit 1, comprising:
a first obtaining subunit 11, configured to obtain a time schedule monitoring instruction sent by the data flow calculating module;
and the second obtaining subunit 12 is configured to obtain, after the time progress monitoring instruction is obtained, time for reporting data by at least one first data collecting terminal.
The device also includes:
and the fourth processing unit 8 is configured to feed back, to the data stream calculation module, a data source flag of the second data acquisition end that is not masked, where the data source flag corresponds to the data source, and is used for the data stream calculation module to acquire data of the data source for performing stream calculation.
In the embodiment, the latest time of data reported by at least one first data acquisition end is obtained, and the first abnormal data acquisition end is determined and shielded according to the latest time of data reported by each first data acquisition end; acquiring reported data of each second data acquisition end which has reported data within a first preset time, wherein the reported data of any one second data acquisition end is the generation time of the latest data in a data source corresponding to the second data acquisition end; and determining a second abnormal data acquisition end according to the reported data of each second data acquisition end, and shielding the second abnormal data acquisition end. According to the latest time of the data reported by each first data acquisition end, whether the data reported by each first data acquisition end is normal or not is determined, and the shielding processing of the first abnormal data acquisition end is realized by judging the working state of the first data acquisition end, so that the promotion of the time progress of the data flow is facilitated; the method comprises the steps of obtaining reported data of each second data acquisition end in a normal working state, judging whether the reported data of each second data acquisition end has a delay exceeding a preset time length or not, namely judging whether the generation time of the latest data of a data source corresponding to each second data acquisition end exceeds the preset time length or not, and shielding the second abnormal data acquisition end corresponding to an abnormal data source or a data source with a slow progress to realize effective data flow time progress monitoring, further ensuring the promotion of the data flow time progress and ensuring the normal running of flow calculation.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 5 is a block diagram of an electronic device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 5, the electronic apparatus includes: one or more processors 501, memory 502, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 5, one processor 501 is taken as an example.
Memory 502 is a non-transitory computer readable storage medium as provided herein. The memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method for data flow monitoring processing provided herein. The non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform the method of data stream monitoring processing provided herein.
The memory 502, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the method of data stream monitoring processing in the embodiment of the present application (for example, the acquisition unit 1, the first processing unit 2, and the second processing unit 3 shown in fig. 3). The processor 501 executes various functional applications of the server and data processing, i.e., a method of implementing the data flow monitoring processing in the above-described method embodiments, by executing non-transitory software programs, instructions, and modules stored in the memory 502.
The memory 502 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device of the data flow monitoring process, and the like. Further, the memory 502 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 502 optionally includes memory located remotely from processor 501, which may be connected to data flow monitoring process electronics over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the method of data stream monitoring processing may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected by a bus or other means, and fig. 5 illustrates the connection by a bus as an example.
The input device 503 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic equipment for data stream monitoring processing, such as an input device such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or the like. The output devices 504 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
The principle and advantageous effects of the data stream monitoring processing system provided in this embodiment refer to the principle and advantageous effects of the data stream monitoring processing method in fig. 1 to fig. 2, and are not described again.
In the embodiments of the present application, the above embodiments may be referred to and referred to by each other, and the same or similar steps and terms are not repeated.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (16)
1. A data flow monitoring processing method is applied to a data flow monitoring platform and comprises the following steps:
acquiring the latest time of data reported by at least one first data acquisition terminal;
determining a first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end according to the latest time of reporting data by each first data acquisition end by taking the current time as a first reference time;
and shielding the first abnormal data acquisition end.
2. The method of claim 1, further comprising:
acquiring reported data of each second data acquisition end which has reported data within a first preset time, wherein the reported data of any one second data acquisition end is the generation time of the latest data in a data source corresponding to the second data acquisition end;
and determining a second abnormal data acquisition end according to the reported data of each second data acquisition end, and shielding the second abnormal data acquisition end.
3. The method of claim 2, wherein determining a second abnormal data acquisition end according to the reported data of each second data acquisition end comprises:
determining the latest generation time as a second reference time in the reported data of all the second data acquisition terminals;
and determining a second data acquisition end of which the difference value between the reported data and the second reference time exceeds a second preset time length as the second abnormal data acquisition end according to the second reference time.
4. The method of claim 3, wherein when the difference between the reported data of a second data acquisition end and the second reference time exceeds the second preset duration and the reported data is 0, it is determined that the data source corresponding to the second data acquisition end is a newly accessed data source, and the second data acquisition end is not masked.
5. The method of claim 2, further comprising:
when the shielding time length of the first abnormal data acquisition end reaches a third preset time length, acquiring the reported data of the first abnormal data acquisition end again, and acquiring the latest time of the reported data of the first abnormal data acquisition end;
and when the shielding time length of the second abnormal data acquisition end reaches a fourth preset time length, acquiring the reported data of the second abnormal data acquisition end again.
6. The method according to any one of claims 1 to 5, wherein obtaining the latest time of the data reported by the at least one first data collecting terminal comprises:
acquiring a time progress monitoring instruction sent by a data flow calculation module;
and after the time progress monitoring instruction is obtained, obtaining the latest time of the data reported by at least one first data acquisition terminal.
7. The method of claim 6, further comprising:
and feeding back a data source mark of the unmasked second data acquisition end corresponding to the data source to the data stream calculation module, wherein the data source mark is used for the data stream calculation module to acquire the data of the data source for stream calculation.
8. A data flow monitoring processing apparatus, which is applied to a data flow monitoring module, and comprises:
the first acquisition unit is used for acquiring the time of data reporting of at least one first data acquisition terminal;
the first processing unit is used for determining a first data acquisition end which does not report data within a first preset time length as a first abnormal data acquisition end by taking the current time as a first reference time according to the data reporting time of each first data acquisition end;
and the second processing unit is used for shielding the first abnormal data acquisition end.
9. The apparatus of claim 8, further comprising:
the second acquiring unit is used for acquiring the reported data of each second data acquisition end which has reported data within a first preset time length, wherein the reported data of any one second data acquisition end is the generation time of the latest data of the data source corresponding to the second data acquisition end;
and the third processing unit is used for determining a second abnormal data acquisition end according to the reported data of each second data acquisition end and shielding the second abnormal data acquisition end.
10. The apparatus of claim 9, wherein the third processing unit comprises:
the first processing subunit is configured to determine, in the reported data of all the second data acquisition terminals, that the latest generation time is a second reference time;
and the second processing subunit is configured to determine, according to the second reference time, that a second data acquisition end where a difference between the reported data and the second reference time exceeds a second preset time duration is the second abnormal data acquisition end.
11. The apparatus according to claim 10, wherein the second processing subunit is further configured to determine that the data source corresponding to a second data acquisition end is a newly accessed data source when a difference between the reported data of the second data acquisition end and the second reference time exceeds the second preset duration and the reported data is 0, and not perform the shielding processing on the second data acquisition end.
12. The apparatus of claim 9, further comprising:
a third obtaining unit, configured to obtain the reported data of the first abnormal data collecting end again when the shielding duration of the first abnormal data collecting end reaches a third preset duration, and obtain the time for the first abnormal data collecting end to report data;
and the fourth obtaining unit is used for obtaining the reported data of the second abnormal data collecting end again when the shielding time length of the second abnormal data collecting end reaches a fourth preset time length.
13. The apparatus according to any one of claims 8-12, wherein the first obtaining unit comprises:
the first acquisition subunit is used for acquiring the time schedule monitoring instruction sent by the data flow calculation module;
and the second obtaining subunit is configured to obtain the time of the data reported by the at least one first data collecting terminal after the time progress monitoring instruction is obtained.
14. The apparatus of claim 13, further comprising:
and the fourth processing unit is configured to feed back, to the data stream calculation module, a data source flag of the data source corresponding to the unmasked second data acquisition end, and is used for the data stream calculation module to acquire the data of the data source for performing stream calculation.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
16. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910863000.7A CN110620701B (en) | 2019-09-12 | 2019-09-12 | Data stream monitoring processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910863000.7A CN110620701B (en) | 2019-09-12 | 2019-09-12 | Data stream monitoring processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110620701A true CN110620701A (en) | 2019-12-27 |
| CN110620701B CN110620701B (en) | 2024-03-08 |
Family
ID=68922887
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910863000.7A Active CN110620701B (en) | 2019-09-12 | 2019-09-12 | Data stream monitoring processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110620701B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114710369A (en) * | 2022-06-06 | 2022-07-05 | 山东云天安全技术有限公司 | Abnormal data detection method and device, computer equipment and storage medium |
| CN114900419A (en) * | 2022-04-22 | 2022-08-12 | 广州番禺电缆集团有限公司 | Digital cable and method for intelligently reporting parameters |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0761061A1 (en) * | 1994-05-04 | 1997-03-12 | Starsight Telecast, Inc. | Television schedule information transmission and utilization system and process |
| AU2001257083A1 (en) * | 2000-04-18 | 2002-01-17 | Motorola Inc. | Wireless System Protocol for Telemetry Monitoring |
| CN101286055A (en) * | 2008-04-25 | 2008-10-15 | 大赢数控设备(深圳)有限公司 | High speed air-floating main shaft temperature alarming and rotation speed monitoring system |
| CN101364863A (en) * | 2008-09-27 | 2009-02-11 | 华为技术有限公司 | Time synchronizing method, apparatus and system for master, slave time clock side in synchronous network |
| CN101790188A (en) * | 2009-01-24 | 2010-07-28 | 华为技术有限公司 | Time offset adjusting method and user terminal |
| CN102361353A (en) * | 2011-10-26 | 2012-02-22 | 东北电网有限公司 | Method for aligning section raw data on basis of double time scale delay evaluation |
| AU2013200391A1 (en) * | 2008-10-02 | 2013-02-14 | Certusview Technologies, Llc | Methods and apparatus for generating electronic records of locate operations |
| AU2013231105A1 (en) * | 2008-03-26 | 2013-10-10 | Theranos Ip Company, Llc | Methods and systems for assessing clinical outcomes |
| EP3141876A1 (en) * | 2015-09-11 | 2017-03-15 | Bouygues Energies et Services | Method for reading photometric data with enhanced accuracy |
| CN107340014A (en) * | 2017-08-31 | 2017-11-10 | 广东美的制冷设备有限公司 | Detection method, device and the computer-readable recording medium of multisensor |
| CN108989463A (en) * | 2018-08-27 | 2018-12-11 | 浙江易享节能技术服务股份有限公司 | A kind of data processing method and device |
| CN109243179A (en) * | 2018-11-07 | 2019-01-18 | 苏州科达科技股份有限公司 | Dynamic captures the differentiating method and device of frame |
| CN109660380A (en) * | 2018-09-28 | 2019-04-19 | 深圳壹账通智能科技有限公司 | Monitoring method, platform, system and the readable storage medium storing program for executing of operation condition of server |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6441747B1 (en) * | 2000-04-18 | 2002-08-27 | Motorola, Inc. | Wireless system protocol for telemetry monitoring |
-
2019
- 2019-09-12 CN CN201910863000.7A patent/CN110620701B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0761061A1 (en) * | 1994-05-04 | 1997-03-12 | Starsight Telecast, Inc. | Television schedule information transmission and utilization system and process |
| AU2001257083A1 (en) * | 2000-04-18 | 2002-01-17 | Motorola Inc. | Wireless System Protocol for Telemetry Monitoring |
| AU2013231105A1 (en) * | 2008-03-26 | 2013-10-10 | Theranos Ip Company, Llc | Methods and systems for assessing clinical outcomes |
| CN101286055A (en) * | 2008-04-25 | 2008-10-15 | 大赢数控设备(深圳)有限公司 | High speed air-floating main shaft temperature alarming and rotation speed monitoring system |
| CN101364863A (en) * | 2008-09-27 | 2009-02-11 | 华为技术有限公司 | Time synchronizing method, apparatus and system for master, slave time clock side in synchronous network |
| AU2013200391A1 (en) * | 2008-10-02 | 2013-02-14 | Certusview Technologies, Llc | Methods and apparatus for generating electronic records of locate operations |
| CN101790188A (en) * | 2009-01-24 | 2010-07-28 | 华为技术有限公司 | Time offset adjusting method and user terminal |
| CN102361353A (en) * | 2011-10-26 | 2012-02-22 | 东北电网有限公司 | Method for aligning section raw data on basis of double time scale delay evaluation |
| EP3141876A1 (en) * | 2015-09-11 | 2017-03-15 | Bouygues Energies et Services | Method for reading photometric data with enhanced accuracy |
| CN107340014A (en) * | 2017-08-31 | 2017-11-10 | 广东美的制冷设备有限公司 | Detection method, device and the computer-readable recording medium of multisensor |
| CN108989463A (en) * | 2018-08-27 | 2018-12-11 | 浙江易享节能技术服务股份有限公司 | A kind of data processing method and device |
| CN109660380A (en) * | 2018-09-28 | 2019-04-19 | 深圳壹账通智能科技有限公司 | Monitoring method, platform, system and the readable storage medium storing program for executing of operation condition of server |
| CN109243179A (en) * | 2018-11-07 | 2019-01-18 | 苏州科达科技股份有限公司 | Dynamic captures the differentiating method and device of frame |
Non-Patent Citations (2)
| Title |
|---|
| GANG MU;MAO YANG;DONG WANG;GANGUI YAN;YUE QI;: "Spatial dispersion of wind speeds and its influence on the forecasting error of wind power in a wind farm", JOURNAL OF MODERN POWER SYSTEMS AND CLEAN ENERGY, no. 02 * |
| 曲国利;吴云;徐改花;陈林;: "嵌入式可编程单点多发智能型数据采集传输仪研究", 安徽农业科学, no. 16 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114900419A (en) * | 2022-04-22 | 2022-08-12 | 广州番禺电缆集团有限公司 | Digital cable and method for intelligently reporting parameters |
| CN114900419B (en) * | 2022-04-22 | 2023-06-16 | 广州番禺电缆集团有限公司 | Digital cable and method for intelligently reporting parameters |
| CN114710369A (en) * | 2022-06-06 | 2022-07-05 | 山东云天安全技术有限公司 | Abnormal data detection method and device, computer equipment and storage medium |
| CN114710369B (en) * | 2022-06-06 | 2022-08-16 | 山东云天安全技术有限公司 | Abnormal data detection method and device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110620701B (en) | 2024-03-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111835856A (en) | File downloading method, device, equipment and storage medium | |
| CN111586126A (en) | Method, device and equipment for pre-downloading small program and storage medium | |
| CN110620701B (en) | Data stream monitoring processing method, device, equipment and storage medium | |
| CN112491617B (en) | Link tracking method, device, electronic equipment and medium | |
| CN112153428B (en) | Video processing method and device | |
| CN112486645A (en) | Timed task monitoring method and device, electronic equipment and medium | |
| CN112115114A (en) | Log processing method, device, equipment and storage medium | |
| CN111664844A (en) | Navigation method, navigation device and electronic equipment | |
| CN111813623A (en) | Page monitoring method and device, electronic equipment and storage medium | |
| CN111460292A (en) | Model evaluation method, apparatus, device, and medium | |
| CN110619008A (en) | Database query method and device, electronic equipment and storage medium | |
| CN114217996A (en) | Sound mixing method and device | |
| CN112351042B (en) | Attack flow calculation method and device, electronic equipment and storage medium | |
| CN112052185B (en) | Exception handling method and device for applet, electronic equipment and storage medium | |
| CN112311597A (en) | Message pushing method and device | |
| CN112395333A (en) | Method and device for checking data exception, electronic equipment and storage medium | |
| CN112395126A (en) | Fault log processing method and device, electronic equipment and storage medium | |
| CN112084150A (en) | Model training method, data retrieval method, device, equipment and storage medium | |
| CN110809041A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| CN113765979B (en) | Information transmission method, system and device | |
| CN115391158A (en) | Time delay determination method, system and device and electronic equipment | |
| CN112822302B (en) | Data normalization method and device, electronic equipment and storage medium | |
| CN112929198B (en) | Local hotspot processing method and device, electronic equipment and storage medium | |
| CN114020741A (en) | Vehicle mileage information storage method and device, vehicle electronic system and vehicle | |
| CN111782542A (en) | Test method, device, equipment, system and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |