CN103490949A - Method and device for collecting data information and detecting data information anomalies - Google Patents
Method and device for collecting data information and detecting data information anomalies Download PDFInfo
- Publication number
- CN103490949A CN103490949A CN201310405119.2A CN201310405119A CN103490949A CN 103490949 A CN103490949 A CN 103490949A CN 201310405119 A CN201310405119 A CN 201310405119A CN 103490949 A CN103490949 A CN 103490949A
- Authority
- CN
- China
- Prior art keywords
- time
- data message
- cycle
- time cycle
- data information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method and device for collecting data information and detecting data information anomalies. Due to N time periods which are preset and used for collecting data information, when data information generated by telecommunication equipment is collected, collecting is performed according to the preset time periods, intermediate data information is conveniently introduced in, a large amount of data information is effectively divided into intermediate data information with different gradients and collected, and therefore, the intermediate data information provides a basis for verification of accuracy of subsequent data information calculation, provides bases for data information anomaly catching and data information correction after anomaly catching, and provides the efficiency in data information collecting and the judgment efficiency when data information anomalies exist. The intermediate data information is storage durably, separation of reading and writing of the data information which undergoes step-by-step calculation and inquiring is further ensured, conflicts are avoided when a large amount of data information undergoes a high-speed operation, and the calculation efficiency of the data information is improved.
Description
Technical field
The present invention relates to the processing data information field, relate in particular to a kind of data information acquisition based on the magnanimity DBMS, the method and apparatus of data message abnormality detection.
Background technology
Telecommunication apparatus webmaster reporting system is based on the KPI(Key Performance Indicator that gathers distinct device, KPI Key Performance Indicator) information data, and carry out statistical analysis, obtain the running quality of equipment or the system of equipment place network quality.
Along with the continuous dilatation of telecommunication system, the quantity of telecom carrier-class device is also more and more, and the device data that telecommunication apparatus webmaster reporting system is faced presents magnanimity level trend development, like this data-handling capacity of telecommunication apparatus webmaster reporting system has been proposed to requirements at the higher level.
The data message of the magnanimity level how telecommunication apparatus in huge telecommunication system produced carries out effectively gathering and becoming the problem of needing solution badly.
Simultaneously, continuous increase along with telecom carrier-class device, utilize existing telecommunication apparatus webmaster reporting system to be gathered the data message produced, can't there will be the abnormal of data message with avoiding, how effectively to detect abnormal that data message occurs in the magnanimity DBMS information produced, also become the problem of needing solution badly.
Summary of the invention
The embodiment of the present invention provides the method and apparatus of a kind of data information acquisition, data message abnormality detection, while producing for solving prior art magnanimity DBMS information, gatherer process and the problem that the existence of judgement stage gathers and abnormal judging efficiency is low extremely.
A kind of acquisition method of data message is applied to, in telecommunication apparatus gateway reporting system, comprising:
From N the time cycle for image data information set in advance, select the cycle very first time, wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer;
According to the cycle very first time of selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
Described method also comprises:
From N the time cycle for image data information set in advance, selected for the second time cycle, wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle;
According to the second time cycle of selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
A described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
After the data message that telecommunication apparatus produces in collection meets each time interval in this cycle very first time, described method also comprises:
Dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected;
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
Described method also comprises:
The corresponding sub-dimension collection of data for each the dimension type obtained, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval;
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
A kind of method that data information acquisition method based on above-mentioned is detected extremely to data message comprises:
In the process of data information acquisition, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting;
Determining that telecommunication apparatus reports the time of described data message and the time period that meets the time cycle of selecting not to be complementary, and determines that the data message gathered occurs abnormal.
Described method also comprises:
When determining that telecommunication apparatus reports the time of described data message to be complementary with the time period that meets the time cycle of selecting, the described data message collected is calculated;
Judge that result of calculation is whether within default number range;
When definite result of calculation is not within default number range, the data message gathered in the time period to time cycle of selecting is recalculated.
Described method also comprises:
Whether the result that recalculates of judgement is within default number range;
When definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, adopt the mode of least square method to be revised the data message gathered.
Described method also comprises:
In the time cycle that judgement is set, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting;
Determining that described telecommunication apparatus reports the time delay degree of described data message to surpass the time span of setting, and triggers the described data message collected in the time cycle to described setting and is calculated.
A kind of collecting device of data message is applied to, in telecommunication apparatus gateway reporting system, comprising:
First selects module, for the N from setting in advance the time cycle for image data information, select the cycle very first time, wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer;
The first acquisition module, for the cycle very first time according to selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
Described equipment also comprises:
Second selects module, for the N from setting in advance the time cycle for image data information, selects for the second time cycle, and wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle;
The data message computing module, for the second time cycle according to selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
A described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
Described equipment also comprises:
Dimension is divided module, after the data message that in each time interval that meets this cycle very first time in collection, telecommunication apparatus produces, dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected;
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
Described equipment also comprises:
The device data generation module, the corresponding sub-dimension collection of data for each the dimension type for obtaining, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval;
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
The equipment that a kind of data information acquisition method based on above-mentioned is detected extremely to data message comprises:
The first judge module, for the process at data information acquisition, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting;
Abnormal determination module, for determining that telecommunication apparatus reports the time of described data message and the time period that meets the time cycle of selecting not to be complementary, and determines that the data message gathered occurs abnormal.
Described equipment also comprises:
Computing module, for when determining that telecommunication apparatus reports the time of described data message to be complementary with the time period that meets the time cycle of selecting, calculated the described data message collected;
The second judge module, the user with judge that result of calculation is whether within default number range, and, when definite result of calculation is not within default number range, triggering described computing module, the data message gathered in the time period to time cycle of selecting is recalculated.
Described equipment also comprises:
The 3rd judge module, whether the result recalculated for judgement is within default number range;
Correcting module, for when definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, and adopts the mode of least square method to be revised the data message gathered.
Described equipment also comprises:
The 4th judge module, within the time cycle that judges setting, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting;
Described computing module, report the time delay degree of described data message to surpass the time span of setting specifically for determine described telecommunication apparatus at described the 4th judge module, triggers the described data message collected in the time cycle to described setting and calculated.
Beneficial effect of the present invention is as follows:
The embodiment of the present invention is by N the time cycle for image data information set in advance, when the data message that telecommunication apparatus is produced is gathered, time cycle according to setting is gathered, facilitated the introduction of intermediate data information, effectively the data message of magnanimity is divided into to the intermediate data information of different gradients, intermediate data information is calculated Accuracy Verification for follow-up data information foundation is provided like this, for the data message correction after data message catch of exception and catch of exception provides basis, provide efficiency and the data message of data information acquisition abnormal judging efficiency to occur, intermediate data information is persisted, also guaranteed that data message separates with the read-write of data in inquiry at step-by-step calculation, clash while having avoided mass data information to carry out high-speed computation, improved the efficiency that data message calculates.
The accompanying drawing explanation
The schematic flow sheet of the method for a kind of data information acquisition that Fig. 1 is the embodiment of the present invention one;
Fig. 2 is interior image data information display structure chart of different time cycle in N time cycle;
The schematic flow sheet of a kind of method that data message is detected extremely that Fig. 3 is the embodiment of the present invention two;
The structural representation of the collecting device of a kind of data message that Fig. 4 is the embodiment of the present invention three;
A kind of device structure schematic diagram that data message is detected extremely that Fig. 5 is the embodiment of the present invention four.
Embodiment
In order to realize purpose of the present invention, the embodiment of the present invention provides a kind of data information acquisition, the method and apparatus of data message abnormality detection, by N the time cycle for image data information set in advance, when the data message that telecommunication apparatus is produced is gathered, time cycle according to setting is gathered, facilitated the introduction of intermediate data information, effectively the data message of magnanimity is divided into to the intermediate data information of different gradients, intermediate data information is calculated Accuracy Verification for follow-up data information foundation is provided like this, for the data message correction after data message catch of exception and catch of exception provides basis, provide efficiency and the data message of data information acquisition abnormal judging efficiency to occur, intermediate data information is persisted, also guaranteed that data message separates with the read-write of data in inquiry at step-by-step calculation, clash while having avoided mass data information to carry out high-speed computation, improved the efficiency that data message calculates.
It should be noted that, each embodiment of the present invention is applied in telecommunication apparatus gateway reporting system, or, in the system of other generation magnanimity DBMS information, does not do restriction here.
Below in conjunction with Figure of description, each embodiment of the present invention is described in detail.
Embodiment mono-:
As shown in Figure 1, be the schematic flow sheet of the method for a kind of data information acquisition of the embodiment of the present invention one, described method comprises:
Step 101: from N the time cycle for image data information set in advance, select the cycle very first time.
Wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer.
In step 101, because telecommunication apparatus quantity to be collected is many, the data message amount that telecommunication apparatus produces is also larger, the data message produced in order effectively to gather telecommunication apparatus, be converted to and utilized N for the time cycle of image data information, to transmit and form step by step by the source performance file data message of existing collection telecommunication apparatus.
Wherein, the time that the N set in advance respectively can produce data message according to telecommunication apparatus for time cycle of image data information determines, for example: be divided into hours period, day cycle, month equal time cycle in cycle; Can also be definite to the time of telecommunication apparatus webmaster reporting system reported data information according to telecommunication apparatus.
Alternatively, a described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
Perhaps, by take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle and take the moon number of setting and combine as the time cycle.
It should be noted that, the time cycle of setting need to meet step by step the trend changed, and facilitates like this telecommunication apparatus webmaster reporting system to be integrated or computing the data message of different periods of collecting.
Step 102: according to the cycle very first time of selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
In step 102, after the cycle very first time of determine selecting, select to meet a time interval in this cycle very first time, and gather choosing a time interval in the data message that produces of telecommunication apparatus.
For example: the cycle very first time of selection is: take five minutes as the time cycle, gather the data message that between 8:00～8:05 in morning, telecommunication apparatus produces, as shown in table 1:
Table 1
This shows, time cycle is shorter, and the amount of image data information is less, has alleviated like this pressure of system acquisition data message, and the different time cycle of utilizing division to obtain is gathered the data message of telecommunication apparatus, reaches the purpose of obtaining magnanimity DBMS information.
The data message obtained is reported to described telecommunication apparatus gateway reporting system simultaneously, by described telecommunication apparatus gateway reporting system take the time cycle as five minutes, morning 8:00～8:05 data message generated data information list, and the storage.
Alternatively, after the data message that telecommunication apparatus produces in collection meets each time interval in this cycle very first time, described method also comprises:
Dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected.
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
Particularly, after collecting the data message that in the time interval that meets the cycle very first time, telecommunication apparatus produces, dimension type difference according to producing data message, be divided into the data message collected the sub-dimension collection of data corresponding to different dimensions type further.
For example: the data message that belongs to NE type in the data message collected is extracted, generate the sub-dimension collection of data corresponding to NE type;
The data message that belongs to type of site in the data message just collected extracts, and generates the sub-dimension collection of data corresponding to type of site;
The data message that belongs to the service area type in the data message collected is extracted, generate the sub-dimension collection of data corresponding to service area type;
The data message that belongs to the guarded region type in the data message collected is extracted, generate the sub-dimension collection of data corresponding to guarded region type.
Alternatively, the corresponding sub-dimension collection of data for each the dimension type obtained, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval.
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
Owing to producing the device type difference of data message in telecommunication apparatus, such as: family's level base station and enterprise-level base station, the quantity difference of processing business, the amount that produces data message is also different, but for the different latitude collection when the image data information, do not distinguish the device type that produces data message, therefore, belong to the data message that has comprised the generation of distinct device type in the data message of Same Latitude collection, for the data message that can produce the distinct device type is exactly monitored, data message that can also be concentrated to Same Latitude is divided, according to being divided according to the difference of device type.
Step 103: from N the time cycle for image data information set in advance, selected for the second time cycle.
Wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle.
In step 103, according to the mode that the time cycle goes forward one by one, on the basis in the cycle very first time of selecting, selected for the second time cycle, requirement selects the time span value of the second time cycle to be greater than the time span value in the cycle very first time of selection.
Step 104: according to the second time cycle of selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
In step 104, the multiple relation of the second time cycle of the definite cycle very first time of selecting and selection, for example: the cycle very first time of selection is to take five minutes as the time cycle, selecting for the second time cycle is to take 1 hour as the time cycle, it is 12 times that the so definite cycle very first time and the multiple of the second time cycle close, that is to say, determine the data message produced in the second time cycle of selecting, the data message that 12 cycles very first time of Time Continuous gather need to be integrated or calculated.
For example: suppose that selecting for the second time cycle is to take 1 hour as the time cycle, the cycle very first time is to take 5 minutes as the time cycle, when selecting the time interval corresponding to the second time cycle, be the data message that between 8:00～9:00, telecommunication apparatus produces so, need to meet a plurality of time intervals in the cycle very first time: 8:00～8:05, 8:06～8:10, 8:11～8:15, 8:16～8:20, 8:21～8:25, 8:26～8:30, 8:31～8:35, 8:36～8:40, 8:41～8:45, 8:46～8:50, 8:51～8:55 and 8:56～8:60(are 9:00) during, the data message that each time interval gathers is integrated or is calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
As shown in Figure 2, be the image data information display structure chart in the cycle of different time in N time cycle.
As can be seen from Figure, cycle very first time image data information, as basis, obtains the second time cycle image data information successively ..., N-1 time cycle image data information obtains N time cycle image data information.
Scheme by the embodiment of the present invention one, the N set in advance the time cycle for image data information, when the data message that telecommunication apparatus is produced is gathered, time cycle according to setting is gathered, facilitated the introduction of intermediate data information, effectively the data message of magnanimity is divided into to the intermediate data information of different gradients, intermediate data information is calculated Accuracy Verification for follow-up data information foundation is provided like this, for the data message correction after data message catch of exception and catch of exception provides basis, provide efficiency and the data message of data information acquisition abnormal judging efficiency to occur, intermediate data information is persisted, also guaranteed that data message separates with the read-write of data in inquiry at step-by-step calculation, clash while having avoided mass data information to carry out high-speed computation, improved the efficiency that data message calculates.
Embodiment bis-:
As shown in Figure 3, schematic flow sheet for a kind of method that data message is detected extremely of the embodiment of the present invention two, the embodiment of the present invention two is on the basis of the embodiment of the present invention one, the data message of different time cycle collection is carried out to the method for abnormality detection, and described method comprises:
Step 201: in the process of data information acquisition, judge that telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting, and if not, performs step 202; If, finish abnormality detection, perform step 204.
In step 201, in the process of data acquisition, the data message often received, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period of the time cycle of selecting, for example: time period corresponding to the time cycle of selection is 8:00～8:05, it is 07:59 that telecommunication apparatus reports the time of described data message, judges that so telecommunication apparatus reports the time period of the time cycle of time of described data message and selection not to be complementary; Time period corresponding to time cycle of selecting is 8:00～8:05, and it is 8:03 that telecommunication apparatus reports the time of described data message, judges that so telecommunication apparatus reports the time period of the time cycle of time of described data message and selection to be complementary.
Step 202: determining that telecommunication apparatus reports the time of described data message and the time period that meets the time cycle of selecting not to be complementary, and determines that the data message gathered occurs abnormal.
Alternatively, in step 202, when determining that telecommunication apparatus reports the time of described data message not to be complementary with the time period that meets the time cycle of selecting, in the time cycle that further judgement is set, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting.
For example: due to the reason of system, cause the time of telecommunication apparatus reported data information to occur postponing, but data message reports delay will cause follow-up data to calculate mistake occurs, therefore, the time span that setting is set is used for judging that telecommunication apparatus reports the time delay degree of described data message, can further guarantee the accuracy of subsequent calculations.
Step 203: determining that described telecommunication apparatus reports the time delay degree of described data message to surpass the time span of setting, and triggers the described data message collected in the time cycle to described setting and is calculated.
Alternatively, determining that described telecommunication apparatus reports the time delay degree of described data message not surpass the time span of setting, and triggers the data message produced in the time cycle to described setting and continues to gather.
Step 204: when determining that telecommunication apparatus reports the time of described data message to be complementary with the time period that meets the time cycle of selecting, the described data message collected is calculated.
Step 205: judge that result of calculation is whether within default number range.
Step 206: when definite result of calculation is not within default number range, the data message gathered in the time period to time cycle of selecting is recalculated.
Whether the result that alternatively, further judgement is recalculated is within default number range.
When definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, adopt the mode of least square method to be revised the data message gathered.
Scheme by the embodiment of the present invention two, in real time the data message gathered in the time cycle of setting is carried out to the data exception detection, from calling time, report several aspects such as time delay degree and data result of calculation to be judged, can guarantee the accuracy of image data information like this, improve the efficiency of the abnormal judgement of data message.
Embodiment tri-:
As shown in Figure 4, structural representation for the collecting device of a kind of data message of the embodiment of the present invention three, described collecting device is applied in telecommunication apparatus gateway reporting system, the embodiment of the present invention three is and the invention of the embodiment of the present invention one～embodiment of the present invention two under same inventive concept, described collecting device comprises: first selects module 11 and the first acquisition module 12, wherein:
First selects module 11, for the N from setting in advance the time cycle for image data information, select the cycle very first time, wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer.
The first acquisition module 12, for the cycle very first time according to selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
Alternatively, described equipment also comprises: second selects module 13 and data message computing module 14, wherein:
Second selects module 13, for the N from setting in advance the time cycle for image data information, selects for the second time cycle, and wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle.
Data message computing module 14, for the second time cycle according to selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
Particularly, a described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
Alternatively, described equipment also comprises: dimension is divided module 15, wherein:
Dimension is divided module 15, after the data message that in each time interval that meets this cycle very first time in collection, telecommunication apparatus produces, dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected;
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
Alternatively, described equipment also comprises: device data generation module 16, wherein:
Device data generation module 16, for the data sub-dimension collection corresponding for each the dimension type obtained, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval;
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
It should be noted that, the collecting device that the embodiment of the present invention three relates to, can be the logical block of telecommunication apparatus gateway reporting system, can also be the object entity unit of telecommunication apparatus gateway reporting system, be integrated in telecommunication apparatus gateway reporting system, do not do restriction here.
Embodiment tetra-:
As shown in Figure 5, a kind of device structure schematic diagram that data message is detected extremely for the embodiment of the present invention four, the embodiment of the present invention four is and the method for the embodiment of the present invention one～embodiment of the present invention three under same inventive concept, described equipment comprises: the first judge module 21 and abnormal determination module 22, wherein:
The first judge module 21, for the process at data information acquisition, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting;
Alternatively, described equipment also comprises: computing module 23 and the second judge module 24, wherein:
The second judge module 24, the user with judge that result of calculation is whether within default number range, and, when definite result of calculation is not within default number range, triggering described computing module, the data message gathered in the time period to time cycle of selecting is recalculated.
Alternatively, described equipment also comprises: the 3rd judge module 25 and correcting module 26, wherein:
The 3rd judge module 25, whether the result recalculated for judgement is within default number range;
Correcting module 26, for when definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, adopt the mode of least square method to be revised the data message gathered.
Alternatively, described equipment also comprises: the 4th judge module 27, wherein:
The 4th judge module 27, within the time cycle that judges setting, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting;
Described computing module 23, specifically for determining that at described the 4th judge module described telecommunication apparatus reports the time delay degree of described data message to surpass the time span of setting, and triggers the described data message collected in the time cycle to described setting and is calculated.
It should be noted that, the collecting device that the embodiment of the present invention three relates to, can be the logical block of telecommunication apparatus gateway reporting system, can also be the object entity unit of telecommunication apparatus gateway reporting system, be integrated in telecommunication apparatus gateway reporting system, do not do restriction here.
It will be understood by those skilled in the art that embodiments of the invention can be provided as method, device (equipment) or computer program.Therefore, the present invention can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect fully.And the present invention can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disc store, CD-ROM, optical memory etc.) of computer usable program code one or more.
The present invention describes with reference to flow chart and/or the block diagram of method, device (equipment) and computer program according to the embodiment of the present invention.Should understand can be in computer program instructions realization flow figure and/or block diagram each flow process and/or the flow process in square frame and flow chart and/or block diagram and/or the combination of square frame.Can provide these computer program instructions to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, make the instruction of carrying out by the processor of computer or other programmable data processing device produce for realizing the device in the function of flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame appointments.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, make the instruction be stored in this computer-readable memory produce the manufacture that comprises command device, this command device is realized the function of appointment in flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame.
These computer program instructions also can be loaded on computer or other programmable data processing device, make and carry out the sequence of operations step to produce computer implemented processing on computer or other programmable devices, thereby the instruction of carrying out on computer or other programmable devices is provided for realizing the step of the function of appointment in flow process of flow chart or a plurality of flow process and/or square frame of block diagram or a plurality of square frame.
Although described the preferred embodiments of the present invention, once those skilled in the art obtain the basic creative concept of cicada, can make other change and modification to these embodiment.So claims are intended to all changes and the modification that are interpreted as comprising preferred embodiment and fall into the scope of the invention.
Obviously, those skilled in the art can carry out various changes and modification and not break away from the spirit and scope of the present invention the present invention.Like this, if within of the present invention these are revised and modification belongs to the scope of the claims in the present invention and equivalent technologies thereof, the present invention also is intended to comprise these changes and modification interior.
Claims (18)
1. the acquisition method of a data message, is characterized in that, is applied to, in telecommunication apparatus gateway reporting system, comprising:
From N the time cycle for image data information set in advance, select the cycle very first time, wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer;
According to the cycle very first time of selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
2. the method for claim 1, is characterized in that, described method also comprises:
From N the time cycle for image data information set in advance, selected for the second time cycle, wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle;
According to the second time cycle of selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
3. the method for claim 1, is characterized in that, a described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
4. the method for claim 1, is characterized in that, after the data message that telecommunication apparatus produces in collection meets each time interval in this cycle very first time, described method also comprises:
Dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected;
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
5. method as claimed in claim 4, is characterized in that, described method also comprises:
The corresponding sub-dimension collection of data for each the dimension type obtained, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval;
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
6. method data message detected extremely based on data information acquisition method claimed in claim 1, is characterized in that, comprising:
In the process of data information acquisition, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting;
Determining that telecommunication apparatus reports the time of described data message and the time period that meets the time cycle of selecting not to be complementary, and determines that the data message gathered occurs abnormal.
7. method as claimed in claim 6, is characterized in that, described method also comprises:
When determining that telecommunication apparatus reports the time of described data message to be complementary with the time period that meets the time cycle of selecting, the described data message collected is calculated;
Judge that result of calculation is whether within default number range;
When definite result of calculation is not within default number range, the data message gathered in the time period to time cycle of selecting is recalculated.
8. method as claimed in claim 7, is characterized in that, described method also comprises:
Whether the result that recalculates of judgement is within default number range;
When definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, adopt the mode of least square method to be revised the data message gathered.
9. method as claimed in claim 7, is characterized in that, described method also comprises:
In the time cycle that judgement is set, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting;
Determining that described telecommunication apparatus reports the time delay degree of described data message to surpass the time span of setting, and triggers the described data message collected in the time cycle to described setting and is calculated.
10. the collecting device of a data message, is characterized in that, is applied to, in telecommunication apparatus gateway reporting system, comprising:
First selects module, for the N from setting in advance the time cycle for image data information, select the cycle very first time, wherein, the time span value of N-1 time cycle is less than the time span value of N time cycle, and N is not less than 2 positive integer;
The first acquisition module, for the cycle very first time according to selecting, gather the data message that in each time interval that meets this cycle very first time, telecommunication apparatus produces, and be stored to described telecommunication apparatus gateway reporting system.
11. equipment as claimed in claim 10, is characterized in that, described equipment also comprises:
Second selects module, for the N from setting in advance the time cycle for image data information, selects for the second time cycle, and wherein, the time span value in the described cycle very first time is less than the time span value of described the second time cycle;
The data message computing module, for the second time cycle according to selecting, by meeting the data message that in time interval of this second time cycle, a plurality of cycles very first time gather, calculated, obtain the data message produced in described the second time cycle, and be stored to described telecommunication apparatus gateway reporting system.
12. equipment as claimed in claim 10, is characterized in that, a described N set in advance at least comprises following a kind of for time cycle of image data information:
Take minute length value set as the time cycle, take hour length value set as the time cycle, take the number of days set as the time cycle, take all numbers of setting as the time cycle, the moon number of setting of take is the time cycle.
13. equipment as claimed in claim 10, is characterized in that, described equipment also comprises:
Dimension is divided module, after the data message that in each time interval that meets this cycle very first time in collection, telecommunication apparatus produces, dimension type difference according to producing data message, be divided into the sub-dimension collection of data corresponding to different dimensions type by the data message collected;
Wherein, described dimension type at least comprises following a kind of: NE type, type of site, service area type, guarded region type, equipment manufacturer's type, the whole network type.
14. equipment as claimed in claim 13, is characterized in that, described equipment also comprises:
The device data generation module, the corresponding sub-dimension collection of data for each the dimension type for obtaining, according to the device type that produces data message, determine the data message that the sub-dimension of each data concentrates the distinct device type to produce within the described time interval;
Wherein, described device type at least comprises following a kind of: family's level base station, enterprise-level base station.
15. equipment data message detected extremely based on data information acquisition method claimed in claim 1, is characterized in that, comprising:
The first judge module, for the process at data information acquisition, judge telecommunication apparatus reports the time of described data message whether to be complementary with the time period that meets the time cycle of selecting;
Abnormal determination module, for determining that telecommunication apparatus reports the time of described data message and the time period that meets the time cycle of selecting not to be complementary, and determines that the data message gathered occurs abnormal.
16. equipment as claimed in claim 15, is characterized in that, described equipment also comprises:
Computing module, for when determining that telecommunication apparatus reports the time of described data message to be complementary with the time period that meets the time cycle of selecting, calculated the described data message collected;
The second judge module, the user with judge that result of calculation is whether within default number range, and, when definite result of calculation is not within default number range, triggering described computing module, the data message gathered in the time period to time cycle of selecting is recalculated.
17. equipment as claimed in claim 16, is characterized in that, described equipment also comprises:
The 3rd judge module, whether the result recalculated for judgement is within default number range;
Correcting module, for when definite result of calculation is not within default number range, extract the interior data message gathered of a continuous setting numerical value time period corresponding to time cycle of selecting, and adopts the mode of least square method to be revised the data message gathered.
18. equipment as claimed in claim 16, is characterized in that, described equipment also comprises:
The 4th judge module, within the time cycle that judges setting, telecommunication apparatus reports the time delay degree of described data message whether to surpass the time span of setting;
Described computing module, report the time delay degree of described data message to surpass the time span of setting specifically for determine described telecommunication apparatus at described the 4th judge module, triggers the described data message collected in the time cycle to described setting and calculated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310405119.2A CN103490949A (en) | 2013-09-06 | 2013-09-06 | Method and device for collecting data information and detecting data information anomalies |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310405119.2A CN103490949A (en) | 2013-09-06 | 2013-09-06 | Method and device for collecting data information and detecting data information anomalies |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103490949A true CN103490949A (en) | 2014-01-01 |
Family
ID=49830922
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310405119.2A Pending CN103490949A (en) | 2013-09-06 | 2013-09-06 | Method and device for collecting data information and detecting data information anomalies |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103490949A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015154568A1 (en) * | 2014-08-11 | 2015-10-15 | 中兴通讯股份有限公司 | Data collection optimization method and system, and server |
| CN106815255A (en) * | 2015-11-27 | 2017-06-09 | 阿里巴巴集团控股有限公司 | The method and device of detection data access exception |
| CN110989453A (en) * | 2019-12-20 | 2020-04-10 | 应急管理部天津消防研究所 | Outdoor fire hydrant monitoring system and detection method thereof |
| CN111190788A (en) * | 2019-12-12 | 2020-05-22 | 珠海随变科技有限公司 | Data monitoring method and device, electronic equipment and readable medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1747398A (en) * | 2004-09-08 | 2006-03-15 | 大唐移动通信设备有限公司 | Mass performance data statistical method in network element management system |
| CN101202656A (en) * | 2006-12-15 | 2008-06-18 | 中兴通讯股份有限公司 | Method and apparatus for resource supervising |
| CN101819586A (en) * | 2010-03-31 | 2010-09-01 | 中兴通讯股份有限公司 | Intelligent sorting server and method and system for data statistics |
| CN101997701A (en) * | 2009-08-10 | 2011-03-30 | 中兴通讯股份有限公司 | Data processing method and a device thereof |
-
2013
- 2013-09-06 CN CN201310405119.2A patent/CN103490949A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1747398A (en) * | 2004-09-08 | 2006-03-15 | 大唐移动通信设备有限公司 | Mass performance data statistical method in network element management system |
| CN101202656A (en) * | 2006-12-15 | 2008-06-18 | 中兴通讯股份有限公司 | Method and apparatus for resource supervising |
| CN101997701A (en) * | 2009-08-10 | 2011-03-30 | 中兴通讯股份有限公司 | Data processing method and a device thereof |
| CN101819586A (en) * | 2010-03-31 | 2010-09-01 | 中兴通讯股份有限公司 | Intelligent sorting server and method and system for data statistics |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015154568A1 (en) * | 2014-08-11 | 2015-10-15 | 中兴通讯股份有限公司 | Data collection optimization method and system, and server |
| CN106815255A (en) * | 2015-11-27 | 2017-06-09 | 阿里巴巴集团控股有限公司 | The method and device of detection data access exception |
| CN111190788A (en) * | 2019-12-12 | 2020-05-22 | 珠海随变科技有限公司 | Data monitoring method and device, electronic equipment and readable medium |
| CN111190788B (en) * | 2019-12-12 | 2020-12-22 | 珠海随变科技有限公司 | Data monitoring method and device, electronic equipment and readable medium |
| CN110989453A (en) * | 2019-12-20 | 2020-04-10 | 应急管理部天津消防研究所 | Outdoor fire hydrant monitoring system and detection method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11636379B2 (en) | Distributed cluster training method and apparatus | |
| US10229129B2 (en) | Method and apparatus for managing time series database | |
| CN103530347B (en) | A kind of Internet resources method for evaluating quality based on big data mining and system | |
| JP6503679B2 (en) | Filter rule creation device, filter rule creation method, and program | |
| CN107181604B (en) | Generation method of alarm association rule, alarm compression method and device | |
| CN103490949A (en) | Method and device for collecting data information and detecting data information anomalies | |
| CN102588210A (en) | Filtering method for preprocessing fitting data of power curve | |
| CN102737093A (en) | Data storage apparatus and data storage method | |
| CN102609501B (en) | Data cleaning method based on real-time historical database | |
| CN103869192A (en) | Smart power grid line loss detection method and system | |
| CN105138650A (en) | Hadoop data cleaning method and system based on outlier mining | |
| CN103136244A (en) | Parallel data mining method and system based on cloud computing platform | |
| CN112764993A (en) | Node information collection method, device, equipment and readable storage medium | |
| CN114595210A (en) | Multi-dimensional data anomaly detection method and device and electronic equipment | |
| CN107688589A (en) | The method and device of Database System Optimization | |
| CN103678314B (en) | Mass data processing system, the device and method extracted based on correlation rule | |
| CN106407233A (en) | A data processing method and apparatus | |
| CN103077080A (en) | Method and device for acquiring parallel program performance data based on high performance platform | |
| CN102546235A (en) | Performance diagnosis method and system of web-oriented application under cloud computing environment | |
| CN102215138B (en) | Method and device for detecting network abnormality | |
| CN110263033A (en) | Manage object portrait generation method, terminal device and medium | |
| CN112732517B (en) | Disk fault alarm method, device, equipment and readable storage medium | |
| CN110633270B (en) | Multi-strategy electric meter daily freezing value automatic substitution method and device based on priority | |
| CN112379656A (en) | Processing method, device, equipment and medium for detecting abnormal data of industrial system | |
| CN105606042A (en) | Method and equipment for monitoring deformation of building |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140101 |
|
| RJ01 | Rejection of invention patent application after publication |