CN109714388A - It is a kind of to stop powering on event real-time analyzer and method based on stream process - Google Patents
It is a kind of to stop powering on event real-time analyzer and method based on stream process Download PDFInfo
- Publication number
- CN109714388A CN109714388A CN201811366203.7A CN201811366203A CN109714388A CN 109714388 A CN109714388 A CN 109714388A CN 201811366203 A CN201811366203 A CN 201811366203A CN 109714388 A CN109714388 A CN 109714388A
- Authority
- CN
- China
- Prior art keywords
- event
- power
- message
- powering
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provide it is a kind of stop powering on event real-time analyzer and method based on stream process, the system comprises for receiving message information that terminal reports and generating the front end processor of log, stop the log collection component for powering on the message information of event, the distributed message middleware of message information for receiving and according to the type of message classification caching log collection component for obtaining terminal from the log that the front end processor generates；Distributed caching component for caching base profile information, the stream process component for carrying out stopping powering on event analysis using stream process technology and stopping powering on event analysis result and be pushed to third party system；For storing the columnar database component for stopping powering on event analysis result.The present invention effectively can carry out real-time monitoring to the power-off condition in distribution, so as to shorten power failure response time and emergency repair time, improve power supply reliability.
Description
Technical field
The present invention relates to electric-power metering technical fields, and in particular to a kind of to stop powering on event reality based on distributed stream processing
When analysis system and method.
Background technique
What power supply reliability embodied is ability of the power grid enterprises to user's continued power, directly embodiment enterprise's good service water
It is flat.Shorten power failure emergency repair time, improves service quality particularly important.In order to grasp the operation to power consumer electric power thus supplied in time
Data, State Grid Corporation of China start power information acquisition system and build, and 2015,420,200,000,000 yuan of State Grid Corporation of China's planned investment
Power grid is built, up to 24%, investment amount records high year-on-year amplification again.Wherein, intelligent electric meter 60,600,000 are installed, is realized
3.16 hundred million family power information automatic collections.
With the construction of such extensive power information acquisition system, Utilities Electric Co. needs to fully understand institute compass of competency
Electricity consumption situation, processing in time is abnormal to have a power failure, powers on influence to power supply reliability；However due to the aging of power supply unit, or
The non-standard operation etc. of user, can all lead to abnormal power failure, the generation of electrifying condition of different range, therefore how timely send out
Existing above situation reduces exception to greatest extent and stops powering on the influence caused by power consumer, shortens the time for the repairing that has a power failure, promoted
Working efficiency provides basic data for power distribution network operational monitoring, is the very urgent demand of each provincial electric power company.
The power failure detection in country's centering low-voltage distribution network does not have overall planning or uniform technical principle also at present, most of
Dedicated transformer, common transformer and platform area have a power failure, line outage is still live operator on duty or user by making a phone call announcement
The mode known is transmitted to maintenance personal layer by layer, and there is no special means to carry out real-time monitoring to the power-off condition in distribution, this
Have a power failure response time and emergency repair time are increased, power supply reliability is reduced.
Summary of the invention
Present invention aims at propose it is a kind of stop powering on event real-time analyzer and method based on stream process, with shorten
Have a power failure response time and emergency repair time, raising power supply reliability.
In order to achieve the object of the present invention, the embodiment of the present invention provides a kind of event of stopping powering on based on stream process and analyzes in real time
System, comprising:
Front end processor, for receiving message information that terminal reports and generating log；
Log collection component, the message for stopping powering on event for obtaining terminal from the log that the front end processor generates are believed
Breath；
Distributed message middleware caches the message of the log collection component for receiving and according to type of message classification
Information and classify cache flow processing component terminal stop upper power information, route stops upper power information and Tai Qu stops upper power information；
Distributed caching component, for caching base profile information；
Stream process component, for being obtained using stream process technology and according to the message information of the distributed message middleware
It carries out stopping powering on event analysis with the base profile information of the distributed caching component, and will stop to power on event analysis result and push away
Give third party system；
Columnar database component described stops powering on event analysis result for receiving and storing.
The present embodiment also provide it is a kind of stop powering on event real-time analysis method based on stream process, include the following steps:
S1 front end processor receives the message information that terminal reports and generates corresponding log；
S2 log collection component obtains terminal from the log that the front end processor generates and stops powering on the message information of event；
The message information that S3 distributed message middleware receives and obtained the log collection component according to type of message
Carry out classification caching；
S4 stream process component obtained using stream process technology and according to the message information of the distributed message middleware and
The base profile information of the distributed caching component carries out stopping powering on event analysis, and will stop to power on the transmission of event analysis result
To distributed message middleware, columnar database component and third party system；
S5 distributed message middleware receive and classify cache the stream process component stop powering on event analysis result；Column
Formula database component stops powering on event analysis result described in receiving and storing.
Wherein, the type of message includes event type message and real-time data types message, and the event type includes
Stop powering on event, the real-time data types message includes voltage, current data.
Wherein, described to stop powering on event analysis result to include that terminal stops upper electrical analysis result, route stops upper electrical analysis result
Stop upper electrical analysis result with platform area；
Wherein, distributed message middleware presses terminal, route and three, platform area category classification and caches institute in the step S5
The terminal for stating stream process component stops upper electrical analysis result, route stops upper electrical analysis result and Tai Qu stops upper electrical analysis result.
Wherein, the step S4 stream process component is obtained using stream process technology and according to the distributed message middleware
Message information and the base profile information of the distributed caching component carry out stopping powering on event analysis and specifically include:
S41 using stream process technology obtain the distributed message middleware message information and the distributed caching group
The base profile information of part；
S42 parses the message information；
S43 stops powering on event according to the parsing result analysing terminal of message to be obtained terminal and stops upper electrical analysis result；
S44 according to terminal stops upper electrical analysis result and judges whether corresponding platform area and route stop to power on to obtain route to stop powering on
Analysis result and platform area stop upper electrical analysis result.
Wherein, the step S43 includes stopping upper electroanalysis based on power-off event message analysis and based on voltage, electric current；
It is described to include: based on power-off event message analysis
Pull the message of event type to be treated in real time from allocation message middleware using stream process technology；
Multiple threads, the message information that parallel processing pulls, wherein required base are enabled according to specific server resource
Plinth archive information is obtained from distributed caching component, and is summarized what analysis obtained as a result, being sent to next link；
Enable multiple thread parallels will analyze result cache into distributed message middleware, for subsequent operation；
The analysis that stops powering on based on voltage, electric current includes:
Pull the message of real-time data types to be treated in real time from allocation message middleware using stream process technology；
Multiple threads are enabled according to specific server resource, the message information pulled is parsed and analyzed parallel,
Wherein, required base profile information is obtained from distributed caching component, and by analysis obtain as a result, being sent to next ring
Section is summarized；
Enable multiple thread parallels will analyze result cache into distributed message middleware, for subsequent operation.
It is wherein, described that stop powering on event analysis result to be sent to third party system include: that result will be analyzed in a manner of FTP
Long-range write-in ftp server generates one using timestamp as the text document of filename per minute.
Wherein, the step S43 includes:
The event of stopping powering on sent on terminal is direct is determined as state to be analyzed, can match it is pairs of stop powering on event, sentence
Break effectively to stop to power on event；
The voltage that reports daily to terminal, current data are analyzed, if discovery certain time period three-phase voltage is below
The rated current of 60% and three-phase current no more than 5% of reference voltage then can be regarded as the power off time of terminal, and by after
Voltage is higher than power-on time of the time of the first time of reference voltage 78% as terminal, and intermediate time interval is as terminal
Power-off event duration, state are judged to surveying wait call together；
Acquisition terminal has a power failure and triggers what power-off event reported, and online rear terminal address changes again, it should fixed
This time power-off event is that normal terminal debugs rotation to justice, if terminal address does not change, it is possible to determine that be invalid power failure
Event；
For power-off event data it is frequent on give, power on event if there is matched, then that matched power-off event
For effective power-off event, others are considered as invalid power-off event, are rejected, otherwise also set up；
The not pairs of matched terminal of power off time and power-on time generates power-off event in power-off event data, and is more than
Preset time does not power on event, then is judged to abnormal power-off event；
The logic error of power off time and power-on time in power-off event data, then be judged to invalid power-off event.
That time obvious exception is sent on power-off event is considered as terminal fault, while judging whether same day voltage, electric current meet
Power failure Rule of judgment is alerted or is rejected if conditions are not met, being judged as invalid power-off event；
Judge whether power off time interval is less than power off time minimum significant interval or maximum effectively more than power off time
Interval, then be judged to invalid power-off event；
It is rejected record is repeated in repetition power-off event data that terminal reports；
According to the overlapping cases of power off time, to user's power-off event of same route, same area, a situation arises carries out
Statistical analysis.
Wherein, stopped on upper electrical analysis result judges whether corresponding platform area and route stop in the step S44 according to terminal
Electricity obtains route to stop upper electrical analysis result including: according to the statistic analysis result of step S43, if all terminals under an area Ge Tai
Meet the judgement of power-off event, then it is assumed that this area has a power failure.
Wherein, stopped on upper electrical analysis result judges whether corresponding platform area and route stop in the step S44 according to terminal
Electricity obtain platform area stop upper electrical analysis result include: according to the statistic analysis result of step S43, if under a route, same
Period meets when stopping powering on the terminal of event and accounting for that total number of terminals accounting reaches preset ratio under the route, is then judged as the route
Have a power failure.
The embodiment of the present invention has the advantages that
Present invention method is in a distributed manner based on stream process technology, in conjunction with distributed distributed message middleware,
The advanced efficient processing technique such as massive logs collection assembly and columnar database, distributed caching, to the report sent in terminal
Literary information is analyzed in real time, to repeating, fail to report, exception and the terminal of specially treated is needed (such as to need to recruit survey electric energy meter
Stop powering on event to judge terminal stop electrifying condition) stop powering on event and be analyzed, and then judge to put into effect area, route stops
Electrifying condition is pushed to external system finally in a manner of ftp file, entire to handle using the main foundation repaired as distribution
Process handling capacity is high, substantially non-delay, effectively carries out real-time monitoring to the power-off condition in distribution, so as to shorten having a power failure
Response time and emergency repair time improve power supply reliability.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 stops powering on event real-time analyzer frame diagram based on stream process to be a kind of in the embodiment of the present invention one.
Fig. 2 stops powering on event real-time analysis method flow chart based on stream process to be a kind of in the embodiment of the present invention two.
Fig. 3 stops powering on event real-time analysis method detailed process based on stream process to be a kind of in the embodiment of the present invention two
Figure.
Fig. 4 is stream process flow chart described in the embodiment of the present invention two.
Fig. 5 is distributed caching operational flowchart described in the embodiment of the present invention two.
Specific embodiment
Various exemplary embodiments, feature and the aspect of the disclosure are described in detail below with reference to attached drawing.It is identical in attached drawing
Appended drawing reference indicate element functionally identical or similar.Although the various aspects of embodiment are shown in the attached drawings, remove
It non-specifically points out, it is not necessary to attached drawing drawn to scale.
In addition, in order to better illustrate the present invention, numerous details is given in specific embodiment below.This
Field is it will be appreciated by the skilled person that without certain details, the present invention equally be can be implemented.In some instances, for this
Means known to the technical staff of field, element and circuit are not described in detail, in order to highlight purport of the invention.
As shown in Figure 1, the embodiment of the present invention one provide it is a kind of stop powering on event real-time analyzer based on stream process, packet
It includes:
Front end processor 1, for receiving message information that terminal reports and generating log；
Distributed information log collection assembly Flume 2, for directly being obtained eventually from the log that front end processor printing generates
Stop powering on the message information of event in end；
Distributed message middleware KAFKA 3, for receiving and caching the log collection group according to type of message classification
On the terminal of the message information of part and cache flow processing component of classifying stops upper power information, route stops upper power information and Tai Qu stops
Power information；
Distributed caching component MEMCACHED 4, for caching base profile information；
Stream process component STORM 5, the stream process component STORM are by configuration, as the consumer of message-oriented middleware,
It is used to obtain using stream process technology and according to the message information and the distributed caching of the distributed message middleware
The base profile information of component carries out stopping powering on event analysis, and will stop to power on event analysis result and be pushed to third party system 6；
Wherein, in the present embodiment third party system 6 refer to distribution repair platform, it is described analysis result can be used as distribution repairing it is main according to
According to.
Columnar database component HBASE 7 described stops powering on event analysis result for receiving and storing.
As shown in Fig. 2, the present embodiment two also provides and a kind of stops powering on event real-time analysis method, the party based on stream process
Method is the analysis method of system described in embodiment one, is included the following steps:
S1 front end processor receives the message information that terminal reports and generates corresponding log；
Specifically, the message sent in terminal is saved in text file by the front end processor, this document is with timestamp
Filename generates a file per minute.
The log collection component that S2 is operated on front end processor obtains terminal from the log that the front end processor generates and stops powering on
The message information of event；
Specifically, time of the log collection component according to front end processor message file generated, the reading message information of sequence,
And judge that it is event message or real time data (voltage, electric current) message, log collection component according to the type of message data
As the producer of message-oriented middleware, message information is stored in message-oriented middleware according to type of message and is cached, wait disappear
Person's of expense (stream process component) carries out the analysis of next link.
The message information that S3 distributed message middleware receives and obtained the log collection component according to type of message
Carry out classification caching；
Wherein, in order to avoid handling delay due to caused by the otherness of processing speed between various components in frame, this
Inventive embodiments use distributed message middleware as caching, to original message, stop upper electrical analysis result and in real time
Load data (voltage, electric current) carries out classification caching.
S4 stream process component obtained using stream process technology and according to the message information of the distributed message middleware and
The base profile information of the distributed caching component carries out stopping powering on event analysis, and will stop to power on the transmission of event analysis result
To distributed message middleware, columnar database component and third party system；
S5 distributed message middleware receive and classify cache the stream process component stop powering on event analysis result；Column
Formula database component stops powering on event analysis result described in receiving and storing.
Distributed column storing data library HBASE is utilized in the storage of the present embodiment analysis result, the component read-write efficiency
Height supports a large amount of concurrent, the data for relatively write-once being suitble to repeatedly to read.The analysis data stored in HBASE are mainly used to
Inquiry, or the basic data excavated as upper layer data.
Specifically, obtain stop powering on as a result, according to terminal, platform area and route three via stream process block analysis
A dimension, is buffered in message-oriented middleware respectively, due to directly pushing or solidifying storage, it is possible to influence stream process component
The treatment effeciency of Storm due to the exception of external module (or system), and causes to hinder during storage or push
Plug flow handles thread.The analysis of caching is as a result, have other special storages or push thread completion operation, to improve cluster
Stability ensures the process performance of cluster.
Wherein, the type of message includes event type message and real-time data types message, and the event type includes
Stop powering on event, the real-time data types message includes voltage, current data.Specifically, log collection component Flume from
Message is extracted in the output document of front end processor, therefrom parses function code AFN, the type of the message data is judged according to function,
According to the difference of type, message is cached respectively, to improve the parallel processing capability of program and the reusability of data.
Wherein, described to stop powering on event analysis result to include that terminal stops upper electrical analysis result, route stops upper electrical analysis result
Stop upper electrical analysis result with platform area；
Wherein, distributed message middleware presses terminal, route and three, platform area category classification and caches institute in the step S5
The terminal for stating stream process component stops upper electrical analysis result, route stops upper electrical analysis result and Tai Qu stops upper electrical analysis result.
The step S4 stream process component is obtained using stream process technology and according to the report of the distributed message middleware
Literary information and the base profile information of the distributed caching component, which carry out stopping powering on event analysis, to be specifically included:
S41 using stream process technology obtain the distributed message middleware message information and the distributed caching group
The base profile information of part；
S42 parses the message information；
S43 stops powering on event according to the parsing result analysing terminal of message to be obtained terminal and stops upper electrical analysis result；
S44 according to terminal stops upper electrical analysis result and judges whether corresponding platform area and route stop to power on to obtain route to stop powering on
Analysis result and platform area stop upper electrical analysis result.
In order to improve the execution efficiency of stream process frame to greatest extent, the embodiment of the present invention is whole by the step S43's
A analytic process is cut into two big modules: stopping upper electroanalysis based on power-off event message analysis and based on voltage, electric current；
It is described to include: based on power-off event message analysis
A1 pulls the message of event type to be treated using stream process technology in real time from allocation message middleware, should
Step does not do any operational processing, and the message pulled is directly sent to next step；
A2 enables multiple threads, the message information that parallel processing pulls, wherein required according to specific server resource
Base profile information is obtained from distributed caching component, and is summarized what analysis obtained as a result, being sent to next link；
A3 enable multiple thread parallels will analysis result cache into distributed message middleware, for subsequent operation,
Process is as shown in Figure 4.
The analysis that stops powering on based on voltage, electric current includes:
B1 pulls the report of real-time data types to be treated using stream process technology in real time from allocation message middleware
Literary (voltage, electric current real time data), which does not do any operational processing, is directly sent to the message pulled next
Step；
B2 enables multiple threads according to specific server resource, and the message information pulled is parsed and divided parallel
Analysis, wherein required base profile information is obtained from distributed caching component, and by analysis obtain as a result, being sent to down
One link is summarized；
B3 enable multiple thread parallels will analysis result cache into distributed message middleware, for subsequent operation,
Process is as shown in Figure 4.
Wherein, stopping powering in analytic process, due to needing a large amount of base profile information, for example, on judging that platform area stops
Electric situation needs to obtain the mapping relations of platform area and terminal, judges that route stops electrifying condition, needs to obtain opening up for platform area and route
Flutter relationship.The embodiment of the present invention has selected Memcached as cache database, and a large amount of file data is cached to more clothes
Be engaged on device node, due to directly obtaining from memory when access, and support a large amount of concurrent operations, thus efficiency much higher than directly from
It is obtained in relevant database Oracle 8, framework and operating process are as shown in Figure 5.
It is wherein, described that stop powering on event analysis result to be sent to third party system include: that result will be analyzed in a manner of FTP
Long-range write-in ftp server generates one using timestamp as the text document of filename per minute.
Specifically, the upper power information of stopping for stopping terminal, platform area and the route that upper electroanalysis obtains is mainly distribution repairing
Platform provides the foundation of repairing, and as module independent in the embodiment of the present invention, it is remote which will analyze result in a manner of FTP
Ftp server is written in journey, generates one per minute using timestamp as the text document of filename, user program is arranged with filename
Sequence, sequence are read, and delete file after being disposed；The document format that FTP is written is as shown in the table.
1 ftp file transformat of table
Wherein, stopping powering in real-time analytic process, for analyzing terminal and whether have occurred and stop powering on promptly and accurately
Event, the embodiment of the present invention is used stops powering on two methods of event message and real-time load data based on analysis, wherein counterweight
Stop powering on event again and be rejected, it is to having a power failure, powering on event unmatched, it surveys ammeter event by recruiting and judges；Finally, with end
End is stopped based on powering on event, stops electrifying condition judge platform area and route.
Wherein, main website stops power-on time according to terminal and judges that terminal stops powering on event, and specific decision logic is as follows:
1) terminal it is direct on the event of stopping powering on sent be determined as state to be analyzed；Can matching it is pairs of stop power on event,
It is judged as and effectively stops powering on event.
2) main website backstage carries out backstage judgement according to the voltage of all terminals, electric current, extrapolates these terminals and stops powering on
Time, judgment rule are as follows:
Voltage that system reports terminal daily, current data are analyzed, if discovery certain time period three-phase voltage is equal
Lower than 60% (massive quantity power supply and measurement judges A, C phase) of reference voltage, and (height is for height for rated current of the three-phase current no more than 5%
Meter judges A, C phase), then it can be regarded as the power off time of the terminal, and voltage higher than reference voltage 78% (sentence by massive quantity power supply and measurement by after
Disconnected A, C phase) first time power-on time of the time as the terminal, power off time of the intermediate interval as the terminal, shape
State judges to survey wait call together, and completion is labeled as stopping powering on equal completion.
3) acquisition terminal has a power failure and triggers what power-off event reported, and online rear terminal address changes again, it should
Defining this power-off event is that normal terminal debugs rotation, if terminal address does not change, it is possible to determine that stop for invalid
Electric event.
4) for power-off event data it is frequent on send (such as report 10 times or more power-off event data in single terminal one day
), event is powered on if there is matched, then that matched power-off event is effective power-off event, and others are considered as in vain
Power-off event, rejected, otherwise also set up.
5) power failure is generated in power-off event data in the not pairs of reflexless terminal or electric energy meter of power off time and power-on time
Event, and be more than that preset time (such as 3 days) do not power on event, it is not judged to abnormal power-off event then in pairs.It is azygous to stop
2 kinds of situation discussion of electric event point:
The first situation: powering on event and without power-off event.At this time if met: this is powered on before event 1 minute to 3 days
Inside there is reference voltage (massive quantity power supply and measurement judge A, C phase) of the three-phase voltage simultaneously less than 60%, and three-phase current is no more than 5%
Rated current (massive quantity power supply and measurement judges A, C phase)；Or the terminal power on event before there is no uplink log in 60 minutes, be judged as to
Call survey together, completion stops powering on event labeled as power-off event completion, and is updated to the power off time for the event that powers on to power on event
The preceding time point for having voltage and current or uplink log recently.If this has corresponding power-off event in 3 days before powering on event,
Then state is judged as and effectively stops powering on event, if it exceeds 3 days do not have voltage and current, switchs to invalid power on event.
Second situation: there is power-off event, but nothing powers on event.After if power-off event occurs, (present invention is or not 1 minute
It is limited to 1 minute, configuration can be reasonably adjusted)-to 78% reference voltage is simultaneously greater than there are three-phase voltage in the same day, (massive quantity power supply and measurement is sentenced
Disconnected A, C phase) or have message information, then completion powers on event, and the event of earliest complete fulfillment rule is power-on time, then judges
For wait call together survey, completion be labeled as power on event completion stop power on event；If judging time memory to current after power-off event
It reference voltage (massive quantity power supply and measurement judge A, C phase) less than 60% or is arrived after there is no voltage or power-off event simultaneously in three-phase voltage
Currently judge there is no uplink log in the time, is then judged as power failure and power-off event before the deadline switched to nothing more than 3 days
The power-off event of effect.
6) in power-off event data power off time and power-on time logic error
Power-on time earlier than power off time, stop/power-on time occur for phenomena such as empty or messy code when, then be judged to invalid stop
Electric event.
7) sent on power-off event the time it is obvious abnormal be considered as terminal fault (such as when installing earlier than electric energy meter or terminal
Between), while judging whether same day voltage, electric current meet power failure Rule of judgment, if conditions are not met, being judged as invalid power failure thing
Part is alerted or is rejected.
8) power-off event duration too short or too long judgement power off time (powers on Time To Event-power failure thing
Part time of origin) it is less than power off time minimum significant interval (such as 1 minute, the invention is not limited thereto), or be more than when having a power failure
Between maximum significant interval (such as 3 days, the invention is not limited thereto), then be judged to invalid power-off event.Power off time is min/max
Significant interval is arranged by examination threshold parameters.
9) the repetition power-off event data that terminal reports are rejected to record is repeated.
10) topological relation between " route-platform area " is combined to carry out user's power-off event association analysis function, i.e. root
According to the overlapping cases of power off time, to user's power-off event of same route, same area, that a situation arises is for statistical analysis, auxiliary
It helps and carries out line outage, the judgement that platform area has a power failure.
(2) platform area stops powering on
If all terminals or concentrator meet the judgement of power-off event under an area Ge Tai, then it is assumed that this area has a power failure.
(3) route stops powering on
If under a route, at same period (configurable, such as 30 minutes), satisfaction stops powering on event terminal and concentration
Device (state include effectively, completion and undetermined) accounts for terminal and concentrator sum accounting under the route, when accounting reaches the ratio of setting
When example (ratio can configure in system parameter table), then it is assumed that meet the judgement of line outage event, system is judged as the route
Have a power failure.
By the descriptions of above embodiments it is found that present invention method is in a distributed manner based on stream process technology, knot
It is advanced efficiently to close distributed distributed message middleware, massive logs collection assembly and columnar database, distributed caching etc.
Processing technique, the message information sent in terminal is analyzed in real time, to repeating, fail to report, exception and need specially treated
Terminal (such as need to recruit survey electric energy meter stop powering on event to judge terminal stop electrifying condition) stop powering on event and be divided
Analysis, so judge to put into effect area, route stops electrifying condition, finally in a manner of ftp file, be pushed to external system, using as
The main foundation of distribution repairing, entire treatment process handling capacity is high, substantially non-delay, effectively to the power-off condition in distribution
Real-time monitoring is carried out, so as to shorten power failure response time and emergency repair time, improves power supply reliability.
Various embodiments of the present invention are described above, above description is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes are obvious for the those of ordinary skill in art field.The selection of term used herein, purport
In principle, the practical application or to the technological improvement in market for best explaining each embodiment, or make the art its
Its those of ordinary skill can understand each embodiment disclosed herein.
Claims (10)
1. a kind of stop powering on event real-time analyzer based on stream process characterized by comprising
Front end processor, for receiving message information that terminal reports and generating log；
Log collection component, the message information for stopping powering on event for obtaining terminal from the log that the front end processor generates；
Distributed message middleware, for receiving and being believed according to the message that type of message classification caches the log collection component
Breath；
Distributed caching component, for caching base profile information；
Stream process component, for being obtained using stream process technology and according to the message information of the distributed message middleware and institute
The base profile information for stating distributed caching component carries out stopping powering on event analysis, and will stop to power on event analysis result and be pushed to
Third party system；
Columnar database component described stops powering on event analysis result for storing.
2. the analysis method for stopping powering on event real-time analyzer based on stream process as described in claim 1, which is characterized in that
Include the following steps:
S1 front end processor receives the message information that terminal reports and generates corresponding log；
S2 log collection component obtains terminal from the log that the front end processor generates and stops powering on the message information of event；
S3 distributed message middleware is received and is carried out according to the message information that type of message obtains the log collection component
Classification caching；
S4 stream process component is obtained using stream process technology and according to the message information of the distributed message middleware and described
The base profile information of distributed caching component carries out stopping powering on event analysis, and will stop to power on event analysis result and be sent to point
Cloth message-oriented middleware, columnar database component and third party system；
S5 distributed message middleware receive and classify cache the stream process component stop powering on event analysis result；Column number
It is received and stored according to library component and described stops powering on event analysis result.
3. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 2
In, the type of message includes event type message and real-time data types message, and the event type includes stopping powering on event,
The real-time data types message includes voltage, current data.
4. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 3
In described to stop powering on event analysis result and include that terminal stops upper electrical analysis result, route stops upper electrical analysis result and on Tai Qu stops
Electrical analysis result；
Wherein, distributed message middleware presses terminal, route and three, platform area category classification and caches the stream in the step S5
The terminal of processing component stops upper electrical analysis result, route stops upper electrical analysis result and Tai Qu stops upper electrical analysis result.
5. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 4
In the step S4 stream process component is obtained using stream process technology and according to the message information of the distributed message middleware
It carries out stopping powering on event analysis with the base profile information of the distributed caching component and specifically include:
S41 obtains the message information and the distributed caching component of the distributed message middleware using stream process technology
Base profile information；
S42 parses the message information；
S43 stops powering on event according to the parsing result analysing terminal of message to be obtained terminal and stops upper electrical analysis result；
S44 according to terminal stops upper electrical analysis result and judges whether corresponding platform area and route stop to power on to obtain route to stop upper electroanalysis
As a result stop upper electrical analysis result with platform area.
6. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 5
It include stopping upper electroanalysis based on power-off event message analysis and based on voltage, electric current in, the step S43；
It is described to include: based on power-off event message analysis
Pull the message of event type to be treated in real time from allocation message middleware using stream process technology；
Multiple threads, the message information that parallel processing pulls, wherein required basic shelves are enabled according to specific server resource
Case information is obtained from distributed caching component, and is summarized what analysis obtained as a result, being sent to next link；
Enable multiple thread parallels will analyze result cache into distributed message middleware, for subsequent operation；
The analysis that stops powering on based on voltage, electric current includes:
Pull the message of real-time data types to be treated in real time from allocation message middleware using stream process technology；
Multiple threads are enabled according to specific server resource, the message information pulled is parsed and analyzed parallel, wherein
Required base profile information is obtained from distributed caching component, and will analysis obtain as a result, be sent to next link into
Row summarizes；
Enable multiple thread parallels will analyze result cache into distributed message middleware, for subsequent operation.
7. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 6
In described to stop powering on event analysis result to be sent to third party system include: that analysis result is remotely written in a manner of FTP
Ftp server generates one using timestamp as the text document of filename per minute.
8. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 7
In the step S43 includes:
The event of stopping powering on sent on terminal is direct is determined as state to be analyzed, can match it is pairs of stop powering on event, be judged as
Effectively stop powering on event；
The voltage that reports daily to terminal, current data are analyzed, if discovery certain time period three-phase voltage is below reference
The rated current of 60% and three-phase current no more than 5% of voltage then can be regarded as the power off time of terminal, and voltage is high by after
In power-on time of the time as terminal of the first time of reference voltage 78%, power failure thing of the intermediate time interval as terminal
Part duration, state are judged to surveying wait call together；
Acquisition terminal has a power failure and triggers what power-off event reported, and online rear terminal address changes again, it should define this
Secondary power-off event is that normal terminal debugs rotation, if terminal address does not change, it is possible to determine that is invalid power-off event；
For power-off event data it is frequent on give, if there is matched power on event, then that matched power-off event is to have
The power-off event of effect, others are considered as invalid power-off event, are rejected, otherwise also set up；
The not pairs of matched terminal of power off time and power-on time generates power-off event in power-off event data, and is more than default
Time does not power on event, then is judged to abnormal power-off event；
The logic error of power off time and power-on time in power-off event data, then be judged to invalid power-off event；
That time obvious exception is sent on power-off event is considered as terminal fault, while judging whether same day voltage, electric current meet power failure
Rule of judgment is alerted or is rejected if conditions are not met, being judged as invalid power-off event；
Judge power off time interval whether be less than power off time minimum significant interval or be more than power off time maximum significant interval,
Then it is judged to invalid power-off event；
It is rejected record is repeated in repetition power-off event data that terminal reports；
According to the overlapping cases of power off time, to user's power-off event of same route, same area, a situation arises counts
Analysis.
9. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 8
In stopping upper electrical analysis result according to terminal in the step S44 and judge whether corresponding platform area and route stop to power on to obtain route
Stopping upper electrical analysis result includes: according to the statistic analysis result of step S43, if all terminals meet power failure thing under an area Ge Tai
The judgement of part, then it is assumed that this area has a power failure.
10. the analysis method for stopping powering on event real-time analyzer based on stream process, feature exist as claimed in claim 9
In stopping upper electrical analysis result according to terminal in the step S44 and judge whether corresponding platform area and route stop to power on to obtain platform area
Stopping upper electrical analysis result includes: according to the statistic analysis result of step S43, if, in the same period, satisfaction is stopped under a route
When powering on the terminal of event and accounting for that total number of terminals accounting reaches preset ratio under the route, then it is judged as the line outage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811366203.7A CN109714388A (en) | 2018-11-16 | 2018-11-16 | It is a kind of to stop powering on event real-time analyzer and method based on stream process |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811366203.7A CN109714388A (en) | 2018-11-16 | 2018-11-16 | It is a kind of to stop powering on event real-time analyzer and method based on stream process |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109714388A true CN109714388A (en) | 2019-05-03 |
Family
ID=66254902
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811366203.7A Pending CN109714388A (en) | 2018-11-16 | 2018-11-16 | It is a kind of to stop powering on event real-time analyzer and method based on stream process |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109714388A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110244163A (en) * | 2019-06-20 | 2019-09-17 | 国网湖南省电力有限公司 | Stop send a telegram in reply event hierarchy intelligence analysis method and device in a kind of area |
| CN110690761A (en) * | 2019-10-22 | 2020-01-14 | 宁波三星医疗电气股份有限公司 | Power-off event determining method, power terminal and power system |
| CN110750403A (en) * | 2019-10-25 | 2020-02-04 | 宁波三星智能电气有限公司 | Power-off test method based on power terminal and related device |
| CN111143314A (en) * | 2019-12-26 | 2020-05-12 | 厦门服云信息科技有限公司 | Log analysis method and system based on high-speed streaming processing technology |
| CN111562460A (en) * | 2020-03-24 | 2020-08-21 | 广东电网有限责任公司广州供电局 | Power distribution network power failure event detection research and judgment method, device, computer equipment and medium |
| CN112468359A (en) * | 2020-11-10 | 2021-03-09 | 许继集团有限公司 | Log acquisition system and method for power system Internet of things edge Internet of things agent device |
| CN112804331A (en) * | 2021-01-14 | 2021-05-14 | 杭州海兴泽科信息技术有限公司 | Electric energy meter data processing method and system based on message bus and electric energy meter |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106483406A (en) * | 2016-09-30 | 2017-03-08 | 国家电网公司 | A kind of method of low-voltage power client's outage information data acquisition |
| CN106502772A (en) * | 2016-10-09 | 2017-03-15 | 国网浙江省电力公司信息通信分公司 | Electric quantity data batch high speed processing method and system based on distributed off-line technology |
| US20180074852A1 (en) * | 2016-09-14 | 2018-03-15 | Salesforce.Com, Inc. | Compact Task Deployment for Stream Processing Systems |
-
2018
- 2018-11-16 CN CN201811366203.7A patent/CN109714388A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180074852A1 (en) * | 2016-09-14 | 2018-03-15 | Salesforce.Com, Inc. | Compact Task Deployment for Stream Processing Systems |
| CN106483406A (en) * | 2016-09-30 | 2017-03-08 | 国家电网公司 | A kind of method of low-voltage power client's outage information data acquisition |
| CN106502772A (en) * | 2016-10-09 | 2017-03-15 | 国网浙江省电力公司信息通信分公司 | Electric quantity data batch high speed processing method and system based on distributed off-line technology |
Non-Patent Citations (1)
| Title |
|---|
| 周振龙: "用电信息采集系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110244163A (en) * | 2019-06-20 | 2019-09-17 | 国网湖南省电力有限公司 | Stop send a telegram in reply event hierarchy intelligence analysis method and device in a kind of area |
| CN110244163B (en) * | 2019-06-20 | 2022-03-11 | 国网湖南省电力有限公司 | Intelligent stage-level studying and judging method and device for power failure and recovery events of transformer area |
| CN110690761A (en) * | 2019-10-22 | 2020-01-14 | 宁波三星医疗电气股份有限公司 | Power-off event determining method, power terminal and power system |
| CN110750403A (en) * | 2019-10-25 | 2020-02-04 | 宁波三星智能电气有限公司 | Power-off test method based on power terminal and related device |
| CN110750403B (en) * | 2019-10-25 | 2023-10-24 | 宁波三星智能电气有限公司 | Power-on-off electric measurement method based on power terminal and related device |
| CN111143314A (en) * | 2019-12-26 | 2020-05-12 | 厦门服云信息科技有限公司 | Log analysis method and system based on high-speed streaming processing technology |
| CN111562460A (en) * | 2020-03-24 | 2020-08-21 | 广东电网有限责任公司广州供电局 | Power distribution network power failure event detection research and judgment method, device, computer equipment and medium |
| CN112468359A (en) * | 2020-11-10 | 2021-03-09 | 许继集团有限公司 | Log acquisition system and method for power system Internet of things edge Internet of things agent device |
| CN112804331A (en) * | 2021-01-14 | 2021-05-14 | 杭州海兴泽科信息技术有限公司 | Electric energy meter data processing method and system based on message bus and electric energy meter |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109714388A (en) | It is a kind of to stop powering on event real-time analyzer and method based on stream process | |
| CN108665186B (en) | Distribution transformer overload power failure monitoring method and device based on metering automation system | |
| CN105427039A (en) | Efficient processing method of distribution network repair work orders based on responsibility areas | |
| CN110806518B (en) | Transformer area line loss abnormal motion analysis module and operation method thereof | |
| CN111562460B (en) | Power distribution network power failure event detection research and judgment method, device, computer equipment and medium | |
| CN109345786A (en) | A kind of non-resident user power utilization abnormal conditions automatic alarm system of low pressure | |
| CN112287548B (en) | Power distribution network real-time monitoring method and device based on broadband network | |
| CN115061013B (en) | Low-voltage common fault studying and judging method and system based on power failure event big data analysis | |
| CN111667143A (en) | Method for realizing fusion of real-time monitoring data and service management data in power grid dispatching | |
| CN110555583A (en) | method for uniformly processing wide-area operation data of intelligent power grid dispatching control system | |
| CN116522746A (en) | Power distribution hosting method for high-energy-consumption enterprises | |
| CN209911524U (en) | Power failure detection terminal | |
| CN116756506A (en) | Regional cable network carbon emission detection method, system, device and storage medium | |
| CN111062191A (en) | Operation ticket generation method and device for power grid | |
| CN110703019A (en) | Power consumption abnormity accurate positioning method based on collected information of power transmission line | |
| CN110705916A (en) | Method and system for judging small and micro load electric quantity of transformer | |
| CN110750760A (en) | Abnormal theoretical line loss detection method based on situation awareness and control chart | |
| CN116739550A (en) | Intelligent auxiliary decision-making method and system for rush repair | |
| CN110163539B (en) | Analysis and judgment method for power failure fault of user side of low-voltage distribution station area | |
| CN108414851B (en) | Intelligent checking method based on EMS theory electric quantity data and collected electric quantity data | |
| CN112308348A (en) | Intelligent analysis method for medium-voltage line loss abnormity | |
| CN111813825A (en) | Distribution transformer outlet power failure event missing report automatic detection method and system | |
| CN110598805A (en) | Method and system for identifying monitoring information of power system | |
| CN112446619B (en) | Power distribution network rush-repair processing method and device | |
| CN214150893U (en) | Modular terminal for classified recording of state data of power distribution equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190503 |
|
| RJ01 | Rejection of invention patent application after publication |