CN103282880B - A kind of method for stream processing and device - Google Patents
A kind of method for stream processing and device Download PDFInfo
- Publication number
- CN103282880B CN103282880B CN201180003717.6A CN201180003717A CN103282880B CN 103282880 B CN103282880 B CN 103282880B CN 201180003717 A CN201180003717 A CN 201180003717A CN 103282880 B CN103282880 B CN 103282880B
- Authority
- CN
- China
- Prior art keywords
- event
- window
- current stream
- expression formula
- keyword
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 179
- 238000004364 calculation method Methods 0.000 claims description 11
- 230000001351 cycling effect Effects 0.000 claims description 2
- 108010001267 Protein Subunits Proteins 0.000 claims 2
- 238000012217 deletion Methods 0.000 claims 1
- 230000037430 deletion Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 5
- 230000014759 maintenance of location Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 241001627144 Iris versicolor Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000006116 polymerization reaction Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a kind of method for stream processing and device, the method includes: receive the event belonging to current stream process window；Belong to current stream described in caching and process the event of window；Judge that the current stream that belongs to cached processes the most satisfied first expression formula relevant with the first keyword of event of window；When judged result is for being unsatisfactory for described first expression formula, does not delete the current stream that belongs to cached and process the event of window, and receive the next event belonging to current stream process window；When judged result is for meeting described first expression formula, the current stream that belongs to cached according to described first keyword output processes the event of window, and the current stream that belongs to that wherein said first keyword has cached for indicating output processes window and meets the event of described first expression formula.Use the present invention, can be in the case of not using more rules nesting, it is achieved meet the output of whole events of condition.
Description
Technical field
The present invention relates to Complex event processing field, particularly relate to a kind of method for stream processing and device.
Background technology
Information processing system needs data volume to be processed increasing at present, and requirement of real-time is more and more higher.
Complex event processing (Complex Event Processing, CEP) technology is a kind of emerging based on flow of event
Data processing technique.System data is regarded as different types of flow of event by it, between analysis event
Relation, the incidence relation detecting, setting up between different event, and utilize filtration, associate, the technology such as polymerization,
Finally produced by simple event, trigger advanced event or business procedure.It is different from traditional database technology,
CEP technology is not the mass data processing static storage, but has the data of timing to dynamically generation
Stream processes in real time, to finding relation schema between a large amount of different event, exception, scarce
Mistake, level etc..
In CEP system, when there being event to flow to, query statement acts on continuously/performs and (i.e. carried out
Filter, association etc. operate) in event.Owing to event is continuously through CEP system, therefore, exist
During CEP processes, generally requiring one window of definition, inquiry is generally based on this specific window and counts
Calculate.Such as: for stock flow of event, the average of all stocks in statistics last minute；Or statistics
The stock average of last 100 transaction.
Query statement in CEP system has various ways to be described, continuous-query language
(Continuous Query Language, CQL) is that one preferably describes language.CQL be a kind of based on
The description language of SQL, can carry out continuous-query for flow data.EPL(Event Process Language)
It it is the stream process description language of a kind of type of structured query language (Structured Query Language, SQL)
Speech, describes language based on SQL and adds, the window that processes for stream, the descriptive power such as pattern.
In EPL language, FROM clause followed by stream title (assuming to flow entitled S), and
What the definition that ". " is later after stream title represented is then the concept of window.Such as: Select*From S.
Win:time (60sec), then it represents that the stream offered 60 seconds for stream S processes window.In EPL, mainly have
The most several windows: time slide window (being expressed as S.win:time (60sec)), quantity sliding window (table
Be shown as S.win:length (60sec)), packet window (being expressed as S.std:groupwin (*)) etc..
In EPL language, having** ＞=10 represent that only return meets having condition in Query Result
As a result, similar with SQL usage；On myevent (CallCounter ＞=10) as a update mywindow as b
Set flag=true where a.strImsi=b.strImsi and b.flag=false represents when meeting where condition,
When myevent stream field CallCounter ＞=10 meet certain condition, update the flag field in mywindow
Content.
In the prior art, stream process in existing keyword Having, can only export that to meet condition later
Record, data before are considered as to be unsatisfactory for condition data together to process with stale data, it is impossible to satisfied
Record after condition exports together, such as: condition is having ＞ 5；If that the actual note meeting condition
Record has 10, but actual output result only has 5～10.
If realizing exporting all records meeting condition, the most under the prior art, need to use more rules
Nested realization: to the data genaration in same period two parts of A, B, find the user meeting condition from A,
Again from B, find out the message registration of this user.
Summary of the invention
Embodiment of the present invention technical problem to be solved is, it is provided that a kind of method for stream processing and device.Can
With in the case of not using more rules nesting, it is achieved meet the output of whole events of condition.
In order to solve above-mentioned technical problem, on the one hand, embodiments provide a kind of method for stream processing,
Described method includes:
Receive the event belonging to current stream process window；
Belong to current stream described in caching and process the event of window；
The current stream that belongs to judging to have cached processes the event of window and whether meets relevant with the first keyword the
One expression formula；
When judged result is for being unsatisfactory for described first expression formula, does not delete the current stream that belongs to cached and process
The event of window, and receive the next event belonging to current stream process window；
When judged result is for meeting described first expression formula, cache according to described first keyword output
Belong to current stream process window event, wherein said first keyword for indicate output cached belong to
Current stream processes window and meets the event of described first expression formula.
On the other hand, the embodiment of the present invention additionally provides a kind of current processing device, and described device includes:
Receive unit, for receiving the event belonging to current stream process window；
Buffer unit, is used for belonging to described in caching the event of current stream process window；
First expression formula judging unit, for judging that cached belongs to whether current stream process the event of window
Meet first expression formula relevant with the first keyword；
Output unit, for the judged result when the first expression formula judging unit for meeting described first expression formula
Time, the event belonging to current stream process window cached according to the first keyword output, wherein said first
The current stream that belongs to that keyword has cached for indicating output processes window and meets the event of the first expression formula；
Cycling element, for expressing for being unsatisfactory for described first when the judged result of the first expression formula judging unit
During formula, do not delete the event belonging to current stream process window described in having cached, and trigger described reception unit
Receive the next event belonging to current stream process window.
In embodiments of the present invention when processing first expression formula relevant with the first keyword, even if being unsatisfactory for
This first expression formula the most do not delete cached described in belong to current stream and process the event of window, will not be because of
The event that current stream processes window is unsatisfactory for condition and does not the most retain these events so that when finally exporting, can
Meet the event output of condition with all the causing being processed by stream in window, meet condition without exporting
Event afterwards.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to enforcement
In example or description of the prior art, the required accompanying drawing used is briefly described, it should be apparent that, describe below
In accompanying drawing be only some embodiments of the present invention, for those of ordinary skill in the art, do not paying
On the premise of going out creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is a schematic flow sheet of the method for stream processing in the embodiment of the present invention；
Fig. 2 is a composition schematic diagram of the current processing device in the embodiment of the present invention；
Fig. 3 is a composition schematic diagram of the buffer unit in the embodiment of the present invention；
Fig. 4 is another composition schematic diagram of the current processing device in the embodiment of the present invention；
Fig. 5 is another schematic flow sheet of the method for stream processing in the embodiment of the present invention；
Fig. 6 is the schematic flow sheet using the method for stream processing in Fig. 5 to process multiple events；
Fig. 7 is the tool of it event change included when repeatedly sliding of the sliding window in the embodiment of the present invention
Body schematic diagram；
Fig. 8 is the schematic flow sheet processing multiple events using the method for stream processing in the embodiment of the present invention；
Fig. 9 is another of its event change included when repeatedly sliding of the sliding window in the embodiment of the present invention
Schematic diagram.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clearly
Chu, be fully described by, it is clear that described embodiment be only a part of embodiment of the present invention rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creation
The every other embodiment obtained under property work premise, broadly falls into the scope of protection of the invention.
Current stream process software class SQL rule describe in, having keyword, can only retention periods (i.e.
Stream process window) in meet the data that condition is later.In embodiments of the present invention, the first keyword is added (e.g.,
Had keyword), can be to cause all data before and after the condition of reaching in retention periods.And can carry after had
Complex conditions expression formula, can be the conditional expression of single stream, it is also possible to be the conditional expression of multithread.
As it is shown in figure 1, be a flow process of the data processing method based on flow of event in the embodiment of the present invention
Schematic diagram.This flow process comprises the steps:
101, reception belongs to the event of current stream process window.In a streaming process, event is the shape with flow of event
Formula inputs.This event can include that call record, short message send record or record is clicked in website.
102, caching belongs to the event of current stream process window.Can be specifically to belong to the process of current stream by described
The event buffer of window processes in the internal memory of engine to stream.
When the event of caching, it is also possible to cache according to the second expression formula further, i.e. belong to described in judgement
Current stream processes whether the event of window meets second expression formula relevant with the second keyword；If it is determined that knot
Fruit for being unsatisfactory for the second expression formula, is then deleted the current stream that belongs to cached and processes the event of window, and cache
Belong to current stream described in Jie Shouing and process the event of window；Otherwise, belong at current stream described in caching reception
The event of reason window.
Certainly, this expression formula can also be the 3rd expression formula, i.e. judges whether to cache institute according to the 3rd expression formula
State current stream and process the event of window, when judged result is for being, belongs to current stream described in caching and process window
Event.
103, judge whether the event belonging to current stream process window cached meets relevant with the first keyword
The first expression formula.
Wherein, described first keyword can be had keyword.
104, when judged result is for being unsatisfactory for described first expression formula, do not delete cached belong to current stream
Process the event of window, and receive the next event belonging to current stream process window.
105, when judged result is for meeting described first expression formula, the most slow according to described first keyword output
The current stream that belongs to deposited processes the event of window, and wherein said first keyword has cached for indicating output
Belong to current stream process window and meet the event of described first expression formula.
Further, this stream of stream processing procedure in embodiments of the present invention processes window can be to change over
Time window, such as time slip-window, hopping time window etc., then when described current stream process window move time,
Delete the event being not belonging in caching in the stream process window after moving.
Meanwhile, when whether the event belonging to current stream process window judging caching meets have with the first keyword
During the first expression formula closed, cache and described current stream is processed the intermediate computations knot that the event of window processes
Really；When according to when belonging to the event that current stream processes window of the first keyword output caching, output is according to institute
State the final calculation result that results of intermediate calculations obtains.
Said method can be used in Complex event processing CEP system, described CEP system use CQL language,
The CEP rule of EPL language or class SQL describes language.
Accordingly, the embodiment of the present invention additionally provides a kind of current processing device, as in figure 2 it is shown, this device bag
Include: receive unit 10, for receiving the event belonging to current stream process window；Buffer unit 20, is used for delaying
Belong to current stream described in depositing and process the event of window；First expression formula judging unit 30, caches for judgement
The current stream that belongs to process the event of window and whether meet first expression formula relevant with the first keyword；Output
Unit 40, for when the judged result of the first expression formula judging unit is for meeting described first expression formula, presses
The current stream that belongs to cached according to the first keyword output processes the event of window, wherein said first keyword
The current stream that belongs to for indicating output to cache processes window and meets the event of the first expression formula；Circulation is single
Unit 50, is used for when the judged result of the first expression formula judging unit is for being unsatisfactory for described first expression formula, no
Delete cached belong to current stream process window event, and trigger described reception unit receive belong to current
Stream processes the next event of window.
Wherein, buffer unit 20 can specifically for by described belong to current stream process window event buffer to flow
Process in the internal memory of engine.
As it is shown on figure 3, buffer unit 20 comprises the steps that the second expression formula judgment sub-unit 200, it is used for judging
Whether the described event belonging to current stream process window meets second expression formula relevant with the second keyword；Place
Reason subelement 202, for the judged result when the second expression formula judgment sub-unit for being unsatisfactory for the second expression formula
Time, delete the current stream that belongs to cached and process the event of window, and cache and described in reception, belong to current stream
Process the event of window；Otherwise, belong to current stream described in caching reception and process the event of window.Or: slow
Memory cell includes: the 3rd expression formula judgment sub-unit (not shown), for according to the 3rd expression formula judgement being
The described current stream of no caching processes the event of window, when judged result is for being, belongs to current stream described in caching
Process the event of window.
Further, as shown in Figure 4, said apparatus may also include that processing unit 60, for slow when judging
When whether the event belonging to current stream process window deposited meets first expression formula relevant with the first keyword,
Cache and described current stream is processed the results of intermediate calculations that the event of window processes；Described output unit 40
It is additionally operable to, when according to when belonging to the event that current stream processes window of the first keyword output caching, export basis
The final calculation result that described results of intermediate calculations obtains.
Wherein, the event of foregoing description can include that call record, short message send record or record is clicked in website,
Described first keyword is had keyword, and described device is in Complex event processing CEP system, described
CEP system uses the CEP rule of CQL language, EPL language or class SQL to describe language.For this dress
Put other terms in embodiment and details can also with reference to the details in embodiment of the method aforementioned or described later,
Do not repeat.
In embodiments of the present invention when processing first expression formula relevant with the first keyword, even if being unsatisfactory for
This first expression formula the most do not delete cached described in belong to current stream and process the event of window, will not be because of
The event that current stream processes window is unsatisfactory for condition and does not the most retain these events so that when finally exporting, can
Meet the event output of condition with all the causing being processed by stream in window, meet condition without exporting
Event afterwards.
In a particular embodiment of the present invention, when event is call record, can according to the first keyword
The first relevant expression formula output meets the all-calls record of condition, and e.g., the malice finding out user's generation is exhaled
Cry, then according to these call records to data base obtain concrete ticket；Will not be because of meeting condition
Part call record before is not buffered, and causes the ticket finally obtained imperfect.
As it is shown in figure 5, be another idiographic flow schematic diagram of the method for stream processing in the embodiment of the present invention.This
Event is processed by example according to the first expression formula and the second expression formula.
201, reception belongs to the event of current stream process window.
202, judge described in belong to current stream and process the event of window and whether meet relevant with the second keyword the
Two expression formulas.If it is judged that for being unsatisfactory for the second expression formula, then perform 203；If it is judged that be full
Foot the second expression formula, then perform 204.
203, delete stream and process the event belonging to current stream process window cached in the internal memory of engine, and will
Belong to current stream described in Jie Shouing to process in the internal memory that the event buffer of window processes engine to stream.Then perform
205。
204, will receive described in belong to current stream process window event buffer to stream process engine internal memory
In.Then step 205 is proceeded to.
205, judge whether the event belonging to current stream process window cached meets relevant with the first keyword
The first expression formula.When judged result is for being unsatisfactory for described first expression formula, perform 206；Work as judged result
During for meeting described first expression formula, perform 207.
206, when judged result is for being unsatisfactory for described first expression formula, do not delete cached belong to current stream
Process window event, and return step 201 receive belong to current stream process window next event.
207, when judged result is for meeting described first expression formula, cached according to the first keyword output
Belong to current stream and process the event of window.
Flow process can be terminated, it is also possible to return step 201 and continue to next thing after this step performs to terminate
Part.
On the basis of above-described embodiment, the stream in a specific embodiment can be limited and process window as one minute
Sliding window, the first expression formula is that user's subsequenct call number of times is more than or equal to five in this minute sliding window
Secondary；Second expression formula is that adjacent twice call record interval is less than 5 seconds (Δ t ＜ 5s), and the second keyword is
Only record meets the call record of the second expression formula.The rule that then EPL describes is as follows:
Select* from stream.win:time (60sec) group by a had count (*) ＞=5 where
(timestamp-previous(timestamp))(5s......
Wherein, where (timestamp-previous (timestamp)) ＜ 5s represents, adjacent two things
The time interval of part is less than 5 seconds.The most as shown in Figure 6, the handling process for the flow of event of Fig. 7 is:
301, event 1 is received, owing to event 1 is first event, it is not necessary to judge itself and previous event
Interval, cache this event 1, now the event count in window 1 is 1 (and having 1 ＜ 5), has not the most deleted
The event 1 of caching, but do not export.
302, receive event 2, now judge that the interval between event 1 and event 2 less than 5 seconds, then caches
Event 2 (event belonging to window 1 i.e.: now cached has two, is event 1 and event 2 respectively),
Now the event count in window 1 is 2 (and having 2 ＜ 5), does not the most delete the event 1 and 2 cached, but also
Do not export.
303, receive event 3, now judge that interval between event 2 and event 3 is more than 5 seconds, the most now
Delete the event 1 that cached and event 2, only caching event 3, now the event count in window 1 be 1 (and
Have 1 ＜ 5), the most do not delete the event 3 of caching, but do not export.
304 and when window sliding time then, sliding window.When window 1 slides as window 2 (also
I.e.: now current stream process window is become window 2 from window 1), delete the event of the window that slides out (here
For event 1), then receive and process successor 4～6, count simultaneously and change the most accordingly, and by above-mentioned side
Method proceeds event handling.
305 and when window sliding time then, sliding window.When window 2 slides as window 3 (also
I.e.: now current stream process window is become window 3 from window 2), delete the event of the window that slides out (here
For event 2), receive event 7, now judge that interval between event 6 and event 7 is less than 5 seconds, then this
Time the event that cached be 3～7, now the event count in window is 5 (and having 5=5), does not the most delete the most slow
The event 3～7 deposited, and export the event 3～7 of caching.
306, similar above-mentioned method is used to continue with successor.
Certainly, above-mentioned time slip-window can also be hopping time window, and its handling process is similar to.
As shown in Figure 8, then for flow process event processed according to the first expression formula and the 3rd expression formula.
In this example, the first keyword is had keyword, and the expression formula of the first keyword is count () ＞ 5, the
Three expression formulas are * *！=null, i.e. field * * are not empty.Then for flow of event as shown in Figure 9, it processes
Flow process is:
401, event 1 is received, owing to event 1 is first event, it is judged that its field * * is not empty, caching
This event, now the event count in window 1 is 1 (and having 1 ＜ 5), does not the most delete the event 1 cached,
But do not export.
402, event 2 is received, it is judged that its field * * is not empty, caches this event, the now thing in window 1
Part is counted as 2 (and having 2 ＜ 5), does not the most delete the event 1 and 2 cached, but does not exports.In like manner process
Event 3～5.When window sliding time then, sliding window.When window 1 slides as window 2, delete
Slide out the event of window, count simultaneously and change the most accordingly, and proceed event handling as stated above.
403, event 6 is received, it is judged that its field * * is not empty, and the event the most cached is 2～6, this
Time window in event count be 5 (and having 5=5), the most do not delete the event cached, and export and cache
Event 2～6.
404, similar above-mentioned method is used to continue with successor.
In the above-described embodiments, keyword had can also be with other various window definition, querying condition, mould
Formula definition etc. is used in combination, e.g., Count (a), count ([all | distinct] expression [, filter_expr])
Count (* [, filter_expr]) etc..
By the description of above-described embodiment, in the prior art, in measurement period: single rule is existing
There is keyword (e.g., having), the record after meeting condition can only be exported, the meeting when there being new event to receive
Delete processed event；The all records meeting condition are caused, it is necessary to more rules combines if listed
Realize.And in embodiments of the present invention, in measurement period: the keyword extension of single rule (e.g., increases
Add keyword had), can list and cause all records meeting condition, realize without more rules combination.
The most in embodiments of the present invention, the record buffer memory of expression formula condition after had will be met, when reaching rule
(for simple event count, it is not inconsistent during expression formula condition after defining output condition or not being inconsistent had
After had, expression formula condition does not the most output, but for complex situations, as there is the situation of classified statistics,
Event is the record of the event in different grouping, and such as packet A may meet 5 times, then packet A's
Record just outputs, and packet B does not meet 5 times, then the record relevant with packet B does not the most export),
After meeting had, all records of expression formula condition export, and empty caching and are further continued for counting.
One of ordinary skill in the art will appreciate that all or part of flow process realizing in above-described embodiment method,
Can be by computer program and complete to instruct relevant hardware, described program can be stored in a calculating
In machine read/write memory medium, this program is upon execution, it may include such as the flow process of the embodiment of above-mentioned each method.
Wherein, described storage medium can be magnetic disc, CD, read-only store-memory body (Read-Only Memory,
Or random store-memory body (Random Access Memory, RAM) etc. ROM).
Above disclosed only one preferred embodiment of the present invention, can not limit this with this certainly
Bright interest field, the equivalent variations therefore made according to the claims in the present invention, still belong to what the present invention was contained
Scope.
Claims (12)
1. a method for stream processing, it is characterised in that described method includes:
Receive the event belonging to current stream process window；
Belong to current stream described in caching and process the event of window；
Judge that the current stream that belongs to cached processes the most satisfied first expression formula relevant with the first keyword of event of window；
When judged result is for being unsatisfactory for described first expression formula, does not delete the current stream that belongs to cached and process the event of window, and receive the next event belonging to current stream process window；
When judged result is for meeting described first expression formula, the current stream that belongs to cached according to described first keyword output processes the event of window, and the current stream that belongs to that wherein said first keyword has cached for indicating output processes window and meets the event of described first expression formula；
Wherein, belong to described in described caching current stream process window event specifically include: by described belong to current stream process window event buffer to stream process engine internal memory in；
Wherein, described method also includes:
When described current stream process window moves, delete the event being not belonging in caching in the stream process window after moving.
2. method for stream processing as claimed in claim 1, it is characterised in that the event belonging to current stream process window described in described caching specifically includes:
Belong to current stream described in judgement and process the most satisfied second expression formula relevant with the second keyword of event of window；
If it is judged that for being unsatisfactory for the second expression formula, then delete the current stream that belongs to cached and process the event of window, and cache the event belonging to current stream process window described in reception；Otherwise, belong to current stream described in caching reception and process the event of window.
3. method for stream processing as claimed in claim 1, it is characterised in that the event belonging to current stream process window described in described caching includes:
Judge whether that caching described current stream processes the event of window according to the 3rd expression formula, when judged result is for being, belongs to current stream described in caching and process the event of window.
4. method for stream processing as claimed any one in claims 1 to 3, it is characterised in that
After whether the described event belonging to current stream process window judging caching meets the first expression formula step relevant with the first keyword, described method also includes: cache and described current stream is processed the results of intermediate calculations that the event of window processes；
When the event belonging to current stream process window cached according to the first keyword output, the final calculation result that output obtains according to described results of intermediate calculations.
5. method for stream processing as claimed any one in claims 1 to 3, it is characterised in that described event includes that call record, short message send record or record is clicked in website.
6. method for stream processing as claimed any one in claims 1 to 3, it is characterised in that described first keyword is had keyword.
7. method for stream processing as claimed any one in claims 1 to 3, it is characterised in that described method is in Complex event processing CEP system, and described CEP system uses the CEP rule of CQL language, EPL language or class SQL to describe language.
8. a current processing device, it is characterised in that described device includes:
Receive unit, for receiving the event belonging to current stream process window；
Buffer unit, is used for belonging to described in caching the event of current stream process window；
First expression formula judging unit, for judging that the current stream that belongs to cached processes the most satisfied first expression formula relevant with the first keyword of event of window；
Output unit, for when the judged result of the first expression formula judging unit is for meeting described first expression formula, the current stream that belongs to cached according to the first keyword output processes the event of window, and the current stream that belongs to that wherein said first keyword has cached for indicating output processes window and meets the event of the first expression formula；
Cycling element, for when the judged result of the first expression formula judging unit is for being unsatisfactory for described first expression formula, does not delete the current stream that belongs to cached and processes the event of window, and triggers described reception unit and receive the next event belonging to current stream process window；
Wherein, described buffer unit specifically for by described belong to current stream process window event buffer to stream process engine internal memory in；
Described device also includes: for when described current stream process window moves, being not belonging to the stream after moving and process the unit of the event in window in deletion caching.
9. device as claimed in claim 8, it is characterised in that described buffer unit specifically includes:
Second expression formula judgment sub-unit, is used for described in judging belonging to current stream and processes the most satisfied second expression formula relevant with the second keyword of event of window；
Process subelement, for when the judged result of the second expression formula judgment sub-unit is for being unsatisfactory for the second expression formula, deletes the current stream that belongs to cached and process the event of window, and cache the event belonging to current stream process window described in reception；Otherwise, belong to current stream described in caching reception and process the event of window.
10. device as claimed in claim 8, it is characterised in that described device also includes:
Processing unit, during for whether meeting first expression formula relevant with the first keyword when the event belonging to current stream process window judging caching, caches and described current stream is processed the results of intermediate calculations that the event of window processes；
Described output unit, is additionally operable to when the event belonging to current stream process window cached according to the first keyword output, the final calculation result that output obtains according to described results of intermediate calculations.
11. devices as claimed in claim 8, it is characterised in that described buffer unit specifically includes:
3rd expression formula judgment sub-unit, for judging whether that caching described current stream processes the event of window according to the 3rd expression formula, when judged result is for being, belongs to current stream and processes the event of window described in caching.
12. devices as according to any one of claim 8 to 11, it is characterized in that, described event includes that call record, short message send record or record is clicked in website, described first keyword is had keyword, described device is in Complex event processing CEP system, and described CEP system uses the CEP rule of CQL language, EPL language or class SQL to describe language.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2011/084643 WO2013097073A1 (en) | 2011-12-26 | 2011-12-26 | Stream processing method and apparatus |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103282880A CN103282880A (en) | 2013-09-04 |
| CN103282880B true CN103282880B (en) | 2016-10-05 |
Family
ID=48696169
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201180003717.6A Expired - Fee Related CN103282880B (en) | 2011-12-26 | 2011-12-26 | A kind of method for stream processing and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103282880B (en) |
| WO (1) | WO2013097073A1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106021326A (en) * | 2016-05-03 | 2016-10-12 | 无锡雅座在线科技发展有限公司 | A stream-computing event processing method and device |
| CN106484595A (en) * | 2016-10-09 | 2017-03-08 | 华青融天（北京）技术股份有限公司 | A kind of event-handling method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101436337A (en) * | 2008-12-23 | 2009-05-20 | 北京中星微电子有限公司 | Method and apparatus for monitoring event |
| CN101685466A (en) * | 2009-07-22 | 2010-03-31 | 中兴通讯股份有限公司 | Event handling method and event handling equipment |
| CN102200932A (en) * | 2010-03-26 | 2011-09-28 | 微软公司 | Predicative and persistent event streams |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8452663B2 (en) * | 2006-05-04 | 2013-05-28 | Sap Ag | Systems and methods for processing auto-ID data |
| US8122006B2 (en) * | 2007-05-29 | 2012-02-21 | Oracle International Corporation | Event processing query language including retain clause |
-
2011
- 2011-12-26 CN CN201180003717.6A patent/CN103282880B/en not_active Expired - Fee Related
- 2011-12-26 WO PCT/CN2011/084643 patent/WO2013097073A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101436337A (en) * | 2008-12-23 | 2009-05-20 | 北京中星微电子有限公司 | Method and apparatus for monitoring event |
| CN101685466A (en) * | 2009-07-22 | 2010-03-31 | 中兴通讯股份有限公司 | Event handling method and event handling equipment |
| CN102200932A (en) * | 2010-03-26 | 2011-09-28 | 微软公司 | Predicative and persistent event streams |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103282880A (en) | 2013-09-04 |
| WO2013097073A1 (en) | 2013-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106484875B (en) | MOLAP-based data processing method and device | |
| CN102521406B (en) | Distributed query method and system for complex task of querying massive structured data | |
| CN102521405B (en) | Massive structured data storage and query methods and systems supporting high-speed loading | |
| US7213012B2 (en) | Optimizer dynamic sampling | |
| CN108256088A (en) | A kind of storage method and system of the time series data based on key value database | |
| CN103678402B (en) | A kind of method of data real-time statistics under mass data | |
| CN102025563B (en) | Network flow identification method based on Hash collision compensation | |
| CN104281684B (en) | Massive logs are stored and querying method and system | |
| CN104679646B (en) | A kind of method and apparatus for detecting SQL code defect | |
| CN110334111A (en) | A kind of multidimensional trajectory analysis method and device | |
| CN108595621A (en) | A kind of early warning analysis method and system write false value added tax invoice | |
| CN108460102A (en) | Social network data querying method, device, computer equipment and storage medium | |
| CN101458713A (en) | Website classifying method and system | |
| CN109885656B (en) | Microblog forwarding prediction method and device based on quantification heat degree | |
| CN106909642A (en) | Database index method and system | |
| CN103282880B (en) | A kind of method for stream processing and device | |
| CN109033173A (en) | It is a kind of for generating the data processing method and device of multidimensional index data | |
| CN110262951A (en) | A kind of business second grade monitoring method and system, storage medium and client | |
| CN108733781A (en) | The cluster temporal data indexing means calculated based on memory | |
| CN105303430A (en) | Transaction indicator acquisition method and device | |
| JP2019204475A (en) | Method of caching plural files of 2 mb or less based upon hadoop | |
| CN107203637A (en) | A kind of data analysing method and system | |
| CN105653714A (en) | Knowledge pushing method based on intelligent capturing | |
| CN110347726A (en) | A kind of efficient time series data is integrated to store inquiry system and method | |
| CN108710606A (en) | A kind of Task Progress monitoring method, computer readable storage medium and terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170525 Address after: 510640 Guangdong City, Tianhe District Province, No. five, road, public education building, unit 371-1, unit 2401 Patentee after: Guangdong Gaohang Intellectual Property Operation Co., Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: Huawei Technologies Co., Ltd. |
|
| CB03 | Change of inventor or designer information |
Inventor after: Wang Xiaoxiu Inventor before: Liu Xiao |
|
| CB03 | Change of inventor or designer information | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20170913 Address after: Zhoukou City, Henan Province, Shangshui County 466100 yuan Bridge Village five groups of villagers Patentee after: Wang Xiaoxiu Address before: 510640 Guangdong City, Tianhe District Province, No. five, road, public education building, unit 371-1, unit 2401 Patentee before: Guangdong Gaohang Intellectual Property Operation Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20161005 Termination date: 20171226 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |