CN109857524A - Streaming computing method, apparatus, equipment and computer readable storage medium - Google Patents
Streaming computing method, apparatus, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109857524A CN109857524A CN201910079453.0A CN201910079453A CN109857524A CN 109857524 A CN109857524 A CN 109857524A CN 201910079453 A CN201910079453 A CN 201910079453A CN 109857524 A CN109857524 A CN 109857524A
- Authority
- CN
- China
- Prior art keywords
- streaming computing
- event
- pipelined data
- business
- business pipelined
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004364 calculation method Methods 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 18
- 230000004048 modification Effects 0.000 claims description 14
- 238000012986 modification Methods 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 2
- 238000012545 processing Methods 0.000 abstract description 16
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 230000007547 defect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000009412 basement excavation Methods 0.000 description 1
- 238000007418 data mining Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Landscapes
- Information Transfer Between Computers (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of streaming computing methods, this method comprises: reading the business pipelined data that operation system generates in real time；Event identifier field is read from the business pipelined data, wherein different event identifier fields is for identifying different events；The business pipelined data is branched in corresponding event according to the event identifier field；In each event, calls default rule packet to carry out regular calculating to the business pipelined data after shunting, obtain corresponding streaming computing result.The invention also discloses a kind of streaming computing device, equipment and a kind of computer readable storage mediums.The present invention can realize the flexible configuration of business rule in streaming computing, and flow of event can be with parallel expansion, to meet the business processing demand increasingly updated.
Description
Technical field
The present invention relates to big data processing technology fields more particularly to streaming computing method, apparatus, equipment and computer can
Read storage medium.
Background technique
Streaming computing is a kind of special incremental computations, different from off-line calculation, and streaming computing is originated from business to magnanimity number
It, can be well to extensive flow-data in continually changing motion process according to the excavation demand in " timeliness " value
It is analyzed in real time, captures the information to come in handy, and result is sent to next calculate node.
Existing streaming computing process are as follows: event is reported to message-oriented middleware, real time computation system RCS by operation system
It is quasi- in conjunction with the message and data source reported after (Real Time Computing System) consumes the message of message-oriented middleware
Standby calculating parameter, is then successively calculated according to the series of rules of hard coded, final output calculated result.This calculating side
The defect of formula is: (1) flow of event can not parallel expansion；(2) it can not accomplish the flexible configuration of business rule, i.e., it is every to increase by one
Event requires the corresponding processing rule of hard coded again, and similar events stream process, can not accomplish to be multiplexed.Thus, it is existing
Streaming computing mode has been unable to satisfy the business processing demand increasingly updated.
Summary of the invention
It is a primary object of the present invention to propose a kind of streaming computing method, apparatus, equipment and computer-readable storage medium
Matter, it is intended to the flexible configuration of business rule is realized in streaming computing, and flow of event can be with parallel expansion, to meet increasingly more
New business processing demand.
To achieve the above object, the present invention provides a kind of streaming computing method, and the streaming computing method includes following step
It is rapid:
The business pipelined data that operation system generates is read in real time；
Event identifier field is read from the business pipelined data, wherein different event identifier fields is for identifying not
Same event；
The business pipelined data is branched in corresponding event according to the event identifier field；
In each event, default rule packet is called to carry out regular calculating to the business pipelined data after shunting,
Obtain corresponding streaming computing result.
Preferably, described real-time the step of reading the business pipelined data that operation system generates, includes:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein distributed message team
The business pipelined data that column are sent for storage service system.
Preferably, described in each event, call default rule packet to the business pipelined data after shunting into
Line discipline calculates, and the step of obtaining corresponding streaming computing result includes:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
Preferably, before described real-time the step of reading the business pipelined data that operation system generates, further includes:
Regular packet configuration-direct is received, according to the regular packet configuration-direct configuration rule packet, and is arranged and the rule
Wrap corresponding incoming parameter.
Preferably, described in each event, call default rule packet to the business pipelined data after shunting into
After the step of line discipline calculates, and obtains corresponding streaming computing result, further includes:
The modification for receiving the rule packet based on configuration and the incoming parameter instructs, and is instructed according to the modification to matching
The rule packet set and the incoming parameter are modified.
In addition, to achieve the above object, the present invention also provides a kind of streaming computing device, the streaming computing device packet
It includes:
First read module, for reading the business pipelined data of operation system generation in real time；
Second read module, for reading event identifier field from the business pipelined data, wherein different events
Identification field is for identifying different events；
Diverter module, for the business pipelined data to be branched to corresponding event according to the event identifier field
In；
Computing module, for calling default rule packet to the business pipelined data after shunting in each event
Regular calculating is carried out, corresponding streaming computing result is obtained.
Preferably, first read module is also used to:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein distributed message team
The business pipelined data that column are sent for storage service system.
Preferably, the computing module is also used to:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
Preferably, the streaming computing device further include:
Configuration module according to the regular packet configuration-direct configuration rule packet, and is set for receiving regular packet configuration-direct
Set incoming parameter corresponding with the rule packet.
Preferably, the streaming computing device further include:
Modified module, the modification for receiving the rule packet based on configuration and the incoming parameter instructs, according to institute
Modification instruction is stated to modify to the rule packet of configuration and the incoming parameter.
In addition, to achieve the above object, the present invention also provides a kind of streaming computing equipment, the streaming computing equipment packet
It includes: memory, processor and being stored in the streaming computing program that can be run on the memory and on the processor, it is described
Streaming computing program realizes the step of streaming computing method as described above when being executed by the processor.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
Streaming computing program is stored on storage medium, the streaming computing program realizes streaming as described above when being executed by processor
The step of calculation method.
The present invention reads the business pipelined data of operation system generation in real time；Event is read from the business pipelined data
Identification field, wherein different event identifier fields is for identifying different events；It will be described according to the event identifier field
Business pipelined data branches in corresponding event；In each event, call default rule packet to the industry after shunting
Business pipelined data carries out regular calculating, obtains corresponding streaming computing result.Streaming computing is carried out in this way, when newly-increased
When one event, flow of event can be with parallel expansion without the corresponding processing rule of hard coded again, when business rule becomes
When more, also only rule packet need to accordingly be modified, so that the present invention can satisfy the business processing demand increasingly updated.
Detailed description of the invention
Fig. 1 is the device structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to；
Fig. 2 is the flow diagram of streaming computing method first embodiment of the present invention；
Fig. 3 is that business pipelined data is branched to the schematic diagram calculated in corresponding event in the embodiment of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The primary solutions of the embodiment of the present invention are: reading the business pipelined data that operation system generates in real time；From institute
Reading event identifier field in business pipelined data is stated, wherein different event identifier fields is for identifying different events；Root
The business pipelined data is branched in corresponding event according to the event identifier field；In each event, call default
Rule packet regular calculating is carried out to the business pipelined data after shunting, obtain corresponding streaming computing result.
Existing streaming computing process are as follows: event is reported to message-oriented middleware, real-time computing platform RCS by operation system
It is quasi- in conjunction with the message and data source reported after (Real Time Computing System) consumes the message of message-oriented middleware
Standby calculating parameter, is then successively calculated according to the series of rules of hard coded, final output calculated result.This calculating side
The defect of formula is: (1) flow of event can not parallel expansion；(2) it can not accomplish the flexible configuration of business rule, i.e., it is every to increase by one
Event requires the corresponding processing rule of hard coded again, and similar events stream process, can not accomplish to be multiplexed.Thus, it is existing
Streaming computing mode has been unable to satisfy the business processing demand increasingly updated.
The present invention carries out streaming computing through the above way, when increase newly an event when, flow of event can with parallel expansion and
Without the corresponding processing rule of hard coded again, when business rule changes, also only rule packet need to accordingly be modified,
To which the present invention can satisfy the business processing demand increasingly updated.
As shown in Figure 1, Fig. 1 is the terminal structure schematic diagram for the hardware running environment that the embodiment of the present invention is related to.
Streaming computing equipment of the embodiment of the present invention can be PC machine or server apparatus.
As shown in Figure 1, the streaming computing equipment may include: processor 1001, such as CPU, network interface 1004, user
Interface 1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 is for realizing the connection between these components
Communication.User interface 1003 may include display screen (Display), input unit such as keyboard (Keyboard), optional user
Interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004 optionally may include having for standard
Line interface, wireless interface (such as WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to stable storage
Device (non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of aforementioned processing
The storage device of device 1001.
It will be understood by those skilled in the art that device structure shown in Fig. 1 does not constitute the restriction to equipment, can wrap
It includes than illustrating more or fewer components, perhaps combines certain components or different component layouts.
As shown in Figure 1, as may include that operating system, network are logical in a kind of memory 1005 of computer storage medium
Believe module, Subscriber Interface Module SIM and streaming computing program.
In terminal shown in Fig. 1, network interface 1004 is mainly used for connecting background server, carries out with background server
Data communication；User interface 1003 is mainly used for connecting client (user terminal), carries out data communication with client；And processor
1001 can be used for calling the streaming computing program stored in memory 1005, and execute following operation:
The business pipelined data that operation system generates is read in real time；
Event identifier field is read from the business pipelined data, wherein different event identifier fields is for identifying not
Same event；
The business pipelined data is branched in corresponding event according to the event identifier field；
In each event, default rule packet is called to carry out regular calculating to the business pipelined data after shunting,
Obtain corresponding streaming computing result.
Further, processor 1001 can call the streaming computing program stored in memory 1005, also execute following
Operation:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein distributed message team
The business pipelined data that column are sent for storage service system.
Further, processor 1001 can call the streaming computing program stored in memory 1005, also execute following
Operation:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
Further, processor 1001 can call the streaming computing program stored in memory 1005, also execute following
Operation:
Regular packet configuration-direct is received, according to the regular packet configuration-direct configuration rule packet, and is arranged and the rule
Wrap corresponding incoming parameter.
Further, processor 1001 can call the streaming computing program stored in memory 1005, also execute following
Operation:
The modification for receiving the rule packet based on configuration and the incoming parameter instructs, and is instructed according to the modification to matching
The rule packet set and the incoming parameter are modified.
Based on above-mentioned hardware configuration, streaming computing embodiment of the method for the present invention is proposed.
It is the flow diagram of streaming computing method first embodiment of the present invention referring to Fig. 2, Fig. 2, which comprises
Step S10 reads the business pipelined data that operation system generates in real time；
The present embodiment streaming computing method is applied to the streaming computing equipment run in big data platform, wherein big number
It can be Spark platform according to platform, Spark platform is that a kind of currently a popular big data calculates and counts platform, by big
Data are calculated and are counted, and Spark platform can be realized various machine learning and data mining；Operation system can be silver
The operation system of the financial institutions such as row, securities broker company, insurance company, for handling and recording the savings of user, transfer accounts, invest
Various financial business, and corresponding business pipelined data is generated, by taking the transaction system of bank as an example, due to the daily transaction of bank
Quantity is very huge, therefore its transaction system may include the transaction system database on a backstage, for by bank account
It the related services information-distribution type such as saves, transfer accounts, remitting money to be stored in multiple storage equipment, so guaranteeing the business of storage magnanimity
Data.Equipped with real time computation system RCS (Real Time Computing System) in streaming computing equipment, transported on RCS
Row is distributed formula streaming computing component, is used for streaming computing, the distributive type computation module includes but is not limited to: Spark
Streaming, Storm, Samza, Flink and Kafka Streams.
Above-mentioned steps S10 can specifically include: read the business of operation system generation in real time from Distributed Message Queue
Pipelined data, wherein Distributed Message Queue is used for the business pipelined data that storage service system is sent.
Specifically, business pipelined data can be sent to Distributed Message Queue and stored by operation system, with distribution
A kind of formula message queue Apache Kafka (distributed post-subscription message system, mainly for the treatment of active streaming number
According to) for, streaming computing equipment reads business pipelined data from Kafka message queue, this part is real-time.It needs to illustrate
, transaction system database can also include corresponding standby library, and standby library is used to transaction data carrying out backup preservation,
When Apache Kafka reads online stream data, it can be read from standby library, to avoid transaction system resource is occupied.In addition,
In addition to Apache Kafka, the Distributed Message Queue in the embodiment of the present invention can also be other kinds of distributed message team
Column, such as ActiveMQ (Message Queue, messaging bus), RabbitMQ, RocketMQ etc., when specific implementation, can be flexible
Setting.
Step S20 reads event identifier field, wherein different event identifier fields is used from the business pipelined data
In the different event of mark；
It include event identifier field in above-mentioned business pipelined data, wherein different event identifier fields is for identifying difference
Event, subsequent newly-increased event can also do parallel expansion, will not influence each other between each event.
Step S30 branches to the business pipelined data in corresponding event according to the event identifier field；
Referring to Fig. 3, Fig. 3 is to branch to business pipelined data in the embodiment of the present invention to calculate in corresponding event
Schematic diagram.Real time computation system branches to business pipelined data in corresponding event according to the event identifier field read,
Such as comprising the business pipelined data of 3 different events (event 1, event 2 and event 3) in current business pipelined data, then
Business pipelined data correspondence is branched in event 1, event 2 and event 3.
Step S40 calls default rule packet to advise the business pipelined data after shunting in each event
It then calculates, obtains corresponding streaming computing result.
After carrying out business datum shunting, in each event, call default rule packet to the business flowing water after shunting
Data carry out regular calculating, obtain corresponding calculated result as streaming computing result.
Step S40 can specifically include: the business pipelined data being diverted in each event is converted to preset standard
Data format；Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；It calls default
Rule packet regular calculating is carried out to the incoming parameter, obtain corresponding streaming computing result.
For the unification for realizing data structure, the business pipelined data being diverted in each event can be converted to first default
Standard data format then, obtained from the business pipelined data after standard data format is converted pre- such as JSON format
If incoming parameter, and default rule packet is called to carry out regular calculating to the incoming parameter, to obtain corresponding streaming
Calculated result.Further, streaming computing result can also be saved in the preset database, is checked in order to subsequent.
The present embodiment carries out streaming computing through the above way, and when increasing an event newly, flow of event can be with parallel expansion
Without the corresponding processing rule of hard coded again, when business rule changes, also only rule packet need to accordingly be repaired
Change, so as to meet the business processing demand increasingly updated.
Further, it is based on streaming computing method first embodiment of the present invention, proposes streaming computing method second of the present invention
Embodiment.
It can also include: to receive regular packet configuration-direct, according to the rule before above-mentioned steps S10 in the present embodiment
Then packet configuration-direct configuration rule packet, and incoming parameter corresponding with the rule packet is set.
Specifically, platform management personnel can trigger regular packet configuration-direct, and real time computation system is matched according to rule packet
Instruction configuration rule packet is set, and incoming parameter corresponding with rule packet is set, wherein including that business processing is patrolled in rule packet
Volume.By preset rules packet, premise is provided for subsequent streaming computing.
Further, after above-mentioned steps S40, can also include: receive based on configuration it is described rule packet and it is described
The modification instruction of incoming parameter modifies to the rule packet of configuration and the incoming parameter according to the modification instruction.
When business rule changes, platform management personnel can trigger modification instruction to wrap to the rule of configuration
It modifies with the incoming parameter, rule packet is updated by real time computation system, and new rule packet comes into force in real time.This mode
It operates flexible and convenient, can satisfy the business processing demand increasingly updated.
The present invention also provides a kind of streaming computing devices.Streaming computing device of the embodiment of the present invention includes:
First read module, for reading the business pipelined data of operation system generation in real time；
Second read module, for reading event identifier field from the business pipelined data, wherein different events
Identification field is for identifying different events；
Diverter module, for the business pipelined data to be branched to corresponding event according to the event identifier field
In；
Computing module, for calling default rule packet to the business pipelined data after shunting in each event
Regular calculating is carried out, corresponding streaming computing result is obtained.
Further, first read module is also used to:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein distributed message team
The business pipelined data that column are sent for storage service system.
Further, the computing module is also used to:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
Further, the streaming computing device further include:
Configuration module according to the regular packet configuration-direct configuration rule packet, and is set for receiving regular packet configuration-direct
Set incoming parameter corresponding with the rule packet.
Further, the streaming computing device further include:
Modified module, the modification for receiving the rule packet based on configuration and the incoming parameter instructs, according to institute
Modification instruction is stated to modify to the rule packet of configuration and the incoming parameter.
Operation performed by above-mentioned each program module can refer to each embodiment of streaming computing method of the present invention, herein no longer
It repeats.
The present invention also provides a kind of computer readable storage mediums.
Streaming computing program is stored on computer readable storage medium of the present invention, the streaming computing program is by processor
The step of streaming computing method as described above is realized when execution.
Wherein, the streaming computing program run on the processor, which is performed realized method, can refer to the present invention
The each embodiment of streaming computing method, details are not described herein again.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the system that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or system.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (12)
1. a kind of streaming computing method, which is characterized in that the streaming computing method includes the following steps:
The business pipelined data that operation system generates is read in real time；
Event identifier field is read from the business pipelined data, wherein different event identifier fields is different for identifying
Event；
The business pipelined data is branched in corresponding event according to the event identifier field；
In each event, calls default rule packet to carry out regular calculating to the business pipelined data after shunting, obtain
Corresponding streaming computing result.
2. streaming computing method as described in claim 1, which is characterized in that the real-time business for reading operation system and generating
The step of pipelined data includes:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein Distributed Message Queue is used
In the business pipelined data that storage service system is sent.
3. streaming computing method as described in claim 1, which is characterized in that it is described in each event, call preset rule
The step of then wrapping and carry out regular calculating to the business pipelined data after shunting, obtaining corresponding streaming computing result include:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
4. streaming computing method as claimed in claim 3, which is characterized in that the real-time business for reading operation system and generating
Before the step of pipelined data, further includes:
Regular packet configuration-direct is received, according to the regular packet configuration-direct configuration rule packet, and is arranged and the rule packet pair
The incoming parameter answered.
5. streaming computing method as claimed in claim 4, which is characterized in that it is described in each event, call preset rule
After the step of then wrapping and carry out regular calculating to the business pipelined data after shunting, obtaining corresponding streaming computing result,
Further include:
The modification for receiving the rule packet based on configuration and the incoming parameter instructs, and is instructed according to the modification to configuration
The rule packet and the incoming parameter are modified.
6. a kind of streaming computing device, which is characterized in that the streaming computing device includes:
First read module, for reading the business pipelined data of operation system generation in real time；
Second read module, for reading event identifier field from the business pipelined data, wherein different event identifiers
Field is for identifying different events；
Diverter module, for being branched to the business pipelined data in corresponding event according to the event identifier field；
Computing module, for calling default rule packet to carry out the business pipelined data after shunting in each event
Rule calculates, and obtains corresponding streaming computing result.
7. streaming computing device as claimed in claim 6, which is characterized in that first read module is also used to:
Read the business pipelined data of operation system generation in real time from Distributed Message Queue, wherein Distributed Message Queue is used
In the business pipelined data that storage service system is sent.
8. streaming computing device as claimed in claim 6, which is characterized in that the computing module is also used to:
The business pipelined data being diverted in each event is converted into preset standard data format；
Preset incoming parameter is obtained from the business pipelined data after standard data format is converted；
It calls default rule packet to carry out regular calculating to the incoming parameter, obtains corresponding streaming computing result.
9. streaming computing device as claimed in claim 8, which is characterized in that the streaming computing device further include:
Configuration module, for receiving regular packet configuration-direct, according to the regular packet configuration-direct configuration rule packet, and be arranged with
The rule wraps corresponding incoming parameter.
10. streaming computing device as claimed in claim 9, which is characterized in that the streaming computing device further include:
Modified module, the modification for receiving the rule packet based on configuration and the incoming parameter are instructed, are repaired according to described
Change instruction to modify to the rule packet of configuration and the incoming parameter.
11. a kind of streaming computing equipment, which is characterized in that the streaming computing equipment includes: memory, processor and is stored in
On the memory and the streaming computing program that can run on the processor, the streaming computing program is by the processor
The step of streaming computing method as described in any one of claims 1 to 5 is realized when execution.
12. a kind of computer readable storage medium, which is characterized in that be stored with streaming meter on the computer readable storage medium
Program is calculated, the streaming computing as described in any one of claims 1 to 5 is realized when the streaming computing program is executed by processor
The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079453.0A CN109857524B (en) | 2019-01-25 | 2019-01-25 | Stream computing method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910079453.0A CN109857524B (en) | 2019-01-25 | 2019-01-25 | Stream computing method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109857524A true CN109857524A (en) | 2019-06-07 |
| CN109857524B CN109857524B (en) | 2024-02-27 |
Family
ID=66896431
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910079453.0A Active CN109857524B (en) | 2019-01-25 | 2019-01-25 | Stream computing method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109857524B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110609852A (en) * | 2019-07-16 | 2019-12-24 | 招联消费金融有限公司 | Streaming data processing method and device, computer equipment and storage medium |
| CN111221550A (en) * | 2019-10-24 | 2020-06-02 | 支付宝(杭州)信息技术有限公司 | Rule updating method and device for streaming computing and streaming computing system |
| CN111509849A (en) * | 2020-04-22 | 2020-08-07 | 广东电网有限责任公司 | Digital power grid system based on stream-oriented computing |
| CN113468199A (en) * | 2021-07-29 | 2021-10-01 | 上海哔哩哔哩科技有限公司 | Index updating method and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120089549A1 (en) * | 2010-10-07 | 2012-04-12 | International Business Machines Corporation | Rule authoring for events in a grid environment |
| US20130318029A1 (en) * | 2012-05-22 | 2013-11-28 | Oracle International Corporation | Distributed order orchestration system with extensible flex field support |
| CN105512297A (en) * | 2015-12-10 | 2016-04-20 | 中国测绘科学研究院 | Distributed stream-oriented computation based spatial data processing method and system |
| CN107025486A (en) * | 2017-02-27 | 2017-08-08 | 中国科学院信息工程研究所 | A kind of event detection system and method |
| CN107506482A (en) * | 2017-06-26 | 2017-12-22 | 湖南星汉数智科技有限公司 | A kind of large-scale data processing unit and method based on Stream Processing framework |
| CN107967347A (en) * | 2017-12-07 | 2018-04-27 | 湖北三新文化传媒有限公司 | Batch data processing method, server, system and storage medium |
| CN108681590A (en) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展（北京）有限公司 | Incremental data processing method and processing device, computer equipment, computer storage media |
| CN108920948A (en) * | 2018-05-25 | 2018-11-30 | 众安信息技术服务有限公司 | A kind of anti-fraud streaming computing device and method |
-
2019
- 2019-01-25 CN CN201910079453.0A patent/CN109857524B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120089549A1 (en) * | 2010-10-07 | 2012-04-12 | International Business Machines Corporation | Rule authoring for events in a grid environment |
| US20130318029A1 (en) * | 2012-05-22 | 2013-11-28 | Oracle International Corporation | Distributed order orchestration system with extensible flex field support |
| CN105512297A (en) * | 2015-12-10 | 2016-04-20 | 中国测绘科学研究院 | Distributed stream-oriented computation based spatial data processing method and system |
| CN107025486A (en) * | 2017-02-27 | 2017-08-08 | 中国科学院信息工程研究所 | A kind of event detection system and method |
| CN107506482A (en) * | 2017-06-26 | 2017-12-22 | 湖南星汉数智科技有限公司 | A kind of large-scale data processing unit and method based on Stream Processing framework |
| CN107967347A (en) * | 2017-12-07 | 2018-04-27 | 湖北三新文化传媒有限公司 | Batch data processing method, server, system and storage medium |
| CN108681590A (en) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展（北京）有限公司 | Incremental data processing method and processing device, computer equipment, computer storage media |
| CN108920948A (en) * | 2018-05-25 | 2018-11-30 | 众安信息技术服务有限公司 | A kind of anti-fraud streaming computing device and method |
Non-Patent Citations (3)
| Title |
|---|
| WANG, ZHIHUA等: "A Data-Driven Architecture Design of Stream Computing for the Dispatch and Control System of the Power Grid", 《IEEE》, 20 December 2018 (2018-12-20) * |
| 祖向荣: "智能电网监控中的分布式复杂事件处理技术研究", 《中国优秀硕士学位论文全文数据库（工程科技Ⅱ辑）》, no. 12, 15 December 2017 (2017-12-15) * |
| 董斌;杨迪;王铮;周文红;: "流计算大数据技术在运营商实时信令处理中的应用", 电信科学, no. 10 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110609852A (en) * | 2019-07-16 | 2019-12-24 | 招联消费金融有限公司 | Streaming data processing method and device, computer equipment and storage medium |
| CN111221550A (en) * | 2019-10-24 | 2020-06-02 | 支付宝(杭州)信息技术有限公司 | Rule updating method and device for streaming computing and streaming computing system |
| CN111509849A (en) * | 2020-04-22 | 2020-08-07 | 广东电网有限责任公司 | Digital power grid system based on stream-oriented computing |
| CN113468199A (en) * | 2021-07-29 | 2021-10-01 | 上海哔哩哔哩科技有限公司 | Index updating method and system |
| CN113468199B (en) * | 2021-07-29 | 2022-11-04 | 上海哔哩哔哩科技有限公司 | Index updating method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109857524B (en) | 2024-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109857524A (en) | Streaming computing method, apparatus, equipment and computer readable storage medium | |
| CN108776934B (en) | Distributed data calculation method and device, computer equipment and readable storage medium | |
| CN109034993A (en) | Account checking method, equipment, system and computer readable storage medium | |
| CN109597842A (en) | Data real-time computing technique, device, equipment and computer readable storage medium | |
| CN110428325A (en) | Transaction tracking and device | |
| CN111784000B (en) | Data processing method, device and server | |
| CN110427304A (en) | O&M method, apparatus, electronic equipment and medium for banking system | |
| CN112559635A (en) | Service processing method, device, equipment and medium for Ether house alliance link node | |
| CN111190750B (en) | Data processing method and system | |
| CN107506284A (en) | Log processing method and device | |
| CN104408178B (en) | WEB controls loading device and method | |
| CN110443441A (en) | Regular efficacy monitoring method, apparatus, computer equipment and storage medium | |
| US20230163998A1 (en) | Data processing method, device, electronic device and computer readable medium | |
| CN115460265A (en) | Interface calling method, device, equipment and medium | |
| CN111105238A (en) | Transaction risk control method and device | |
| CN105160553A (en) | Client grouping method and apparatus | |
| CN112416488B (en) | User portrait implementing method, device, computer equipment and computer readable storage medium | |
| CN112637793B (en) | Scene charging method, system, electronic equipment and storage medium based on 5G | |
| CN111176588B (en) | Service bill issuing method, device, medium and electronic equipment | |
| TWI662499B (en) | A method and system for automatically processing corporate action events | |
| CN115250276A (en) | Distributed system and data processing method and device | |
| CN110309848A (en) | The method that off-line data and stream data real time fusion calculate | |
| CN113392011A (en) | Link segmentation performance testing method and device | |
| CN117061258A (en) | Charging detection method, device, equipment and medium | |
| TWI425439B (en) | Method and system for judging the number of types of telecom operators by weight |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |