CN113821361B - Internet of things platform message processing method and system based on streaming processing - Google Patents
Internet of things platform message processing method and system based on streaming processing Download PDFInfo
- Publication number
- CN113821361B CN113821361B CN202111397905.3A CN202111397905A CN113821361B CN 113821361 B CN113821361 B CN 113821361B CN 202111397905 A CN202111397905 A CN 202111397905A CN 113821361 B CN113821361 B CN 113821361B
- Authority
- CN
- China
- Prior art keywords
- processing
- message
- streaming
- data
- internet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 190
- 238000003672 processing method Methods 0.000 title claims description 10
- 238000000034 method Methods 0.000 claims abstract description 27
- 230000008569 process Effects 0.000 claims abstract description 10
- 238000001914 filtration Methods 0.000 claims description 6
- 238000012958 reprocessing Methods 0.000 claims description 6
- 238000012805 post-processing Methods 0.000 claims description 5
- 230000004931 aggregating effect Effects 0.000 claims description 3
- 238000005111 flow chemistry technique Methods 0.000 claims description 2
- 230000010354 integration Effects 0.000 claims 1
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000008358 core component Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000003319 supportive effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24568—Data stream processing; Continuous queries
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y10/00—Economic sectors
- G16Y10/75—Information technology; Communication
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y20/00—Information sensed or collected by the things
- G16Y20/40—Information sensed or collected by the things relating to personal data, e.g. biometric data, records or preferences
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/10—Detection; Monitoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/547—Messaging middleware
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/50—Reducing energy consumption in communication networks in wire-line communication networks, e.g. low power modes or reduced link rate
Abstract
The invention provides a method for processing an internet of things platform message based on streaming processing, which comprises the following steps: the data access service of the platform of the Internet of things receives data reported by equipment and pushes original data reported by the equipment to a message middleware for storing messages; setting a preposed stream processing node configured with a first type of processing rule, splitting original data stored in a message middleware into message branches taking specified characteristic information as a division basis, and then storing each message branch to the message middleware again; setting a post-streaming processing node configured with a second type of processing rule, processing each message branch in the message middleware, and storing the processed result in a database or continuously transferring to the next message middleware; the process is repeated until the processed data meets the preset service requirement. The method provided by the invention can support the user to configure the streaming processing rule according to the service customization while improving the efficiency and the real-time performance of the Internet of things platform for processing the message.
Description
Technical Field
The invention relates to the technical field of Internet of things, in particular to a method for processing an Internet of things platform message based on streaming processing.
Background
With the continuous development of the internet of things technology, internet of things platforms, big data processing and the like are widely applied to various industries. The internet of things platform is used as a core component of the application of the internet of things technology, and the quality of the performance of the internet of things platform plays a key role in the whole internet of things service. Although the existing internet of things platform technology has been widely applied to various aspects of society, the internet of things platform still has the following disadvantages in terms of processing high-concurrency time sequence messages of mass equipment:
the traditional message processing of the Internet of things platform is based on single node distribution processing, and the method has the following defects: firstly, messages in a processing platform cannot be consumed quickly, various real-time data reported by equipment in an internet of things platform can be completely processed only by consuming several minutes or even several hours due to the fact that the data volume is too large, larger time delay exists, and feedback of the processed real-time data cannot be provided; secondly, the traditional internet of things platform has limited applicable scenes, cannot adapt to dynamic service needs of users, has poor expandability, is generally a combination of platform limiting function modules, has higher difficulty in user-defined development and cannot meet personalized requirements.
In the existing patent, the invention patent with publication number CN111124392A, a method for improving high concurrency of a rule engine of an internet of things platform, dynamically configures rule chain nodes by a method for constructing a rule chain, can customize logic of message processing of the internet of things platform, and adopts an actor model to realize high concurrency distribution and processing of messages, thereby improving the concurrency of message processing of the internet of things platform to a certain extent. However, the code of the creating operator model system is highly coupled with the code of the platform of the internet of things, developers need to understand the principle of the operator model and then modify the source code, and a certain difficulty threshold exists; in addition, the method adopts a single-chain rule engine, all messages are distributed to lower-level sub-nodes through a main node for hierarchical processing, and when the concurrency reaches a certain amount, delay caused by node processing cannot be avoided.
In addition, the invention patent with publication number CN111444291A, a real-time data alarm method based on a stream processing engine and a rule engine, discloses that a stream processing engine Flink is used to perform real-time processing according to configured rules, and match the processing result to the corresponding event trigger, and the configured rules are stored in a relational database, so that the alarm event triggered by the message has higher processing efficiency. However, the scenario used by the scheme has limitations, the method only carries out streaming processing on the alarm message, cannot expand the use range of the alarm message, and maintains the rule configuration of the streaming engine of the alarm message compared with a dependency relationship type database.
Disclosure of Invention
In order to solve at least one technical problem, the invention provides a message processing method of an internet of things platform based on streaming processing, which can support a user to configure streaming processing rules according to business customization while improving the efficiency and the real-time performance of the internet of things platform for processing messages, thereby enhancing the overall performance of the internet of things platform in processing messages.
The invention provides a method for processing an internet of things platform message based on streaming processing, which comprises the following steps:
s1, receiving data reported by the equipment by the Internet of things platform data access service, and pushing the original data reported by the equipment to a message middleware for storing messages;
s2, setting at least one prepositive stream processing node configured with a first type of processing rule, extracting the appointed characteristic information of the original data stored in the message middleware, splitting the original data into message branches taking the appointed characteristic information as a division basis based on the first type of processing rule, and then storing each message branch to the message middleware again;
s3, setting at least one post-flow processing node configured with second type processing rules, extracting the device information or data part information from each message branch in the message middleware, processing each message branch based on the second type processing rules, and storing the processed result in the database or transferring the processed result to the next message middleware;
s4, setting a post-stage streaming processing node configured with a subsequent processing rule, processing the data transferred to the next message middleware again based on the subsequent processing rule, and storing the processed result in a database or transferring the processed result to the next message middleware; the process is repeated until the processed data meets the preset service requirement.
Further, in step S1, the data reported by the device and received by the platform data access service of the internet of things at least includes a tenant ID and a message type of the device, and one or more of the device ID, a device state, or sensing data monitored by the device.
Further, in step S2, the extracted specific feature information includes a tenant ID and a message type, and the original data is split into message branches based on the tenant ID and/or the message type.
Further, in step S3, the second type of processing rule includes processing logic for the device information or data part in the message branch.
Further, the logic for processing the device information in the message branch includes further splitting the message branch based on the device ID or the device status.
Further, the processing logic for the data portion of the message branch includes at least one of filtering, aggregating, consuming, filtering, converting, accumulating, arithmetic, or storage integrating the data.
Further, the preposed streaming processing node is set based on a siddhi streaming engine or an actor model; the post-positioned streaming processing node and the post-positioned streaming processing node are set based on the siddhi streaming engine.
Further, the first type of processing rule, the second type of processing rule and the subsequent processing rule are configured by a user in a customized way based on the siddhi streaming engine or the actor model.
A second aspect of the present invention provides a message processing system for an internet of things platform based on streaming processing, including:
the platform data access service of the Internet of things is used for receiving data reported by equipment;
at least one message middleware for storing the original data reported by the device or the data processed by the streaming processing node;
the configuration unit is used for configuring a preposed stream processing node, the preposed stream processing node is used for extracting specified characteristic information from the original data stored in the message middleware, splitting the original data into message branches taking the specified characteristic information as a division basis based on a first class of processing rules, and then storing each message branch to the message middleware again; and
the post-streaming processing node is used for extracting equipment information or data part information of each message branch in the message middleware, processing each message branch based on a second type of processing rule, and storing a processed result to a database or continuously transferring to the next message middleware; and
the system comprises a post-stage streaming processing node, a database and a post-stage streaming processing middleware, wherein the post-stage streaming processing node is used for configuring the post-stage streaming processing node, and the post-stage streaming processing node is used for reprocessing the data transferred to the next message middleware based on a subsequent processing rule and storing the processed result in the database or transferring the processed result to the next message middleware for reprocessing;
and the database is used for storing the original data or the data processed by each streaming processing node.
Further, the front-end streaming processing node is set based on a siddhi streaming engine or an actor model, and the rear-end streaming processing node are set based on the siddhi streaming engine; the first type of processing rule, the second type of processing rule and the subsequent processing rule are configured by a user in a customized mode based on the siddhi streaming engine or the actor model.
The invention has the following beneficial technical effects:
the invention adopts the stream processing node (stream processing engine) configured with the corresponding processing rule to receive data in real time and process the data according to the configured rule, so that the platform of the Internet of things has the capability of real-time response processing. Meanwhile, the invention allows the user to self-define the configuration processing rule based on the siddhi rule engine, does not depend on a relational database, occupies small space of a single configuration file, and greatly enhances the expandability of the message processing of the platform of the Internet of things.
On the other hand, the invention achieves the purpose of shunting the information converged to the platform by distinguishing and screening the original reported data of the equipment according to the specified characteristic information. And further configuring a stream processing node (stream processing engine) for the messages after the stream division, thereby achieving the purpose of dividing and treating one message by one, improving concurrency, simultaneously having timeliness, reducing delay of message processing, improving overall stability and high efficiency of the platform of the Internet of things, and meeting the requirements of users on self-defining or optimized processing rules.
Drawings
Fig. 1 is a schematic overall process diagram of an embodiment of a message processing method for an internet of things platform according to the present invention.
Fig. 2 is a schematic diagram of a first stage processing of an embodiment of a message processing method for an internet of things platform.
Fig. 3 is a second stage processing diagram of the message processing method of the internet of things platform according to the embodiment of the invention.
Detailed Description
For a further understanding of the invention, reference will now be made to the preferred embodiments of the invention by way of example, and it is to be understood that the description is intended to further illustrate features and advantages of the invention, and not to limit the scope of the claims.
The noun explains:
accessing a service: the method particularly refers to a program of a protocol of the internet of things platform docking equipment, if the equipment reports data by adopting an HTTP protocol, corresponding HTTP monitoring service is needed in the access service to obtain the data reported by the equipment, the format type of the data is json, and other internet of things communication protocols are similar in access.
Message middleware: message middleware is a supportive software system that provides synchronous or asynchronous, reliable message transport for application systems in a network environment based on queue and messaging technology. Is a storage carrier of the message, and aims to reduce the coupling degree of message communication between different systems.
A tenant: the user using the Internet of things platform is different from a platform system administrator, the permission range of the tenant is limited, the user can only operate equipment, assets and the like under the current user generally, and the information of other tenants cannot be interfered.
Referring to fig. 1, an embodiment of the present invention provides a method for processing an internet of things platform message based on streaming processing, including the following steps.
Firstly, the data access service of the platform of the internet of things receives data reported by equipment and pushes original data reported by the equipment to a message middleware for storing messages.
Specifically, the data reported by the device and received by the platform data access service of the internet of things at least includes a tenant ID and a message type of the device, and one or more of the device ID, a device state, or sensing data monitored by the device.
In an illustrated embodiment, the device reports data to the internet of things platform access service, and the data information includes an ID of the device, a state of the device, sensing data monitored by the device, and the like. And the access service receives the reported data, completes the tenant information of the equipment and the message type of the reported message according to the equipment id and an equipment information table maintained on the platform of the Internet of things, and pushes the message to a message middleware.
And secondly, setting at least one preposed streaming processing node configured with a first type of processing rule, extracting specified characteristic information from the original data stored in the message middleware, splitting the original data into message branches taking the specified characteristic information as a division basis based on the first type of processing rule, and then storing each message branch to the message middleware again.
As a preferred embodiment, the specific feature information extracted in this step includes the tenant ID and the message type, so as to split the original data into message branches based on the tenant ID and/or the message type.
Referring to fig. 2, in one illustrative embodiment, pre-streaming processing nodes are set up based on a siddhi streaming engine, where a first class of processing rules is custom configured by a user in setting up the nodes. In this embodiment, a pre-stream processing node of a first type of processing rule is configured, data is consumed from a message middleware, a tenant id, a message type, and message data of a message are obtained, the message is distributed according to the configured rule, the tenant id and the message type are spliced to serve as a flow direction topic of the message, the message is pushed to the topic specified by the message middleware, and messages of different message types are pushed to different topics.
It should be noted that, in another embodiment, an operator model may also be used to perform distribution processing on the originally reported message according to the tenant id and the message type, so that the message distribution processing performed on the original message by using the rules of the siddhi streaming engine may be simplified, the streaming processing engine may be configured in a centralized manner to perform branch processing on the distributed message, complexity caused by multiple configuration processes may be reduced, and the core may be placed in the logic compiling of the distributed message processing.
And thirdly, setting at least one post-streaming processing node configured with a second type of processing rule, extracting the equipment information or data part information of each message branch in the message middleware, processing each message branch based on the second type of processing rule, and storing the processed result in a database or continuously transferring to the next message middleware.
As a preferred embodiment, the second type of processing rule in this step includes processing logic for the device information or data portion in the message branch. Wherein the logic for processing the device information in the message branch comprises further splitting the message branch based on the device ID or the device status; the processing logic for the data portion of the message branch includes at least one of filtering, aggregating, consuming, filtering, converting, accumulating, arithmetic, or storage integrating the data.
Referring to fig. 3, in one illustrative embodiment, sensory data in the message branch, including battery and temperature, is processed based on a siddhi streaming engine configured post-streaming processing node 1 configured with a second type of processing rule.
The method specifically comprises the following steps:
consuming data from the topic of the reported message type, judging whether the temperature in the message is more than 90, if so, pushing the part of the message to the topic of the specified processing in the message middleware for processing by a post-level streaming processing node; and consuming data from the topic of the report message type, and storing all fields of the data in a database for querying historical data.
Meanwhile, the post-streaming processing node 2 configured with the second type of processing rule set based on the siddhi streaming engine processes the device state data in the message branch, including status (device state); and consuming data from the topic of the report message type, and storing all fields of the data into a database for querying historical data.
After the above processing, if the message needs further processing, the next step is performed:
fourthly, setting a post-stage streaming processing node configured with a subsequent processing rule, carrying out secondary processing on the data transferred to the next message middleware based on the subsequent processing rule, and storing the processed result in a database or continuously transferring to the next message middleware; the process is repeated until the processed data meets the preset service requirement.
Referring to fig. 3, in an illustrated embodiment, after the post-streaming processing node 1 performs first processing on the temperature (monitored temperature) in the message branch (determines whether the temperature in the message is greater than 90), a post-streaming processing node may be further configured, and the number of all messages whose temperature is greater than 90 are cumulatively generated is used as one data of the statistical service with the over-high temperature, and the final data is stored in a database or continuously transferred to the middle of the next message for further processing.
It should be noted that, in the above embodiment, the processing rules configured by each streaming processing node may be configured by the user based on the siddhi streaming engine, so as to meet the user's requirement for customizing or optimizing the processing rules. By adopting the method, a relational database is not relied on, and a single configuration file occupies a small space, so that the expandability of message processing of the platform of the Internet of things is greatly enhanced.
Through the process, the purpose of shunting the message converged to the platform is achieved, the message after shunting is further processed, and therefore the purpose of shunting is achieved, the concurrency is improved, the timeliness is achieved, the delay of message processing is reduced, the overall stability and high efficiency of the platform of the internet of things are improved, and the requirements of a user on self-defining or optimized processing rules are met.
Another embodiment of the invention provides a message processing system of an internet of things platform based on streaming processing, so as to implement the method. As a preferred embodiment, the system in this example comprises:
the Internet of things platform data access service is used for receiving data reported by equipment;
at least one message middleware for storing the original data reported by the device or the data processed by the streaming processing node;
the configuration unit is used for configuring a preposed stream processing node and is used for extracting specified characteristic information from the original data stored in the message middleware, splitting the original data into message branches taking the specified characteristic information as a division basis based on a first type of processing rule and then storing each message branch to the message middleware again; and
the post-configured streaming processing node is used for extracting equipment information or data part information of each message branch in the message middleware, processing each message branch based on a second type of processing rule, and storing a processed result in a database or continuously transferring to the next message middleware; and
the system comprises a post-level streaming processing node, a database and a post-processing middleware, wherein the post-level streaming processing node is used for configuring a post-level streaming processing node, and is used for reprocessing the data transferred to the next message middleware based on a post-processing rule and storing the processed result in the database or transferring the processed result to the next message middleware for reprocessing;
and the database is used for storing the original data or the data processed by each streaming processing node.
In this embodiment, the front-end streaming processing node is set based on a siddhi streaming engine or an actor model, and the back-end streaming processing node are set based on the siddhi streaming engine.
It should be noted that the system in this embodiment may be run on a computer, and the user may implement the custom configuration of the first type processing rule, the second type processing rule, and the subsequent processing rule based on the siddhi streaming engine through software or an operation window. The specific implementation process has been described in detail in the foregoing method embodiments, and is not described herein again.
The above description of the embodiments is only intended to facilitate the understanding of the method of the invention and its core idea. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present invention.
Claims (5)
1. An Internet of things platform message processing method based on streaming processing is characterized by comprising the following steps:
s1, receiving data reported by the equipment by the Internet of things platform data access service, and pushing the original data reported by the equipment to a message middleware for storing messages;
s2, setting at least one prepositive stream processing node configured with a first type processing rule, extracting specified characteristic information from the original data stored in the message middleware, splitting the original data into message branches taking the specified characteristic information as a division basis based on the first type processing rule, and then storing each message branch to the message middleware again;
s3, setting at least one post-flow processing node configured with second type processing rules, extracting the device information or data part information from each message branch in the message middleware, processing each message branch based on the second type processing rules, and continuously transferring the processed result to the next message middleware;
s4, setting a post-stage streaming processing node configured with a post-processing rule, carrying out re-processing on the data transferred to the next message middleware based on the post-processing rule, and continuously transferring the processed result to the next message middleware; repeating the process until the processed data meet the preset service requirement, and storing the processed data in a database;
the front-stage streaming processing node, the rear-stage streaming processing node and the rear-stage streaming processing node are arranged based on the siddhi streaming engine; the second type of processing rule includes processing logic for device information or data portions in the message branch, the processing logic for device information in the message branch includes further splitting the message branch based on the device ID or the device state, and the processing logic for data portions in the message branch includes one of filtering, aggregating, consuming, filtering, converting, accumulating, arithmetic, or storage integration of the data.
2. The internet of things platform message processing method based on streaming processing according to claim 1, wherein in step S1, the data reported by the device received by the internet of things platform data access service at least includes a tenant ID and a message type of the device, and one or more of a device ID, a device state, or sensing data monitored by the device.
3. The internet of things platform message processing method based on streaming processing as claimed in claim 2, wherein in step S2, the extracted specified feature information includes a tenant ID and a message type, and the original data is split into message branches based on the tenant ID and/or the message type.
4. The message processing method of an internet of things platform based on streaming processing as claimed in any one of claims 1-3, wherein the first type of processing rule, the second type of processing rule and the subsequent processing rule are configured by a user based on a siddhi streaming engine or an actor model in a customized manner.
5. An internet of things platform message processing system based on streaming processing, comprising:
the Internet of things platform data access service is used for receiving data reported by equipment;
at least one message middleware for storing the original data reported by the device or the data processed by the streaming processing node;
the configuration unit is used for configuring a preposed stream processing node, the preposed stream processing node is used for extracting specified characteristic information from the original data stored in the message middleware, splitting the original data into message branches taking the specified characteristic information as a division basis based on a first class of processing rules, and then storing each message branch to the message middleware again; and
the post-streaming processing node is used for extracting the equipment information or the data part information of each message branch in the message middleware, processing each message branch based on a second class of processing rules and continuously transferring the processed result to the next message middleware; and
the system comprises a post-level streaming processing node, a post-level streaming processing node and a message middleware, wherein the post-level streaming processing node is used for carrying out reprocessing on data transferred to the next message middleware based on a post-processing rule and transferring a processed result to the next message middleware for reprocessing;
the database is used for storing original data or data which is processed by each streaming processing node and meets the preset service requirement;
the front-end streaming processing node is set based on a siddhi streaming engine or an operator model, and the rear-end streaming processing node are set based on the siddhi streaming engine; the first type of processing rule, the second type of processing rule and the subsequent processing rule are configured by a user in a customized mode based on the siddhi streaming engine or the actor model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111397905.3A CN113821361B (en) | 2021-11-24 | 2021-11-24 | Internet of things platform message processing method and system based on streaming processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111397905.3A CN113821361B (en) | 2021-11-24 | 2021-11-24 | Internet of things platform message processing method and system based on streaming processing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113821361A CN113821361A (en) | 2021-12-21 |
| CN113821361B true CN113821361B (en) | 2022-05-17 |
Family
ID=78919726
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111397905.3A Active CN113821361B (en) | 2021-11-24 | 2021-11-24 | Internet of things platform message processing method and system based on streaming processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113821361B (en) |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110601876A (en) * | 2019-08-20 | 2019-12-20 | 西安向南网络信息科技有限公司 | Intelligent Internet of things platform |
| CN110677277B (en) * | 2019-09-02 | 2021-12-28 | 深圳中兴网信科技有限公司 | Data processing method, device, server and computer readable storage medium |
| CN112825070A (en) * | 2019-11-21 | 2021-05-21 | 高新兴科技集团股份有限公司 | Rule processing method and device based on data flow of Internet of things and storage medium |
| CN111897843B (en) * | 2020-06-19 | 2023-10-31 | 深圳奇迹智慧网络有限公司 | Configuration method and device of data flow strategy of Internet of things and computer equipment |
| CN112333227B (en) * | 2020-09-11 | 2022-07-15 | 浙江工业大学 | Internet of things platform of mixed type protocol based on rule engine |
| CN113360576A (en) * | 2021-06-16 | 2021-09-07 | 国电南瑞科技股份有限公司 | Power grid mass data real-time processing method and device based on Flink Streaming |
-
2021
- 2021-11-24 CN CN202111397905.3A patent/CN113821361B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113821361A (en) | 2021-12-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109254982B (en) | Stream data processing method, system, device and computer readable storage medium | |
| CN110995846A (en) | Internet of things collected data processing device, method and system | |
| WO2019223062A1 (en) | Method and system for processing system exceptions | |
| CN112235130A (en) | Method and device for realizing operation and maintenance automation based on SDN network | |
| CN110535928B (en) | Event pushing method for JAVA intelligent contract of block chain | |
| CN114363042B (en) | Log analysis method, device, equipment and readable storage medium | |
| CN114338746A (en) | Analysis early warning method and system for data collection of Internet of things equipment | |
| CN101667932B (en) | Method of network element equipment log management and device | |
| CN114885044A (en) | Adaptive analysis processing method for heterogeneous monitoring data packet of measurement and control equipment | |
| RU2697648C2 (en) | Traffic classification system | |
| KR101686919B1 (en) | Method and apparatus for managing inference engine based on big data | |
| CN114328695A (en) | ETL data processing method and device, computing equipment and storage medium | |
| CN113821361B (en) | Internet of things platform message processing method and system based on streaming processing | |
| CN111191103B (en) | Method, device and storage medium for identifying and analyzing enterprise subject information from internet | |
| CN112817539A (en) | Industrial data storage method and system, electronic device and storage medium | |
| EP3756105A1 (en) | Standing query creation using store query | |
| CN108737522A (en) | A kind of processing method of message, device and system | |
| Chen et al. | A semantic unification approach for M2M applications based on ontology | |
| CN116225866A (en) | Alarm information processing method and device, electronic equipment and readable storage medium | |
| CN112328613B (en) | Online analysis processing method and device, electronic equipment and storage medium | |
| CN115174633B (en) | Industrial Internet service data processing method and system and cloud platform | |
| WO2021169524A1 (en) | Network operation and maintenance method, apparatus and system | |
| CN112286875A (en) | System framework for processing real-time data stream and real-time data stream processing method | |
| CN108111344B (en) | Linkable streaming data analysis dynamic process construction model implementation method | |
| CN117573755A (en) | Stream data processing platform and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220330 Address after: 310000 3002-23, Tianren building, No. 188, Liyi Road, ningwei street, Xiaoshan District, Hangzhou City, Zhejiang Province Applicant after: Cecep Jinghe Smart City Technology (Zhejiang) Co.,Ltd. Applicant after: China energy saving Jinghe Technology Co.,Ltd. Address before: 310000 3002-23, Tianren building, No. 188, Liyi Road, ningwei street, Xiaoshan District, Hangzhou City, Zhejiang Province Applicant before: Cecep Jinghe Smart City Technology (Zhejiang) Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: No. 689, aixihu North Road, high tech Industrial Development Zone, Nanchang City, Jiangxi Province Patentee after: China energy saving Jinghe Technology Co.,Ltd. Patentee after: Cecep Jinghe Smart City Technology (Zhejiang) Co.,Ltd. Address before: 310000 3002-23, Tianren building, No. 188, Liyi Road, ningwei street, Xiaoshan District, Hangzhou City, Zhejiang Province Patentee before: Cecep Jinghe Smart City Technology (Zhejiang) Co.,Ltd. Patentee before: China energy saving Jinghe Technology Co.,Ltd. |
|
| CP03 | Change of name, title or address | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231211 Address after: No. 689, aixihu North Road, high tech Industrial Development Zone, Nanchang City, Jiangxi Province Patentee after: China energy saving Jinghe Technology Co.,Ltd. Address before: No. 689, aixihu North Road, high tech Industrial Development Zone, Nanchang City, Jiangxi Province Patentee before: China energy saving Jinghe Technology Co.,Ltd. Patentee before: Cecep Jinghe Smart City Technology (Zhejiang) Co.,Ltd. |
|
| TR01 | Transfer of patent right |