CN114900523A - Directional load balancing data flow processing method under Internet of things architecture - Google Patents
Directional load balancing data flow processing method under Internet of things architecture Download PDFInfo
- Publication number
- CN114900523A CN114900523A CN202210497186.0A CN202210497186A CN114900523A CN 114900523 A CN114900523 A CN 114900523A CN 202210497186 A CN202210497186 A CN 202210497186A CN 114900523 A CN114900523 A CN 114900523A
- Authority
- CN
- China
- Prior art keywords
- data
- load balancing
- service
- internet
- directional load
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a directional load balancing data flow processing method under an Internet of things architecture, and provides a directional load balancing service for the same equipment under a big data Internet of things architecture, so that the high-performance transmission of data in a distributed system is ensured, and the supervision requirement of the system on the equipment is met. The directional load balance realizes data interaction on external services by an input part and an output part; the method and the device for receiving the subscription data improve the oriented high-performance data flow of the same device which cannot be realized by the traditional load balancing. The Internet of things equipment can realize low-delay high-efficiency real-time processing on data, and as the number of monitored equipment is increased, the problem of data processing is not needed to be worried, only data acquisition service needs to be added, data sending service is registered, and when data comes, the data is sent to the data forwarding service.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a directional load balancing data flow processing method under an Internet of things architecture.
Background
The internet of things is that any object or process needing monitoring, connection and interaction is collected in real time through various devices and technologies such as various information sensors, radio frequency identification technologies, global positioning systems, infrared sensors, laser scanners and the like, various required information such as sound, light, heat, electricity, mechanics, chemistry, biology, positions and the like is collected, ubiquitous connection of objects and objects, and ubiquitous connection of objects and people are realized through various possible network accesses, and intelligent sensing, identification and management of the objects and the processes are realized. The internet of things is an information bearer based on the internet, a traditional telecommunication network and the like, and all common physical objects which can be independently addressed form an interconnected network.
The construction of the Internet of things is less than the creation of the cloud platform of the Internet of things, data collected by the sensors are transmitted to the platform in a timing mode, the types of Internet-connected objects are different, the transmitted data and the collected return frequency are different, vehicles and batteries are taken as examples, the data volume required by the objects is large, the collected return frequency is high, and the collected return frequency is 10 seconds, 2 seconds, 1 second and 200 milliseconds. 10 ten thousand and 1 million devices return to the platform with 200 milliseconds of data, and a single data server cannot process such a large amount of data simultaneously. The equipment that thing networking platform accessed, not only save data, still can carry out real-time data processing to data, the platform need carry out quick real-time processing to a large amount of data after receiving data, the scheme of traditional internet is that data branch is handled to different servers through load balancing after the data upload, every request can be handled independently, but the control of thing networking requires that each data that is uploaded by supervisory equipment will have the continuation, if the data that uploads same equipment has come into different data processing server respectively then the result of calculating can't satisfy the demand.
1. Load balancing is needed for data with large data volume and received data;
2. the accessed equipment is in a mobile state, the network environment is unstable, and the equipment is frequently reconnected;
3. traditional load balancing is performed according to each piece of data;
4. the data of the same monitored equipment can be distributed to different servers;
5. the monitored devices need to process the data in real time to fulfill regulatory requirements.
6. Data processing requires continuity.
7. Traditional load balancing may follow the sharing of data among different servers based on server stress.
8. The data processing loses continuity;
9. if the cache is used for storing the equipment state data in the middle of the server, the performance is low;
10. if the state data is not saved. Such as: the monitoring equipment alarms at the temperature of 80 ℃ for 60 seconds, the state data of the first 30 seconds is not stored, the system only judges the last 30 seconds, and the normal use of the system is seriously influenced when the alarm is not given in the process of alarming.
Disclosure of Invention
The present invention is directed to a phase-cut power supply and a color matching method thereof, so as to solve the problems mentioned in the background art.
In order to achieve the purpose, the invention provides the following technical scheme:
a directional load balancing data flow processing method under an Internet of things architecture comprises the following steps:
A. starting directional load balancing;
B. starting monitoring of the data input service;
C. starting monitoring of data output service;
D. a data output service subscription;
E. informing the range of the unique identifier of the directional load balancing receiving equipment;
F. saving the link in an array form;
G. registering for data input services;
H. receiving data for a data entry service;
I. judging the integrity of the data;
J. writing a data receiving queue;
K. a data receiving queue, which monitors periodically with a monitoring period of 1 second;
l, whether data exist in the queue or not;
m, taking out a piece of data from the data receiving queue;
n, starting a data sending process;
o, judging whether the data is subscribed or not, and discarding the data if the data is not subscribed;
p, discovering one or more subscriptions, ensuring that the data is received by all the subscriptions, and sending the data to each subscription in a circulating mode;
q, writing the data into a sending queue corresponding to a service subscribed with the unique data identifier;
r, judging the maximum storage upper limit of the queue, and if the maximum storage upper limit is exceeded, discarding the first piece of data and recording a log;
s, monitoring a subscription service sending queue;
t, whether the queue has data or not;
u, taking out a piece of data from a data sending queue of the subscription service;
v, sending data;
w, data transmission is successful;
x, whether other data subscribed to the device exist is checked;
and Y, subscribing the sending process for one more time, and discarding the data if the sending process is not subscribed.
As a further technical scheme of the invention: the directional load balancing realizes data interaction to external services by an input part and an output part.
As a further technical scheme of the invention: the step I is specifically as follows: and judging whether the unique identification information of the equipment exists or not, and discarding the data if the unique identification information does not exist.
As a further technical scheme of the invention: and the step R is used for avoiding server abnormity caused by excessive memory occupation due to data exceeding the upper limit.
As a further technical scheme of the invention: the subscription service has a device unique identification range to be received by the subscription service after registration.
Compared with the prior art, the invention has the beneficial effects that:
the invention improves the directional high-performance data flow of the same equipment which can not be realized by the traditional load balancing. The Internet of things equipment can realize low-delay high-efficiency real-time processing on data, and as the number of monitored equipment is increased, the problem of data processing is not needed to be worried, only data acquisition service needs to be added, data sending service is registered, and when data comes, the data is sent to the data forwarding service.
Drawings
FIG. 1 is an architectural diagram of the present invention.
Fig. 2 is a schematic diagram of the present invention.
FIG. 3 is a flow chart of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-3, the present invention provides a directional load balancing service for the same device in a big data internet of things architecture, which ensures high performance transmission of data in a distributed system and meets the supervision requirements of the system on the device.
The directional load balance realizes data interaction on external services by an input part and an output part; the subscription service is used for receiving subscription data and has a device unique identification range to be received after registration.
A directional load balancing data flow processing method under an Internet of things architecture comprises the following steps:
A. starting directional load balancing;
B. starting monitoring of data input service;
C. starting monitoring of data output service;
D. a data output service subscription;
E. informing the range of the unique identifier of the directional load balancing receiving equipment;
F. saving the link in an array form;
G. registering for data input services;
H. receiving data for a data input service;
I. and judging the integrity of the data, and judging whether the unique identification information of the equipment exists. Whether there is data. If not, discarding the data;
J. writing a data receiving queue;
K. a data receiving queue, which monitors periodically with a monitoring period of 1 second;
l, whether data exist in the queue or not;
m, taking out a piece of data from the data receiving queue;
n, starting a data sending process;
o, judging whether the data is subscribed or not, and discarding the data if the data is not subscribed;
p, discovering one or more subscriptions, ensuring that the data is received by all the subscriptions, and sending the data to each subscription in a circulating mode;
q, writing the data into a sending queue corresponding to a service subscribed with the unique data identifier;
and R, judging the maximum storage upper limit of the queue, and taking the first piece of data to discard and record the log if the maximum storage upper limit is exceeded. In order to avoid server abnormality caused by excessive memory occupation due to data exceeding an upper limit;
s, monitoring a subscription service sending queue;
t, whether the queue has data or not;
u, taking out a piece of data from a data sending queue of the subscription service;
v, sending data;
w, data transmission is successful;
x, whether other data subscribed to the device exist is checked;
and Y, subscribing the sending process for one more time, and discarding the data if the sending process is not subscribed.
The design improves the directional high-performance data flow of the same equipment, which cannot be realized by the traditional load balancing. The Internet of things equipment can realize low-delay high-efficiency real-time processing on data, and as the number of monitored equipment is increased, the problem of data processing is not needed to be worried, only data acquisition service needs to be added, data sending service is registered, and when data comes, the data is sent to the data forwarding service.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Furthermore, it should be understood that although the present specification describes embodiments, not every embodiment includes only a single embodiment, and such description is for clarity purposes only, and it is to be understood that all embodiments may be combined as appropriate by one of ordinary skill in the art to form other embodiments as will be apparent to those of skill in the art from the description herein.
Claims (5)
1. A directional load balancing data flow processing method under an Internet of things architecture is characterized by comprising the following steps:
A. starting directional load balancing;
B. starting monitoring of data input service;
C. starting monitoring of data output service;
D. a data output service subscription;
E. informing the range of the unique identifier of the directional load balancing receiving equipment;
F. saving the link in an array form;
G. registering for data input services;
H. receiving data for a data input service;
I. judging the integrity of the data;
J. writing a data receiving queue;
K. a data receiving queue, which monitors periodically with a monitoring period of 1 second;
l, whether data exist in the queue or not;
m, taking out a piece of data from the data receiving queue;
n, starting a data sending process;
o, judging whether the data is subscribed or not, and discarding the data if the data is not subscribed;
p, discovering one or more subscriptions, ensuring that the data is received by all the subscriptions, and sending the data to each subscription in a circulating mode;
q, writing the data into a sending queue corresponding to a service subscribed with the unique data identifier;
r, judging the maximum storage upper limit of the queue, and if the maximum storage upper limit is exceeded, discarding the first piece of data and recording a log;
s, monitoring a subscription service sending queue;
t, whether the queue has data or not;
u, taking out a piece of data from a data sending queue of the subscription service;
v, sending data;
w, data transmission is successful;
x, whether other data subscribed to the device exist is checked;
and Y, subscribing the sending process for one more time, and discarding the data if the sending process is not subscribed.
2. The method for processing the directional load balancing data flow under the architecture of the internet of things as claimed in claim 1, wherein the directional load balancing is implemented by two parts, namely input and output, so as to implement data interaction on external services.
3. The method for processing the directional load balancing data flow under the architecture of the internet of things according to claim 1, wherein step I specifically comprises: and judging whether the unique identification information of the equipment exists or not, and discarding the data if the unique identification information does not exist.
4. The method for processing the directional load balancing data flow under the architecture of the internet of things according to claim 1, wherein the step R is used for avoiding server abnormality caused by excessive memory occupation due to data exceeding an upper limit.
5. The method for processing the directional load balancing data flow under the architecture of the internet of things as claimed in claim 4, wherein the subscription service has a device unique identification range to be received by the subscription service after registration.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210497186.0A CN114900523A (en) | 2022-05-09 | 2022-05-09 | Directional load balancing data flow processing method under Internet of things architecture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210497186.0A CN114900523A (en) | 2022-05-09 | 2022-05-09 | Directional load balancing data flow processing method under Internet of things architecture |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114900523A true CN114900523A (en) | 2022-08-12 |
Family
ID=82720675
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210497186.0A Pending CN114900523A (en) | 2022-05-09 | 2022-05-09 | Directional load balancing data flow processing method under Internet of things architecture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114900523A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990252A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Data processing method and device |
| CN103458033A (en) * | 2013-09-04 | 2013-12-18 | 北京邮电大学 | System for providing services of event-driven service-oriented internet of things and working method thereof |
| US20190058772A1 (en) * | 2017-08-15 | 2019-02-21 | Microsoft Technology Licensing, Llc | Event delivery |
| CN110336736A (en) * | 2019-05-27 | 2019-10-15 | 四川长虹电器股份有限公司 | The shared method subscribed to is realized based on MQTT server cluster |
| WO2020113304A1 (en) * | 2018-12-06 | 2020-06-11 | Salvus Tecnologia Ltda - Epp | Remote monitoring and management method for medicinal and industrial gases |
| CN113114760A (en) * | 2021-04-12 | 2021-07-13 | 浙江大学 | Construction method of remote Internet of things platform based on heterogeneous equipment |
| CN113572815A (en) * | 2021-06-25 | 2021-10-29 | 广州大学 | Communication technology method, system and medium for crossing heterogeneous platforms |
| CN114095537A (en) * | 2021-11-18 | 2022-02-25 | 重庆邮电大学 | Netty-based mass data access method and system in application of Internet of things |
-
2022
- 2022-05-09 CN CN202210497186.0A patent/CN114900523A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990252A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Data processing method and device |
| CN103458033A (en) * | 2013-09-04 | 2013-12-18 | 北京邮电大学 | System for providing services of event-driven service-oriented internet of things and working method thereof |
| US20190058772A1 (en) * | 2017-08-15 | 2019-02-21 | Microsoft Technology Licensing, Llc | Event delivery |
| WO2020113304A1 (en) * | 2018-12-06 | 2020-06-11 | Salvus Tecnologia Ltda - Epp | Remote monitoring and management method for medicinal and industrial gases |
| CN110336736A (en) * | 2019-05-27 | 2019-10-15 | 四川长虹电器股份有限公司 | The shared method subscribed to is realized based on MQTT server cluster |
| CN113114760A (en) * | 2021-04-12 | 2021-07-13 | 浙江大学 | Construction method of remote Internet of things platform based on heterogeneous equipment |
| CN113572815A (en) * | 2021-06-25 | 2021-10-29 | 广州大学 | Communication technology method, system and medium for crossing heterogeneous platforms |
| CN114095537A (en) * | 2021-11-18 | 2022-02-25 | 重庆邮电大学 | Netty-based mass data access method and system in application of Internet of things |
Non-Patent Citations (1)
| Title |
|---|
| 乔秀全;章洋;吴步丹;程渤;赵帅;马华东;陈俊亮;: "事件驱动、面向服务的物联网服务提供方法", 中国科学:信息科学, no. 10 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11019484B2 (en) | Systems and methods for distributing Internet-of-Things messages | |
| CN112511325B (en) | Network congestion control method, node, system and storage medium | |
| CN101645928A (en) | Content resource caching method, device and system | |
| CN116980284B (en) | Optical cable fiber distribution box operation and maintenance information transmission method and system based on Internet of things | |
| CN106791639A (en) | Video frequency monitoring method and system under large-scale data concurrent environment | |
| CN114466437B (en) | Heartbeat keep-alive method, device, equipment and computer readable storage medium | |
| CN113360783B (en) | User online list updating method and device and computer equipment | |
| CN109561469A (en) | Caching method, device, storage medium and the electronic device of local content | |
| CN114900523A (en) | Directional load balancing data flow processing method under Internet of things architecture | |
| US20140317181A1 (en) | Establishing dynamic connection | |
| CN110825023B (en) | Data interaction method and system between PLC remote modules | |
| CN115242717A (en) | Centralized storage system based on end-side calculation and control method | |
| CN116170445A (en) | Industrial data processing system based on cloud computing | |
| Nidhya et al. | Enhancing Energy Consumption of a Node in Wireless Sensor Networks Using Quick Response Code | |
| CN103414648A (en) | Communication flow control method and system | |
| CN111836228A (en) | Safety precaution analysis alarm system based on thing networking | |
| CN117376352B (en) | Block chain-based Internet of things system | |
| CN216930053U (en) | Data transmission system of Internet of things | |
| CN109005240A (en) | Real time data method for subscribing based on http protocol | |
| CN117857465B (en) | Data processing method, device, equipment, storage medium and program product | |
| CN113595555B (en) | Energy consumption data predictive coding compression acquisition method and system | |
| CN117240903B (en) | Internet of things offline message dynamic management configuration system | |
| CN117992243B (en) | Load balancing method and device for middleware and computer equipment | |
| CN114726895B (en) | Distributed thermoelectric conversion transmission optimization system of intelligent network connection | |
| CN118210578B (en) | Management system for multiple data source platforms |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |