CN111031511A - Variable-granularity real-time environment data acquisition method for Internet of things - Google Patents
Variable-granularity real-time environment data acquisition method for Internet of things Download PDFInfo
- Publication number
- CN111031511A CN111031511A CN201911371100.4A CN201911371100A CN111031511A CN 111031511 A CN111031511 A CN 111031511A CN 201911371100 A CN201911371100 A CN 201911371100A CN 111031511 A CN111031511 A CN 111031511A
- Authority
- CN
- China
- Prior art keywords
- data
- prediction
- time
- nodes
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0203—Power saving arrangements in the radio access network or backbone network of wireless communication networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
A variable granularity real-time environment data acquisition method for the Internet of things belongs to the field of Wireless Sensor Networks (WSNs). The nodes in the wireless sensor network are limited by the volume of the nodes, the energy carried by the nodes is limited, and the energy consumption for data transmission occupies a large amount of node energy consumption, so how to reduce the node energy consumption is an important problem in the WSN. Considering that in the WSN for collecting normal data, the data collected by the nodes usually have strong data correlation, which makes it possible to predict the data by using the linear correlation of the data, reduce the data transmission amount, reduce the energy consumption of data transmission, and prolong the life cycle of the network. In the method, the same prediction model needs to be run on the environmental sensor node and the server sink node. At the same time, the predictive model produces the same predicted real-time data at both ends. Meanwhile, deviation judgment of the predicted value and actual real-time data is carried out on the environment sensor nodes, and if the prediction is met, the communication behavior of the sensor nodes is restrained to reduce the data transmission quantity and reduce the overall energy consumption. If the prediction is not satisfied, the environmental sensor node is required to transmit data. Meanwhile, the method provides a corresponding data coding mode to compress data volume and a data packet message format suitable for a double prediction model.
Description
The technical field is as follows:
the invention relates to a variable-granularity real-time environment data acquisition method for the Internet of things.
Background
The collection, processing and transmission of environmental data are one of the most important targets for the application of the internet of things, and limited hardware, network and computing resources are the main bottlenecks limiting the development of the internet of things: therefore, efficient and low-power-consumption environmental data collection becomes one of the most popular research directions in the field of internet of things, and the prediction model scheme is concerned about reducing the communication quantity between nodes to a certain extent.
Many error-based prediction model schemes now perform error estimation after performing complex mathematical prediction operations to obtain a value that satisfies the error. In fact, since the actual environmental data changes slightly and slowly, and the data changes within the error interval in a long time, performing the complicated mathematical prediction operation without deviating from the error interval consumes some unnecessary system resources. And many prediction model schemes do not encode data, actual data are directly transmitted, and communication bandwidth resources are wasted. Therefore, the scheme for acquiring the variable-granularity real-time environment data facing to the Internet of things is provided.
Disclosure of Invention
The invention designs an internet of things real-time data collection method, which is used for saving limited storage resources and operation resources of sensor nodes and reasonably utilizing limited communication capacity between the sensor nodes and sink nodes.
The hardware main body of the invention is a sensor node and a sink node, wherein the sensor node is responsible for collecting, processing and sending data, and the sink node is responsible for receiving and processing data and is a final data collection place. The deployment is detailed in fig. 1.
The prediction model scheme can effectively reduce the communication times between the sensor nodes and the sink nodes, so that the communication energy consumption between the nodes is reduced. The prediction model scheme is realized by running the same prediction algorithm on the sensor node and the sink node, meanwhile, the sensor node and the sink node have the same acquisition period, the sensor node collects and codes real environment data at a preset acquisition time, and then the real environment data is compared with prediction data generated by the prediction model, if the prediction is satisfied, the communication behavior is inhibited, and if the prediction is not satisfied, the coded data needs to be sent out. Meanwhile, the sink node at the other end updates the data pool by using the received data as data or by using the data generated by the prediction model as data, as shown in fig. 2 and 3. And at the preset acquisition time, the prediction algorithm is operated at the sensor node and the sink node to generate the same prediction result.
Real environmental data is often a collection of limited data spaces, in (U)min,Umax) Now, the data space set is divided into a plurality of intervals with the length of 2 δ, and δ is the error allowed by the prediction model. According to equation (1), n segments will be generated.
Now, a fixed-length coding mode is adopted, and each interval segment corresponds to a binary code with the length of L. The length L is obtained by equation (2).
L=log2n (2)
Now, assuming that there is a set of humidity environment data, the unit is%, the distribution range is 0.00% to 7.99%, and the error tolerance is 0.25%, after processing, the limited data space can be divided into a plurality of binary codes, as shown in fig. 4.
Here a simple monitoring mechanism is used to build a prediction model, as shown in fig. 5, which predicts the overall trend of the change by periodic change monitoring for each bit of the encoded data. For each bit, a bit space is created, in which a queue of n cycles of historical data is stored, and only the most recently occurring n cycles of historical data are stored, the queue being denoted by tn,tn-1,tn-2,…,t1]The historical data period refers to the time for which the data retention state is unchanged. The next variation period T of each bit is predicted according to equation (3), as shown in fig. 6.
At each acquisition moment, the prediction model judges whether each digit needs to change at the current sampling moment according to the latest change moment of each digit and the change period T obtained by averaging the latest n times of historical data periods, and the final overall prediction is generated through local prediction of each digit.
The data message is sent to the sink node by the sensor node. The message format adopts UTF-8 coding.
Start symbol | Source of message | Message sequence number | Message body | Check code | Ending symbol |
1 byte | 2 bytes | 1 byte | N byte | 2 bytes | 1 byte |
The start character: 0x23 (#);
the source of the message: sensor ID, the entire network can accommodate 256 × 256 sensor nodes.
Message sequence number: the sequence used for marking the message, for the same node message, the message counts from 0x00 to 0xFF according to the sending sequence, and counts again every 256 messages;
message body: all information in the message is contained;
checking: the check is performed from the start symbol to the end of the message body. CRC-16/IBM is adopted for checking;
an end symbol: 0x25 (%);
for example, the sink node receives a piece of information 0x23FF0403646C0925, the content of the message is start symbol 0x23, message source 0xFF04, message sequence 0x03, message body 0x64, check code 0x6C09, and end symbol 0x 25.
Advantageous effects
1. Based on the sensor binary number processing, floating point number conversion is not needed, the calculation is based on binary codes from beginning to end, the calculation is faster, and the cost is smaller;
2. the tolerance of the user to the error is put to the beginning instead of the end, so that the data volume is reduced at the beginning, and all subsequent calculations are convenient;
3. and the coded data is predicted and transmitted, so that the energy consumption is reduced.
Drawings
FIG. 1 is a schematic diagram of a device deployment;
FIG. 2 is a flow chart of sink node work;
FIG. 3 is a sensor node workflow diagram;
FIG. 4 is a schematic view of a process of converting data collected by a sensor into corresponding encoded data;
FIG. 5 is a schematic diagram of a monitoring mechanism;
FIG. 6 is a state update flow chart;
Detailed Description
How this model works is described below with specific cases: at a predetermined acquisition time, the sensor node converts the collected environmental data into its corresponding code, which is then compared with the predictive data generated by the contemporaneous predictive model. If the data is the same, the send operation is suppressed and instead the data needs to be sent and then the queue holding the historical data period is updated. Meanwhile, at the other end, the sink node needs to judge whether the sink node collects data at a preset time, if the sink node receives the data, the received data is used as a real-time data record, if the sink node does not receive the data, a data is generated according to a self prediction model and used as a real-time data record, and the data is the same as the data generated by a prediction model operated at the sensor end, and a queue storing a historical data period is updated. Finally, the encoded data is stored in the data pool, so that the encoded data needs to be restored into a data interval according to a preset encoding rule when the data pool is used at last.
Suppose that data encoded as 0011 is collected in real time at the sensor node side, and the prediction model also generates data encoded as 0011. At this time, the sensor node considers that the prediction is successful and suppresses the data uploading behavior. Since the sensor node prediction model and the sink node prediction model are the same, at the sink node, the prediction model generates the same data 0011. After the preset collection period is finished, the sink node does not receive any data, the data 0011 generated by the model is considered to be correct, and the data 0011 is stored in the data pool. After the preset acquisition period is finished, the sensor nodes and the sink nodes update the prediction model according to the data 0011.
Suppose that 0100 encoded data is collected at the sensor node end in real time, and 0011 encoded data is generated by the prediction model. At this time, the sensor node regards the prediction as failed and uploads the data. At the sink node at the other end, the predictive model produces prediction data 0011. In a preset acquisition period, as the sink node receives the data 0100, the sink node considers that the prediction fails, discards the predicted data 0011, and stores the data 0100 in the data pool. After the predetermined acquisition period is finished, the sensor nodes and the sink nodes update the prediction model according to the data 0100.
0-1 state machine:
after the acquisition period is finished, it is assumed that the prediction model is updated by 0100 data, and the specific process is as follows: the 0100 data is sequentially decomposed into four bit state values of 0, 1, 0 and 0, and then the related information value of each bit state is updated. Taking a first bit state value 0 as an example, the state value 0 is input into a first bit space corresponding to a model, a cycle queue [2, 2,3,4] of which the latest n is 4 state changes, a state identifier (0 or 1) of the bit, namely the previous data state and the time point of the latest state change, are stored in the first bit space of the model, the first 2 in [2, 2,3,4] is the latest encoded data change cycle, and the last 4 is the farthest data change cycle. If in this update it is found that the input value 0 is different from the current bit identifier, i.e. the current bit identifier is 1, then the update cycle queue is required to be [1,2,2,3], update the current bit identifier to 0, update the latest state change time point. If the current bit identifier is found to be 0, i.e., the state has not changed, then the current bit identifier and the most recent state change time point are not changed, and only the periodic alignment is changed to [3,2,3,4 ].
Assuming that a prediction model is needed to generate data, for each bit, the prediction model takes the average value of the change period queue as the change period of the prediction model, further estimates whether the prediction model changes at the current time point, outputs the prediction state of each bit, and generates the final overall prediction by locally predicting each bit.
Claims (3)
1. A variable granularity real-time environment data acquisition method facing to the Internet of things is characterized in that a hardware main body comprises sensor nodes and sink nodes, the sensor nodes are responsible for acquiring, processing and sending data, the sink nodes are responsible for receiving and processing the data and are final sink places of the data, and the method is characterized by comprising the following steps: the same prediction model is deployed at the sensor node and the sink node, and the communication traffic of data at two ends is reduced through the behavior of prediction data; the sensor nodes and the sink nodes have the same acquisition period, the sensor nodes acquire and encode environmental data at a preset acquisition time, and a prediction model on the sensor nodes also generates real-time prediction data; the sensor node compares the predicted data with the actually acquired data, and if the predicted data is the same as the actually acquired data, the communication behavior is inhibited; if the data are different, the actually acquired data need to be sent out; meanwhile, at the sink node at the other end, at a preset acquisition time, the prediction model deployed on the sink node also generates real-time prediction data, after the acquisition time is over, if the sink node receives the data, the data is taken as the real-time data, if the sink node does not receive the data, the prediction data is considered to meet the prediction, and the prediction data is taken as the real-time data.
2. The acquisition method according to claim 1, characterized in that: the coding process of the coded data generated by the sensor nodes is as follows:
the real environment data is a collection of finite data spaces, in (U)min,Umax) In the meantime, the data space set is divided into a plurality of intervals with the length of 2 delta, delta is the error allowed by the prediction model, n interval segments are generated according to the formula (1),
at present, a fixed-length coding mode is adopted, each interval segment corresponds to a binary code with the length L, the length L is obtained by a formula (2),
L=log2n (2) 。
3. the acquisition method according to claim 1, wherein the prediction model is used for predicting the encoded data, and the prediction model uses a monitoring mechanism to generate a binary code having the same length as the encoded data, specifically, the change trend of the whole binary code is predicted by monitoring the periodic change of each bit of the binary code; wherein, for each bit, a queue [ t ] is established for storing the history data change periodn,tn-1,tn-2,…,t1]Recording the latest change time of the corresponding bit data, and storing the state identifier of the corresponding bit; then, taking the average value of the recently generated n times of historical data periods as the next change period T of each digit; when the prediction data needs to be generated, the prediction moduleJudging whether each bit needs to be changed at the moment, and generating a final overall prediction by locally predicting each bit, wherein the condition of the change of the ith bit data is as follows:
current predicted time tkThe average value of the last change time of the ith data and the latest n times of historical data cycles of the ith data.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911371100.4A CN111031511A (en) | 2019-12-26 | 2019-12-26 | Variable-granularity real-time environment data acquisition method for Internet of things |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911371100.4A CN111031511A (en) | 2019-12-26 | 2019-12-26 | Variable-granularity real-time environment data acquisition method for Internet of things |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111031511A true CN111031511A (en) | 2020-04-17 |
Family
ID=70214872
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911371100.4A Pending CN111031511A (en) | 2019-12-26 | 2019-12-26 | Variable-granularity real-time environment data acquisition method for Internet of things |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111031511A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112163668A (en) * | 2020-09-29 | 2021-01-01 | 上海交通大学 | Method for reducing time series data transmission based on prediction and cloud edge cooperation |
CN112597177A (en) * | 2020-12-30 | 2021-04-02 | 中冶南方工程技术有限公司 | Blast furnace real-time data updating method and device based on point location marks |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102595496A (en) * | 2012-03-08 | 2012-07-18 | 西北大学 | Context-adaptive quotient and remainder encoding method used for sensing data of wireless sensing nodes |
CN103345227A (en) * | 2013-07-02 | 2013-10-09 | 东南大学 | Micro grid monitoring and energy management device and method |
CN103354652A (en) * | 2013-06-14 | 2013-10-16 | 中国农业大学 | Method and apparatus for lightweight data fusion in WBAN (wireless body area network) |
CN104507096A (en) * | 2014-12-10 | 2015-04-08 | 中国科学院计算技术研究所 | Model-driven data transmission method and system in wireless sensor network |
US9235804B1 (en) * | 2013-03-12 | 2016-01-12 | Google Inc. | System and method for selecting and serving content items based on sensor data from mobile devices |
-
2019
- 2019-12-26 CN CN201911371100.4A patent/CN111031511A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102595496A (en) * | 2012-03-08 | 2012-07-18 | 西北大学 | Context-adaptive quotient and remainder encoding method used for sensing data of wireless sensing nodes |
US9235804B1 (en) * | 2013-03-12 | 2016-01-12 | Google Inc. | System and method for selecting and serving content items based on sensor data from mobile devices |
CN103354652A (en) * | 2013-06-14 | 2013-10-16 | 中国农业大学 | Method and apparatus for lightweight data fusion in WBAN (wireless body area network) |
CN103345227A (en) * | 2013-07-02 | 2013-10-09 | 东南大学 | Micro grid monitoring and energy management device and method |
CN104507096A (en) * | 2014-12-10 | 2015-04-08 | 中国科学院计算技术研究所 | Model-driven data transmission method and system in wireless sensor network |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112163668A (en) * | 2020-09-29 | 2021-01-01 | 上海交通大学 | Method for reducing time series data transmission based on prediction and cloud edge cooperation |
CN112163668B (en) * | 2020-09-29 | 2023-05-05 | 上海交通大学 | Method for reducing time series data transmission quantity based on prediction and cloud edge cooperation |
CN112597177A (en) * | 2020-12-30 | 2021-04-02 | 中冶南方工程技术有限公司 | Blast furnace real-time data updating method and device based on point location marks |
CN112597177B (en) * | 2020-12-30 | 2022-06-24 | 中冶南方工程技术有限公司 | Blast furnace real-time data updating method and device based on point location marks |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Kountouris et al. | Semantics-empowered communication for networked intelligent systems | |
Tayeh et al. | A distributed real-time data prediction and adaptive sensing approach for wireless sensor networks | |
Al-Qurabat et al. | Two tier data reduction technique for reducing data transmission in IoT sensors | |
Tayeh et al. | A spatial-temporal correlation approach for data reduction in cluster-based sensor networks | |
CN111031511A (en) | Variable-granularity real-time environment data acquisition method for Internet of things | |
Abdulzahra MSc et al. | Energy conservation approach of wireless sensor networks for IoT applications | |
US10484286B2 (en) | Adaptive reliability protocol | |
Al-Qurabat et al. | A Bi-level data lowering method to minimize transferring big data in the sensors of IoT applications | |
Luo et al. | A novel adaptive gradient compression scheme: Reducing the communication overhead for distributed deep learning in the Internet of Things | |
CN111629232A (en) | Real-time video transmission self-adaptive forward error correction method and system based on deep learning | |
Al-Qurabat et al. | Dictionary-based dpcm method for compressing iot big data | |
CN113556253A (en) | Method, system, device and storage medium for predicting real-time flow of switch port | |
Ye et al. | LT codes based distributed coding for efficient distributed storage in wireless sensor networks | |
CN112994965B (en) | Network anomaly detection method and device and server | |
Enam et al. | An adaptive data aggregation technique for dynamic cluster based wireless sensor networks | |
Vidhyapriya et al. | Energy efficient data compression in wireless sensor networks. | |
CN110856144B (en) | LT code-based atomization caching method in mobile edge computing network | |
CN111182488A (en) | Traceability data energy-saving transmission method based on time channel | |
CN103427951B (en) | With the data forwarding method that coding redundancy controls | |
Hong et al. | On the throughput, delay, and energy efficiency of distributed source coding in random access sensor networks | |
Liu et al. | Energy-efficient scheduling of distributed estimation with convolutional coding and rate-compatible punctured convolutional coding | |
Lu et al. | Backup path with energy prediction based on energy-aware spanning tree in wireless sensor networks | |
Chen et al. | Research on data compression algorithm based on prediction coding for wireless sensor network nodes | |
CN106302573B (en) | Method, system and device for processing data by adopting erasure code | |
Chang et al. | Bounded error data compression and aggregation in wireless sensor networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200417 |