CN111031511A - Variable-granularity real-time environment data acquisition method for Internet of things - Google Patents

Variable-granularity real-time environment data acquisition method for Internet of things Download PDF

Info

Publication number
CN111031511A
CN111031511A CN201911371100.4A CN201911371100A CN111031511A CN 111031511 A CN111031511 A CN 111031511A CN 201911371100 A CN201911371100 A CN 201911371100A CN 111031511 A CN111031511 A CN 111031511A
Authority
CN
China
Prior art keywords
data
prediction
time
nodes
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201911371100.4A
Other languages
Chinese (zh)
Inventor
高彬
徐晓斌
赵辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Technology
Original Assignee
Beijing University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Technology filed Critical Beijing University of Technology
Priority to CN201911371100.4A priority Critical patent/CN111031511A/en
Publication of CN111031511A publication Critical patent/CN111031511A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/38Services specially adapted for particular environments, situations or purposes for collecting sensor information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W52/00Power management, e.g. TPC [Transmission Power Control], power saving or power classes
    • H04W52/02Power saving arrangements
    • H04W52/0203Power saving arrangements in the radio access network or backbone network of wireless communication networks
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

A variable granularity real-time environment data acquisition method for the Internet of things belongs to the field of Wireless Sensor Networks (WSNs). The nodes in the wireless sensor network are limited by the volume of the nodes, the energy carried by the nodes is limited, and the energy consumption for data transmission occupies a large amount of node energy consumption, so how to reduce the node energy consumption is an important problem in the WSN. Considering that in the WSN for collecting normal data, the data collected by the nodes usually have strong data correlation, which makes it possible to predict the data by using the linear correlation of the data, reduce the data transmission amount, reduce the energy consumption of data transmission, and prolong the life cycle of the network. In the method, the same prediction model needs to be run on the environmental sensor node and the server sink node. At the same time, the predictive model produces the same predicted real-time data at both ends. Meanwhile, deviation judgment of the predicted value and actual real-time data is carried out on the environment sensor nodes, and if the prediction is met, the communication behavior of the sensor nodes is restrained to reduce the data transmission quantity and reduce the overall energy consumption. If the prediction is not satisfied, the environmental sensor node is required to transmit data. Meanwhile, the method provides a corresponding data coding mode to compress data volume and a data packet message format suitable for a double prediction model.

Description

Variable-granularity real-time environment data acquisition method for Internet of things
The technical field is as follows:
the invention relates to a variable-granularity real-time environment data acquisition method for the Internet of things.
Background
The collection, processing and transmission of environmental data are one of the most important targets for the application of the internet of things, and limited hardware, network and computing resources are the main bottlenecks limiting the development of the internet of things: therefore, efficient and low-power-consumption environmental data collection becomes one of the most popular research directions in the field of internet of things, and the prediction model scheme is concerned about reducing the communication quantity between nodes to a certain extent.
Many error-based prediction model schemes now perform error estimation after performing complex mathematical prediction operations to obtain a value that satisfies the error. In fact, since the actual environmental data changes slightly and slowly, and the data changes within the error interval in a long time, performing the complicated mathematical prediction operation without deviating from the error interval consumes some unnecessary system resources. And many prediction model schemes do not encode data, actual data are directly transmitted, and communication bandwidth resources are wasted. Therefore, the scheme for acquiring the variable-granularity real-time environment data facing to the Internet of things is provided.
Disclosure of Invention
The invention designs an internet of things real-time data collection method, which is used for saving limited storage resources and operation resources of sensor nodes and reasonably utilizing limited communication capacity between the sensor nodes and sink nodes.
The hardware main body of the invention is a sensor node and a sink node, wherein the sensor node is responsible for collecting, processing and sending data, and the sink node is responsible for receiving and processing data and is a final data collection place. The deployment is detailed in fig. 1.
The prediction model scheme can effectively reduce the communication times between the sensor nodes and the sink nodes, so that the communication energy consumption between the nodes is reduced. The prediction model scheme is realized by running the same prediction algorithm on the sensor node and the sink node, meanwhile, the sensor node and the sink node have the same acquisition period, the sensor node collects and codes real environment data at a preset acquisition time, and then the real environment data is compared with prediction data generated by the prediction model, if the prediction is satisfied, the communication behavior is inhibited, and if the prediction is not satisfied, the coded data needs to be sent out. Meanwhile, the sink node at the other end updates the data pool by using the received data as data or by using the data generated by the prediction model as data, as shown in fig. 2 and 3. And at the preset acquisition time, the prediction algorithm is operated at the sensor node and the sink node to generate the same prediction result.
Real environmental data is often a collection of limited data spaces, in (U)min,Umax) Now, the data space set is divided into a plurality of intervals with the length of 2 δ, and δ is the error allowed by the prediction model. According to equation (1), n segments will be generated.
Figure BDA0002337322410000021
Now, a fixed-length coding mode is adopted, and each interval segment corresponds to a binary code with the length of L. The length L is obtained by equation (2).
L=log2n (2)
Now, assuming that there is a set of humidity environment data, the unit is%, the distribution range is 0.00% to 7.99%, and the error tolerance is 0.25%, after processing, the limited data space can be divided into a plurality of binary codes, as shown in fig. 4.
Here a simple monitoring mechanism is used to build a prediction model, as shown in fig. 5, which predicts the overall trend of the change by periodic change monitoring for each bit of the encoded data. For each bit, a bit space is created, in which a queue of n cycles of historical data is stored, and only the most recently occurring n cycles of historical data are stored, the queue being denoted by tn,tn-1,tn-2,…,t1]The historical data period refers to the time for which the data retention state is unchanged. The next variation period T of each bit is predicted according to equation (3), as shown in fig. 6.
Figure BDA0002337322410000031
At each acquisition moment, the prediction model judges whether each digit needs to change at the current sampling moment according to the latest change moment of each digit and the change period T obtained by averaging the latest n times of historical data periods, and the final overall prediction is generated through local prediction of each digit.
The data message is sent to the sink node by the sensor node. The message format adopts UTF-8 coding.
Start symbol Source of message Message sequence number Message body Check code Ending symbol
1 byte 2 bytes 1 byte N byte 2 bytes 1 byte
The start character: 0x23 (#);
the source of the message: sensor ID, the entire network can accommodate 256 × 256 sensor nodes.
Message sequence number: the sequence used for marking the message, for the same node message, the message counts from 0x00 to 0xFF according to the sending sequence, and counts again every 256 messages;
message body: all information in the message is contained;
checking: the check is performed from the start symbol to the end of the message body. CRC-16/IBM is adopted for checking;
an end symbol: 0x25 (%);
for example, the sink node receives a piece of information 0x23FF0403646C0925, the content of the message is start symbol 0x23, message source 0xFF04, message sequence 0x03, message body 0x64, check code 0x6C09, and end symbol 0x 25.
Advantageous effects
1. Based on the sensor binary number processing, floating point number conversion is not needed, the calculation is based on binary codes from beginning to end, the calculation is faster, and the cost is smaller;
2. the tolerance of the user to the error is put to the beginning instead of the end, so that the data volume is reduced at the beginning, and all subsequent calculations are convenient;
3. and the coded data is predicted and transmitted, so that the energy consumption is reduced.
Drawings
FIG. 1 is a schematic diagram of a device deployment;
FIG. 2 is a flow chart of sink node work;
FIG. 3 is a sensor node workflow diagram;
FIG. 4 is a schematic view of a process of converting data collected by a sensor into corresponding encoded data;
FIG. 5 is a schematic diagram of a monitoring mechanism;
FIG. 6 is a state update flow chart;
Detailed Description
How this model works is described below with specific cases: at a predetermined acquisition time, the sensor node converts the collected environmental data into its corresponding code, which is then compared with the predictive data generated by the contemporaneous predictive model. If the data is the same, the send operation is suppressed and instead the data needs to be sent and then the queue holding the historical data period is updated. Meanwhile, at the other end, the sink node needs to judge whether the sink node collects data at a preset time, if the sink node receives the data, the received data is used as a real-time data record, if the sink node does not receive the data, a data is generated according to a self prediction model and used as a real-time data record, and the data is the same as the data generated by a prediction model operated at the sensor end, and a queue storing a historical data period is updated. Finally, the encoded data is stored in the data pool, so that the encoded data needs to be restored into a data interval according to a preset encoding rule when the data pool is used at last.
Suppose that data encoded as 0011 is collected in real time at the sensor node side, and the prediction model also generates data encoded as 0011. At this time, the sensor node considers that the prediction is successful and suppresses the data uploading behavior. Since the sensor node prediction model and the sink node prediction model are the same, at the sink node, the prediction model generates the same data 0011. After the preset collection period is finished, the sink node does not receive any data, the data 0011 generated by the model is considered to be correct, and the data 0011 is stored in the data pool. After the preset acquisition period is finished, the sensor nodes and the sink nodes update the prediction model according to the data 0011.
Suppose that 0100 encoded data is collected at the sensor node end in real time, and 0011 encoded data is generated by the prediction model. At this time, the sensor node regards the prediction as failed and uploads the data. At the sink node at the other end, the predictive model produces prediction data 0011. In a preset acquisition period, as the sink node receives the data 0100, the sink node considers that the prediction fails, discards the predicted data 0011, and stores the data 0100 in the data pool. After the predetermined acquisition period is finished, the sensor nodes and the sink nodes update the prediction model according to the data 0100.
0-1 state machine:
after the acquisition period is finished, it is assumed that the prediction model is updated by 0100 data, and the specific process is as follows: the 0100 data is sequentially decomposed into four bit state values of 0, 1, 0 and 0, and then the related information value of each bit state is updated. Taking a first bit state value 0 as an example, the state value 0 is input into a first bit space corresponding to a model, a cycle queue [2, 2,3,4] of which the latest n is 4 state changes, a state identifier (0 or 1) of the bit, namely the previous data state and the time point of the latest state change, are stored in the first bit space of the model, the first 2 in [2, 2,3,4] is the latest encoded data change cycle, and the last 4 is the farthest data change cycle. If in this update it is found that the input value 0 is different from the current bit identifier, i.e. the current bit identifier is 1, then the update cycle queue is required to be [1,2,2,3], update the current bit identifier to 0, update the latest state change time point. If the current bit identifier is found to be 0, i.e., the state has not changed, then the current bit identifier and the most recent state change time point are not changed, and only the periodic alignment is changed to [3,2,3,4 ].
Assuming that a prediction model is needed to generate data, for each bit, the prediction model takes the average value of the change period queue as the change period of the prediction model, further estimates whether the prediction model changes at the current time point, outputs the prediction state of each bit, and generates the final overall prediction by locally predicting each bit.

Claims (3)

1. A variable granularity real-time environment data acquisition method facing to the Internet of things is characterized in that a hardware main body comprises sensor nodes and sink nodes, the sensor nodes are responsible for acquiring, processing and sending data, the sink nodes are responsible for receiving and processing the data and are final sink places of the data, and the method is characterized by comprising the following steps: the same prediction model is deployed at the sensor node and the sink node, and the communication traffic of data at two ends is reduced through the behavior of prediction data; the sensor nodes and the sink nodes have the same acquisition period, the sensor nodes acquire and encode environmental data at a preset acquisition time, and a prediction model on the sensor nodes also generates real-time prediction data; the sensor node compares the predicted data with the actually acquired data, and if the predicted data is the same as the actually acquired data, the communication behavior is inhibited; if the data are different, the actually acquired data need to be sent out; meanwhile, at the sink node at the other end, at a preset acquisition time, the prediction model deployed on the sink node also generates real-time prediction data, after the acquisition time is over, if the sink node receives the data, the data is taken as the real-time data, if the sink node does not receive the data, the prediction data is considered to meet the prediction, and the prediction data is taken as the real-time data.
2. The acquisition method according to claim 1, characterized in that: the coding process of the coded data generated by the sensor nodes is as follows:
the real environment data is a collection of finite data spaces, in (U)min,Umax) In the meantime, the data space set is divided into a plurality of intervals with the length of 2 delta, delta is the error allowed by the prediction model, n interval segments are generated according to the formula (1),
Figure FDA0002337322400000011
at present, a fixed-length coding mode is adopted, each interval segment corresponds to a binary code with the length L, the length L is obtained by a formula (2),
L=log2n (2) 。
3. the acquisition method according to claim 1, wherein the prediction model is used for predicting the encoded data, and the prediction model uses a monitoring mechanism to generate a binary code having the same length as the encoded data, specifically, the change trend of the whole binary code is predicted by monitoring the periodic change of each bit of the binary code; wherein, for each bit, a queue [ t ] is established for storing the history data change periodn,tn-1,tn-2,…,t1]Recording the latest change time of the corresponding bit data, and storing the state identifier of the corresponding bit; then, taking the average value of the recently generated n times of historical data periods as the next change period T of each digit; when the prediction data needs to be generated, the prediction moduleJudging whether each bit needs to be changed at the moment, and generating a final overall prediction by locally predicting each bit, wherein the condition of the change of the ith bit data is as follows:
current predicted time tkThe average value of the last change time of the ith data and the latest n times of historical data cycles of the ith data.
CN201911371100.4A 2019-12-26 2019-12-26 Variable-granularity real-time environment data acquisition method for Internet of things Pending CN111031511A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911371100.4A CN111031511A (en) 2019-12-26 2019-12-26 Variable-granularity real-time environment data acquisition method for Internet of things

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911371100.4A CN111031511A (en) 2019-12-26 2019-12-26 Variable-granularity real-time environment data acquisition method for Internet of things

Publications (1)

Publication Number Publication Date
CN111031511A true CN111031511A (en) 2020-04-17

Family

ID=70214872

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911371100.4A Pending CN111031511A (en) 2019-12-26 2019-12-26 Variable-granularity real-time environment data acquisition method for Internet of things

Country Status (1)

Country Link
CN (1) CN111031511A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112163668A (en) * 2020-09-29 2021-01-01 上海交通大学 Method for reducing time series data transmission based on prediction and cloud edge cooperation
CN112597177A (en) * 2020-12-30 2021-04-02 中冶南方工程技术有限公司 Blast furnace real-time data updating method and device based on point location marks

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595496A (en) * 2012-03-08 2012-07-18 西北大学 Context-adaptive quotient and remainder encoding method used for sensing data of wireless sensing nodes
CN103345227A (en) * 2013-07-02 2013-10-09 东南大学 Micro grid monitoring and energy management device and method
CN103354652A (en) * 2013-06-14 2013-10-16 中国农业大学 Method and apparatus for lightweight data fusion in WBAN (wireless body area network)
CN104507096A (en) * 2014-12-10 2015-04-08 中国科学院计算技术研究所 Model-driven data transmission method and system in wireless sensor network
US9235804B1 (en) * 2013-03-12 2016-01-12 Google Inc. System and method for selecting and serving content items based on sensor data from mobile devices

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595496A (en) * 2012-03-08 2012-07-18 西北大学 Context-adaptive quotient and remainder encoding method used for sensing data of wireless sensing nodes
US9235804B1 (en) * 2013-03-12 2016-01-12 Google Inc. System and method for selecting and serving content items based on sensor data from mobile devices
CN103354652A (en) * 2013-06-14 2013-10-16 中国农业大学 Method and apparatus for lightweight data fusion in WBAN (wireless body area network)
CN103345227A (en) * 2013-07-02 2013-10-09 东南大学 Micro grid monitoring and energy management device and method
CN104507096A (en) * 2014-12-10 2015-04-08 中国科学院计算技术研究所 Model-driven data transmission method and system in wireless sensor network

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112163668A (en) * 2020-09-29 2021-01-01 上海交通大学 Method for reducing time series data transmission based on prediction and cloud edge cooperation
CN112163668B (en) * 2020-09-29 2023-05-05 上海交通大学 Method for reducing time series data transmission quantity based on prediction and cloud edge cooperation
CN112597177A (en) * 2020-12-30 2021-04-02 中冶南方工程技术有限公司 Blast furnace real-time data updating method and device based on point location marks
CN112597177B (en) * 2020-12-30 2022-06-24 中冶南方工程技术有限公司 Blast furnace real-time data updating method and device based on point location marks

Similar Documents

Publication Publication Date Title
Kountouris et al. Semantics-empowered communication for networked intelligent systems
Tayeh et al. A distributed real-time data prediction and adaptive sensing approach for wireless sensor networks
Al-Qurabat et al. Two tier data reduction technique for reducing data transmission in IoT sensors
Tayeh et al. A spatial-temporal correlation approach for data reduction in cluster-based sensor networks
CN111031511A (en) Variable-granularity real-time environment data acquisition method for Internet of things
Abdulzahra MSc et al. Energy conservation approach of wireless sensor networks for IoT applications
US10484286B2 (en) Adaptive reliability protocol
Al-Qurabat et al. A Bi-level data lowering method to minimize transferring big data in the sensors of IoT applications
Luo et al. A novel adaptive gradient compression scheme: Reducing the communication overhead for distributed deep learning in the Internet of Things
CN111629232A (en) Real-time video transmission self-adaptive forward error correction method and system based on deep learning
Al-Qurabat et al. Dictionary-based dpcm method for compressing iot big data
CN113556253A (en) Method, system, device and storage medium for predicting real-time flow of switch port
Ye et al. LT codes based distributed coding for efficient distributed storage in wireless sensor networks
CN112994965B (en) Network anomaly detection method and device and server
Enam et al. An adaptive data aggregation technique for dynamic cluster based wireless sensor networks
Vidhyapriya et al. Energy efficient data compression in wireless sensor networks.
CN110856144B (en) LT code-based atomization caching method in mobile edge computing network
CN111182488A (en) Traceability data energy-saving transmission method based on time channel
CN103427951B (en) With the data forwarding method that coding redundancy controls
Hong et al. On the throughput, delay, and energy efficiency of distributed source coding in random access sensor networks
Liu et al. Energy-efficient scheduling of distributed estimation with convolutional coding and rate-compatible punctured convolutional coding
Lu et al. Backup path with energy prediction based on energy-aware spanning tree in wireless sensor networks
Chen et al. Research on data compression algorithm based on prediction coding for wireless sensor network nodes
CN106302573B (en) Method, system and device for processing data by adopting erasure code
Chang et al. Bounded error data compression and aggregation in wireless sensor networks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200417