CN117858038A - Data uploading method, device and system based on NB-IoT - Google Patents
Data uploading method, device and system based on NB-IoT Download PDFInfo
- Publication number
- CN117858038A CN117858038A CN202311747866.4A CN202311747866A CN117858038A CN 117858038 A CN117858038 A CN 117858038A CN 202311747866 A CN202311747866 A CN 202311747866A CN 117858038 A CN117858038 A CN 117858038A
- Authority
- CN
- China
- Prior art keywords
- data
- iot
- uploading
- iot based
- converted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 33
- 238000007781 pre-processing Methods 0.000 claims abstract description 20
- 239000011159 matrix material Substances 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 15
- 238000013178 mathematical model Methods 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 8
- 238000013144 data compression Methods 0.000 claims description 8
- 238000013467 fragmentation Methods 0.000 claims 1
- 238000006062 fragmentation reaction Methods 0.000 claims 1
- 238000004891 communication Methods 0.000 abstract description 6
- 230000002035 prolonged effect Effects 0.000 abstract description 3
- 230000005540 biological transmission Effects 0.000 description 25
- 238000000354 decomposition reaction Methods 0.000 description 12
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 238000005265 energy consumption Methods 0.000 description 3
- 239000012634 fragment Substances 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 206010033799 Paralysis Diseases 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000013496 data integrity verification Methods 0.000 description 1
- 238000013524 data verification Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012067 mathematical method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Abstract
The invention belongs to the technical field of communication of the Internet of things, and particularly relates to a data uploading method, device and system based on NB-IoT. By preprocessing and converting the original data, the size and the number of the original data are reduced, so that the data are convenient to transmit, the data uploading efficiency is effectively improved, and the service life of the battery of the Internet of things equipment is effectively prolonged.
Description
Technical Field
The invention belongs to the technical field of communication of the Internet of things, and particularly relates to a data uploading method, device and system based on NB-IoT.
Background
Along with the development of science and technology, the meter reading does not need staff to go to the to-be-read expression sites of residents or units to read, but the data information of the intelligent meter is acquired through a concentrator or a server.
The NB-IoT fully-called narrowband Internet of things (narrow band internet of things) is one of low-power-consumption wide area networks (lpwans), and is mainly applied to connection of large-scale low-data-volume Internet of things. Compared with lte and emtc, the NB-IoT has very narrow bandwidth, so that the number of the terminal reporting in parallel is limited, and the terminal centralized access can lead to the improvement of network noise and the reduction of access indexes; if the terminal does not make peak staggering optimization, the terminal equipment is difficult to access, the network is congested, and the data reporting fails.
The existing NB-IoT internet of things water meter is usually powered by a battery and needs to satisfy a service life of 6 years, so that a period of reporting NB-IoT internet of things water meter data is usually reported once a day or once a few days. If the quantity of the water meters of the Internet of things is huge, the water meters are reported in the same time period, the concurrency problem can be caused, the reported data is lost, and the system paralysis can be seriously caused.
Disclosure of Invention
The invention provides a data uploading method, equipment and a system based on NB-IoT, which reduce the size and the number of original data by preprocessing and converting the original data, so that the data is convenient to transmit, and the data uploading efficiency is effectively improved.
In order to achieve the above purpose, the invention adopts the following technical scheme:
in a first aspect, the present invention provides a NB-IoT based data uploading method, comprising the steps of:
preprocessing the original data to be uploaded, and converting the preprocessed data to obtain converted data;
uploading the converted data to a network server using the NB-IoT protocol;
the network server restores the received converted data to the original data.
The preprocessing of the original data to be uploaded comprises data compression processing and data slicing processing.
Preferably, the preprocessed data is transformed using a discrete mathematical model.
Preferably, the type of the discrete mathematical model is configured according to the characteristics of the data and the purpose of the data.
Preferably, the discrete mathematical model is a hash function model or a matrix decomposition model.
As a preferred approach, the type of NB-IoT protocol is configured according to the nature of the data and the purpose of the data.
Preferably, when converting data and restoring data, the data are encrypted and protected.
In a second aspect, the present invention provides an NB-IoT based data uploading apparatus, configured to periodically upload data to implement the above-described NB-IoT based data uploading method, including a data preprocessing module, a data conversion module, and a data uploading module that are connected in sequence;
the data preprocessing module is used for preprocessing the data to be uploaded;
the data conversion module is used for converting the preprocessed data;
the data uploading module is used for uploading the converted data to the network server.
In a third aspect, the present invention provides an NB-IoT based data uploading system, including the above-mentioned plurality of NB-IoT based data uploading devices and a network server connected to the plurality of NB-IoT based data uploading devices, so as to implement the above-mentioned NB-IoT based data uploading method.
The beneficial effects of the invention are as follows:
1. the original data is preprocessed, the original data is converted into a smaller form which is easier to process and transmit, and the size and the number of the original data can be reduced, so that the uploading time is shortened, and the data uploading efficiency is improved; the data after pretreatment is converted by using a discrete mathematical model, so that the data can be converted into a form suitable for efficient transmission, and the efficiency and reliability of data uploading can be improved.
2. The data after pretreatment is converted by using a discrete mathematical model, and then the converted data is uploaded, so that the accuracy and reliability of data recovery in the data recovery process can be effectively improved.
3. After preprocessing and data conversion, the size and the number of the data are reduced, the uploading time is reduced, and the energy consumption of the equipment is correspondingly reduced, so that the service life of the battery of the equipment of the Internet of things can be prolonged. Meanwhile, the data uploading method based on the NB-IoT can be compatible with the existing NB-IoT device, and is convenient for upgrading and replacing the internet of things device.
4. The discrete mathematical model and the NB-IoT protocol can be adjusted and optimized according to the actual conditions of data characteristics, data purposes and the like, and the method has good expandability and can adapt to different application scenes and requirements.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a NB-IoT based data upload method.
Fig. 2 is a schematic diagram of an NB-IoT based data uploading device.
Fig. 3 is a schematic diagram of a NB-IoT based data upload system.
Detailed Description
The following specific examples are presented to illustrate the present invention, and those skilled in the art will readily appreciate the additional advantages and capabilities of the present invention as disclosed herein. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict.
NB-IoT is a narrowband Internet of things technology, which is a low-power, wide-coverage wireless communication technology designed specifically for Internet of things applications. NB-IoT technology can enable interworking between devices, can support large-scale device connections, and has lower power consumption and cost. The technology has wide application in the field of Internet of things, including the fields of smart home, smart city, industrial automation and the like.
But NB-IoT is relatively low in data transmission rate compared to other communication technologies and is not suitable for applications requiring large amounts of data transmission; due to the low power consumption and narrowband nature, NB-IoT data transmission delays are relatively high, and are not suitable for applications with high real-time requirements, and may have some stability and compatibility issues.
Currently, smart meter products for many cells are NB-IoT devices that require periodic uploading of data to a server. If the number of NB-IoT devices connected to the server is huge, and the plurality of NB-IoT devices upload data to the server in the same period, the problems of device communication failure, data loss, processing delay of the server and the like may be caused, and even the whole system is paralyzed, a new data uploading mode is needed to improve the efficiency of data uploading.
Referring to fig. 1, a NB-IoT based data upload method includes the steps of:
preprocessing the original data to be uploaded, and converting the preprocessed data to obtain converted data;
uploading the converted data to a network server using the NB-IoT protocol;
the network server restores the received converted data to the original data.
By preprocessing and converting the original data, the size and the number of the original data are reduced, so that the data are convenient to transmit, and the data uploading efficiency is effectively improved.
Further, preprocessing the original data to be uploaded comprises data compression processing and data slicing processing.
Data compression processing and data slicing processing are common techniques in data processing. Specific:
data compression processing: and selecting a proper compression algorithm according to the data characteristics and the data application, and processing the data to be uploaded.
Data slicing processing: the data slicing rule can be slicing according to fixed size, slicing according to specific identifier, or slicing according to time period according to data characteristics and data use determining rules; according to the determined rule, the data is fragmented to generate a plurality of data fragments, and different data fragments are usually identified by using numbers or other modes; the data fragments can be reassembled into complete data as needed.
When data compression and data slicing are carried out, the completeness and accuracy of the data are required to be paid attention to, so that the data loss is avoided, and errors occur.
Further, the preprocessed data is converted by using a discrete mathematical model, and the type of the discrete mathematical model is configured according to the characteristics of the data and the purpose of the data.
Specific: the discrete mathematical model is a hash function model or a matrix decomposition model.
The hash function is a function that maps data of arbitrary length to a fixed-length hash value. The hash function is characterized as follows:
1. data compression: the hash function can compress a large amount of data into a hash value with a fixed length, so that the data size can be reduced in the data transmission process, and the data transmission efficiency can be improved.
2. Fixed length output: regardless of the length of the input data, the hash function produces a fixed length output, which helps reduce the amount of data transferred.
3. Uniqueness: an excellent hash function should minimize the probability that different inputs map to the same hash value to ensure the uniqueness of the data.
The hash function is often used in the fields of data encryption, data verification, data integrity verification and the like, and for data uploading of the internet of things equipment, the data can be compressed into a hash value with a fixed length through the hash function, so that the size of data transmission is reduced, and the data transmission efficiency is improved.
The following is one example of NB-IoT data reporting using a hash function:
assume that one NB-IoT device needs to report sensor data to the cloud server. The device stores the acquired sensor data in a data structure, such as a dictionary or array.
The device uses a hash function (e.g., SHA-256) to convert the sensor data to a unique hash value. This hash value may serve as a unique identifier for the data and may be used to verify the integrity and authenticity of the data.
The device sends the hash value and the sensor data to the cloud server. During transmission, if data is tampered with or damaged, the receiving side can detect an error by calculating a hash value of the received data.
After the cloud server receives the hash value and the sensor data, the same hash function is used for calculating the hash value of the data. The received hash value is then compared to the calculated hash value to verify the integrity and authenticity of the data.
Matrix factorization is a mathematical method of factoring data represented by a matrix. The matrix decomposition is characterized as follows:
1. data dimension reduction: the matrix decomposition can represent the data in a more compact form, reduce the dimension and complexity of the data and reduce the transmission quantity in the data transmission process.
2. Feature extraction: through matrix decomposition, important features in the data can be extracted, and redundant information can be reduced in the transmission and storage processes.
Matrix decomposition is commonly used in the fields of data dimension reduction, feature extraction, data compression and the like, and for data uploading of Internet of things equipment, original data can be converted into a more compact and efficient representation form through matrix decomposition, so that the efficiency of data transmission is improved, and the energy consumption of the equipment is reduced.
The following is one example of NB-IoT data reporting using matrix factorization:
assume that one NB-IoT device needs to report sensor data to the cloud server. The device stores the acquired sensor data in a matrix, such as a two-dimensional array.
The device uses a matrix decomposition algorithm (e.g., singular value decomposition) to matrix decompose the sensor data into products of multiple matrices. This decomposition process can extract important features in the sensor data and reduce the dimensionality of the data, thereby reducing the complexity and storage requirements of the data.
The device sends the decomposed matrix and the original sensor data to the cloud server. In the transmission process, the data dimension after matrix decomposition is reduced, so that the data quantity of transmission can be reduced, and the transmission efficiency is improved.
And after the cloud server receives the decomposed matrix and the original sensor data, decomposing the received data matrix by using the same matrix decomposition algorithm. The received decomposed matrix is then compared with the decomposed matrix transmitted by the device to verify the integrity and authenticity of the data.
If the two matrices match, then the data is complete and authentic, and the cloud server can further process and analyze the data. Otherwise, if the two matrices do not match, indicating that the data has been tampered with or corrupted, the cloud server may reject the data and notify the device to resend.
Further, the type of NB-IoT protocol is configured according to the nature of the data and the purpose of the data.
The NB-IoT protocol is specially designed for the Internet of things device, has lower power consumption and better coverage range, and can realize wide-coverage and low-power consumption data uploading.
The selection of the NB-IoT protocol type also considers the rate of data transmission, the cost of data transmission, the range of data transmission and the power consumption of the NB-IoT device for transmitting data, and the specific application scenario is needed, so that the efficiency and the accuracy of data transmission are improved.
The protocols mainly adopted by the NBIOT device uploading include CoAP protocol and MQTT protocol.
The CoAP protocol is a lightweight M2M communication protocol, and is designed specifically for internet of things devices. The method has the characteristics of small size, low power consumption, easy realization and the like, and is suitable for small-sized equipment and low-power consumption network environments. The CoAP protocol is based on the UDP protocol, can realize rapid data transmission and response, and is suitable for scenes with high real-time requirements.
The MQTT protocol is a message transmission protocol based on a publish/subscribe mode and is widely applied to the field of the Internet of things. The system supports various platforms and devices, and can realize efficient and reliable data transmission and sharing. The MQTT protocol has flexibility and expandability and can be customized and optimized according to different requirements.
Further, when converting data and restoring data, the data are encrypted and protected.
The encryption and decryption mode adopts AES encryption, and the AES encryption uses the same key for encryption and decryption, so that the encryption and decryption speeds are very high. The AES encryption algorithm supports a variety of key lengths including 128 bits, 192 bits, and 256 bits, with 256 bits being the highest security level. The AES encryption algorithm adopts a Substitution-replacement network (sub-Permutation Network) structure, and data are mixed and spread through multiple rounds of nonlinear transformation and linear transformation, so that the safety of the data is ensured.
The advantages of AES encryption include:
1. the encryption speed is high: because of the symmetrical encryption algorithm, the speed of encryption and decryption is very fast, and the method is suitable for encrypting a large amount of data.
2. The safety is high: the AES encryption algorithm adopts a high-strength encryption algorithm and a key length, can resist various known attack modes, and ensures the safety of data.
3. The flexibility is good: the AES encryption algorithm supports multiple key lengths and encryption modes, and can be flexibly configured and used according to different requirements.
The encryption and protection processing are carried out on some sensitive information, so that the sensitive data can be prevented from being acquired by unauthorized personnel in the transmission and storage processes, and the privacy of a user is protected. The encryption and protection processes can effectively reduce the risks of data theft, tampering and damage, effectively reduce the risks of data leakage, and ensure the safety of the data in the transmission and storage processes.
Referring to fig. 2, an NB-IoT based data uploading apparatus for periodically uploading data to implement an NB-IoT based data uploading method as described above includes a data preprocessing module, a data conversion module, and a data uploading module connected in sequence;
the data preprocessing module is used for preprocessing the data to be uploaded;
the data conversion module is used for converting the preprocessed data;
the data uploading module is used for uploading the converted data to the network server.
After preprocessing and data conversion, the size and the number of the data are reduced, the uploading time is reduced, and the energy consumption of the equipment is correspondingly reduced, so that the service life of the battery of the equipment of the Internet of things can be prolonged. Meanwhile, the data uploading method based on the NB-IoT can be compatible with the existing NB-IoT device, and is convenient for upgrading and replacing the internet of things device.
Referring to fig. 3, an NB-IoT based data uploading system includes the above-mentioned plurality of NB-IoT based data uploading devices and a network server connected to the plurality of NB-IoT based data uploading devices, so as to implement the above-mentioned NB-IoT based data uploading method.
After the data uploaded by each device is processed, the size and the number of the data are reduced, so that the network server can more efficiently acquire the data of each device and perform subsequent analysis and processing on the data.
The above examples are merely illustrative of the preferred embodiments of the present invention and are not intended to limit the scope of the present invention, and various modifications and improvements made by those skilled in the art to the technical solution of the present invention should fall within the protection scope of the present invention without departing from the design spirit of the present invention.
Claims (9)
1. A NB-IoT based data upload method, comprising the steps of:
preprocessing the original data to be uploaded, and converting the preprocessed data to obtain converted data;
uploading the converted data to a network server using the NB-IoT protocol;
the network server restores the received converted data to the original data.
2. The NB-IoT based data uploading method of claim 1, wherein preprocessing the raw data to be uploaded comprises data compression processing and data fragmentation processing.
3. The NB-IoT based data uploading method of claim 1, wherein the pre-processed data is converted using a discrete mathematical model.
4. A method of NB-IoT based data uploading in accordance with claim 3, wherein the type of discrete mathematical model is configured according to the nature of the data and the purpose of the data.
5. The NB-IoT device of claim 4, wherein the discrete mathematical model is a hash function model or a matrix factorization model.
6. The NB-IoT based data uploading method according to claim 1, wherein the type of NB-IoT protocol is configured according to characteristics of the data and usage of the data.
7. The NB-IoT device data uploading method of claim 1, wherein the data is encrypted and protected when the data is converted and restored.
8. A NB-IoT based data uploading device configured to periodically upload data to implement a NB-IoT based data uploading method according to any of claims 1-7, comprising a data preprocessing module, a data conversion module, and a data uploading module connected in sequence;
the data preprocessing module is used for preprocessing the data to be uploaded;
the data conversion module is used for converting the preprocessed data;
the data uploading module is used for uploading the converted data to the network server.
9. An NB-IoT based data upload system comprising a plurality of NB-IoT based data upload devices of claim 8 and a network server connected to the plurality of NB-IoT based data upload devices to implement an NB-IoT based data upload method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311747866.4A CN117858038A (en) | 2023-12-19 | 2023-12-19 | Data uploading method, device and system based on NB-IoT |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311747866.4A CN117858038A (en) | 2023-12-19 | 2023-12-19 | Data uploading method, device and system based on NB-IoT |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117858038A true CN117858038A (en) | 2024-04-09 |
Family
ID=90539145
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311747866.4A Pending CN117858038A (en) | 2023-12-19 | 2023-12-19 | Data uploading method, device and system based on NB-IoT |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117858038A (en) |
-
2023
- 2023-12-19 CN CN202311747866.4A patent/CN117858038A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102571966B (en) | Network transmission method for large extensible markup language (XML) document | |
| CN100586109C (en) | Communication method and system for universal service data based on self-defined template | |
| CN113660092B (en) | Power data uploading system and method based on zero knowledge proof | |
| CN110830251B (en) | Method for safely transmitting electricity consumption information in ubiquitous power Internet of things environment | |
| CN103473913B (en) | Wireless data transmission method used for intelligent oil production system | |
| CN105072636A (en) | Wireless testing and data transmission system | |
| CN102857514B (en) | HTTP (hyper text transport protocol) based secret information hidden-transmission method | |
| Sarkar et al. | Development of lossless compression algorithms for power system operational data | |
| Tang et al. | Information security terminal architecture of power transportation mobile internet of things based on big data analysis | |
| CN114205375A (en) | Electric power data acquisition system based on edge internet of things agent equipment | |
| EP2381579A1 (en) | Method for compressing/decompressing data | |
| CN117858038A (en) | Data uploading method, device and system based on NB-IoT | |
| CN102523580A (en) | M2M (Machine-to-Machine/Man) service terminal data processing method and M2M service card as well as M2M terminal data processing card | |
| Sarkar et al. | Development of a quasi‐real‐time distribution voltage monitoring system | |
| CN114501432A (en) | Electric power data security encryption module based on LoRa wireless communication technology | |
| CN103763384A (en) | Water and sand remote monitoring system and method based on double-link communication | |
| Miao et al. | Research on Data Transmission and Processing Technology of Intelligent Agricultural Robot based on Internet of Things | |
| Zhong et al. | Discussion and application of blockchain technology in information management of internet of things in smart lab | |
| CN116506514B (en) | Data compression method, device, equipment, server and sewage cloud control system | |
| CN117478605B (en) | Load balancing method, concentrator, ammeter and storage medium | |
| CN110545282A (en) | Data acquisition and analysis system based on wireless body area network and low-energy-consumption data fusion privacy protection algorithm | |
| CN113352318B (en) | Intelligent robot communication link self-checking selection method | |
| CN108520474A (en) | A kind of power analysis system and power analysis method | |
| Sun et al. | An Efficient Recoverable Concealed Data Aggregation Scheme for Direct Load Control | |
| Sisodia et al. | Review of Computer Engineering Research |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |