CN108965483A - The data of Internet of things system large number of equipment store and the network system realization of push - Google Patents
The data of Internet of things system large number of equipment store and the network system realization of push Download PDFInfo
- Publication number
- CN108965483A CN108965483A CN201811143300.XA CN201811143300A CN108965483A CN 108965483 A CN108965483 A CN 108965483A CN 201811143300 A CN201811143300 A CN 201811143300A CN 108965483 A CN108965483 A CN 108965483A
- Authority
- CN
- China
- Prior art keywords
- push
- data
- equipment
- topic
- url
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013507 mapping Methods 0.000 claims abstract description 4
- 230000004044 response Effects 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 7
- 241001269238 Data Species 0.000 claims description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/55—Push-based network services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses the network system realizations of the storage of the data of Internet of things system large number of equipment and push, include the following steps: step 1: each equipment is divided to the group belonging to it respectively；Step 2: according to the source of the data acquired from equipment, device-topic table is inquired, group topic belonging to data is obtained, then correspondence is inserted into push-data table；Step 3: establishing the mapping relations of topic and url, and inserts it into okhttp-push table；Step 4: going to inquire in push-data table with the value of the topic and mid of a line every in okhttp-push table, then the data which is not properly received by the user of the corresponding address url further below are sent with okhttp sequence；Step 5: by the response data of okhttp, judging whether user has successfully received PUSH message, if having successfully received, updates in okhttp-push table, this topic and the corresponding mid of url.The present invention is realized to the mass data acquired from arbitrary equipments such as various kinds of equipment, such as gateway, terminal node, and database is arrived in storage, and is pushed to each user.
Description
Technical field
The present invention relates to data storage and push technology fields.It is more particularly related to which Internet of things system is a large amount of
The data of equipment store and the network system realization of push.
Background technique
In Internet of things system, there are a large amount of various kinds of equipment, the mass data converged from various kinds of equipment needs to store to database
In, also to classify and be pushed to each user.Traditional implementation method is the every data converged from equipment, is wanted with this data
The url address binding of push, is then inserted into database.When same data will be pushed to several different addresses url,
Need to be inserted into the identical record of several message contents, i.e. the summary journal item number etc. of database into propelling data table push-data
In message number multiplied by url number of addresses, meanwhile, the data-pushing in push-data table will be stored in another process
When to each address url, the field that whether data is successfully transmitted in this table needed to update.Exist to push-data table
It is largely concurrently inserted into and modifies operation, with increasing for device data, database will more become the bottleneck of system performance.
Summary of the invention
It is an object of the present invention to provide the system realization sides of the storage of the data of Internet of things system large number of equipment and push
Method, to the mass data acquired from arbitrary equipments such as various kinds of equipment (including but not limited to), such as gateway, terminal node,
Database is stored, and is pushed to each user.
In order to realize these purposes and other advantages according to the present invention, the data of Internet of things system large number of equipment are provided
The network system realization of storage and push, includes the following steps:
Step 1: building database table structure, including device-topic table, push-data table, okhttp-push table,
Company's url address table；
Step 2: the different recipients that will be sent to according to device data respectively divide each equipment belonging to it
Group topic, is inserted into device-topic relation table for the corresponding relationship of equipment and its affiliated group；
Step 3: the data acquired from equipment pass through device- according to the equipment dev-eui in this data source
Topic table determines the topic parameter of this data, and then correspondence is inserted into push-data table；
Step 4: establishing the mapping relations of topic and url, and inserts it into okhttp-push table, for determining
The address url that data below same topic are sent to；
Step 5: recording each in okhttp-push table, respectively each thread: using okhttp-push
The value of topic and mid goes to inquire in push-data table in table, and the topic is not further below by the user of the corresponding address url
The device data of successful reception, and these device datas are sent according to the size of major key id with okhttp sequence；
Step 6: by the response data of okhttp, judging whether user has successfully received PUSH message, if receiving, more
The corresponding vernier mid of this topic and url in new okhttp-push table；If not receiving, okhttp-push table, line are not updated
Cheng Chongfu reads not sent device data and is retransmitted.
Preferably, the device-topic table includes parameter: the non-traffic major key id of equipment list, equipment unique number
Group topic belonging to location dev-eui, equipment.
Preferably, the push-data propelling data table includes parameter: the non-traffic major key id of equipment list, facility information
Creation time create-time, equipment unique number address app-eui, group topic, equipment belonging to equipment gateway
gateways。
Preferably, the okhttp-push push allocation list includes parameter: the non-traffic major key id of equipment list, equipment institute
The position vernier mid that the group topic of category, id, that is, url-id of the url of message push, message are had successfully received.
Preferably, the company url address table includes parameter: the non-traffic major key id of company table, Business Name
Name, company the address url url.
Preferably, the step 4 specifically: give each user with http method of synchronization pushing equipment data, pass through
Sql sentence configures the corresponding relationship of corresponding push address url in topic and company's url address table.
The present invention is include at least the following beneficial effects:
1. realizing propelling data push-data table and data-pushing url address configuration table okhttp-push-config's
Separation, to can be reduced the data volume in push-data table；
2. realize that the update for sending state to the insertion operation and data of the device data of same database table operates, point
Solution is the insertion and update operation respectively to two database tables, so that concurrent write of the reduction to push-data table, is promoted
System performance；
3. the address url that the data under grouping topic and topic belonging to equipment are sent flexibly can configure；
4. supporting the local persistence from devices collect data, convenient for doing the analysis statistics of data, current mainstream can be based on
Relational database.
Further advantage, target and feature of the invention will be partially reflected by the following instructions, and part will also be by this
The research and practice of invention and be understood by the person skilled in the art.
Specific embodiment
The present invention is described in further detail below, to enable those skilled in the art's refer to the instruction text being capable of evidence
To implement.
The present invention provides the network system realization of data storage and the push of a kind of Internet of things system large number of equipment, including such as
Lower step:
Step 1: building database table structure, including device-topic table, push-data table, okhttp-push table,
Company's url address table；
Step 2: the different recipients that will be sent to according to device data respectively divide each equipment belonging to it
Group topic, is inserted into device-topic relation table for the corresponding relationship of equipment and its affiliated group；
Step 3: the data acquired from equipment pass through device- according to the equipment dev-eui in this data source
Topic table determines the topic parameter of this data, and then correspondence is inserted into push-data table；
Step 4: establishing the mapping relations of topic and url, and inserts it into okhttp-push table, for determining
The address url that data below same topic are sent to；Specifically: each use is given with http method of synchronization pushing equipment data
Family configures the corresponding relationship of corresponding push address url in topic and company's url address table, sql sentence by sql sentence are as follows:
" insert into okhttp-push (topic, url-id) values (' value of topic ', ' id ' of url) "；
Step 5: recording each in okhttp-push table, respectively each thread: using okhttp-push
The value of topic and mid goes to inquire in push-data table in table, and the topic is not further below by the user of the corresponding address url
The device data of successful reception, and these device datas are sent according to the size of major key id with okhttp sequence；
Step 6: by the response data of okhttp, judging whether user has successfully received PUSH message, if receiving, more
The corresponding vernier mid of this topic and url in new okhttp-push table；If not receiving, okhttp-push table, line are not updated
Cheng Chongfu reads not sent device data and is retransmitted.
In another technical solution, the device-topic table includes parameter: the non-traffic major key id of equipment list, equipment
Group topic belonging to unique number address dev-eui, equipment.
Device-topic relation table, storage be equipment grouping information, the field being related to following table structure explanation:
In another technical solution, the push-data propelling data table includes parameter: the non-traffic major key of equipment list
Id, it the creation time create-time of facility information, equipment unique number address app-eui, group topic belonging to equipment, sets
Standby gateway gateways.
Push-data propelling data table stores the data come from equipment acquisition and by data-pushing to the core table of user,
The information of each equipment reported is stored entirely in this table, this table structure is as follows:
| Field name | Field type | Explanation of field | Remarks |
| id | bigint | The non-traffic major key of equipment list | It is automatic to increase |
| create-time | datetime | The creation time of facility information | |
| application-id | bigint(20) | ||
| app-eui | varchar(255) | Equipment unique number address | |
| data | varchar(8000) | ||
| data-type | Int(11) | ||
| mac | varchar(255) | ||
| reserver | varchar(255) | ||
| v-id | varchar(255) | ||
| topic | int | Group belonging to equipment | |
| gateways | varchar(8000) | The gateway of equipment | |
| create-times | varchar(50) |
In another technical solution, the company url address table includes parameter: the non-traffic major key id of company table, public affairs
Take charge of the address the url url of title name, company.
Company's url address table, mgr-company company url address table store each data-pushing of each company
The address url
In another technical solution, the okhttp-push push allocation list includes parameter: the non-traffic major key of equipment list
The position vernier mid that group topic, id, that is, url-id of the url of message push belonging to id, equipment, message are had successfully received.
Okhttp-push pushes allocation list
| id | bigint | Non-traffic major key | It is automatic to increase |
| topic | int | Group belonging to equipment | |
| url-id | bigint | The id of the url of message push | |
| mid | bigint | The position vernier that message is had successfully received |
Although the embodiments of the present invention have been disclosed as above, but its is not only in the description and the implementation listed
With it can be fully applied to various fields suitable for the present invention, for those skilled in the art, can be easily
Realize other modification, therefore without departing from the general concept defined in the claims and the equivalent scope, the present invention is simultaneously unlimited
In specific details and embodiment shown and described herein.
Claims (6)
1. the data of Internet of things system large number of equipment store and the network system realization of push, which is characterized in that including walking as follows
It is rapid:
Step 1: building database table structure, including device-topic table, push-data table, okhttp-push table, company
Url address table；
Step 2: each equipment is divided the group belonging to it by the different recipients that will be sent to according to device data respectively
The corresponding relationship of equipment and its affiliated group is inserted into device-topic relation table by topic；
Step 3: the data acquired from equipment, according to the equipment dev-eui in this data source, by device-topic table,
Determine the topic parameter of this data, then correspondence is inserted into push-data table；
Step 4: establishing the mapping relations of topic and url, and inserts it into okhttp-push table, same for determining
The address url that data below topic are sent to；
Step 5: recording each in okhttp-push table, respectively each thread: in okhttp-push table
The value of topic and mid goes to inquire in push-data table, and the topic is not further below by user's success of the corresponding address url
Received device data, and these device datas are sent according to the size of major key id with okhttp sequence；
Step 6: by the response data of okhttp, judge whether user has successfully received PUSH message, if receiving, update
The corresponding vernier mid of this topic and url in okhttp-push table；If not receiving, okhttp-push table, thread are not updated
Repetition is read not sent device data and is retransmitted.
2. the data of Internet of things system large number of equipment as described in claim 1 store and the network system realization of push, special
Sign is that the device-topic table includes parameter: the non-traffic major key id of equipment list, equipment unique number address dev-eui,
Group topic belonging to equipment.
3. the data of Internet of things system large number of equipment as described in claim 1 store and the network system realization of push, special
Sign is that the push-data table includes parameter: the creation time create- of the non-traffic major key id of equipment list, facility information
The gateway gateways of time, equipment unique number address app-eui, group topic, equipment belonging to equipment.
4. the data of Internet of things system large number of equipment as described in claim 1 store and the network system realization of push, special
Sign is that the okhttp-push table includes parameter: group topic belonging to the non-traffic major key id of equipment list, equipment, message push away
The position vernier mid that the id of the url sent i.e. url-id, message are had successfully received.
5. the data of Internet of things system large number of equipment as described in claim 1 store and the network system realization of push, special
Sign is that the company url address table includes parameter: the non-traffic major key id of company table, Business Name name, company url
Address url.
6. the data of Internet of things system large number of equipment as described in claim 1 store and the network system realization of push, special
Sign is, the step 4 specifically: gives each user with http method of synchronization pushing equipment data, is configured by sql sentence
The corresponding relationship for pushing address url is corresponded in topic and company's url address table.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811143300.XA CN108965483B (en) | 2018-09-28 | 2018-09-28 | System implementation method for storing and pushing data of mass equipment in Internet of things system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811143300.XA CN108965483B (en) | 2018-09-28 | 2018-09-28 | System implementation method for storing and pushing data of mass equipment in Internet of things system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108965483A true CN108965483A (en) | 2018-12-07 |
| CN108965483B CN108965483B (en) | 2021-04-23 |
Family
ID=64472307
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811143300.XA Active CN108965483B (en) | 2018-09-28 | 2018-09-28 | System implementation method for storing and pushing data of mass equipment in Internet of things system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965483B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109918393A (en) * | 2019-01-28 | 2019-06-21 | 武汉慧联无限科技有限公司 | The data platform and its data query and multilist conjunctive query method of Internet of Things |
| CN111767276A (en) * | 2020-06-29 | 2020-10-13 | 北京百度网讯科技有限公司 | Data storage method and device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106528A (en) * | 2007-07-31 | 2008-01-16 | 杭州华三通信技术有限公司 | Packet forward system and method based on secure device and its secure device |
| CN102325061A (en) * | 2011-09-16 | 2012-01-18 | 北京星网锐捷网络技术有限公司 | Method for monitoring network, equipment and system |
| CN106896737A (en) * | 2017-03-10 | 2017-06-27 | 南京邮电大学 | A kind of intelligent domestic Integrated Information Processing System |
| WO2018106159A1 (en) * | 2016-12-05 | 2018-06-14 | Telefonaktiebolaget Lm Ericsson (Publ) | Methods and apparatus for operating and managing a constrained device within |
-
2018
- 2018-09-28 CN CN201811143300.XA patent/CN108965483B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101106528A (en) * | 2007-07-31 | 2008-01-16 | 杭州华三通信技术有限公司 | Packet forward system and method based on secure device and its secure device |
| CN102325061A (en) * | 2011-09-16 | 2012-01-18 | 北京星网锐捷网络技术有限公司 | Method for monitoring network, equipment and system |
| WO2018106159A1 (en) * | 2016-12-05 | 2018-06-14 | Telefonaktiebolaget Lm Ericsson (Publ) | Methods and apparatus for operating and managing a constrained device within |
| CN106896737A (en) * | 2017-03-10 | 2017-06-27 | 南京邮电大学 | A kind of intelligent domestic Integrated Information Processing System |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109918393A (en) * | 2019-01-28 | 2019-06-21 | 武汉慧联无限科技有限公司 | The data platform and its data query and multilist conjunctive query method of Internet of Things |
| CN111767276A (en) * | 2020-06-29 | 2020-10-13 | 北京百度网讯科技有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN111767276B (en) * | 2020-06-29 | 2024-03-15 | 北京百度网讯科技有限公司 | Data storage method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108965483B (en) | 2021-04-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104486743B (en) | A method of user information correlation is carried out to each interface XDR data of core net | |
| CN104980487B (en) | Service discovery using set synchronization with exact names | |
| CN102088489B (en) | Distributed data synchronizing system and method | |
| CN105338113B (en) | A kind of multi-platform data interconnection system for Urban Data resource-sharing | |
| CN103873451B (en) | A kind of method, apparatus and system of data syn-chronization | |
| KR100945218B1 (en) | Transfer of data objects | |
| CN109213792A (en) | Method, server-side, client, device and the readable storage medium storing program for executing of data processing | |
| CN102202073A (en) | Distributed system and data synchronization method thereof | |
| CN106055698A (en) | Data migration method, agent node and database instance | |
| CN101278519B (en) | Device management method using nodes having additional attribute and device management client terminal thereof | |
| CN102710548A (en) | Method and system for tracking operation of each email receiver over email | |
| US11176111B2 (en) | Distributed database management system with dynamically split B-tree indexes | |
| CN108965483A (en) | The data of Internet of things system large number of equipment store and the network system realization of push | |
| CN101202966A (en) | Method, system and apparatus for collecting user information | |
| CN107870982A (en) | Data processing method, system and computer-readable recording medium | |
| CN105227662A (en) | Message treatment method, device and system | |
| CN107612833A (en) | A kind of URI method for routing and relevant apparatus based on storage system | |
| CN106101412A (en) | The information session processing method of mobile communication terminal and mobile communication terminal | |
| CN102347847A (en) | Contact state releasing method and system | |
| Saito et al. | Optimistic replication for internet data services | |
| CN102651722A (en) | Mail attachment processing method, mail sending server and mail receiving server | |
| CN109634757B (en) | Data acquisition method for seismic industry big data processing | |
| CN105447000A (en) | Transactional message transmission method and device | |
| CN104077355B (en) | A kind of method, apparatus and system of unstructured data storage and inquiry | |
| CN105812178A (en) | Terminal upgrade method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: System implementation method of data storage and push of a large number of equipment in Internet of things system Effective date of registration: 20220125 Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2022420000034 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Date of cancellation: 20230201 Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2022420000034 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: System implementation method for data storage and push of a large number of devices in the Internet of Things system Effective date of registration: 20230206 Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2023420000024 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2023420000024 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: System implementation method for data storage and push of a large number of devices in the Internet of Things system Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2024980035110 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| PC01 | Cancellation of the registration of the contract for pledge of patent right |
Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2024980035110 |
|
| PC01 | Cancellation of the registration of the contract for pledge of patent right | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: System implementation method for data storage and push of a large number of devices in the Internet of Things system Granted publication date: 20210423 Pledgee: Bank of Communications Ltd. Wuhan East Lake New Technology Development Zone sub branch Pledgor: WUHAN EASYLINKIN TECHNOLOGY CO.,LTD Registration number: Y2024980037971 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |