CN109818904A - A kind of internet-of-things terminal data flow processing method and device - Google Patents
A kind of internet-of-things terminal data flow processing method and device Download PDFInfo
- Publication number
- CN109818904A CN109818904A CN201711162968.4A CN201711162968A CN109818904A CN 109818904 A CN109818904 A CN 109818904A CN 201711162968 A CN201711162968 A CN 201711162968A CN 109818904 A CN109818904 A CN 109818904A
- Authority
- CN
- China
- Prior art keywords
- tcp
- data packet
- network side
- internet
- things
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of internet-of-things terminal data flow processing method and devices, are related to internet of things field, and method includes: the TCP/IP data packet that network side collects numerous internet-of-things terminals；Network side carries out parsing filtration treatment using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals, obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding data packet, and send it to corresponding purpose processing system.
Description
Technical field
The present invention relates to internet of things field, in particular to a kind of internet-of-things terminal data flow processing method and device.
Background technique
Invasive system is needed for the dispersion of current internet-of-things terminal data, the processing of more network elements, is generally adopted real in the following method
It is existing:
1) hardware platform passes through software desk Implementation TCP (Transmission Control Protocol, transmission control
Agreement)/IP (Internet Protocol, Internet protocol) agreement and communications protocol conversion；
2) hardware platform uses the insertion based on ARM (Advanced RISC Machines, embedded RISC processor)
Formula platform, the embedded platform is equipped with wired network adapter, wireless network card, bluetooth module, infrared data communication module and ZigBee
Wireless sensor module, the software platform are based on Embedded LINUX system.
But existing method has the following problems:
1) newly-increased agreement is needed to realize that ICP/IP protocol and communications protocol are converted；
2) it is based on ARM embedded platform, it is also necessary to it is newly developed, increase process and cost.
Therefore terminal data dispersion access is caused, difficult problem is assembled.
Summary of the invention
The technical issues of scheme provided according to embodiments of the present invention solves is that hardware platform is used to make terminal data point
It dissipates access and aggregation is difficult.
A kind of internet-of-things terminal data flow processing method provided according to embodiments of the present invention, comprising:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is parsed using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filter processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding
Data packet, and send it to corresponding purpose processing system；
Wherein, the TCP refers to transmission control protocol；The IP refers to Internet protocol.
Preferably, the network side collects the TCP/IP data packet of numerous internet-of-things terminals and includes:
Network side utilizes the ICP/IP protocol stack under linux environment and collects numerous objects using raw socket acquisition mode
The TCP/IP data packet of networked terminals；Or
Network side is utilized the ICP/IP protocol stack under linux/windows environment and is collected using pcap acquisition mode numerous
The TCP/IP data packet of internet-of-things terminal.
Preferably, the network side is using ICP/IP protocol to the TCP/IP data packet of collected numerous internet-of-things terminals
Parsing filtration treatment is carried out, each TCP/IP filtering data packet for obtaining being sent to different purpose processing systems includes:
Network side parses the TCP/IP data packet using ICP/IP protocol, obtains the TCP/IP data packet
TCP port and IP address；
Network side is according to the TCP port and IP address of obtained TCP/IP data packet and preset TCP port and IP
Location filtering rule is filtered processing to the TCP/IP data packet, obtains being sent to each of different purpose processing systems
TCP/IP filters data packet.
Preferably, the network side is filtered processing to the TCP/IP data packet, obtains being sent to different purposes
Each TCP/IP of processing system filters data packet
Network side is filtered processing to the TCP/IP data packet, obtains being sent to each of different purpose processing systems
A TCP/IP data packet；
Network side judges the TCP/IP data by detecting to obtained each TCP/IP total length of data packets
Whether packet total length is more than the Internet of Things MTU value；
If judging, the TCP/IP total length of data packets is more than the Internet of Things MTU value, and network side is according to the Internet of Things
Net MTU value carries out subpackage processing to the TCP/IP data packet, obtains each TCP/ for being sent to different purpose processing systems
IP filters data packet；
Wherein, the MTU refers to maximum transmission unit.
Preferably, the network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding
TCP/IP forward data packet, and send it to corresponding purpose processing system and include:
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains the TCP/IP of same length
Reorganizing packets；
Network side is repaired using TCP port and IP address of the ICP/IP protocol to each TCP/IP reorganizing packets
Change, obtains corresponding TCP/IP forwarding data packet；
Network side according to the TCP/IP forward data packet TCP port and IP address, calculate for corresponding purpose
Processing system establishes the session key of communication connection, and leading to using the Session key establishment and corresponding purpose processing system
Letter connection, to use the communication connection that TCP/IP forwarding data packet is sent to corresponding purpose processing system.
A kind of internet-of-things terminal data stream processing device provided according to embodiments of the present invention, comprising:
Collection module, for collecting the TCP/IP data packet of numerous internet-of-things terminals；
Filtering module is parsed, for the TCP/IP data packet using ICP/IP protocol to collected numerous internet-of-things terminals
Parsing filtration treatment is carried out, each TCP/IP filtering data packet for being sent to different purpose processing systems is obtained；
Forward process module obtains corresponding for carrying out reorganization by filtering data packet to each TCP/IP
TCP/IP forward data packet, and send it to corresponding purpose processing system；
Wherein, the TCP refers to transmission control protocol；The IP refers to Internet protocol.
Preferably, the collection module includes:
First collector unit, for utilizing the ICP/IP protocol stack under linux environment and using the acquisition side raw socket
Formula collects the TCP/IP data packet of numerous internet-of-things terminals；Or
Second collector unit, for being acquired using the ICP/IP protocol stack under linux/windows environment and using pcap
Mode collects the TCP/IP data packet of numerous internet-of-things terminals.
Preferably, the parsing filtering module includes:
Resolution unit obtains the TCP/IP for parsing using ICP/IP protocol to the TCP/IP data packet
The TCP port and IP address of data packet；
Filter element, for according to the TCP port and IP address of obtained TCP/IP data packet and preset TCP port
With IP address filtering rule, processing is filtered to the TCP/IP data packet, obtains being sent to different purpose processing systems
Each TCP/IP filter data packet.
Preferably, the filter element is specifically used for being filtered processing to the TCP/IP data packet, obtains to be sent
To each TCP/IP data packet of different purpose processing systems, and by obtained each TCP/IP total length of data packets into
Row detection, judges whether the TCP/IP total length of data packets is more than the Internet of Things MTU value, if judging the TCP/IP data
Packet total length is more than the Internet of Things MTU value, then carries out at subpackage according to the Internet of Things MTU value to the TCP/IP data packet
Reason obtains each TCP/IP filtering data packet for being sent to different purpose processing systems.
A kind of equipment of the internet-of-things terminal Data Stream Processing provided according to embodiments of the present invention, the equipment include: place
Manage device, and the memory with processor coupling；The object that can be run on the processor is stored on the memory
The program of networked terminals Data Stream Processing, the program of the internet-of-things terminal Data Stream Processing is executed by the processor includes:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is parsed using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filter processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding
Data packet, and send it to corresponding purpose processing system.
A kind of computer storage medium provided according to embodiments of the present invention, is stored with internet-of-things terminal Data Stream Processing
When the program of program, the internet-of-things terminal Data Stream Processing is executed by processor the following steps are included:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is parsed using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filter processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding
Data packet, and send it to corresponding purpose processing system.
The scheme provided according to embodiments of the present invention utilizes the TCP/ of linux/windows in internet-of-things terminal access point
IP protocol stack obtains the data packet in IP level using raw socket, and filtration treatment TCP or udp protocol is arranged according to system
Packet after obtaining ICP/IP protocol packet, the data packet of specified IP, PORT is filtered further according to system setting, these data packets are passed through
Raw socket is distributed to different purpose processing systems.So that utilizing IP communication equipment in the case where not modifying existing system
System realizes the more network element processing of internet-of-things terminal data flow in communication level.
Detailed description of the invention
Fig. 1 is a kind of internet-of-things terminal data flow processing method flow chart provided in an embodiment of the present invention；
Fig. 2 is a kind of internet-of-things terminal data stream processing device schematic diagram provided in an embodiment of the present invention；
Fig. 3 is internet-of-things terminal data flow processing module schematic diagram provided in an embodiment of the present invention；
Fig. 4 is the process flow diagram of original data acquisition module in Fig. 3 provided in an embodiment of the present invention；
Fig. 5 is the process flow diagram of data forwarding module in Fig. 3 provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing to a preferred embodiment of the present invention will be described in detail, it should be understood that described below is excellent
Select embodiment only for the purpose of illustrating and explaining the present invention and is not intended to limit the present invention.
Fig. 1 is a kind of internet-of-things terminal data flow processing method flow chart provided in an embodiment of the present invention, as shown in Figure 1,
Include:
Step S101: network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Step S102: network side using ICP/IP protocol to the TCP/IP data packets of collected numerous internet-of-things terminals into
Row parsing filtration treatment obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Step S103: network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding
TCP/IP forwards data packet, and sends it to corresponding purpose processing system.
Wherein, it includes: that network side utilizes linux ring that the network side, which collects the TCP/IP data packet of numerous internet-of-things terminals,
ICP/IP protocol stack under border and the TCP/IP data packet that numerous internet-of-things terminals are collected using raw socket acquisition mode；Or
Person's network side utilizes the ICP/IP protocol stack under linux/windows environment and collects numerous Internet of Things using pcap acquisition mode
The TCP/IP data packet of terminal.
Wherein, the network side using ICP/IP protocol to the TCP/IP data packets of collected numerous internet-of-things terminals into
Row parsing filtration treatment, each TCP/IP filtering data packet for obtaining being sent to different purpose processing systems includes: network side
The TCP/IP data packet is parsed using ICP/IP protocol, with obtaining TCP port and the IP of the TCP/IP data packet
Location；Network side is filtered according to the TCP port and IP address of obtained TCP/IP data packet and preset TCP port and IP address
Rule is filtered processing to the TCP/IP data packet, obtains each TCP/IP for being sent to different purpose processing systems
Filter data packet.
Wherein, the network side is filtered processing to the TCP/IP data packet, obtains being sent at different purposes
Reason system each TCP/IP filtering data packet include: that network side is filtered processing to the TCP/IP data packet, obtain to
It is sent to each TCP/IP data packet of different purpose processing systems；Network side passes through to obtained each TCP/IP data packet
Total length is detected, and judges whether the TCP/IP total length of data packets is more than the Internet of Things MTU value；If described in judgement
TCP/IP total length of data packets is more than the Internet of Things MTU value, then network side is according to the Internet of Things MTU value to the TCP/IP
Data packet carries out subpackage processing, obtains each TCP/IP filtering data packet for being sent to different purpose processing systems.
Wherein, the network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding
TCP/IP forwards data packet, and sending it to corresponding purpose processing system includes: that network side passes through to each TCP/
IP filters data packet and carries out reorganization, obtains the TCP/IP reorganizing packets of same length；Network side utilizes ICP/IP protocol
It modifies to the TCP port and IP address of each TCP/IP reorganizing packets, obtains corresponding TCP/IP forwarding data
Packet；Network side according to the TCP/IP forward data packet TCP port and IP address, calculate for corresponding purpose processing system
The session key of the vertical communication connection of construction in a systematic way, and utilize the communication link of the Session key establishment and corresponding purpose processing system
It connects, to use the communication connection that TCP/IP forwarding data packet is sent to corresponding purpose processing system.
Fig. 2 is a kind of internet-of-things terminal data stream processing device schematic diagram provided in an embodiment of the present invention, as shown in Fig. 2,
It include: collection module 201, for collecting the TCP/IP data packet of numerous internet-of-things terminals；Filtering module 202 is parsed, for benefit
Parsing filtration treatment is carried out with TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals, is obtained to be sent
Each TCP/IP to different purpose processing systems filters data packet；Forward process module 203, for by described each
TCP/IP filters data packet and carries out reorganization, obtains corresponding TCP/IP forwarding data packet, and send it to corresponding mesh
Processing system.
Wherein, the collection module 201 includes: the first collector unit, for utilizing the ICP/IP protocol under linux environment
Stack and the TCP/IP data packet that numerous internet-of-things terminals are collected using raw socket acquisition mode；Or second collector unit,
For collecting numerous internet-of-things terminals using the ICP/IP protocol stack under linux/windows environment and using pcap acquisition mode
TCP/IP data packet.
Wherein, the parsing filtering module 202 includes: resolution unit, for utilizing ICP/IP protocol to the TCP/IP
Data packet is parsed, and the TCP port and IP address of the TCP/IP data packet are obtained；Filter element, for according to obtained by
TCP/IP data packet TCP port and IP address and preset TCP port and IP address filtering rule, to the TCP/IP number
It is filtered processing according to packet, obtains each TCP/IP filtering data packet for being sent to different purpose processing systems.
Specifically, the filter element is specifically used for being filtered processing to the TCP/IP data packet, obtain pending
It is sent to each TCP/IP data packet of different purpose processing systems, and by obtained each TCP/IP total length of data packets
It is detected, judges whether the TCP/IP total length of data packets is more than the Internet of Things MTU value, if judging the TCP/IP number
It is more than the Internet of Things MTU value according to packet total length, then subpackage is carried out to the TCP/IP data packet according to the Internet of Things MTU value
Processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems.
Wherein, the forward process module 203 is specifically used for carrying out weight by filtering data packet to each TCP/IP
Group processing obtains the TCP/IP reorganizing packets of same length, and recombinates number to each TCP/IP using ICP/IP protocol
It modifies according to the TCP port and IP address of packet, obtains corresponding TCP/IP forwarding data packet, and turn according to the TCP/IP
The TCP port and IP address of data packet are sent out, the session key for establishing communication connection with corresponding purpose processing system is calculated,
And using the communication connection of the Session key establishment and corresponding purpose processing system, to use the communication connection by institute
It states TCP/IP forwarding data packet and is sent to corresponding purpose processing system.
A kind of equipment of the internet-of-things terminal Data Stream Processing provided according to embodiments of the present invention, the equipment include: place
Manage device, and the memory with processor coupling；The object that can be run on the processor is stored on the memory
The program of networked terminals Data Stream Processing, the program of the internet-of-things terminal Data Stream Processing is executed by the processor includes:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is parsed using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filter processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding
Data packet, and send it to corresponding purpose processing system.
A kind of computer storage medium provided according to embodiments of the present invention, is stored with internet-of-things terminal Data Stream Processing
When the program of program, the internet-of-things terminal Data Stream Processing is executed by processor the following steps are included:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is parsed using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filter processing obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding
Data packet, and send it to corresponding purpose processing system.
Fig. 3 is internet-of-things terminal data flow processing module schematic diagram provided in an embodiment of the present invention, as shown in Figure 3, comprising:
Raw data acquisition module, data filtering analysis module, data forwarding module and response data processing module.
Wherein, the raw data acquisition mode major function is from terminal access server needed for acquisition system, user
The raw data packets wanted；Raw data acquisition provides terminal communication data packet for data filtering analysis module.There are mainly two types of skills
Art scheme realizes packet capture, as shown in figure 4, first is that raw socket；Create raw socket, bound host and end
Mouthful, socket handle is obtained, handle is incorporated to select and is read in queue, data are read by recv function and give data filtering point
Analyse module.Second is that pcap packet is realized；It is realized using pcap open source projects and obtains data frame in data link layer, taken out in data frame
IP data packet after, call data filtering analytic function.
Different system environments is derived mainly from using raw socket or pcap different technologies scheme, and is required.Using raw
Socket acquires data, and without relying on other softwares, ICP/IP protocol stack can be supported, but under windows environment, due to peace
Full reason raw socket supports bad.Data are acquired using pcap scheme, need system that one pcap driving is installed, convenient for from
Data link layer obtains message.
Wherein, the data filtering analysis module mainly completes the filtration treatment after terminal data acquisition, according to user's need
It asks and is filtered rule settings.Mainly have and is filtered by IP raw address, destination address, TCP original port, destination port.
Data filtering analysis module will carry out subpackage processing to received IP datagram according to the MTU value size of local area network,
Maximum IP packet is limited within the scope of MTU.After the completion of subpackage, need to modify the field in the packet header IP.
Data packet is put into data forwarding queue after the completion of data filtering analysis processing.
Wherein, the data forwarding module mainly complete to filtering data packet forwarding operation, data forwarding module will acquire,
Filtered data packet is assembled new IP data packet by system convention, and is forwarded to purpose system.
Data forwarding module can press rules modification source, mesh according to rule with duplicate packet to destination IP, packet content
MAC Address；Source, purpose IP address；The information such as source, destination port, in order to guarantee that ICP/IP protocol stack can work normally, also
Need to modify the contents such as checkSum serial number.
Data forwarding module is to guarantee that destination server does not perceive the state of TCP, data can be normally handled, for part
IP packet needs to handle respectively.As shown in figure 5, for different IP data packets, data forwarding module need according to source IP, source port or
Destination IP, destination port calculate a session key, for marking, storing TCP connection.If connecting in systems without some TCP
Connect information, then need to create a TCP connection: current IP packet is SYN, then directly forwards SYN packet to destination server；If current
IP packet is not SYN, then system needs to forge a SYN and is sent to destination server.Current destination server replys SYN_ACK
After data forwarding module, data forwarding module will complete the three-way handshake of TCP.Data forwarding module is according to destination server
Data response condition decides whether transmission, retransmission data packet.
Data forwarding module is similar with acquisition module, and raw socket or pcap two ways can be taken main to purpose
Send data packet.There is differents for both forwarding communication modes: for raw socket, forwarding data packet is main
It is IP level, system only needs that destination server IP and port is arranged；And pcap sends data packet and is then related to data
Link layer needs system to specify mac-layer address.Here MAC Address includes source MAC and target MAC (Media Access Control) address, target MAC (Media Access Control) address
Refer to the address of the next-hop network element in data routing.
Wherein, the response data processing module mainly completes in data dissemination process IP layer data by normal, efficient place
Reason, guarantee data forwarding module can orderly, normally send data, guarantee more network element processing modules not by the shadow of response message
Ring efficient process.
Response data processing module is responsible for reception, segmentation, the forwarding of the TCP or udp protocol message of destination server reply
Deng operation.To guarantee destination server, forwarding server unaware, needs to be arranged on destination server IP and forward routing, in fact
Existing purpose is that the data packet of forwarding server is all forwarded to response data processing module.Response data processing receives the mode of data
It can be raw socket mode, be also possible to pcap mode.After receiving response data, response data processing module needs basis
The necessary part of IP data communications is sent to data forwarding module by the structure of IP data packet.The necessary part of IP data communications
Include mainly IP and TCP or UDP heading, i.e., need to be split IP data packet in response data processing module, intercepts
Data packet head content.Response data processing module is realized when forwarding data using bi-directional chaining: in response data processing module
Two-way dedicated TCP connection is connected between data forwarding module is used for transmission response data packet.After exclusive data, which connects, to be disconnected,
Indicate that the presence between forwarding, respond module is abnormal, system will alarm and attempt reconnection.
In conclusion primary focus of the invention is to realize the more network elements of terminal data stream on ICP/IP protocol stack layer face
Processing, the application without influencing existing system；Filter analysis supports source, destination address, port operation, meets to different directions number
The purpose handled according to more network elements；System data flow is replicated in TCP/IP layer completion, and response, forward process algorithm are not connected by host
Too many limitation.
The scheme provided according to embodiments of the present invention, including the following:
Advantage one: in the case where existing Internet of things system does not perceive, the more network element processing of terminal data stream are realized；
Advantage two: on the basis of protocol stack, any number of network element processing data are theoretically realized；
Advantage three: more network element processing data flows can accomplish not interfere mutually, data flow transparent processing.
Although describing the invention in detail above, but the invention is not restricted to this, those skilled in the art of the present technique
It can be carry out various modifications with principle according to the present invention.Therefore, all to be modified according to made by the principle of the invention, all it should be understood as
Fall into protection scope of the present invention.
Claims (10)
1. a kind of internet-of-things terminal data flow processing method, comprising:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is carried out at parsing filtering using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Reason obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding data
Packet, and send it to corresponding purpose processing system.
2. according to the method described in claim 1, the TCP/IP data packet that the network side collects numerous internet-of-things terminals includes:
Network side utilizes the ICP/IP protocol stack under linux environment and collects numerous Internet of Things using raw socket acquisition mode
The TCP/IP data packet of terminal；Or
Network side utilizes the ICP/IP protocol stack under linux/windows environment and collects numerous Internet of Things using pcap acquisition mode
The TCP/IP data packet of network termination.
3. according to the method described in claim 1, the network side is whole to collected numerous Internet of Things using ICP/IP protocol
The TCP/IP data packet at end carries out parsing filtration treatment, obtains each TCP/IP filtering for being sent to different purpose processing systems
Data packet includes:
Network side parses the TCP/IP data packet using ICP/IP protocol, obtains the TCP of the TCP/IP data packet
Port and IP address；
Network side is according to the TCP port and IP address of obtained TCP/IP data packet and preset TCP port and IP address mistake
Filter rule, is filtered processing to the TCP/IP data packet, obtains each TCP/ for being sent to different purpose processing systems
IP filters data packet.
4. according to the method described in claim 3, the network side is filtered processing to the TCP/IP data packet, obtain to
The each TCP/IP for being sent to different purpose processing systems filters data packet and includes:
Network side is filtered processing to the TCP/IP data packet, obtains being sent to each of different purpose processing systems
TCP/IP data packet；
Network side judges that the TCP/IP data packet is total by detecting to obtained each TCP/IP total length of data packets
Whether length is more than the Internet of Things MTU value；
If judge the TCP/IP total length of data packets be more than the Internet of Things MTU value, network side according to the Internet of Things most
Big transmission unit MTU value carries out subpackage processing to the TCP/IP data packet, obtains being sent to different purpose processing systems
Each TCP/IP filters data packet.
5. according to the method described in claim 4, the network side carries out weight by filtering data packet to each TCP/IP
Group processing obtains corresponding TCP/IP forwarding data packet, and sends it to corresponding purpose processing system and include:
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains the TCP/IP recombination of same length
Data packet；
Network side is modified using TCP port and IP address of the ICP/IP protocol to each TCP/IP reorganizing packets,
Obtain corresponding TCP/IP forwarding data packet；
Network side forwards the TCP port and IP address of data packet according to the TCP/IP, calculates for handling with corresponding purpose
System establishes the session key of communication connection, and utilizes the communication link of the Session key establishment and corresponding purpose processing system
It connects, to use the communication connection that TCP/IP forwarding data packet is sent to corresponding purpose processing system.
6. a kind of internet-of-things terminal data stream processing device, comprising:
Collection module, for collecting the TCP/IP data packet of numerous internet-of-things terminals；
Filtering module is parsed, for carrying out using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Filtration treatment is parsed, each TCP/IP filtering data packet for being sent to different purpose processing systems is obtained；
Forward process module obtains corresponding for carrying out reorganization by filtering data packet to each TCP/IP
TCP/IP forwards data packet, and sends it to corresponding purpose processing system.
7. device according to claim 6, the collection module include:
First collector unit, for being received using the ICP/IP protocol stack under linux environment and using raw socket acquisition mode
Collect the TCP/IP data packet of numerous internet-of-things terminals；Or
Second collector unit, for utilizing the ICP/IP protocol stack under linux/windows environment and using pcap acquisition mode
Collect the TCP/IP data packet of numerous internet-of-things terminals.
8. device according to claim 6, the parsing filtering module include:
Resolution unit obtains the TCP/IP data for parsing using ICP/IP protocol to the TCP/IP data packet
The TCP port and IP address of packet；
Filter element, for the TCP port and IP address and preset TCP port and IP according to obtained TCP/IP data packet
Address filtering rule, is filtered processing to the TCP/IP data packet, obtains being sent to each of different purpose processing systems
A TCP/IP filters data packet.
9. a kind of equipment of internet-of-things terminal Data Stream Processing, the equipment includes: processor, and is coupled with the processor
Memory；The program for the internet-of-things terminal Data Stream Processing that can be run on the processor is stored on the memory,
The program of the internet-of-things terminal Data Stream Processing is executed by the processor
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is carried out at parsing filtering using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Reason obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding data
Packet, and send it to corresponding purpose processing system.
10. a kind of computer storage medium is stored with the program of internet-of-things terminal Data Stream Processing, the internet-of-things terminal data
When the program of stream process is executed by processor the following steps are included:
Network side collects the TCP/IP data packet of numerous internet-of-things terminals；
Network side is carried out at parsing filtering using TCP/IP data packet of the ICP/IP protocol to collected numerous internet-of-things terminals
Reason obtains each TCP/IP filtering data packet for being sent to different purpose processing systems；
Network side carries out reorganization by filtering data packet to each TCP/IP, obtains corresponding TCP/IP forwarding data
Packet, and send it to corresponding purpose processing system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711162968.4A CN109818904A (en) | 2017-11-21 | 2017-11-21 | A kind of internet-of-things terminal data flow processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711162968.4A CN109818904A (en) | 2017-11-21 | 2017-11-21 | A kind of internet-of-things terminal data flow processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109818904A true CN109818904A (en) | 2019-05-28 |
Family
ID=66598251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711162968.4A Pending CN109818904A (en) | 2017-11-21 | 2017-11-21 | A kind of internet-of-things terminal data flow processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109818904A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111770117A (en) * | 2020-09-01 | 2020-10-13 | 北京东方通软件有限公司 | Network packet splicing method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543104A (en) * | 2003-04-28 | 2004-11-03 | 华为技术有限公司 | Data transmission method for mobile packet network |
| CN101729542A (en) * | 2009-11-26 | 2010-06-09 | 上海大学 | Multi-protocol information resolving system based on network packet |
| US20120101967A1 (en) * | 2003-07-22 | 2012-04-26 | Sonicwall, Inc. | Statistical message classifier |
| CN102868609A (en) * | 2012-09-27 | 2013-01-09 | 中兴通讯股份有限公司 | Maximum transmission unit consultation method and data terminal |
| CN103259868A (en) * | 2013-05-31 | 2013-08-21 | 清华大学 | Data collaborative processing system based on intelligent gateway |
| CN103701695A (en) * | 2013-12-26 | 2014-04-02 | 四川九洲电器集团有限责任公司 | Intelligent home gateway control system |
| CN103780620A (en) * | 2014-01-22 | 2014-05-07 | 牟大同 | Network security method and network security system |
| CN103780610A (en) * | 2014-01-16 | 2014-05-07 | 绵阳师范学院 | Network data recovery method based on protocol characteristics |
| US20140310392A1 (en) * | 2013-04-10 | 2014-10-16 | Lap-Wah Lawrence Ho | Method and apparatus for processing composite web transactions |
-
2017
- 2017-11-21 CN CN201711162968.4A patent/CN109818904A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1543104A (en) * | 2003-04-28 | 2004-11-03 | 华为技术有限公司 | Data transmission method for mobile packet network |
| US20120101967A1 (en) * | 2003-07-22 | 2012-04-26 | Sonicwall, Inc. | Statistical message classifier |
| CN101729542A (en) * | 2009-11-26 | 2010-06-09 | 上海大学 | Multi-protocol information resolving system based on network packet |
| CN102868609A (en) * | 2012-09-27 | 2013-01-09 | 中兴通讯股份有限公司 | Maximum transmission unit consultation method and data terminal |
| US20140310392A1 (en) * | 2013-04-10 | 2014-10-16 | Lap-Wah Lawrence Ho | Method and apparatus for processing composite web transactions |
| CN103259868A (en) * | 2013-05-31 | 2013-08-21 | 清华大学 | Data collaborative processing system based on intelligent gateway |
| CN103701695A (en) * | 2013-12-26 | 2014-04-02 | 四川九洲电器集团有限责任公司 | Intelligent home gateway control system |
| CN103780610A (en) * | 2014-01-16 | 2014-05-07 | 绵阳师范学院 | Network data recovery method based on protocol characteristics |
| CN103780620A (en) * | 2014-01-22 | 2014-05-07 | 牟大同 | Network security method and network security system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111770117A (en) * | 2020-09-01 | 2020-10-13 | 北京东方通软件有限公司 | Network packet splicing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102377650B (en) | Data transmission processing method, device and system | |
| US20140112322A1 (en) | Increasing access point throughput by exceeding a-mpdu buffer size limitation in a 802.11 compliant station | |
| CN103581035B (en) | A kind of method of multipath TCP congestion control, Apparatus and system | |
| US20140095711A1 (en) | System, device and method for managing network traffic by using monitoring and filtering policies | |
| CN104572574A (en) | GigE (gigabit Ethernet) vision protocol-based Ethernet controller IP (Internet protocol) core and method | |
| CN103795632A (en) | Data message transmission method, related equipment and system | |
| CN107147655A (en) | A kind of network dual stack parallel process model and its processing method | |
| KR101467063B1 (en) | Building Integrated Network Management Sever and Managing Method Thereof | |
| KR20140097691A (en) | Recording Medium, Method and Device for Server Grouping | |
| CN113194550A (en) | Data channel construction method, server and data cluster system | |
| CN104539722B (en) | A kind of collection method of remote short-haul connections manipulation data | |
| CN109818904A (en) | A kind of internet-of-things terminal data flow processing method and device | |
| CN103001966B (en) | The process of a kind of private network IP, recognition methods and device | |
| CN103458431B (en) | The playback system of multipoint acquisition and cross-layer | |
| CN107104892A (en) | The method and apparatus of network acceleration | |
| CN105791239B (en) | A kind of TCP go-between processing method | |
| CN103428044A (en) | Data packet monitoring method, device and system | |
| CN107659966A (en) | Data transmission method, the network equipment, user terminal, gateway device | |
| CN103078720B (en) | Message processing method and device | |
| CN111866216B (en) | NAT equipment detection method and system based on wireless network access point | |
| CN111865790B (en) | Method and device for collecting router information, internet of things equipment and Internet of things system | |
| CN113489794A (en) | Communication interaction method for intelligent identification master station and intelligent station end equipment of transformer substation | |
| KR101053958B1 (en) | Communication systems | |
| KR101564643B1 (en) | Network apparatus and selective information monitoring method using the same | |
| CN112000054B (en) | Equipment monitoring system based on thing networking |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190528 |
|
| RJ01 | Rejection of invention patent application after publication |