CN105871520A - Data transmission method and device - Google Patents

Data transmission method and device Download PDF

Info

Publication number
CN105871520A
CN105871520A CN201511029979.6A CN201511029979A CN105871520A CN 105871520 A CN105871520 A CN 105871520A CN 201511029979 A CN201511029979 A CN 201511029979A CN 105871520 A CN105871520 A CN 105871520A
Authority
CN
China
Prior art keywords
data
collection data
described collection
preset
sent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201511029979.6A
Other languages
Chinese (zh)
Inventor
徐龙飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LeTV Information Technology Beijing Co Ltd
Original Assignee
LeTV Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LeTV Information Technology Beijing Co Ltd filed Critical LeTV Information Technology Beijing Co Ltd
Priority to CN201511029979.6A priority Critical patent/CN105871520A/en
Publication of CN105871520A publication Critical patent/CN105871520A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1867Arrangements specially adapted for the transmitter end
    • H04L1/1874Buffer management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Abstract

The invention relates to a data transmission method and device. The method comprises following steps of receiving to-be-transmitted collection data; sending the collection data through a network in real time by using a preset communications protocol; judging whether the collection data is sent successfully or not; caching the collection data to the local when the collection data is not sent successfully; automatically retransmitting the collection data cached to the local by using a preset retransmission mode until the collection data is sent successfully. According to the method, fragmented data transmission can be realized, the data transmission efficiency is improved, and the data transmission timeliness is high.

Description

Data transmission method and device
Technical field
The present invention relates to technical field of data transmission, particularly relate to a kind of data transmission method and device.
Background technology
Along with the development of globalization, increasing enterprise all carries out in all parts of the world business, enters data for convenience Line pipe reason and analysis, be the most all to be provided with server in location, namely may in all parts of the world all an enterprise It is provided with substantial amounts of server, but in order to realize the same management to data, needs these servers are aggregated into data system Meter center, such as: the enterprise of China may need data summarization to being arranged on domestic data statistics center.
But when existing transnational server transmission data, collection of server is to after data abroad, relies primarily on nginx (a high performance HTTP and Reverse Proxy) daily record, nginx daily record rotates once, produces for every ten minutes One log (daily record) file, then uses SCP (Session Control Protocol;Session control protocol) technology Nginx log file entirety is sent in domestic server.
And in actual applications, external to domestic network potentially unstable, for the biggest nginx log file, passing Defeated file processes may interrupt at any time, occur interrupting, may be by whole nginx log file retransmission, this is on the one hand Not only waste resource, and data report and minimum to postpone 10 minutes, poor real, it is impossible to meet wanting of big data summarization Ask.
Summary of the invention
For overcoming problem present in correlation technique, the present invention provides a kind of data transmission method and device.
First aspect according to embodiments of the present invention, it is provided that a kind of data transmission method, including:
Receive collection data waiting for transmission;
The default network transmission protocol is utilized described collection data to be sent in real time by network;
Judge whether described collection data are sent successfully;
When described collection data do not send successful, by described collection data buffer storage to local;
Utilize default retransmission scheme that the described collection data being cached to this locality are carried out autonomous retransmission, until by described collection number According to being successfully transmitted.
Alternatively, described reception collection waiting for transmission data, including:
Judge whether preset data access interface is called;
When described preset data access interface is called, the data received by described preset data access interface are as institute State collection data.
Alternatively, described utilization is preset the network transmission protocol and described collection data is sent in real time by network, including:
Resolve the data type of described collection data;
According to the data type of described collection data, determine the encryption policy corresponding with described collection data;
Utilize described encryption policy that described collection data carry out strategy process;
Collection data after being processed by strategy are sent in real time by described transmission network.
Alternatively, the data type of described parsing described collection data, including:
Travel through the field contents of all fields in described collection data;
Judge whether described field contents exists preset field;
When described field contents comprises preset field, data type corresponding for described preset field is defined as described in adopt The data type of collection data.
Alternatively, described judge whether described collection data are sent successfully, including:
After described collection data being sent in real time by network, detect whether to receive to preset in preset time period successfully to ring Answer code;
When receiving described default successful answer code in preset time period, determine that described collection data are sent successfully;
When not receiving described default successful answer code in preset time period, determine that described collection data are not become by transmission Merit.
Alternatively, described utilization is preset retransmission scheme and the described collection data being cached to this locality is carried out autonomous retransmission, including:
The described collection data being cached to this locality it are successively read according to data write sequence;
The default network transmission protocol is utilized the described collection data read to be sent by network.
Second aspect according to embodiments of the present invention, it is provided that a kind of data transmission device, including:
Data reception module, is used for receiving collection data waiting for transmission;
Sending module in real time, is used for utilizing the default network transmission protocol described collection data to be sent in real time by network;
Send judge module, be used for judging whether described collection data are sent successfully;
Data cache module, for when described collection data do not send successful, by described collection data buffer storage to local;
Data retransmission module, for utilizing default retransmission scheme that the described collection data being cached to this locality are carried out autonomous retransmission, Until described collection data are successfully transmitted.
Alternatively, described data reception module, including:
Call judgement submodule, be used for judging whether preset data access interface is called;
Gather data determining module, for when described preset data access interface is called, described preset data is accessed The data that interface arrives are as described collection data.
Alternatively, described real-time sending module, including:
Data type analyzing sub-module, for resolving the data type of described collection data;
Encryption policy determines submodule, for the data type according to described collection data, determines and described collection data phase Corresponding encryption policy;
Strategy processes submodule, is used for utilizing described encryption policy that described collection data carry out strategy process;
Sending submodule, the collection data after being processed by strategy are sent in real time by described transmission network.
Alternatively, described data type analyzing sub-module, including:
Field obtains submodule, for traveling through the field contents of all fields in described data;
Field judges submodule, is used for judging whether described field contents exists preset field;
Data type determines submodule, for when comprising preset field in described field contents, by described preset field pair The data type answered is defined as the data type of described collection data.
Alternatively, described transmission judge module, including:
Answer code detection module, for, after described collection data being sent in real time by network, detecting whether when default Between receive in section and preset successfully answer code;
First determines submodule, for when receiving described default successful answer code in preset time period, determines described Gather data to be sent successfully;
Second determines submodule, for when not receiving described default successful answer code in preset time period, determines institute State collection data not sent successfully.
Alternatively, described data retransmission module, including:
Digital independent submodule, for being successively read the described collection data being cached to this locality according to data write sequence;
Data send submodule, for utilizing the default network transmission protocol the described collection data read to be sent out by network Send.
The technical scheme that embodiments of the invention provide can include following beneficial effect:
The method that the embodiment of the present invention provides, receives collection data waiting for transmission;Utilize and preset the network transmission protocol by institute State collection data to be sent in real time by network;Judge whether described collection data are sent successfully;When described collection data not When sending successfully, by described collection data buffer storage to local;Utilize the described collection presetting retransmission scheme to being cached to this locality Data carry out autonomous retransmission, until described collection data being successfully transmitted
In the method, owing to data can be sent in real time, correspondingly, whenever receiving collection data, all can be straight Connecing and sent, therefore, data need not retransmit after the locally stored file being a specific format.Compared to existing Have in technology, for using nginx log daily record to send a secondary data in every 10 minutes, the party that the embodiment of the present invention provides Method, it is possible to achieve fragmentation of dataization is transmitted, improves the efficiency of data transmission, and the real-time of data transmission is high.
Further, since when network busy or fault, gather data when receiving, it is impossible to sent in real time, that Just, still can press when network state is good by this collection data buffer storage to local for the data of local cache Order according to write uses fragmentation transmission, the most equally improves the efficiency of data transmission, the real-time of data transmission High.
It should be appreciated that it is only exemplary and explanatory that above general description and details hereinafter describe, can not Limit the present invention.
Accompanying drawing explanation
Accompanying drawing herein is merged in description and constitutes the part of this specification, it is shown that meet embodiments of the invention, And for explaining the principle of the present invention together with description.
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing In technology description, the required accompanying drawing used is briefly described, it should be apparent that, for those of ordinary skill in the art Speech, on the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the schematic flow sheet according to a kind of data transmission method shown in an exemplary embodiment;
Fig. 2 is the schematic flow sheet of step S101 in Fig. 1;
Fig. 3 is the schematic flow sheet of step S102 in Fig. 1;
Fig. 4 is the schematic flow sheet of step S103 in Fig. 1;
Fig. 5 is the schematic flow sheet of step S105 in Fig. 1;
Fig. 6 is the structural representation according to a kind of data transmission device shown in an exemplary embodiment;
Fig. 7 is the structural representation of data reception module in Fig. 6;
Fig. 8 is the structural representation of real-time sending module in Fig. 6;
Fig. 9 is the structural representation sending judge module in Fig. 6;
Figure 10 is the structural representation of data retransmission module in Fig. 6.
Detailed description of the invention
Here will illustrate exemplary embodiment in detail, its example represents in the accompanying drawings.Explained below relates to attached During figure, unless otherwise indicated, the same numbers in different accompanying drawings represents same or analogous key element.Following exemplary is implemented Embodiment described in example does not represent all embodiments consistent with the present invention.On the contrary, they be only with such as The example of the apparatus and method that some aspects that described in detail in appended claims, the present invention are consistent.
Fig. 1 is the flow chart according to a kind of data transmission method shown in an exemplary embodiment.This data transmission method can To be applied in server, in particular for the acquisition server in multiple servers that trans-regional data are transmitted, work as collection Collection of server to after data, needs trans-regional collection data to be sent to other server, as it is shown in figure 1, these data Transmission method may comprise steps of.
Step S101, receives collection data waiting for transmission.
Gathering data can be the data that server is currently received that user uploads, it is also possible to be that server is from data file Reading the data that obtain, no matter which kind of mode, the collection data received are required to be transferred to other server.
In one embodiment, as in figure 2 it is shown, this step may comprise steps of:
Step S1011, it is judged that whether preset data access interface is called.
When described preset data access interface is called, perform step S1012;Otherwise, flow process is terminated.
Step S1012, the data received by described preset data access interface are as described collection data.
In embodiments of the present invention, data access layer restful api can be provided with gathering in service area, wherein, REST refers to REpresentation State Transfer, is called for short: declarative state shifts, and API refers to Application Programming Interface, is called for short: application programming interface.
Correspondingly, in the present embodiment, preset data access interface, can be data access layer restful api.? In acquisition server, once there is certain service calling this preset data access interface, then just can be by this present count The data that this service is uploaded are received according to access interface.
Step S102, utilizes the default network transmission protocol described collection data to be sent in real time by network.
In embodiments of the present invention, the default network transmission protocol refers to the agreement that can data be sent in real time, such as: HTTP Agreement (Hyper Text Transfer Protocol, HTML (Hypertext Markup Language)) etc..Owing to data can be sent in real time, Correspondingly, whenever receiving collection data, all can directly be sent, therefore, data need not be locally stored Retransmit after the file of one specific format.Compared in prior art, nginx log daily record is used to send for every 10 minutes For one secondary data, the method that the embodiment of the present invention provides, it is possible to achieve fragmentation of dataization is transmitted, improve data and pass Defeated efficiency, the real-time of data transmission is high.
In an embodiment of the present invention, as it is shown on figure 3, above-mentioned steps S102 may comprise steps of:
Step S1021, resolves the data type of described collection data.
In embodiments of the present invention, multiple different data type can be set according to the privacy override level of data, such as: May include that high private data type, low private data type and non-private data type, wherein, high private data class Type may include that ID, cookie, login password etc., low private data type may include that user access logs, Operation notes etc., non-stealthy data type may include that url, and (Uniform Resource Locator, unified resource is fixed Position symbol) address etc..
In embodiments of the present invention, step S1021 can realize in the following ways.
S1, travels through the field contents of all fields in described collection data.
S2, it is judged that whether described field contents exists preset field.
Preset field refers to above-mentioned: ID, cookie, login password, access log, url etc..
S3, when comprising preset field in described field contents, is defined as institute by data type corresponding for described preset field State the data type gathering data.
See the description previously with regard to data type, it is known that during once it is determined that field contents comprises preset field, Just can accurately determine the data type of these collection data.
Step S1022, according to the data type of described collection data, determines the encryption plan corresponding with described collection data Slightly.
In embodiments of the present invention, for high private data type, the encryption policy of its correspondence can use MD5 (Message Digest Algorithm 5, Message Digest 5 5) cipher mode, low private data type this kind of for user journal, The encryption policy of its correspondence can use symmetric encipherment algorithm and rivest, shamir, adelman, non-private data this kind of for url Type, can directly transmit, and is not compressed processing.
Step S1023, utilizes described encryption policy that described collection data carry out strategy process.
According to the encryption policy determined in step S1022, in this step, can directly enter according to the encryption policy determined Row processes respectively.
Step S1024, the collection data after being processed by strategy are sent in real time by described transmission network.
Step S103, it is judged that whether described collection data are sent successfully.
In embodiments of the present invention, after described collection data are sent in real time by network, as shown in Figure 4, this step Can use and comprise the following steps.
Step S1031, detects whether to receive in preset time period to preset successfully answer code.
For http protocol, when, after data transmission success, 200 pages being returned to the sender of data, once send out The side of sending receives 200 pages, represents that data send successfully.
When receiving described default successful answer code in preset time period, perform step S1032, otherwise, perform step Rapid S1033.
Step S1032, determines that described collection data are sent successfully;
Step S1033, determines that described collection data are not sent successfully.
When described collection data send successfully, terminate flow process.When described collection data do not send successful, perform step S104。
Step S104, by described collection data buffer storage to local.
Step S105, utilizes default retransmission scheme that the described collection data being cached to this locality are carried out autonomous retransmission, until will Described collection data are successfully transmitted.
When retransmitting, re-transmission script can be pre-set, in retransmitting script, re-transmission entry condition can be set, such as Can be to network real-time monitoring, once network state is good, can start re-transmission, and can include when retransmitting following Step.
Step S1051, is successively read the described collection data being cached to this locality according to data write sequence.
Step S1052, utilizes the default network transmission protocol the described collection data read to be sent by network.
Owing to when network busy or fault, gathering data when receiving, it is impossible to sent in real time, then just may be used With by this collection data buffer storage to local, for the data of local cache, when network state is good, still according to write Order use fragmentation transmission, the most equally improve the efficiency of data transmission, the real-time of data transmission is high.
On the basis of embodiment illustrated in fig. 1, the embodiment of the present invention also provides for a kind of data transmission device, as shown in Figure 6, This data transmission device, may include that
Data reception module 11, is used for receiving collection data waiting for transmission.
Gathering data can be the data that server is currently received that user uploads, it is also possible to be that server is from data file Reading the data that obtain, no matter which kind of mode, the collection data received are required to be transferred to other server.
In an alternative embodiment of the invention, as it is shown in fig. 7, the data reception module 11 in Fig. 6, may include that
Call and judge submodule 111, be used for judging whether preset data access interface is called.
Gather data determining module 112, for when described preset data access interface is called, by described preset data The data that access interface receives are as described collection data.
In embodiments of the present invention, data access layer restful api can be provided with gathering in service area, wherein, REST refers to REpresentation State Transfer, is called for short: declarative state shifts, and API refers to Application Programming Interface, is called for short: application programming interface.
Correspondingly, in the present embodiment, preset data access interface, can be data access layer restful api.? In acquisition server, once there is certain service calling this preset data access interface, then just can be by this present count The data that this service is uploaded are received according to access interface.
Sending module 12 in real time, is used for utilizing the default network transmission protocol described collection data to be sent in real time by network.
In embodiments of the present invention, the default network transmission protocol refers to the agreement that can data be sent in real time, such as: HTTP Agreement (Hyper Text Transfer Protocol, HTML (Hypertext Markup Language)) etc..Owing to data can be sent in real time, Correspondingly, whenever receiving collection data, all can directly be sent, therefore, data need not be locally stored Retransmit after the file of one specific format.Compared in prior art, nginx log daily record is used to send for every 10 minutes For one secondary data, the method that the embodiment of the present invention provides, it is possible to achieve fragmentation of dataization is transmitted, improve data and pass Defeated efficiency, the real-time of data transmission is high.
In an alternative embodiment of the invention, as shown in Figure 8, the real-time sending module 12 in Fig. 6 may include that
Data type analyzing sub-module 121, for resolving the data type of described collection data.
In embodiments of the present invention, multiple different data type can be set according to the privacy override level of data, such as: May include that high private data type, low private data type and non-private data type, wherein, high private data class Type may include that ID, cookie, login password etc., low private data type may include that user access logs, Operation notes etc., non-stealthy data type may include that url, and (Uniform Resource Locator, unified resource is fixed Position symbol) address etc..
In an alternative embodiment of the invention, the data type analyzing sub-module in Fig. 6, including:
Field obtains submodule, for traveling through the field contents of all fields in described data.
Field judges submodule, is used for judging whether described field contents exists preset field.
Preset field refers to above-mentioned: ID, cookie, login password, access log, url etc..
Data type determines submodule, for when comprising preset field in described field contents, by described preset field pair The data type answered is defined as the data type of described collection data.
See the description previously with regard to data type, it is known that during once it is determined that field contents comprises preset field, Just can accurately determine the data type of these collection data.
Encryption policy determines submodule 122, for the data type according to described collection data, determines and described collection number According to corresponding encryption policy.
In embodiments of the present invention, for high private data type, the encryption policy of its correspondence can use MD5 (Message Digest Algorithm 5, Message Digest 5 5) cipher mode, low private data type this kind of for user journal, The encryption policy of its correspondence can use symmetric encipherment algorithm and rivest, shamir, adelman, non-private data this kind of for url Type, can directly transmit, and is not compressed processing.
Strategy processes submodule 123, is used for utilizing described encryption policy that described collection data carry out strategy process.
Sending submodule 124, the collection data after being processed by strategy are sent in real time by described transmission network.
Send judge module 13, be used for judging whether described collection data are sent successfully.
In an alternative embodiment of the invention, as it is shown in figure 9, the transmission judge module 13 in Fig. 6 may include that
Answer code detection module 131, for, after described collection data being sent in real time by network, detecting whether in advance If receiving in the time period and presetting successfully answer code.
For http protocol, when, after data transmission success, 200 pages being returned to the sender of data, once send out The side of sending receives 200 pages, represents that data send successfully.
First determines submodule 132, for when receiving described default successful answer code in preset time period, determines Described collection data are sent successfully.
Second determines submodule 133, is used for when not receiving described default successful answer code in preset time period, really Fixed described collection data are not sent successfully.
Data cache module 14, for when described collection data do not send successful, by described collection data buffer storage to local.
Data retransmission module 15, for utilizing default retransmission scheme automatically to weigh the described collection data being cached to this locality Pass, until described collection data are successfully transmitted.
When retransmitting, re-transmission script can be pre-set, in retransmitting script, re-transmission entry condition can be set, such as Can be to network real-time monitoring, once network state is good, can start re-transmission, as shown in Figure 10, described in Fig. 6 Data retransmission module 15, including:
Digital independent submodule 151, for being successively read the described collection data being cached to this locality according to data write sequence.
Data send submodule 152, for utilizing the default network transmission protocol that the described collection data read are passed through net Network sends.
Owing to when network busy or fault, gathering data when receiving, it is impossible to sent in real time, then just may be used With by this collection data buffer storage to local, for the data of local cache, when network state is good, still according to write Order use fragmentation transmission, the most equally improve the efficiency of data transmission, the real-time of data transmission is high.
Those skilled in the art, after considering description and putting into practice invention disclosed herein, will readily occur to other of the present invention Embodiment.The application is intended to any modification, purposes or the adaptations of the present invention, these modification, purposes Or adaptations follow the present invention general principle and include the present invention undocumented in the art known often Know or conventional techniques means.Description and embodiments is considered only as exemplary, true scope and spirit of the invention by under The claim in face is pointed out.
It should be appreciated that the invention is not limited in precision architecture described above and illustrated in the accompanying drawings, and Various modifications and changes can carried out without departing from the scope.The scope of the present invention is only limited by appended claim.

Claims (12)

1. a data transmission method, it is characterised in that including:
Receive collection data waiting for transmission;
The default network transmission protocol is utilized described collection data to be sent in real time by network;
Judge whether described collection data are sent successfully;
When described collection data do not send successful, by described collection data buffer storage to local;
Utilize default retransmission scheme that the described collection data being cached to this locality are carried out autonomous retransmission, until by described collection number According to being successfully transmitted.
Method the most according to claim 1, it is characterised in that described reception collection waiting for transmission data, including:
Judge whether preset data access interface is called;
When described preset data access interface is called, the data received by described preset data access interface are as institute State collection data.
3. to go the method described in 1 according to right, it is characterised in that described utilization is preset the network transmission protocol and adopted described Collection data are sent in real time by network, including:
Resolve the data type of described collection data;
According to the data type of described collection data, determine the encryption policy corresponding with described collection data;
Utilize described encryption policy that described collection data carry out strategy process;
Collection data after being processed by strategy are sent in real time by described transmission network.
Method the most according to claim 3, it is characterised in that the data type of described parsing described collection data, Including:
Travel through the field contents of all fields in described collection data;
Judge whether described field contents exists preset field;
When described field contents comprises preset field, data type corresponding for described preset field is defined as described in adopt The data type of collection data.
Method the most according to claim 1, it is characterised in that described judge whether described collection data are become by transmission Merit, including:
After described collection data being sent in real time by network, detect whether to receive to preset in preset time period successfully to ring Answer code;
When receiving described default successful answer code in preset time period, determine that described collection data are sent successfully;
When not receiving described default successful answer code in preset time period, determine that described collection data are not become by transmission Merit.
Method the most according to claim 1, it is characterised in that described utilization presets retransmission scheme to being cached to this locality Described collection data carry out autonomous retransmission, including:
The described collection data being cached to this locality it are successively read according to data write sequence;
The default network transmission protocol is utilized the described collection data read to be sent by network.
7. a data transmission device, it is characterised in that including:
Data reception module, is used for receiving collection data waiting for transmission;
Sending module in real time, is used for utilizing the default network transmission protocol described collection data to be sent in real time by network;
Send judge module, be used for judging whether described collection data are sent successfully;
Data cache module, for when described collection data do not send successful, by described collection data buffer storage to local;
Data retransmission module, for utilizing default retransmission scheme that the described collection data being cached to this locality are carried out autonomous retransmission, Until described collection data are successfully transmitted.
Device the most according to claim 7, it is characterised in that described data reception module, including:
Call judgement submodule, be used for judging whether preset data access interface is called;
Gather data determining module, for when described preset data access interface is called, described preset data is accessed The data that interface arrives are as described collection data.
Device the most according to claim 7, it is characterised in that described real-time sending module, including:
Data type analyzing sub-module, for resolving the data type of described collection data;
Encryption policy determines submodule, for the data type according to described collection data, determines and described collection data phase Corresponding encryption policy;
Strategy processes submodule, is used for utilizing described encryption policy that described collection data carry out strategy process;
Sending submodule, the collection data after being processed by strategy are sent in real time by described transmission network.
Device the most according to claim 9, it is characterised in that described data type analyzing sub-module, including:
Field obtains submodule, for traveling through the field contents of all fields in described data;
Field judges submodule, is used for judging whether described field contents exists preset field;
Data type determines submodule, for when comprising preset field in described field contents, by described preset field pair The data type answered is defined as the data type of described collection data.
11. devices according to claim 7, it is characterised in that described transmission judge module, including:
Answer code detection module, for, after described collection data being sent in real time by network, detecting whether when default Between receive in section and preset successfully answer code;
First determines submodule, for when receiving described default successful answer code in preset time period, determines described Gather data to be sent successfully;
Second determines submodule, for when not receiving described default successful answer code in preset time period, determines institute State collection data not sent successfully.
12. devices according to claim 7, it is characterised in that described data retransmission module, including:
Digital independent submodule, for being successively read the described collection data being cached to this locality according to data write sequence;
Data send submodule, for utilizing the default network transmission protocol the described collection data read to be sent out by network Send.
CN201511029979.6A 2015-12-31 2015-12-31 Data transmission method and device Pending CN105871520A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201511029979.6A CN105871520A (en) 2015-12-31 2015-12-31 Data transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511029979.6A CN105871520A (en) 2015-12-31 2015-12-31 Data transmission method and device

Publications (1)

Publication Number Publication Date
CN105871520A true CN105871520A (en) 2016-08-17

Family

ID=56624513

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511029979.6A Pending CN105871520A (en) 2015-12-31 2015-12-31 Data transmission method and device

Country Status (1)

Country Link
CN (1) CN105871520A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385414A (en) * 2016-09-13 2017-02-08 郑州云海信息技术有限公司 Distributed cluster monitoring method and system compatible with public network
CN106533887A (en) * 2016-12-13 2017-03-22 安徽声讯信息技术有限公司 Method for accelerating data transmission at voice terminal of intelligent network based on cloud computing
CN107612942A (en) * 2017-10-31 2018-01-19 北京拓通信科技有限公司 A kind of SMS platform user data transmission safe encryption method
CN108462751A (en) * 2018-03-23 2018-08-28 上海地面通信息网络股份有限公司 A kind of reverse proxy system
CN109981230A (en) * 2019-03-25 2019-07-05 广东金赋科技股份有限公司 A kind of the business datum upload ensuring equipment and application method of government affairs self-aided terminal
CN113055402A (en) * 2021-03-30 2021-06-29 深圳红途创程科技有限公司 Data transmission control method and device, computer equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102413311A (en) * 2010-09-20 2012-04-11 北京中星微电子有限公司 Mobile monitoring device, system and monitoring method thereof
CN103837197A (en) * 2014-03-18 2014-06-04 昆明理工大学 System and method for continuously monitoring temperature and humidity
CN104144186A (en) * 2013-05-10 2014-11-12 中国电信股份有限公司 Data uploading method and system based on Web browser in cloud computing environment
CN104468399A (en) * 2014-12-08 2015-03-25 北京奇虎科技有限公司 Data transmission method and device and server
CN105141637A (en) * 2015-09-25 2015-12-09 中铁工程装备集团有限公司 Transmission encryption method taking flows as granularity

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102413311A (en) * 2010-09-20 2012-04-11 北京中星微电子有限公司 Mobile monitoring device, system and monitoring method thereof
CN104144186A (en) * 2013-05-10 2014-11-12 中国电信股份有限公司 Data uploading method and system based on Web browser in cloud computing environment
CN103837197A (en) * 2014-03-18 2014-06-04 昆明理工大学 System and method for continuously monitoring temperature and humidity
CN104468399A (en) * 2014-12-08 2015-03-25 北京奇虎科技有限公司 Data transmission method and device and server
CN105141637A (en) * 2015-09-25 2015-12-09 中铁工程装备集团有限公司 Transmission encryption method taking flows as granularity

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106385414A (en) * 2016-09-13 2017-02-08 郑州云海信息技术有限公司 Distributed cluster monitoring method and system compatible with public network
CN106533887A (en) * 2016-12-13 2017-03-22 安徽声讯信息技术有限公司 Method for accelerating data transmission at voice terminal of intelligent network based on cloud computing
CN107612942A (en) * 2017-10-31 2018-01-19 北京拓通信科技有限公司 A kind of SMS platform user data transmission safe encryption method
CN108462751A (en) * 2018-03-23 2018-08-28 上海地面通信息网络股份有限公司 A kind of reverse proxy system
CN108462751B (en) * 2018-03-23 2023-08-22 上海地面通信息网络股份有限公司 Reverse proxy system
CN109981230A (en) * 2019-03-25 2019-07-05 广东金赋科技股份有限公司 A kind of the business datum upload ensuring equipment and application method of government affairs self-aided terminal
CN113055402A (en) * 2021-03-30 2021-06-29 深圳红途创程科技有限公司 Data transmission control method and device, computer equipment and storage medium
CN113055402B (en) * 2021-03-30 2022-04-12 深圳红途科技有限公司 Data transmission control method and device, computer equipment and storage medium

Similar Documents

Publication Publication Date Title
CN105871520A (en) Data transmission method and device
US10778554B2 (en) Latency measurement in resource requests
US9912740B2 (en) Latency measurement in resource requests
US9185012B2 (en) Latency measurement in resource requests
US9253065B2 (en) Latency measurement in resource requests
CN101448006B (en) Method and system for realizing access for a great amount of terminals for streaming media server
US8448233B2 (en) Dealing with web attacks using cryptographically signed HTTP cookies
US20080175383A1 (en) Method and communication unit for communicating between communication apparatus
US11196833B1 (en) Proxy server synchronizer
CN101662464A (en) System for realizing HTTP request service and method thereof
CN101119385A (en) Method for enhancing HTTP network velocity using WebPush
CN104683313B (en) Multimedia service processing unit, method and system
CN110351379B (en) Communication control method and device, electronic equipment and storage medium
WO2012155994A1 (en) Anonymous signalling
CN102195882A (en) Method and device for selecting route according to data stream application type
CN103166996A (en) Self-adaptation method, device and system of hyper text transport protocol (HTTP) connection and hypertext transfer protocol secure (HTTPS) connection
CN107239308A (en) A kind of calling function realization method and system of browser
CN108737343B (en) Method and device for realizing secure access to network
CN106031097A (en) Service processing method and device
WO2016180284A1 (en) Service node allocation method, device, cdn management server and system
CN105491158A (en) HTTP content reduction method and HTTP content reduction system based on network data flow
CN105376096B (en) A kind of domain name mapping data quality accessment feedback and data optimization methods and system
US7406496B2 (en) System and method for processing callback requests, which include a client port and address, included in web-based procedure calls
CN109446086A (en) A kind of method of App inside packet capturing
CN104468642B (en) Browser rs cache resource prediction method and system, reverse proxy device and browser

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20160817

WD01 Invention patent application deemed withdrawn after publication