CN105657017A - Data transmission method, device and system - Google Patents
Data transmission method, device and system Download PDFInfo
- Publication number
- CN105657017A CN105657017A CN201610003894.9A CN201610003894A CN105657017A CN 105657017 A CN105657017 A CN 105657017A CN 201610003894 A CN201610003894 A CN 201610003894A CN 105657017 A CN105657017 A CN 105657017A
- Authority
- CN
- China
- Prior art keywords
- data
- mark
- demand
- queue
- send
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data transmission method, device and system. A specific embodiment of the data transmission method comprises the following steps: receiving data carrying an identifier sent by at least one data collection server; storing the received data in a local cache; and sending the data in the cache to at least one corresponding data demand end according to a corresponding relation of the preset identifier and the data demand end. The data transmission method in the embodiment is used for reducing the occupation of bandwidth resources, improving the scalability of the program and reducing operation and maintenance costs.
Description
Technical field
The application relates to field of computer technology, is specifically related to data communication technology field, especiallyRelate to data transmission method, device and system.
Background technology
At present, along with the growth of the universal and data volume of internet, Ge great ISP existsEach main cities, the whole nation all can have respectively data center, and each data center is by the number collectingIn the one or more data acquisition servers that deposit in data center. As need send data toDemand data end, each data acquisition server can send the data at least one of correspondence separatelyIndividual demand data end.
But, carry out transfer of data by technique scheme, same data are transmittedRepeatedly, bandwidth resources take larger. And, in the time of newly-increased demand data end, need to be rightAt least one data acquisition server of answering provides new AM access module, therefore technique schemeAlso make the extensibility of calling program poor, O&M cost is higher.
Summary of the invention
The application's object is to propose a kind of data transmission method, device and system, solvesThe technical problem that above background technology part is mentioned.
First aspect, the application provides a kind of data transmission method, and described method comprises: connectReceive the data with mark that at least one data acquisition server sends; By receive eachData are saved in local cache; According to the corresponding pass between default mark and demand data endSystem, sends at least one corresponding demand data end by the data in described buffer memory.
Second aspect, the application provides a kind of data transmission device, and described device comprises: numberAccording to receiving element, the number with mark sending for receiving at least one data acquisition serverAccording to; Data buffer storage unit, for being saved in local cache by each data that receive; NumberAccording to transmitting element, for according to the corresponding relation between default mark and demand data end, incite somebody to actionData in described buffer memory send at least one corresponding demand data end.
The third aspect, the application provides a kind of data transmission system, and described system comprises: extremelyA few data acquisition server and at least one data transfer server; Wherein, described dataTransmission server comprises the data transmission device described in first aspect; Described data acquisition serverComprise data sending device, for the data with mark that receive from acquisition terminal are sentTo data transfer server.
Data transmission method, device and system that the application provides, by will be from least one numberThe data with mark that receive according to acquisition server are saved in local cache, and according in advanceIf mark and demand data end between corresponding relation, the data in local cache are sent toCorresponding demand data end, thus make acquisition server only need transmission primaries data, can be justMultiple demand data ends provide data, have reduced taking of bandwidth resources. Meanwhile, new at needsWhile increasing demand data end, only need arrange and identify the corresponding relation between new data demand end,Without new AM access module is provided at data acquisition server, thus the expanding of the program having improvedMalleability, has reduced O&M cost.
Brief description of the drawings
By read do with reference to the following drawings non-limiting example is done retouch in detailState, it is more obvious that the application's other features, objects and advantages will become:
Fig. 1 is that the application can be applied to exemplary system architecture figure wherein;
Fig. 2 is according to the flow chart of the application's data transmission method embodiment;
Fig. 3 is according to the flow chart of another embodiment of the application's data transmission method;
Fig. 4 is according to the structural representation of the application's data transmission device embodiment;
Fig. 5 shows according to the example arrangement of the application's data transmission system embodimentIntention;
Fig. 6 is data acquisition server or the transfer of data being suitable for for realizing the embodiment of the present applicationThe structural representation of the computer system of server.
Detailed description of the invention
Below in conjunction with drawings and Examples, the application is described in further detail. Be appreciated that, specific embodiment described herein is only for explaining related invention, but not to thisBright restriction. It also should be noted that, for convenience of description, in accompanying drawing, only show withAbout the relevant part of invention.
It should be noted that, in the situation that not conflicting, the embodiment in the application and embodimentIn feature can mutually combine. Describe below with reference to the accompanying drawings and in conjunction with the embodiments this in detailApplication.
Fig. 1 shows data transmission method, data transmission device or the number that can apply the applicationThe reportedly exemplary system architecture 100 of the embodiment of communication system.
As shown in Figure 1, system architecture 100 can comprise data center 101,102,103,Network 104, central data center 105 and demand data end 106,107. Network 104 in order toBetween data center 101,102,103 and central data center 105, central data center105 and demand data end 106,107 between the medium of communication link is provided. Network 104 canComprise various connection types, for example wired, wireless communication link or fiber optic cables etc.
Data center 101,102,103 comprises the data acquisition service of at least one storage dataDevice, mutual by network 104 and central data center 105, to send data etc.
Central data center 105 be generally from each data center relatively close to or in eachThe central data center of data center. Central data center 105 comprises that at least one provides severalAccording to the data transfer server of transmission service. Data transfer server can be to the data that receiveCarry out caching process, and the data of buffer memory are sent to demand data end.
Demand data end 106,107 can be that the data to receiving are carried out off-line analysis, machineStudy and the server calculating in real time, can be also data to receiving show variousElectronic equipment, include but not limited to smart mobile phone, panel computer, pocket computer on knee andDesktop computer.
It should be noted that, the data transmission method that the embodiment of the present application provides is conventionally by dataData transfer server in center 105 is carried out. Correspondingly, data transmission device can arrangeIn data transfer server in data center 105.
Should be appreciated that, data center, central data center, network and data in Fig. 1 needThe number of asking end is only schematic. According to realizing needs, can there is the number of arbitrary numberAccording to center, central data center, network and demand data end.
Continue with reference to figure 2, Fig. 2 shows according to the application's data transmission method realityExecute routine flow process 200.
As shown in Figure 2, the data transmission method of the present embodiment comprises the following steps:
Step 201, receives the data with mark that at least one data acquisition server sends.
In the present embodiment, data transmission method moves electronic equipment (for example Fig. 1 thereonData transfer server in above-mentioned central data center) can pass through wired or wireless sideFormula receives the data with mark that at least one data acquisition server sends. Wherein, above-mentionedData acquisition server can be to be arranged in different pieces of information multiple acquisition servers in the heart. Above-mentionedMark can be which collection project (for example cpu temperature, memory usage) for identification dataData.
It is pointed out that above-mentioned wireless connections mode can include but not limited to 3G/4G connect,WiFi connects, bluetooth connects, WiMAX connects, Zigbee connects, UWB (ultrawideband)Connect and other present wireless connections modes known or that develop in the future.
Step 202, is saved in each data that receive in local cache.
In the present embodiment, electronic equipment can be kept at each data that receive in advance and divideIn the local buffer area of joining. Wherein, buffer memory is the memory that can carry out high-speed data exchange,It is prior to internal memory and CPU swap data, and therefore speed is very fast.
Step 203, according to the corresponding relation between default mark and demand data end, by upperThe data of stating in buffer memory send at least one corresponding demand data end.
In the present embodiment, electronic equipment can be according between default mark and demand data endCorresponding relation, by a each data Replica in buffer memory or many parts, then by former data andThe data that copy send to respectively corresponding demand data end. Wherein, mark and demand data endBetween corresponding relation can be the mapping relations of multi-to-multi, can be in advance by manually arranging,For example arrange by configuration file. Electronic equipment can be by reading above-mentioned corresponding relation (exampleAs obtained above-mentioned corresponding relation by reading configuration file) each data in buffer memory are sent toAt least one demand data end corresponding with data.
In some optional implementations of the present embodiment, step 203 can comprise: determineWhether the data in above-mentioned buffer memory meet following condition: data volume is greater than the first predetermined data volumeThreshold value; The data time of staying is greater than predetermined very first time threshold value; According to default mark and numberAccording to the corresponding relation between demand end, the data that meet in the buffer memory of arbitrary above-mentioned condition are sentTo corresponding demand data end. Wherein, above-mentioned the first data volume threshold value and above-mentioned very first time thresholdValue can be according to the actual requirements by manually arranging. For example, if demand is height, handle up just can be firstData volume threshold value is corresponding with above-mentioned very first time threshold value establishes more greatly; If demand be low delay justVery first time threshold value need to be established a little bit smaller. By this implementation, make electronic equipment slowWhen data in depositing reach a certain amount of, data packing is sent, instead of receiving data at every turnSend, improved data transmission efficiency; Meanwhile, owing to being provided with very first time threshold value, alsoEnsure the real-time of data.
The data transmission method that the present embodiment provides, by serving from least one data acquisitionDevice receive with mark data be saved in local cache, and according to default mark withCorresponding relation between demand data end, sends to corresponding data by the data in local cacheDemand end, thus make acquisition server only need transmission primaries data, can be just that multiple data needAsk end that data are provided, reduced taking of bandwidth resources. Meanwhile, increase demand data newly at needsWhen end, only need arrange and identify the corresponding relation between new data demand end, without countingProvide new AM access module according to acquisition server, thereby the extensibility of the program having improved is fallenLow O&M cost.
Continue with reference to figure 3, Fig. 3 shows according to another of the application's data transmission methodThe flow process 300 of embodiment.
As shown in Figure 3, the data transmission method of the present embodiment comprises the following steps:
Step 301, receives the data with mark that at least one data acquisition server sends.
In the present embodiment, the concrete processing of step 301 can be implemented Fig. 2 is corresponding with reference to above-mentionedIn example, the detailed description of step 201, does not repeat them here.
Step 302, arrives corresponding with the mark of above-mentioned data by each Data dissemination receivingQueue, wherein, each mark is corresponding one by one with each queue.
In the present embodiment, electronic equipment can, according to the quantity of existing mark, be set up respective countsAccording to queue, each mark is corresponding one by one with each queue, then by each data that receiveBe distributed to the queue corresponding with the mark of above-mentioned data.
Step 303, deposits respectively the data in each queue in the in advance buffer memory for queue assignmentQu Zhong.
In the present embodiment, electronic equipment distributes respectively corresponding buffer area for each queue in advance,Then just the data in each queue deposit in respectively in corresponding buffer area. Like this, Mei GehuanWhat deposit district's storage is all the data of same mark.
Step 304, according to mark corresponding to each queue and default mark and demand dataCorresponding relation between end, sends at least one corresponding data by the data in each queueDemand end.
In the present embodiment, electronic equipment can travel through each queue and is handled as follows: readThe corresponding demand data end of mark that queue is corresponding, then by buffer area corresponding queueData packing sends to above-mentioned demand data end.
In some optional implementations of the present embodiment, step 304 can comprise: determineWhether the data in the corresponding buffer area of each queue meet following condition: data volume is greater than in advanceThe first fixed data volume threshold value; The data time of staying is greater than predetermined very first time threshold value; According toCorresponding relation between the mark that queue is corresponding and default mark and demand data end, will expireData in the queue that the buffer area of arbitrary above-mentioned condition is corresponding enough send to corresponding demand dataEnd. The concrete processing of this implementation and the technique effect producing thereof can be with reference to above-mentioned to Fig. 2In corresponding embodiment, the detailed description of corresponding implementation, does not repeat them here.
As can be seen from Figure 3, the embodiment corresponding with Fig. 2 compares, the number in the present embodimentReportedly the flow process 300 of transmission method arrives different queues according to mark by the Data dissemination receivingIn, and according between mark corresponding to each queue and default mark and demand data endCorresponding relation, sends at least one corresponding demand data end by the data in each queue.Thus, electronic equipment can be without traveling through the data of each data with the mark correspondence of reading out dataDemand end, only needs a small amount of several queues of traversal to read the corresponding data of mark corresponding to queueDemand end, and the data packing in buffer area corresponding queue is sent to above-mentioned demand data end,Greatly improve the efficiency of transfer of data.
With further reference to Fig. 4, as the realization to method shown in above-mentioned each figure, the application providesAn a kind of embodiment of data transmission device, the method shown in this device embodiment and Fig. 2Embodiment is corresponding, and this device specifically can be applied in data transfer server.
As shown in Figure 4, the above-mentioned data transmission device 400 of the present embodiment comprises: data receiverUnit 401, data buffer storage unit 402 and data transmission unit 403. Wherein, data receiverUnit 401, the data with mark that send for receiving at least one data acquisition server;Data buffer storage unit 402, for being saved in local cache by each data that receive; NumberAccording to transmitting element 403, for according to the corresponding relation between default mark and demand data end,Data in above-mentioned buffer memory are sent to at least one corresponding demand data end.
In the present embodiment, data receiver unit 401, data buffer storage unit 402 and dataThe concrete processing of transmitting element 403 respectively reference is above-mentioned to step in the corresponding embodiment of Fig. 2201, the detailed description of step 203 and step 203, does not repeat them here.
In some optional implementations of the present embodiment, data transmission unit 403 can be wrappedDraw together: first sends definite subelement 4031, whether meet for the data of determining above-mentioned buffer memoryFollowing condition: data volume is greater than the first predetermined data volume threshold value; The data time of staying is greater than in advanceFixed very first time threshold value; The first data send subelement 4032, for according to default markAnd the corresponding relation between demand data end, by the data that meet in the buffer memory of arbitrary above-mentioned conditionSend to corresponding demand data end. The concrete processing of this implementation and the technology producing thereofEffect can be with reference to the above-mentioned detailed description to corresponding implementation in the corresponding embodiment of Fig. 2, at thisRepeat no more.
In some optional implementations of the present embodiment, data buffer storage unit 402 can wrapDraw together: queue assignment subelement 4021, for by each Data dissemination to the mark of above-mentioned dataCorresponding queue, wherein, each mark is corresponding one by one with each queue; Data buffer storage subelement4022, be in the buffer area of queue assignment in advance for the data of each queue are deposited in respectively.The concrete processing reference respectively of queue assignment subelement 4021 and data buffer storage subelement 4022The above-mentioned detailed description to step 302 and step 303 in the corresponding embodiment of Fig. 3, at this no longerRepeat.
Based on above-mentioned implementation, in some optional implementations of the present embodiment, dataTransmitting element 403 can further be configured for the mark corresponding according to each queue and defaultMark and demand data end between corresponding relation, it is right that the data in each queue are sent toAt least one demand data end of answering. The concrete processing of this implementation can be with reference to above-mentioned to Fig. 3In corresponding embodiment, the detailed description of step 304, does not repeat them here.
And, in some optional implementations of the present embodiment, data transmission unit 403Can comprise: second sends definite subelement (not shown), for determining each queue instituteWhether the data in corresponding buffer area meet following condition: data volume is greater than the second predetermined numberAccording to amount threshold value; The data time of staying is greater than the second predetermined time threshold; Data send subelement(not shown), for according to mark corresponding to queue and default mark and demand dataCorresponding relation between end, by the number in the queue corresponding buffer area that meets arbitrary above-mentioned conditionAccording to sending to corresponding demand data end. Second sends definite subelement and the second data transmissionThe concrete processing of unit and the technique effect producing thereof can be with reference to above-mentioned to the corresponding embodiment of Fig. 3In the detailed description of corresponding implementation, do not repeat them here.
It will be understood by those skilled in the art that above-mentioned data transmission device 400 also comprises some itsHis known features, such as processor, memory etc., for fuzzy reality of the present disclosure unnecessarilyExecute example, these known structures are not shown in Fig. 4.
The data transmission device that the present embodiment provides, connects data by data buffer storage unit 402Receive the preservation of the data with mark that unit 401 receives from least one data acquisition serverIn local cache, and pass through data transmission unit 403 according to default mark and demand dataCorresponding relation between end, sends to corresponding demand data end by the data in local cache,Thereby make acquisition server only need transmission primaries data, just can provide for multiple demand data endsData, have reduced taking of bandwidth resources. Meanwhile, in the time that needs increase demand data end newly, onlyNeed arrange and identify the corresponding relation between new data demand end, without taking in data acquisitionBusiness device provides new AM access module, thereby the extensibility of the program having improved has reduced O&MCost.
With further reference to Fig. 5, the application also provides a kind of enforcement of data transmission systemExample.
As shown in Figure 5, the data transmission system 500 of the present embodiment comprises: data acquisition serviceDevice 501 and data transfer server 502. Wherein, data acquisition server 501 comprises dataDispensing device 5011, for sending to number by the data with mark that receive from acquisition terminalAccording to transmission server; Data transfer server 502 comprises that embodiment as corresponding in Fig. 4 providesData transmission device 5021.
It should be noted that, data acquisition server 501 can be arranged in the data shown in Fig. 1In the heart 101,102,103, data transfer server 502 can be positioned at the central authorities shown in Fig. 1In data center 105.
And data acquisition server 501 and the data transfer server 502 of the present embodiment canThink one or more, the data acquisition server in Fig. 5 and the number of data transfer serverOnly schematic. According to realizing needs, can there is the data acquisition service of arbitrary numberDevice and data transfer server.
In some optional implementations of the present embodiment, data sending device 5011 can wrapDraw together: data receiver unit (not shown), for receive data collection station send withThe data of mark; Data buffer storage unit (not shown), for depositing above-mentioned data in collectionIn the local cache of server; Send determining unit (not shown), for determining above-mentionedWhether the data in ground buffer memory meet following condition: data volume is greater than predetermined data volume threshold value;The data time of staying is greater than predetermined time threshold value; Data transmission unit (not shown), usesIn determining that in above-mentioned transmission determining unit the data in above-mentioned local cache meet arbitrary above-mentioned conditionTime, the data that send in above-mentioned local cache arrive above-mentioned data transfer server.
In some optional implementations of the present embodiment, data sending device 5011 is all rightComprise: persistence unit (not shown), when sending unsuccessfully in data transmission unit,By the data persistence of above-mentioned transmission failure in the local disk of acquisition server; Write-back is determinedUnit (not shown), for determining that above-mentioned data pass in real time or every scheduled time lengthWhether whether defeated server serves normal and above-mentioned local cache enough residual capacities; NumberAccording to write-back unit (not shown), for determine above-mentioned transfer of data clothes in write-back determining unitWhen normal the and above-mentioned local cache of business device service has enough residual capacities, by above-mentioned diskData be written back in above-mentioned local cache. By this implementation, make data acquisition serviceDevice 501, in the time that data send unsuccessfully, still can ensure the integrality of data.
In some optional implementations of the present embodiment, data sending device 5011 is all rightComprise data compression unit (not shown), for send above-mentioned this locality in data transmission unitBefore data in buffer memory arrive above-mentioned data transfer server, by the data in above-mentioned local cacheCompression. Thereby reduce data traffic, more reduced taking of bandwidth resources.
Below with reference to Fig. 6, it shows the data acquisition being suitable for for realizing the embodiment of the present applicationThe structural representation of the computer system 600 of server and data transfer server.
As shown in Figure 6, computer system 600 comprises CPU (CPU) 601, itsCan be according to being stored in program in read-only storage (ROM) 602 or from storage area 608Be loaded into the program in random access storage device (RAM) 603 and carry out various suitable actionsAnd processing. In RAM603, also store system 600 and operate required various programs and numberAccording to. CPU601, ROM602 and RAM603 are connected with each other by bus 604. Input/ output (I/O) interface 605 is also connected to bus 604.
Be connected to I/O interface 605 with lower component: the importation 606 that comprises keyboard, mouse etc.;Comprise such as cathode-ray tube (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.Output 607; Comprise the storage area 608 of hard disk etc.; And comprise such as LAN card,The communications portion 609 of the NIC of modem etc. Communications portion 609 via such asThe network executive communication processing of internet. Driver 610 is also connected to I/O interface as required605. Detachable media 611, such as disk, CD, magneto-optic disk, semiconductor memory etc.,Be arranged on as required on driver 610, so that the computer program basis of reading from itNeed to be mounted into storage area 608.
Especially, according to embodiment of the present disclosure, the process that above reference flow sheet is described canBe implemented as computer software programs. For example, embodiment of the present disclosure comprises a kind of computer journeyOrder product, it comprises the computer program being visibly included on machine readable media, described meterCalculation machine program package is containing the program code for the method shown in flowchart. In such enforcementIn example, this computer program can be downloaded and installed from network by communications portion 609,And/or be mounted from detachable media 611.
Flow chart in accompanying drawing and block diagram, illustrate according to the system of the various embodiment of the application,Architectural framework in the cards, function and the operation of method and computer program product. This pointUpper, the each square frame in flow chart or block diagram can represent module, program segment or a codeA part, a part for described module, program segment or code comprise one or more forRealize the executable instruction of the logic function of regulation. Also it should be noted that at some as an alternativeIn realization, the order that the function marking in square frame also can be marked to be different from accompanying drawing is sent outRaw. For example, in fact the square frame that two adjoining lands represent can be carried out substantially concurrently, theySometimes also can carry out by contrary order, this determines according to related function. Also to noteBe, the square frame in each square frame and block diagram and/or flow chart in block diagram and/or flow chartCombination, can realize by the special hardware based system of the function putting rules into practice or operation,Or can realize with the combination of specialized hardware and computer instruction.
Being described in unit involved in the embodiment of the present application can be real by the mode of softwareExisting, also can realize by the mode of hardware. Described unit also can be arranged on processingIn device, for example, can be described as: a kind of processor comprises data receiver unit, data buffer storageUnit and data transmission unit. Wherein, the title of these unit structure not under certain conditionsThe restriction of this unit itself in pairs, for example, data receiver unit can also be described to " receiveThe unit of the data that acquisition terminal sends ".
As on the other hand, the application also provides a kind of non-volatile computer storage medium,This non-volatile computer storage medium can be in device, to comprise described in above-described embodimentNon-volatile computer storage medium; Also can be individualism, be unkitted and allocate non-in terminal intoVolatibility computer-readable storage medium. Above-mentioned non-volatile computer storage medium stores have one orThe multiple programs of person, in the time that described one or more program is carried out by an equipment, described in makingEquipment: receive the data with mark that at least one data acquisition server sends; To receiveTo each data be saved in local cache; Between default mark and demand data endCorresponding relation, the data in described buffer memory are sent to at least one corresponding demand data end.
More than describing is only the application's preferred embodiment and saying institute's application technology principleBright. It will be appreciated by those skilled in the art that invention scope related in the application, do not limitThe technical scheme forming in the particular combinations of above-mentioned technical characterictic, also should be encompassed in and not depart from simultaneouslyIn the situation of described inventive concept, be combined by above-mentioned technical characterictic or its equivalent featureAnd other technical scheme forming. For example, in above-mentioned feature and the application disclosed (but being not limited to)The technical characterictic with similar functions is replaced mutually and the technical scheme that forms.
Claims (14)
1. a data transmission method, is characterized in that, described method comprises:
Receive the data with mark that at least one data acquisition server sends;
Each data that receive are saved in local cache;
According to the corresponding relation between default mark and demand data end, by described buffer memoryData send at least one corresponding demand data end.
2. method according to claim 1, is characterized in that, the mark that described basis is defaultKnow with demand data end between corresponding relation, by the data in described buffer memory send to correspondenceAt least one demand data end, comprising:
Determine whether the data in described buffer memory meet following condition: data volume is greater than predeterminedOne data volume threshold value; The data time of staying is greater than predetermined very first time threshold value;
According to the corresponding relation between default mark and demand data end, will meet arbitrary described inThe data of the buffer memory of condition send to corresponding demand data end.
3. method according to claim 1, is characterized in that, described by each data guarantorDeposit with local cache in, comprising:
Each Data dissemination is arrived to the queue corresponding with the mark of described data, wherein, each markKnow corresponding one by one with each queue;
It is in the buffer area of queue assignment in advance that data in each queue are deposited in respectively.
4. method according to claim 3, is characterized in that, the mark that described basis is defaultKnow with demand data end between corresponding relation, by the data in described buffer memory send to correspondenceAt least one demand data end, comprising:
Right according between mark corresponding to each queue and default mark and demand data endShould be related to, the data in each queue are sent to at least one corresponding demand data end.
5. method according to claim 4, is characterized in that, described according to each queueCorresponding relation between corresponding mark and default mark and demand data end, by each teamData in row send at least one corresponding demand data end, comprising:
Determine whether the data in the corresponding buffer area of each queue meet following condition: dataAmount is greater than the second predetermined data volume threshold value; The data time of staying is greater than the second predetermined time thresholdValue;
According to the corresponding pass between mark corresponding to queue and default mark and demand data endSystem, sends to the data in the queue corresponding buffer area that meets arbitrary described condition correspondingDemand data end.
6. a data transmission device, is characterized in that, described device comprises:
Data receiver unit, for receive that at least one data acquisition server sends with markThe data of knowing;
Data buffer storage unit, for being saved in local cache by each data that receive;
Data transmission unit, for according to the corresponding pass between default mark and demand data endSystem, sends at least one corresponding demand data end by the data in described buffer memory.
7. device according to claim 6, is characterized in that, described data transmission unitComprise:
Whether first sends definite subelement, meet as follows for the data of determining described buffer memoryCondition: data volume is greater than the first predetermined data volume threshold value; The data time of staying is greater than predeterminedVery first time threshold value;
The first data send subelement, for according between default mark and demand data endCorresponding relation, sends to corresponding data need by the data that meet in the buffer memory of arbitrary described conditionAsk end.
8. device according to claim 6, is characterized in that, described data buffer storage unitComprise:
Queue assignment subelement, for arriving corresponding with the mark of described data by each Data disseminationQueue, wherein, each mark is corresponding one by one with each queue;
Data buffer storage subelement is queue for the data of each queue are deposited in respectively in advanceIn the buffer area distributing.
9. device according to claim 8, is characterized in that, described data transmission unitFurther be configured for the mark corresponding according to each queue and default mark and demand dataCorresponding relation between end, sends at least one corresponding data by the data in each queueDemand end.
10. device according to claim 9, is characterized in that, described data send singleUnit comprises:
Second sends definite subelement, for determining the number of the corresponding buffer area of each queueAccording to whether meeting following condition: data volume is greater than the second predetermined data volume threshold value; Data stopTime is greater than the second predetermined time threshold;
The second data send subelement, for according to mark corresponding to queue and default markAnd the corresponding relation between demand data end, by corresponding the buffer area that meets arbitrary described conditionData in queue send to corresponding demand data end.
11. 1 kinds of data transmission systems, is characterized in that, described system comprises: data acquisitionServer and data transfer server;
Wherein, described data acquisition server comprises data sending device, for will be from gathering endThe data with mark that termination is received send to data transfer server;
Described data transfer server comprises the arbitrary described transfer of data dress of claim 6-10Put.
12. systems according to claim 11, is characterized in that, described data send dressPut and comprise:
Data receiver unit, the data with mark that send for receiving data collection station;
Data buffer storage unit, for depositing described data in the local cache of acquisition server;
Send determining unit, whether meet following bar for the data of determining described local cachePart: data volume is greater than predetermined data volume threshold value; The data time of staying is greater than predetermined time thresholdValue;
Data transmission unit, for determining described local cache in described transmission determining unitWhen data meet arbitrary described condition, the data that send in described local cache pass to described dataDefeated server.
13. systems according to claim 12, is characterized in that, described data send dressAlso put and comprise:
Persistence unit, when sending unsuccessfully in data transmission unit, sends unsuccessfully describedData persistence in the local disk of acquisition server;
Write-back determining unit, for determining that described data pass in real time or every scheduled time lengthWhether whether defeated server serves normal and described local cache enough residual capacities;
Data write-back unit, for determining described data transfer server clothes in write-back determining unitWhen normal the and described local cache of doing honest work has enough residual capacities, by the data in described diskBe written back in described local cache.
14. systems according to claim 12, is characterized in that, described data send dressAlso put and comprise: data compression unit, for send described local cache in data transmission unitData to before described data transfer server, by the data compression in described local cache.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610003894.9A CN105657017A (en) | 2016-01-04 | 2016-01-04 | Data transmission method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610003894.9A CN105657017A (en) | 2016-01-04 | 2016-01-04 | Data transmission method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105657017A true CN105657017A (en) | 2016-06-08 |
Family
ID=56491677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610003894.9A Pending CN105657017A (en) | 2016-01-04 | 2016-01-04 | Data transmission method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105657017A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407307A (en) * | 2016-08-31 | 2017-02-15 | 天津南大通用数据技术股份有限公司 | Interaction method and interaction device for node data of distributed database |
| CN107426307A (en) * | 2017-07-11 | 2017-12-01 | 北京潘达互娱科技有限公司 | Data processing method and device |
| CN109547363A (en) * | 2018-11-13 | 2019-03-29 | 中广核核电运营有限公司 | Data transmission method, device, computer equipment and storage medium |
| CN109982009A (en) * | 2019-03-21 | 2019-07-05 | 深兰科技（上海）有限公司 | A kind of method and device of image data long distance transmission |
| CN111478884A (en) * | 2020-03-06 | 2020-07-31 | 视联动力信息技术股份有限公司 | Method, device and storage medium for data transmission among different video networks |
| CN112684878A (en) * | 2020-12-24 | 2021-04-20 | 维沃移动通信（杭州）有限公司 | Data transmission method and electronic equipment |
| CN112770356A (en) * | 2021-01-06 | 2021-05-07 | 维沃移动通信有限公司 | Data transmission method and electronic equipment |
| WO2021223110A1 (en) * | 2020-05-06 | 2021-11-11 | 深圳市大疆创新科技有限公司 | Data processing apparatus and method, medium, computer device, and mobile device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101056250A (en) * | 2007-04-12 | 2007-10-17 | 中控科技集团有限公司 | Method and system for operation and management of real time information |
| CN101079760A (en) * | 2007-07-27 | 2007-11-28 | 华为技术有限公司 | Method, system and content distribution network for monitoring network |
| CN102768667A (en) * | 2011-05-06 | 2012-11-07 | 腾讯科技（北京）有限公司 | Method and system for releasing pushed information |
| CN102917026A (en) * | 2012-09-20 | 2013-02-06 | 中国联合网络通信集团有限公司 | Method, equipment and system for subscribing information of internet of things |
| CN203164734U (en) * | 2013-03-29 | 2013-08-28 | 北京经纬恒润科技有限公司 | Data acquisition and monitoring system |
| US20140280673A1 (en) * | 2013-03-15 | 2014-09-18 | Schweitzer Engineering Laboratories, Inc. | Systems and methods for communicating data state change information between devices in an electrical power system |
| CN104468399A (en) * | 2014-12-08 | 2015-03-25 | 北京奇虎科技有限公司 | Data transmission method and device and server |
-
2016
- 2016-01-04 CN CN201610003894.9A patent/CN105657017A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101056250A (en) * | 2007-04-12 | 2007-10-17 | 中控科技集团有限公司 | Method and system for operation and management of real time information |
| CN101079760A (en) * | 2007-07-27 | 2007-11-28 | 华为技术有限公司 | Method, system and content distribution network for monitoring network |
| CN102768667A (en) * | 2011-05-06 | 2012-11-07 | 腾讯科技（北京）有限公司 | Method and system for releasing pushed information |
| CN102917026A (en) * | 2012-09-20 | 2013-02-06 | 中国联合网络通信集团有限公司 | Method, equipment and system for subscribing information of internet of things |
| US20140280673A1 (en) * | 2013-03-15 | 2014-09-18 | Schweitzer Engineering Laboratories, Inc. | Systems and methods for communicating data state change information between devices in an electrical power system |
| CN203164734U (en) * | 2013-03-29 | 2013-08-28 | 北京经纬恒润科技有限公司 | Data acquisition and monitoring system |
| CN104468399A (en) * | 2014-12-08 | 2015-03-25 | 北京奇虎科技有限公司 | Data transmission method and device and server |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407307A (en) * | 2016-08-31 | 2017-02-15 | 天津南大通用数据技术股份有限公司 | Interaction method and interaction device for node data of distributed database |
| CN107426307A (en) * | 2017-07-11 | 2017-12-01 | 北京潘达互娱科技有限公司 | Data processing method and device |
| CN109547363A (en) * | 2018-11-13 | 2019-03-29 | 中广核核电运营有限公司 | Data transmission method, device, computer equipment and storage medium |
| CN109982009A (en) * | 2019-03-21 | 2019-07-05 | 深兰科技（上海）有限公司 | A kind of method and device of image data long distance transmission |
| CN109982009B (en) * | 2019-03-21 | 2021-05-11 | 深兰科技（上海）有限公司 | Method and device for long-distance transmission of image data |
| CN111478884A (en) * | 2020-03-06 | 2020-07-31 | 视联动力信息技术股份有限公司 | Method, device and storage medium for data transmission among different video networks |
| CN111478884B (en) * | 2020-03-06 | 2022-11-15 | 视联动力信息技术股份有限公司 | Method, device and storage medium for data transmission among different video networks |
| WO2021223110A1 (en) * | 2020-05-06 | 2021-11-11 | 深圳市大疆创新科技有限公司 | Data processing apparatus and method, medium, computer device, and mobile device |
| CN112684878A (en) * | 2020-12-24 | 2021-04-20 | 维沃移动通信（杭州）有限公司 | Data transmission method and electronic equipment |
| CN112684878B (en) * | 2020-12-24 | 2022-09-30 | 维沃移动通信（杭州）有限公司 | Data transmission method and electronic equipment |
| CN112770356A (en) * | 2021-01-06 | 2021-05-07 | 维沃移动通信有限公司 | Data transmission method and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105657017A (en) | Data transmission method, device and system | |
| CN108009028A (en) | Message treatment method, device, equipment and computer-readable recording medium | |
| CN106034330A (en) | Mobile terminal flow processing method based on content distribution network, apparatus and system thereof | |
| CN104079630A (en) | Business server side load balancing method, client side, server side and system | |
| CN107844524A (en) | Data processing method, data processing equipment, computer equipment and storage medium | |
| CN107636722A (en) | For the management method and management server using multiple SIM card | |
| CN107819891A (en) | Data processing method, device, computer equipment and storage medium | |
| CN104519036A (en) | Method and device for sending service request message | |
| CN105309029B (en) | Distribution is for virtualizing the shared resource of networking | |
| CN101594259A (en) | Terminating apparatus management system and interface arrangement and correlation method, recording medium | |
| CN105656964B (en) | The implementation method and device of data-pushing | |
| JP7097427B2 (en) | Data processing system and data processing method | |
| CN108173782A (en) | The method, apparatus and storage medium of transmitting data stream in virtual private cloud | |
| CN104468408A (en) | Method for adjusting dynamically service bandwidth and control center server | |
| CN103929377A (en) | Wired network and wireless network combined dispatching method and system and related devices | |
| CN106412043A (en) | CDN flow guide method and device | |
| CN110365508A (en) | The method and network function of virtual network function instantiation virtualize composer | |
| CN103368872A (en) | Data packet forwarding system and method | |
| US7168043B2 (en) | Apparatus and system for communication | |
| CN103796191A (en) | Method, device and terminal for sending data to user terminal | |
| CN109804612A (en) | Method and apparatus for being communicated between user equipment | |
| CN109525633A (en) | Block chain network, the message transmission based on block chain network, message receival method | |
| CN101621530B (en) | Method and device for dispatching load balancing network resource based on light path share | |
| CN103560937A (en) | Data accessing method and entry server | |
| KR101264951B1 (en) | Device for intercepting and analyzing traffic for a terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160608 |
|
| RJ01 | Rejection of invention patent application after publication |