CN108199856A - Data transmission method for uplink, device, computer node and storage medium - Google Patents

Data transmission method for uplink, device, computer node and storage medium Download PDF

Info

Publication number
CN108199856A
CN108199856A CN201711252540.9A CN201711252540A CN108199856A CN 108199856 A CN108199856 A CN 108199856A CN 201711252540 A CN201711252540 A CN 201711252540A CN 108199856 A CN108199856 A CN 108199856A
Authority
CN
China
Prior art keywords
node
data
demand
common data
demand information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711252540.9A
Other languages
Chinese (zh)
Inventor
高睿
于福超
贾宏超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Neusoft Corp
Original Assignee
Neusoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Neusoft Corp filed Critical Neusoft Corp
Priority to CN201711252540.9A priority Critical patent/CN108199856A/en
Publication of CN108199856A publication Critical patent/CN108199856A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/185Arrangements for providing special services to substations for broadcast or conference, e.g. multicast with management of multicast group membership
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks

Abstract

The invention discloses a kind of data transmission method for uplink, device, computer node and storage mediums, can save the Internet resources for transmitting common data between node in a distributed system.The method is applied to distributed system, and the distributed system includes host node and multiple from node, the method includes:The host node receives the multiple common data demand information sent from least one of node from node;The host node sends corresponding common data according to the common data demand information to the slave node for having demand data.

Description

Data transmission method for uplink, device, computer node and storage medium
Technical field
The present invention relates to field of computer technology, and in particular, to a kind of data transmission method for uplink, device, computer node And storage medium.
Background technology
Distributed system can connect multiple stage computers using network, and big data Computational frame can be applied to point In cloth system, for example, Hadoop (a kind of compartment system architecture), a kind of Spark (Distributed Calculation frames based on memory Frame), etc..
In a distributed system, in order to handle the data of larger data amount, can execution part task be distinguished by each node, most The processing to mass data is realized eventually, so when having common variable or data, host node would generally be directly copied to often A calculate node, i.e., by broadcasting variable, effectively to the copy of each one big data quantity input set of node.
However, to respectively from the common variable of node broadcasts or data, needing common data copying to each calculating section On point, more Internet resources can be occupied, meanwhile, to each for node, more memory is needed to go to store the institute received There is common data, cause the waste of memory space, also reduce the efficiency of data processing.
Invention content
The object of the present invention is to provide a kind of data transmission method for uplink, device, computer node and storage mediums, can save For transmitting the resource of common data between node.
It is according to embodiments of the present invention in a first aspect, provide a kind of data transmission method for uplink, it is described applied to distributed system Distributed system includes host node and multiple from node, including:
The host node receives the multiple common data demand information sent from least one of node from node;
The host node is sent corresponding public according to the common data demand information to the slave node for having demand data Data.
Optionally, the host node is according to the common data demand information, to the slave node transmission pair for having demand data The common data answered, including:
The host node has each from the required number of node of demand data according to the common data demand information, statistics According to;
The host node sends corresponding common data in a manner of multicast to the slave node for having demand data.
Optionally, the multiple common data sent from least one of node from node is received in the host node It is further included before demand information:
It is the multiple to send the public affairs from node to the host node by following steps from node from any in node Demand data information altogether:
In the process of running, it detects whether to lack the common data needed for operation;
Detect lack the common data needed for operation when, the title of the common data of demand and data type are recorded It is somebody's turn to do from the demand data table of node to described;
According to demand data table, according to this from the corresponding predetermined period of node, periodically being sent to the host node should From the common data demand information of node.
Optionally, the host node receives the multiple common data sent from least one of node from node and needs Information is sought, including:
The host node receives respectively the multiple each to be sent out from node from node according to corresponding predetermined period The common data demand information sent, wherein, the common data demand information that the slave node of no data demand is sent is used to indicate this From node no data demand;
The host node is sent corresponding public according to the common data demand information to the slave node for having demand data Data, including:
The host node is after the common data demand information all sent from node is received, according to described all from section The common data demand information that point is sent sends corresponding common data to the slave node for having demand data.
Optionally, the multiple common data sent from least one of node from node is received in the host node It is further included before demand information:
It is the multiple to send the public affairs from node to the host node by following steps from node from any in node Demand data information altogether:
In the process of running, it detects whether to lack the common data needed for operation;
Detect lack operation needed for common data when, the title and data type of common data according to demand, The common data demand information from node is sent to the host node.
Optionally, the host node receives the multiple common data sent from least one of node from node and needs Information is sought, including:
The host node receives the multiple at least one public number sent from node for having demand data from node According to demand information;
The host node is sent corresponding public according to the common data demand information to the slave node for having demand data Data, including:
The common data demand information received is recorded in demand data statistical form the host node;
The host node is according to setting period and the demand data statistical form, periodically to the slave section for having demand data Point sends corresponding common data.
Second aspect according to embodiments of the present invention provides a kind of data sending device, applied in distributed system Host node, the distributed system include the host node and multiple from node, and described device includes:
Receiving module, for receiving the multiple common data demand letter sent from least one of node from node Breath;
Sending module, for according to the common data demand information, being sent to the slave node for having demand data corresponding Common data.
Optionally, the sending module includes:
Statistical module, for according to the common data demand information, statistics to have each required from node of demand data Data;
First sending submodule, for sending corresponding public number to the slave node for having demand data in a manner of multicast According to.
Optionally, the receiving module includes:
First receiving submodule, for receive respectively it is the multiple from node each from node according to corresponding pre- If the common data demand information that the period sends, wherein, the common data demand information that the slave node of no data demand is sent is used It should be from node no data demand in instruction;
The sending module further includes:
Second sending submodule, for after the common data demand information all sent from node is received, according to institute The common data demand information all sent from node is stated, corresponding common data is sent to the slave node for having demand data.
Optionally, the receiving module further includes:
Second receiving submodule has at least one of demand data to be sent from node for receiving the multiple from node Common data demand information;
The sending module further includes:
Logging modle, for the common data received demand information to be recorded in demand data statistical form;
Third sending submodule, for according to the setting period and demand data statistical form, periodically to there is data The slave node of demand sends corresponding common data.
The third aspect according to embodiments of the present invention provides a kind of data sending device, applied in distributed system It is any from node, the distributed system includes the host node and multiple from node, and described device includes:
Detection module, for from node operational process, detecting whether to lack the common data needed for operation;
Logging modle, for detect lack operation needed for common data when, by the title of the common data of demand And described be somebody's turn to do from the demand data table of node is recorded in data type;
Sending module, for according to demand data table, according to this from the corresponding predetermined period of node, periodically to described Host node sends the common data demand information from node.
Fourth aspect according to embodiments of the present invention provides a kind of data sending device, applied in distributed system It is any from node, the distributed system includes the host node and multiple from node, and described device includes:
Detection module, for from node operational process, detecting whether to lack the common data needed for operation;
Sending module, for detect lack operation needed for common data when, the name of common data according to demand Title and data type, the common data demand information from node is sent to the host node.
Fourth aspect according to embodiments of the present invention, provides a kind of computer node, and the computer node is distribution Host node in system, the distributed system include the computer node and multiple from node, the computer node packet It includes:
Non-transitorycomputer readable storage medium;And
One or more processor, for performing the program in the non-transitorycomputer readable storage medium;Institute It states and is stored with to perform in first aspect applied to the method for host node side in non-transitorycomputer readable storage medium Instruction.
5th aspect according to embodiments of the present invention, provides a kind of computer node, and the computer node is distribution Any from node in system, the distributed system includes the computer node and multiple from node, the computer section Point includes:
Non-transitorycomputer readable storage medium;And
One or more processor, for performing the program in the non-transitorycomputer readable storage medium;Institute It states to be stored in non-transitorycomputer readable storage medium and be applied in first aspect from the method for node side for performing Instruction.
6th aspect according to embodiments of the present invention, provides a kind of non-transitorycomputer readable storage medium, described non- Provisional computer readable storage medium includes one or more programs, and one or more of programs are for performing above-mentioned the One side any one of them method.
Through the above technical solutions, the host node of distributed system can receive at least one public number sent from node According to demand information, then information according to demand, being sent to the slave node for having demand data should be from the required common data of node. In this way, only when there is the demand of common data from node, host node can just send common data, without the mode of broadcast Common data is sent from node to each, achievees the purpose that save network transmission resource, meanwhile, for from node, Unwanted common data need not be stored, has saved memory space, improves the ability of data processing.
Other features and advantages of the present invention will be described in detail in subsequent specific embodiment part.
Description of the drawings
Attached drawing is to be used to provide further understanding of the present invention, and a part for constitution instruction, with following tool Body embodiment is used to explain the present invention, but be not construed as limiting the invention together.In the accompanying drawings:
Fig. 1 is the schematic diagram according to a kind of distributed system shown in an exemplary embodiment;
Fig. 2 is the flow chart according to a kind of data transmission method for uplink shown in an exemplary embodiment;
Fig. 3 is the block diagram according to a kind of data sending device shown in an exemplary embodiment;
Fig. 4 is the block diagram according to a kind of data sending device shown in an exemplary embodiment;
Fig. 5 is the block diagram according to a kind of data sending device shown in an exemplary embodiment.
Specific embodiment
The specific embodiment of the present invention is described in detail below in conjunction with attached drawing.It should be understood that this place is retouched The specific embodiment stated is merely to illustrate and explain the present invention, and is not intended to restrict the invention.
First, the implementation environment of the disclosure is illustrated, refers to Fig. 1, Fig. 1 is shows according to an exemplary embodiment A kind of distributed system schematic diagram, system includes a host node 100 and multiple for node 101 to Fig. 1 in a distributed manner.It is main Node 100 can be connect by network with multiple from node 101, respectively can also pass through network connection (figure between each other from node 101 In do not illustrate).In a distributed system, host node 100 is equivalent to leader, is responsible for scheduler task, metadata management, safeguards text The work such as part storage mapping relationship.Respectively then it is responsible for completing the task that host node 100 is dispatched from node 101.
Fig. 1 is according to a kind of flow chart of data transmission method for uplink shown in an exemplary embodiment, as shown in Figure 1, the number It can be applied in distributed system according to sending method, which includes host node and multiple from node, this method packet Include following steps.
Step S11:Host node receives multiple common data demand informations sent from least one of node from node;
Step S12:Host node is sent corresponding public according to common data demand information to the slave node for having demand data Data.
In the embodiment of the present disclosure, data transmission method for uplink can be applied to arbitrarily transmit common data by the way of broadcast The distributed system of (common data between some nodes such as global variable).Host node (such as host node 100 shown in FIG. 1) can To receive multiple common data demands sent from least one of node (such as shown in FIG. 1 from node 101) from node Information, then according to the common data demand information received, need to only be sent to the slave node for having demand data should need from node The common data asked.In this way, the mode without broadcast sends common data to each from node, reach and save network biography The purpose of defeated resource, meanwhile, for from node, without unwanted common data is stored, memory space is saved, has been carried The high ability of data processing.
Optionally, host node is sent corresponding public according to common data demand information to the slave node for having demand data Data, can be host node first according to common data demand information, statistics has each from the required data of node of demand data, Then in a manner of multicast corresponding common data is sent to the slave node for having demand data.
The mode of multicast realizes point-to-point configuration between sender's (host node) and each recipient (from node) Connection.If a sender transmits identical data to multiple recipients simultaneously, a identical data also need to be only replicated Packet.Such mode improves data-transmission efficiency, reduces backbone network and the possibility of congestion occurs.
For example, including data 1, data 2 from the common data of 1 demand of node, include number from the common data of 2 demand of node According to 2, data 3, include data 1, data 3 from the common data of 3 demand of node.So host node to respectively from the demand of node into After row statistics, common data is distributed in a manner of multicast, i.e., in transmission data 1, is only copied to from node 1 and from node 3, with This analogizes, and so as to reduce network flow, saves Internet resources.
For realizing each host node to the mode of the corresponding common data of slave node transmission for having demand data, disclosure reality It applies example not limit, as long as distribution common data can be corresponded to according to from the demand of node.It below will be to possible mode It illustrates.
First way:
Optionally, multiple common data demand informations sent from least one of node from node are received in host node Before, it is multiple to send the common data from node to host node by following steps from node from any in node and need Seek information:In the process of running, it detects whether to lack the common data needed for operation;Detect lack operation needed for it is public During data, the title of the common data of demand and data type are recorded in the demand data table from node;According to data Demand schedule according to this from the corresponding predetermined period of node, periodically sends the common data demand from node to host node Information.
Optionally, host node can receive respectively it is multiple from node each from node according to corresponding predetermined period The common data demand information of transmission, wherein, the common data demand information that the slave node of no data demand is sent is used to indicate It should be from node no data demand.Then after the common data demand information all sent from node is received, according to all from The common data demand information that node is sent sends corresponding common data to the slave node for having demand data.
In other words, it is multiple can respectively be scanned in the process of running from node and count needs common data (such as Global variable etc.), then when detecting common data in need, it can be stored in demand data table, there is no needs During the situation of common data, then demand schedule is not updated the data.It is (different to be set not from node according to respective predetermined period With or identical predetermined period, the embodiment of the present disclosure do not limit) give host node send common data demand information.At some When reaching from the node period and having the common data of demand, can be sent to host node required common data title (or Mark), the information such as data type (for example can also send the IP address from node, know it which is from section so as to host node Point send information), if some from node when reaching in the period, also can be to main section even if there be no the common data of demand Point sends common data demand information, for example sends an empty table, is used to refer to no demand data.In this way, host node Whether respectively from node need common data and need which common data, be conducive to if being known by common data demand information Distribute common data further according to demand, simultaneously as also having sent the type of the common data of demand, be conducive to transmit During data, the compression of data can be carried out according to data type, and then reduces the load of network transmission.
Host node (certainly, public affairs that some is sent from node after all common data demand informations from node are received Data information may be sky altogether, then should be from node no data demand), according still further to respectively from the demand of node, progress common data Distribution.
The second way:
Optionally, multiple common data demand informations sent from least one of node from node are received in host node Before, it is multiple to send the common data demand from node to host node by following steps from node from any in node and believe Breath:In the process of running, it detects whether to lack the common data needed for operation;Lack the required common data of operation detecting When, the title and data type of common data according to demand send the common data demand information from node to host node.
Optionally, host node can receive it is multiple have from node demand data it is at least one sent from node it is public Then demand data information the common data demand information received is recorded in demand data statistical form, further according to setting Period and demand data statistical form periodically send corresponding common data to the slave node for having demand data.
In other words, multiple common datas that equally can scan and count needs in respective operational process from node, When having detected common data demand, common data demand information just is sent to host node, for example send the public number of demand According to title (or mark), the information such as data type, do not sent then without demand.Host node often receives a demand data letter Breath, is just recorded, for example be recorded in demand data statistical form, as soon as then unite every the setting period according to demand data The information counted in meter table sends the common data from node demand to the slave node for having demand data.
Respectively from the demand data of node and reduce data transmission in the above manner, can meet in distributed system Amount alleviates network load, saves Internet resources, meanwhile, for from node, it need to only store the common data of respective demand , without being stored to the common data not used, saved memory space.
The technical solution of the embodiment of the present disclosure will be illustrated by complete embodiment below.
1st, it is respectively scanned respectively from node and counts the common data of needs or the information of global variable.It generates shown in table 1 Demand data table:
1. demand data table of table
Data Type Node IP
A Int 10.4.130.4
B List 10.4.130.4
C String 10.4.130.4
The public number that this table be node IP address is what 10.4.130.4 was generated, is needed can be seen that by table above According to for A, B, C, and have recorded the data type of each data.
2 and then the host node for holding these variables is issued by network.
3rd, it when host node is connected to these demands, can be recorded in demand data statistical form, as shown in table 2:
2. demand data statistical form of table
Data Data type Node IP
A Int 10.4.130.4
B List 10.4.130.4
B List 10.4.130.5
C String 10.4.130.4
C String 10.4.130.5
C String 10.4.130.6
D Double 10.4.130.5
E Class 10.4.130.6
E Class 10.4.130.4
When host node will send out variable, demand data statistical form can be inquired, variable is distributed in the form of multicast, as above Table when sending out variable B only to 10.4.130.4 and 10.4.130.5, and then reduces network flow.
Fig. 3 is referred to, based on same inventive concept, the embodiment of the present disclosure provides a kind of data sending device 300, is applied to Host node in distributed system, distributed system include host node and multiple from node, which includes:
Receiving module 301, for receiving multiple common data demand letters sent from least one of node from node Breath;
Sending module 302, for according to common data demand information, corresponding public affairs to be sent to the slave node for having demand data Data altogether.
Optionally, sending module 302 includes:
Statistical module, for according to common data demand information, statistics to have each from the required number of node of demand data According to;
First sending submodule, for sending corresponding public number to the slave node for having demand data in a manner of multicast According to.
Optionally, receiving module 301 includes:
First receiving submodule, for receive respectively it is multiple from node each from node according to corresponding default week The common data demand information that phase sends, wherein, the common data demand information that the slave node of no data demand is sent is used to refer to Show this from node no data demand;
Sending module 302 further includes:
Second sending submodule, for after the common data demand information all sent from node is received, according to complete The common data demand information that portion is sent from node sends corresponding common data to the slave node for having demand data.
Optionally, receiving module 301 further includes:
Second receiving submodule has at least one public affairs sent from node of demand data for receiving multiple from node Demand data information altogether;
Sending module 302 further includes:
Logging modle, for the common data received demand information to be recorded in demand data statistical form;
Third sending submodule, for according to setting period and demand data statistical form, periodically to there is demand data Slave node send corresponding common data.
Fig. 4 is referred to, based on same inventive concept, the embodiment of the present disclosure provides a kind of data sending device 400, is applied to Any from node in distributed system, distributed system includes host node and multiple from node, which includes:
Detection module 401, for from node operational process, detecting whether to lack the common data needed for operation;
Logging modle 402, for detect lack operation needed for common data when, by the name of the common data of demand Claim and data type is recorded in the demand data table from node;
Sending module 403, for according to demand data table, according to this from the corresponding predetermined period of node, periodically to Host node sends the common data demand information from node.
Fig. 5 is referred to, based on same inventive concept, the embodiment of the present disclosure provides a kind of data sending device 500, is applied to Any from node in distributed system, distributed system includes host node and multiple from node, which includes:
Detection module 501, for from node operational process, detecting whether to lack the common data needed for operation;
Sending module 502, for detect lack the common data needed for operation when, common data according to demand Title and data type send the common data demand information from node to host node.
Based on same inventive concept, the embodiment of the present disclosure also provides a kind of computer node, and the computer node is divides Host node in cloth system, the distributed system include the computer node and multiple from node, the computer section Point includes:
Non-transitorycomputer readable storage medium;And
One or more processor, for performing the program in the non-transitorycomputer readable storage medium;Institute It states to be stored in non-transitorycomputer readable storage medium and is applied to host node side in above-mentioned data transmission method for uplink for performing Method instruction.
Based on same inventive concept, the embodiment of the present disclosure also provides another computer node, and the computer node is Any from node in distributed system, the distributed system includes the computer node and multiple from node, the meter Calculation machine node includes:
Non-transitorycomputer readable storage medium;And
One or more processor, for performing the program in the non-transitorycomputer readable storage medium;Institute It states to be stored in non-transitorycomputer readable storage medium and be applied to for performing in above-mentioned data transmission method for uplink from node side Method instruction.
In embodiment provided by the present invention, it should be understood that disclosed device and method can pass through others Mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the module or unit, Only a kind of division of logic function, can there is an other dividing mode in actual implementation, such as multiple units or component can be with With reference to or be desirably integrated into another system or some features can be ignored or does not perform.
Each function module in each embodiment of the application can be integrated in a processing unit or each Module is individually physically present, can also two or more modules integrate in a unit.Above-mentioned integrated unit both may be used It realizes, can also be realized in the form of SFU software functional unit in the form of using hardware.
If the integrated unit is realized in the form of SFU software functional unit and is independent product sale or uses When, it can be stored in a computer read/write memory medium.Based on such understanding, the technical solution of the application is substantially The part to contribute in other words to the prior art or all or part of the technical solution can be in the form of software products It embodies, which is stored in a storage medium, is used including some instructions so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) perform the application The all or part of step of embodiment the method.And aforementioned storage medium includes:USB flash disk, mobile hard disk, ROM (Read- Only Memory, read-only memory), RAM (Random Access Memory, random access memory), magnetic disc or CD Etc. the various media that can store program code.
The above, above example is only to be described in detail technical scheme of the present invention, but above implementation The explanation of example is merely used to help understand the method and its core concept of the present invention, should not be construed as limiting the invention.This In the technical scope disclosed by the present invention, the change or replacement that can be readily occurred in should all be covered those skilled in the art Within protection scope of the present invention.

Claims (10)

1. a kind of data transmission method for uplink, applied to distributed system, the distributed system includes host node and multiple from node, It is characterized in that, the method includes:
The host node receives the multiple common data demand information sent from least one of node from node;
The host node sends corresponding public number according to the common data demand information to the slave node for having demand data According to.
2. according to the method described in claim 1, it is characterized in that, the host node according to the common data demand information, Corresponding common data is sent to the slave node for having demand data, including:
The host node has each from the required data of node of demand data according to the common data demand information, statistics;
The host node sends corresponding common data in a manner of multicast to the slave node for having demand data.
3. method according to claim 1 or 2, which is characterized in that received in the host node the multiple from node It is at least one from node send common data demand information before further include:
It is the multiple to send the public number from node to the host node by following steps from node from any in node According to demand information:
In the process of running, it detects whether to lack the common data needed for operation;
Detect lack operation needed for common data when, institute is recorded in the title of the common data of demand and data type It states in the demand data table from node;
According to demand data table, according to this from the corresponding predetermined period of node, periodically being sent to the host node should be from section The common data demand information of point.
4. according to the method described in claim 3, it is characterized in that, the host node receive it is the multiple from node at least One common data demand information sent from node, including:
The host node receives respectively the multiple each to be sent from node from node according to corresponding predetermined period Common data demand information, wherein, the common data demand information that the slave node of no data demand is sent is used to indicate this from section Point no data demand;
The host node sends corresponding public number according to the common data demand information to the slave node for having demand data According to, including:
The host node is all sent out after the common data demand information all sent from node is received according to described from node The common data demand information sent sends corresponding common data to the slave node for having demand data.
5. method according to claim 1 or 2, which is characterized in that received in the host node the multiple from node It is at least one from node send common data demand information before further include:
It is the multiple to send the public number from node to the host node by following steps from node from any in node According to demand information:
In the process of running, it detects whether to lack the common data needed for operation;
Detect lack operation needed for common data when, the title and data type of common data according to demand, to institute It states host node and sends the common data demand information from node.
6. according to the method described in claim 5, it is characterized in that, the host node receive it is the multiple from node at least One common data demand information sent from node, including:
The host node receives the multiple at least one common data sent from node for having demand data from node and needs Seek information;
The host node sends corresponding public number according to the common data demand information to the slave node for having demand data According to, including:
The common data demand information received is recorded in demand data statistical form the host node;
The host node is periodically sent out according to setting period and the demand data statistical form to the slave node for having demand data Send corresponding common data.
7. a kind of data sending device, applied to the host node in distributed system, the distributed system includes the main section It puts and multiple from node, which is characterized in that described device includes:
Receiving module, for receiving the multiple common data demand information sent from least one of node from node;
Sending module, for according to the common data demand information, being sent to the slave node for having demand data corresponding public Data.
8. device according to claim 7, which is characterized in that the sending module includes:
Statistical module, for according to the common data demand information, statistics to have each from the required number of node of demand data According to;
First sending submodule, for sending corresponding common data to the slave node for having demand data in a manner of multicast.
9. a kind of computer node, which is characterized in that the computer node be distributed system in host node, the distribution Formula system includes the computer node and multiple from node, and the computer node includes:
Non-transitorycomputer readable storage medium;And
One or more processor, for performing the program in the non-transitorycomputer readable storage medium;It is described non- The method for performing as described in any one of claim 1,2,4 and 6 is stored in provisional computer readable storage medium Instruction.
A kind of 10. non-transitorycomputer readable storage medium, which is characterized in that the non-transitory computer-readable storage medium Matter includes one or more programs, and one or more of programs require the side described in any one of 1 to 6 for perform claim Method.
CN201711252540.9A 2017-12-01 2017-12-01 Data transmission method for uplink, device, computer node and storage medium Pending CN108199856A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711252540.9A CN108199856A (en) 2017-12-01 2017-12-01 Data transmission method for uplink, device, computer node and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711252540.9A CN108199856A (en) 2017-12-01 2017-12-01 Data transmission method for uplink, device, computer node and storage medium

Publications (1)

Publication Number Publication Date
CN108199856A true CN108199856A (en) 2018-06-22

Family

ID=62573321

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711252540.9A Pending CN108199856A (en) 2017-12-01 2017-12-01 Data transmission method for uplink, device, computer node and storage medium

Country Status (1)

Country Link
CN (1) CN108199856A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660668A (en) * 2018-12-25 2019-04-19 杭州达现科技有限公司 A kind of the fast resource sharing method and device of display interface
CN113301084A (en) * 2020-06-30 2021-08-24 阿里巴巴集团控股有限公司 Data processing method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006073694A1 (en) * 2004-12-30 2006-07-13 Motorola, Inc. Paging method and apparatus for broadcast and multicast services in a mobile communications network
CN101965059A (en) * 2009-07-22 2011-02-02 中兴通讯股份有限公司 Method and device for sending uplink and downlink data based on uplink and downlink fixed resources
CN104601343A (en) * 2015-01-30 2015-05-06 乐视网信息技术(北京)股份有限公司 Data downloading method, device and system
CN105635233A (en) * 2014-11-24 2016-06-01 中兴通讯股份有限公司 File transmitting method and apparatus, and file downloading method and apparatus
CN107251612A (en) * 2015-02-10 2017-10-13 高通股份有限公司 On-demand system information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006073694A1 (en) * 2004-12-30 2006-07-13 Motorola, Inc. Paging method and apparatus for broadcast and multicast services in a mobile communications network
CN101965059A (en) * 2009-07-22 2011-02-02 中兴通讯股份有限公司 Method and device for sending uplink and downlink data based on uplink and downlink fixed resources
CN105635233A (en) * 2014-11-24 2016-06-01 中兴通讯股份有限公司 File transmitting method and apparatus, and file downloading method and apparatus
CN104601343A (en) * 2015-01-30 2015-05-06 乐视网信息技术(北京)股份有限公司 Data downloading method, device and system
CN107251612A (en) * 2015-02-10 2017-10-13 高通股份有限公司 On-demand system information

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109660668A (en) * 2018-12-25 2019-04-19 杭州达现科技有限公司 A kind of the fast resource sharing method and device of display interface
CN113301084A (en) * 2020-06-30 2021-08-24 阿里巴巴集团控股有限公司 Data processing method and device

Similar Documents

Publication Publication Date Title
CN100462977C (en) Capture server, distribution server, method and system for generating webpage capture
CN105824744B (en) A kind of real-time logs capturing analysis method based on B2B platform
CN106789377B (en) Service parameter updating method of network element cluster
CN111818112A (en) Kafka system-based message sending method and device
CN101860493A (en) Method, server and system for distributing application server address for clients
CN107015884B (en) Data storage method and device
CN108199856A (en) Data transmission method for uplink, device, computer node and storage medium
DE102013209934B4 (en) Start or stop virtual servers in proper order
CN108989101B (en) Log output system and method and electronic equipment
CN106649371A (en) Data processing method and device for crawlers
CN107040393A (en) A kind of route management method and equipment
CN113391973A (en) Internet of things cloud container log collection method and device
CN109714214B (en) Server exception handling method and management equipment
CN112612631B (en) Message queue accumulation detection method and related device
CN105450686A (en) Method and device for establishing server cluster
CN105429881A (en) Multicast message forwarding method and device
CN107896196B (en) Method and device for distributing messages
CN102055620B (en) Method and system for monitoring user experience
CN105468502A (en) Log collection method, device and system
CN105871806A (en) Streaming media file slicing method, device and system
EP2690560B1 (en) Method of benchmarking the behaviour of a replacement information system with the old system
CN115022275B (en) Distributed mail circulation method, device, system, equipment and storage medium
CN103530297A (en) Method and device capable of automatically carrying out website analysis
US9129263B2 (en) System and method for automatically building up topic-specific messaging identities
CN113055493B (en) Data packet processing method, device, system, scheduling device and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180622

RJ01 Rejection of invention patent application after publication