WO2014185167A1 - データ配信システム、データ配信のためのデータ通信装置およびプログラム - Google Patents

データ配信システム、データ配信のためのデータ通信装置およびプログラム Download PDF

Info

Publication number
WO2014185167A1
WO2014185167A1 PCT/JP2014/058966 JP2014058966W WO2014185167A1 WO 2014185167 A1 WO2014185167 A1 WO 2014185167A1 JP 2014058966 W JP2014058966 W JP 2014058966W WO 2014185167 A1 WO2014185167 A1 WO 2014185167A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
communication
distribution
data communication
communication device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2014/058966
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
巧巳 北林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Skeed Co Ltd
Original Assignee
Skeed Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Skeed Co Ltd filed Critical Skeed Co Ltd
Priority to US14/891,127 priority Critical patent/US10666723B2/en
Priority to EP14797775.5A priority patent/EP3012742B1/en
Publication of WO2014185167A1 publication Critical patent/WO2014185167A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1042—Peer-to-peer [P2P] networks using topology management mechanisms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/104—Peer-to-peer [P2P] networks
    • H04L67/1074—Peer-to-peer [P2P] networks for supporting data block transmission mechanisms
    • H04L67/1078—Resource delivery mechanisms
    • H04L67/1085—Resource delivery mechanisms involving dynamic management of active down- or uploading connections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Definitions

  • the present invention relates to a data distribution technique via a network.
  • P2P Peer-to-Peer
  • a plurality of data communication devices communicate directly with each other without distinguishing between a server and a client, receive data stored in other data communication devices, and store their own data. Is transmitted to another data communication device.
  • data is distributed via the plurality of data communication devices from the data communication device that is the data distribution source to the data communication device that is the data distribution destination.
  • Patent documents that propose data distribution technology using P2P include, for example, Patent Documents 1 to 3.
  • Patent Document 1 a plurality of receiving devices are received on the basis of available bandwidths that are estimated based on the received information on the transmission capabilities.
  • a mechanism has been proposed in which a unicast route from a specific distribution source to a specific distribution destination is determined by classifying them into the above classes and rearranging them in descending order of available bandwidth estimated for each class.
  • Patent Document 1 describes that information regarding the transmission capabilities of a plurality of receiving apparatuses may be reacquired every predetermined time, and the determined unicast path may be re-determined.
  • a load distribution server device and a plurality of distribution server devices are provided, and each of the plurality of server devices simultaneously distributes the same distribution target data to a terminal device allocated from the load distribution server device. It is possible to send. According to this method, it is necessary to prepare and manage a plurality of server devices, which increases costs.
  • an object of the present invention is to provide means for distributing the same distribution target data from a distribution source data communication device to a plurality of distribution destination data communication devices at high speed and at low cost.
  • the present invention provides a plurality of distribution data communication devices that are data communication devices that perform at least one of transmission and reception of distribution target data that is distribution target data, and the plurality of distribution data communication devices.
  • a management data communication device that is a data communication device that manages a data transmission path between the plurality of distribution data communication devices, each time a predetermined condition is satisfied from each of the plurality of distribution data communication devices.
  • communication status data indicating the communication partner of the distribution data communication device and the communication speed between the communication partner, and stored data indicating the amount of data stored in the distribution data communication device among the distribution target data
  • each of the plurality of distribution data communication devices Based on the stored data amount data, according to a predetermined rule, for each of the plurality of distribution data communication devices, one or more distribution data communication devices of the plurality of distribution data communication devices are assigned to the distribution data communication device. Determining means for determining as a communication partner, and transmitting means for transmitting communication partner data indicating a communication partner of the distribution data communication device to each of the plurality of distribution data communication devices according to the determination by the determination means; Each of the plurality of distribution data communication devices includes at least reception means for receiving communication partner data indicating a communication partner of the own device transmitted from the management data communication device to the own device, and at least the management data communication device.
  • At least one of transmission means for transmitting data, the transmission means of the own apparatus, and the reception means, the reception means of the own apparatus Instruction means for instructing transmission or reception of at least a part of the distribution target data with the communication partner indicated by the communication partner data received by the communication partner data, and at least a part of the distribution target data by the receiving means of the own device If received, the storage means for storing the data, and the stored data amount data indicating the amount of data stored in the storage means of the own machine among the distribution target data is generated, and the transmission means of the own machine And when at least one of the receiving means transmits or receives at least a part of the distribution target data in accordance with an instruction of the instruction means of its own device, communication between the communication partner and the communication partner in the transmission or reception Generating means for generating communication state data indicating the speed, and the transmitting means of each of the plurality of distribution data communication devices satisfies a predetermined condition.
  • a data distribution system for transmitting the communication status data and stored data amount data generated by the generating
  • each of the plurality of distribution data communication devices is generated by the generation unit of the own device when the communication partner data received by the reception unit of the own device indicates a plurality of communication partners.
  • a selection unit that selects one or more communication partners from a plurality of communication partners indicated by the communication partner data is provided, and the instruction unit includes the selection unit of the own device.
  • the transmission unit or the reception unit of its own apparatus may be instructed to transmit or receive at least a part of the distribution target data with one or more communication partners selected by the above.
  • the present invention is provided each time a predetermined condition is satisfied from each of a plurality of distribution data communication devices that are data communication devices that perform transmission and reception of distribution target data that is distribution target data.
  • Communication status data indicating the communication partner of the distribution data communication device and the communication speed with the communication partner, and stored data amount indicating the amount of data stored in the distribution data communication device among the distribution target data
  • Receiving means for receiving data and each time a predetermined condition is satisfied, the plurality of distributions according to a predetermined rule based on communication state data and stored data amount data received by the receiving means
  • one or more distribution data communication devices of the plurality of distribution data communication devices are connected to the distribution data communication device.
  • a data communication device is provided.
  • the present invention provides a communication partner that indicates a communication partner from a management data communication device that is a data communication device that manages a transmission path of distribution target data that is data to be transmitted and received between a plurality of data communication devices.
  • a receiving means for receiving data, at least a sending means for sending data to the management data communication device, and at least one of the sending means and the receiving means, the communicating party indicated by the communicating party data received by the receiving means An instruction means for instructing transmission or reception of at least a part of the distribution target data between and a storage means for storing the data when the receiving means receives at least a part of the distribution target data; and Generate stored data amount data indicating the amount of data stored in the storage means among the distribution target data, When at least one of the transmission unit and the reception unit transmits or receives at least a part of the distribution target data according to the instruction of the instruction unit, the communication speed between the communication partner and the communication partner in the transmission or reception Generating means for generating communication status data indicating, each time the predetermined condition is satisfied
  • the communication partner data received by the receiving unit indicates a plurality of communication partners
  • the communication partner data is determined according to a predetermined rule based on the communication state data generated by the generating unit.
  • the transmission unit or the reception unit may be instructed to transmit or receive a part.
  • the present invention is a data communication apparatus that performs at least one of transmission and reception of distribution target data, which is data to be distributed, to a computer including a communication unit that performs data communication with another data communication apparatus.
  • a predetermined condition is satisfied from each of a plurality of distribution data communication devices, communication status data indicating a communication partner of the distribution data communication device and a communication speed between the communication partners, and the distribution target data
  • Processing for receiving stored data amount data indicating the amount of data stored in the distribution data communication device, and the received communication state data and the stored data each time a predetermined condition is satisfied Based on the data amount data, according to a predetermined rule, the plurality of distribution data communication devices for each of the plurality of distribution data communication devices.
  • Processing for determining one or more of the distribution data communication devices as communication partners of the distribution data communication device, and communication indicating the determined communication partner of the distribution data communication device for each of the plurality of distribution data communication devices A program for executing processing for transmitting partner data is provided.
  • the present invention provides at least distribution target data that is data to be transmitted / received between a plurality of data communication devices, to a computer provided with communication means for performing data communication with other data communication devices.
  • At least part of the distribution target data between the process of receiving communication partner data indicating the communication partner from the management data communication device that is a data communication device that manages the transmission path and the communication partner indicated by the received communication partner data
  • Stored data amount data indicating the amount of data stored in the distribution target data and the processing for storing the data when at least a part of the distribution target data is received
  • at least a part of the data to be distributed is transmitted or received, the communication partner in the transmission or reception
  • processing for generating communication status data indicating the communication speed with the communication partner, and each time a predetermined condition is satisfied, the generated communication status data and the stored data amount data are transmitted to the management data communication.
  • Provided is a program for executing processing to be transmitted to an apparatus.
  • the communication partner data received by the computer indicates a plurality of communication partners
  • a plurality of communication partners indicated by the communication partner data is determined according to a predetermined rule based on the generated communication state data.
  • the distribution target data is transmitted to the selected one or more communication partners. You may comprise as a program for performing the process which performs at least one part transmission or reception.
  • the status data and stored data amount data indicating the amount of data stored in the distribution data communication device among the distribution target data are transmitted.
  • the communication partner of each distribution data communication device is determined based on the communication state data and the stored data amount data regarding each distribution data communication device in the management data communication device.
  • Each distribution data communication device transmits / receives distribution target data to / from a communication partner determined by the management data communication device.
  • the data communication device to which the distribution target data is distributed is included in a plurality of distribution data communication devices that perform transmission / reception of the distribution target data, and at least a part of the distribution target data has been received and received.
  • the distribution target data is transmitted to another data communication device.
  • the management data communication device is a distribution data communication device in which, for example, a distribution data communication device having a large amount of stored data among distribution target data is arranged on the upstream side of the data distribution route, and the amount of stored data is small Is arranged on the downstream side of the data distribution path, and the arrangement of the distribution data communication device is changed appropriately according to a predetermined rule.
  • a distribution data communication device having a large amount of stored data among distribution target data is arranged on the upstream side of the data distribution route, and the amount of stored data is small Is arranged on the downstream side of the data distribution path, and the arrangement of the distribution data communication device is changed appropriately according to a predetermined rule.
  • the time required from the start of the distribution of the distribution target data to the completion of the distribution of the distribution target data to all of the distribution destination data communication devices is shortened. In this case, it is not necessary to provide a load distribution server device or a plurality of distribution server devices, and the cost is not increased.
  • FIG. 1 is a diagram showing the overall configuration of the data distribution system 1.
  • the data distribution system 1 includes a distribution source data communication device 12 to a plurality of distribution destination data communication devices 13, that is, a distribution destination data communication device 13-1, a distribution destination data communication device 13-2,.
  • This is a system for distributing data to be distributed to the device 13-n (where n is an arbitrary natural number).
  • each of the distribution destination data communication devices 13 receives at least a part of the distribution target data received from the distribution source data communication device 12 or the other distribution destination data communication device 13. 13 is distributed in a bucket relay format. That is, the delivery destination data communication device 13 functions as a delivery source data communication device for at least a part of the delivery target data.
  • the distribution source data communication device 12 and the distribution destination data communication device 13 are collectively referred to as “distribution data communication device”.
  • the distribution target data is divided into a plurality of blocks, and is distributed from one distribution data communication device to another distribution in block units, basically in the order from the beginning to the end of the distribution target data. It is transmitted to the data communication device.
  • the “global” of the distribution destination data communication device 13 constituting the distribution path of the distribution target data (bucket relay path).
  • the arrangement is changed to “dynamic”.
  • dynamic means the quantity of each received block of the distribution destination data communication device 13 and the change in communication speed in the block transmission / reception performed by the distribution destination data communication device 13 with other distribution data communication devices. This means that the “global” arrangement of the distribution destination data communication device 13 is changed as appropriate.
  • “global” arrangement means an arrangement with a degree of freedom.
  • a part of the distribution destination data communication device 13 is allowed to communicate with a plurality of communication partners by a global arrangement.
  • the distribution destination data communication device 13 autonomously selects, for example, a communication partner having a high communication speed from a plurality of communication partners, communicates with the selected communication partner, and does not communicate with other communication partners. You can also. Accordingly, the distribution route of the distribution target data is not uniquely determined depending on the global arrangement.
  • the data distribution system 1 includes a management data communication device 11 as a device for determining the global arrangement of the distribution destination data communication device 13 described above.
  • Each of the management data communication device 11, the distribution source data communication device 12, and the distribution destination data communication device 13 is a general computer equipped with communication means for performing data communication with other data communication devices via a network. This is realized by executing processing according to the application program according to the present embodiment.
  • FIG. 2 is a block diagram showing the hardware configuration of each of the management data communication device 11, the distribution source data communication device 12, and the distribution destination data communication device 13. That is, each of the management data communication device 11, the distribution source data communication device 12, and the distribution destination data communication device 13 is configured by a computer 10 as hardware.
  • the computer 10 performs various operations in accordance with programs such as an OS and application programs and controls other components, a memory 102 that stores the programs and various data, and various data among other data communication devices.
  • Communication I / F 103 which is an interface (Interface) for performing transmission / reception of.
  • FIG. 3 is a block diagram showing a functional configuration of the management data communication device 11. That is, the computer 10 that is the hardware of the management data communication device 11 functions as a device including the components illustrated in FIG. 3 by executing processing according to the application program for the management data communication device 11 according to the present embodiment. .
  • the management data communication device 11 includes a determination unit 111 that determines a global arrangement of the distribution destination data communication device 13, and a communication partner generated for each of the distribution data communication devices according to the global arrangement determined by the determination unit 111.
  • the transmission means 112 for transmitting the communication partner data indicating to each of the distribution data communication devices, and the communication speed for each communication partner in the communication performed by each of the distribution data communication devices according to the communication partner data transmitted by the transmission unit 112
  • Receiving means 113 for receiving communication status data from each of the distribution data communication devices is provided.
  • FIG. 4 is a diagram showing a state in which the global arrangement of the distribution destination data communication device 13 is determined by the determination unit 111, taking the case where the number of distribution destination data communication devices 13 is six as an example.
  • circles indicate distribution data communication devices.
  • the determination unit 111 distributes data as illustrated in FIG.
  • the pre-data communication devices 13 are arranged in a line at random.
  • the distribution destination data communication devices 13-1 to 13-6 are arranged in that order from the upstream to the downstream of the distribution path of the distribution target data (hereinafter referred to as “upstream” and “downstream”). ”Means upstream and downstream in the direction in which the distribution target data is distributed), but this order has no particular meaning at this stage.
  • the determination unit 111 determines a data transmission / reception route between the distribution data communication devices as indicated by arrows in FIG. 4B for the distribution destination data communication devices 13 arranged in a line.
  • the determination unit 111 is configured so that each of the distribution destination data communication devices 13 is adjacent to the distribution data communication device adjacent to the upstream side of the own device, and further to the upstream side of the distribution data communication device.
  • This is a transmission / reception route determined according to a predetermined rule of receiving data from two distribution data communication devices with adjacent distribution data communication devices. (However, if there is no distribution data communication device corresponding to the upstream side or the downstream side, the communication partner of that part is absent.)
  • the determining unit 111 generates communication partner data indicating a communication partner for each of the distribution data communication devices according to the transmission / reception path determined as described above.
  • FIG. 4C illustrates communication partner data generated with respect to the delivery destination data communication device 13-2 shown in FIG. 4B.
  • the communication partner data usually includes at least one IP address of the distribution data communication device as the reception source and one IP address of the distribution data communication device as the transmission destination.
  • the communication partner data regarding the delivery destination data communication device 13 arranged on the most downstream side includes the IP of the delivery data communication device of the transmission destination. Address is not included.
  • the communication partner data related to the distribution source data communication device 12 arranged on the most upstream side does not include the IP address of the distribution data communication device of the reception source.
  • the communication partner data generated by the determination unit 111 as described above is transmitted to each of the distribution source data communication device 12 and the distribution destination data communication device 13 by the transmission unit 112.
  • Each of the distribution source data communication device 12 and the distribution destination data communication device 13 starts transmission / reception of a block with the communication partner indicated by the communication partner data transmitted from the management data communication device 11.
  • communication state data is transmitted from the distribution source data communication device 12, and communication state data and stored data amount data are transmitted from each of the distribution destination data communication devices 13 to the management data communication device 11. It will be.
  • the receiving means 113 receives these data transmitted from each of the distribution data communication devices.
  • FIG. 5 is a diagram illustrating a data configuration of communication state data (FIG. 5A) and stored data amount data (FIG. 5B).
  • the communication status data is data indicating the average communication speed within the most recent predetermined time with respect to each of the communication counterparts (reception source distribution data communication device and transmission destination distribution data communication device). is there.
  • the communication status data indicates, for example, a null value for communication with a communication partner that has not performed communication due to autonomous selection by the distribution destination data communication device 13.
  • the stored data amount data is data indicating the ratio (%) of the number of blocks that have been received with respect to the total number of blocks of the distribution target data.
  • the communication state data and the stored data amount data received by the receiving unit 113 are transferred to the determining unit 111 and used for determining a new global arrangement (generation of communication partner data).
  • the determination unit 111 is already stored in the communication state of the distribution source data communication device 12 and the distribution destination data communication device 13 indicated by the communication state data and the stored data amount data, and in the distribution destination data communication device 13. Based on the number of blocks of the distribution target data, the global arrangement of the distribution destination data communication device 13 is determined according to the following rules.
  • FIG. 6 is a diagram showing a state in which the global arrangement is determined by the determining unit 111 based on the communication state data and the stored data amount data.
  • the distribution destination data communication device 13 having a higher communication speed with the transmission destination is arranged on the upstream side.
  • the distribution destination data communication device 13 having a larger number of stored blocks is arranged on the upstream side.
  • the distribution destination data communication device 13 having a higher communication speed with the receiving source is arranged on the upstream side.
  • the determination unit 111 gives a higher score to the distribution destination data communication device 13 as the communication speed with the transmission destination is faster, and the distribution destination data as the number of stored blocks increases.
  • a higher score is assigned to the communication device 13, and the higher the communication speed with the receiver, the higher the score is given to the destination data communication device 13, and the weights according to the importance of (1) to (3) are given to them.
  • the index of the distribution capability of the distribution destination data communication device 13 is calculated.
  • the determination unit 111 arranges the delivery destination data communication devices 13 from upstream to downstream in descending order of the calculated index.
  • FIG. 6A is a diagram exemplifying the arrangement of the delivery destination data communication device 13 determined as described above.
  • the delivery destination data communication device 13-5 and the delivery destination data communication device 13-2 are both arranged at the end of the route. This is because these distribution destination data communication apparatuses 13 are not permitted to relay data (the communication speed of the transmission destination indicated by the communication status data is 0 bps) or from these distribution destination data communication apparatuses 13 due to some communication failure. This is because the communication speed of the data to be transmitted was extremely slow, and the determination unit 111 arranged these distribution destination data communication devices 13 at the end of the route as distribution destination data communication devices 13 exclusively receiving blocks.
  • the determination unit 111 provides a transmission / reception route of data between the distribution data communication devices as indicated by arrows in FIG. 6B to the distribution destination data communication device 13 whose arrangement has been determined as described above. decide. At that time, the determination unit 111 determines the route (arrow) so that the difference between the total transmission speed of the distribution data communication device serving as the reception source and the total reception speed of the distribution destination data communication device 13 serving as the transmission destination becomes small. ) Position and number. As a result, the number of communication partners (reception source and transmission destination distribution data communication devices) assigned to each of the distribution destination data communication devices 13 and their relative positional relationships can be different from each other.
  • the determining unit 111 generates communication partner data indicating a communication partner for each of the distribution data communication devices according to the transmission / reception path determined as described above.
  • FIG. 6C is a diagram illustrating communication partner data generated with respect to the delivery destination data communication device 13-4 shown in FIG. 6B.
  • the communication partner data generated by the determination unit 111 is transmitted to each of the distribution data communication devices by the transmission unit 112 as described above.
  • the receiving unit 113 receives the communication state data and the stored data amount data, the determining unit 111 generates the communication partner data, the transmission unit 112 transmits the communication partner data, and the distribution of the distribution target data is completed. Run repeatedly.
  • the distribution destination data communication device 13 that has completed the reception of all the blocks starts to appear.
  • the delivery destination data communication apparatus 13 that has received all the blocks no longer needs to receive the blocks, and, like the distribution source data communication apparatus 12, other distributions that have not yet completed reception of all the blocks. It plays a role of transmitting a block to the previous data communication device 13.
  • FIG. 7 shows the global arrangement of the distribution destination data communication device 13 determined by the determination means 111 and the transmission / reception between the distribution data communication devices in a state where the distribution destination data communication device 13 that has completed reception of all blocks appears. It is the figure which illustrated the path
  • the distribution destination data communication device 13-1 and the distribution destination data communication device 13-3 complete reception of all blocks, and the distribution destination data communication device 13-1 receives the distribution destination data communication device 13- 6 and the distribution destination data communication apparatus 13-2, the distribution destination data communication apparatus 13-3 exclusively plays a role of transmitting blocks to the distribution destination data communication apparatus 13-5.
  • FIG. 8 is a block diagram showing a functional configuration of the distribution source data communication device 12. That is, the computer 10 that is the hardware of the distribution source data communication device 12 executes a process according to the application program for the distribution source data communication device 12 according to the present embodiment, and thereby includes the components shown in FIG. Function.
  • the distribution source data communication device 12 receives the communication partner data from the management data communication device 11 and the storage unit 121 that stores in advance all blocks of the distribution target data at the start of distribution of the distribution target data as a function configuration unit.
  • the transmission means 124 for reading out and transmitting the block to the distribution destination data communication device 13, and the generation means 124 for monitoring the communication speed at the transmission of the block by the transmission means 124 for each communication partner and generating communication state data.
  • the transmission unit 124 also transmits the communication status data generated by the generation unit 124 to the management data communication device 11.
  • FIG. 9 is a block diagram showing a functional configuration of the delivery destination data communication apparatus 13. That is, the computer 10 that is the hardware of the delivery destination data communication device 13 executes a process according to the application program for the delivery destination data communication device 13 according to the present embodiment, and thereby includes the components shown in FIG. Function.
  • the distribution destination data communication device 13 includes, as a functional component, a receiving unit 131 that receives communication partner data from the management data communication device 11 and receives a block of data to be distributed from another distribution data communication device, and a reception unit 131.
  • the storage unit 132 stores the received block, and the transmission unit 133 transmits the block stored in the storage unit 132 to another distribution data communication device.
  • the distribution destination data communication device 13 generates communication state data by monitoring the communication speed at the reception of the block by the reception unit 131 and the transmission of the block by the transmission unit 133 for each communication partner, and is stored in the storage unit 132.
  • the generation unit 134 that generates the stored data amount data by dividing the number of blocks by the number of all blocks of the distribution target data (for example, acquired from the management data communication apparatus 11 via the reception unit 131), and the reception unit 131
  • Selecting means 136 for selecting a communication partner for actual communication based on the communication state data generated by the generation means 134 from the communication partners indicated by the communication partner data. For example, the selection unit 136 selects a communication partner whose communication speed indicated by the communication state data is equal to or higher than a threshold as a communication partner that actually performs communication.
  • the distribution destination data communication device 13 instructs the reception unit 131 to receive a block from the distribution data communication device selected by the selection unit 136 among the distribution data communication devices of the reception source indicated by the communication partner data, and performs communication.
  • An instruction unit 136 is provided for instructing the transmission unit 133 to transmit a block to the distribution destination data communication device 13 selected by the selection unit 136 among the transmission destination data communication devices 13 of the transmission destination indicated by the partner data.
  • the block transmission / reception between the distribution data communication devices is performed, for example, by the distribution data communication device at the transmission destination (downstream side) making a transmission request for the block to the distribution data communication device at the reception source (upstream side). If the requested block is stored in the data communication device, the block is transmitted to the destination delivery data communication device.
  • FIG. 10 is a flowchart showing an operation when the data distribution system 1 having the above-described configuration distributes distribution target data. It is assumed that all blocks of distribution target data are stored in advance in the distribution source data communication device 12.
  • the management data communication device 11 determines the global arrangement of the distribution destination data communication device 13 (step S001). Subsequently, the management data communication device 11 determines a transmission / reception route between the distribution data communication devices arranged globally (step S002). In step S001 performed first, the management data communication device 11 randomly determines a global arrangement. In S002, which is performed first, the management data communication device 11 performs distribution data communication according to a simple rule that each of the distribution destination data communication devices 13 receives data from two distribution data communication devices adjacent on the upstream side. Determine the transmission and reception paths between devices.
  • the management data communication device 11 generates communication partner data related to each of the distribution data communication devices according to the determined path (step S003). Subsequently, the management data communication device 11 transmits the generated communication partner data to each of the distribution data communication devices (step S004).
  • each of the distribution data communication devices Upon receiving the communication partner data transmitted from the management data communication device 11, each of the distribution data communication devices starts transmission / reception of blocks with the communication partner indicated in the communication partner data (step S005), and received The block is stored (step S006). (However, the distribution source data communication device 12 does not receive and store blocks.)
  • Each of the distribution data communication devices monitors the communication speed for each communication partner in parallel with the processes of steps S005 and S006 (step S007), and continuously determines whether or not a predetermined time has passed (Ste S008). If it is determined in step S008 that the predetermined time has elapsed (step S008: Yes), the distribution data communication device generates stored data amount data and communication state data (step S009), and manages the generated data. It transmits to the data communication apparatus 11 (step S010).
  • the management data communication device 11 continuously repeats the determination of whether or not a predetermined time has elapsed after the execution of step S004 (step S011). Meanwhile, stored data amount data and communication status data transmitted from each of the distribution data communication devices are received. If it is determined in step S011 that the predetermined time has elapsed (step S011: Yes), the management data communication device 11 continues to determine whether all the delivery destination data communication devices 13 are all based on the received stored data amount data. It is determined whether or not the reception of this block has been completed (step S012). If there is at least one stored data amount data indicating a value not reaching 100%, the management data communication device 11 determines that the distribution of the distribution target data is not completed (step S012: No), and the process is stepped. Return to S001.
  • the management data communication device 11 determines a global arrangement based on the stored data amount data and communication state data received from each of the distribution data communication devices. Further, in the subsequent processing of step S002 performed after the second time, the management data communication device 11 is based on the stored data amount data and the communication state data received from each of the distribution data communication devices. Determine the transmission / reception route. Thereafter, the processing after step S003 is repeated.
  • step S012 if all the stored data amount data indicates 100%, the management data communication device 11 determines that the distribution of the distribution target data has been completed (step S012: Yes). In this case, the data distribution system 1 ends the process for distributing a series of distribution target data.
  • the global arrangement of the distribution destination data communication device 13 The transmission / reception route between the distribution data communication devices according to the arrangement is dynamically determined. Therefore, the same distribution target data is distributed to a plurality of distribution destination data communication devices 13 at high speed. Further, since the data distribution system 1 does not include a load distribution server device or a plurality of distribution server devices, it can be realized at a low cost.
  • the distribution destination data communication device 13 communicates only with a communication partner whose communication speed is faster than a threshold among communication partners determined by the management data communication device 11, for example. It is configured to autonomously improve the efficiency of distribution of the distribution target data of its own device, and such improved efficiency is reflected in the communication status data, so that the global arrangement and transmission / reception of the distribution data communication device Feedback on route determination. As a result, higher-speed distribution of distribution target data is performed.
  • the data distribution system 1 described above is not the distribution destination of the distribution target data itself, but stores all the blocks of the distribution target data or a part of them, and exclusively the distribution destination data communication.
  • a data communication device that transmits a block stored in the device 13 to the device 13 is introduced.
  • a data communication device that exclusively transmits a block stored in the own device to the distribution destination data communication device 13 is referred to as a “distribution support data communication device 14”.
  • the distribution source data communication device 12, the distribution destination data communication device 13, and the distribution support data communication device 14 are collectively referred to as “distribution data communication device”.
  • the distribution support data communication device 14 is not the distribution destination of the current distribution target data, but has been the distribution destination of the same distribution target data (the distribution destination data communication device 13) in the past. Is a data communication device that stores. Accordingly, the configuration of the distribution support data communication device 14 is the same as the configuration of the distribution destination data communication device 13.
  • the determination unit 111 rearranges the distribution support data communication device 14 according to the following rules, for example.
  • the distribution support data communication device 14 having a higher communication speed with the transmission destination is arranged on the upstream side.
  • the distribution support data communication device 14 having a larger number of stored blocks is arranged on the upstream side.
  • the determination unit 111 gives a higher score to the distribution support data communication device 14 as the communication speed with the transmission destination is higher, and the distribution support data as the number of stored blocks increases.
  • a high score is assigned to the communication device 14, and weights corresponding to the importance levels of (1) and (2) are multiplied by these scores and added to calculate an index of the distribution capability of the distribution support data communication device 14. .
  • the determining unit 111 arranges the distribution support data communication devices 14 from upstream to downstream in descending order of the calculated index.
  • the determination unit 111 arranges the distribution support data communication devices 14 rearranged as described above with respect to the distribution destination data communication devices 13 arranged globally, for example, in order from the upstream side, and transmits and receives between the distribution data communication devices. Determine the route. At this time, the determination unit 111 determines the position of the route so that the difference between the total transmission speed of the distribution data communication device serving as the reception source and the total reception speed of the distribution destination data communication device 13 serving as the transmission destination becomes small. And determine the number.
  • FIG. 11 is a diagram exemplifying the global arrangement of the distribution destination data communication device 13 and the transmission / reception route between the distribution data communication devices determined by the determination unit 111 when the distribution support data communication device 14 is introduced.
  • the distribution support data communication device 14-1 is arranged as a distribution data communication device as a reception source of the distribution destination data communication device 13-1 and the distribution destination data communication device 13-2
  • the distribution support data communication device 14-2 is arranged as a distribution data communication device as a reception source of the distribution destination data communication device 13-3 and the distribution destination data communication device 13-4.
  • the number of block transmission sources is increased by the support of the distribution support data communication device 14, so that the distribution of target data in the data distribution system 1 is performed at a higher speed.
  • the data communication system 1 is not a distribution destination of distribution target data, but a data communication device having a high data distribution capability is purely distributed in the data distribution system 1. Introduced to increase speed.
  • the data communication device introduced purely for the purpose of increasing the distribution speed of the distribution target data in the data distribution system 1 is referred to as “relay data communication device 15”.
  • the distribution source data communication device 12, the distribution destination data communication device 13, and the relay data communication device 15 are collectively referred to as “distribution data communication device”.
  • the relay data communication device 15 has the same configuration as the distribution destination data communication device 13 except that the data distribution capability is high (potential transmission speed and reception speed are high) compared to the distribution destination data communication device 13.
  • a data communication device is high (potential transmission speed and reception speed are high) compared to the distribution destination data communication device 13.
  • the relay data communication device 15 notifies the management data communication device 11 that the own device is the relay data communication device 15, and the determination unit 111 of the management data communication device 11 follows the notification to distribute the destination data communication device.
  • the transmission / reception route between the distribution data communication devices is determined.
  • the relay data communication device 15 improves the transmission capability of the block on the upstream side, so that the data to be distributed in the data distribution system 1 is distributed at a higher speed.
  • the blocks are transmitted and received between the distribution data communication devices according to the order in the distribution target data.
  • the blocks received in the downstream distribution data communication device are assembled in the correct order.
  • the transmission order of the blocks may be any order.
  • the stored data amount data indicates the ratio (%) of the number of stored blocks to the total number of blocks of the distribution data communication device. Any other numerical value may be used as long as it indicates the amount of stored data among the distribution target data.
  • the stored data amount data may be data indicating the number of blocks stored in the distribution destination data communication device 13 or a distribution target stored in the distribution destination data communication device 13 for the total number of bits of the distribution target data. It may be data indicating the ratio of the number of bits of part (or all) of data.
  • the distribution source data communication device 12 and the distribution destination data communication device 13 generate stored data amount data and communication state data with the passage of a predetermined time as a trigger, and the management data communication device 11
  • the trigger of generation and transmission of stored data amount data and communication state data is not limited to the elapse of a predetermined time, and may be triggered when other conditions are satisfied.
  • each of the delivery destination data communication devices 13 may be configured to transmit stored data amount data and communication state data to the management data communication device 11 each time a predetermined amount of data is received.
  • the communication status data is data indicating the communication speed observed until the generation of new communication status data after the previous generation of the communication status data.
  • the communication speed indicated by the data is not limited to this.
  • data indicating the communication speed within a predetermined period including a period before the timing when the communication state data was generated last time may be used as the communication state data.
  • a large value is assigned to the communication speed at the timing close to the current time
  • a small weight is assigned to the communication speed at the timing farther (older) than the current time
  • the weighted average is used.
  • the data indicating the representative value may be used as communication state data.
  • the fields of the transmission destination and the reception source are respectively included in the communication status data of the upstream delivery data communication device and the communication status data of the downstream delivery data communication device that communicate with each other. Includes data indicating the same communication speed. Therefore, the communication status data may be configured to indicate only one of these (for example, only the data in the transmission destination column).
  • the delivery destination data communication devices 13 are arranged in a single line in a global arrangement.
  • the shape of the global arrangement is not limited to a single line, for example, a plurality of lines or a plurality of branches. Other shapes such as a bifurcated shape or a mesh-like shape may be employed.
  • the determining unit 111 determines the first global arrangement
  • the order of the distribution destination data communication devices 13 is determined at random.
  • the distance between the distribution data communication devices on the network is estimated, and the global arrangement is determined so that the data communication devices estimated to be close to each other are adjacent or close to each other.
  • the determination unit 111 may be configured to determine the global arrangement of the distribution destination data communication device 13 according to a specific rule.
  • the determination unit 111 determines the first global arrangement, the communication status data received by the management data communication apparatus 11 from the distribution data communication apparatus in the distribution of other distribution target data in the past can be used. If so, instead of randomly determining the order of the distribution destination data communication devices 13, a global arrangement of the distribution destination data communication devices 13 may be determined based on communication state data received in the past.
  • management data communication device 11 and the distribution source data communication device 12 are separate devices, but the management data communication device 11 and the distribution source data communication device 12 are in the same casing. It may be configured as an arranged device.
  • the number of distribution source data communication devices 12 is one.
  • the data distribution system 1 may include a plurality of distribution source data communication devices 12. In this case, since the distribution of the distribution target data is started simultaneously from the plurality of distribution source data communication devices 12, the distribution target data is distributed at a higher speed.
  • the management data communication device 11, the distribution source data communication device 12, and the distribution destination data communication device 13 each execute processing according to the application program according to the present embodiment on a general computer.
  • one or more of these devices may be configured as a so-called dedicated machine.
  • the management data communication device 11 designates the communication partner of the distribution data communication device as distinguished from the reception source and the transmission destination.
  • the management data communication device 11 may be configured to designate a communication partner permitted to each of the distribution data communication devices without distinguishing between the reception source and the transmission destination.
  • the distribution data communication device can both transmit and receive blocks with the communication partner designated by the management data communication device 11.
  • the distribution data communication device generates communication state data indicating the communication speed of communication performed with the designated communication partner for each of reception and transmission.
  • the downstream delivery destination data communication device 13 receives and stores many blocks ahead of the upstream delivery destination data communication device 13 in a global arrangement, the upstream delivery is performed. Since the destination data communication device 13 is also permitted to receive a block from the downstream delivery destination data communication device 13, the delivery target data is delivered at a higher speed.
  • the communication partner data usually includes the IP address of the distribution data communication device as the reception source and the IP address of the distribution data communication device as the transmission destination.
  • the data included in the communication partner data is not limited to the IP address of the communication partner communication device, and may include data in any format as long as the data can identify the communication partner node on the network.
  • the communication partner data includes data necessary for communication between communication devices such as an identifier indicating a communication protocol and a port number in the communication protocol, in addition to data for enabling identification of a node of the communication partner. It may be adopted. If the communication partner data is configured to include these data, it is convenient that there is no need to separately perform the process of transferring these data between the communication devices.
  • transmission / reception of blocks between distribution data communication devices is performed by, for example, sending a distribution data communication device at a transmission destination (downstream side) to a distribution data communication device at a reception source (upstream side).
  • the transmission request is made, and if the received distribution data communication device stores the requested block, the block is transmitted to the transmission data distribution device of the transmission destination.
  • the procedure for confirming whether or not the block is stored between the distribution data communication devices is not limited to this, and various other procedures can be adopted.
  • the distribution data communication device at the reception source requests the transmission data communication device at the transmission destination (downstream side) whether or not a block that can be transmitted has been acquired, and distribution of the transmission destination
  • the data communication apparatus notifies the receiving distribution data communication apparatus of unacquired blocks among the blocks that can be transmitted by the receiving distribution data communication apparatus, and the receiving distribution data communication apparatus receives the block. May be performed according to the procedure of transmitting to the distribution data communication device of the transmission destination.
  • Application programs for the management data communication device 11, the distribution source data communication device 12, and the distribution destination data communication device 13 shown in the above-described embodiment are recorded on a recording medium readable by the computer 10 and distributed. Alternatively, it may be downloaded to the computer 10 via a network.
  • the present invention can be used in a service industry that widely distributes data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Computer And Data Communications (AREA)
PCT/JP2014/058966 2013-05-16 2014-03-27 データ配信システム、データ配信のためのデータ通信装置およびプログラム Ceased WO2014185167A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/891,127 US10666723B2 (en) 2013-05-16 2014-03-27 Data distribution system, data communication device and program for data distribution
EP14797775.5A EP3012742B1 (en) 2013-05-16 2014-03-27 Data distribution system, data communication device and program for data distribution

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013104584A JP5724154B2 (ja) 2013-05-16 2013-05-16 データ配信システム、データ配信のためのデータ通信装置およびプログラム
JP2013-104584 2013-05-16

Publications (1)

Publication Number Publication Date
WO2014185167A1 true WO2014185167A1 (ja) 2014-11-20

Family

ID=51898151

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/058966 Ceased WO2014185167A1 (ja) 2013-05-16 2014-03-27 データ配信システム、データ配信のためのデータ通信装置およびプログラム

Country Status (4)

Country Link
US (1) US10666723B2 (enExample)
EP (1) EP3012742B1 (enExample)
JP (1) JP5724154B2 (enExample)
WO (1) WO2014185167A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10241929B2 (en) 2015-02-19 2019-03-26 Simulatio Corporation Data transfer method for parallel transfer of data divided into a plurality of data groups over multiple TCP connections simultaneously

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10630494B2 (en) * 2017-12-15 2020-04-21 Crestron Electronics, Inc. PoE powered device with link layer startup processor
US11128731B2 (en) * 2019-01-24 2021-09-21 Microsoft Technology Licensing, Llc Generalized resource accountant
US11755100B2 (en) * 2021-03-18 2023-09-12 Dell Products L.P. Power/workload management system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4598073B2 (ja) 2005-08-01 2010-12-15 パナソニック株式会社 送信装置および送信方法
JP2011151701A (ja) * 2010-01-25 2011-08-04 Cellius Inc サーバシステム、クライアント装置、プログラム、及び情報記憶媒体
JP2012252593A (ja) * 2011-06-03 2012-12-20 Fujitsu Ltd ファイル配布方法、ファイル配布システム、マスタサーバ、ファイル配布プログラム、データ配布方法、及びデータ配布システム
JP2013058056A (ja) * 2011-09-08 2013-03-28 Fujitsu Ltd 配信システム、配信方法、及び配信プログラム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI265697B (en) * 2002-06-06 2006-11-01 Ibm Digital contents distribution system, digital contents distribution method, computer readable recording medium storing the program therein, and server and client therefor
US20090300673A1 (en) * 2006-07-24 2009-12-03 Nds Limited Peer- to- peer set-top box system
JP2009171388A (ja) * 2008-01-18 2009-07-30 Panasonic Corp 情報送信装置および情報配信システム
JP4609547B2 (ja) * 2008-08-14 2011-01-12 ソニー株式会社 無線通信装置、通信システム、および通信制御方法、並びにプログラム
WO2012153173A2 (en) 2011-01-29 2012-11-15 Redthorne Media, Llc Feedback oriented private overlay network for content distribution

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4598073B2 (ja) 2005-08-01 2010-12-15 パナソニック株式会社 送信装置および送信方法
JP2011151701A (ja) * 2010-01-25 2011-08-04 Cellius Inc サーバシステム、クライアント装置、プログラム、及び情報記憶媒体
JP2012252593A (ja) * 2011-06-03 2012-12-20 Fujitsu Ltd ファイル配布方法、ファイル配布システム、マスタサーバ、ファイル配布プログラム、データ配布方法、及びデータ配布システム
JP2013058056A (ja) * 2011-09-08 2013-03-28 Fujitsu Ltd 配信システム、配信方法、及び配信プログラム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10241929B2 (en) 2015-02-19 2019-03-26 Simulatio Corporation Data transfer method for parallel transfer of data divided into a plurality of data groups over multiple TCP connections simultaneously

Also Published As

Publication number Publication date
JP5724154B2 (ja) 2015-05-27
JP2014225169A (ja) 2014-12-04
US10666723B2 (en) 2020-05-26
EP3012742A1 (en) 2016-04-27
US20160255147A1 (en) 2016-09-01
EP3012742A4 (en) 2017-03-29
EP3012742B1 (en) 2019-05-08

Similar Documents

Publication Publication Date Title
US8180853B2 (en) Method and apparatus for transmitting data in a peer-to-peer network
CN108023812B (zh) 云计算系统的内容分发方法及装置、计算节点及系统
KR20130008325A (ko) 컨텐츠 중심 네트워크에서 컨텐츠 요청자, 중간 노드 및 컨텐츠 소유자의 통신 방법
KR101805458B1 (ko) 웹 소켓 지원 방법, 그리고 이를 사용한 웹 서버 및 웹 애플리케이션 서버
US20110246658A1 (en) Data exchange optimization in a peer-to-peer network
JP5724154B2 (ja) データ配信システム、データ配信のためのデータ通信装置およびプログラム
CN112087382A (zh) 一种服务路由方法及装置
CN108881034B (zh) 一种应用于bt系统的请求响应方法、设备及系统
KR20120138546A (ko) 분산 네트워크에서 우선순위에 기반한 디스커버리를 수행하는 장치 및 방법과, 디스커버리 백오프 타임 결정 방법
CN105049463B (zh) 分散数据库、数据共享方法、用于分散数据库的装置
US20170193006A1 (en) Distributed file system and method of creating files effectively
KR101592727B1 (ko) P2p를 이용한 하이브리드 스토리지 시스템 및 이를 이용한 데이터 전송 방법
CN102651757A (zh) 一种p2p内容分发的方法和系统
CN101355512B (zh) 数据传输系统、方法及传输控制服务器
JP2016046785A (ja) キャッシュサーバ選択装置、分散キャッシュシステム、及びキャッシュサーバ選択方法
KR101420108B1 (ko) 순차적 ｐ2ｐ 다운로드 시스템 및 방법
JP2017073089A (ja) データ配布プログラム、データ配布方法、情報処理装置及び情報処理システム
US9942314B2 (en) System and method for optimizing web service availability with a node group agreement protocol
JP5783008B2 (ja) ストレージ装置、ストレージシステム、データ更新方法およびデータ管理プログラム
JP5673268B2 (ja) 通信装置、およびプログラム
US10367725B2 (en) Network programming
JP6191466B2 (ja) 映像配信システム及び映像配信システムにおいて使用されるノード装置
CN118827675A (zh) 业务流量的负载均衡方法、装置、电子设备及存储介质
JP5659915B2 (ja) マルチキャストシステム、マルチキャストツリー構成方法、及びプログラム
JP2006343970A (ja) 通信システム、ノード、変更通知方法及びプログラム並びに記憶媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14797775

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2014797775

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14891127

Country of ref document: US