JP6179141B2 - Data transfer system and network load reducing method - Google Patents

Description

  A data transfer system, a transfer data transmission device, a transfer data processing device, a network load reduction method, and a transfer data transmission program for reducing the load on the network when storing target data in a plurality of storages via a network And a data processing program for transfer.

  In a cloud system using OpenStack (registered trademark) Swift, when data is stored, the data is stored in multiples in order to ensure redundancy. In order to reduce the price of the entire system, when the system is configured using low-trust storage, the reliability of the node storing the data is to be ensured by storing the data in multiple layers. .

  Patent Document 1 describes a multicast data communication system that reduces the load on a branching device. The multicast data communication system described in Patent Document 1 reduces the load of the switch itself by not performing the branch process in a switch that does not require the branch process.

  Further, Non-Patent Document 1 describes TRILL (TRansparent Interconnection of Lots of Links) as a technique for making a path redundant with Ethernet (registered trademark). TRILL described in Non-Patent Document 1 reduces a network load by selecting or limiting a network route through which data is transmitted. As a related technique, IGMP (Internet Group Management Protocol) snooping for filtering unnecessary multicast traffic is also known.

JP 2005-175609 A

Nikkei Business Publications, “TRILL: ITpro”, [online], [March 11, 2013 search], Internet <URL: http://itpro.nikkeibp.co.jp/article/Keyword/20101019/353114 />

  In OpenStack's Switch, data is guaranteed even when a failure occurs in the storage node by writing multiple data from the proxy node. In the following description, the writing to the storage node is described as being three multiplexed. In this case, data more than three times the amount of data transmitted by the user flows through the network between the proxy node and the storage node, which increases the network load.

  When the storage reliability is high, the data multiplicity may be about three. However, when the storage reliability is low, it is necessary to further increase the multiplicity in order to guarantee the data. As the multiplicity increases, the network load further increases accordingly.

  Specifically, there is a problem that when the reliability of a node is to be ensured by storing data in multiple layers, the higher the redundancy, the higher the load on the network. Specifically, when the proxy node instructs the storage node that actually stores the data to store the data in a multiplexed manner, a large amount of the same data flows through the network between the proxy node and the storage node. There is a problem that it ends up.

  Moreover, although the system described in Patent Document 1 can reduce the load on the branching device, it cannot reduce the load on the communication path through which data is transmitted. Therefore, for example, when the same communication path is used when transmitting the same data, the load on the communication path cannot be reduced. Even if TRILL described in Non-Patent Document 1 is used, when the same communication path is used when transmitting the same data, it is difficult to reduce the load on the communication path. This is the same when IGMP smoothing is used.

  Therefore, the present invention provides a data transfer system, a transfer data transmission device, and transfer data that can reduce the network load between the data transmission side device and the storage when data is made redundant and stored in a plurality of storages. It is an object of the present invention to provide a processing device, a network load reduction method, a transfer data transmission program, and a transfer data processing program.

A data transfer system according to the present invention is a data transfer system that stores the same target data in a plurality of storages via a network, and a proxy server that determines a plurality of storages to store the target data, and a proxy server that transmits the data. A node that receives data and transfers it to the storage, and the node includes a transfer destination node that is a node to which data is transferred from its own node, and a plurality of storages that store data that passes through the transfer destination node. Transfer destination information table storage means for storing the associated transfer destination information table, data transfer means for transferring the received data, branch point determination means for determining whether or not the own node is a branch point, and branch point determination means If the local node is determined to be a branch point, the storage capacity of the local node's transfer destination The previous address, the request for the virtual address allocated to the local node comprises an address request unit which transmits to the proxy server, the proxy server, storage location of the plurality of storage and destination node of the target data, the target data is stored A packet transmission means that creates a transfer packet that includes the address and the target data and sends the transfer packet to the node, and a node at which the path for transmitting the target data to multiple storage branches And when there are two or more storages at the transfer destination of the transfer destination node of the node indicating the branch point, the branch point is stored in the transfer destination information table storage means of the node indicating the branch point. The transfer destination information registration that registers the virtual address of the transfer destination node of the indicated node and two or more storages existing in the transfer destination in association with each other. And it means, when the branch point determining means of the proxy server sends a special port addressed packets to the path to each storage, branch point determination unit node, to send a special port packet addressed to different physical ports, The local node is determined to be a branch point, the branch point determination unit of the proxy server assigns a virtual address in response to a request for a virtual address, and the transfer destination information registration unit of the proxy server exists at the assigned virtual address and transfer destination If the transfer destination node is registered in the transfer destination information table storage means , the node data transfer means corresponds to the transfer destination node. The storage address other than the storage to be used is deleted from the transfer packet and the transfer packet is transferred to the transfer destination node. The target data is copied and transferred to the storage address.

A transfer data transmitting apparatus according to the present invention is a transfer data transmitting apparatus that determines a plurality of storages to store the same target data, and transmits the target data to each determined storage via a node on the network. The node stores a transfer destination information table in which a transfer destination node that is a transfer destination of data from its own node and a plurality of storages storing data passing through the transfer destination node are stored. A destination information table storage means is provided, and a transfer packet including the transfer destination of the target data, storage destination addresses of the plurality of storages storing the target data, and the target data is created and addressed to the plurality of storages. When the target data of the target is branched, the target data is copied from the transfer packet and sent to each storage. A packet transmitting means for transmitting a transmission packet, and the branch point determining means path determines that the branch point node that branches when transmitting target data into a plurality of storage, transfer destination node of the node indicating a branch point If there are two or more storages in advance, the transfer destination information table storage means of the node indicating the branch point stores the virtual address of the transfer destination node of the node indicating the branch point and two or more storages existing at the transfer destination. And a transfer destination information registering means for registering them in association with each other . The branch point determining means transmits a special port addressed packet to the path to each storage, and the node transmits the special port addressed packet to a different physical port. When the local node is determined to be a branch point, the storage destination address that is sent from that node and that exists at the local node's forwarding destination, and the local node In response to a request for a virtual address to be allocated, a virtual address is allocated, and the transfer destination information registration unit associates the allocated virtual address with two or more storages existing in the transfer destination and registers them in the transfer destination information table storage unit. characterized in that it.

The transfer data processing device according to the present invention determines a plurality of storages to store the same target data, receives a transfer packet from a transmission device that transmits the determined target data addressed to each storage, and stores the plurality of storages A transfer data processing device for transferring the transfer packet to a transfer destination node to which data is transferred from its own node and a plurality of storages for storing data passing through the transfer destination node. When the transfer destination information table storage unit for storing the associated transfer destination information table and the transfer destination node are registered in the transfer destination information table storage unit, the transfer destination node of the target data and the target data are stored. When a transfer packet containing the storage destination addresses of multiple storages and the target data is received from the transmitter, From socket, remove the storage destination address other than the storage corresponding to the destination node forwards the destination node, a data transfer means for transferring duplicates the target data addressed deleted storage destination address, for the mobile transfer A branch point determination unit that determines whether or not the data processing device is a branch point; and if the data processing device for own transfer is determined to be a branch point by the branch point determination unit, the transfer destination of the data processing device for own transfer is A storage destination address of an existing storage and an address request means for transmitting a request for a virtual address to be allocated to the data processing apparatus for own transfer to the transmission apparatus. The branch point determination means transmits the path from the transmission apparatus to each storage. When a packet addressed to a special port is received and the packet addressed to the special port is transmitted to a different physical port, the data processing device for own transfer is determined to be a branch point. The data transfer means determines the node at which the path when the transmission device transmits the target data to the plurality of storages in response to the request for the virtual address as the branch point, and the transfer destination node of the node indicating the branch point When there are two or more storages at the transfer destination, the virtual address assigned to the transfer destination node of the node indicating the branch point is associated with the two or more storages existing at the transfer destination in association with the transfer destination information table storage means If registered, the target data is transferred according to the registered contents .

The network load reducing method according to the present invention is a network load reducing method for reducing the load on the network when the same target data is stored in a plurality of storages via a network, and the plurality of storages to store the target data. The proxy server determines the transfer destination node of the target data, the storage destination addresses of the multiple storages storing the target data, and the transfer packet including the target data, and is transmitted from the proxy server. The transfer packet is transmitted to the node that receives the data to be transferred to the storage, and the node associates the transfer destination node with a plurality of storages that store the data passing through the transfer destination node. If the destination node to which data is transferred from the local node is registered in the destination information table , Remove the storage destination address other than the storage corresponding to the destination node from the transfer packet and forwards the transfer packet to the destination node, and forwarding duplicates the target data deleted storage destination address destined When the proxy server sends a packet destined for the special port to the path to each storage, and the node sends the packet destined for the special port to a different physical port, the node determines that the node is a branch point, and the node is a branch point. If it is determined that, the storage destination address of the local node's transfer destination and the request for the virtual address to be allocated to the local node are sent to the proxy server, and the proxy server sends the target data to multiple storages path nodes that branch determines the branching point of time, assigns a virtual address in response to a request of the virtual address, the proxy server But if there is more than one storage destination destination node of a node indicating a branch point, the transfer destination information table storage unit of the node indicating the branch point, the destination node of the node representing the branch point The allocated virtual address and two or more storages existing at the transfer destination are registered in association with each other.

The transfer data transmission program according to the present invention determines a plurality of storages to store the same target data, and is used for a transfer applied to a computer that transmits the target data to each determined storage via a node on the network. In the data transmission program, a node is a transfer destination information table in which a transfer destination node that is a node to which data is transferred from its own node and a plurality of storages that store data that passes through the transfer destination node are associated with each other. A transfer destination information table storage means for storing a transfer packet including a transfer destination of target data, storage destination addresses of a plurality of storages storing the target data, and the target data. Create target data from multiple packets when the target data for multiple storage branches Ltd. to packet transmission processing for transmitting the transfer packet to the node to be sent to each storage branch point determination process path is determined as the branch point node that branches when transmitting target data into a plurality of storage, When there are two or more storages at the transfer destination of the transfer destination node of the node indicating the branch point, the transfer destination information table storage means of the node indicating the branch point stores the transfer destination node of the node indicating the branch point. A transfer destination information registration process for registering a virtual address and two or more storages existing at a transfer destination in association with each other is executed, and a special port-addressed packet is transmitted to the path to each storage in a branch point determination process. Is sent from that node when it determines that its own node is a branch point when sending a packet addressed to a special port to a different physical port. In response to a request for a storage destination address of a storage existing at the destination and a virtual address allocated to the own node, a virtual address is assigned, and two or more existing at the assigned virtual address and the destination in the transfer destination information registration process The storage is associated with each other and registered in the transfer destination information table storage means .

The transfer data processing program according to the present invention determines a plurality of storages to store the same target data, receives a transfer packet from a transmission device that transmits the determined target data addressed to each storage, A transfer data processing program applied to a computer that transfers the transfer packet to a storage, wherein the transfer destination node is associated with a plurality of storages that store data passing through the transfer destination node When the transfer destination node to which data is transferred from the own node is registered in the transfer destination information table, the transfer destination node of the target data from the transmitting device and the storage destination addresses of the multiple storages storing the target data And the target data are received from the transfer packet. Remove the storage destination address other than the storage corresponding to the de transferred to the destination node, the data transfer process for transferring duplicates the target data addressed storage destination address that has been removed, the self computer whether a branch point The branch point determination process to be determined, and if the local computer is determined to be a branch point in the branch point determination process, a request for the storage address of the storage existing at the transfer destination of the local computer and the virtual address to be allocated to the local computer Execute the address request processing to send to the transmitting device, receive the special port-addressed packet sent to the path from the transmitting device to each storage, and send the special port-addressed packet to a different physical port in the branch point judgment processing The computer determines that it is a branch point, and in the data transfer process, the sending device responds to a request for a virtual address. If the node at which the path for transmitting the target data to the number of storages branches is determined as a branch point, and there are two or more storages in the transfer destination of the transfer destination node of the node indicating the branch point, the branch point is When the virtual address assigned to the transfer destination node of the indicated node is associated with two or more storages existing at the transfer destination and registered in the transfer destination information table storage means, the target data is transferred according to the registered contents. Features.

  ADVANTAGE OF THE INVENTION According to this invention, when making data redundant and storing in several storage, the network load between the transmission side apparatus and storage of data can be reduced.

1 is a block diagram illustrating an embodiment of a data transfer system according to the present invention. It is explanatory drawing which shows the example of the cloud system using a data transfer system. It is explanatory drawing explaining the example of the communication method which a data transfer system performs. It is explanatory drawing which shows the example of the transfer destination information table produced | generated in the cloud system illustrated in FIG. It is explanatory drawing which shows the example of the packet for a transfer. It is a flowchart which shows the example of the operation | movement which determines a branch point. It is a flowchart which shows the example of the operation | movement which produces a transfer destination information table. It is a block diagram which shows the outline | summary of the data transfer system by this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing an embodiment of a data transfer system according to the present invention. FIG. 2 is an explanatory diagram showing an example of a cloud system using the data transfer system of this embodiment.

  In the cloud system illustrated in FIG. 2, for example, OpenStack Swift is used. The cloud system illustrated in FIG. 2 includes a large number of clients 40 and a plurality of storage nodes 31 to 33 that store data. The cloud system illustrated in FIG. 2 includes three storage nodes, but the number of storage nodes is not limited to three, and may be two or four or more. In the following description, the storage node may be simply referred to as storage.

  Between the client 40 and the storage nodes 31 to 33, there are a plurality of proxy nodes 10 that relay the data d1 from the client 40. When the proxy node 10 receives the target data from the user (client 40), the proxy node 10 determines a plurality of storage nodes in which the target data is to be stored, and sends the data to the plurality of storage nodes 31 to 33 determined from the received data file names. Multiple data is stored (for example, data d1 is copied to data d1 to d3). The cloud system illustrated in FIG. 2 includes two proxy nodes. However, the number of proxy nodes is not limited to two, and may be one or three or more.

  The proxy node 10 and the storage nodes 31 to 33 are connected by a communication network, and there are switches 20a to 20c that receive data transmitted from the proxy node 10 and relay the data to the storage nodes 31 to 33. To do. Duplicate data is stored in each of the storage nodes 31 to 33 via the communication network. The cloud system illustrated in FIG. 2 includes three switches 20a to 20c, but the number of switches is not limited to three, and may be two or four or more. .

  In the following description, a case where data is made redundant and stored in a plurality of storages using OpenStack Swift is exemplified, but the technology used for redundancy is not limited to OpenStack Swift. Further, in the present embodiment, in order to simplify the description, a case of 3 multiplexing that is the minimum unit will be described as an example.

  Referring to FIG. 1, the data transfer system of this embodiment includes a proxy node 10 and a switch 20.

  The proxy node 10 includes a branch point determination unit 11, an address notification unit 12, a transfer destination information table creation unit 13, a transfer destination information table storage unit 14, a UDP (User Datagram Protocol) encapsulation packet creation unit 15, a connection Management means 16 and data storage destination selection means 17 are included.

  The data storage destination selection means 17 receives data to be stored in the storage node from a large number of clients, and determines to which storage node the received data is to be multiplexed. For example, the data storage destination selection unit 17 may determine a storage node to be overwritten based on the basic function of OpenStack Switch. Note that the method for determining the storage node to be overwritten is not limited to this method.

  The connection management means 16 establishes a communication path by creating a communication endpoint for each of the determined plurality of storage nodes. At this time, the connection management means 16 uses a socket used for communication with the storage node (hereinafter referred to as a child socket) and a special socket for managing the child socket (hereinafter referred to as a parent socket). Create The detailed operation of the connection management unit 16 will be described later.

  The branch point determination unit 11 establishes a communication path to the storage node. At that time, the branch point determination means 11 identifies a switch on which the path for transmitting the target data branches, and determines that switch as a branch point. Then, the branch point determination means 11 virtually allocates an IP address to the switch that becomes the branch point.

  The address notification unit 12 notifies the allocated virtual IP address to the branch point (switch) determined by the branch point determination unit 11.

  The transfer destination information table storage means 14 is a transfer destination information table in which a switch to which data is transferred (hereinafter referred to as a transfer destination node) and a plurality of storages storing data passing through the transfer destination node are associated with each other. Remember. When determining a communication path, this transfer destination information table shows a plurality of destinations (specifically, storage nodes) existing ahead of the branch point when a branch occurs in the route for transmitting the target data. It is something to remember.

  Specifically, when there are a plurality of storage nodes ahead of the branch point, the transfer destination information table creation means 13 described later indicates that the plurality of storage nodes exist for the next switch. Register in the transfer destination information table.

  When there are two or more storage nodes at the transfer destination of the transfer destination node of the branch point (switch), the transfer destination information table creation means 13 stores the branch point (switch) in the transfer destination information table of the branch point (switch). ) And the two or more storage nodes existing in the transfer destination are registered in the transfer destination information table in association with each other.

  In other words, the transfer destination information table creation unit 13 determines that a branch occurs when determining a communication path, and if there are a plurality of destinations (storage nodes) at the end of the branch point, a plurality of destinations at the switch destination. The existence of the destination is stored in the transfer destination information table inside the switch.

  The UDP encapsulation packet creating means 15 transmits the target data to the transfer destination node. Specifically, the UDP encapsulation packet creating unit 15 collects a plurality of pieces of information to which data is transmitted as UDP data addressed to the special port, and transmits the data encapsulated in UDP to the transfer destination node. Hereinafter, the data created by the UDP encapsulation packet creating means 15 may be referred to as a transfer packet.

  The transfer packet includes a transmission source address, a transfer destination (switch) address, addresses of a plurality of storage nodes indicating storage destinations, and target data stored in the storage.

  The branch point determination means 11, the address notification means 12, the transfer destination information table creation means 13, the UDP encapsulation packet creation means 15, the connection management means 16, and the data storage destination selection means 17 are a program (data for transfer). This is realized by a CPU of a computer that operates according to a transmission program. For example, the program is stored in a storage unit (not shown) of the proxy node 10, and the CPU reads the program, and according to the program, the branch point determination unit 11, the address notification unit 12, the transfer destination information table creation unit 13, The UDP encapsulation packet creating unit 15, the connection managing unit 16, and the data storage destination selecting unit 17 may be operated.

  Further, the branch point determination unit 11, the address notification unit 12, the transfer destination information table creation unit 13, the UDP encapsulation packet creation unit 15, the connection management unit 16, and the data storage destination selection unit 17 are dedicated to each. It may be realized by hardware.

  Further, since the proxy node 10 generates data to be transferred to the storage node and transmits it to each switch, the proxy node 10 can be referred to as a transfer data transmitting device.

  The switch 20 includes a branch point determination unit 21, an address request unit 22, a transfer destination information table creation unit 23, a transfer destination information table storage unit 24, and a UDP encapsulation packet transfer unit 25.

  The branch point determination means 21 determines whether or not the own switch corresponds to a branch point. Specifically, the branch point determination unit 21 branches the own switch when the physical port for sending data is different, triggered by a packet transmitted by the branch point determination unit 11 of the proxy node 10 to determine the branch point. Judge as a point.

  The address request unit 22 requests the proxy node 10 for a virtual IP address when it is determined that the own switch corresponds to the branch point. The virtual IP address assigned from the proxy node 10 is used when transferring the transfer data.

  Similarly to the transfer destination information table storage unit 14, the transfer destination information table storage unit 24 stores a transfer destination information table.

  Based on the data received from the proxy node 10, the transfer destination information table creation unit 23 transfers a transfer destination information table in which the virtual address of the transfer destination node is associated with two or more storage nodes existing in the transfer destination. The information is registered in the destination information table storage unit 24.

  Specifically, the transfer destination information table creation unit 23 receives a virtual IP address assignment notification of the transfer destination node from the proxy node 10 and sets the virtual IP address in the transfer destination information table storage unit 24. Furthermore, when there are a plurality of destinations (storage nodes) ahead of the transfer destination node, the transfer destination information table creating unit 23 creates a transfer destination information table in which the transfer destination node and the plurality of destination nodes are associated with each other. The data is stored in the transfer destination information table storage unit 24.

  The UDP encapsulation packet transfer unit 25 transfers the target data received based on the contents of the transfer destination information table stored in the transfer destination information table storage unit 24 to the transfer destination node. Specifically, when the transfer destination node is registered in the transfer destination information table storage unit 24, the UDP encapsulating packet transfer unit 25 uses the transfer destination packet to store the storage destination address other than the storage node corresponding to the transfer destination node. Delete the packet and transfer the transfer packet to the transfer destination node. Further, the UDP encapsulation packet transfer means 25 copies and transfers the target data to the deleted storage address.

  For example, when receiving the encapsulated UDP packet addressed to the special port, the UDP encapsulation packet transfer means 25 analyzes the destination information in the data and duplicates the data according to the information in the transfer destination information table. Then, the UDP encapsulation packet transfer means 25 sends the copied data to the next switch intended.

  For example, in a cloud system using OpenStack Switch, the same data is stored in a plurality of storage nodes. At that time, a plurality of identical data originally flows in the network between the proxy node in the previous stage and the storage node in the subsequent stage. In the present embodiment, even when a plurality of identical data needs to pass through the same path in the network, it can be flowed as a single data, so that the network load between the proxy node and the storage node can be reduced. In particular, the load can be effectively reduced in a common network path where data is concentrated.

  The branch point determination means 21, address request means 22, transfer destination information table creation means 23, and UDP encapsulation packet transfer means 25 are realized by a CPU of a computer that operates according to a program (transfer data processing program). For example, the program is stored in a storage unit (not shown) of the switch 20, and the CPU reads the program, and according to the program, the branch point determination unit 21, the address request unit 22, the transfer destination information table creation unit 23, and the UDP The capsule packet transfer means 25 may operate.

  Further, each of the branch point determination means 21, the address request means 22, the transfer destination information table creation means 23, and the UDP encapsulation packet transfer means 25 may be realized by dedicated hardware.

  In addition, since the switch 20 processes the transfer packet generated by the proxy node 10 according to the transfer destination, the switch 20 can be called a transfer data processing device.

  Hereinafter, the operation of the connection management means 16 will be described in detail. First, the connection management unit 16 creates a special communication end point that collects communication end points to be created. At this time, the connection management means 16 creates this communication end point as a special port, and requests that the path switch to which the branch point determination means 11 assigns the IP address also create a communication end point that can receive the port of speciality. To do. At this time, the requested switch creates a communication endpoint in response to this request.

  Next, when performing broadcast communication, the connection management unit 16 establishes a connection to the data storage destination (storage node) selected by the data storage destination selection unit 17 and creates a child socket for each connection.

  At this time, the connection management means 16 refers to a storage location information table (not shown) that stores information of the storage that is the storage location. When there is no storage destination (storage node) information in the storage destination information table, the connection management unit 16 instructs the branch point determination unit 11 to update the storage destination information table. On the other hand, when the storage destination information exists in the storage destination information table, the connection management unit 16 puts the child socket under the management of the parent socket. That is, the connection management means 16 controls the connection information to be sent to the child socket so that the data passed to the child socket can be managed by the parent socket.

  Therefore, the child socket refers to the data by this control, but does not perform actual data transmission. The child socket notifies the parent socket of connection information (specifically, a partner address, a port, a self port, a sequence (seq) number, and an acknowledgment (ACK) number).

  As the communication end point of the parent socket (hereinafter referred to as the parent communication end point), the communication end point of the child socket (hereinafter referred to as the child communication end point) encapsulated by the UDP encapsulation packet creating means 15 is used. Note that communication end points using child sockets correspond to the respective storage nodes.

  When the UDP encapsulation packet creating means 15 transmits the encapsulated data, the parent socket updates the seq number of the child socket. The encapsulated data is finally sent to each data storage destination, and ACK is returned. On the other hand, the returned seq number and ACK number are notified from the child socket to the parent socket.

  The connection management unit 16 refers to the seq number notified from the parent socket, and when retransmission is necessary, retransmits using the data referenced by the child socket.

  Here, the operation when the child socket uses a TCP (Transmission Control Protocol) connection has been described. When the child socket is UDP, the connection information passed from the child socket to the parent socket is only the partner address, port, and own port. Further, the storage destination information stored in the created UDP encapsulation data is also only the storage destination address and the port number. Further, when the child socket is UDP, exchange of seq number and ACK number, management, and retransmission operations that are performed when a TCP connection is used are not necessary.

  FIG. 3 is an explanatory diagram illustrating an example of a communication method performed by the data transfer system of the present embodiment. In the present embodiment, the above-described operations (for example, Seq update, ACK notification, etc.) are performed between the proxy node and the switch. However, the packet (data) is sent to the client using a socket of a commonly used format. Sent and received. That is, communication performed between the client and the proxy node (in other words, between the client / server) is not different from normal socket communication.

  Next, the operation of the data transfer system of this embodiment will be described. Here, it is assumed that the data transfer system of this embodiment is used in the cloud system illustrated in FIG.

  First, the connection management unit 16 of the proxy node 10 creates a special parent socket in order to manage the connection established with the storage nodes 31 to 33. After the proxy node 10 receives the file (target data) from the client 40, the data storage destination selection unit 17 determines a plurality of storage nodes (three in this case) to store the file from the file information.

  The connection management means 16 notifies the connection information of the child socket to the parent socket in order to manage the child socket after creating the connection with the plurality of storage nodes 31 to 33. For example, when the child socket is TCP, the connection management means 16 notifies the parent socket as connection information of its own port number, partner address, partner port number, seq number, and ACK number. For example, when the child socket is UDP, the connection management unit 16 notifies the parent socket of its own port number, counterpart address, and counterpart port number as connection information.

  Next, the branch point determination unit 11 transmits a UDP packet of a special port for investigating the route to each of the storage nodes 31 to 33 determined as the communication destination. The branch point determination means 21 determines that it is a branch point when it sends out at least one UDP packet to a different physical port.

  In the example shown in FIG. 2, this UDP packet first passes through the switch A. The branch point determination means 21 of the switch A through which this packet has passed sends this UDP packet to a different physical port, and therefore determines that the switch A itself is the branch point.

  At this time, the address request means 22 requests that a virtual IP address be allocated to the transmission source of this UDP packet. If all the physical ports that send out the UDP packet in the switch are the same port, the address request unit 22 does not perform any processing.

  The address request unit 22 also notifies the sender of this UDP packet of a plurality of received storage destination addresses (storage node IP addresses). The proxy node 10 that is a transmission source receives data requesting an IP address. When the storage destination address assigned to the sent UDP packet is included in the data requesting the IP address, the branch point determination unit 11 assigns the virtual IP address to the switch A. Further, the transfer destination information table creation unit 13 stores the assigned IP address and storage destination address pair in the transfer destination information table storage unit 14.

  In the example shown in FIG. 2, this UDP packet further passes through the switch B. Therefore, the address request unit 22 of the switch B requests to allocate a virtual IP address to the transmission source of this UDP packet.

  Further, when a request for allocating a virtual IP address is made from the switch ahead (that is, switch B ahead of switch A), the data requesting the IP address is stored with the storage address reduced. Yes. This is because a part of the packet (the address of the storage node 3 in FIG. 2) branched by the upstream switch (here, switch A) does not reach the downstream switch (here, switch B). .

  The proxy node 10 (more specifically, the branch point determination unit 11) also allocates a virtual IP address to the switch B. The transfer destination information table creation unit 13 notifies the switch A of the virtual IP address assigned to the switch B and the storage destination address included in the data transmitted from the switch B when the IP address is requested. In the notified switch A, the transfer destination information table creation unit 23 stores the IP address and storage destination address of the switch B in the transfer destination information table storage unit 24 of the switch A itself.

  FIG. 4 is an explanatory diagram illustrating an example of a transfer destination information table generated in the cloud system illustrated in FIG. The proxy node 10 stores a transfer destination information table in which the IP address of the switch A that is the transfer destination node is associated with the storage nodes 1, 2, and 3 existing at the transfer destination of the switch A. In addition, the switch A stores a transfer destination information table in which the IP address of the switch B that is the transfer destination node is associated with the storage nodes 1 and 2 existing at the transfer destination of the switch B.

  Next, a method in which the proxy node 10 transmits the target data received from the client 40 to the plurality of storage nodes determined by the data storage destination selection unit 17 will be described. FIG. 5 is an explanatory diagram illustrating an example of a transfer packet.

  In the processing described above, the parent socket can acquire connection information from a child socket that has actually established connections with a plurality of storage nodes. Therefore, the UDP encapsulation packet creating means 15 encapsulates the data using this connection information, and transmits the target data together with the connection information to the transfer destination node (switch A in the description) shown in the transfer destination information table. .

  In the example shown in FIG. 2, the UDP encapsulation packet creating means 15 generates a transfer packet including the connection information of the storage nodes 1 to 3 (see FIG. 5A).

  When the switch A receives the UDP encapsulation packet, the UDP encapsulation packet transfer means 25 refers to the plurality of storage destination addresses included in the UDP encapsulation packet and compares the next transfer destination with the transfer destination information table provided in itself. decide.

  The UDP encapsulation packet transfer means 25 deletes the information of the storage node 3 that does not exist ahead of the switch B from the UDP encapsulation packet, and transfers the UDP encapsulation packet from which this information has been deleted to the switch B. Further, the UDP encapsulation packet transfer unit 25 transmits the connection information of the storage node 3 included in the encapsulation packet and the target data (that is, normal TCP data) to the storage node 3.

  In the switch B, the transfer destination information table is not stored in the transfer destination information table storage unit 24. Therefore, the UDP encapsulation packet transfer means 25 of the switch B adds the target data to each of the connection information of the storage node 1 and the connection information of the storage node 2 included in the UDP encapsulation packet, and transmits it to the transfer destination node ( (Refer FIG.5 (c)).

  Thereafter, each of the storage nodes 1 to 3 receives target data as normal TCP data and performs necessary processing.

  Here, with reference to FIG. 4 and FIG. 5, the operation in which each switch generates a transfer packet will be described in more detail. When transferring data, each switch refers to a transfer destination information table illustrated in FIG. 4 and searches for a data storage destination address group (storage node address group) as a transmission destination. When the address group exists in the transfer destination information table, the UDP encapsulation packet transfer unit 25 creates a UDP header in which the address of the transfer destination node is set as the transfer destination.

  Next, the UDP encapsulation packet transfer means 25 generates a transfer packet to which all the connection information (storage node IP address, port number, Seq number, and ACK number) with the storage node is added, and transmits it to the transfer destination node. To do.

  When a part of the storage destination address group is searched when the data storage destination address group is searched, the UDP encapsulation packet transfer means 25 encapsulates only the connection information of the searched storage destination and transfers the transfer destination. Transfer to node. On the other hand, the UDP encapsulation packet transfer means 25 does not encapsulate an address that does not exist in the transfer destination information table, adds the target data with the connection information of the storage destination as a header, and transfers it to the transfer destination node.

  For example, when the proxy node 10 stores the transfer destination information table illustrated in FIG. 4, the UDP encapsulation packet creating unit 15 encapsulates the addresses of the storage nodes 1 to 3 (storage destination addresses 1 to 3).

  Next, when the switch A stores the transfer destination information table illustrated in FIG. 4, the storage destination addresses 1 and 2 included in the UDP encapsulation packet match the addresses of the transfer destination information table. Therefore, the UDP encapsulation packet transfer means 25 encapsulates only the storage destination addresses 1 and 2 and transmits a normal TCP packet to the storage destination address 3.

  In addition, the transfer destination information table of switch B that has received the UDP encapsulation packet from switch A has no information. Therefore, the UDP encapsulation packet transfer unit 25 does not encapsulate any address, and transmits normal TCP packets to the storage destination addresses 1 and 2 respectively.

  Next, an operation in which the proxy node 10 determines a branch point will be described. FIG. 6 is a flowchart illustrating an example of an operation for determining a branch point. The data storage destination selection unit 17 of the proxy node 10 determines a plurality of storage destinations. Then, the branch point determination unit 11 transmits the UDP packet of the special port to each storage destination address (step S11).

  When each switch receives the UDP packet of the special port (Yes in step S12), the branch point determination unit 21 temporarily stores the source IP address, the destination IP address, and the physical port that transmitted the UDP packet. (Step S13). When a UDP packet is transmitted to a different physical port (Yes in step S14), the address request unit 22 requests an IP address from the transmission source. At this time, the address request unit 22 also transmits a storage destination address group received from the transmission source (step S15).

  If the packet received in step S12 is not a special port UDP packet (No in step S12), or if the physical port to which the UDP packet is transmitted is not different in step S14 (No in step S14), the processing Is not done.

  When the proxy node 10 as the transmission source receives an IP address request from the switch, the branch point determination unit 11 allocates a virtual IP address to the switch (step S16). Thereafter, processing for creating a transfer destination information table is performed.

  Next, an operation for creating a transfer destination information table will be described. FIG. 7 is a flowchart illustrating an example of an operation for creating a transfer destination information table.

  When the proxy node 10 receives the IP address request from the switch (step S21), the transfer destination information table creation unit 13 includes all the storage destination addresses transmitted together with the UDP packet in the storage destination address transmitted together with the IP address request. It is judged whether it is (step S22).

  When all the transmitted storage destinations are included (Yes in step S22), the transfer destination information table creating unit 13 displays a transfer destination information table in which the virtual IP address to be allocated and the storage destination address group are associated with each other. The data is stored in the storage unit 14 (step S23). In the example illustrated in FIG. 2, a case where the storage destination addresses of the storage nodes 1 to 3 are transmitted from the switch A to the proxy node 10 together with the IP address request.

  On the other hand, when not all of the transmitted storage destinations are included (No in step S22), the transfer destination information table creation unit 13 refers to the transfer destination information table and includes the storage destination address transmitted together with the IP address request. It is determined whether there is a virtual IP address associated with more storage destination addresses than the transmitted storage destination addresses among the virtual IP addresses (step S24).

  When the corresponding virtual IP address exists (Yes in step S24), the transfer destination information table creation unit 13 sets the virtual IP address to be allocated and the information of the storage destination address group to the virtual IP in which all the storage destination addresses are associated. The address is notified (step S25). In the example illustrated in FIG. 2, the case where the storage destination addresses of the storage nodes 1 and 2 are transmitted from the switch B to the proxy node 10 together with the IP address request corresponds. In this case, the virtual IP address allocated to the switch B and the address group of the storage nodes 1 and 2 are transmitted to the switch A.

  The switch receives information on the IP address and the storage destination address group (step S26). In the received switch, the transfer destination information table creation unit 23 stores the transfer destination information table in which the virtual IP address and the storage destination address group are associated with each other in the transfer destination information table storage unit 24 (step S27). In the example illustrated in FIG. 2, the switch A stores a transfer destination information table in which the virtual IP address is associated with the address group of the storage nodes 1 and 2.

  As described above, according to the present embodiment, the UDP encapsulation packet creating unit 15 of the proxy node 10 includes the transfer destination node of the target data, the storage destination addresses of the plurality of storages storing the target data, and the target A transfer packet including data is created and transmitted to the switch A. Further, when the transfer destination node is registered in the transfer destination information table, the UDP encapsulation packet transfer means 25 of the switch 20a deletes the transfer destination address other than the storage corresponding to the transfer destination node from the transfer packet and transfers it. Transfer to the destination node (switch B). Further, the UDP encapsulation packet transfer means 25 copies and transfers the target data to the deleted storage address. Therefore, when data is made redundant and stored in a plurality of storages, the network load between the data transmission side device and the storage can be reduced.

  That is, according to the present embodiment, when multiple writing is performed to a plurality of storage nodes on the network, the amount of data flowing through the network can be limited, so that the load on the entire system can be reduced. In particular, according to the present embodiment, since the load on the communication path where data is concentrated can be reduced, the load can be effectively reduced in the communication path that becomes a bottleneck.

  Further, in this embodiment, when the target data transmitted from the client 40 is received by the proxy node 10 and then written to a plurality of storage nodes via the network, data is not duplicated while the communication path is the same. I am doing so. The transfer destination information table includes an IP address assigned to a switch at the end of a common path through which data is sent to a plurality of selected data storage destinations. Up to the switch, UDP encapsulation data obtained by encapsulating common data is transmitted together with a plurality of storage destination information.

  Then, the UDP encapsulation packet transfer means 25 duplicates the data to be transmitted at the time when the communication path to the storage node branches. For this reason, it is possible to particularly reduce the network load of the route where the data amount is concentrated. In other words, originally, only one UDP encapsulation data is flowed on the common communication path where the same data should flow multiple times. Therefore, the network load on the common communication path where data is concentrated can be reduced.

  Further, when the data finally reaches the storage node of the storage destination, the encapsulation is released and each storage node can receive the data by a normal communication procedure.

  Next, the outline of the present invention will be described. FIG. 8 is a block diagram showing an outline of a data transfer system according to the present invention. The data transfer system according to the present invention stores target data in a plurality of storages via a network.

  A data transfer system according to the present invention includes a proxy server 80 (e.g., proxy node 10) that determines a plurality of storages (e.g., storage nodes 31 to 33) to store target data (e.g., received from the client 40), and A node 90 (for example, switches 20a to 20c) that receives data (for example, transfer packets) transmitted from the proxy server 80 and transfers the data to the storage.

  The node 90 is a transfer destination information that stores a transfer destination information table in which a transfer destination node that is a node to which data is transferred from the own node and a plurality of storages that store data that passes through the transfer destination node are associated with each other. Table storage means 91 (for example, transfer destination information table storage means 24) and data transfer means 92 (for example, UDP encapsulation packet transfer means 25) for transferring received data are included.

  The proxy server 80 creates a transfer packet (for example, a UDP encapsulation packet) including a transfer destination node of the target data, storage destination addresses of a plurality of storages in which the target data is stored, and the target data. Packet transmission means 81 (for example, UDP encapsulation packet creation means 15) for transmitting the transfer packet to the node 90 is included.

  The data transfer unit 92 of the node 90 (for example, the switch A in FIG. 2), when the transfer destination node (for example, the switch B in FIG. 2) is registered in the transfer destination information table storage unit 91, A storage destination address other than the corresponding storage (for example, storage nodes 1 and 2 in FIG. 2) (for example, the storage destination address of storage node 3 in FIG. 2) is deleted from the transfer packet, and the transfer packet is transferred to the transfer destination. Transfer to the node, copy the target data to the deleted storage address, and transfer.

  With such a configuration, when data is made redundant and stored in a plurality of storages, the network load between the data transmission side device and the storage can be reduced.

  Further, the proxy server 80 determines, as a branch point, a node on which a path for transmitting the target data to a plurality of storages branches (for example, a branch point is determined by transmitting a packet destined for a special port). (For example, the branch point determination means 11) and two or more storages (for example, storage nodes 1 and 2) at the transfer destination of the transfer destination node (for example, switch B) of the node indicating the branch point (for example, switch A). If it exists, the virtual address of the transfer destination node of the node indicating the branch point and two or more storages existing at the transfer destination are registered in the transfer destination information table storage unit 91 of the node indicating the branch point in association with each other. Transfer destination information registration means (for example, transfer destination information table creation means 13) to be included.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Supplementary note 1) In a data transfer system for storing the same target data in a plurality of storages via a network, a proxy server for determining a plurality of storages for storing the target data, and data transmitted from the proxy server A node that receives and transfers the data to the storage, and the node includes a transfer destination node that is a destination node to which data is transferred from the own node, and a plurality of storages in which data passing through the transfer destination node is stored. A transfer destination information table storage unit for storing the associated transfer destination information table; and a data transfer unit for transferring the received data, wherein the proxy server stores a transfer destination node of the target data and the target data. Create a transfer packet that includes the storage destination addresses of multiple storages and the target data. Packet transfer means for transmitting the transfer packet to the node, and the data transfer means of the node, when the transfer destination node is registered in the transfer destination information table storage means, A storage destination address other than the corresponding storage is deleted from the transfer packet, the transfer packet is transferred to the transfer destination node, and the target data is copied and transferred to the deleted storage destination address. And data transfer system.

(Supplementary Note 2) The proxy server uses a branch point determination unit that determines a node at which a path for transmitting target data to a plurality of storage branches as a branch point, and a transfer destination of a transfer destination node of the node indicating the branch point. When there are two or more storages, the transfer destination information table storage means of the node indicating the branch point includes a virtual address of the transfer destination node of the node indicating the branch point, and two or more storages existing at the transfer destination. The data transfer system according to appendix 1, further comprising transfer destination information registration means for registering them in association with each other.

(Supplementary Note 3) The node includes a branch point determination unit that determines whether or not the node itself is a branch point, and the branch point determination unit of the proxy server transmits a packet addressed to the special port to a path to each storage, and the branch The data transfer system according to supplementary note 2, wherein the point determination means determines that the own node is a branch point when the packet addressed to the special port is transmitted to a different physical port.

(Supplementary Note 4) When the node determines that the node is a branch point by the branch point determination means, the node proxies the request for the storage destination address of the storage existing at the transfer destination of the node and the virtual address to be allocated to the node. An address request means for transmitting to the server, the branch point determination means assigns a virtual address in response to the request, and the transfer destination information registration means includes the assigned virtual address and two or more storages existing at the transfer destination; The data transfer system according to appendix 3, wherein the information is registered in the transfer destination information table storage unit in association with each other.

(Supplementary Note 5) The proxy server includes connection management means for creating a second socket for managing a plurality of first sockets used for communication with the storage, and the packet transmission means uses the second socket. The data transfer system according to any one of appendix 1 to appendix 4, wherein the transfer packet is transmitted.

(Supplementary note 6) A transfer data transmitting apparatus for determining a plurality of storages to store the same target data, and transmitting the target data to each determined storage via a node on the network, wherein the target data A transfer packet including a transfer destination, a storage destination address of a plurality of storages in which the target data is stored, and the target data, and the target packet destined for the plurality of storages is branched. A data transmission apparatus for transfer, comprising: a packet transmission means for transmitting the transfer packet to a node that replicates the target data from and transmits the data to each storage.

(Supplementary note 7) A plurality of storages in which the same target data is to be stored are determined, a transfer packet is received from a transmission device that transmits the target data addressed to each determined storage, and the transfer data is transferred to the plurality of storages A data processing apparatus for transferring packets, in which a transfer destination node that is a node to which data is transferred from its own node and a plurality of storages that store data passing through the transfer destination node are associated with each other A transfer destination information table storing means for storing a destination information table; and when the transfer destination node is registered in the transfer destination information table storing means, a transfer destination node of the target data and a plurality of the target data stored therein When the transfer packet including the storage destination address of the storage and the target data is received from the transmission device, the transfer packet A data transfer means for deleting a storage destination address other than the storage corresponding to the transfer destination node from the network, transferring the address to the transfer destination node, and copying and transferring the target data to the deleted storage destination address; A data processing apparatus for transfer, comprising:

(Supplementary note 8) A network load reducing method for reducing the load on the network when storing the same target data in a plurality of storages via a network, wherein the proxy determines a plurality of storages to store the target data Data sent from the proxy server by the server creating a transfer packet including the transfer destination node of the target data, storage destination addresses of a plurality of storages storing the target data, and the target data The transfer packet is transmitted to the node that transfers the packet to the storage, and the node associates the transfer destination node with a plurality of storages that store data passing through the transfer destination node. If the transfer destination node to which data is transferred from the local node is registered in the destination information table, the transfer A storage destination address other than the storage corresponding to the destination node is deleted from the transfer packet, the transfer packet is transferred to the transfer destination node, and the target data is copied and transferred to the deleted storage destination address. A network load reducing method characterized by the above.

(Supplementary note 9) A transfer data transmission method for determining a plurality of storages to store the same target data, and transmitting the target data to each determined storage via a node on the network, wherein the target data Transfer packet including the transfer destination, the storage destination addresses of the plurality of storages in which the target data is stored, and the target data, and the transfer packet when the target data destined for the plurality of storages branches A transfer data transmission method, comprising: transmitting the transfer packet to a node that replicates target data from a node and transmits the data to each storage.

(Supplementary Note 10) A plurality of storages to store the same target data are determined, a transfer packet is received from a transmission device that transmits the target data destined for each determined storage, and the transfer data is transferred to the plurality of storages A transfer data processing method for transferring a packet, in which data is transferred from the own node to a transfer destination information table in which a transfer destination node is associated with a plurality of storages storing data passing through the transfer destination node. A transfer packet including a transfer destination node of the target data from the transmission device, storage destination addresses of a plurality of storages storing the target data, and the target data when a destination transfer destination node is registered Is received, the storage destination address other than the storage corresponding to the forwarding destination node is deleted from the forwarding packet and the forwarding packet is deleted. Transferred to Okusaki node, transfers data processing method characterized by transferring replicating the target data destined deleted storage address.

(Supplementary Note 11) A transfer data transmission program applied to a computer that determines a plurality of storages to store the same target data and transmits the target data to each determined storage via a node on the network. In the computer, a transfer packet including the transfer destination of the target data, storage destination addresses of the plurality of storages storing the target data, and the target data is created, and the target data addressed to the plurality of storages is created. A data transmission program for transfer for causing a node that replicates the target data from the transfer packet and transmits it to each storage to execute a packet transmission process for transmitting the transfer packet when the node branches.

(Supplementary Note 12) A plurality of storages to store the same target data are determined, a transfer packet is received from a transmission device that transmits the target data destined for each determined storage, and the transfer is transferred to the plurality of storages Transfer data processing program applied to a computer for transferring packets for transfer, wherein the transfer destination node associates a transfer destination node with a plurality of storages storing data passing through the transfer destination node When a transfer destination node to which data is transferred from the own node is registered in the table, the transfer destination node of the target data from the transmission device, and storage destination addresses of a plurality of storages storing the target data When the transfer packet including the target data is received, the transfer packet is transferred from the transfer packet to the transfer destination node. A transfer data processing program for deleting a storage destination address other than the corresponding storage, transferring it to the transfer destination node, and executing a data transfer process for copying and transferring the target data to the deleted storage destination address .

  The present invention is preferably applied to, for example, a cloud system using OpenStack that reduces a network load between a proxy node and a storage node when writing data.

DESCRIPTION OF SYMBOLS 10 Proxy node 11 Branch point determination means 12 Address notification means 13 Transfer destination information table creation means 14 Transfer destination information table storage means 15 UDP encapsulation packet creation means 16 Connection management means 17 Data storage destination selection means 20, 20a to 20c Switch 21 Branch Point decision means 22 Address request means 23 Transfer destination information table creation means 24 Transfer destination information table storage means 25 UDP encapsulation packet transfer means 31-33 Storage nodes (1-3)
40 clients

Claims (7)

In a data transfer system that stores the same target data in multiple storages via a network,
A proxy server for determining a plurality of storages to store the target data;
A node that receives data transmitted from the proxy server and transfers the data to the storage;
The node is
A transfer destination information table storage unit for storing a transfer destination information table in which a transfer destination node that transfers data from the own node and a plurality of storages in which data passing through the transfer destination node are stored are associated with each other; ,
Data transfer means for transferring received data ;
A branch point judging means for judging whether or not the own node is a branch point;
Address request for transmitting to the proxy server a request for the storage address of the storage existing at the transfer destination of the local node and the virtual address to be allocated to the local node when the branch point determining means determines that the local node is the branch point Means ,
The proxy server is
A packet that creates a transfer packet including a transfer destination node of the target data, storage destination addresses of a plurality of storages storing the target data, and the target data, and transmits the transfer packet to the node A transmission means ;
A branch point determination means for determining, as a branch point, a node at which a path for transmitting target data to the plurality of storages branches;
When two or more storages exist in the transfer destination of the transfer destination node of the node indicating the branch point, the transfer destination information table storage unit of the node indicating the branch point stores the transfer destination node of the node indicating the branch point. Transfer destination information registration means for registering a virtual address and two or more storages existing in the transfer destination in association with each other ;
The branch point determination means of the proxy server sends a packet addressed to the special port to the path to each storage,
The node branch point determination means determines that the own node is a branch point when transmitting the packet addressed to the special port to a different physical port,
The branch point determination means of the proxy server assigns a virtual address in response to the request for the virtual address,
The transfer destination information registration unit of the proxy server registers the allocated virtual address and two or more storages existing in the transfer destination in association with each other in the transfer destination information table storage unit,
When the transfer destination node is registered in the transfer destination information table storage unit, the data transfer unit of the node deletes the storage destination address other than the storage corresponding to the transfer destination node from the transfer packet, and A data transfer system, wherein a transfer packet is transferred to the transfer destination node, and the target data is copied and transferred to the deleted storage address. The proxy server
Including a connection management means for creating a second socket for managing a plurality of first sockets used for communication with the storage;
Packet transmission means, the data transfer system of claim 1, wherein transmitting the transfer packet by using the second socket. A data transmission device for transfer that determines a plurality of storages to store the same target data, and transmits the target data to each determined storage via a node on the network,
The node is a transfer destination information that stores a transfer destination information table in which a transfer destination node that is a node to which data is transferred from the own node and a plurality of storages that store data that passes through the transfer destination node are associated with each other. A table storage means,
When a transfer packet including the transfer destination of the target data, storage destination addresses of a plurality of storages storing the target data, and the target data is created, and the target data destined for the plurality of storages branches A packet transmission means for transmitting the transfer packet to a node that copies the target data from the transfer packet and transmits it to each storage ;
A branch point determination means for determining, as a branch point, a node at which a path for transmitting target data to the plurality of storages branches;
When two or more storages exist in the transfer destination of the transfer destination node of the node indicating the branch point, the transfer destination information table storage unit of the node indicating the branch point stores the transfer destination node of the node indicating the branch point. Transfer destination information registration means for registering a virtual address and two or more storages existing in the transfer destination in association with each other ;
The branch point determination means transmits a packet addressed to a special port to a path to each storage, and determines that the node is a branch point when the node determines that the special port address packet is transmitted to a different physical port. Assign a virtual address according to the request for the storage address of the storage that exists at the transfer destination of the local node and the virtual address to be allocated to the local node,
The transfer destination information registration unit registers the assigned virtual address and two or more storages existing in the transfer destination in association with each other in the transfer destination information table storage unit . Determine a plurality of storages to store the same target data, receive a transfer packet from a transmitting device that transmits the target data addressed to each determined storage, and transfer the transfer packet to the plurality of storages A data processing device for transfer,
A transfer destination information table storage unit for storing a transfer destination information table in which a transfer destination node that transfers data from the own node and a plurality of storages in which data passing through the transfer destination node are stored are associated with each other; ,
When the transfer destination node is registered in the transfer destination information table storage unit, the transfer destination node of the target data, storage destination addresses of a plurality of storages storing the target data, and the target data are included. When the transfer packet is received from the transmission device, the storage destination address other than the storage corresponding to the transfer destination node is deleted from the transfer packet and transferred to the transfer destination node, and the deleted storage address and data transfer means for transferring to replicate the target data addressed,
A branch point judging means for judging whether or not the data processing device for own transfer is a branch point;
When it is determined by the branch point determination means that the self-transfer data processing device is a branch point, the storage destination address of the storage existing at the transfer destination of the self-transfer data processing device and the self-transfer data processing device are allocated. Address request means for transmitting a request for a virtual address to the transmitter,
The branching point judging means receives a special port-addressed packet transmitted from the transmitting device to each storage path, and transmits the special-port-addressed packet to a different physical port. Judge as a branch point,
The data transfer means determines a node at which a path when the transmission device transmits target data to the plurality of storages in response to a request for the virtual address as a branch point, and transfers a node indicating the branch point When two or more storages exist in the transfer destination of the destination node, the transfer destination is associated with the virtual address assigned to the transfer destination node of the node indicating the branch point and the two or more storages existing in the transfer destination A data processing apparatus for transfer, which, when registered in the information table storage means, transfers the target data in accordance with the registered contents . A network load reduction method for reducing the load on the network when storing the same target data in a plurality of storages via a network,
A proxy server that determines a plurality of storages to store the target data includes a transfer destination node for the target data, storage destination addresses of a plurality of storages for storing the target data, and the target data Create a packet, send the transfer packet to the node that receives the data sent from the proxy server and forwards it to the storage,
The transfer destination node to which data is transferred from its own node is registered in the transfer destination information table in which the node associates the transfer destination node with a plurality of storages storing data passing through the transfer destination node. The storage destination address other than the storage corresponding to the transfer destination node is deleted from the transfer packet, the transfer packet is transferred to the transfer destination node, and the target data is sent to the deleted storage destination address. Duplicate and transfer ,
The proxy server sends a packet addressed to the special port to the path to each storage,
When the node transmits the packet addressed to the special port to a different physical port, the node determines that the node is a branch point, and determines that the node is a branch point. A request for a storage address and a virtual address to be allocated to the own node is sent to the proxy server,
The proxy server determines, as a branch point, a node at which a path when transmitting target data to the plurality of storages branches, and assigns a virtual address in response to the request for the virtual address,
When the proxy server has two or more storages in the transfer destination of the transfer destination node of the node indicating the branch point, the node indicating the branch point in the transfer destination information table storage unit of the node indicating the branch point A network load reduction method comprising: registering a virtual address assigned to a transfer destination node in association with two or more storages existing at the transfer destination . A data transmission program for transfer applied to a computer that determines a plurality of storages to store the same target data, and transmits the target data to each determined storage via a node on the network,
The node is a transfer destination information that stores a transfer destination information table in which a transfer destination node that is a node to which data is transferred from the own node and a plurality of storages that store data that passes through the transfer destination node are associated with each other. A table storage means,
In the computer,
When a transfer packet including the transfer destination of the target data, storage destination addresses of a plurality of storages storing the target data, and the target data is created, and the target data destined for the plurality of storages branches Packet transmission processing for transmitting the transfer packet to a node that copies the target data from the transfer packet and transmits it to each storage ,
A branch point determination process for determining, as a branch point, a node at which a path when transmitting target data to the plurality of storages branches; and
When two or more storages exist in the transfer destination of the transfer destination node of the node indicating the branch point, the transfer destination information table storage unit of the node indicating the branch point stores the transfer destination node of the node indicating the branch point. A transfer destination information registration process for registering a virtual address and two or more storages existing in the transfer destination in association with each other;
In the branch point determination process, the special port addressed packet is transmitted to the path to each storage, and when the node determines that the node is a branch point as transmitting the special port addressed packet to a different physical port, In response to a request for the storage address of the storage existing at the transfer destination of the local node and the virtual address to be allocated to the local node, the virtual address is allocated,
A transfer data transmission program for associating the allocated virtual address with two or more storages existing in the transfer destination in the transfer destination information registration process and registering them in the transfer destination information table storage means . Decide a plurality of storages to store the same target data, receive transfer packets from the transmitting device that transmits the target data addressed to each determined storage, and transfer the transfer packets to the plurality of storages A data processing program for transfer applied to a computer,
In the computer,
When a transfer destination node to which data is transferred from its own node is registered in a transfer destination information table in which a transfer destination node is associated with a plurality of storages storing data passing through the transfer destination node, When a transfer packet including a transfer destination node of the target data, storage destination addresses of a plurality of storages in which the target data is stored, and the target data is received from the transmission device, from the transfer packet, A data transfer process for deleting a storage destination address other than the storage corresponding to the transfer destination node, transferring the address to the transfer destination node, and copying and transferring the target data to the deleted storage destination address ;
A branch point determination process for determining whether or not the local computer is a branch point; and
When the branch point determination process determines that the own computer is a branch point, the storage destination address of the storage existing at the transfer destination of the own computer and the address for sending a request for a virtual address to be assigned to the own computer to the transmission device Execute request processing,
In the branch point determination process, when receiving a packet destined for a special port transmitted on the route from the transmitting device to each storage and transmitting the packet destined for the special port to a different physical port, the local computer is determined to be a branch point. Let
In the data transfer process, a node that branches a path when the transmission device transmits target data to the plurality of storages in response to a request for the virtual address is determined as a branch point, and a node indicating the branch point is transferred. When two or more storages exist in the transfer destination of the destination node, the transfer destination is associated with the virtual address assigned to the transfer destination node of the node indicating the branch point and the two or more storages existing in the transfer destination A transfer data processing program for transferring the target data in accordance with the registered contents when registered in the information table storage means .

Images