CN104580268A - Method and device for transmitting file data - Google Patents
Method and device for transmitting file data Download PDFInfo
- Publication number
- CN104580268A CN104580268A CN201310468020.7A CN201310468020A CN104580268A CN 104580268 A CN104580268 A CN 104580268A CN 201310468020 A CN201310468020 A CN 201310468020A CN 104580268 A CN104580268 A CN 104580268A
- Authority
- CN
- China
- Prior art keywords
- file data
- storage server
- file
- data blocks
- remote storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention discloses a method and device for transmitting file data. In the abovementioned method, a file service request message is received from a client, wherein, the file service request message is used to obtain the file data; under the circumstance that a local storage server lacks the file data requested by the client, a remote storage server corresponding to each file data block in the file data is obtained; and each obtained remote storage server is successively requested to send the file data block stored on the remote storage server to the client. According to the technical solution provided in the present invention, consumption of the storage server performance is further reduced during the file service process, the pressure on the internal storage network bandwidth is reduced, and the concurrent access performance of a distributed file system is greatly improved.
Description
Technical field
The present invention relates to the communications field, in particular to a kind of transmission method and device of file data.
Background technology
At present, along with the fast development of the Internet and multimedia industry, the media file storage of magnanimity is had higher requirement to memory technology and system.In order to guarantee high reliability, Large Copacity and cost performance, most of IT vendor and Internet service business usually adopt distributed file system to store data.These systems usually adopt the mode of redundant storage to ensure the reliability storing data, make up the deficiency on hardware with reliable software, thus provide cheap magnanimity distributed storage and computing system reliably.
In the file service application of distributed file system, usually meta data server, document storage server and file access server is all comprised, wherein, document storage server and file access server all combine usually (referred to as storage server, providing file service function) simultaneously.Client user, when demand file service, if the data of user's request are on local storage server, then can directly obtain file data from local memory device and provide file service; And if the data of user's request are not on local storage server, but be stored in remote storage server, then need by storage inside network, file data first to be sent remote storage server, and then provide file service to client.Such as: when distributed file system is applied to the service of IPTV (IPTV) files in stream media, real time streaming transport protocol (RTSP) the files in stream media service request that main control server receiving set up box sends, main control server control store server provides streaming media service, notice storage server reading flow media file, and file data is packaged into real-time transport protocol (rtp) bag and sends to Set Top Box.
Under above-mentioned service mode, file data blocks distributes more even at storage server each other, distributed file system is when providing file service, and need the volume of transmitted data of carrying out between storage server larger, the pressure produced inner storage networking is also larger.This adds very large pressure virtually to storage inside network and local storage server; And file data stores overstepping the bounds of propriety loose, the expense of distributed file system inside is also larger, and this will directly have influence on the Concurrency Access performance of distributed file system.When distributed file system provides file service, how can reduce the impact on storage server performance and the storage inside network bandwidth, for promoting the use of of distributed file system, there is important Research Significance.
As can be seen here, in correlation technique, when distributed file system provides file service, how can reduce the impact of storage server performance and the storage inside network bandwidth is technical barrier urgently to be resolved hurrily.
Summary of the invention
The invention provides a kind of transmission method and device of file data, at least to solve in correlation technique when distributed file system provides file service, how can reduce the problem of the impact on storage server performance and the storage inside network bandwidth.
According to an aspect of the present invention, a kind of transmission method of file data is provided.
Transmission method according to file data of the present invention comprises: receive the file server requests message coming from client, wherein, file server requests message is for obtaining file data; When determining that local storage server lacks the file data of client-requested, obtain the remote storage server corresponding with each file data blocks in file data; Each remote storage server got is asked to send the file data blocks that this remote storage server stores to client successively.
Preferably, obtain the remote storage server corresponding with each file data blocks in file data to comprise: the ordinal relation obtaining the multiple file data blocks in file data; Relation searches the multiple remote storage server corresponding with each file data blocks successively in order, and from multiple remote storage server, chooses current remote storage server the most idle for client and provide file data blocks service.
Preferably, after obtaining the remote storage server corresponding with each file data blocks in file data, also comprise: send file service updating message to client, wherein, the information of carrying in file service updating message comprises: the service source address information of the remote storage server got, and whether the file data blocks that service source address information receives for client validation derives from the remote storage server got.
Preferably, ask each remote storage server to send to client the file data blocks that this remote storage server stores successively to comprise: from file server requests message, parse the address of service information of client and the service request information of client, wherein, address of service information and service request information encapsulate for the remote storage server got the file data blocks stored and are sent to client; File data blocks service request information is sent to the remote storage server got, wherein, the information of carrying in file data blocks service request information comprises: the routing information of the file data blocks that the remote storage server that gets stores, address of service information and service request information, and routing information reads for the remote storage server got the file data blocks stored; Receive the file data blocks service end coming from the remote storage server got, and continue to be chosen for the remote storage server that client provides next file data blocks to serve, until all files data block in file data is all disposed.
Preferably, after sending asking each remote storage server successively the file data blocks that this remote storage server stores to client, also comprise: determine that all files data block in the file data of client-requested is sent all; Send file request to client and complete message, wherein, file request completes message for notifying that the current file server requests of client completes.
According to a further aspect in the invention, a kind of transmitting device of file data is provided.
Transmitting device according to file data of the present invention comprises: receiver module, and for receiving the file server requests message coming from client, wherein, file server requests message is for obtaining file data; Acquisition module, for when determining that local storage server lacks the file data of client-requested, obtains the remote storage server corresponding with each file data blocks in file data; Request module, sends for asking each remote storage server got successively the file data blocks that this remote storage server stores to client.
Preferably, acquisition module comprises: acquiring unit, for obtaining the ordinal relation of the multiple file data blocks in file data; Choose unit, search the multiple remote storage server corresponding with each file data blocks successively for relation in order, and from multiple remote storage server, choose current remote storage server the most idle for client file data blocks service is provided.
Preferably, said apparatus also comprises: the first sending module, for sending file service updating message to client, wherein, the information of carrying in file service updating message comprises: the service source address information of the remote storage server got, and whether the file data blocks that service source address information receives for client validation derives from the remote storage server got.
Preferably, request module comprises: resolution unit, for the service request information of the address of service information and client that parse client from file server requests message, wherein, address of service information and service request information encapsulate for the remote storage server got the file data blocks stored and are sent to client; Transmitting element, for sending file data blocks service request information to the remote storage server got, wherein, the information of carrying in file data blocks service request information comprises: the routing information of the file data blocks that the remote storage server that gets stores, address of service information and service request information, and routing information reads for the remote storage server got the file data blocks stored; Receiving element, for receiving the file data blocks service end coming from the remote storage server got, and continue to be chosen for the remote storage server that client provides next file data blocks to serve, until all files data block in file data is all disposed.
Preferably, said apparatus also comprises: determination module, for determining that all files data block in the file data of client-requested is sent all; Second sending module, completes message for sending file request to client, and wherein, file request completes message for notifying that the current file server requests of client completes.
By the present invention, adopt the file server requests message receiving and come from client, wherein, file server requests message is for obtaining file data, when determining that local storage server lacks the file data of client-requested, obtain the remote storage server corresponding with each file data blocks in file data, each remote storage server got is asked to send the file data blocks that this remote storage server stores to client successively, moving to successively by file service deposits in the remote storage server of file data blocks, by orientating the remote storage server of client service successively as and connecting successively with each remote storage server respectively, each file data blocks in file data is sent by a remote storage server respectively, to solve in correlation technique when distributed file system provides file service thus, how can reduce the problem of the impact on storage server performance and the storage inside network bandwidth, and then the consumption reduced to storage server performance in file service process, decrease the pressure to inner storage networking bandwidth, significantly improve the Concurrency Access performance of distributed file system.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, and form a application's part, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the flow chart of the transmission method of file data according to the embodiment of the present invention;
Fig. 2 is the flow chart realizing file service relay method according to the preferred embodiment of the invention;
Fig. 3 is the structured flowchart of the transmitting device of file data according to the embodiment of the present invention;
Fig. 4 is the structured flowchart of the transmitting device of file data according to the preferred embodiment of the invention;
Fig. 5 is the structural representation of file service relay system according to the preferred embodiment of the invention.
Embodiment
Hereinafter also describe the present invention in detail with reference to accompanying drawing in conjunction with the embodiments.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.
Fig. 1 is the flow chart of the transmission method of file data according to the embodiment of the present invention.As shown in Figure 1, the method can comprise following treatment step:
Step S102: receive the file server requests message coming from client, wherein, file server requests message is for obtaining file data;
Step S104: when determining that local storage server lacks the file data of client-requested, obtains the remote storage server corresponding with each file data blocks in file data;
Step S106: ask each remote storage server got to send the file data blocks that this remote storage server stores to client successively.
In correlation technique, when distributed file system provides file service, how can reduce the impact on storage server performance and the storage inside network bandwidth.Adopt method as shown in Figure 1, receive the file server requests message coming from client, wherein, file server requests message is for obtaining file data, when determining that local storage server lacks the file data of client-requested, obtain the remote storage server corresponding with each file data blocks in file data, each remote storage server got is asked to send the file data blocks that this remote storage server stores to client successively, moving to successively by file service deposits in the remote storage server of file data blocks, by orientating the remote storage server of client service successively as and connecting successively with each remote storage server respectively, each file data blocks in file data is sent by a remote storage server respectively, to solve in correlation technique when distributed file system provides file service thus, how can reduce the problem of the impact on storage server performance and the storage inside network bandwidth, and then the consumption reduced to storage server performance in file service process, decrease the pressure to inner storage networking bandwidth, significantly improve the Concurrency Access performance of distributed file system.
Preferably, in step S104, obtain the remote storage server corresponding with each file data blocks in file data and can comprise following operation:
Step S1: the ordinal relation obtaining the multiple file data blocks in file data;
Step S2: relation searches the multiple remote storage server corresponding with each file data blocks successively in order, and from multiple remote storage server, choose current remote storage server the most idle for client file data blocks service is provided.
In a preferred embodiment, a file data blocks distribution map is included in main control server, can the remote storage server at direct locating file data block place, and without the need to connecting with each remote storage server simultaneously, but process each file data blocks successively.Such as: main control server is after receiving the file server requests message coming from client, the Storage Server List at first file data blocks place of this file data can be inquired about according to the file name of carrying in file server requests message, and select a most idle storage server to provide service for it.Can learn second file data blocks after being positioned at first file data blocks subsequently according to the metadata information on main control server, starting to find new storage server for client provides service.By inquiring about the Storage Server List at second file data blocks place, and select a most idle storage server to provide service.By that analogy, until by the Storage Server List at last file data blocks place of inquiry, and select a most idle storage server to provide service.
Preferably, in step S104, after obtaining the remote storage server corresponding with each file data blocks in file data, can also comprise the following steps:
Step S3: send file service updating message to client, wherein, the information of carrying in file service updating message comprises: the service source address information of the remote storage server got, and whether the file data blocks that service source address information receives for client validation derives from the remote storage server got.
In a preferred embodiment, after determining storage server by selection, main control server can send file service updating message to client, to notify which storage server is the service source address of each file data blocks of client be specially.The service source address information of current record, after receiving above-mentioned file service updating message, is updated to the storage server of main control server notice by client.Client, after receiving file data bag, confirms by examination service source address information whether the service source of file data blocks is the storage server that main control server notifies.
Preferably, in step s 106, ask each remote storage server to send to client the file data blocks that this remote storage server stores successively and can comprise following operation:
Step S4: parse the address of service information of client and the service request information of client from file server requests message, wherein, address of service information and service request information encapsulate for the remote storage server got the file data blocks stored and are sent to client;
Step S5: send file data blocks service request information to the remote storage server got, wherein, the information of carrying in file data blocks service request information comprises: the routing information of the file data blocks that the remote storage server that gets stores, address of service information and service request information, and routing information reads for the remote storage server got the file data blocks stored;
Step S6: receive the file data blocks service end coming from the remote storage server got, and continue to be chosen for the remote storage server that client provides next file data blocks to serve, until all files data block in file data is all disposed.
In a preferred embodiment, first, client sends file server requests message to main control server, and wherein, the information of carrying in this file service request information comprises: the file name of request service, address of service and service request.Secondly, main control server sends file data blocks service request information to storage server, and the information of carrying in this file data blocks service request information comprises: the address of service of the routing information of file data blocks on storage server and client and service request information.Storage server after receiving this file data blocks service request information, according to the content of the routing information file reading data block of file data blocks on storage server; Then according to service request information, file data blocks is carried out packing process, and become file data bag to send to client according to address of service Information encapsulation.
Preferably, in step S106, ask each remote storage server to after client sends the file data blocks that this remote storage server stores successively, can also comprise the following steps:
Step S7: determine that all files data block in the file data of client-requested is sent all;
Step S8: send file request to client and complete message, wherein, file request completes message for notifying that the current file server requests of client completes.
In a preferred embodiment, main control server is after receiving last file data blocks service end, learn that this file data blocks is last file data blocks of file data request according to the metadata information on main control server, namely now the file request of client is disposed, therefore can send file request to client and complete message.Client, receiving after this file request completes message, terminates this file service.
Below in conjunction with the preferred implementation shown in Fig. 2, above-mentioned preferred implementation process is further described.
Fig. 2 is the flow chart realizing file service relay method according to the preferred embodiment of the invention.As shown in Figure 2, between client and main control server, carry out file service interacting message, between main control server and storage server, carry out file data blocks service message mutual, and storage server provides file data blocks service for client.The method realizing file service relay in distributed file system application can comprise the following steps:
Step S202: client sends file server requests message to main control server, and wherein, the information of carrying in this file service request information comprises: the file name of request service, address of service and service request.
Step S204: main control server is after receiving this file service request information, the Storage Server List at first file data blocks A place of this file data can be inquired about according to file name, and select a most idle storage server 1 to provide service for it.After determining storage server 1 by selection, send file service updating message 1 to client, to notify that the service source address of client first file data blocks A is for storage server 1.Client is after receiving this file service updating message, and upgrading service source address information is storage server 1.
The information such as the address of service of step S206: main control server sends file data blocks A service request information to storage server 1, and the information of carrying in this file data blocks A service request information comprises: file data blocks A routing information on storage server 1 and client and service request.
Step S208: storage server 1 after receiving this file data blocks A service request information, according to the routing information of file data blocks A on storage server 1, the content of file reading data block A; Then according to service request information, file data blocks A is packed, and become file data bag to send to client according to address of service Information encapsulation.Client, after receiving file data bag, confirms that by inspection the service source of file data blocks A is storage server 1.
Step S210: storage server 1 sends file data blocks A to main control server and serves end after completing and providing file data blocks A to serve to client.
Step S212: main control server is served after end receiving file data blocks A, according to the metadata information on main control server learn be positioned at file data blocks A after be file data blocks B, starting to find new storage server for client provides service.By the Storage Server List at inquiry file data block B place, and select a most idle storage server 2 to provide service.After determining storage server 2 by selection, send file service updating message 2 to client, to notify that the service source address of the next file data blocks B of client is for storage server 2.Client is after receiving this file service updating message, and upgrading service source address information is storage server 2.
The information such as the address of service of step S214: main control server sends file data blocks B service request information to storage server 2, and the information of carrying in this file data blocks B service request information comprises: file data blocks B routing information on storage server 2 and client and service request.
Step S216: storage server 2 after receiving this file data blocks B service request information, according to the routing information of file data blocks B on storage server 2, the content of file reading data block B; Then according to service request information, file data blocks B is packed, and become file data bag to send to client according to address of service Information encapsulation.Client, after receiving file data bag, confirms that by inspection the service source of file data blocks B is storage server 2.
Step S218: storage server 2 sends file data blocks B to main control server and serves end after completing and providing file data blocks B to serve to client.
Step S220: main control server is served after end receiving file data blocks B, according to the metadata information on main control server learn be positioned at file data blocks B after be file data blocks C, starting to find new storage server for client provides service.By the Storage Server List at inquiry file data block C place, and select a most idle storage server 3 to provide service.After determining storage server 3 by selection, send file service updating message 3 to client, to notify that the service source address of the next file data blocks C of client is for storage server 3.Client is after receiving this file service updating message, and upgrading service source address information is storage server 3.
The information such as the address of service of step S222: main control server sends file data blocks C service request information to storage server 3, and the information of carrying in this file data blocks C service request information comprises: file data blocks C routing information on storage server 3 and client and service request.
Step S224: storage server 3 after receiving this file data blocks C service request information, according to the routing information of file data blocks C on storage server 3, the content of file reading data block C; Then according to service request information, file data blocks C is packed, and become file data bag to send to client according to address of service Information encapsulation.Client, after receiving file data bag, confirms that by inspection the service source of file data blocks C is storage server 3.
Step S226: storage server 3 sends file data blocks C to main control server and serves end after completing and providing file data blocks C to serve to client.
Step S228: main control server is after receiving file data blocks C service end, learn that file data blocks C is last file data blocks of these demand file data according to the metadata information on main control server, namely now the file request of client is disposed, therefore can send file request to client and complete message.Client, receiving after this file request completes message, completes this file service.
In sum, the embodiment of the present invention is in distributed file system application, when providing file service to client, in order to reduce data transmission of pressure on storage inside network, simultaneously in order to reduce the overhead of internal network communication, main control server selects the local storage server depositing service data to provide service for client as far as possible.When the current file data block deposited when storage server this locality completes service, main control server by the storage server of services migrating to next file data blocks, can continue as client and provides continual service.By the way, between multiple storage server, achieve service relay, will the concurrent file access performance significantly promoting distributed file system be contributed to.
Fig. 3 is the structured flowchart of the transmitting device of file data according to the embodiment of the present invention.As shown in Figure 1, the transmitting device of this file data can comprise: receiver module 10, and for receiving the file server requests message coming from client, wherein, file server requests message is for obtaining file data; Acquisition module 20, for when determining that local storage server lacks the file data of client-requested, obtains the remote storage server corresponding with each file data blocks in file data; Request module 30, sends for asking each remote storage server got successively the file data blocks that this remote storage server stores to client.
Adopt device as shown in Figure 3, to solve in correlation technique when distributed file system provides file service, how can reduce the problem of the impact on storage server performance and the storage inside network bandwidth, and then the consumption reduced to storage server performance in file service process, decrease the pressure to inner storage networking bandwidth, significantly improve the Concurrency Access performance of distributed file system.
Preferably, as shown in Figure 4, acquisition module 20 can comprise: acquiring unit 200, for obtaining the ordinal relation of the multiple file data blocks in file data; Choose unit 202, search the multiple remote storage server corresponding with each file data blocks successively for relation in order, and from multiple remote storage server, choose current remote storage server the most idle for client file data blocks service is provided.
Preferably, as shown in Figure 4, said apparatus can also comprise: the first sending module 40, for sending file service updating message to client, wherein, the information of carrying in file service updating message comprises: the service source address information of the remote storage server got, and whether the file data blocks that service source address information receives for client validation derives from the remote storage server got.
Preferably, as shown in Figure 4, request module 30 can comprise: resolution unit 300, for the service request information of the address of service information and client that parse client from file server requests message, wherein, address of service information and service request information encapsulate for the remote storage server got the file data blocks stored and are sent to client; Transmitting element 302, for sending file data blocks service request information to the remote storage server got, wherein, the information of carrying in file data blocks service request information comprises: the routing information of the file data blocks that the remote storage server that gets stores, address of service information and service request information, and routing information reads for the remote storage server got the file data blocks stored; Receiving element 304, for receiving the file data blocks service end coming from the remote storage server got, and continue to be chosen for the remote storage server that client provides next file data blocks to serve, until all files data block in file data is all disposed.
Preferably, as shown in Figure 4, said apparatus can also comprise: determination module 50, for determining that all files data block in the file data of client-requested is sent all; Second sending module 60, completes message for sending file request to client, and wherein, file request completes message for notifying that the current file server requests of client completes.
Fig. 5 is the structural representation of file service relay system according to the preferred embodiment of the invention.As shown in Figure 5, this file service relay system can comprise: main control server, storage server and client.
Main control server, be integrated with metadata and file service scheduling feature, for being in charge of the file metadata information in distributed file system, wherein, can comprise: file directory or filename, the distribution of file data blocks on storage server, be responsible for the file server requests that process client sends simultaneously, file data is carried out deconsolidation process according to the size of file data blocks, then storage server is chosen for client according to the strategy preset to each file data blocks request and service is provided, service relay can be carried out according to data block between storage server to realize file server requests.Meanwhile, when converting between different storage servers, file service updating message can be sent to client.Finally, after the service of all files data block completes, file service can also be sent to client and complete message.
Storage server, be integrated with file data service and file data memory function, for according to main control server metadata information stores file data blocks, be responsible for the file data blocks service request that process main control server sends simultaneously, then from file reading data block local memory device, require organize and send to client according to data, services.After the service of file data blocks completes, then send file data blocks service response message to main control server.
Client, for sending file server requests to main control server, and can receive the file service updating message of main control server transmission, to receive the file data blocks service provided from different storage server.
From above description, can find out, above embodiments enable following technique effect (it should be noted that these effects are effects that some preferred embodiment can reach): the technical scheme provided according to the embodiment of the present invention, in distributed file system application, when providing file service to client, in order to reduce data transmission of pressure on storage inside network, simultaneously in order to reduce the overhead of internal network communication, main control server selects the local storage server depositing service data to provide service for client as far as possible.When the current file data block deposited when storage server this locality completes service, main control server by the storage server of services migrating to next file data blocks, can continue as client and provides continual service.By the way, between multiple storage server, achieve service relay, will the concurrent file access performance significantly promoting distributed file system be contributed to.
Obviously, those skilled in the art should be understood that, above-mentioned of the present invention each module or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on network that multiple calculation element forms, alternatively, they can realize with the executable program code of calculation element, thus, they can be stored and be performed by calculation element in the storage device, and in some cases, step shown or described by can performing with the order be different from herein, or they are made into each integrated circuit modules respectively, or the multiple module in them or step are made into single integrated circuit module to realize.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a transmission method for file data, is characterized in that, comprising:
Receive the file server requests message coming from client, wherein, described file server requests message is for obtaining file data;
When determining that local storage server lacks the described file data of described client-requested, obtain the remote storage server corresponding with each file data blocks in described file data;
Each remote storage server got is asked to send the file data blocks that this remote storage server stores to described client successively.
2. method according to claim 1, is characterized in that, obtains the remote storage server corresponding with each file data blocks in described file data and comprises:
Obtain the ordinal relation of the multiple file data blocks in described file data;
Search the multiple remote storage server corresponding with each file data blocks successively according to described ordinal relation, and from described multiple remote storage server, choose current remote storage server the most idle for described client file data blocks service is provided.
3. method according to claim 1, is characterized in that, after obtaining the remote storage server corresponding with each file data blocks in described file data, also comprises:
File service updating message is sent to described client, wherein, the information of carrying in described file service updating message comprises: described in the service source address information of remote storage server that gets, described service source address information be used for file data blocks that described client validation receives whether derive from described in the remote storage server that gets.
4. method according to claim 1, is characterized in that, asks each remote storage server to send to described client the file data blocks that this remote storage server stores successively and comprises:
The address of service information of described client and the service request information of described client is parsed from described file server requests message, wherein, described address of service information and described service request information be used for described in the file data blocks of remote storage server to described storage that get encapsulate and be sent to described client;
File data blocks service request information is sent to the described remote storage server got, wherein, the information of carrying in described file data blocks service request information comprises: described in the routing information of the file data blocks that stores of the remote storage server that gets, described address of service information and described service request information, the remote storage server got described in described routing information is used for reads the file data blocks of described storage;
Receive the file data blocks service end of the remote storage server got described in coming from, and continue to be chosen for the remote storage server that described client provides next file data blocks to serve, until all files data block in described file data is all disposed.
5. method according to claim 1, is characterized in that, is asking each remote storage server to after described client sends the file data blocks that this remote storage server stores successively, is also comprising:
Determine that all files data block in the described file data of described client-requested is sent all;
Send file request to described client and complete message, wherein, described file request completes message for notifying that the current file server requests of described client completes.
6. a transmitting device for file data, is characterized in that, comprising:
Receiver module, for receiving the file server requests message coming from client, wherein, described file server requests message is for obtaining file data;
Acquisition module, for when determining that local storage server lacks the described file data of described client-requested, obtains the remote storage server corresponding with each file data blocks in described file data;
Request module, sends for asking each remote storage server got successively the file data blocks that this remote storage server stores to described client.
7. device according to claim 6, is characterized in that, described acquisition module comprises:
Acquiring unit, for obtaining the ordinal relation of the multiple file data blocks in described file data;
Choose unit, for searching the multiple remote storage server corresponding with each file data blocks successively according to described ordinal relation, and from described multiple remote storage server, choose current remote storage server the most idle for described client file data blocks service is provided.
8. device according to claim 6, is characterized in that, described device also comprises:
First sending module, for sending file service updating message to described client, wherein, the information of carrying in described file service updating message comprises: described in the service source address information of remote storage server that gets, described service source address information be used for file data blocks that described client validation receives whether derive from described in the remote storage server that gets.
9. device according to claim 6, is characterized in that, described request module comprises:
Resolution unit, for parsing the address of service information of described client and the service request information of described client from described file server requests message, wherein, described address of service information and described service request information be used for described in the file data blocks of remote storage server to described storage that get encapsulate and be sent to described client;
Transmitting element, for sending file data blocks service request information to the described remote storage server got, wherein, the information of carrying in described file data blocks service request information comprises: described in the routing information of the file data blocks that stores of the remote storage server that gets, described address of service information and described service request information, the remote storage server got described in described routing information is used for reads the file data blocks of described storage;
Receiving element, for receive come from described in get remote storage server file data blocks service end, and continue to be chosen for the remote storage server that described client provides next file data blocks to serve, until all files data block in described file data is all disposed.
10. device according to claim 6, is characterized in that, described device also comprises:
Determination module, for determining that all files data block in the described file data of described client-requested is sent all;
Second sending module, completes message for sending file request to described client, and wherein, described file request completes message for notifying that the current file server requests of described client completes.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310468020.7A CN104580268A (en) | 2013-10-09 | 2013-10-09 | Method and device for transmitting file data |
| PCT/CN2014/076627 WO2014177058A1 (en) | 2013-10-09 | 2014-04-30 | Transmission method and device for file data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310468020.7A CN104580268A (en) | 2013-10-09 | 2013-10-09 | Method and device for transmitting file data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104580268A true CN104580268A (en) | 2015-04-29 |
Family
ID=51843144
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310468020.7A Withdrawn CN104580268A (en) | 2013-10-09 | 2013-10-09 | Method and device for transmitting file data |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104580268A (en) |
| WO (1) | WO2014177058A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105187489A (en) * | 2015-08-05 | 2015-12-23 | 深圳联友科技有限公司 | File transfer method and system capable of clustering and supporting multiple users to upload simultaneously |
| WO2016206192A1 (en) * | 2015-06-24 | 2016-12-29 | 中兴通讯股份有限公司 | Data processing method and device for database |
| CN107566477A (en) * | 2017-08-28 | 2018-01-09 | 北京奇艺世纪科技有限公司 | A kind of method and apparatus that file is obtained in distributed file system cluster |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050172080A1 (en) * | 2002-07-04 | 2005-08-04 | Tsutomu Miyauchi | Cache device, cache data management method, and computer program |
| CN1900931A (en) * | 2006-07-04 | 2007-01-24 | 华为技术有限公司 | Multiple machine file storage system and method |
| CN101599994A (en) * | 2009-06-01 | 2009-12-09 | 中兴通讯股份有限公司 | The method of transfer files data between distributed file system, access node and node |
| CN101707684A (en) * | 2009-10-14 | 2010-05-12 | 北京东方广视科技股份有限公司 | Method, device and system for dispatching Cache |
| CN101777031A (en) * | 2009-01-14 | 2010-07-14 | 中兴通讯股份有限公司 | Direct memory access controller and data transmission method |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AUPO899697A0 (en) * | 1997-09-05 | 1997-10-02 | Bardell, Norman John Charles | Data dissemination system for computer networks |
| US8910149B2 (en) * | 2010-12-24 | 2014-12-09 | Microsoft Corporation | On-demand or incremental remote data copy |
| US8886752B2 (en) * | 2011-11-21 | 2014-11-11 | Sony Computer Entertainment America | System and method for optimizing transfers of downloadable content |
| CN102739791B (en) * | 2012-06-28 | 2017-04-05 | 北京奇虎科技有限公司 | A kind of download of file, method for uploading and device |
| CN103220367A (en) * | 2013-05-13 | 2013-07-24 | 深圳市中博科创信息技术有限公司 | Data replicating method and data storing system |
-
2013
- 2013-10-09 CN CN201310468020.7A patent/CN104580268A/en not_active Withdrawn
-
2014
- 2014-04-30 WO PCT/CN2014/076627 patent/WO2014177058A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050172080A1 (en) * | 2002-07-04 | 2005-08-04 | Tsutomu Miyauchi | Cache device, cache data management method, and computer program |
| CN1900931A (en) * | 2006-07-04 | 2007-01-24 | 华为技术有限公司 | Multiple machine file storage system and method |
| CN101777031A (en) * | 2009-01-14 | 2010-07-14 | 中兴通讯股份有限公司 | Direct memory access controller and data transmission method |
| CN101599994A (en) * | 2009-06-01 | 2009-12-09 | 中兴通讯股份有限公司 | The method of transfer files data between distributed file system, access node and node |
| CN101707684A (en) * | 2009-10-14 | 2010-05-12 | 北京东方广视科技股份有限公司 | Method, device and system for dispatching Cache |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016206192A1 (en) * | 2015-06-24 | 2016-12-29 | 中兴通讯股份有限公司 | Data processing method and device for database |
| CN105187489A (en) * | 2015-08-05 | 2015-12-23 | 深圳联友科技有限公司 | File transfer method and system capable of clustering and supporting multiple users to upload simultaneously |
| CN107566477A (en) * | 2017-08-28 | 2018-01-09 | 北京奇艺世纪科技有限公司 | A kind of method and apparatus that file is obtained in distributed file system cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014177058A1 (en) | 2014-11-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102771080B (en) | Use the system and method that the efficient media of buffer memory transmits | |
| US8606996B2 (en) | Cache optimization | |
| US8521851B1 (en) | DNS query processing using resource identifiers specifying an application broker | |
| US8521885B1 (en) | Dynamically translating resource identifiers for request routing using popularity information | |
| US8756341B1 (en) | Request routing utilizing popularity information | |
| KR101379864B1 (en) | Request routing using network computing components | |
| CN102118376B (en) | Content delivery network service device and content download method | |
| US8407260B2 (en) | Method and apparatus for caching broadcasting information | |
| US20140074961A1 (en) | Efficiently Delivering Time-Shifted Media Content via Content Delivery Networks (CDNs) | |
| CN104283933A (en) | Data downloading method, client-side and system | |
| US8903972B2 (en) | Method and apparatus for sharing contents using information of group change in content oriented network environment | |
| CN104714965A (en) | Static resource weight removing method, and static resource management method and device | |
| CN103631820B (en) | The metadata management method and equipment of distributed file system | |
| US9479607B2 (en) | Content caching and delivering system with traffic of repetitively requested content reduced | |
| CN107566477B (en) | Method and device for acquiring files in distributed file system cluster | |
| CN102438004A (en) | Method and system for acquiring metadata information of media file and multimedia player | |
| CN104935653A (en) | Bypass cache method for visiting hot spot resource and device | |
| CN107070978B (en) | Method and system for cross-network proxy Web map service and proxy server | |
| CN104580268A (en) | Method and device for transmitting file data | |
| CN101635741A (en) | Method and system thereof for inquiring recourses in distributed network | |
| CN103685411A (en) | Data sharing method and device in heterogeneous network | |
| CN108134811B (en) | Method, device and system for distributing or downloading target file | |
| CN109873855A (en) | A kind of resource acquiring method and system based on block chain network | |
| CN103166978A (en) | Method and device of data obtaining | |
| CN104462129A (en) | Distributed file storage and query method and distributed file access system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20150429 |