CN102638583A - Method for realizing file distributing transmission - Google Patents
Method for realizing file distributing transmission Download PDFInfo
- Publication number
- CN102638583A CN102638583A CN2012101164207A CN201210116420A CN102638583A CN 102638583 A CN102638583 A CN 102638583A CN 2012101164207 A CN2012101164207 A CN 2012101164207A CN 201210116420 A CN201210116420 A CN 201210116420A CN 102638583 A CN102638583 A CN 102638583A
- Authority
- CN
- China
- Prior art keywords
- address
- virtual address
- data
- server
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 38
- 238000000034 method Methods 0.000 title claims abstract description 10
- 238000006243 chemical reaction Methods 0.000 claims abstract description 10
- 241001269238 Data Species 0.000 claims description 3
- 238000007599 discharging Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
Images
Landscapes
- Computer And Data Communications (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method for realizing file distributing transmission. A system comprises a virtual address module (1), a load balancing module (2) and an address conversion module (3), wherein the virtual address module (1) virtualizes MAC (Media Access Control) addresses or SAS (Serial Attached SCSI) addresses of the same type and the same amount according to the type and the amount of service interfaces connected with a rear end; the load balancing module (2) is used for client accessing data, pairs the virtual address and a rear-end real server address and throws data to an idle target server; and the address conversion module (3) releases the virtual address for the data which reaches the target server so as to finish transmission.
Description
Technical field
The present invention relates to Computer Storage distributed document field, be specifically related to a kind of method that realizes the transmission of file distribution formula.
Background technology
Distributed file system is widely used by each producer at present; But all be that file system through software realizes that this system generally is only applicable to high-end cluster product, so all somewhat expensive aspect cost; Can't satisfy the low side demand. but just at present; The low side storage market still occupies the half of the country of storage market, and this type of user has been owing to had certain memory device input early stage, but along with the continuous growth of customer service; They also slowly begin to have had the demand of distributed file system; But it is impossible letting them go up the cluster distributed file system of a cover again, so this type client is still very vigorous to this type of product demand, but the relation of suffering from framework and cost can't realize. the present invention just provide a kind of in the low side storage products way of realization distributed file system.
Summary of the invention
The purpose of this invention is to provide a kind of method that realizes the transmission of file distribution formula.
The objective of the invention is to realize that by following mode system comprises 1) the virtual address module; 2) load balancing module; 3) address conversion module, wherein:
1) virtual address module:, fictionalize the MAC Address or the SAS address of same type and quantity according to service interface type and the quantity that the rear end connects;
2) load balancing module: for client's visit data, virtual address and real server address, rear end are matched, and data are invested idle destination server;
3) address conversion module:, thereby virtual address is discharged the completion transmission for the data that arrive destination server;
Transmitting step is following:
1) at first initiates a large amount of concurrent visit datas by client's section; Be sent to main frame earlier, the virtual address module in the main frame is according to the type and the quantity of back-end server interface; Fictionalize the address of same-interface type and quantity, data are sent to the next stage load balancing module then;
2) load balancing module is judged the loading condition of back end interface according to the release conditions of virtual address; Thereby virtual address and the server address that need throw in are bound, thereby the realization data-directed is thrown in the realization distributed transmission; Why to virtual address and real server address be bound; Exactly in order can to confirm server address, thereby throw in data smoothly, simple virtual address is to have no being worth with transmission of meaning; If just a virtual address has been bound a physical address; Explaining at once will be toward that address transmitting data, and if have idle virtual address and physical address not to bind, explain that this physical address corresponding with service device is idle;
3) in transfer of data behind server end; Address conversion module can be dialled virtual address from discharging; Thereby the free time gets off to prepare transmission next time once more to make transmission line; This has just realized a simple distributed transmission, and in transmission next time, virtual address is bound new free physical address once more and transmitted like this.
The virtual address administration module is used to generate the virtual address with the back-end server equivalent amount, leaves load balancing module then in, after data arrives; To bind with virtual address and data, backend server is thrown in then, and at this time the data of transmission will take this virtual address; And,, be that back-end server takies so virtual address is occupied because virtual address and back-end server are one to one; Have only behind DTD; This virtual address is released back load balancing module, so just proves that this server is idle, proceeds the transmission of next data.
The invention has the beneficial effects as follows: the present invention utilizes 3 modules, has just realized a SiteServer LBS efficiently; It is cheap many that the cluster that this Billy realizes with senior distributed file system, cost are wanted.The present invention not only is applicable to the transmission of distributed document, can also expand to the processing of piece level file, realizes the storage load balancing through distributed transmission.
Description of drawings
Fig. 1 is the system configuration sketch map;
Fig. 2 is the transmitting step flow chart.
Embodiment
Explanation at length below with reference to Figure of description method of the present invention being done.
Structured flowchart: the module that system comprises among the promptly last figure is following:
1) virtual address module: the interface type and the quantity of the service that connects according to the rear end fictionalize the MAC Address, SAS address of same type and quantity etc.;
2) load balancing module: for client's visit data, virtual address and real server address, rear end are matched, and data are invested idle destination server;
3) address conversion module: for the data that arrive destination server, virtual address is discharged, thereby accomplish transmission;
Transmitting step is following:
Shown in accompanying drawing, at first initiate a large amount of concurrent visit datas by client's section, can arrive main frame earlier; Virtual address module in the main frame; Can be in advance according to the type and the quantity of back-end server interface, why the address that fictionalizes same-interface type and quantity (will select virtual address, exactly because virtual address need not to bind with real server; Each transmission can be bound an address transfer at random according to loading condition). data can arrive the next stage load balancing module then.
Load balancing module is judged the loading condition of back end interface according to the release conditions of virtual address; Thereby virtual address and the server address that needs to throw in are bound; Thereby realize the data-directed input, realize distributed transmission. why to virtual address and real server address be bound, exactly in order to confirm server address; Thereby can throw in data smoothly, simple virtual address is to have no being worth with transmission of meaning.If just a virtual address has been bound a physical address, explaining at once will be toward that address transmitting data, and if have idle virtual address and physical address not to bind, explain that this physical address corresponding with service device is idle.
In transfer of data behind server end; Address conversion module can be dialled virtual address from discharging; Thereby the free time gets off to prepare transmission next time once more to make transmission line. and this has just realized a simple distributed transmission method. and in transmission next time, the physical address that virtual address can be bound the new free time transmits like this.
In data transmission procedure, the concurrent data access of client arrives load balancing module; Module introduction through the front is understood, and the virtual address administration module mainly is to use the virtual address that generates with the back-end server equivalent amount, leaves load balancing module then in; After data arrives, will bind with virtual address and data, backend server is thrown in then; At this time the data of transmission will take this virtual address, and because virtual address and back-end server are one to one, so virtual address is occupied; Be that back-end server takies, have only behind DTD, this virtual address is released back load balancing module; So just prove that this server is idle, can carry out the transmission of next data.
Except that the described technical characterictic of specification, be the known technology of those skilled in the art.
Claims (2)
1. a method that realizes the transmission of file distribution formula is characterized in that system comprises 1) the virtual address module; 2) load balancing module; 3) address conversion module, wherein:
1) virtual address module:, fictionalize the MAC Address or the SAS address of same type and quantity according to service interface type and the quantity that the rear end connects;
2) load balancing module: for client's visit data, virtual address and real server address, rear end are matched, and data are invested idle destination server;
3) address conversion module:, thereby virtual address is discharged the completion transmission for the data that arrive destination server;
Transmitting step is following:
1) at first initiates a large amount of concurrent visit datas by client's section; Be sent to main frame earlier, the virtual address module in the main frame is according to the type and the quantity of back-end server interface; Fictionalize the address of same-interface type and quantity, data are sent to the next stage load balancing module then;
2) load balancing module is judged the loading condition of back end interface according to the release conditions of virtual address; Thereby virtual address and the server address that need throw in are bound, thereby the realization data-directed is thrown in the realization distributed transmission; Why to virtual address and real server address be bound; Exactly in order can to confirm server address, thereby throw in data smoothly, simple virtual address is to have no being worth with transmission of meaning; If just a virtual address has been bound a physical address; Explaining at once will be toward that address transmitting data, and if have idle virtual address and physical address not to bind, explain that this physical address corresponding with service device is idle;
3) in transfer of data behind server end; Address conversion module can be dialled virtual address from discharging; Thereby the free time gets off to prepare transmission next time once more to make transmission line; This has just realized a simple distributed transmission, and in transmission next time, virtual address is bound new free physical address once more and transmitted like this.
2. according to the method under the claim 1, it is characterized in that the virtual address administration module is used to generate the virtual address with the back-end server equivalent amount; Leave load balancing module then in, after data arrives, will bind with virtual address and data; Backend server is thrown in then, and at this time the data of transmission will take this virtual address, and because virtual address and back-end server are one to one; So virtual address is occupied; Be that back-end server takies, have only behind DTD, this virtual address is released back load balancing module; So just prove that this server is idle, proceed the transmission of next data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210116420.7A CN102638583B (en) | 2012-04-20 | 2012-04-20 | A kind of method realizing file distribution transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210116420.7A CN102638583B (en) | 2012-04-20 | 2012-04-20 | A kind of method realizing file distribution transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102638583A true CN102638583A (en) | 2012-08-15 |
| CN102638583B CN102638583B (en) | 2016-08-17 |
Family
ID=46622824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210116420.7A Active CN102638583B (en) | 2012-04-20 | 2012-04-20 | A kind of method realizing file distribution transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102638583B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765570A (en) * | 2015-03-16 | 2015-07-08 | 浪潮集团有限公司 | Storage unit based on PCI-E multi-master share |
| CN110708393A (en) * | 2019-10-21 | 2020-01-17 | 北京百度网讯科技有限公司 | Method, device and system for transmitting data |
| CN114710443A (en) * | 2022-03-17 | 2022-07-05 | 杭州华橙软件技术有限公司 | Traffic scheduling method and device for forwarding server |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1312889C (en) * | 2003-12-17 | 2007-04-25 | 浪潮电子信息产业股份有限公司 | Single address traffic distributor of cluster network |
| CN101155109B (en) * | 2006-09-30 | 2010-04-21 | 华为技术有限公司 | Ethernet switching system and equipment |
| CN101778370B (en) * | 2010-01-20 | 2012-09-05 | 北京邮电大学 | Method of supporting cooperation work of multiple routers by utilizing virtual interface |
-
2012
- 2012-04-20 CN CN201210116420.7A patent/CN102638583B/en active Active
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104765570A (en) * | 2015-03-16 | 2015-07-08 | 浪潮集团有限公司 | Storage unit based on PCI-E multi-master share |
| CN110708393A (en) * | 2019-10-21 | 2020-01-17 | 北京百度网讯科技有限公司 | Method, device and system for transmitting data |
| US11483382B2 (en) | 2019-10-21 | 2022-10-25 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method, apparatus and system for transmitting data |
| CN110708393B (en) * | 2019-10-21 | 2023-11-21 | 北京百度网讯科技有限公司 | Method, device and system for transmitting data |
| CN114710443A (en) * | 2022-03-17 | 2022-07-05 | 杭州华橙软件技术有限公司 | Traffic scheduling method and device for forwarding server |
| CN114710443B (en) * | 2022-03-17 | 2024-03-19 | 杭州华橙软件技术有限公司 | Traffic scheduling method and device for forwarding server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102638583B (en) | 2016-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107003943B (en) | The control method of reading and writing data order, storage equipment and system in NVMe over Fabric framework | |
| CN104461958B (en) | Support storage resource access method, storage control and the storage device of SR-IOV | |
| US10257273B2 (en) | Systems, methods and devices for RDMA read/write operations | |
| CN107995129A (en) | A kind of NFV message forwarding methods and device | |
| CN101160942B (en) | Method and system for mobile terminal downloading data and data sharing between mobile terminals | |
| CN106933775A (en) | Data handling system and the method for data processing | |
| CN102118433A (en) | Multiple-tier distributed cluster system | |
| CN102270186A (en) | Virtual desktop external equipment support system | |
| WO2009155433A3 (en) | System and method for achieving high performance data flow among user space processes in storage systems | |
| CN104572301B (en) | A kind of resource allocation methods and system | |
| CN102611735A (en) | Load balancing method and system of application services | |
| CN102439983A (en) | Data rapid distribution method and device | |
| CN101763221A (en) | Storing method, storing system and controller | |
| CN102638583A (en) | Method for realizing file distributing transmission | |
| CN102053800A (en) | Data access method, message receiving resolver and system | |
| CN105408875B (en) | Distributed process on memory interface executes and file system | |
| CN103237031B (en) | Time source side method and device in order in content distributing network | |
| CN103176780A (en) | Binding system and method of multiple network interfaces | |
| CN103297499A (en) | Scheduling method and system based on cloud platform | |
| CN103744719A (en) | Lock management method, lock management system, lock management system configuration method and lock management system configuration device | |
| TW201202946A (en) | Multi-level port expansion for port multipliers | |
| CN102841869A (en) | Multi-channel I2C controller based on FPGA | |
| JP2014532923A5 (en) | ||
| CN1331070C (en) | Method and equipment of data communication | |
| EP2913759B1 (en) | Memory access processing method based on memory chip interconnection, memory chip, and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |