CN1290029C - Method for batch quick copy of computer data - Google Patents
Method for batch quick copy of computer data Download PDFInfo
- Publication number
- CN1290029C CN1290029C CNB2004100198818A CN200410019881A CN1290029C CN 1290029 C CN1290029 C CN 1290029C CN B2004100198818 A CNB2004100198818 A CN B2004100198818A CN 200410019881 A CN200410019881 A CN 200410019881A CN 1290029 C CN1290029 C CN 1290029C
- Authority
- CN
- China
- Prior art keywords
- data
- copy
- server
- packet
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Computer And Data Communications (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to a method for quickly copying computer data in a mass mode. Date needed by a client is divided into a plurality of data packages by mapping files by the method, and the data packages are stored at a server end continuously. The data packages are broadcast by a server by beginning from the first data packet orderly backward to be looped. The client can be added in to copy at any time, the first received integral data package is used as the beginning of the client, and data in the received data package is written into a correct position according to positional information. Then, the next data package is received and processed until processing to the previous data package of a beginning position, and then the copy of all data is completed. The mass copying efficiency of large data quantity is enhanced furthest by the present invention via a ' circulating broadcast, instant addition ' technique. The present invention is matched with a computer churn mode best, and production efficiency can be greatly enhanced. The requirement of network hardware is low, high-efficient mapping mass copy of a hard disk system can be realized by using a low side server, and operating costs are greatly reduced.
Description
[technical field]: the batch quick copy field, particularly client computer that the present invention relates to computer data directly copy corresponding data by the network connection service device from server.
[background technology]: in the computing machine production run, need be installation system and application software in every hard disc of computer, mainly adopt two kinds of methods at present in the industry:
Method 1: to every kind of configuration type, install in advance and make a stamper, use then and copy the dish machine it is copied in other hard disks, assemble again.This method needs artificial dismounting hard disk, copies the dish machine for every and can only duplicate a small amount of hard disk simultaneously, and speed is slow, and efficient is low.
Method 2: the network-copy mode, promptly to make stamper in advance and its reflection is stored in server, scheduler and server networking use software to carry out the method for boot image download copy.Alternative dish machine and the relevant manual work copied of the method, but because transmitted data amount is huge, every client computer all will copy the above data of 2-3GB, to server, the network hardware requires very high, needs high-performance server and gigabit networking, every station server can only be served tens client computer simultaneously, the number of clients increase causes efficient to reduce at double, and hardware drops into high, has limited applying of this pattern.
As, connect 50 client computes with every station server, according to common mode, on the 100Mbit network, (100M bps, about 11M byte per second), every client computer can only obtain the bandwidth of 0.2M byte per second in theory at most, and per minute also can reach the transmission speed of 12M byte at most, and the transmission speed of valid data in fact, also can only reach about 70% of theoretical value, just the 8M byte/minute about.
[summary of the invention]: the present invention seeks to overcome the deficiencies in the prior art, a kind of method of batch quick copy of computer data is provided, realize hard disk network copy at a high speed in enormous quantities, and reduce requirement to server and network.
For achieving the above object, the present invention at first needs the problem that solves, is exactly significantly to reduce offered load.Because when computing machine is produced, the data of the required copy of same model computing machine are identical, so can adopt " broadcasting " formula, by server data " broadcasting " are gone out, every client computer all can be received use simultaneously, like this, no matter connect how many platform client computer, same data are at network on transmission primaries, rather than are transferred to All Clients respectively by server, reduce offered load at double.
But because of reflection is made as alphabetic data, need the consecutive order copy, multiplexing for reaching each client data like this, All Clients need begin to receive data simultaneously, be written in the hard disk successively then, and actual production is a pipeline system, therefore can produce the wait process, reduce production efficiency.
So second problem that the present invention need solve be, overcome the above-mentioned synchronous problem of client computer that needs, the present invention has adopted " the instant adding " technology, and client computer can be added at any time, receives data at any time.Server starts anew, the broadcast (sites) in turn Image Data, and client computer can add at any time, receives the data of current broadcast immediately, according to the positional information in the data, is written into the tram in the hard disk, until finishing total data.
The method of batch quick copy of computer data provided by the invention, finish according to the following steps:
The first, image file constitutes: the client computer desired data is kept at server end with image file, and this image file is divided into N packet, deposit continuously, the valid data in the record object hard disk are seen Fig. 1 respectively;
The second, the Image Data bag constitutes: the formation of each packet can include Bale No., packet length is size of data, positional information, data check information and valid data content part, sees Fig. 2.
Three, reflection broadcasting/receiving course:
Server is from first packet, and order broadcast data packet has backward been broadcasted last packet successively, the repeat playing that then circulates first.Client computer adds to come at any time, receive first complete packet, then as the beginning of this client computer, the data that receive in the bag are written to the tram according to positional information, receive then and handle next bag, until the previous bag of handling the starting position, then finish the total data copy, see Fig. 3.
Four, the concrete workflow of server end:
Whether server is at first checked has the client requests copy or finishes this reflection of copy;
Client requests copy is arranged, and server is from first packet, and order broadcast data packet has backward been broadcasted last packet successively, the repeat playing that then circulates first;
All client computer is finished this reflection of copy, and server stops to play, and waits for, and is returned to original state, sees Fig. 4;
Five, the concrete workflow of client-side:
Client computer can send request to server at any time, add copy, with first the complete packet that receives, beginning as this client computer, and the data that will receive in the bag are written to the tram according to positional information, receive to handle next bag then, until the previous bag of handling the starting position, then finish the total data copy, see Fig. 5.
Advantage of the present invention and good effect: the present invention is by " broadcast (sites) in turn; the instant adding " technology, at utmost promoted the batch duplicating efficient of big data quantity, carry out optimum matching with computer streamline production model, make and carry out system image by network mode and download and install, replacing artificial hard disk becomes possibility to copying operation, significantly promotes production efficiency.Adopt the inventive method, lower to network hardware requirement, use low-end server, just can realize high efficiency hard-disk system reflection batch duplicating, therefore greatly reduce operating cost.
[description of drawings]:
Fig. 1 is that image file to be copied constitutes synoptic diagram;
Fig. 2 is that each Image Data bag constitutes synoptic diagram;
Fig. 3 is a reflection broadcasting/receiving course synoptic diagram;
Fig. 4 is a server end workflow block diagram;
Fig. 5 is a client workflow block diagram;
Fig. 6 is concrete application examples SNA synoptic diagram.
[embodiment]:
Embodiment 1
As shown in Figure 1, image file to be copied is become by several data packet group, and all packets are deposited continuously, and the valid data in the record object hard disk are kept at server end respectively.
As shown in Figure 2, each Image Data bag comprises valid data, positional information, size of data, information such as verification.Positional information wherein, do not have any related with other data in the reflection, comprised the independent information that data should writing position, according to this information, but specified data is written to the physical location (sector number) in the hard disk, guarantee that client computer receives any one packet, can both be written to the tram in the client hard disk with data according to positional information.
As shown in Figure 3 the reflection broadcasting/receiving course:
Server is from first packet, and order broadcast data packet has backward been broadcasted last packet successively, the repeat playing that then circulates first.Client computer adds to come at any time, receives first complete packet, then as the beginning of this client computer, the data that receive in the bag are written to the tram according to positional information, receive then and handle next bag,, then finish the total data copy until the previous bag of handling the starting position.
The server end workflow is described as follows as shown in Figure 4:
4-1: server begins, and the packet numbers that will broadcast reflection is changed to 0;
Whether 4-2: checking has the client requests copy or finishes this reflection of copy;
4-3: calculate the number of clients of current request copy,, then need to broadcast this Image Data as greater than 0;
4-4: begin to read the current packet that will broadcast, packet numbers+1;
4-5:, then circular wait a period of time, enter initial state (4-1) then as there not being the client requests data;
4-6: broadcast ready prepd packet, return 4-2 then, broadcast next packet, repeat until finishing;
The client workflow is described as follows as shown in Figure 5:
5-1: beginning sends request to server;
5-2: server process, confirm request, client reception server enabling signal;
5-3: client adds, the reception server broadcast data; First packet is noted down;
5-4: check the packet that receives, the checking Bale No., whether data content is correct;
5-5: according to wrong, then carry out fault processing as receiver packet number;
5-6: check whether repeat to have received first bag, in this way, then all packets have been finished in expression;
5-7: otherwise, packet is handled, the positional information in the bag is resolved, valid data are written to the tram; Turn back to 5-3 then, repeat to receive next packet, until all finishing;
5-8: after finishing (no matter correct or wrong), this client computer of announcement server end is finished;
By above flow process, client can join in the sequence of server broadcast (sites) in turn at any time, can begin to receive data after the adding, until all finishing, increases any excessive data transmission hardly, guarantees top efficiency.
Concrete application example
Be that example describes with production line of computer for the hard-disk system reflection being installed below with a collection of computer.
SNA as shown in Figure 6, because of adopting the inventive method, use low-end server, just can realize high efficiency hard-disk system reflection batch duplicating, every station server can connect 256 client computer at most simultaneously, can be that 256 production machines are downloaded Image Data simultaneously, the speed of every client computer copy data can reach the 300M byte/minute.
The Image Data file of making in advance is kept on the server hard disc, when client requests, server just begins this Image Data bag is carried out broadcast (sites) in turn in order, and client computer can connect adding at any time, withdraw from immediately after finishing, vacate the client computer that connects for the back and add.All share the reception broadcast data simultaneously because of All Clients, be combined into complete data mapping then, so broadcast data takies the overall network bandwidth, and each packet only need be broadcasted once.And if the employing common mode then needs to transmit simultaneously different packets to give different client computer, data volume is multiplied, and efficient reduces at double.
It below is experimental data.
Table one: test environment
| Server | Network | The Image Data size |
| P4 1.5G CPU 256MB RAM 80GB*2IDE RAID | 100MBit Switch | 2.0GB |
Table two: efficiency data
| Connect the client computer number simultaneously | Mode of the present invention | The separate copies mode | ||||
| The server end network transmission speed | Client data bag receiving velocity | The average deadline of client computer | The server end network transmission speed | Client data bag receiving velocity | The average deadline of client computer | |
| 16 | The 510MB/ branch | The 450MB/ branch | 4.6 minute | The 510MB/ branch | The 43MB/ branch | 47.6 minute |
| 64 | The 510MB/ branch | The 430MB/ branch | 4.8 minute | The 510MB/ branch | The 11MB/ branch | 186.1 minute |
| 128 | The 510MB/ branch | The 380MB/ branch | 5.4 minute | The 510MB/ branch | The 2MB/ branch | 1024 minutes |
Table two is a test result data, therefrom can see, adopt mode of the present invention, client receives Image Data speed, approaching with the highest transmission speed of server end, simultaneously, because all clients all receive identical packet simultaneously, when the connection number of clients was multiplied, data download time increase was not remarkable.
And if adopt common copy mode, every data that client computer needs, server end all will independently send its required data for it, so efficient is very low, and can't support a large amount of client computer to move simultaneously.
In addition, if adopt synchronized broadcast transmissions mode, i.e. machine that production line produces, behind the Connection Service device, must wait for a period of time earlier, when waiting number of clients that connects simultaneously to reach certain value, server begins from first to last to broadcast, and All Clients finishes simultaneously after finishing.Like this than separate copies mode efficient height, but can't realize instant adding, the client computer of first connection, after need waiting until always that last client computer adds, just can begin, if on average each minute the machine that rolls off the production line, when connecting 64 client computer, just need wait the longest 64 minutes, average waiting 32 minutes also can't promote production efficiency.
Claims (2)
1, a kind of method of batch quick copy of computer data is characterized in that this method finishes according to the following steps:
The first, the client computer desired data is kept at server end with image file, and this image file is divided into N packet, deposit continuously;
The second, image file broadcasting
Whether server is at first checked has the client requests copy or finishes this image file of copy;
Client requests copy is arranged, and server is from first packet, and order broadcast data packet has backward been broadcasted last packet successively, the repeat playing that then circulates first;
All client computer is finished this image file of copy, and server stops to play, and waits for, and is returned to original state;
Three, client computer receiving course
Client computer can send request to server at any time, add copy, with first the complete packet that receives, beginning as this client computer, and the data that will receive in the bag are written to the tram according to positional information, receive then and handle next bag,, then finish the total data copy until the previous bag of handling the starting position.
2, the method for batch quick copy of computer data according to claim 1 is characterized in that the formation of each packet in the image file can include Bale No., packet length is size of data, positional information, data check information and valid data content part.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100198818A CN1290029C (en) | 2004-07-06 | 2004-07-06 | Method for batch quick copy of computer data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100198818A CN1290029C (en) | 2004-07-06 | 2004-07-06 | Method for batch quick copy of computer data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1595908A CN1595908A (en) | 2005-03-16 |
| CN1290029C true CN1290029C (en) | 2006-12-13 |
Family
ID=34663106
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100198818A Expired - Fee Related CN1290029C (en) | 2004-07-06 | 2004-07-06 | Method for batch quick copy of computer data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1290029C (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9984341B2 (en) | 2006-12-13 | 2018-05-29 | Crown Equipment Corporation | Information system for industrial vehicles including cyclical recurring vehicle information message |
| CN101242288B (en) * | 2007-02-09 | 2010-05-19 | 武汉回归科技有限公司 | A realization method for variant duplication |
| KR101730353B1 (en) * | 2009-09-01 | 2017-04-27 | 크라운 이큅먼트 코포레이션 | Information system for industrial vehicles including cyclical recurring vehicle information message |
| CN115102966A (en) * | 2022-06-01 | 2022-09-23 | 咪咕视讯科技有限公司 | Node management method, device, equipment and computer readable storage medium |
-
2004
- 2004-07-06 CN CNB2004100198818A patent/CN1290029C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1595908A (en) | 2005-03-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108881944A (en) | A kind of Streaming Media accelerates dissemination method and system | |
| WO2013159703A1 (en) | Offline download method, multimedia file download method and system thereof | |
| CN101076021A (en) | Network data storage system | |
| CN1290029C (en) | Method for batch quick copy of computer data | |
| CN101188622B (en) | A method and device for downloading file by using P2P living broadcast channel | |
| CN101764831A (en) | Method and system for sharing stream media data, and stream media node | |
| CN1822536A (en) | System and method for synchronizing time of day clocks on first and second computers | |
| CN1549507A (en) | Method and apparatus for layout data in communication equipment | |
| CN1878147A (en) | Method for balancing load between multi network cards of network file system server | |
| CN1933454A (en) | Synchronous information interface realizing method based on JAVA information service | |
| CN1471273A (en) | Method for realizing dynamic discussion group establish using instant communication tool and control flow chart | |
| CN101068341A (en) | Stream media dispatching system and medium file scheduling method thereof | |
| CN101035130A (en) | Browser/server structure based information distribution method and system | |
| CN1825800A (en) | Load method, load system and mobile station using load method | |
| CN1452375A (en) | Network calling center system and network calling processing method | |
| CN1831782A (en) | Allopatric data image method of network information system | |
| CN105354110A (en) | Cloud server data backup method and apparatus | |
| CN1277374C (en) | Communication system base station and server database real-time synchronizing method | |
| WO2008002877A2 (en) | Transmit driver data communication | |
| CN101079871A (en) | Transparent transfer method and system of multimedia information stream | |
| CN101063952A (en) | Universal serial bus host controller rapid testing system and method thereof | |
| CN1801934A (en) | Method for realizing IGRS AV player device | |
| CN1210956C (en) | Real time receiving and sxtorage method for video signal conference stream medium | |
| CN1933450A (en) | Interplate communicating method and interface plate | |
| CN1213574C (en) | Data bus system including source control device and transmitting station |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C19 | Lapse of patent right due to non-payment of the annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| C49 | Reinstatement of patent right or utility model | ||
| RR01 | Reinstatement of patent right | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20061213 Termination date: 20130706 |