CN104346101A - Dynamic storage space allocation system and method - Google Patents
Dynamic storage space allocation system and method Download PDFInfo
- Publication number
- CN104346101A CN104346101A CN201310320522.5A CN201310320522A CN104346101A CN 104346101 A CN104346101 A CN 104346101A CN 201310320522 A CN201310320522 A CN 201310320522A CN 104346101 A CN104346101 A CN 104346101A
- Authority
- CN
- China
- Prior art keywords
- file server
- server
- byte stream
- storage
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
A dynamic storage space allocation system is applied to a control server and comprises a receiving module, a downloading module, a determining module and a transmitting module, wherein the receiving module is used for receiving a request for storing a target file from a client and determining a web server for storing the target file according to the request, the downloading module is used for acquiring byte stream of the target file from the determined web server and temporarily storing the byte stream in a storage device of the control server, the determining module is used for determining a target file server according to the size of the byte stream and residual storage space of a plurality of file servers, and the transmitting module is used for transmitting the byte stream to the target file server for storage. The invention further provides a dynamic storage space allocation method. By the system and the method, file storage can be dynamically allocated.
Description
Technical field
The present invention relates to data storage technology, particularly relate to a kind of storage space dynamic allocation system and method.
Background technology
When carrying out data transmission or data and storing, often there will be the situation of the Insufficient disk space of memory storage, thus file cannot be carried out move normally, copy.Especially download from the network terminal (such as, Website server) mass data carry out automated back-up to server time, server storage deficiency can cause can not back up in time, the situation such as loss of data.
Summary of the invention
In view of above content, be necessary to provide a kind of storage space dynamic allocation system and method, initiatively can monitor the residual memory space size of multiple file server, and automatically distribute suitable file server when needing storage file to store this file.
A kind of storage space dynamic allocation method, be applied in Control Server, this Control Server is connected with client and multiple file server, and the method comprises: receive the request of preserving file destination from described client; The Website server storing described file destination is determined according to this request; Obtain the byte stream of this file destination from this Website server determined, and described byte stream is kept in in the memory storage of described Control Server; According to the size of described byte stream and the residual memory space of multiple file server, determine target file server; And described byte stream is sent to described target file server stores.
A kind of storage space dynamic allocation system, be applied in Control Server, this Control Server is connected with client and multiple file server, this system comprises: receiver module, for receiving the request of preserving file destination from described client, and determine according to this request the Website server storing described file destination; Download module, the Website server for determining from this obtains the byte stream of this file destination, and is kept in by described byte stream in the memory storage of described Control Server; Determination module, for according to the size of described byte stream and the residual memory space of multiple file server, determines target file server; And sending module, store for described byte stream is sent to described target file server.
Compared to prior art, described storage space dynamic allocation system and method, initiatively can monitor the residual memory space size of multiple file server, and automatically distribute suitable file server when needing storage file to store this file.
Accompanying drawing explanation
Fig. 1 is the running environment figure of the better embodiment of storage space dynamic allocation system of the present invention.
Fig. 2 is the functional block diagram of the better embodiment of storage space dynamic allocation system of the present invention.
Fig. 3 is the process flow diagram of the better embodiment of storage space dynamic allocation method of the present invention.
Main element symbol description
| Control Server | 1 |
| Storage space dynamic allocation system | 10 |
| Receiver module | 100 |
| Download module | 101 |
| Configuration module | 102 |
| Determination module | 103 |
| Sending module | 104 |
| Notification module | 105 |
| Processor | 11 |
| Memory storage | 12 |
| File server | 2 |
| Memory storage | 20 |
| Website server | 3 |
| Network | 4 |
| Client | 5 |
Following embodiment will further illustrate the present invention in conjunction with above-mentioned accompanying drawing.
Embodiment
As shown in Figure 1, be the running environment figure of better embodiment of storage space dynamic allocation system of the present invention.Described storage space dynamic allocation system 10 is applied in Control Server 1.In this better embodiment, described Control Server 1 is connected with multiple file server 2 and client 5.Described Control Server 1 can be computing machine, main frame or other device.
Described file server 2 is for the computing machine of storage file or other kinds data, main frame or other device, and comprises memory storage 20.In other embodiments, described file server 2 can be network disk or local disk, and namely namely described file server 2 is memory storage, then can not comprise memory storage 20 in addition.Connection between described file server 2 and described Control Server 1 connects by internet (Internet) or in-house network (Intranet).
Described client 5 can be dissimilar electronic installation, the electronic installations such as such as computing machine, mobile phone, TV, panel computer, notebook computer, personal digital assistant.Described client connects described Control Server 1 by internet or in-house network, and then downloads relevant data from described file server 2.Described client 5 also can directly carry out with described multiple file servers 2 being connected to realize carrying out associative operation to the data in this file server 2, such as, checks, edits, preserves, the operation such as deletion.
In addition, in other embodiments, described client 5 also directly can access corresponding Website server 3 by network 4, and at needs from a special Website server 3 during download file, the association attributes of this file is sent in described Control Server 1, such as, the association attributes of this file can include, but are not limited to: network address, file name, file layout, FileVersion, file type etc.
Described Control Server 1 is connected with multiple Website server (Web Server) 3 further by network 4, with the file destination from described Website server 3 needed for download user.Described network can be the communication network of internet or other type, as GPRS, Wi-Fi/WLAN, 3G/WCDMA, 3.5G/HSDPA etc.
In the present embodiment, the request of preservation file of described storage space dynamic allocation system 10 for receiving user and sending from described client 5, the file destination downloaded needed for user is confirmed according to the request of this preservation file, connect corresponding Website server 3 and download the byte stream of this file destination, and specify the suitable byte stream of file server 2 to this file destination to store according to the dynamic memory space of multiple file server 2, thus the request of preservation file described in realizing.
Described Control Server 1 comprises processor 11 and memory storage 12.Described processor 11 such as, for performing described storage space dynamic allocation system 10 and all kinds of softwares of installation in described Control Server 1, operating system etc.Described memory storage 12 can be hard disk, or the storage card of other types or memory device.Described memory storage 12 for storing Various types of data, such as, the information such as video, audio frequency, image, file, and data that are set for storage space dynamic allocation system described in memory 10, that receive.
In the present embodiment, described memory storage 12 can be used for the byte stream of temporary file destination.
As shown in Figure 2, be the functional block diagram of better embodiment of storage space dynamic allocation system of the present invention.In the present embodiment, described storage space dynamic allocation system 10 comprises multiple functional module, respectively: receiver module 100, download module 101, configuration module 102, determination module 103, sending module 104 and notification module 105.
Module alleged by the present invention has been the program segment of a specific function, is more suitable for describing the implementation of software in described Control Server 1 than program.The concrete function of each module is described below with reference to Fig. 3.
As shown in Figure 3, be the process flow diagram of better embodiment of storage space dynamic allocation method of the present invention.
First, step S2, described receiver module 100 receives the request of preserving file destination from described client 5.As described above, the request of this preservation file destination can include, but are not limited to following information: access the network address of this file destination, file name, file layout, FileVersion, file type etc.
Step S4, described receiver module 100 determines according to this request the Website server 3 storing described file destination.Such as, described receiver module 100 can access the Website server 3 at related web page place according to the network address of accessing this file destination in this request.
Step S6, described download module 101 obtains the byte stream of (download) this file destination from the Website server 3 that this is determined, and is kept in by described byte stream in the memory storage 12 of described Control Server 1.Byte stream transmits or preserving type the one of routine data (such as, described file destination), and input word throttling can be used to read data, and the throttling of use output word completes the preservation to data.
Step S8, described determination module 103, according to the residual memory space of the size of described byte stream and multiple file server 2, determines a target file server 2.The residual memory space of this target file server 2 is more than or equal to the size of described byte stream, thus guarantees to realize the storage to this file destination.
In the present embodiment, the address of described configuration module 102 is pre-recorded each file server 2 and residual memory space.The address of described file server 2 can be local disk address, such as " C: ", also can be network disk address, such as " 10.111.222.33 " etc.Described residual memory space can carry out real-time renewal according to the physical memory space of each file server 2, and described configuration module 102 is by initiatively renewal or passive update mode realize the renewal of the residual memory space to each file server 2.
Described active update mode be described configuration module 102 initiatively regularly (such as, every 1 minute) send the residual memory space that each file server 2 is checked in instruction, described multiple file server 2 sends echo message to described configuration module 102 according to the instruction received, and this echo message then comprises the residual memory space of each file server 2.
Described passive update mode is that described configuration module 102 regularly receives the information initiatively sent from described file server 2, and this information comprises the residual memory space of each file server 2.
When there being the residual memory space of multiple file server 2 to be more than or equal to the size of described byte stream, described determination module 103, according to the priority orders of the file server 2 preset, selects the file server 2 possessing higher priority as target file server 2 from described multiple file server 2.
Step S10, described byte stream is sent to described target file server 2 and stores by described sending module 104, then, process ends.Described configuration module 102, after described target file server 2 completes the storage to described byte stream, upgrades the residual memory space of this target file server 2.In other embodiments, described notification module 105 can after described target file server 2 completes the storage to this file destination, send completion notice to described client 5, this completion notice completes preservation in order to the file destination notifying the user of described client 5 and ask.In addition, this completion notice also can comprise the address of described target file server 2.The user of described client 5 can access described target file server 2 according to the address of described target file server 2 and check this file destination.
Further, in other embodiments, above-mentioned storage space dynamic allocation method also comprises step: when not having the residual memory space of file server 2 to be more than or equal to the size of described byte stream, or when the memory storage 12 of described Control Server 1 cannot preserve described byte stream, described notification module 105 sends exception reporting to described client 5 to notify that this Control Server 1 of described client 5 or file server 2 cannot complete the storage to this file destination.
Further, in other embodiments, when described receiver module 100 receives the request of above-mentioned preservation file destination, also first can retrieve described multiple file server 2, and when this file destination has been stored in file server 2, directly the address of the file server 2 storing this file destination is returned to described client 5, and without the need to again carrying out download and the storage of same file by described download module 101.
It should be noted that, the file in multiple embodiment mentioned above, comprises multiple type, such as, and image file, audio files, video file, text etc.
Above embodiment is only in order to illustrate technical scheme of the present invention and unrestricted, although with reference to above better embodiment to invention has been detailed description, those of ordinary skill in the art should be appreciated that and can modify to technical scheme of the present invention or be equal to the spirit and scope of replacing and should not depart from technical solution of the present invention.
Claims (10)
1. a storage space dynamic allocation method, is applied in Control Server, and this Control Server is connected with client and multiple file server, it is characterized in that, the method comprises:
The request of preserving file destination is received from described client;
The Website server storing described file destination is determined according to this request;
Obtain the byte stream of this file destination from this Website server determined, and described byte stream is kept in in the memory storage of described Control Server;
According to the size of described byte stream and the residual memory space of multiple file server, determine target file server; And
Described byte stream is sent to described target file server store.
2. storage space dynamic allocation method as claimed in claim 1, it is characterized in that, the method also comprises:
After the storage that described target file server completes this file destination, send completion notice to described client, this completion notice comprises the address of described target file server.
3. storage space dynamic allocation method as claimed in claim 1, it is characterized in that, the method also comprises:
Record address and the residual memory space of each file server.
4. storage space dynamic allocation method as claimed in claim 3, it is characterized in that, the method also comprises:
After the storage that described target file server completes described byte stream, upgrade the residual memory space of this target file server.
5. storage space dynamic allocation method as claimed in claim 1, it is characterized in that, the method also comprises:
When there being the residual memory space of multiple file server to be more than or equal to the size of described byte stream, according to the priority orders of the file server preset, from described multiple file server, select the file server possessing higher priority as target file server.
6. the storage space dynamic allocation method according to any one of claim 1 to 5, it is characterized in that, the method also comprises:
When not having the residual memory space of file server to be more than or equal to the size of described byte stream, or when the memory storage of described Control Server cannot preserve described byte stream, send exception reporting to described client to notify that described client cannot complete the storage to this file destination.
7. a storage space dynamic allocation system, is applied in Control Server, and this Control Server is connected with client and multiple file server, it is characterized in that, this system comprises:
Receiver module, for receiving the request of preserving file destination from described client, and determines according to this request the Website server storing described file destination;
Download module, the Website server for determining from this obtains the byte stream of this file destination, and is kept in by described byte stream in the memory storage of described Control Server;
Determination module, for according to the size of described byte stream and the residual memory space of multiple file server, determines target file server; And
Sending module, stores for described byte stream is sent to described target file server.
8. storage space dynamic allocation system as claimed in claim 7, it is characterized in that, this system also comprises configuration module, for recording address and the residual memory space of each file server.
9. storage space dynamic allocation system as claimed in claim 8, is characterized in that, described configuration module also for after the storage that completes described byte stream in described target file server, upgrades the residual memory space of this target file server.
10. storage space dynamic allocation system as claimed in claim 7, it is characterized in that, described determination module is also for when there being the residual memory space of multiple file server to be more than or equal to the size of described byte stream, according to the priority orders of the file server preset, from described multiple file server, select the file server possessing higher priority as target file server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310320522.5A CN104346101A (en) | 2013-07-29 | 2013-07-29 | Dynamic storage space allocation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310320522.5A CN104346101A (en) | 2013-07-29 | 2013-07-29 | Dynamic storage space allocation system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104346101A true CN104346101A (en) | 2015-02-11 |
Family
ID=52501824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310320522.5A Pending CN104346101A (en) | 2013-07-29 | 2013-07-29 | Dynamic storage space allocation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104346101A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107861694A (en) * | 2017-12-04 | 2018-03-30 | 合肥联宝信息技术有限公司 | A kind of information storage means and electronic equipment |
| CN109120665A (en) * | 2018-06-20 | 2019-01-01 | 中国科学院信息工程研究所 | High speed packet acquisition method and device |
| CN110489237A (en) * | 2019-08-20 | 2019-11-22 | 深圳市丰润达科技有限公司 | Serial data receiving handling method, device and computer readable storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200910873A (en) * | 2007-08-24 | 2009-03-01 | Hon Hai Prec Ind Co Ltd | System and method for analyzing and processing downloaded data |
| CN103096146A (en) * | 2011-11-04 | 2013-05-08 | 华为软件技术有限公司 | Media information issuing method and issuing management server |
| CN103118045A (en) * | 2011-11-17 | 2013-05-22 | 腾讯科技（深圳）有限公司 | Method and system of off-line downloading |
-
2013
- 2013-07-29 CN CN201310320522.5A patent/CN104346101A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200910873A (en) * | 2007-08-24 | 2009-03-01 | Hon Hai Prec Ind Co Ltd | System and method for analyzing and processing downloaded data |
| CN103096146A (en) * | 2011-11-04 | 2013-05-08 | 华为软件技术有限公司 | Media information issuing method and issuing management server |
| CN103118045A (en) * | 2011-11-17 | 2013-05-22 | 腾讯科技（深圳）有限公司 | Method and system of off-line downloading |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107861694A (en) * | 2017-12-04 | 2018-03-30 | 合肥联宝信息技术有限公司 | A kind of information storage means and electronic equipment |
| CN109120665A (en) * | 2018-06-20 | 2019-01-01 | 中国科学院信息工程研究所 | High speed packet acquisition method and device |
| CN109120665B (en) * | 2018-06-20 | 2020-05-29 | 中国科学院信息工程研究所 | High-speed data packet acquisition method and device |
| CN110489237A (en) * | 2019-08-20 | 2019-11-22 | 深圳市丰润达科技有限公司 | Serial data receiving handling method, device and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20140047070A1 (en) | Cloud comuting device and method for storing data files in cloud servers | |
| US20140164487A1 (en) | File saving system and method | |
| US20140164391A1 (en) | Data block saving system and method | |
| CN102810066A (en) | Terminal adapting method and terminal and server based on terminal characteristic configuration program | |
| CN111475483B (en) | Database migration method and device and computing equipment | |
| CN105262608B (en) | Monitoring method and device for network service | |
| US20140237024A1 (en) | Network communication devices and file tracking methods thereof | |
| CN103607428A (en) | Method of accessing shared memory and apparatus thereof | |
| US8856365B2 (en) | Computer-implemented method, computer system and computer readable medium | |
| CN103634144A (en) | Method, system and equipment for managing multi-IDC (internet data center) cluster configuration file | |
| US20120296871A1 (en) | File managing apparatus for processing an online storage service | |
| CN102567339A (en) | Method, device and system for acquiring start page | |
| EP3582116A1 (en) | Webpage loading method, webpage loading system, and server | |
| CN110781149A (en) | Method, device, equipment and storage medium for managing live broadcast room information | |
| CN108196902A (en) | For showing the method and apparatus for advertisement of spreading its tail | |
| CA2813339C (en) | Methods, apparatus, and systems for electronic device recovery | |
| CN104346101A (en) | Dynamic storage space allocation system and method | |
| CN111783005B (en) | Method, device and system for displaying web page, computer system and medium | |
| CN105453518B (en) | Synchronization of metering networks | |
| CN110677443A (en) | Data transmitting and receiving method, transmitting end, receiving end, system and storage medium | |
| CN110096295B (en) | Multi-module mobile application thermal updating method and system based on reactivating | |
| CN105144073A (en) | Removable storage device identity and configuration information | |
| CN105338058A (en) | Application updating method and device | |
| CN112688980B (en) | Resource distribution method and device, and computer equipment | |
| CN115269063A (en) | Process creation method, system, device and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150211 |
|
| WD01 | Invention patent application deemed withdrawn after publication |