CN108769127A - A kind of big file uploading and download process method - Google Patents
A kind of big file uploading and download process method Download PDFInfo
- Publication number
- CN108769127A CN108769127A CN201810408374.5A CN201810408374A CN108769127A CN 108769127 A CN108769127 A CN 108769127A CN 201810408374 A CN201810408374 A CN 201810408374A CN 108769127 A CN108769127 A CN 108769127A
- Authority
- CN
- China
- Prior art keywords
- file
- server
- web server
- big
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Abstract
The present invention relates to a kind of big file uploading and download process methods, build a file server first, and installation file system database is used to store large-data documents on the server；File designation rule is defined on file server, it is FILE_ID unique for the document definition that each stores, then this FILE_ID is stored into database table；It resettles web server and is connected with the above-mentioned file server built, and setting file uploads interface, file download interface on a web server, user is named from file server and by custom rule in storage to file system database after web server successively by that can carry out file upload request on browsing client, and when downloading request, meeting basis has named file to be screened from file system database after web server.The present invention provides one kind to take up less resources, and corresponding speed is fast, calls efficiently easily big file uploading and download process method.
Description
Technical field
The present invention relates to computer file processing methods, and in particular to a kind of big file uploading and download process method.
Background technology
With the fast development and popularization and application of computer and information technology, the scale of sector application system expands rapidly,
Data caused by sector application are in explosive increase.What we needed to solve is the storage problem of the upper transmitting file of client, is uploaded
The quantity of file be likely to be breached one day 300 to 8000.Traditional big document handling modus cannot meet present situation.Therefore,
Seek effective big data treatment technology, ways and means have become the active demand of real world.
Traditional processing mode：It, in addition can also be in database one is the file of upload can be put in the database
In deposit filename, then document entity is stored in file system；But traditional method has the following problems：If big
If file deposit data library, visit capacity is very big, can compare occupancy resource when reading file content, reduce the performance of database,
If depositing local file, hard disk needs frequently to read catalogue listing, can also reduce performance in this way.
Invention content
The one kind provided the invention aims to overcome the deficiencies in the prior art takes up less resources, corresponding speed is fast,
Call efficient easily big file uploading and download process method.
In order to achieve the above objectives, the present invention adopts the following technical scheme that.
For ease of the statement of the technical program, description below is made to the technical term being referred to below：MongoDB refers to base
In the database of distributed document storage；FILE_ID refers to storage file address name；Web server refers to Website server；
Submit refers to that file is submitted；ObjectId refers to the unique identifying number of each file of storage.
A kind of big file uploading and download process method, comprise the following specific steps that：
Step 1：A file server is built first, and MongoDB file system databases are installed on the server（Both divided
The database of cloth file storage）For storing large file；
Step 2：Self-defined a set of file designation rule on file server, for one FILE_ of document definition each stored
ID, a file correspond to FILE_ID unique, and then this FILE_ID is stored into database table；
Step 3：It resettles a web server and is connected with the file server in the step 2, and in web services
The interface of upload and download is set on device；
Step 4：When browsing client executes the upload operation request of file, one has been write in the page of browsing client
The button of list and a submit type submits the entire form content, and web server obtains the file of our submissions, so
Call the interface of upper transmitting file, file big in this way that can be uploaded directly into MongoDB file system by this interface afterwards, simultaneously
It obtains ObjectId of this file in MongoDB file system databases and this ObjectId is stored in database table
In；
Step 5：When browsing client executes the down operation request of file, web server is by obtaining this solicited message
The ObjectId of file will be downloaded by obtaining this, and then by the download file interface of web server, this ObjectId is made
It is transmitted to file server for parameter, the file of our needs can be downloaded from MongoDB file system databases.
As a further improvement on the present invention, the file server has the storage expansion space of no less than 2T.
As a further improvement on the present invention, the browsing client is mobile phone or computer browsing client.
Due to the application of the above technical scheme, effective effect that the present invention is brought：The technical program is by each to store
Document definition naming rule, and a file corresponds to unique document ID, has to search for follow-up upload and download and has established necessity
Search speed is improved on basis, improves the advantageous effects of the accuracy of file transmission；The technical program also sets up independent
Web server may be implemented to call the independent operation of the processing of file, have maintain easily upgrading, improve call efficiency,
Occupy the few advantageous effects of file server resources；File block is also stored in MongoDB files system by the technical program
It unites in database, there are the advantageous effects that the efficient storage to data may be implemented, improve data transmission feedback speed.
Description of the drawings
Technical scheme of the present invention is further explained below in conjunction with the accompanying drawings.
Attached drawing 1 is overall flow block diagram of the present invention.
Attached drawing 2 is file upload operation flow diagram of the present invention.
Attached drawing 3 is file download operation flow diagram of the present invention.
In figure：1. building file server；2. installation file system database；3. defining file designation rule；4. establishing
Web server；5. file uploads interface；6. file download interface；7. user file uploads；8. user file is downloaded.
Specific implementation mode
Below in conjunction with the accompanying drawings and specific embodiment invention is further described in detail.
As shown in Figures 1 to 3, a kind of big file uploading and download process method build a file server 1 first, and
Installation file system database 2 on the server（Both the database of MongoDB distributed documents storage）For storing big data
Measure file；File designation rule 3 is defined on file server, for document definition one FILE_ID each stored, one
File corresponds to FILE_ID unique, this FILE_ID is then stored into lane database；Resettle web server 4 and with
The above-mentioned file server 1 built is connected, and file is arranged in web server 2 and uploads interface 5, file download interface 6；
When browsing client executes the upload operation request of file, a list and one have been write in the page of browsing client
The button of a submit types, the entire form content is submitted, and web server obtains the file of our submissions, is then called
The interface of transmitting file, file big in this way can be uploaded directly by this interface in MongoDB file system, while obtain this
ObjectId of the file in MongoDB file system databases is simultaneously stored in this ObjectId in database table；
When browsing client executes the down operation request of file, web server obtains this by obtaining this solicited message
A ObjectId that download file, then by the download file interface of web server, using this ObjectId as parameter
It is transmitted to file server, the file of our needs can be downloaded from MongoDB file system databases.
The specific application example that the above is only the present invention, is not limited in any way protection scope of the present invention；All uses
Equivalent transformation or equivalent replacement and the technical solution formed, all fall within rights protection scope of the present invention.
Claims (3)
1. a kind of big file uploading and download process method, comprise the following specific steps that：
Step 1：A file server is built first, and MongoDB file system databases are installed on the server（Both divided
The database of cloth file storage）For storing large file；
Step 2：Self-defined a set of file designation rule on file server, for one FILE_ of document definition each stored
ID, a file correspond to FILE_ID unique, and then this FILE_ID is stored into database table；
Step 3：It resettles a web server and is connected with the file server in the step 2, and in web services
The interface of upload and download is set on device；
Step 4：When browsing client executes the upload operation request of file, one has been write in the page of browsing client
The button of list and a submit type submits the entire form content, and web server obtains the file of our submissions, so
Call the interface of upper transmitting file, file big in this way that can be uploaded directly into MongoDB file system by this interface afterwards, simultaneously
It obtains ObjectId of this file in MongoDB file system databases and this ObjectId is stored in database table
In；
Step 5：When browsing client executes the down operation request of file, web server is by obtaining this solicited message
The ObjectId of file will be downloaded by obtaining this, and then by the download file interface of web server, this ObjectId is made
It is transmitted to file server for parameter, the file of our needs can be downloaded from MongoDB file system databases.
2. a kind of big file uploading according to claim 1 and download process method, it is characterised in that：The file service
Utensil has the storage expansion space of no less than 2T.
3. a kind of big file uploading according to claim 1 and download process method, it is characterised in that：The browsing client
End is mobile phone or computer browsing client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810408374.5A CN108769127A (en) | 2018-05-02 | 2018-05-02 | A kind of big file uploading and download process method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810408374.5A CN108769127A (en) | 2018-05-02 | 2018-05-02 | A kind of big file uploading and download process method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108769127A true CN108769127A (en) | 2018-11-06 |
Family
ID=64009172
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810408374.5A Pending CN108769127A (en) | 2018-05-02 | 2018-05-02 | A kind of big file uploading and download process method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769127A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307219A (en) * | 2011-03-18 | 2012-01-04 | 北京神州数码思特奇信息技术股份有限公司 | File access system, file uploading method and file downloading method |
| CN104468843A (en) * | 2014-12-31 | 2015-03-25 | 浪潮软件股份有限公司 | File uploading method and device |
| CN107220304A (en) * | 2017-05-10 | 2017-09-29 | 杭州铭师堂教育科技发展有限公司 | The slow Log Administration Systems of magnanimity mongodb based on salt |
-
2018
- 2018-05-02 CN CN201810408374.5A patent/CN108769127A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102307219A (en) * | 2011-03-18 | 2012-01-04 | 北京神州数码思特奇信息技术股份有限公司 | File access system, file uploading method and file downloading method |
| CN104468843A (en) * | 2014-12-31 | 2015-03-25 | 浪潮软件股份有限公司 | File uploading method and device |
| CN107220304A (en) * | 2017-05-10 | 2017-09-29 | 杭州铭师堂教育科技发展有限公司 | The slow Log Administration Systems of magnanimity mongodb based on salt |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11711420B2 (en) | Automated management of resource attributes across network-based services | |
| JP6621543B2 (en) | Automatic update of hybrid applications | |
| US11516288B2 (en) | Synchronized content library | |
| KR101373461B1 (en) | Terminal and method for using cloud sevices | |
| WO2018098429A1 (en) | Event driven extract, transform, load (etl) processing | |
| US9971788B2 (en) | Unified file and object data storage | |
| US10187255B2 (en) | Centralized configuration data in a distributed file system | |
| WO2016180055A1 (en) | Method, device and system for storing and reading data | |
| Peek et al. | EnsemBlue: Integrating distributed storage and consumer electronics | |
| JP2016516233A (en) | Share content items | |
| US11574025B2 (en) | Systems and methods for managed asset distribution in a distributed heterogeneous storage environment | |
| CN103023982A (en) | Low-latency metadata access method of cloud storage client | |
| US9600486B2 (en) | File system directory attribute correction | |
| CN103617199A (en) | Data operating method and data operating system | |
| CN105227672A (en) | The method and system that data store and access | |
| CN108268609A (en) | A kind of foundation of file path, access method and device | |
| CN105653209A (en) | Object storage data transmitting method and device | |
| US11157456B2 (en) | Replication of data in a distributed file system using an arbiter | |
| CN101483668A (en) | Network storage and access method, device and system for hot spot data | |
| WO2023109934A1 (en) | Data access method of object storage bucket and cloud management platform | |
| CN105653566B (en) | A kind of method and device for realizing database write access | |
| US20220318201A1 (en) | Accessing network based content items by a mobile device while offline | |
| CN108769127A (en) | A kind of big file uploading and download process method | |
| WO2012171363A1 (en) | Method and equipment for data operation in distributed cache system | |
| CN113760822A (en) | HDFS-based distributed intelligent campus file management system optimization method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181106 |
|
| RJ01 | Rejection of invention patent application after publication |