CN106407297A - Data packet downloading management system and method - Google Patents
Data packet downloading management system and method Download PDFInfo
- Publication number
- CN106407297A CN106407297A CN201610766340.4A CN201610766340A CN106407297A CN 106407297 A CN106407297 A CN 106407297A CN 201610766340 A CN201610766340 A CN 201610766340A CN 106407297 A CN106407297 A CN 106407297A
- Authority
- CN
- China
- Prior art keywords
- packet
- file
- size
- storage
- threshold value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/113—Details of archiving
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a data packet downloading management system and method. The data packet downloading management method comprises the steps of judging whether a file storage mode of a to-be-downloaded data packet is a multi-file storage mode, and if yes, judging whether a division mode stored in a file is a time division mode, a size division mode or a time and size comprehensive division mode; if the division mode is the time division mode, processing folders stored in the data packet according to a set time, and storing the divided data packets to the corresponding folders; if the division mode is the size division mode, processing the files stored in the data packet according to a set size, and storing the divided data packets to the corresponding files; and if the division mode is the time and size comprehensive division mode, processing the folders and the files stored in the data packet according to the set comprehensive division mode, and storing the divided data packets to the corresponding folders and files. The time division and size division storage of the downloaded data packet can be flexibly selected and supported, and the high-efficiency data packet local analysis and evidence collection can be provided.
Description
Technical field
The present invention relates to a kind of packet download management system and method, more particularly to one kind are applied to backtracking network dividing
The packet download management system of analysis and method.
Background technology
Based in backtracking analysis of network, generally, it is that network packet is all stored in server, when having
During to the labor of packet, need locally downloading for the packet of server using as analysis with collect evidence.
Traditional downloading mode be download data to locally stored for certain file（As download tools such as sudden peals of thunder）, lead to
The data APMB package once downloaded is too big, but network packet can not be adopted in this way, because work as downloading the total of packet
When amount is too big, one too big file detection of data packet analysis tool analysis is extremely low, in addition some analytical tools can not analyze super
Cross a certain size file（Most data packets analytical tool, needs when analysis for packet to be loaded into internal memory, but due to
Internal memory limits, so the size of the packet once analyzed is limited）.
Content of the invention
The technical problem to be solved in the present invention be provide a kind of download packet time span larger, convenient according to the time
Section, the packet download management system being analyzed in turn and method.
The technical solution used in the present invention is as follows：A kind of packet download management system, including,
File memory module judge module, judges whether the file memory module of packet to be downloaded is multifile storage mould
Formula；
Fractionation regimen judge module, judges that the Fractionation regimen of file storage is time division pattern, or size Fractionation regimen, also
It is the comprehensive Fractionation regimen of time and size；
Packet segmentation module, is more than segmentation to stepping out sliced time and/or current data packet size plus new files size
The packet of size threshold value carries out time division and/or size segmentation storage；
File creation module, for time division pattern, creates the new folder of the packet of storage to be split；
File creation module, for size Fractionation regimen, creates the new file of the packet of storage to be split.
If the packet time span downloaded is larger, when often analyzing, need according to the time period, carry out in turn
Analysis.Therefore downloading data bag when be late between and the size strategy being split and stored can cause to analyze and collect evidence especially tired
Difficult.The present invention program proposes multifile memory module, to packet time span larger data bag itself size downloaded relatively
Big packet carries out segmentation storage, can effectively improve the local analytics evidence obtaining efficiency of packet.
Also include file storage selecting module, file memory module is selected；Described file memory module includes list
File memory module and multifile memory module.
Default document memory module can be set it is also possible to select to store mould to file before carrying out file download storage
Formula is selected, and is user-friendly to.
Also include partitioning scheme selecting module, the Fractionation regimen of storage file is selected, including time division pattern
Select unit and size Fractionation regimen select unit.
Default document Fractionation regimen can be set it is also possible to carry out file division model selection before file is stored,
Described time division mode selecting unit and size Fractionation regimen select unit can select first, can also both of which choose.
Also include splitting size threshold value setup module, size threshold value to be split is configured.
User carries out size threshold value setting according to the actual requirements, and such as this threshold value can be 1MB or 2MB, or
10MB.
Also include sliced time threshold setting module, time threshold to be split is configured.
User carries out time threshold setting according to the actual requirements, and for example this time threshold can be several seconds or several
Minute, a few houres, several days or even several weeks.
A kind of packet downloading management method, concrete grammar step is：
Whether the file memory module of S1, judgement packet to be downloaded is multifile memory module, if it is, entering next
Step；If it is not, then carrying out file download storage according to monofile memory module；
S2, the Fractionation regimen judging file storage are time division patterns, or size Fractionation regimen, or time and size
Comprehensive Fractionation regimen；If time division pattern then enters S3；If size Fractionation regimen, then enter S4；If when
Between and the comprehensive Fractionation regimen of size then enter S5；
S3, process according to the time division pattern file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S4, process according to the when size Fractionation regimen file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S5, according to the comprehensive Fractionation regimen setting, to packet, the file storing and file are processed, and will temporally divide
Packet after cutting is stored in corresponding file, and the packet after splitting by size is stored in corresponding file.
In described time division pattern, user arranges sliced time threshold value according to self-demand, according to during the segmentation setting
Between threshold value packet to be stored is carried out segmentation storage, judge whether current data packet has stepped out sliced time, be then to exist
Newly-built sliced time file under file directory, and this new folder is set for storage location.
One and only one timestamp of each packet, judges whether packet time stamp is more than time division point, such as
Fruit reaches then new folder, and new files store this packet in new file.
In described size Fractionation regimen, user arranges segmentation size threshold value according to self-demand, big according to the segmentation setting
Little threshold value carries out segmentation storage to packet to be stored, and judges that current data packet size adds file size whether more than segmentation
Size threshold value, is then in storage location new files, and arranges this new files for storage location.
Each packet has and fixing length, judges whether the packet file size of packet write is more than file
Size cut-point, if reached, new files store this packet.
In described comprehensive Fractionation regimen, user arranges sliced time threshold value and segmentation size threshold value according to self-demand, presses
According to the sliced time threshold value setting and segmentation size threshold value, packet to be stored is carried out with segmentation storage；Judge current data packet
Whether stepped out sliced time, be then newly-built sliced time file under file directory, and this new folder be set be
Storage location, judges that current data packet size adds that file size, whether more than segmentation size threshold value, is then in storage position simultaneously
Put new files, and this new files is set for storage location.
If the size segmentation threshold of packet is 1MB, a divided data package size is certainly less than 1MB, same
In one nanosecond, a packet write thread is it is impossible to write two data APMB packages close to 1MB.
Compared with prior art, the invention has the beneficial effects as follows：Can flexibly select to support the timesharing of downloading data bag, point
Size stores, and provides the local analytics of efficient packet to collect evidence, is embodied in：
1. can be according to the timestamp of packet, by packet according to windows package management file, file, the form of file
Management is got up；
2., when being analyzed to packet, quickly corresponding data APMB package can be found according to extraction analysis time；
3. monofile, time division multifile, size splits multifile, and it is all dynamically optional that time size splits multifile simultaneously
?.
Brief description
Fig. 1 is the principle schematic of a present invention wherein embodiment.
Specific embodiment
In order that the objects, technical solutions and advantages of the present invention become more apparent, below in conjunction with drawings and Examples, right
The present invention is further elaborated.It should be appreciated that specific embodiment described herein is only in order to explain the present invention, not
For limiting the present invention.
This specification（Including summary and accompanying drawing）Disclosed in any feature, unless specifically stated otherwise, all can be equivalent by other
Or the alternative features with similar purpose are replaced.I.e., unless specifically stated otherwise, each feature is a series of equivalent or class
Like one of feature example.
Specific embodiment 1
A kind of packet download management system, including,
File memory module judge module, judges whether the file memory module of packet to be downloaded is multifile storage mould
Formula；
Fractionation regimen judge module, judges that the Fractionation regimen of file storage is time division pattern, or size Fractionation regimen, also
It is the comprehensive Fractionation regimen of time and size；
Packet segmentation module, is more than segmentation to stepping out sliced time and/or current data packet size plus new files size
The packet of size threshold value carries out time division and/or size segmentation storage；
File creation module, for time division pattern, creates the new folder of the packet of storage to be split；
File creation module, for size Fractionation regimen, creates the new file of the packet of storage to be split.
Specific embodiment 2
On the basis of specific embodiment 1, also include file storage selecting module, file memory module is selected；Described
File memory module includes monofile memory module and multifile memory module.
Default document memory module can be set it is also possible to select to store mould to file before carrying out file download storage
Formula is selected, and is user-friendly to.
Specific embodiment 3
On the basis of specific embodiment 1 or 2, also include partitioning scheme selecting module, the Fractionation regimen of storage file is carried out
Select, including time division mode selecting unit and size Fractionation regimen select unit.
Default document Fractionation regimen can be set it is also possible to carry out file division model selection before file is stored,
Described time division mode selecting unit and size Fractionation regimen select unit can select first, can also both of which choose.
Specific embodiment 4
On the basis of one of specific embodiment 1 to 3, also include splitting size threshold value setup module, to size threshold to be split
Value is configured.
User carries out size threshold value setting according to the actual requirements, and such as this threshold value can be 1MB or 2MB, or
10MB.
Specific embodiment 5
On the basis of one of specific embodiment 1 to 4, also include sliced time threshold setting module, to time threshold to be split
Value is configured.
User carries out time threshold setting according to the actual requirements, and for example this time threshold can be several seconds or several
Minute, a few houres, several days or even several weeks.
Specific embodiment 6
On the basis of one of specific embodiment 1 to 5, a kind of packet downloading management method, concrete grammar step is：
Whether the file memory module of S1, judgement packet to be downloaded is multifile memory module, if it is, entering next
Step；If it is not, then carrying out file download storage according to monofile memory module；
S2, the Fractionation regimen judging file storage are time division patterns, or size Fractionation regimen, or time and size
Comprehensive Fractionation regimen；If time division pattern, enter S3；If size Fractionation regimen, then enter S4；If the time
And the comprehensive Fractionation regimen of size then enters S5；
S3, process according to the time division pattern file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S4, process according to the when size Fractionation regimen file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S5, according to the comprehensive Fractionation regimen setting, to packet, the file storing and file are processed, and will temporally divide
Packet after cutting is stored in corresponding file, and the packet after splitting by size is stored in corresponding file.
Specific embodiment 7
On the basis of specific embodiment 6, in described time division pattern, user arranges sliced time threshold according to self-demand
Value, whether the sliced time threshold value according to setting carries out segmentation storage to packet to be stored, judge current data packet
Step out sliced time, be then newly-built sliced time file under file directory, and to arrange this new folder be storage location.
Specific embodiment 8
On the basis of one of specific embodiment 6 to 7, in described size Fractionation regimen, user arranges segmentation according to self-demand
Size threshold value, the segmentation size threshold value according to setting carries out segmentation storage to packet to be stored, and judges that current data packet is big
Little plus file size whether more than segmentation size threshold value, be then in storage location new files, and this new files be set be
Storage location.
Specific embodiment 9
On the basis of one of specific embodiment 6 to 8, in described comprehensive Fractionation regimen, user arranges segmentation according to self-demand
Time threshold and segmentation size threshold value, enter to packet to be stored according to the sliced time threshold value setting and segmentation size threshold value
Row segmentation storage；Judge whether current data packet has stepped out sliced time, be then newly-built sliced time literary composition under file directory
Part presss from both sides, and arranges this new folder for storage location, judges whether current data packet size is more than plus file size simultaneously
Segmentation size threshold value, is then in storage location new files, and arranges this new files for storage location.
Specific embodiment 10
As shown in figure 1, in this specific embodiment, first determining whether how civilian whether the file memory module of packet to be downloaded be
Part memory module, if it is not, then carry out file download storage according to monofile memory module；If it is, carrying out to packet
Download process, judges whether to need file is carried out with segmentation storage, selects segmentation memory module if necessary.
In this specific embodiment, first judge whether enabling time Fractionation regimen, be then according to the time division mould setting
The file that formula stores to packet is processed, and the packet after segmentation is stored in corresponding file；Otherwise arrange
Newly-built storage folder after good file storage location；Judge whether wherein size Fractionation regimen again, be then according to big when setting
The file that little Fractionation regimen stores to packet is processed, and the packet after segmentation is stored in corresponding file.Also may be used
First to judge whether that enabling size Fractionation regimen judges whether enabling time Fractionation regimen again.
Wherein, time division is measured, in this specific embodiment, using using folder management strategy：As adopted 1
Minute segmentation, then new folder title in the following manner " year-month-day-when. point. the second-year-month-day-when. point. the second " for example：
" 2016-08-23.11.24.00-2016-08-23.11.25.00 ", " 2016-08-23.11.25.00-2016-08-
23.11.26.00 " etc., then place the packet belonging to this time period under these files, the time period closes right open interval for a left side
[2016-08-23.11.25.00,2016-08-23.11.26.00), that is, the time storing is " 2016-08-23.11.25.00
To 2016-08-23.11.25.59 " packet.
For size segmentation strategy, using file management strategy：As split using 1MB, then new files size adds i.e.
The size of data to be written bag is more than 1MB, with regard to newly-built another one file.Separately, the title of file uses User Defined base
This title+write file current time, such as：Basic designation is " test ", then：" test time " example：“test2016-08-
23.11.28.51.667”.
Claims (9)
1. a kind of packet download management system it is characterised in that：Including,
File memory module judge module, judges whether the file memory module of packet to be downloaded is multifile storage mould
Formula；
Fractionation regimen judge module, judges that the Fractionation regimen of file storage is time division pattern, or size Fractionation regimen, also
It is the comprehensive Fractionation regimen of time and size；
Packet segmentation module, is more than segmentation to stepping out sliced time and/or current data packet size plus new files size
The packet of size threshold value carries out time division and/or size segmentation storage；
File creation module, for time division pattern, creates the new folder of the packet of storage to be split；
File creation module, for size Fractionation regimen, creates the new file of the packet of storage to be split.
2. packet download management system according to claim 1 it is characterised in that：Also include file storage and select mould
Block, selects to file memory module；Described file memory module includes monofile memory module and multifile memory module.
3. packet download management system according to claim 1 it is characterised in that：Also include partitioning scheme and select mould
Block, selects to the Fractionation regimen of storage file, selects single including time division mode selecting unit and size Fractionation regimen
Unit.
4. packet download management system according to claim 1 it is characterised in that：Also include splitting size threshold value setting
Module, is configured to size threshold value to be split.
5. the packet download management system according to claim 1 or 4 it is characterised in that：Also include sliced time threshold value
Setup module, is configured to time threshold to be split.
6. a kind of packet downloading management method, concrete grammar step is：
Whether the file memory module of S1, judgement packet to be downloaded is multifile memory module, if it is, entering next
Step；If it is not, then carrying out file download storage according to monofile memory module；
S2, the Fractionation regimen judging file storage are time division patterns, or size Fractionation regimen, or time and size
Comprehensive Fractionation regimen；If time division pattern then enters S3；If size Fractionation regimen, then enter S4；If when
Between and the comprehensive Fractionation regimen of size then enter S5；
S3, process according to the time division pattern file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S4, process according to the when size Fractionation regimen file that packet store setting, and by the packet after splitting
It is stored in corresponding file；
S5, according to the comprehensive Fractionation regimen setting, to packet, the file storing and file are processed, and will temporally divide
Packet after cutting is stored in corresponding file, and the packet after splitting by size is stored in corresponding file.
7. packet downloading management method according to claim 1, in described time division pattern, user is according to itself need
Seek setting sliced time threshold value, the sliced time threshold value according to setting carries out segmentation storage to packet to be stored, judge to work as
Whether front packet has stepped out sliced time, is then newly-built sliced time file under file directory, and it is newly-built to arrange this
File is storage location.
8. packet downloading management method according to claim 1, in described size Fractionation regimen, user is according to itself need
Seek setting segmentation size threshold value, the segmentation size threshold value according to setting carries out segmentation storage to packet to be stored, and judges to work as
Front data package size adds that file size, whether more than segmentation size threshold value, is then in storage location new files, and arranges this
New files are storage location.
9. packet downloading management method according to claim 1, in described comprehensive Fractionation regimen, user is according to itself need
Ask setting sliced time threshold value and segmentation size threshold value, according to the sliced time threshold value setting and segmentation size threshold value to will store
Packet carry out segmentation storage；Judge whether current data packet has stepped out sliced time, be then newly-built under file directory
Sliced time file, and this new folder is set for storage location, judge that current data packet size adds that file is big simultaneously
Whether little be then in storage location new files more than segmentation size threshold value, and arranges this new files for storage location.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610766340.4A CN106407297A (en) | 2016-08-31 | 2016-08-31 | Data packet downloading management system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610766340.4A CN106407297A (en) | 2016-08-31 | 2016-08-31 | Data packet downloading management system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106407297A true CN106407297A (en) | 2017-02-15 |
Family
ID=58003489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610766340.4A Pending CN106407297A (en) | 2016-08-31 | 2016-08-31 | Data packet downloading management system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106407297A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107133357A (en) * | 2017-05-26 | 2017-09-05 | 维沃移动通信有限公司 | A kind of picture storage method and mobile terminal |
| CN110032478A (en) * | 2018-01-11 | 2019-07-19 | 中兴通讯股份有限公司 | Method, device and system for real-time synchronization of data of main and standby centers and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101155296A (en) * | 2006-09-29 | 2008-04-02 | 中国科学技术大学 | Method for transmitting data |
| CN101615175A (en) * | 2009-08-11 | 2009-12-30 | 深圳市五巨科技有限公司 | A kind of system and method for reading electronic book of mobile terminal |
| CN102004760A (en) * | 2010-11-03 | 2011-04-06 | 深圳市同洲电子股份有限公司 | Multimedia file storing and applying method, related device and system |
| CN103442090A (en) * | 2013-09-16 | 2013-12-11 | 苏州市职业大学 | Cloud computing system for data scatter storage |
| CN104679905A (en) * | 2015-03-20 | 2015-06-03 | 四川特伦特科技股份有限公司 | High-speed storage system based on cloud storage |
| CN105282200A (en) * | 2014-07-18 | 2016-01-27 | 中国电信股份有限公司 | Breakpoint resume method and server |
-
2016
- 2016-08-31 CN CN201610766340.4A patent/CN106407297A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101155296A (en) * | 2006-09-29 | 2008-04-02 | 中国科学技术大学 | Method for transmitting data |
| CN101615175A (en) * | 2009-08-11 | 2009-12-30 | 深圳市五巨科技有限公司 | A kind of system and method for reading electronic book of mobile terminal |
| CN102004760A (en) * | 2010-11-03 | 2011-04-06 | 深圳市同洲电子股份有限公司 | Multimedia file storing and applying method, related device and system |
| CN103442090A (en) * | 2013-09-16 | 2013-12-11 | 苏州市职业大学 | Cloud computing system for data scatter storage |
| CN105282200A (en) * | 2014-07-18 | 2016-01-27 | 中国电信股份有限公司 | Breakpoint resume method and server |
| CN104679905A (en) * | 2015-03-20 | 2015-06-03 | 四川特伦特科技股份有限公司 | High-speed storage system based on cloud storage |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107133357A (en) * | 2017-05-26 | 2017-09-05 | 维沃移动通信有限公司 | A kind of picture storage method and mobile terminal |
| CN107133357B (en) * | 2017-05-26 | 2020-01-14 | 维沃移动通信有限公司 | Picture storage method and mobile terminal |
| CN110032478A (en) * | 2018-01-11 | 2019-07-19 | 中兴通讯股份有限公司 | Method, device and system for real-time synchronization of data of main and standby centers and storage medium |
| CN110032478B (en) * | 2018-01-11 | 2022-05-13 | 中兴通讯股份有限公司 | Method, device and system for real-time synchronization of data of main and standby centers and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI753887B (en) | Front-end user behavior statistics method and device | |
| CN104391954B (en) | The processing method and processing device of database journal | |
| US9075817B2 (en) | System, method, and computer readable media for identifying a user-initiated log file record in a log file | |
| CN110020339B (en) | Webpage data acquisition method and device based on non-buried point | |
| TW200627279A (en) | A prioritization system | |
| US20210224349A1 (en) | Method and apparatus for analyzing data flow, device, and medium | |
| US8321476B2 (en) | Method and system for determining boundary values dynamically defining key value bounds of two or more disjoint subsets of sort run-based parallel processing of data from databases | |
| CN102411617B (en) | Method for storing and inquiring a large quantity of URLs | |
| CN106407297A (en) | Data packet downloading management system and method | |
| CN108492342B (en) | Method, device, processor, storage medium and terminal for merging broken graphs | |
| CN107688488A (en) | A kind of optimization method and device of the task scheduling based on metadata | |
| CN102609412A (en) | RSS (Really Simple Syndication)-based multi-thread graphic information synchronization crawling control method and system | |
| CN103823852B (en) | The treating method and apparatus of database server daily record | |
| CN113242159A (en) | Application access relation determining method and device | |
| CN111106965A (en) | Intelligent log analysis method, tool, equipment and medium for complex system | |
| CN109446441B (en) | General credible distributed acquisition and storage system for network community | |
| CN103853771A (en) | Search result pushing method and search result pushing system | |
| CN114490554A (en) | Data synchronization method and device, electronic equipment and storage medium | |
| CN111475394B (en) | Application testing method and device | |
| CN112069144A (en) | Method and device for collecting system logs by multi-control cluster | |
| CN109657294A (en) | Test flight data automated analysis method and system based on characteristic parameter | |
| CN108563665A (en) | A kind of data processing system and method based on big data technology | |
| CN110110151B (en) | Method, system, computer equipment and storage medium for analyzing and warehousing resource packages | |
| CN114326640A (en) | Bottleneck station searching method, system, equipment and storage medium | |
| CN109241388A (en) | A kind of application programming interfaces behavior analysis method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170215 |