CN105072489B - A kind of method and system that rapid file is read - Google Patents
A kind of method and system that rapid file is read Download PDFInfo
- Publication number
- CN105072489B CN105072489B CN201510425302.8A CN201510425302A CN105072489B CN 105072489 B CN105072489 B CN 105072489B CN 201510425302 A CN201510425302 A CN 201510425302A CN 105072489 B CN105072489 B CN 105072489B
- Authority
- CN
- China
- Prior art keywords
- user
- data
- memory
- read
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44213—Monitoring of end-user related data
- H04N21/44222—Analytics of user selections, e.g. selection of programs or purchase activity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44204—Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Social Psychology (AREA)
- Human Computer Interaction (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The present invention relates to the method and systems that a kind of rapid file is read, including step S1, obtain user and play behavioural information；Step S2 plays behavioural information according to the user, and forecast analysis is loaded into the currently playing data of memory；The currently playing data are actively loaded into memory by step S3；It is further comprising the steps of after executing the step S1：Step S4 plays the analysis of being associated property of behavioural information to the user, the hot spot file associated with the currently playing data that forecast analysis is loaded into speedy storage equipment；Step S5, speedy storage equipment read the hot spot file, and memory is supplied to carry out data load.The present invention solves to store the contradiction between I O read performance greatly using memory and fast disc level 2 cache memory model, and can ensure data cached validity and stability.
Description
Technical field
The present invention relates to the method and systems that file reads field more particularly to a kind of reading of rapid file.
Background technology
Various regions radio and TV operator has begun to carry out its VOD service at present, in order to make full use of it to possess
Hfc plant transmit video frequency request program, be substantially using the I PQAM transmission technologys based on hfc plant, pass through QAM modulation
Mode I P signals are converted into RF radio signal transmissions to user.But there are one very big drawbacks for this transmission mode, just
It is that requirement server is sent to the data rate of I PQAM equipment and has to stablize, centre cannot have more than the interval of 100ms, no
Then flower screen or interim card will occur in the video of user's viewing.However there is a large amount of video content in the commercial city of various regions operation at present, these
Content is distributed to above each Edge Server, and in order to store these contents, Edge Server can only use the hard of large capacity
Disk stores data.Due to the hard disk of large capacity, its readwrite performance is nothing like the storages such as SSD, and in IO utilization rates
When larger, it is extremely susceptible to Caton phenomenon once in a while, so causing Edge Server with traditional HTTP server phase
Compare, the concurrent user that can be supported greatly reduces.
Existing media server is mainly the transmission that related data is carried out according to the time of media data, to ensure data
Code stream it is consistent with actual file code stream, but when high concurrent, IO can be constantly in busier state, at this moment extremely
There is interim card in the read operation for being easy to cause IO, at this moment can not only influence the viewing effect of this user, also can influence to service simultaneously
Other users on device.It is recorded and is counted according to the broadcasting of actual user, 80% user is in the video that viewing is reached the standard grade recently
Hold, and be wherein more than 50% user be all to watch 20% video content reached the standard grade recently, it can be seen that video content
Concentration is compared in access.
Present system is directly to read the mode of data from storage and use memory respectively there are mainly two types of realization method
Data cached mode；The mode that data are wherein directly read from storage uses directly from storage reading data, not to after
The data to be read carry out prediction load, realize that logic is simple, it is easy to accomplish.But it when I/O utilization is higher, has
Interim card delay phenomenon causes server that cannot make full use of IO performances, supports larger number of concurrent；Use memory cache data
Mode uses the prediction algorithm that caching is read, and a part of data can be loaded previously into memory, is used for playing module.But
Since memory size is limited, and the data of video file are all larger, which should not realize, and the data that can be cached
Also limited, cause data frequently to change to and swap out caching, it is very big to the dependence of storage performance.
Invention content
Technical problem to be solved by the invention is to provide the method and systems that a kind of rapid file of high stability is read.
The technical solution that the present invention solves above-mentioned technical problem is as follows：A kind of method that rapid file is read, including it is following
Step：
Step S1 obtains user and plays behavioural information；
Step S2 plays behavioural information according to the user, and forecast analysis is loaded into the currently playing data of memory；
The currently playing data are actively loaded into memory by step S3.
Based on the above technical solution, the present invention can also be improved as follows.
Further, further comprising the steps of after executing the step S1：
Step S4 plays the analysis of being associated property of behavioural information to the user, and forecast analysis is loaded into quick storage
The hot spot file associated with the currently playing data of equipment；
Step S5, speedy storage equipment read the hot spot file, and memory is supplied to carry out data load.
Further, in step S1, it includes the current popular video content played, user that the user, which plays behavioural information,
The playing duration of the position of broadcasting, the dragging position and user of user.
Further, in step S2, the forecast analysis according to data buffered in also included current memory.
Further, the speedy storage equipment includes multiple SSD disks.
The another technical solution that the present invention solves above-mentioned technical problem is as follows：A kind of system that rapid file is read, packet
Include statistical analysis module, internal storage data prediction module and internal storage data cache module；
The statistical analysis module plays behavioural information for obtaining user；
The internal storage data prediction module is used to play behavioural information according to the user, and forecast analysis is loaded into memory
Currently playing data；
The internal storage data cache module by the currently playing data for being actively loaded into memory.
Based on the above technical solution, the present invention can also be improved as follows.
Further, the system that the rapid file is read, further includes rapid file prediction module and rapid file pipe
Manage module；
The rapid file prediction module is used to play the analysis of being associated property of behavioural information, forecast analysis to the user
The hot spot file associated with the currently playing data for being loaded into speedy storage equipment；
The rapid file management module is supplied to interior deposit into for making speedy storage equipment read the hot spot file
Row data load.
Further, it includes the position that currently the popular video content played, user play that the user, which plays behavioural information,
It sets, the playing duration of the dragging position and user of user.
Further, the forecast analysis according to data buffered in also included current memory.
Further, the speedy storage equipment includes multiple SSD disks.
The beneficial effects of the invention are as follows：The present invention using memory and fast disc level 2 cache memory model come solve greatly store and
Contradiction between I O read performance, and can ensure data cached validity and stability.
Description of the drawings
Fig. 1 is the method flow diagram that rapid file of the present invention is read；
Fig. 2 is the system construction drawing that rapid file of the present invention is read.
Specific implementation mode
The principle and features of the present invention will be described below with reference to the accompanying drawings, and the given examples are served only to explain the present invention, and
It is non-to be used to limit the scope of the present invention.
The present invention solves to store the contradiction between I O read performance greatly using memory and fast disc level 2 cache memory model.
The speedy storage equipment of one layer of SSD disk composition is added between memory and data storage device, which can be by
Multiple SSD disks compositions, space size can reach T ranks, it is sufficient to cache hot spot file being played on, and video file
Reading all serially read, therefore memory cache may be used the simple algorithm serially prefetched and realize, to ensure that
Data cached validity and stability.
Fig. 1 is the method flow diagram that rapid file of the present invention is read.
As shown in Figure 1, a kind of method that rapid file is read, includes the following steps：
Step S1 obtains user and plays behavioural information；The acquisition refers to being obtained from playing module, playing module, that is, general
Player in meaning, the user play behavioural information include the current popular video content played, user play position,
The playing duration etc. of the dragging position and user of user.
Step S2 plays behavioural information according to the user, and forecast analysis is loaded into the currently playing data of memory；Institute
State forecast analysis according to data buffered in also included current memory, predict which data needs to be loaded into immediately
Memory ensures that the data that user plays can hit memory, rather than goes to read from speedy storage equipment, and can also count
It is the expired memory cache not used which, which is calculated, and carries out caching removing.
The currently playing data are actively loaded into memory by step S3；The played data of user can be direct in this way
It is obtained from memory, reduces and directly read data from speedy storage equipment, cause to play the probability that thread blocks, it in this way can be further
The utilization rate of IO is improved, and removes expired cache block in time.
The method that the also included rapid file of the present invention is read, it is further comprising the steps of after executing the step S1：
Step S4 plays the analysis of being associated property of behavioural information to the user, and forecast analysis is loaded into quick storage
The hot spot file associated with the currently playing data of equipment；The foundation of the correlation analysis includes local quick storage
The access temperature of the buffered video file of equipment, the access time of video file and video file；And it can also update system
Result data is counted, pervious expired hot spot file is come out, is used for the cleaning in speedy storage equipment space.
Step S5, speedy storage equipment read the hot spot file, and memory is supplied to carry out data load.Quick storage
Equipment copies the hot spot file from data storage device, and data buffer storage, the data are loaded for internal storage data cache module
Storage device can be common hard disc in general sense；The disk space size for checking speedy storage equipment simultaneously, works as use
Space size when being more than the threshold value of setting, by according to the data that come out, clean up past file in time, ensure newest
Prediction file can store in speedy storage equipment in time.
Fig. 2 is the system construction drawing that rapid file of the present invention is read.
As shown in Fig. 2, the system that a kind of rapid file is read, including it is statistical analysis module, internal storage data prediction module, interior
Deposit data cache module, rapid file prediction module and rapid file management module；
Statistical analysis module plays behavioural information for obtaining user；The acquisition refers to being obtained from playing module, is played
Module is player in general sense, and it includes the current popular video content played, user that the user, which plays behavioural information,
The playing duration etc. of the position of broadcasting, the dragging position and user of user.
Internal storage data prediction module is used to play behavioural information according to the user, and forecast analysis is loaded into working as memory
Preceding played data；The forecast analysis according to data buffered in also included current memory, which data predicted
It needs to be loaded into memory immediately, ensures that the data that user plays can hit memory, rather than go to read from speedy storage equipment
It takes, it is the expired memory cache not used which internal storage data prediction module, which can also calculate, is convenient for internal storage data
Cache module internally deposits into row caching and removes.
Internal storage data cache module by the currently playing data for being actively loaded into memory；The broadcasting number of user in this way
It according to can directly be obtained from memory, reduces and directly reads data from speedy storage equipment, cause to play the probability that thread blocks,
The utilization rate of IO can be further increased in this way, and removes expired cache block in time.
Rapid file prediction module is used to play the analysis of being associated property of behavioural information to the user, and forecast analysis is to be added
The hot spot file associated with the currently playing data for being downloaded to speedy storage equipment；The foundation of the correlation analysis includes
The access temperature of the buffered video file of local speedy storage equipment, the access time of video file and video file；And
And rapid file prediction module can also update statistical result data, and pervious expired hot spot file is come out, convenient for quick
Document management module clears up speedy storage equipment space.
Rapid file management module is supplied to memory into line number for making speedy storage equipment read the hot spot file
According to load.Speedy storage equipment copies the hot spot file from data storage device, and number is loaded for internal storage data cache module
According to caching, the data storage device can be common hard disc in general sense；Rapid file management module can be with simultaneously
The disk space size for checking speedy storage equipment will be according to counting when the space size used is more than the threshold value of setting
The data come clean up past file in time, ensure that newest prediction file can store in speedy storage equipment in time.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.
Claims (6)
1. a kind of method that rapid file is read, which is characterized in that include the following steps：
Step S1 obtains user and plays behavioural information；
Step S2 plays behavioural information or according to data buffered in current memory, forecast analysis according to the user
It is loaded into the currently playing data of memory；
The currently playing data are actively loaded into memory by step S3；
Step S4 plays the analysis of being associated property of behavioural information to the user, and forecast analysis is loaded into speedy storage equipment
Hot spot file associated with the currently playing data；
Step S5, speedy storage equipment read the hot spot file, and memory is supplied to carry out data load.
2. the method that rapid file according to claim 1 is read, which is characterized in that in step S1, the user plays
Behavioural information includes the broadcasting for dragging position and user of the current popular video content played, the position that user plays, user
Duration.
3. the method that rapid file according to claim 1 is read, which is characterized in that the speedy storage equipment includes more
A SSD disks.
4. the system that a kind of rapid file is read, which is characterized in that including statistical analysis module, internal storage data prediction module, interior
Deposit data cache module, rapid file prediction module and rapid file management module；
The statistical analysis module plays behavioural information for obtaining user；
The internal storage data prediction module is used to be played according to the user buffered in behavioural information or current memory
Data, forecast analysis are loaded into the currently playing data of memory；
The internal storage data cache module by the currently playing data for being actively loaded into memory；
The rapid file prediction module is used to play the analysis of being associated property of behavioural information to the user, and forecast analysis is to be added
The hot spot file associated with the currently playing data for being downloaded to speedy storage equipment；
The rapid file management module is supplied to memory into line number for making speedy storage equipment read the hot spot file
According to load.
5. the system that rapid file according to claim 4 is read, which is characterized in that the user plays behavioural information packet
Include the playing duration of the dragging position and user of position, user that currently the popular video content played, user play.
6. the system that rapid file according to claim 4 is read, which is characterized in that the speedy storage equipment includes more
A SSD disks.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510425302.8A CN105072489B (en) | 2015-07-17 | 2015-07-17 | A kind of method and system that rapid file is read |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510425302.8A CN105072489B (en) | 2015-07-17 | 2015-07-17 | A kind of method and system that rapid file is read |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105072489A CN105072489A (en) | 2015-11-18 |
| CN105072489B true CN105072489B (en) | 2018-08-03 |
Family
ID=54501749
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510425302.8A Active CN105072489B (en) | 2015-07-17 | 2015-07-17 | A kind of method and system that rapid file is read |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105072489B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108415667B (en) * | 2018-01-31 | 2021-06-25 | 惠州华阳通用电子有限公司 | Audio file loading method |
| CN110008016B (en) * | 2019-04-15 | 2021-06-22 | 深圳市万普拉斯科技有限公司 | Anonymous page management method and device, terminal device and readable storage medium |
| CN113312329B (en) * | 2020-02-26 | 2024-03-01 | 阿里巴巴集团控股有限公司 | Scheduling method, device and equipment for data files |
| CN112533067B (en) * | 2020-11-12 | 2022-05-31 | 烽火通信科技股份有限公司 | Method and device for quickly starting up super-high-definition video on demand |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009105465A2 (en) * | 2008-02-21 | 2009-08-27 | Activevideo Networks, Inc. | Using triggers with video for interactive content identification |
| CN102905188A (en) * | 2012-11-01 | 2013-01-30 | 北京奇艺世纪科技有限公司 | Video code stream switching method and device |
| CN103618942A (en) * | 2013-12-16 | 2014-03-05 | 乐视致新电子科技（天津）有限公司 | Smart television, as well as method and device for playing browser webpage video of smart television |
| CN103686414A (en) * | 2013-12-19 | 2014-03-26 | 北京奇艺世纪科技有限公司 | Network video playing method and device |
| CN104093044A (en) * | 2014-01-20 | 2014-10-08 | 腾讯科技（深圳）有限公司 | Online media playing method, server and system |
-
2015
- 2015-07-17 CN CN201510425302.8A patent/CN105072489B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009105465A2 (en) * | 2008-02-21 | 2009-08-27 | Activevideo Networks, Inc. | Using triggers with video for interactive content identification |
| CN102905188A (en) * | 2012-11-01 | 2013-01-30 | 北京奇艺世纪科技有限公司 | Video code stream switching method and device |
| CN103618942A (en) * | 2013-12-16 | 2014-03-05 | 乐视致新电子科技（天津）有限公司 | Smart television, as well as method and device for playing browser webpage video of smart television |
| CN103686414A (en) * | 2013-12-19 | 2014-03-26 | 北京奇艺世纪科技有限公司 | Network video playing method and device |
| CN104093044A (en) * | 2014-01-20 | 2014-10-08 | 腾讯科技（深圳）有限公司 | Online media playing method, server and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105072489A (en) | 2015-11-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105072489B (en) | A kind of method and system that rapid file is read | |
| US20170034233A1 (en) | Pre-Buffering Audio Streams | |
| CN103702057B (en) | Block storage algorithm applicable to multiple paths of concurrent-written stream media data | |
| CN100568957C (en) | A kind of video frequency request program caching method based on the p2p technology | |
| CN101304514B (en) | VOD system as well as data caching method and scheduling server thereof | |
| US20170371807A1 (en) | Cache data determining method and apparatus | |
| US9483191B2 (en) | Multi-tier storage for delivery of services | |
| US20110093905A1 (en) | Adaptive media caching for video on demand | |
| CN101345638B (en) | Equity system supporting time shift business | |
| CN101068341B (en) | Stream media dispatching system and medium file scheduling method thereof | |
| CN101882289A (en) | Advertisement playing control system and method thereof | |
| CN111314772B (en) | Method, device, terminal and storage medium for determining video downloading code rate | |
| CN101873355A (en) | Method, device and system for downloading file | |
| CN103414747A (en) | Adaptive streaming media caching method | |
| CN106686411A (en) | Streaming media channel recording method and device, playback method and device and server | |
| CN103297431A (en) | Streaming media video-on-demand duplicate hybrid buffer strategy based on cloud server cluster | |
| CN105915985A (en) | Method for performing watch-back in live broadcasting and device thereof | |
| CN105516672A (en) | Real time stream media play system and method based on internet of things sensing cloud | |
| CN102332284A (en) | Multimedia data processing method and processing system suitable for digital media broadcast | |
| CN110032691A (en) | Data cached sweep-out method, device and equipment | |
| CN101110844B (en) | Program fragment prefetching method and peer-to-peer network node | |
| CN109451344A (en) | Based on the buffer replacing method of correlation rule in P2P stream media system | |
| CN107333169A (en) | A kind of client-cache method of adjustment and device | |
| TW201533656A (en) | Multi-threshold storage device and method thereof | |
| WO2016155256A1 (en) | Method and system for controlling program recording, and management server and hotness counting server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |