CN103200272A - Streaming media storage system and storage method - Google Patents
Streaming media storage system and storage method Download PDFInfo
- Publication number
- CN103200272A CN103200272A CN2013101344717A CN201310134471A CN103200272A CN 103200272 A CN103200272 A CN 103200272A CN 2013101344717 A CN2013101344717 A CN 2013101344717A CN 201310134471 A CN201310134471 A CN 201310134471A CN 103200272 A CN103200272 A CN 103200272A
- Authority
- CN
- China
- Prior art keywords
- files
- stream media
- storage
- server
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title abstract description 20
- 238000013507 mapping Methods 0.000 claims abstract description 40
- 238000012360 testing method Methods 0.000 claims description 12
- 241000606643 Anaplasma centrale Species 0.000 claims description 3
- 238000013461 design Methods 0.000 description 19
- 230000005540 biological transmission Effects 0.000 description 10
- 238000004140 cleaning Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000004044 response Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000010008 shearing Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000008929 regeneration Effects 0.000 description 1
- 238000011069 regeneration method Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to a stream media storage system, which comprises terminal equipment, a central server, a cache server and at least two storage servers, wherein the cache server and each storage server are respectively used for storing at least two divided stream media files of a stream media file, and a mapping relation of each stream media file corresponding to the storage information of the stream media file is established in the central server; the terminal equipment sends streaming media requests to the cache server and each storage server according to the storage information of the specified streaming media file corresponding to the sub-streaming media file, which is obtained by the central server, and obtains the feedback of the specified streaming media file; meanwhile, the invention also relates to a storage method based on the streaming media storage system, and by the system and the method, the concurrency problem in multi-terminal access can be solved, and the network access speed of streaming media files can be effectively improved.
Description
Technical field
The present invention relates to a kind of Streaming Media storage system and storage means.
Background technology
The form of the mode that Streaming Media refers to flow transmission of audio, video and multimedia file in network; The files in stream media form is the media formats of supporting to adopt stream transmission and broadcast.The stream transmission mode is that multimedia files such as video and audio frequency are divided into compressed package one by one through special compress mode,, in real time transmission continuous to subscriber computer by server.In the system that adopts the stream transmission mode, the user needn't wait until the content in the middle of just seeing after the whole downloads of whole file finish as non-stream is play, but only need can utilize corresponding player that streaming video files such as the video of compression or audio frequency are play at subscriber computer through the startup in several seconds or tens seconds time-delay, rest parts will be proceeded to download, until finishing.
The a series of relevant bag of this process is called " stream ", and Streaming Media is actual to refer to a kind of new medium load mode, but not a kind of new medium.After the stream media technology overall application, people's directly phonetic entry of chatting on the net; If think to see each other the other side's appearance, expression, as long as both sides respectively have a camera just passable; See interested commodity on the net, after the click, the image of guide and commodity will be jumped out; More there is the video news of the sense of reality also can occur.
To be divided into the form that a plurality of files store corresponding with files in stream media, in the application of prior art to Streaming Media, the technical staff can store a plurality of files that are divided into respectively on a plurality of servers, this is because single memory node, not only restricted the user concurrent number, affect fail safe and the reliability of system, involve great expense simultaneously, also existing big defective aspect maintenance and the data regeneration rate, store into respectively on a plurality of servers so files in stream media is divided into a plurality of files, can effectively overcome the above problems.But along with extensive use and the cybertimes of Streaming Media are constantly progressive, terminal equipment in the access network becomes more and more, the transmission speed of network becomes the significant consideration that people use network, the appearance of Streaming Media and application, efficiently solve the concurrent problem of multi-terminal equipment, but for its network transmission, still depend on the transmission speed of its place network, and do not have effective method that it is improved.
Summary of the invention
Technical problem to be solved by this invention provides a kind of concurrent problem that occurs not only can solve multiple terminal access the time, and can effectively improve the Streaming Media storage system of files in stream media access to netwoks speed.
Corresponding therewith, technical problem to be solved by this invention provides a kind of Streaming Media storage system based on the present invention design, the concurrent problem that occurs when not only solving multiple terminal access, and can effectively improve storage means to the access speed of files in stream media.
The present invention is in order to solve the problems of the technologies described above by the following technical solutions: the present invention has designed a kind of Streaming Media storage system, comprises terminal equipment, central server and at least two storage servers; The files in stream media of each required storage is divided at least two sub-files in stream media through central server respectively, is stored in respectively in each storage server; Terminal equipment sends the Streaming Media request instruction to central server, central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again; Also comprise the caching server that is used for storing respectively each sub-files in stream media with each storage server in the lump, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
As a kind of optimal technical scheme of the present invention: described caching server and each storage server comprise corresponding with it individual count module respectively, respectively the number of times that is called of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server.
A kind of Streaming Media storage system of the present invention adopts above technical scheme compared with prior art, has following technique effect:
(1) the Streaming Media storage system of the present invention design is set up caching server and can effectively be improved terminal equipment to the reading speed of files in stream media adopting a plurality of storage servers to be divided at files in stream media on the basis that a plurality of files store respectively;
(2) in the Streaming Media storage system of the present invention's design, at caching server and each storage server, corresponding with it counting module is set respectively, can conveniently counts the accessed number of times of each files in stream media, can upgrade the files in stream media of storing targetedly in the future.
Corresponding therewith, the present invention is in order to solve the problems of the technologies described above by the following technical solutions: the present invention has also designed a kind of storage means of Streaming Media storage system, comprises the steps:
Step 1. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage, be stored in each storage server respectively at random, and set up the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
Step 2. central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again;
In the described step 1, each the sub-files in stream media after central server is cut apart each files in stream media respectively is stored in respectively in caching server and each storage server at random;
In the described step 2, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
As a kind of optimal technical scheme of the present invention: described step 1 comprises the steps:
Step a. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage;
Each first cross-talk files in stream media that step b. central server will correspond respectively to the files in stream media of each required storage is stored in the caching server, and all the other each sub-files in stream media are stored in each storage server respectively at random;
The step c central server is set up the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media according to the storage at each sub-files in stream media, is stored in the central server.
As a kind of optimal technical scheme of the present invention: also comprise the steps I after the described step 1, step I and step 2 are carried out simultaneously, and the step I is as follows:
Counting module in described caching server and each storage server, respectively the call number of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server, central server is determined popular files in stream media and unexpected winner files in stream media according to popular Streaming Media call number threshold values, unexpected winner Streaming Media call number threshold values that each sub-files in stream media is called the statistics of number of times and sets in advance.
As a kind of optimal technical scheme of the present invention: in the described step I, also comprise the steps: at described popular files in stream media
Described central server is stored in each sub-files in stream media on each storage server at popular files in stream media, at least one cross-talk files in stream media of picked at random, it is copied in the caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Simultaneously, popular files in stream media integral body is backed up to caching server.
As a kind of optimal technical scheme of the present invention: in the described step I, also comprise the steps: at described unexpected winner files in stream media
Described central server carries out analysis and judgement at the sub-files in stream media that the unexpected winner files in stream media is stored on the caching server: if judge other the sub-files in stream media that exists except the first cross-talk files in stream media, at least one section other sub-files in stream media of picked at random then, it is deleted from caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
If judge other the sub-files in stream media that does not exist except the first cross-talk files in stream media, then this first cross-talk files in stream media is trimmed in the storage server of selecting at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
As a kind of optimal technical scheme of the present invention: also comprise step ⅰ, step ⅰ carried out before step 1 or carries out simultaneously with step 1, step 2, and step ⅰ is as follows:
Described each storage server at the appointed time detects its concurrent visit situation and memory capacity situation in the interval respectively, and testing result is uploaded to described central server, central server is according to the testing result that receives, each storage server is divided into effective storage server or non-effective storage server respectively, according to dividing the result files in stream media to be stored is stored again.
As a kind of optimal technical scheme of the present invention: if certain server in described each storage server is being given directions testing result from the time interval to central server that do not upload its concurrent visit situation and memory capacity situation in, then central server is divided into the failed storage server with it, and at failed storage server triggers fault-tolerant scheduling strategy, simultaneously, upgrade the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, be stored in the central server.
As a kind of optimal technical scheme of the present invention: described fault-tolerant scheduling strategy comprises the steps:
Described central server searches whether there be the backup stream media file corresponding with described failed server neutron current media file in the described caching server, if exist, then the backup stream media file is copied in the effective storage server of picked at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
The storage means of a kind of Streaming Media storage system of the present invention adopts above technical scheme compared with prior art, has following technique effect:
(1) storage means of the Streaming Media storage system of the present invention's design, each sub-files in stream media after each files in stream media cut apart respectively, be stored at random respectively in caching server and each storage server, can effectively improve the access speed of files in stream media by setting up caching server, improve the network transmission efficiency of files in stream media;
(2) storage means of the Streaming Media storage system of the present invention's design, in the sub-files in stream media of after each files in stream media is cut apart each, the first cross-talk files in stream media corresponding with each files in stream media is stored in the caching server, can improve the access speed of the first cross-talk files in stream media targetedly, and then improve terminal equipment at the access speed of the whole access process of files in stream media;
(3) in the storage means of the Streaming Media storage system of the present invention's design, files in stream media at storage, by the counting to its accessed number of times, it is divided into popular files in stream media and unexpected winner files in stream media, respectively popular files in stream media and unexpected winner files in stream media are carried out corresponding storage update again, the index of content aspect not only can be provided for terminal access, and can make rational planning to the storage of files in stream media, improve the whole access efficiency of stored stream media file;
(4) storage means of the Streaming Media storage system of the present invention's design, in the storing process at files in stream media, at the appointed time in the interval, detect concurrent visit situation and the memory capacity situation of each storage server, each storage server is divided into effective storage server or non-effective storage server respectively, can effectively improves the storage efficiency of files in stream media and terminal equipment to the access speed of files in stream media;
(5) in the storage means of the Streaming Media storage system of the present invention's design, at the failed storage server, central server has adopted the fault-tolerant scheduling strategy, can guarantee at utmost that terminal equipment is to the visit of files in stream media.
Description of drawings
Fig. 1 is the structural representation of the Streaming Media storage system that designs of the present invention.
Embodiment
Below in conjunction with Figure of description the specific embodiment of the present invention is described in further detail.
As shown in Figure 1, the present invention has designed a kind of Streaming Media storage system, comprises terminal equipment, central server and at least two storage servers; The files in stream media of each required storage is divided at least two sub-files in stream media through central server respectively, is stored in respectively in each storage server; Terminal equipment sends the Streaming Media request instruction to central server, central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again; Also comprise the caching server that is used for storing respectively each sub-files in stream media with each storage server in the lump, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
The Streaming Media storage system of the present invention design is set up caching server and can effectively be improved terminal equipment to the reading speed of files in stream media adopting a plurality of storage servers to be divided at files in stream media on the basis that a plurality of files store respectively.
As a kind of optimal technical scheme of the present invention: described caching server and each storage server comprise corresponding with it individual count module respectively, respectively the number of times that is called of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server.
In the Streaming Media storage system of the present invention's design, at caching server and each storage server, corresponding with it counting module is set respectively, can conveniently counts the accessed number of times of each files in stream media, can upgrade the files in stream media of storing targetedly in the future.
The Streaming Media storage system of the present invention's design is in the middle of the application process of reality, files in stream media to be stored is divided at least two sub-files in stream media through central server, store into respectively in caching server and each storage server, terminal equipment sends the request instruction of read-write Streaming Media to central server, the Streaming Media request instruction that the central server receiving terminal apparatus sends, and according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, to specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again, and then realization terminal equipment reading files in stream media, when solving the concurrent problem in multiple terminals, effectively improved the access speed of terminal equipment to Streaming Media.
Wherein, at cutting apart in the storing process of files in stream media, the a plurality of sub-files in stream media that belongs to same files in stream media adopts random function thought, determines its storage information, and as much as possible sub-files in stream media is kept at respectively uniformly in caching server and each storage server; Cutting apart in the process of storage at files in stream media, setting up the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, and be stored in the central server.By central server the mapping relations of corresponding its sub-files in stream media storage information of files in stream media of storage are safeguarded like this, and make terminal equipment directly carry out communication with caching server and each storage server according to the storage information that obtains, read the appointment files in stream media.
Corresponding therewith, the present invention is in order to solve the problems of the technologies described above by the following technical solutions: the present invention has also designed a kind of storage means of Streaming Media storage system, comprises the steps:
Step 1. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage, be stored in each storage server respectively at random, and set up the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
Step 2. central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again;
In the described step 1, each the sub-files in stream media after central server is cut apart each files in stream media respectively is stored in respectively in caching server and each storage server at random;
In the described step 2, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
The storage means of the Streaming Media storage system of the present invention's design, each sub-files in stream media after each files in stream media cut apart respectively, be stored at random respectively in caching server and each storage server, can effectively improve the access speed of files in stream media by setting up caching server, improve the network transmission efficiency of files in stream media.
As a kind of optimal technical scheme of the present invention: described step 1 comprises the steps:
Step a. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage;
Each first cross-talk files in stream media that step b. central server will correspond respectively to the files in stream media of each required storage is stored in the caching server, and all the other each sub-files in stream media are stored in each storage server respectively at random;
The step c central server is set up the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media according to the storage at each sub-files in stream media, is stored in the central server.
The storage means of the Streaming Media storage system of the present invention's design, in the sub-files in stream media of after each files in stream media is cut apart each, the first cross-talk files in stream media corresponding with each files in stream media is stored in the caching server, can improve the access speed of the first cross-talk files in stream media targetedly, and then improve terminal equipment at the access speed of the whole access process of files in stream media.
As a kind of optimal technical scheme of the present invention: also comprise the steps I after the described step 1, step I and step 2 are carried out simultaneously, and the step I is as follows:
Counting module in described caching server and each storage server, respectively the call number of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server, central server is determined popular files in stream media and unexpected winner files in stream media according to popular Streaming Media call number threshold values, unexpected winner Streaming Media call number threshold values that each sub-files in stream media is called the statistics of number of times and sets in advance.
As a kind of optimal technical scheme of the present invention: in the described step I, also comprise the steps: at described popular files in stream media
Described central server is stored in each sub-files in stream media on each storage server at popular files in stream media, at least one cross-talk files in stream media of picked at random, it is copied in the caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Simultaneously, popular files in stream media integral body is backed up to caching server.
As a kind of optimal technical scheme of the present invention: in the described step I, also comprise the steps: at described unexpected winner files in stream media
Described central server carries out analysis and judgement at the sub-files in stream media that the unexpected winner files in stream media is stored on the caching server: if judge other the sub-files in stream media that exists except the first cross-talk files in stream media, at least one section other sub-files in stream media of picked at random then, to from caching server, delete, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
If judge other the sub-files in stream media that does not exist except the first cross-talk files in stream media, then this first cross-talk files in stream media is trimmed in the storage server of selecting at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
In the storage means of the Streaming Media storage system of the present invention's design, files in stream media at storage, by the counting to its accessed number of times, it is divided into popular files in stream media and unexpected winner files in stream media, respectively popular files in stream media and unexpected winner files in stream media are carried out corresponding storage update again, the index of content aspect not only can be provided for terminal access, and can make rational planning to the storage of files in stream media, improve the whole access efficiency of stored stream media file.
As a kind of optimal technical scheme of the present invention: also comprise step ⅰ, step ⅰ carried out before step 1 or carries out simultaneously with step 1, step 2, and step ⅰ is as follows:
Described each storage server at the appointed time detects its concurrent visit situation and memory capacity situation in the interval respectively, and testing result is uploaded to described central server, central server is according to the testing result that receives, each storage server is divided into effective storage server or non-effective storage server respectively, according to dividing the result files in stream media to be stored is stored again, wherein, non-effective storage server is carried out cleaning operation.
The storage means of the Streaming Media storage system of the present invention's design, in the storing process at files in stream media, at the appointed time in the interval, detect concurrent visit situation and the memory capacity situation of each storage server, each storage server is divided into effective storage server or non-effective storage server respectively, can effectively improves the storage efficiency of files in stream media and terminal equipment to the access speed of files in stream media.
As a kind of optimal technical scheme of the present invention: if certain server in described each storage server is being given directions testing result from the time interval to central server that do not upload its concurrent visit situation and memory capacity situation in, then central server is divided into the failed storage server with it, and at failed storage server triggers fault-tolerant scheduling strategy, simultaneously, upgrade the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, be stored in the central server.
In the storage means of the Streaming Media storage system of the present invention's design, at the failed storage server, central server has adopted the fault-tolerant scheduling strategy, can guarantee at utmost that terminal equipment is to the visit of files in stream media.
As a kind of optimal technical scheme of the present invention: described fault-tolerant scheduling strategy comprises the steps:
Described central server searches whether there be the backup stream media file corresponding with described failed server neutron current media file in the described caching server, if exist, then the backup stream media file is copied in the effective storage server of picked at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
The storage means of the Streaming Media storage system of the present invention's design is in the middle of the application process of reality, carry out in the storing process being divided at least two sub-files in stream media at files in stream media, it is stored in respectively in the middle of caching server and each storage server, wherein, each first cross-talk files in stream media that central server will correspond respectively to each files in stream media is stored in the caching server, all the other each sub-files in stream media are stored in each storage server respectively at random, afterwards, in the process of terminal equipment convection current media file access, central server is according to the accessed number of times of each files in stream media, each files in stream media is divided into popular files in stream media and unexpected winner files in stream media, and be optimized adjustment at the memory location of popular files in stream media and unexpected winner files in stream media, and upgrade the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, be stored in the central server, concrete to optimize and revise process as follows:
Also comprise the steps: at described popular files in stream media
Described central server is stored in each sub-files in stream media on each storage server at popular files in stream media, at least one cross-talk files in stream media of picked at random, it is copied in the caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Simultaneously, popular files in stream media integral body is backed up to caching server.
Also comprise the steps: at described unexpected winner files in stream media
Described central server carries out analysis and judgement at the sub-files in stream media that the unexpected winner files in stream media is stored on the caching server: if judge other the sub-files in stream media that exists except the first cross-talk files in stream media, at least one section other sub-files in stream media of picked at random then, it is deleted from caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Be embodied as, utilize randomized policy to choose the sub-files in stream media that several belong to this unexpected winner files in stream media, concrete number should dynamically be formulated according to the sub-files in stream media number of this unexpected winner files in stream media in the current cache server, half (rounding up) as the sub-files in stream media sum that belongs to this unexpected winner files in stream media in the caching server, but wherein the sub-files in stream media that reading times is maximum keeps, if namely choose the sub-files in stream media of shearing and be in the caching server in this unexpected winner files in stream media, the sub-files in stream media that reading times is maximum, then choose again, after finishing whole shearing step, by central server the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media are upgraded, and be stored in the central server.
If judge other the sub-files in stream media that does not exist except the first cross-talk files in stream media, then this first cross-talk files in stream media is trimmed in the storage server of selecting at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
Based on optimizing and revising of above memory location at popular files in stream media and unexpected winner files in stream media, can effectively improve terminal equipment to the access efficiency of files in stream media, effectively optimized the access speed of popular files in stream media.
In the middle of the actual application, described each storage server at the appointed time detects its concurrent visit situation and memory capacity situation in the interval respectively, and testing result is uploaded to described central server, central server is according to the testing result that receives, each storage server is divided into effective storage server or non-effective storage server respectively, according to dividing the result files in stream media to be stored is stored again, like this when storing at files in stream media to be stored, the memory location be can reasonably arrange, storage and access efficiency to files in stream media effectively improved.Wherein, when certain storage server is divided into non-effective storage server, then this storage server will be cancelled the storage operation for the treatment of the stored stream media file, and stop the data read operation that response terminal equipment does not also carry out this non-effective storage server simultaneously, reduce significantly until the concurrent visit situation of this storage server, have simultaneously rational residue memory capacity once again, then again this storage server is divided into effective storage server, the storage operation of stored stream media file is treated in participation, wherein, take with at the different method of operation of unexpected winner files in stream media in the caching server, sub-files in stream media corresponding in non-effective storage server is cleared up.This storage server of central server order triggers the internal cleaning scheduling, determine the cleaning list based on the call number of each sub-files in stream media, carry out cleaning operation then, stop the Streaming Media request instruction that response terminal equipment does not also carry out this storage server simultaneously, again have rational residual memory space until this non-effective storage server, the concurrent user number of this non-effective memory node acceptance reduces significantly simultaneously, central server redefines it and is effective storage server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Wherein cleaning operation comprises according to the cleaning list, the sub-files in stream media deletion that call number is low; Or the sub-files in stream media that call number is low is trimmed in other effective storage server of picked at random.
At the fault-tolerant scheduling strategy at the failed storage server, can guarantee to greatest extent that terminal equipment is to the successful access of files in stream media.Further, when the failed storage server at the appointed time recovers to send the testing result of its concurrent visit situation and memory capacity situation at interval again, central server is cancelled the division to its failed storage server, wherein concrete fault-tolerant scheduling strategy is that described central server searches whether there be the backup stream media file corresponding with described failed server neutron current media file in the described caching server, if exist, then the backup stream media file is copied in the effective storage server of picked at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
Wherein, the memory capacity situation of each storage server comprises storage heap(ed) capacity, current memory capacity, residue memory capacity, concurrent visit situation and memory capacity situation according to each storage server, central server is divided into effective storage server or non-effective storage server respectively with each storage server, according to dividing the result files in stream media to be stored is stored again.
In the actual application, each storage server has some IDE RAID hard disks under its command, forms the RAIDI storage architecture, guarantees the effectively a plurality of users' of response the concurrent service of single storage server.
More than in the storage means at the Streaming Media storage system, central server is dynamically preserved maintenance to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media of each renewal.Based on above storage means at the Streaming Media storage system, terminal equipment is still followed as follows for the visit of each files in stream media:
Terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, to specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again, and then realize terminal equipment reading files in stream media.
In the storage means of the Streaming Media storage system of the present invention's design, by regularly neutralize each sub-files in stream media in each storage server of caching server being carried out that integral body is cleared up, adjustment, and upgrade the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, be stored in the central server, can effectively improve storage and the application efficiency of this Streaming Media storage system.
In sum, the invention provides a kind of Streaming Media storage system and storage means, introduce caching server, simultaneously balancedly be kept in caching server and each storage server files in stream media is distributed, and according to concurrent visit situation and the definite storage server that participates in storing process each time of memory capacity situation of each storage server.Simultaneously based on the division of popular files in stream media and unexpected winner files in stream media, and at the optimizing and revising of popular files in stream media and unexpected winner files in stream media memory location, improved the access rate of popular files in stream media; Moreover, utilize the backup file of popular files in stream media in caching server simultaneously, farthest protect the visit of popular files in stream media by the fault-tolerant scheduling strategy.
By reference to the accompanying drawings embodiments of the present invention have been done detailed description above, but the present invention is not limited to above-mentioned execution mode, in the ken that those of ordinary skills possess, can also under the prerequisite that does not break away from aim of the present invention, makes a variety of changes.
Claims (10)
1. a Streaming Media storage system comprises terminal equipment, central server and at least two storage servers; The files in stream media of each required storage is divided at least two sub-files in stream media through central server respectively, is stored in respectively in each storage server; Terminal equipment sends the Streaming Media request instruction to central server, central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again; It is characterized in that: also comprise the caching server that is used for storing respectively each sub-files in stream media with each storage server in the lump, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
2. according to the described a kind of Streaming Media storage system of claim 1, it is characterized in that: described caching server and each storage server comprise corresponding with it individual count module respectively, respectively the number of times that is called of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server.
3. one kind based on the storage means according to any described a kind of Streaming Media storage system in the claim 1 to 2, comprises the steps:
Step 1. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage, be stored in each storage server respectively at random, and set up the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
Step 2. central server is according to the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media and the Streaming Media request instruction of terminal equipment, call the storage information of specifying corresponding its sub-files in stream media of files in stream media, feed back to terminal equipment, terminal equipment is again according to the storage information that obtains, each storage server of appointment sends Streaming Media request instruction in the storage information, will specify each sub-files in stream media of files in stream media to be sent to terminal equipment by each storage server of appointment again;
It is characterized in that:
In the described step 1, each the sub-files in stream media after central server is cut apart each files in stream media respectively is stored in respectively in caching server and each storage server at random;
In the described step 2, terminal equipment is according to the storage information that is obtained by central server, the caching server of appointment and each storage server send the Streaming Media request instruction in the storage information, will specify the sub-files in stream media of files in stream media to be sent to terminal equipment by caching server and each storage server of appointment again.
4. according to the storage means of the described a kind of Streaming Media storage system of claim 3, it is characterized in that: described step 1 comprises the steps:
Step a. central server is divided at least two sub-files in stream media respectively with the files in stream media of each required storage;
Each first cross-talk files in stream media that step b. central server will correspond respectively to the files in stream media of each required storage is stored in the caching server, and all the other each sub-files in stream media are stored in each storage server respectively at random;
The step c central server is set up the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media according to the storage at each sub-files in stream media, is stored in the central server.
5. according to the storage means of the described a kind of Streaming Media storage system of claim 4, it is characterized in that: also comprise the steps I after the described step 1, step I and step 2 are carried out simultaneously, and the step I is as follows:
Counting module in described caching server and each storage server, respectively the call number of its sub-files in stream media in inside is counted, and at the appointed time at interval count results is sent to described central server, central server is determined popular files in stream media and unexpected winner files in stream media according to popular Streaming Media call number threshold values, unexpected winner Streaming Media call number threshold values that each sub-files in stream media is called the statistics of number of times and sets in advance.
6. according to the storage means of the described a kind of Streaming Media storage system of claim 5, it is characterized in that: in the described step I, also comprise the steps: at described popular files in stream media
Described central server is stored in each sub-files in stream media on each storage server at popular files in stream media, at least one cross-talk files in stream media of picked at random, it is copied in the caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server; Simultaneously, popular files in stream media integral body is backed up to caching server.
7. according to the storage means of claim 5 or 6 described a kind of Streaming Media storage systems, it is characterized in that: in the described step I, also comprise the steps: at described unexpected winner files in stream media
Described central server carries out analysis and judgement at the sub-files in stream media that the unexpected winner files in stream media is stored on the caching server: if judge other the sub-files in stream media that exists except the first cross-talk files in stream media, at least one section other sub-files in stream media of picked at random then, it is deleted from caching server, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server;
If judge other the sub-files in stream media that does not exist except the first cross-talk files in stream media, then this first cross-talk files in stream media is trimmed in the storage server of selecting at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
8. according to the storage means of claim 3 or 4 described a kind of Streaming Media storage systems, it is characterized in that: also comprise step ⅰ, step ⅰ carried out before step 1 or carries out simultaneously with step 1, step 2, and step ⅰ is as follows:
Described each storage server at the appointed time detects its concurrent visit situation and memory capacity situation in the interval respectively, and testing result is uploaded to described central server, central server is according to the testing result that receives, each storage server is divided into effective storage server or non-effective storage server respectively, according to dividing the result files in stream media to be stored is stored again.
9. the storage means of described a kind of Streaming Media storage system according to Claim 8, it is characterized in that: if certain server in described each storage server is being given directions testing result from the time interval to central server that do not upload its concurrent visit situation and memory capacity situation in, then central server is divided into the failed storage server with it, and at failed storage server triggers fault-tolerant scheduling strategy, simultaneously, upgrade the mapping relations of corresponding its sub-files in stream media storage information of each files in stream media, be stored in the central server.
10. according to the storage means of the described a kind of Streaming Media storage system of claim 9, it is characterized in that: described fault-tolerant scheduling strategy comprises the steps:
Described central server searches whether there be the backup stream media file corresponding with described failed server neutron current media file in the described caching server, if exist, then the backup stream media file is copied in the effective storage server of picked at random, and upgrade the mapping relations that corresponding its sub-files in stream media of each files in stream media is stored information, be stored in the central server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310134471.7A CN103200272B (en) | 2013-04-18 | 2013-04-18 | Streaming media storage system and storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310134471.7A CN103200272B (en) | 2013-04-18 | 2013-04-18 | Streaming media storage system and storage method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103200272A true CN103200272A (en) | 2013-07-10 |
| CN103200272B CN103200272B (en) | 2016-01-20 |
Family
ID=48722627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310134471.7A Expired - Fee Related CN103200272B (en) | 2013-04-18 | 2013-04-18 | Streaming media storage system and storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103200272B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105450542A (en) * | 2014-08-21 | 2016-03-30 | 联想(北京)有限公司 | Data-processing method and first electronic device |
| CN106454959A (en) * | 2016-11-01 | 2017-02-22 | 佛山科学技术学院 | Service quality control method of distributed network and server |
| CN106533937A (en) * | 2016-11-01 | 2017-03-22 | 佛山科学技术学院 | Multipath distributed message forwarding method and base station |
| CN106528349A (en) * | 2016-12-06 | 2017-03-22 | 郑州云海信息技术有限公司 | Data storage method and apparatus |
| CN106572030A (en) * | 2016-11-01 | 2017-04-19 | 佛山科学技术学院 | Multipath sending control method and multipath sending control system in distributed network |
| CN106717012A (en) * | 2014-05-06 | 2017-05-24 | TiVo解决方案有限公司 | Cloud-based media content management |
| CN107249135A (en) * | 2016-05-31 | 2017-10-13 | 杭州海康威视数字技术股份有限公司 | Video data storage systems and its operating method and index server |
| CN108419119A (en) * | 2018-02-09 | 2018-08-17 | 北京小米移动软件有限公司 | Data cached sweep-out method and device |
| CN110191143A (en) * | 2018-12-13 | 2019-08-30 | 浙江宇视科技有限公司 | A kind of resource issuing method, apparatus and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010044851A1 (en) * | 2000-04-28 | 2001-11-22 | Rothman Peter Lorin | System and method for reducing the resources required to deliver streaming media |
| CN101141627A (en) * | 2007-10-23 | 2008-03-12 | 深圳市迅雷网络技术有限公司 | Storage system and method of stream media file |
-
2013
- 2013-04-18 CN CN201310134471.7A patent/CN103200272B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20010044851A1 (en) * | 2000-04-28 | 2001-11-22 | Rothman Peter Lorin | System and method for reducing the resources required to deliver streaming media |
| CN101141627A (en) * | 2007-10-23 | 2008-03-12 | 深圳市迅雷网络技术有限公司 | Storage system and method of stream media file |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106717012A (en) * | 2014-05-06 | 2017-05-24 | TiVo解决方案有限公司 | Cloud-based media content management |
| CN105450542A (en) * | 2014-08-21 | 2016-03-30 | 联想(北京)有限公司 | Data-processing method and first electronic device |
| CN105450542B (en) * | 2014-08-21 | 2019-08-27 | 联想(北京)有限公司 | A kind of data processing method and the first electronic equipment |
| WO2017206539A1 (en) * | 2016-05-31 | 2017-12-07 | 杭州海康威视数字技术股份有限公司 | Video data storage system, operation method therefor and retrieval server |
| US10827205B2 (en) | 2016-05-31 | 2020-11-03 | Hangzhou Hikvision Digital Technology Co., Ltd. | Video data storage system, operation method thereof, and retrieval server |
| CN107249135B (en) * | 2016-05-31 | 2019-01-25 | 杭州海康威视数字技术股份有限公司 | Video data storage systems and its operating method and index server |
| CN107249135A (en) * | 2016-05-31 | 2017-10-13 | 杭州海康威视数字技术股份有限公司 | Video data storage systems and its operating method and index server |
| CN106533937B (en) * | 2016-11-01 | 2019-08-30 | 佛山科学技术学院 | A kind of distributed message forwarding method of multipath and base station |
| CN106572030A (en) * | 2016-11-01 | 2017-04-19 | 佛山科学技术学院 | Multipath sending control method and multipath sending control system in distributed network |
| CN106533937A (en) * | 2016-11-01 | 2017-03-22 | 佛山科学技术学院 | Multipath distributed message forwarding method and base station |
| CN106454959A (en) * | 2016-11-01 | 2017-02-22 | 佛山科学技术学院 | Service quality control method of distributed network and server |
| CN106528349A (en) * | 2016-12-06 | 2017-03-22 | 郑州云海信息技术有限公司 | Data storage method and apparatus |
| CN108419119A (en) * | 2018-02-09 | 2018-08-17 | 北京小米移动软件有限公司 | Data cached sweep-out method and device |
| CN108419119B (en) * | 2018-02-09 | 2020-10-30 | 北京小米移动软件有限公司 | Cache data clearing method and device |
| CN110191143A (en) * | 2018-12-13 | 2019-08-30 | 浙江宇视科技有限公司 | A kind of resource issuing method, apparatus and system |
| CN110191143B (en) * | 2018-12-13 | 2022-09-30 | 浙江宇视科技有限公司 | Resource publishing method, device and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103200272B (en) | 2016-01-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103200272A (en) | Streaming media storage system and storage method | |
| CN110069714B (en) | Video recommendation system | |
| CN104967861B (en) | Video caching system and method in CDN network | |
| US7774550B2 (en) | Storage system and storage system control method | |
| CN101232600B (en) | Device, system and method for providing order program contents | |
| JP5577350B2 (en) | Method and system for efficient data synchronization | |
| US8612668B2 (en) | Storage optimization system based on object size | |
| CN111159436B (en) | Method, device and computing equipment for recommending multimedia content | |
| US9946467B2 (en) | Data storage method and electronic device | |
| US20060230170A1 (en) | Streaming media content delivery system and method for delivering streaming content | |
| US8578089B2 (en) | Storage device cache | |
| CN103455577A (en) | Multi-backup nearby storage and reading method and system of cloud host mirror image file | |
| CN101277211A (en) | Method and apparatus for buffering data | |
| CN107179878A (en) | The method and apparatus of data storage based on optimizing application | |
| CN110442646B (en) | Write performance optimization system and method for master end of ceph data synchronization module | |
| CN109213420A (en) | Date storage method, apparatus and system | |
| CN103870393B (en) | cache management method and system | |
| CN110196818A (en) | Data cached method, buffer memory device and storage system | |
| CN103198027A (en) | Method and device for storing and providing files | |
| CN102063295A (en) | Management of internal operations by a storage device | |
| CN102104494B (en) | Metadata server, out-of-band network file system and processing method of system | |
| US11223528B2 (en) | Management of cloud-based shared content using predictive cost modeling | |
| CN109460345A (en) | The calculation method and system of real time data | |
| CN102118315B (en) | Method for fluidizing, recording and reading data and system adopting same | |
| CN108958667A (en) | A kind of method for reading data based on distributed memory system, system and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160120 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |