CN106603627B - The synchronous method of video file and isochronous schedules device when data center online - Google Patents
The synchronous method of video file and isochronous schedules device when data center online Download PDFInfo
- Publication number
- CN106603627B CN106603627B CN201610987415.1A CN201610987415A CN106603627B CN 106603627 B CN106603627 B CN 106603627B CN 201610987415 A CN201610987415 A CN 201610987415A CN 106603627 B CN106603627 B CN 106603627B
- Authority
- CN
- China
- Prior art keywords
- data center
- file
- list
- downloading
- online
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of synchronous method of video file when data center's data center online, comprising the following steps: isochronous schedules device receives synchronization notice；In the synchronization notice comprising data center relevant information and start the synchronous time；Temperature listed files is requested to data management system；It is requested to go over the highest regional document list of temperature in preset time to every other computer room similar in data center's physical location；Temperature listed files is merged with regional document list and removed duplicate keys, obtains master file list；The position of file in local search master file list, and it is sent to data center, for data center's downloading.The invention also discloses a kind of isochronous schedules devices.The present invention can save the costs such as manpower, bandwidth, also improve the quality of flexibility and service.
Description
Technical field
The present invention relates to a kind of synchronous method of video file when network technique field more particularly to data center online and
Isochronous schedules device.
Background technique
IDC (Internet Data Center, Internet data center), also referred to as computer room, are continuous along with internet
The demand of development and develop rapidly, to become an important ring indispensable in Internet industry.It is interconnection
Net content supplier, enterprise, media and all kinds of websites provide extensive, high quality, safe and reliable proficient service device trustship,
The business such as space rental, network bandwidth.Currently, when new CDN (Content Delivery Network, a content distribution
Network) after video computer room (vIDC) equipment is ready, need to carry out the synchronous working of video file before online, it will be a large amount of
Hot spot file is copied to online on the hard disk of server in machine room.Synchronous method used at present is as shown in Figure 1:
The first step, operation maintenance personnel configure source IDC list, configure good new IDC to which or which (generally 4) source
File in IDC request list, and it is sent to Sync Manager；
After second step, Sync Manager are connected to configured list, a hot spot listed files is requested to data management system immediately；
Third step, Sync Manager generate task list by matching hot spot listed files and source IDC list, then will
Task list is distributed to new IDC；
According to task list, Xiang Yuan IDC downloads content by 4th step, new IDC；When the inner capacities of downloading reaches certain amount
When, it is believed that meet online condition, computer room is online, and synchronous process terminates.
There are following technological deficiencies in existing synchronous method: source IDC list needs operation maintenance personnel manual configuration, not only disappears
Consume a large amount of human costs, and configuration mode be it is static, based on experience, it is inflexible；And operation maintenance personnel configures source IDC
When, the situation of source IDC can not be known in real time, can not be known the situation of link in real time, also just not can guarantee the service of synchronizing process
Quality can not determine and need synchronous considerable task that can or can not bring other problems to system.
Summary of the invention
The main purpose of the present invention is to provide a kind of synchronous method of video file when data center's data center online,
It aims to solve the problem that and needs operation maintenance personnel manual configuration in the prior art, the technical issues of taking time and effort.
To achieve the above object, when a kind of data center online provided by the invention video file synchronous method, it is described
Method the following steps are included:
Isochronous schedules device receives synchronization notice；In the synchronization notice comprising data center relevant information and start to synchronize
Time；
Temperature listed files is requested to data management system；
It is highest to requesting it to go over temperature in preset time with every other computer room similar in data center's physical location
Regional document list；
Temperature listed files is merged with regional document list and removed duplicate keys, obtains master file list；
The position of file in local search master file list, and it is sent to data center, for data center's downloading.
Preferably, the above method is further comprising the steps of:
Receive the downloading result that data center feeds back when downloading task is completed.
Preferably, the position of the file in local search master file list, and the step of being sent to data center packet
It includes:
Regard data center as user, each of master file list file is regarded as to a request, according to real-time letter
Breath carries out the position of file in inquiry master file list；
The corresponding downloading mode of each request and address combination are sent to computer room in one file.
Preferably, the above method is further comprising the steps of:
The problem of downloading when the file amount of downloading reaches threshold value and in regional document list part is more than default hundred
Point than when execute data center online movement.
Preferably, the physical location is with " province " for unit.
The present invention also provides a kind of isochronous schedules device, the isochronous schedules device includes:
Receiving module, for receiving synchronization notice；It include the relevant information and beginning of data center in the synchronization notice
The synchronous time；
Listed files request module, for requesting temperature listed files to data management system；And to data center's object
Every other computer room similar in reason position requests it to go over the highest regional document list of temperature in preset time；
Master file list obtains module, for merging and removing duplicate keys with regional document list for temperature listed files,
Obtain master file list；
Document processing module for the position of the file in local search master file list, and is sent to data center.
Preferably, the receiving module is also used to:
Receive the downloading result that data center feeds back when downloading task is completed.
Preferably, the document processing module is used for:
Regard data center as user, each of master file list file is regarded as to a request, according to real-time letter
Breath is inquired；
The corresponding downloading mode of each request and address combination are sent to computer room in one file.
Preferably, above-mentioned isochronous schedules device further include:
Online execution module, for what is downloaded when the file amount of downloading reaches threshold value and in the regional document list
Data center online movement is executed when problem part is more than preset percentage.
The synchronous method of video file when data center's data center online proposed by the present invention, by the synchronization of data center
Task regards the process of a large number of users request video as, aims at the synchronous and scheduler that designs using one to handle these requests,
The costs such as manpower, bandwidth can be saved, the quality of flexibility and service is also improved.
Detailed description of the invention
Fig. 1 is synchronous method flow diagram in the prior art；
The step flow diagram of the synchronous method of video file when Fig. 2 is data center's data center online of the present invention；
The synchronous method of video file is looked into locally when Fig. 3 is data center's data center online of one embodiment of the invention
The position of file in master file list is ask, and is sent to the step schematic diagram of data center；
Fig. 4 is the modular structure schematic diagram of the isochronous schedules device of one embodiment of the invention；
Fig. 5 is the synchronous architecture and synchronous method flow diagram of one embodiment of the invention.
Specific embodiment
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.It should
Understand, the specific embodiments described herein are merely illustrative of the present invention, is not intended to limit the present invention.
The synchronous method of video file when the present invention provides a kind of data center's data center online, it is real one referring to Fig. 2
Apply in example, when data center's data center online video file synchronous method the following steps are included:
Step S10, isochronous schedules device receive synchronization notice；In the synchronization notice comprising data center relevant information and
Start the synchronous time；In the embodiment of the present invention, data center, that is, new vIDC or new room, relevant information includes location
Domain, address etc., synchronization notice can be sent by operation maintenance personnel.
Step S20 requests temperature listed files to data management system；To with similar in data center's physical location it is all its
His computer room requests it to go over the highest regional document list of preset time (such as 24 hours) interior temperature；Temperature listed files is
Top temperature listed files.There are some hot spot files to pass through in the prior art in each region (such as identical province, city, area)
The hot spot listed files that Sync Manager is requested to data management system, does not often include nearest one day hot spot file, therefore leads
Even if new vIDC is caused to complete almost all of downloading task, a large amount of Hui Yuan can be also generated within several hours after just online
Request to increase the unstability of system, and influences performance.In the embodiment of the present invention, isochronous schedules device no longer only considers heat
Spend listed files, it is also considered that the file of the new region vIDC Top temperature, after new vIDC completes downloading task, will not or
Source request is seldom generated back, to reduce back source rate, improves the stability and performance of system.
Temperature listed files is merged with regional document list and is removed duplicate keys, obtains master file list by step S30；
Sync Manager generates the mode of task list at present, is that all tasks are divided equally to the source provided into the configuration of all operation maintenance personnels
IDC, it is not intended that source IDC load pressure at this time, Network status etc., or even do not consider whether source IDC has requested text yet
Part, therefore it is also possible that source IDC generates more time source request.Other IDC of the present invention from the new region vIDC (province)
Or the IDC in neighbouring province obtains the same day most hot listed files, to be mended to the listed files obtained from data management system
It fills.The foundation done so is IDC similar in physical location, and the user group of service often has approximate viewing video
Preference thereby may be ensured that hit rate.
Step S40, the position of file in local search master file list, and it is sent to data center, in data
Heart downloading.
The synchronous method of video file when data center's data center online proposed by the present invention, by the synchronization of data center
Task regards the process of a large number of users request video as, aims at the synchronous and scheduler that designs using one to handle these requests,
Operation maintenance personnel no longer needs to configure source IDC, and only needs to provide the information of new vIDC, and the costs such as manpower, bandwidth are greatly saved；
Meanwhile isochronous schedules device no longer only considers temperature listed files, can also consider that the file of the new region vIDC Top temperature can drop
Low time source rate improves the stability and performance of system.
In a preferred embodiment of the present invention, the above method is further comprising the steps of:
Receive the downloading result that data center feeds back when downloading task is completed.What new vIDC was returned according to isochronous schedules device
As a result, taking most suitable mode to obtain each file download task, while reporting when the task is completed to synchronization
Scheduler, the downloading fed back by isochronous schedules device reception data center when downloading task is completed is as a result, to execute online
Business.
Referring to shown in Fig. 3, in the embodiment of the present invention, abovementioned steps S40 can include:
Step S41 regards data center as user, each of master file list file is regarded as to a request, root
It is inquired according to real time information；Wherein, new vIDC, i.e., regarded as user by the algorithm of search algorithm multiplexing CDN conventional scheduler, main
Each of listed files file regards a request as, is inquired according to real-time information.
The corresponding downloading mode of each request and address combination are sent to computer room by step S42 in one file.
For each request, obtained result all should be the combination of an a variety of method for down loading, multiple addresses, can be used
Metalink file format realizes that (metalink file is actually that download link address and download priority are contained in one
XML file).
In one embodiment, the above method can comprise the further steps of:
The problem of downloading when the file amount of downloading reaches threshold value and in regional document list part is more than default hundred
Point than when execute data center online movement.The data volume that the online condition of new vIDC is no longer only completed using file also can as standard
The performance for considering vital document, to further decrease back source rate.
In previous embodiment, physical location is with " province " for unit.For example, the present invention is from the new region vIDC (province)
Other IDC or the IDC in neighbouring province obtain the same day most hot listed files, thus to the listed files obtained from data management system
It is supplemented.
Referring to fig. 4, the present invention also provides a kind of isochronous schedules devices, for realizing the above method.In one embodiment, this is same
Walking scheduler includes:
Receiving module 10, for receiving synchronization notice；In the synchronization notice comprising data center relevant information and open
Begin the synchronous time；
Listed files request module 20, for requesting temperature listed files to data management system；And to data center
Every other computer room similar in physical location requests it to go over the highest regional document list of temperature in preset time；
Master file list obtains module 30, for merging temperature listed files with regional document list and removing repetition
, obtain master file list；
Document processing module 40 for the position of the file in local search master file list, and is sent to data center.
In one embodiment, receiving module 10 is also used to:
Receive the downloading result that data center feeds back when downloading task is completed.
In one embodiment, document processing module 40 is used for:
Regard data center as user, each of master file list file is regarded as to a request, according to real-time letter
Breath is inquired；
The corresponding downloading mode of each request and address combination are sent to computer room in one file.
Preferably, above-mentioned isochronous schedules device further include:
Online execution module, for what is downloaded when the file amount of downloading reaches threshold value and in the regional document list
Data center online movement is executed when problem part is more than preset percentage.
Referring to Figure 5, in isochronous schedules device embodiment of the present invention, communication process the following steps are included:
Step 1: operation maintenance personnel sends a synchronization notice to isochronous schedules device, only needs the phase comprising new IDC in notice
It closes information and starts the synchronous time；
Step 2: isochronous schedules device requests Top temperature listed files (i.e. temperature listed files) to data management system；
Step 3: isochronous schedules device with every other vIDC similar in new vIDC physical location to when requesting it default in the past
Interior most hot listed files (i.e. regional document list)；Temperature listed files is merged with regional document list and removes repetition
, obtain master file list；
Step 4: the position of isochronous schedules device file into itself inquiry master file list, and return to new vIDC.Wherein,
Search algorithm is multiplexed the algorithm of CDN conventional scheduler, i.e., new vIDC is regarded as user, each of master file list file is seen
A request is done, is inquired according to real-time information；For each request, obtained result all should be under one a variety of
The combination of support method, multiple addresses can be used the realization of metalink file format, it is real that metalink file format can be used
Existing (metalink file is actually that the XML file of download link address and download priority is contained in one)；
Step 5: according to the return of isochronous schedules device as a result, for each file download task, taking most suitable side
Formula obtains, while reporting when the task is completed and giving isochronous schedules device.Being determined to online condition is first, the text of downloading
Part amount must reach certain scale, and second, it is more than that the file of certain percentage must download completion in regional document list.
In the embodiment of the present invention, isochronous schedules device can be realized by computer program, for implement earlier figures 2 to 3 and
Embodiment corresponding to its word segment, effect, principle and the effect of each module can be found in preceding method embodiment, do not make herein
It is described in detail.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (8)
1. the synchronous method of video file when a kind of data center online characterized by comprising
Isochronous schedules device receives synchronization notice；Relevant information in the synchronization notice comprising data center and when starting synchronous
Between；
Temperature listed files is requested to data management system；
It is requested to go over the highest region of temperature in preset time to every other computer room similar in data center's physical location
Listed files；
Temperature listed files is merged with regional document list and removed duplicate keys, obtains master file list；
The position of file in local search master file list, and it is sent to data center, for data center's downloading；
When the file downloaded when the file amount of downloading reaches threshold value and in the regional document list is more than preset percentage
Execute data center online movement.
2. the synchronous method of video file when data center online as described in claim 1, which is characterized in that further include following
Step:
Receive the downloading result that data center feeds back when downloading task is completed.
3. the synchronous method of video file when data center online as claimed in claim 2, which is characterized in that described in local
The position of file in master file list is inquired, and the step of being sent to data center includes:
Regard data center as user, each of master file list file regarded as to a request, according to real time information into
The position of file in row inquiry master file list；
The corresponding downloading mode of each request and address combination are sent to data center in one file.
4. the synchronous method of video file when data center online as described in claim 1, which is characterized in that the physical bit
It sets with " province " as unit.
5. a kind of isochronous schedules device, which is characterized in that the isochronous schedules device includes:
Receiving module, for receiving synchronization notice；In the synchronization notice comprising data center relevant information and start to synchronize
Time；
Listed files request module, for requesting temperature listed files to data management system；And to data center's physical bit
Setting similar every other computer room requests it to go over the highest regional document list of temperature in preset time；
Master file list obtains module and obtains for merging and removing duplicate keys with regional document list for temperature listed files
Master file list；
Document processing module for the position of the file in local search master file list, and is sent to data center, for number
It is downloaded according to center；
Online execution module, the file for being downloaded when the file amount of downloading reaches threshold value and in the regional document list
Data center online movement is executed when more than preset percentage.
6. isochronous schedules device as claimed in claim 5, which is characterized in that the receiving module is also used to:
Receive the downloading result that data center feeds back when downloading task is completed.
7. isochronous schedules device as claimed in claim 6, which is characterized in that the document processing module is used for:
Regard data center as user, each of master file list file regarded as to a request, according to real time information into
The position of file in row inquiry master file list；
The corresponding downloading mode of each request and address combination are sent to computer room in one file.
8. isochronous schedules device as claimed in claim 5, which is characterized in that the physical location is with " province " for unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610987415.1A CN106603627B (en) | 2016-11-09 | 2016-11-09 | The synchronous method of video file and isochronous schedules device when data center online |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610987415.1A CN106603627B (en) | 2016-11-09 | 2016-11-09 | The synchronous method of video file and isochronous schedules device when data center online |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106603627A CN106603627A (en) | 2017-04-26 |
| CN106603627B true CN106603627B (en) | 2019-11-08 |
Family
ID=58589945
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610987415.1A Active CN106603627B (en) | 2016-11-09 | 2016-11-09 | The synchronous method of video file and isochronous schedules device when data center online |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106603627B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174235B (en) * | 2018-01-17 | 2022-05-17 | 北京奇艺世纪科技有限公司 | Video online method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103281394A (en) * | 2013-06-07 | 2013-09-04 | 北京奇虎科技有限公司 | File acquiring method, node servers and system |
| CN104284201A (en) * | 2014-09-26 | 2015-01-14 | 北京奇艺世纪科技有限公司 | Video content processing method and device |
| CN105872636A (en) * | 2015-12-15 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Video pushing method and system, and device based on CDN (Content Delivery Network) |
-
2016
- 2016-11-09 CN CN201610987415.1A patent/CN106603627B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103281394A (en) * | 2013-06-07 | 2013-09-04 | 北京奇虎科技有限公司 | File acquiring method, node servers and system |
| CN104284201A (en) * | 2014-09-26 | 2015-01-14 | 北京奇艺世纪科技有限公司 | Video content processing method and device |
| CN105872636A (en) * | 2015-12-15 | 2016-08-17 | 乐视致新电子科技（天津）有限公司 | Video pushing method and system, and device based on CDN (Content Delivery Network) |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106603627A (en) | 2017-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102882974B (en) | Method for saving website access resource by website identification version number | |
| CN103348691B (en) | The method, apparatus and system of distribution live content | |
| CN108600300B (en) | Log data processing method and device | |
| US20140165119A1 (en) | Offline download method, multimedia file download method and system thereof | |
| CN108200220A (en) | A kind of method of data synchronization, server and storage medium | |
| CN106330997B (en) | A kind of method and system of the content distribution for mobile terminal application | |
| CN103095743A (en) | Handling method and system of grey release | |
| CN107483627A (en) | A kind of file distributing, method for down loading, Distributor, client and system | |
| NZ538168A (en) | Update distribution system architecture and method for distributing software | |
| CN103457979B (en) | Distribution type file storage system and method | |
| CN106980678A (en) | Data analysing method and system based on zookeeper technologies | |
| WO2020119540A1 (en) | Group profile picture generation method and device | |
| US10893091B2 (en) | Management of asynchronous content post and media file transmissions | |
| CN108428144A (en) | Flow allocation method, service distribution method and the device of pushed information order | |
| CN103324696B (en) | A kind of data log collection and statistical analysis system and method | |
| CN105743945A (en) | Method and system for downloading files on the basis of switching download sources | |
| US20140317497A1 (en) | Method, Apparatus and System for Changing Font for Application Program | |
| CN109862376B (en) | Live content delivery system, method and device, list server and storage medium | |
| CN113238851B (en) | Script automatic execution method, system, equipment and medium based on cloud platform | |
| CN103888539A (en) | P2P cache guiding method and device and P2P cache system | |
| CN107770212A (en) | Rich communication suite distribution platform, method for updating edition and system, mobile terminal | |
| CN111581565B (en) | Page style configuration method, system, medium and equipment | |
| CN106603627B (en) | The synchronous method of video file and isochronous schedules device when data center online | |
| KR101634322B1 (en) | QoS profile generating apparatus and method for supporting data distribution service in cyber physical system | |
| CN106375132B (en) | Cloud server system and management method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |