CN101887456A - System and method for migrating data - Google Patents
System and method for migrating data Download PDFInfo
- Publication number
- CN101887456A CN101887456A CN 201010217506 CN201010217506A CN101887456A CN 101887456 A CN101887456 A CN 101887456A CN 201010217506 CN201010217506 CN 201010217506 CN 201010217506 A CN201010217506 A CN 201010217506A CN 101887456 A CN101887456 A CN 101887456A
- Authority
- CN
- China
- Prior art keywords
- data
- assets
- media asset
- migrated
- migration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a system and a method for migrating media data and service data in an internet protocol television (IPTV) system, which are used for the data asset migration between a source media asset library and a target media asset library. The system comprises a content retrieval module and a content accessing module, wherein the content retrieval module is used for storing and processing the data information of the source media asset library and the data information of the target media asset library, marking statuses of data assets in the source media asset library and the target media asset library and outputting data asset information to be migrated; and the content accessing module is used for migrating the data assets to be migrated from the source media asset library to the target media asset library according to the status marks. The system and the method of the invention have the advantages of improving the migration speed and reducing the storage requirement on the conventional system and the possibility of error in the migration process of the media assets along with flexible migration scheme and suitability for different environments.
Description
Technical field
The present invention relates to a kind of migratory system and method for data, refer in a kind of IPTV system system and method that media data and business datum are moved especially.
Background technology
The method of setting up a cover IPTV local level Content Management System at present in some areas is to dispose a cover IPTV Content Management System application program earlier, and then by the centre point management system by SDH (Synchronous Digital Hierarchy, SDH (Synchronous Digital Hierarchy)) network to local level Content Management System issuing service data message and signaling.The local level Content Management System is looked for relevant media content download according to signaling in center media assets storehouse; Last local level Content Management System injects content information to CDN network (Content Delivery Network, content distributing network).
Fig. 1 is the structural drawing of existing system, and this figure comprises: centre point management system, local level Content Management System.The centre point management system comprises: the center business management system, and center media assets index, center media assets storehouse, the center issues instruction interface.The local level Content Management System comprises: instruction acquisition interface, local level business management system, local level media asset index, local level media asset library, service order interface, content delivery network grouting socket.Existing data migtation flow process is such: the service lists that business management system selection in center will be moved, the center of transferring to then issues instruction interface and handles, the center issues instruction interface serial processing service lists successively, from the media asset index of center, select and professional relevant media asset information according to a business datum, generate instruction.The center issues instruction interface and instruction acquisition interface communication.Instruction acquisition interface processing instruction is transferred to the local level business management system with business datum and is handled; The media asset information analysis is handled, and the downloads of media data are transferred to local level media asset index and are generated local level media asset concordance list to media asset library after download finishes from the media asset library of center.So far an instruction process finishes, and the center issues instruction interface and handles next bar business datum.The local level Content Management System injects business information and media data by service order interface and content delivery network grouting socket to content distributing network simultaneously.
Shortcomings such as the flow process of prior art and system are the processing procedures of a serial, exist bandwidth availability ratio low, and the time is long are unfavorable for fast construction one cover IPTV Content Management Platform.
Simultaneously, present data migration method great majority require target memory capacity to be not less than source memory capacity, and in fact local level operation centre is because the resources supplIes restriction can not have the media asset library bigger than central operation centre.Further, most variations requirement source data in transition process can not be modified, and this can not be suitable for for long IPTV content scene of transition process time cycle, and this has just limited the application of existing technical scheme in the IPTV field.
The inventor makes the present invention at the defective of prior art.
Summary of the invention
Technical matters to be solved by this invention provides the high data migtation system and method for a kind of non-serial transmission efficient.
For solving the problems of the technologies described above, on the one hand, the invention provides a kind of data migtation system, be used for the data assets migration between source media asset library and the target medium assets storehouse, it is characterized in that, described data migtation system comprises content retrieval module and content access module, described content retrieval module is used to deposit and handle the data message of described source media asset library and the data message in described target medium assets storehouse, and the data assets in described source media asset library and the described target medium assets storehouse carried out status indication, export data assets information to be migrated, described content access module is used for according to described status indication described data assets to be migrated being migrated to target medium assets storehouse from the source media asset library.
On the other hand, the invention provides a kind of data migration method, be used for the data assets migration between source media asset library and the target medium assets storehouse, it is characterized in that, the content retrieval module is carried out mark to described source media asset library and described target medium assets database data assets, exports data assets information to be migrated; The content access module migrates to target medium assets storehouse with described data assets to be migrated from the source media asset library according to described data assets information to be migrated.
Adopt data migtation system and method for the present invention, can accelerate the migration velocity of data, reduce the memory requirement to existing system, reduce the probability that media asset goes wrong in transition process, the migration scheme can adapt to varying environment flexibly.
Description of drawings
Fig. 1 is the synoptic diagram of prior art systems,
Fig. 2 is a data migtation system schematic of the present invention,
Fig. 3 is the embodiment of the invention 1 system schematic,
Fig. 4 is the embodiment of the invention 1 a data migtation block diagram,
Fig. 5 is the embodiment of the invention 2 system schematic,
Fig. 6 is the embodiment of the invention 2 data migtation block diagram.
Embodiment
Further disclose as follows for some embodiment to technical spirit of the present invention below in conjunction with accompanying drawing:
As shown in Figure 2, the invention provides a kind of data migtation system, be used for the data assets migration between source media asset library and the target medium assets storehouse, described data migtation system comprises content retrieval module and content access module, described content retrieval module is used to deposit and handle the data message of described source media asset library and the data message in described target medium assets storehouse, and the data assets in described source media asset library and the described target medium assets storehouse carried out status indication, export data assets information to be migrated, described content access module is used for according to described status indication described data assets to be migrated being migrated to target medium assets storehouse from the source media asset library.
Further, described data assets comprises business datum assets and media data assets, described content retrieval module is used for determining the residual capacity and the media asset state in target medium assets storehouse, described source media asset library is specially the centre point management system, and described centre point management system comprises center business management system module and center media assets storehouse; Described target medium assets storehouse is specially the local level Content Management System, and described local level Content Management System comprises regional business management system module and regional media asset library.
Further, described content access module is moved described data assets to be migrated by mobile memory; Described content access module is moved described data assets to be migrated by the internet.Described content retrieval module is used for upgrading described data assets information to be migrated in data assets migration finishing back.Described data migtation system comprises a plurality of content access modules, and described a plurality of content access modules are used for the described data assets to be migrated of parallel access.
The present invention also provides a kind of data migration method on the other hand, be used for the data assets migration between source media asset library and the target medium assets storehouse, the content retrieval module is carried out mark to described source media asset library and described target medium assets database data assets, exports data assets information to be migrated; The content access module migrates to target medium assets storehouse with described data assets to be migrated from the source media asset library according to described data assets information to be migrated.
Further, described data assets comprises business datum assets and media data assets, and the disposable migration of described business datum assets finishes.Described content retrieval module adopts arabic numeral or letter to give flag state to described media data assets, and described state includes but not limited to following state and combination thereof: state in state to be migrated, the migration, migration completion status, can't transition state.
Further, described content access module is moved described data assets to be migrated by mobile memory or described content access module is moved described data assets to be migrated by the internet; Described content retrieval module is upgraded described data assets information to be migrated in data assets migration finishing back.Described data migtation system comprises a plurality of content access modules, the described data assets to be migrated of described a plurality of content access module parallel access.
Embodiment 1:
Be illustrated in figure 3 as the system construction drawing of the embodiment of the invention, this system comprises:
The centre point management system comprises business management system module and media asset library,
The local level Content Management System comprises business management system module and media asset library,
The data migtation system is used for the media data of centre point management system is moved to the local level Content Management System,
The high capacity portable hard drive is used for storing data in data migration process.
As shown in Figure 4:
S101, the content access module is moved business datum,
Because the relative media data data volume of business datum is very little, business datum can once be moved and be finished.The present invention does not limit concrete business datum transition process, can adopt any existing migration pattern, derives such as the batch of data to import.
S102, the scope of definite migration, the media data that the content retrieval module will be moved generates the media asset migration table according to the media asset concordance list;
For each media asset status indication is arranged in the media asset migration table, concrete status indication can be explained with numerals such as 0,1,2, also can represent with A, B, C, D.
Concrete state has:
A, state to be migrated.Represent that this media asset is not also moved.
State in B, the migration.Represent that this media asset derives from the media asset library of center, also successfully do not import the local level media asset library.
C, migration completion status.Represent that this media asset successfully imports the local level media asset library.
D, can't transition state.Expression is because the mistake of source media asset library causes the state that can't move.
Migration generally has two kinds of situations for media data: a kind of is the migration of whole storehouse, and a kind of is to select the migration of part of media assets, and this programme is all supported for dual mode.
S103, the content retrieval module compares the data to be migrated and the data mode of having moved, and revises the media asset migration table, need do the state adjustment according to the media asset migration record sheet of media asset migratory system for existing media asset migration table.Moved successful data mode change into the migration finish; The data mode of having moved failure changes into to be migrated.
For the situation that the media data in center media assets storehouse changes in transition process, the content retrieval module will change into the migration neutralization migration completion status of this media data in the media asset migration table to be migrated.
S104 determines the residual capacity and the media asset state of local level media asset library, and it is residual capacity that the total volume of local level media asset library deducts the capacity of depositing media asset.
Media asset state in the local level media asset library has three kinds of states: be untreated, injected success of CDN network and mistake.Need delete so that discharge storage space for the media data that injects the success of CDN network.Error condition is meant that the minority media asset makes a mistake and need moves again that this part data does not take up room in migration.
S105, the content retrieval module is selected data to be migrated from the media asset migration table, calculates the media asset of this migration according to the residual capacity in target medium assets storehouse.
S106, the migration media asset, the migration media asset can be used the high capacity mobile memory.Storer includes but not limited to hard disk, flash memory, CD.According to the media asset migration table, the content access module is saved in the high capacity portable hard drive with media data by the storehouse outbound of center media assets.Be transported to the local level system then, insert in the media asset migratory system.
The media asset migratory system will generate the media asset migration table by the content retrieval module in migration, the record transition state.
S107, the content retrieval module will be upgraded the media asset concordance list of local level media asset library.
Can generate the media asset concordance list of local level media asset library according to the recording status of media asset migratory system in transition process.
Embodiment 2:
Be illustrated in figure 5 as the server architecture figure of the embodiment of the invention 2, this system comprises:
The centre point management system comprises business management system module and media asset library,
The local level Content Management System comprises business management system module and media asset library,
Media asset migration storehouse, source system is used for the media data of centre point management system is moved to centre data migration storer,
Media asset migration object library system is used for the media data of local level data migtation storer is moved to the local level Content Management System.
The data migtation system, the media data that is used for centre data is moved storer is moved to local level data migtation storer.
Transmit data by the internet between media asset migration storehouse, source system and the media asset migration object library system.Present embodiment does not limit the mode of transmission data, and any method of transmitting data reliably that can provide can be replaced the data transfer mode that the internet becomes present embodiment.
As shown in Figure 6:
S201, the content access module is moved business datum,
Because the relative media data data volume of business datum is very little, business datum can once be moved and be finished.The present invention does not limit concrete business datum transition process, can adopt any existing migration pattern, derives such as the batch of data to import.
S202, the scope of definite migration, the media data that the content retrieval module will be moved generates the media asset migration table according to the media asset concordance list;
For each media asset status indication is arranged in the media asset migration table, concrete status indication can be explained with numerals such as 0,1,2, also can represent with A, B, C, D.
Concrete state has:
A, state to be migrated.Represent that this media asset is not also moved.
State in B, the migration.Represent that this media asset derives from the media asset library of center, also successfully do not import the local level media asset library.
C, migration completion status.Represent that this media asset successfully imports the local level media asset library.
D, can't transition state.Expression is because the mistake of source media asset library causes the state that can't move.
Migration generally has two kinds of situations for media data: a kind of is the migration of whole storehouse, and a kind of is to select the migration of part of media assets, and this programme is all supported for dual mode.
S203, the content retrieval module compares the data to be migrated and the data mode of having moved, and revises the media asset migration table, need do the state adjustment according to the media asset migration record sheet of media asset migratory system for existing media asset migration table.Moved successful data mode change into the migration finish; The data mode of having moved failure changes into to be migrated.
For the situation that the media data in center media assets storehouse changes in transition process, the content retrieval module will change into the migration neutralization migration completion status of this media data in the media asset migration table to be migrated.
S204 determines the residual capacity and the media asset state of local level media asset library, and it is residual capacity that the total volume of local level media asset library deducts the capacity of depositing media asset.
Media asset state in the local level media asset library has three kinds of states: be untreated, injected success of CDN network and mistake.Need delete so that discharge storage space for the media data that injects the success of CDN network.Error condition is meant that the minority media asset makes a mistake and need moves again that this part data does not take up room in migration.
The content retrieval module is selected data to be migrated from the media asset migration table, calculates the media asset of this migration according to the residual capacity in target medium assets storehouse.
S205, the center media assets storehouse media asset of moving out, the content access module is moved out media asset from the media asset library of center in batches, the capacity limit of every batch data volume acceptor center data migtation storer.
S206, data transmission, data are transmitted by the internet in media asset migration storehouse, source system and media asset migration object library system.Host-host protocol can be to send instruction by media asset migration storehouse, source system, and media asset migration object library system receives instruction and downloads.Or media asset migration object library system provides the Data Receiving service, by media asset migration storehouse, source system propelling data to serve port.
S207, the local level media asset of moving into, treat that S207 finishes after, the content access module with media asset from the local level data migtation storer local level media asset library of moving into, moving into finishes afterwards discharges the space of local level data migtation storer, waits for the transmission of next batch.
S208, the content retrieval module will be upgraded the media asset concordance list of local level media asset library.
What describe in the embodiment of the invention is the system that is used for the media asset migration, and the media asset content is unrestricted, can be video file, also can be audio file or picture file.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (16)
1. data migtation system, be used for the data assets migration between source media asset library and the target medium assets storehouse, it is characterized in that, described data migtation system comprises content retrieval module and content access module, described content retrieval module is used to deposit and handle the data message of described source media asset library and the data message in described target medium assets storehouse, and the data assets in described source media asset library and the described target medium assets storehouse carried out status indication, export data assets information to be migrated, described content access module is used for according to described status indication described data assets to be migrated being migrated to target medium assets storehouse from the source media asset library.
2. data migtation as claimed in claim 1 system is characterized in that described data assets comprises business datum assets and media data assets.
3. data migtation as claimed in claim 1 system is characterized in that, described content retrieval module is used for determining the residual capacity and the media asset state in target medium assets storehouse.
4. data migtation as claimed in claim 1 system is characterized in that described source media asset library is specially the centre point management system, and described centre point management system comprises center business management system module and center media assets storehouse; Described target medium assets storehouse is specially the local level Content Management System, and described local level Content Management System comprises regional business management system module and regional media asset library.
5. data migtation as claimed in claim 1 system is characterized in that described content access module is moved described data assets to be migrated by mobile memory.
6. data migtation as claimed in claim 1 system is characterized in that described content access module is moved described data assets to be migrated by the internet.
7. data migtation as claimed in claim 1 system is characterized in that, described content retrieval module is used for upgrading described data assets information to be migrated in data assets migration finishing back.
8. as the arbitrary described data migtation of claim 1～7 system, it is characterized in that described data migtation system comprises a plurality of content access modules, described a plurality of content access modules are used for the described data assets to be migrated of parallel access.
9. data migration method, be used for the data assets migration between source media asset library and the target medium assets storehouse, it is characterized in that the content retrieval module is carried out mark to described source media asset library and described target medium assets database data assets, exports data assets information to be migrated; The content access module migrates to target medium assets storehouse with described data assets to be migrated from the source media asset library according to described data assets information to be migrated.
10. data migration method as claimed in claim 9 is characterized in that, described data assets comprises business datum assets and media data assets.
11. data migration method as claimed in claim 10 is characterized in that, the disposable migration of described business datum assets finishes.
12. data migration method as claimed in claim 10, it is characterized in that, described content retrieval module adopts arabic numeral or letter to give flag state to described media data assets, and described state includes but not limited to following state and combination thereof: state in state to be migrated, the migration, migration completion status, can't transition state.
13. data migration method as claimed in claim 9 is characterized in that, described content access module is moved described data assets to be migrated by mobile memory.
14. data migration method as claimed in claim 9 is characterized in that, described content access module is moved described data assets to be migrated by the internet.
15. data migration method as claimed in claim 9 is characterized in that, described content retrieval module is upgraded described data assets information to be migrated in data assets migration finishing back.
16., it is characterized in that described data migtation system comprises a plurality of content access modules, the described data assets to be migrated of described a plurality of content access module parallel access as the arbitrary described data migration method of claim 9～15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010217506 CN101887456A (en) | 2010-06-30 | 2010-06-30 | System and method for migrating data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201010217506 CN101887456A (en) | 2010-06-30 | 2010-06-30 | System and method for migrating data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101887456A true CN101887456A (en) | 2010-11-17 |
Family
ID=43073378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201010217506 Pending CN101887456A (en) | 2010-06-30 | 2010-06-30 | System and method for migrating data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101887456A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102103629A (en) * | 2010-12-14 | 2011-06-22 | 西北工业大学 | Online data migration method |
| CN103685368A (en) * | 2012-09-10 | 2014-03-26 | 中国电信股份有限公司 | Method and system for migrating data |
| CN108629051A (en) * | 2018-05-18 | 2018-10-09 | 阿里巴巴集团控股有限公司 | data processing method, server and data processing system |
| CN109766392A (en) * | 2019-01-21 | 2019-05-17 | 北京字节跳动网络技术有限公司 | Data processing method and device |
| CN113468140A (en) * | 2021-06-30 | 2021-10-01 | 上海掌门科技有限公司 | Data migration processing method, electronic device and computer-readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1934568A (en) * | 2004-06-10 | 2007-03-21 | 国际商业机器公司 | Method, system, and program for migrating source data to target data |
| CN101364186A (en) * | 2008-09-27 | 2009-02-11 | 腾讯科技（深圳）有限公司 | Data migration method, system, data migration server and data interface server |
| US20090198726A1 (en) * | 2008-02-04 | 2009-08-06 | Samsung Electronics Co., Ltd. | Method and apparatus for organizing contents |
| CN101667921A (en) * | 2008-09-03 | 2010-03-10 | 青岛海信传媒网络技术有限公司 | Method and network for distributing IPTV streaming media data |
| US20100153342A1 (en) * | 2008-12-17 | 2010-06-17 | Alistair Duncan | Vim next generation - migration |
-
2010
- 2010-06-30 CN CN 201010217506 patent/CN101887456A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1934568A (en) * | 2004-06-10 | 2007-03-21 | 国际商业机器公司 | Method, system, and program for migrating source data to target data |
| US20090198726A1 (en) * | 2008-02-04 | 2009-08-06 | Samsung Electronics Co., Ltd. | Method and apparatus for organizing contents |
| CN101667921A (en) * | 2008-09-03 | 2010-03-10 | 青岛海信传媒网络技术有限公司 | Method and network for distributing IPTV streaming media data |
| CN101364186A (en) * | 2008-09-27 | 2009-02-11 | 腾讯科技（深圳）有限公司 | Data migration method, system, data migration server and data interface server |
| US20100153342A1 (en) * | 2008-12-17 | 2010-06-17 | Alistair Duncan | Vim next generation - migration |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102103629A (en) * | 2010-12-14 | 2011-06-22 | 西北工业大学 | Online data migration method |
| CN102103629B (en) * | 2010-12-14 | 2012-09-26 | 西北工业大学 | Online data migration method |
| CN103685368A (en) * | 2012-09-10 | 2014-03-26 | 中国电信股份有限公司 | Method and system for migrating data |
| CN103685368B (en) * | 2012-09-10 | 2017-04-12 | 中国电信股份有限公司 | method and system for migrating data |
| CN108629051A (en) * | 2018-05-18 | 2018-10-09 | 阿里巴巴集团控股有限公司 | data processing method, server and data processing system |
| CN109766392A (en) * | 2019-01-21 | 2019-05-17 | 北京字节跳动网络技术有限公司 | Data processing method and device |
| CN113468140A (en) * | 2021-06-30 | 2021-10-01 | 上海掌门科技有限公司 | Data migration processing method, electronic device and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103226561B (en) | Content addressable storage based on brother's group | |
| CN102129434B (en) | Method and system for reading and writing separation database | |
| CN101887456A (en) | System and method for migrating data | |
| CN101673192B (en) | Method for time-sequence data processing, device and system therefor | |
| CN101741730A (en) | Method and equipment for downloading file and method and system for providing file downloading service | |
| CN101488928A (en) | Internet enterprise group communication device and internet enterprise group communication method | |
| CN103139259A (en) | Method and server of achieving low-flux synchronous message logging | |
| CN102306115A (en) | Asynchronous remote copying method, system and equipment | |
| CN107786638A (en) | A kind of data processing method, apparatus and system | |
| CN101620618A (en) | Method and device for maintaining data stored in memory | |
| CN103152390A (en) | Method and device and nodes and system for node configuration of distributed storage system | |
| CN105141672A (en) | Method, device and system for data storage | |
| CN101650744A (en) | System and method for processing great data amount based on transport tablespace | |
| CN104111924A (en) | Database system | |
| CN103038742A (en) | Method and system for dynamically replicating data within a distributed storage system | |
| CN102317901A (en) | Methods for object adjustment and devices for remove control, node and storage system | |
| CN106933836A (en) | A kind of date storage method and system based on point table | |
| CN106570093A (en) | Independent metadata organization structure-based massive data migration method and apparatus | |
| CN110147203A (en) | A kind of file management method, device, electronic equipment and storage medium | |
| CN104793981A (en) | Online snapshot managing method and device for virtual machine cluster | |
| CN103888424A (en) | Cluster-type data encryption system and data processing method thereof | |
| CN105354110B (en) | Cloud Server data back up method and device | |
| CN102164152A (en) | Method and system for remotely processing files | |
| CN105975614A (en) | Cluster configuration device and data updating method and device | |
| CN105978744B (en) | A kind of resource allocation methods, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20101117 |