CN115514986A - Method and system for realizing database turnover of materials between new and old media asset systems - Google Patents
Method and system for realizing database turnover of materials between new and old media asset systems Download PDFInfo
- Publication number
- CN115514986A CN115514986A CN202211160329.5A CN202211160329A CN115514986A CN 115514986 A CN115514986 A CN 115514986A CN 202211160329 A CN202211160329 A CN 202211160329A CN 115514986 A CN115514986 A CN 115514986A
- Authority
- CN
- China
- Prior art keywords
- media asset
- asset system
- old
- new
- new media
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 239000000463 material Substances 0.000 title claims abstract description 185
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000007306 turnover Effects 0.000 title claims abstract description 29
- 238000013508 migration Methods 0.000 claims abstract description 16
- 238000013507 mapping Methods 0.000 claims abstract description 12
- 238000003860 storage Methods 0.000 claims description 127
- 230000008569 process Effects 0.000 claims description 27
- 239000013077 target material Substances 0.000 claims description 22
- 238000012546 transfer Methods 0.000 claims description 11
- 238000002347 injection Methods 0.000 claims description 6
- 239000007924 injection Substances 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 3
- 230000005012 migration Effects 0.000 abstract description 15
- 230000007704 transition Effects 0.000 abstract description 4
- 230000009191 jumping Effects 0.000 description 6
- 230000008676 import Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 241001025261 Neoraja caerulea Species 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/232—Content retrieval operation locally within server, e.g. reading video streams from disk arrays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/458—Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations
- H04N21/4586—Content update operation triggered locally, e.g. by comparing the version of software modules in a DVB carousel to the version stored locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]
Abstract
The invention discloses a method and a system for realizing database turnover of materials between a new and old media resource system. The invention separately migrates the metadata and the physical file by analyzing the database structure and the network mapping, and executes the migration task of the material after the new media resource system receives the download request initiated by the user to the material of the old media resource system. The invention avoids the problem of long transition of new and old media asset services caused by low file migration speed, realizes the rapid database turnover of data, is convenient for a new media asset system to rapidly acquire full data, and can rapidly transition the user retrieval downloading service to the new media asset system.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method for realizing the database turnover of materials between new and old media asset systems.
Background
A media resource management system is built in each television station in China and used for cataloguing, storing, managing and releasing video and audio programs and material resources produced in daily life, and realizing uniform filing and centralized management of content resources. With the technology of cloud computing, artificial intelligence, big data and the like entering the broadcasting and television industry and the development of new media such as short videos and the like, the original media resource system cannot meet the reproduction service of the new media and the media fusion and a new media resource management mode in the technical architecture and the service flow. Therefore, many television stations can choose to build a new media resource system to meet the production and management mode of the converged media.
Because a large amount of metadata information and PB level storage capacity exist in an original aged media asset system, most physical files are stored in a data stream tape or a blue-ray medium, the work of material library turnover (namely metadata + physical file migration) is usually calculated by taking the year as a unit, and the data transition period of a new and old system is long, so that a user cannot obtain the most complete resources in the new media asset system; and the four-layer cataloging service in the old medium resource system can not be transited to the new medium resource system in time due to the hysteresis of manual cataloging. Therefore, how to realize a method for rapidly turning over the database of the materials between the new and old media resource systems is one of the needs to be solved urgently.
Disclosure of Invention
The invention aims to provide a method for realizing the database turnover of materials between a new medium resource system and an old medium resource system aiming at the defect that the material turnover speed is low, so that a user cannot finish material retrieval and use in the medium resource system. Meanwhile, the online high-low code storage disk of the old media asset system is mounted to the new media asset system through network mapping, so that the new media asset system can realize quick access to the streaming media low-code file and the high-code source code file of the old system without migrating the physical file of the old system. And separating the source code file migration from the data migration and the streaming media access by calling a back migration interface of the old media asset system.
The invention adopts the following specific technical scheme:
in a first aspect, the present invention provides a method for implementing a database turnover between a new and an old media asset system, which comprises:
according to all materials stored in a database of the aged media asset system, metadata including cataloguing information and physical storage path information are exported to form a full XML file; if the old media asset system has materials which are not subjected to standard cataloguing, the existing cataloguing information is firstly imported into a full XML file, and the metadata after the standard cataloguing is exported in batches in the subsequent process of performing cataloguing business on the part of materials to form XML update files of different batches;
the physical storage catalog of the old media asset system is mounted to the new media asset system through network sharing mapping, and the physical storage catalog is mapped to the storage configuration corresponding to the new media asset system in a relational manner, so that the new media asset system can access the materials physically stored on the old media asset system through a network;
after exporting the full XML file, transferring the warehousing of the new materials from the old media asset system to the new media asset system, and injecting the full XML file into the new media asset system according to a warehousing protocol pre-constructed between the new and old media asset systems; if the old media resource system has materials which are not catalogued, the new XML update file is reinjected into the new media resource system after being obtained every time, and data corresponding to the XML update file in the imported full-amount XML file are covered; in the new media asset system, a database turning identifier defaulting to a database not to be turned is initialized and set for each material of newly-introduced metadata;
after the injection of the full XML file and the physical storage catalog mounting of the old media system are finished in the new media system, the new media system provides material retrieval and downloading service for the outside; after the new media asset system receives a downloading request initiated by a user for the retrieved material, if the material is from the old media asset system, whether a target material related in the request is turned over or not needs to be judged according to the turning over identification, if the material is not turned over, an old media asset system return interface is called to transfer the target material from the old media asset system to the online storage of the new media asset system and execute the downloading operation and update the corresponding turning over identification, and if the material is turned over, the downloading operation is directly executed in the online storage of the new media asset system.
As a preferred aspect of the first aspect, the metadata type derived in the old media asset system includes a multi-value attribute, a single-value attribute, an attribute group, a material basic information attribute, and a physical storage path information attribute of different files in a material.
Preferably, in the full-volume XML file and the XML update file, the cataloguing information derived from the material which has been cataloguing in the standard format is four-layer cataloguing information, and includes attribute fields of a program layer, a segment layer, a scene layer, and a lens layer of the material.
Preferably, when the full-size XML file and the XML update file are generated, each material in the legacy media asset system generates an independent XML file with a corresponding unique identification code.
Preferably, the full-amount XML file and the XML update file are warehoused in the new media asset system based on the unique identification code, and the metadata field in the XML file is stored in the database of the new media asset system according to the field mapping relationship in the warehousing protocol; the full XML file is put in storage in a data adding mode, and the XML updating file is put in storage in a data covering mode.
As a preferred aspect of the first aspect, after the new media resource system receives a download request initiated by the user for the retrieved material, the subsequent processing flow is as follows:
1) The new media asset system judges whether the target material to be downloaded is from an old media asset system, if not, the downloading process is directly initiated in the new media asset system, if so, the new media asset system judges whether the target material is turned over based on the library turning identifier of the target material, if so, the downloading process is directly initiated in the new media asset system, and if not, the downloading process is initiated in the new media asset system after 2);
2) The new media asset system scans material files under corresponding paths in the online storage of the old media asset system according to the physical storage path information recorded in the metadata of the target material, and if the material files can be scanned, the material files are migrated from the online storage of the old media asset system to the online storage of the new media asset system; if the material file can not be scanned, calling a back-transfer interface of the old media asset system to acquire the material file from the associated tape library and transfer the material file to the online storage of the old media asset system, and then transferring the material file from the online storage of the old media asset system to the online storage of the new media asset system; when the element files are migrated from the online storage of the old media asset system to the online storage of the new media asset system, the new media asset system needs to update the physical storage path information recorded in the metadata of the elements to the physical storage path in the online storage of the new media asset system, and simultaneously, the database turning identifier of the elements is changed into a turned database.
Preferably, when the material file is acquired from the associated tape library by calling the migration interface of the old media asset system, whether the material file has been migrated from the tape library to the online storage of the old media asset system needs to be scanned regularly, and after the material file has been migrated from the tape library to the online storage of the old media asset system is scanned, the material file is further migrated to the online storage of the new media asset system.
Preferably, when the material file is migrated from the online storage of the old media asset system to the online storage of the new media asset system, the material file is also archived to a tape library associated with the new media asset system through an archiving process.
Preferably, the physical storage files related to the physical storage directory of the aged media asset system include source code files, streaming media low code files, portrait frames, key frames and attachments of materials.
In a second aspect, the present invention provides a system for implementing the database turnover between the new and old media asset systems, which includes:
the XML file export module is used for exporting metadata including cataloguing information and physical storage path information aiming at all materials stored in a database of the aged media asset system to form a full XML file; if the old media asset system has materials which are not subjected to standard cataloguing, the existing cataloguing information is firstly imported into a full XML file, and the metadata after the standard cataloguing is exported in batches in the subsequent process of performing cataloguing business on the part of materials to form XML update files of different batches;
the physical storage mounting module is used for mounting a physical storage catalogue of the old media asset system to the new media asset system through network sharing mapping and mapping the physical storage catalogue to a storage configuration corresponding to the new media asset system in a relation mode, so that the new media asset system can access materials physically stored on the old media asset system through a network;
the XML file warehousing module is used for transferring warehousing of new materials from the old media asset system to the new media asset system after exporting the full XML files, and injecting the full XML files into the new media asset system according to a warehousing protocol which is constructed in advance among the new and old media asset systems; if the old media asset system has materials which are not catalogued yet, the new XML update file is reinjected into the new media asset system after being obtained every time, and data corresponding to the XML update file in the imported full-size XML file is covered; in the new media asset system, a database turning identifier defaulting to a non-turned database is initialized and set for each material of newly-introduced metadata;
the material file database turning module is used for assisting the new media asset system to provide material retrieval and downloading services to the outside after the injection of the full XML file is completed in the new media asset system and the physical storage catalog mounting of the old media asset system is completed; after the new media asset system receives a downloading request initiated by a user for the retrieved material, if the material is from the old media asset system, whether a target material related in the request is turned over or not needs to be judged according to the turning over identification, if the material is not turned over, an old media asset system return interface is called to transfer the target material from the old media asset system to the online storage of the new media asset system and execute the downloading operation and update the corresponding turning over identification, and if the material is turned over, the downloading operation is directly executed in the online storage of the new media asset system.
Compared with the prior art, the invention has the following beneficial effects:
the method for realizing the database turnover between the new and old media asset systems avoids the problem of long transition of new and old media asset services caused by low file migration speed, realizes the rapid database turnover of data by separating the data from the file migration, is convenient for the new media asset system to rapidly acquire the full amount of data, and enables a user to search and download services to rapidly transit to the new media asset system.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
Fig. 1 is a diagram of a network architecture upon which a method implementation relies in an embodiment of the invention.
Fig. 2 is a flow chart of the operation of a method in an embodiment of the invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, embodiments accompanying figures are described in detail below. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. The technical characteristics in the embodiments of the invention can be correspondingly combined on the premise of no mutual conflict.
In the description of the present invention, it should be understood that when an element is referred to as being "connected" to another element, it can be directly connected to the other element or be indirectly connected to the other element, i.e., intervening elements may be present. In contrast, when an element is referred to as being "directly connected" to another element, there are no intervening elements present.
In a preferred embodiment of the present invention, a method for implementing a database turnover between a new and an old media asset system is provided, which specifically comprises the following procedures:
according to all materials stored in a database of the aged media asset system, metadata including cataloguing information and physical storage path information are exported to form a full XML file; if the old media asset system has materials which are not subjected to standard cataloguing, the existing cataloguing information is firstly imported into a full XML file, and the metadata after the standard cataloguing is exported in batches in the subsequent process of performing cataloguing business on the part of materials, so that XML update files in different batches are formed.
It should be noted that the metadata type derived from the old media asset system needs to be determined after analyzing the specific database in the system. In a preferred embodiment of the present invention, when analyzing the old media asset system database, the database tables corresponding to the program layer, the segment layer, the scene layer and the lens layer of the material and the fields corresponding to the four-layer cataloging attributes can be obtained respectively for classification, and the specific types are as follows:
multi-value attribute: fields with multiple values, e.g. program type, keywords, etc
The single-value attribute is as follows: fields with unique values, such as title, channel, security level, and first broadcast date
Property group: refers to a collection containing multiple single-valued attributes. For example, the column attribute group includes 4 single-value attributes of the column name, the column period number, the column season number, and the year to which the column name, the column season number, and the column season number belong.
Basic information attributes of the material: including creation time, distribution status, and cataloguing status of material
Physical storage path information attributes of different files in the material: the method comprises the related information of the physical files such as source code files, streaming media files, portrait frames, key frames, attachments and the like of the materials.
Based on the analysis of the metadata type needing to be exported in the aged media asset system, the XML file output for recording the metadata can be correspondingly realized. In order to facilitate warehousing, when a full-amount XML file and an XML update file are generated in the specific XML output process, each material in the old media asset system generates an independent XML file by using a corresponding unique identification code objectid, namely the XML files can be named by using the objectid.
In the present invention, the standard cataloging of the material refers to cataloging of the digital media material according to the relevant standard. According to the current related cataloging standard, the cataloging of the media resource materials is generally divided into four levels, namely a program layer, a segment layer, a scene layer and a lens layer. Therefore, in the preferred embodiment of the present invention, in the full XML file and the XML update file, the cataloguing information derived from the material which has been cataloguing in the standard format is four-layer cataloguing information, which includes the attribute fields of the program layer, the segment layer, the scene layer and the lens layer of the material, and the specific type of each attribute field may be one or more of the foregoing classification types, and the determination is performed according to the specific fields.
It should be noted that the full XML file contains metadata information of all materials in the old media asset system, and the XML update file only contains metadata of materials for which standard cataloguing is not completed at the time of switching the new media asset system. That is, if there is material that is not yet cataloged in the old media asset system when the new media asset system is switched, the metadata of this part of material also needs to construct the full XML file with the metadata when the material is not cataloged in the standard (at this time, there still exists simple cataloging information, but not the four-layer cataloging in the standard). After the full XML file is obtained, standard cataloguing still needs to be carried out, and the metadata of a batch of material after standard cataloguing can be exported after the standard cataloguing of the batch of materials is completed, so that an XML update file is formed. Because the amount of the materials stored in the medium resource system is huge, and the system switching and cataloging processes can not be completed quickly, the method can quickly meet the time requirement of the switching of the new medium resource system and the old medium resource system, and avoids the need of respectively searching in the new medium resource system and the old medium resource system in the switching process. Of course, if the standard cataloguing of all the materials in the old media asset system is finished at the time of switching the new media asset system and the old media asset system, the full XML file can be directly exported without exporting the XML update file.
In addition, for the physical storage catalog of the old media asset system, the physical storage catalog of the old media asset system is mounted to the new media asset system through network sharing mapping and is mapped into the storage configuration corresponding to the new media asset system in a relational manner, so that the new media asset system can access the materials physically stored on the old media asset system through the network. Therefore, in the system switching process, the time required by system switching is greatly reduced without completely importing the physical storage files into a new media resource system.
It should be noted that the specific type of the physical storage file related to the physical storage directory of the legacy media asset system needs to be determined according to the type of the file stored in the physical storage directory, and generally includes the types of source code files, streaming media low-code files, thumbnail frames, key frames, attachments, and the like of the material.
After exporting the full XML file, moving the warehousing of the new materials from the old media asset system to the new media asset system, stopping warehousing of the new materials in the old media asset system, and warehousing all the new materials in the new media asset system. And then, starting service switching, and injecting the full XML file into the new media resource system according to a pre-constructed warehousing protocol between the new and old media resource systems. And if the old media resource system has materials which are not catalogued, re-injecting a new XML update file into the new media resource system after acquiring the new XML update file every time, and covering the data corresponding to the XML update file in the imported full-amount XML file. And in the new media asset system, a database turnover identifier defaulting to a non-turnover database is initialized and set for each material of newly-introduced metadata, and the database turnover identifier is updated in the actual data migration process.
It should be noted that if there are materials that have not been cataloged in the old media asset system when exporting the full XML file, the cataloging in the metadata information in the full XML file is not standard and incomplete, although it can support a certain degree of retrieval, its effect is poor. Thus, in continuing with the standard cataloguing of these materials, the original full XML file may be replaced with its XML update file in batches.
Therefore, in the preferred embodiment of the invention, the full-amount XML file and the XML update file can be warehoused in the new media asset system based on the unique identification code, and the metadata field in the XML file is stored in the database of the new media asset system according to the field mapping relation in the warehousing protocol; the full XML files are put in storage in a data adding mode, and the XML updating files are put in storage in a data covering mode, namely, each XML updating file replaces material metadata under the corresponding unique identification code objectid in a new media asset system based on the unique identification code objectid.
In addition, in order to facilitate the library turning process, a library turning identifier is also required to be set in the invention, whether the physical file is transferred to a new media system or not is identified through the library turning identifier, and then the material which is not transferred can be screened according to the identifier. The database turning identifier can be generated by a database of a new media resource system when a full XML file is put in storage, and is not required to be written into the XML file.
After the first full XML file is imported, the user can search the most full data information in the new media asset system, and at the moment, the user contains all material information in the old media asset system and material information directly stored in the new media asset system. Therefore, after the injection of the full XML file is completed in the new media resource system and the physical storage catalog mounting of the old media resource system is completed, the new media resource system can provide the material retrieval and download service to the outside. After the new media asset system receives a downloading request initiated by a user for the retrieved material, if the material is from the old media asset system, whether a target material related in the request is turned over or not needs to be judged according to the turning over identification, if the material is not turned over, an old media asset system return interface is called to transfer the target material from the old media asset system to the online storage of the new media asset system and execute the downloading operation and update the corresponding turning over identification, and if the material is turned over, the downloading operation is directly executed in the online storage of the new media asset system.
In a preferred embodiment of the present invention, after the new media resource system receives a download request initiated by the user for the retrieved material, the background processing flow is preferably as follows:
1) The new media asset system judges whether the target material to be downloaded is from an old media asset system, if not, the downloading process is directly initiated in the new media asset system, if so, the new media asset system judges whether the target material is turned over based on the library turning identifier of the target material, if so, the downloading process is directly initiated in the new media asset system, and if not, the downloading process is initiated in the new media asset system after 2);
2) The new media asset system scans material files under corresponding paths in the online storage of the old media asset system according to the physical storage path information recorded in the metadata of the target material, and if the material files can be scanned, the material files are migrated from the online storage of the old media asset system to the online storage of the new media asset system; if the material file can not be scanned, calling a back-transfer interface of the old media asset system to acquire the material file from the associated tape library and transfer the material file to the online storage of the old media asset system, and then transferring the material file from the online storage of the old media asset system to the online storage of the new media asset system; when the element files are transferred from the online storage of the old media asset system to the online storage of the new media asset system, the new media asset system needs to update the physical storage path information recorded in the metadata of the elements to the physical storage path in the online storage of the new media asset system, and meanwhile, the database turnover identification of the elements is changed into a turned database.
It should be noted that, because it may take a certain time for the old media asset system to acquire the material file from the tape library, and even manual intervention is needed to search in some cases, when the return interface of the old media asset system is called to acquire the material file from the associated tape library, it may be scanned regularly whether the material file has been migrated from the tape library to the online storage of the old media asset system, and when the material file has been migrated from the tape library to the online storage of the old media asset system, it is further migrated to the online storage of the new media asset system.
In addition, because the online storage capacity of the new media asset system is online, when a material file is migrated from the online storage of the old media asset system to the online storage of the new media asset system, the material file needs to be filed to a tape library associated with the new media asset system through a filing process, so that the new media asset system can remove part of the material from the online storage according to actual needs, and then read again when being called subsequently, so as to ensure the normal use of the online storage.
The method for realizing the database turnover of the materials between the old and new media resource systems is applied to a specific case to show a specific network architecture for realizing the method and a specific implementation process of the method.
Examples
As shown in fig. 1, the diagram is a network architecture diagram that is relied on by the method for implementing the database turnover between the new and old media asset systems in the embodiment of the present invention. In this embodiment, the network architecture includes an office network 10, a PC client 20, an old media asset system router/firewall 30, a new media asset system router/firewall 40, a new media asset system core switch 50, a new media asset online storage 60, a new media asset database cluster 70, a new media asset core server cluster 80, a new media asset migration transcoding cluster 90, an old media asset core switch 100, an XML export software interface server 110, an old media asset oracle database server 120, an old media asset interface server 130, and an old media asset storage sharing area 140. Wherein the PC client 20 has access to the office network 10; the PC client 20 can be connected to the XML export software interface server 110, and the oracle database server 120, the interface server 130, and the storage sharing area 140 of the old media asset system through the firewall 30 and the core switch 100; the PC client 20 is connectable to a database cluster 70, a core server cluster 80, a migration transcoding cluster 90 and an online storage 60 of the new media asset system via a firewall 40 and a core switch 50; the migration transcoding cluster 90 is connected with the storage sharing area 140 through a network high-speed channel, so that the connection and communication between the physical file and the XML are realized. The PC client 20 provides the user to access the old media asset system and the new media asset system to execute the related operations, the XML export software in the old media asset system is deployed on the XML export software interface server 110, and the related software in the new media asset system for executing warehousing is deployed on the new media asset migration transcoding cluster 90.
As shown in fig. 2, it is a flow chart of the operation of the method of the present invention, and the flow chart method includes the following steps:
step S1: the XML export software interface server 110 is accessed on the PC client 20 and the XML export software is opened to perform the first full XML file export by year and month of creation time. The specific method comprises the following steps: inquiring the created time in the com _ basic fo, acquiring the resource generation path by month, and generating an XML file named by the unique identification code object of the material under the path for each material, wherein the information comprises:
reading a basic information field in a com _ basicinfo table by taking object id as an identifier, wherein the basic information field comprises the creation time, the release state and the cataloguing state of the material;
reading data fields in the cob _ program (video) and cob _ music (audio), a clip list field in a cob _ sequence (clip layer) table, a scene list field in a cob _ scene (scene layer) table, and a shot list field in a cob _ shot (scene layer) table, with object id as an identifier;
reading file attribute field information such as a source code, a streaming media low code, an attachment and a physical file name, a file type, a path and the like of a portrait picture in the spm _ file (file table) by taking object as an identifier;
the object is used as an identifier to read the key frame time code, description and key frame file storage path in the com _ keyframe.
At this time, part of the materials still have not been subjected to four-layer cataloging, and a four-layer cataloging task needs to be continuously performed manually.
Step S2: and accessing the XML export software interface server 110 on the PC client 20, opening XML export software, carrying out batch XML export according to the year and month of four-layer cataloging completion time, and generating an XML update file, wherein the content in the XML update file is the same as the full XML file in the step S1.
In order to ensure that no missing materials appear in the service switching process, once the export of the full XML file is completed, the aged media resource system can comprehensively stop warehousing, and only the cataloguing service is kept to continue until all tasks are finished.
And step S3: the new media resource system starts to conduct the first full XML import: the new media asset system completes information injection to the database through a standard warehousing protocol, and can complete the introduction work of million-level media asset data in one month basically. In the process, the new materials are not uploaded to the old media asset system, but are directly uploaded to the new media asset system. In the warehousing process, the new media resource system can scan the XML file, the export information is injected into the new media resource system database (the file generated in the step S1 is injected in a data adding mode, the file generated in the step S2 is injected in a data covering mode), and meanwhile, the database turning identifier is set to be in an untransferred state by default. The warehousing work is executed based on the unique identification code object of the material recorded in the XML file name exported by the source library (i.e. the aged media asset system):
converting the file basic information field in the source library into a file basic information field of a new system database by taking the object as an identifier;
taking object as an identifier, and converting four layers of cataloguing information of a source library, including cataloguing fields of a program layer, a segment layer, a scene layer and a lens layer, into a field form supported by a new system warehousing protocol according to the sequence of program-segment-scene-lens layering and attribute group-multi-valued attribute-single-valued attribute;
converting field information such as media high and low codes, attachments, physical file names of portrait pictures, file types, paths and the like of basic information of source library files into a field form supported by a new system warehousing protocol by taking object as an identifier;
converting the key frame time code, description and key frame file storage path in the key frame table into a field form supported by a new system warehousing protocol by taking object as an identifier;
after the first full XML import is completed and the physical storage catalog mounting of the old media asset system is completed, the new media asset system can provide material retrieval and download service to the outside, and the specific flow is sequentially shown as S4-S12.
However, it should be noted that, since the old media asset system still performs four-layer cataloging work of the material, after the first full XML import is completed, for the new media asset system, the new media asset migration transcoding cluster 90 still needs to cover and import the cataloging information in batches according to the cataloging completion time, and the specific process is as follows:
and taking the first full XML import date as the initial time of cataloguing completion until the final media asset cataloguing service is finished as the final cataloguing completion time, and re-importing the regenerated XML update file in stages according to the sequence of the four-layer cataloguing completion time to cover the original initial cataloguing data generated by the full XML file in the new media asset system.
And step S4: the user searches materials in the new media resource system, initiates downloading operation of the specified materials according to the requirement, and jumps to the step S5;
step S5: the new media asset system judges whether the material source is an old media asset system, if not, the step S6 is skipped; if yes, jumping to the step S7;
step S6: and downloading the file to a user target system or path from the new media asset storage, and directly ending the current downloading flow. The step is a general download process of a media asset system, and mainly comprises the steps of judging the online state, disassociating off-line materials, bringing a library back to online, migrating on-line files to a target path and the like, and is not described again here.
Step S7: the new media asset system judges the database turning identifier, and if the database turning identifier is a database turned (namely, the material file is transferred from the old media asset system to the new media asset system), the step returns to the step S6; if the identification is not the library (namely the material file has not been transferred to the new media asset system from the old media asset system), jumping to step S8;
step S8: scanning files under corresponding paths in online storage of the old media asset system according to physical storage path information of materials recorded by metadata in the new media asset system in the old media asset system, if the files can be scanned, indicating that the files are online, and jumping to the step S10; if the file cannot be scanned, the file is not on-line, and the step S9 is skipped;
step S9: calling a backtracking interface of the old medium resource system, calling the backtracking interface of the old medium resource system by the old medium resource system to acquire the material file from the associated band library and transferring the material file to online storage of the old medium resource system, scanning whether the file exists in the online storage of the old medium resource system by the new medium resource system every 15 minutes, and jumping to the step S10 when the file exists after scanning;
step S10: migrating the physical material files from the old media asset online storage to the new media asset online storage 60, and jumping to the step S11;
step S11: the new media resource system updates the physical path of the source code of the material, and the online path of the material is the online storage path under the new system; meanwhile, updating the database turning identifier as a turned database, initiating a filing process to file the material into a belt database associated with the new media resource system, and jumping to the step S6.
The above-described embodiments are merely preferred embodiments of the present invention, which should not be construed as limiting the invention. Various changes and modifications may be made by one of ordinary skill in the pertinent art without departing from the spirit and scope of the present invention. Therefore, the technical scheme obtained by adopting the mode of equivalent replacement or equivalent transformation is within the protection scope of the invention.
Claims (10)
1. A method for realizing the database turnover of materials among the new and old media asset systems is characterized by comprising the following steps:
according to all materials stored in a database of the aged media asset system, metadata including cataloguing information and physical storage path information are exported to form a full XML file; if the old media asset system has materials which are not subjected to standard cataloguing, the existing cataloguing information is firstly imported into a full XML file, and the metadata after the standard cataloguing is exported in batches in the subsequent process of performing cataloguing business on the part of materials to form XML update files of different batches;
the physical storage catalog of the old media asset system is mounted to the new media asset system through network sharing mapping, and the physical storage catalog is mapped to the storage configuration corresponding to the new media asset system in a relational manner, so that the new media asset system can access the materials physically stored on the old media asset system through a network;
after exporting the full XML file, transferring the warehousing of the new materials from the old media asset system to the new media asset system, and injecting the full XML file into the new media asset system according to a warehousing protocol pre-constructed between the new and old media asset systems; if the old media resource system has materials which are not catalogued, the new XML update file is reinjected into the new media resource system after being obtained every time, and data corresponding to the XML update file in the imported full-amount XML file are covered; in the new media asset system, a database turning identifier defaulting to a database not to be turned is initialized and set for each material of newly-introduced metadata;
after the injection of the full XML file and the mounting of the physical storage catalog of the old media asset system are finished in the new media asset system, the new media asset system provides material retrieval and downloading service for the outside; after the new media asset system receives a downloading request initiated by a user for the retrieved material, if the material is from the old media asset system, whether a target material related in the request is turned over or not needs to be judged according to the turning over identification, if the material is not turned over, an old media asset system return interface is called to transfer the target material from the old media asset system to the online storage of the new media asset system and execute the downloading operation and update the corresponding turning over identification, and if the material is turned over, the downloading operation is directly executed in the online storage of the new media asset system.
2. The method for realizing the stock turnover between the old and new media asset systems as claimed in claim 1, wherein the metadata types derived in the old media asset system include multi-value attributes, single-value attributes, attribute groups, basic information attributes of the stock, and physical storage path information attributes of different files in the stock.
3. The method for realizing the stock turnover between the new and old media asset systems as claimed in claim 1, wherein in the full XML file and the XML update file, the cataloguing information derived from the standard cataloguing material is four layers of cataloguing information, including the attribute fields of the program layer, the segment layer, the scene layer and the lens layer of the material.
4. The method for realizing the material library turnover between the old and new media asset systems as claimed in claim 1, wherein when the full XML file and the XML update file are generated, each material in the old media asset system generates an independent XML file with a corresponding unique identification code.
5. The method for realizing the database turnover of the materials between the old and new media asset systems according to claim 5, wherein the full-amount XML file and the XML update file are warehoused in the new media asset system based on the unique identification code, and the metadata field in the XML file is stored in the database of the new media asset system according to the field mapping relationship in the warehousing protocol; the full XML file is put in storage in a data adding mode, and the XML updating file is put in storage in a data covering mode.
6. The method for realizing the database turnover of the materials between the old and new media asset systems as claimed in claim 1, wherein after the new media asset system receives the download request initiated by the user to the retrieved materials, the subsequent processing flow is as follows:
1) The new media asset system judges whether the target material to be downloaded is from an old media asset system, if not, the new media asset system directly initiates a downloading flow, if so, the new media asset system judges whether the target material has been turned over on the basis of the library turning identifier of the target material, if so, the new media asset system directly initiates a downloading flow, and if not, the new media asset system first executes 2) and then initiates a downloading flow;
2) The new media asset system scans material files under corresponding paths in the online storage of the old media asset system according to the physical storage path information recorded in the metadata of the target material, and if the material files can be scanned, the material files are migrated from the online storage of the old media asset system to the online storage of the new media asset system; if the material file can not be scanned, calling a back-transfer interface of the old media asset system to acquire the material file from the associated tape library and transfer the material file to the online storage of the old media asset system, and then transferring the material file from the online storage of the old media asset system to the online storage of the new media asset system; when the element files are migrated from the online storage of the old media asset system to the online storage of the new media asset system, the new media asset system needs to update the physical storage path information recorded in the metadata of the elements to the physical storage path in the online storage of the new media asset system, and simultaneously, the database turning identifier of the elements is changed into a turned database.
7. The method for realizing the material library turnover between the old and new media asset systems as claimed in claim 1, wherein when the back-migration interface of the old media asset system is called to obtain the material file from the associated tape library, whether the material file has been migrated from the tape library to the online storage of the old media asset system or not is periodically scanned, and when the material file has been migrated from the tape library to the online storage of the old media asset system, the material file is further migrated to the online storage of the new media asset system.
8. The method for realizing the material library turnover between the old and new media asset systems as claimed in claim 1, wherein when the material files are migrated from the online storage of the old media asset system to the online storage of the new media asset system, the material files are also archived to the tape library associated with the new media asset system through an archiving process.
9. The method for realizing the stock turnover between the old and new media asset systems as claimed in claim 1, wherein the physical storage files related to the physical storage directory of the old media asset system include source code files, streaming media low code files, zodiac frames, key frames and attachments of the stock.
10. A system for realizing the material library turnover between the new and old media asset systems is characterized by comprising the following steps:
the XML file export module is used for exporting metadata including cataloguing information and physical storage path information aiming at all materials stored in a database of the aged media asset system to form a full XML file; if the old media asset system has materials which are not subjected to standard cataloguing, the existing cataloguing information is firstly imported into a full XML file, and the metadata after the standard cataloguing is exported in batches in the subsequent process of performing cataloguing business on the part of materials to form XML update files of different batches;
the physical storage mounting module is used for mounting a physical storage catalogue of the old media asset system to the new media asset system through network sharing mapping and mapping the physical storage catalogue to a storage configuration corresponding to the new media asset system in a relation mode, so that the new media asset system can access materials physically stored on the old media asset system through a network;
XML file warehouse entry module: after exporting the full XML file, transferring the warehousing of the new materials from the old media asset system to the new media asset system, and injecting the full XML file into the new media asset system according to a warehousing protocol pre-constructed between the new and old media asset systems; if the old media asset system has materials which are not catalogued yet, the new XML update file is reinjected into the new media asset system after being obtained every time, and data corresponding to the XML update file in the imported full-size XML file is covered; in the new media asset system, a database turning identifier defaulting to a database not to be turned is initialized and set for each material of newly-introduced metadata;
the material file database turning module is used for assisting the new media asset system to provide material retrieval and downloading services to the outside after the injection of the full XML file is completed in the new media asset system and the physical storage catalog mounting of the old media asset system is completed; after the new media asset system receives a downloading request initiated by a user for the retrieved material, if the material is from the old media asset system, whether a target material related in the request is turned over or not needs to be judged according to the turning over identification, if the material is not turned over, an old media asset system return interface is called to transfer the target material from the old media asset system to the online storage of the new media asset system and execute the downloading operation and update the corresponding turning over identification, and if the material is turned over, the downloading operation is directly executed in the online storage of the new media asset system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211160329.5A CN115514986B (en) | 2022-09-22 | 2022-09-22 | Method and system for realizing material database turning between new and old media resource systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211160329.5A CN115514986B (en) | 2022-09-22 | 2022-09-22 | Method and system for realizing material database turning between new and old media resource systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115514986A true CN115514986A (en) | 2022-12-23 |
| CN115514986B CN115514986B (en) | 2024-03-26 |
Family
ID=84505691
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211160329.5A Active CN115514986B (en) | 2022-09-22 | 2022-09-22 | Method and system for realizing material database turning between new and old media resource systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115514986B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040117429A1 (en) * | 2002-12-11 | 2004-06-17 | Jeyhan Karaoguz | Migration of stored media through a media exchange network |
| EP1857946A2 (en) * | 2006-05-16 | 2007-11-21 | Sap Ag | Systems and methods for migrating data |
| US20120030247A1 (en) * | 2010-07-29 | 2012-02-02 | Accenture Global Services Limited | Document migration |
| CN102682029A (en) * | 2011-03-17 | 2012-09-19 | 新奥特（北京）视频技术有限公司 | Implementation mode of tight coupling between production system and medium resource system |
| CN107277565A (en) * | 2017-08-07 | 2017-10-20 | 苏州市广播电视总台 | The categorization and cataloguing device of media resource system material |
| CN109189756A (en) * | 2018-06-29 | 2019-01-11 | 平安科技（深圳）有限公司 | Electronic device, the method for Data Migration and storage medium |
-
2022
- 2022-09-22 CN CN202211160329.5A patent/CN115514986B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040117429A1 (en) * | 2002-12-11 | 2004-06-17 | Jeyhan Karaoguz | Migration of stored media through a media exchange network |
| EP1857946A2 (en) * | 2006-05-16 | 2007-11-21 | Sap Ag | Systems and methods for migrating data |
| US20120030247A1 (en) * | 2010-07-29 | 2012-02-02 | Accenture Global Services Limited | Document migration |
| CN102682029A (en) * | 2011-03-17 | 2012-09-19 | 新奥特（北京）视频技术有限公司 | Implementation mode of tight coupling between production system and medium resource system |
| CN107277565A (en) * | 2017-08-07 | 2017-10-20 | 苏州市广播电视总台 | The categorization and cataloguing device of media resource system material |
| CN109189756A (en) * | 2018-06-29 | 2019-01-11 | 平安科技（深圳）有限公司 | Electronic device, the method for Data Migration and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115514986B (en) | 2024-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7778962B2 (en) | Client store synchronization through intermediary store change packets | |
| US6574655B1 (en) | Associative management of multimedia assets and associated resources using multi-domain agent-based communication between heterogeneous peers | |
| US10372883B2 (en) | Satellite and central asset registry systems and methods and rights management systems | |
| JP2001313639A (en) | System and method for managing network configuration data and recording medium | |
| JP2002540530A (en) | Automatic file pruning | |
| CN105912675B (en) | A kind of batch deletion/querying method and device merged for small documents | |
| US20090254585A1 (en) | Method for Associating Administrative Policies with User-Definable Groups of Files | |
| JP2010524126A (en) | Method and computer program for generating and distributing media | |
| JP2007519081A (en) | System and method for organizing audio / video data | |
| CN110633250B (en) | Resource management system and method | |
| CN113448946B (en) | Data migration method and device and electronic equipment | |
| CN115514986B (en) | Method and system for realizing material database turning between new and old media resource systems | |
| EP3518120B1 (en) | Indexing media asset aggregates in a multi-database environment | |
| CN104750815A (en) | Lob data storing method and device based on HBase | |
| CN102033896B (en) | Device and method for processing information | |
| CN109947739B (en) | Data source management method and device | |
| CN110825715B (en) | Multi-object data second combination implementation method based on Ceph object storage | |
| CN1828596A (en) | File system represented inside a database | |
| WO2022031293A1 (en) | Systems and methods for federated searches of assets in disparate dam repositories | |
| KR100644612B1 (en) | Method for changing URL information, apparatus for changing URL information and computer readable recording medium storing a program for performing the method | |
| CN111143366A (en) | High-efficiency storage method for massive large object data | |
| CN116842220B (en) | Data access method based on logic classification and data role control | |
| CN114328437B (en) | Method, device, equipment and medium for rapidly deleting historical data | |
| US20240160701A1 (en) | Systems and methods for federated searches of assets in disparate dam repositories | |
| EP4195068A1 (en) | Storing and retrieving media recordings in an object store |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |