CN1760900A - Assets management system for broadcast television media, and method of adjust and control - Google Patents

Assets management system for broadcast television media, and method of adjust and control Download PDF

Info

Publication number
CN1760900A
CN1760900A CNA2004100836626A CN200410083662A CN1760900A CN 1760900 A CN1760900 A CN 1760900A CN A2004100836626 A CNA2004100836626 A CN A2004100836626A CN 200410083662 A CN200410083662 A CN 200410083662A CN 1760900 A CN1760900 A CN 1760900A
Authority
CN
China
Prior art keywords
data
management
audio
server
media
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2004100836626A
Other languages
Chinese (zh)
Other versions
CN100552709C (en
Inventor
宋宜纯
徐威
季小军
赵严
王东向
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Central TV Station
Original Assignee
China Central TV Station
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Central TV Station filed Critical China Central TV Station
Priority to CNB2004100836626A priority Critical patent/CN100552709C/en
Publication of CN1760900A publication Critical patent/CN1760900A/en
Application granted granted Critical
Publication of CN100552709C publication Critical patent/CN100552709C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

Using modern ladder of management, digitized and networked assets management system for audio/video data media integrates functions of collecting and arranging audio/video data in order, storing catalogue, search and change as well as multiple functions of service. The system provides support and service of audio/video data information for internal TV station to produce and broadcast programs, and provides service for querying and searching broadcast, TV, audio/video data for wide media audiences and receivers externally. The system also provides basic condition and provision of condition for effective preserve audio/video data, scientific management, and developing transact business through market. The system is likes a high performance, digital product line for processing audio/video data. Being processed and digitized, audio/video data are entered to data bank, and issued for search and data application quickly.

Description

The asset management system of broadcasters and regulate and control method thereof
Technical field
The invention belongs to broadcasters asset management field, particularly a kind of TV station media asset management system and regulate and control method thereof.
Technical background
Because the data volume that field of broadcast televisions relates to is big, technical sophistication, therefore the media asset management system in this field rests on theory and technology analytically always, the project of domestic application just solves the storage problem of broadcasters' data in the mode of simple numericalization+storage, media asset management fully also is far from being.Therefore external relevant project also exists the corresponding techniques problem because gordian technique and means are immature.This field of develop rapidly along with computing machine and correlation technique had also obtained significant progress in recent years, but all had corresponding defective at aspects such as the management of The application of new technique, system and regulate and control methods.
Japan NHK TV station: this TV station has built a NHK data archive separately for the storage administration of its TV media data, is mainly used in permanent preservation and is convenient to inquiry utilization.This system adopts the form of MPEG1 to store corresponding television program data, and the video and audio material at broadcast level does not carry out the digitizing storage, browses though can retrieve, and actual broadcast level application also needs to use traditional audio cassette of looking.
Chinese Shanghai audio and video files shop: the original basic traditional tape storage way to manage that adopts of this data archive, the mode of traditional libraries is also adopted in the inquiry of data and application, after through digital improvement, high code stream adopts the DV form, low code stream adopts the MPEG1 form, substantially realized the digitizing storage of data, but because technology is at that time limit, the whole framework of its system is based upon on the basis of Fast Ethernet network, storage system also adopts traditional classification storing software Petasuit, can't realize data migtation, make that the whole data throughout of system is lower based on LAN Free.
China CCTV news shared system: this system is that CCTV handles a cover collection news collection of building for realizing the news total digitalization, make, editor, storage, broadcast in the large-scale digital media of one and make network, this system is more prone to the digital media manufacturing system of a specialty, and the part of media asset has just realized the classification storage based on LAN Free, and, then lack advanced and perfect regulation and control and management method for Content Management Platform.
Summary of the invention
The object of the present invention is to provide the asset management system of a kind of broadcasters and regulate and control method thereof, be mainly used in a large amount of storage of looking the audio frequency media data of solution, management, inquiry and utilization again, main target is to make a catalogue and store, manage, retrieve the feasible total solution of collection the whole bodys such as browsing for the user provides the digitizing of a collection media article, data information.The objective of the invention is to realize by following technical proposals:
The asset management system of a kind of broadcasters is characterized in that: mainly be made of arrangement acquisition subsystem, content disposal subsystem, data multiplex subsystem and supporting with it software architecture;
Dispose in the described arrangement acquisition subsystem and comprise: the data pre-service, look audio workstation collection, audio collection processing, full-automatic video collection of server, acquisition tasks management, several parts of remote data transmission;
The arrangement acquisition subsystem passes through arrangement with simulation audio and video files such as traditional video media, audio media, video/audio signals, digital coding, remote data transmission, pre-catalogues etc. are handled and are generated many bit stream datas media article, and this data medium data and corresponding metadata information are sent to content disposal subsystem;
Configuration comprises in the described content disposal subsystem: list processing, retrieval issue,, workflow schedule,, application server middleware, core database service (DBMS), full-text search engine, transcoding center, graded memory management system, store management, workflow management and catalogue application management;
Content disposal subsystem is that the core business of system is handled support platform, mission critical is by the non-structured audio frequency media data of looking is set up structurized catalogue metadata information, and employing workflow management, multiple means such as classification storage are effectively stored the data medium data that system generates and are managed, so that the utilization again of data;
Dispose in the described data multiplex subsystem and comprise: audiovisual is examined, workstation is downloaded, DVD imprinting, remote data transmission, and Streaming Media is issued several parts; The data medium data that the data multiplex subsystem stores the content disposal subsystem inediting is handled externally output through data multiplex and is generated reproducible, exchange, the audio and video files of examining, browsing;
Full-automatic video collection of server and remote data transmission in the described arrangement acquisition subsystem, all be to realize transmission of media data by the transcoding center service that Content Management Platform provides, tasks such as storage and coded format conversion, and its associated metadata information also enters the content management database of core simultaneously.
Described software architecture adopts the three-layer architecture based on client software (application layer), Content Management Platform (middle layer), database (data Layer), and client can adopt the B/S pattern, also can be C/S model.
A kind of broadcasters assets control method, it is characterized in that: use the arrangement acquisition subsystem traditional audio media of looking, simulation audio and video files such as signal carry out acquisition process, and generate the digital media data of multiple code stream and multiple form by digital coding, and by the related media data is made a catalogue, the classification storage, effective means such as transcoding make these digitized unstructured datas effectively include Content Management Platform in and effectively manage by setting up structured index, become corresponding medium by the output of means such as issue, data or signal are used for exchange and utilize.In case these non-structured media datas enter Content Management Platform, generated relevant data message by system, then these data just become the media asset of effective management.
Use the data multiplex subsystem that described media asset is carried out data recycle and handle, externally output generates reproducible, exchange, the audio and video files of examining, browsing.
Overall traffic structure of the present invention is by management service; Applied business; The storage service three parts are formed, applied business wherein, and storage service comprises:
1. memory transactions
Memory transactions is the program material storage platform of whole data archive system centre, by set up a safety, reliable, stable memory transactions subsystem is stored the various data objects of data archive and manage.The demand of memory transactions system mainly comprises the following aspects:
● data bank reservoir area sub-population is divided into 16 storehouses, and the design stores total volume is 1,000,000 hours, supports online, near line and three kinds of storage modes of off-line.
● online and near line service provides exports browsing with the data of part information of stock's program material, supports with hard disk array and automatic mechanical hand streaming tape storehouse mode; Offline service is defined as program material data output service is provided by appointment.
● several media such as traditional AV medium, streaming tape, CD, disk and paper are adopted in the storage of data bank.
● the storage format of television program data adopts the data mode storage, and the video compression coding form adopts MPEG2 IBP25Mbps.Simultaneity factor adopts the two compression ratio techniques of dual code stream, when broadcast level digital media data storage is provided, also provides the Streaming Media low code stream data based on the broadband network online browse, and low code stream adopts the WinMedia based on 300Kbps.
● online storage data object comprises: the metadata information of media data, the digital media data (simultaneously also as the buffer zone of exchanges data and use) of using or frequently using, low code stream stream medium data and other coordinate indexing information (literal, key frame etc.).Guaranteeing to adopt the RAID rank of ratio of performance to price optimum under the prerequisite of performance to guarantee data security.
● the nearline storage data object comprises: the high code stream digital media data of broadcast level, and system data back-up (comprising the low code stream backup, high code stream backup and system metadata backup).
● the offline storage data comprise the various data objects that all need be stored, and system supports storage medium to preserve with offline mode and utilizes intensive tape library mode of storage mode employing again
2. look the Audio Processing center
Look the Audio Processing center and be divided into data compilation system and information reproduction system, they are key links (network data is exchanged for auxiliary link) of general program warehouse-in and outbound, and the production efficiency of these two systems and quality will directly influence whole audio and video files shop system.
Data compilation system: be mainly used in the arrangement of video and audio material, comprise following content:
● for guaranteeing to obtain the highest digitized program quality, system carries out necessary processing processing to the video/audio signal of warehouse-in, as noise reduction, colour correction etc.
● system can generate two kinds of different bit-rate video information simultaneously: retrieval code check (300Kbps), storage code check (25Mbps).
● system has the acquisition function of sound signal, can generate two kinds of different code check audio-frequency informations simultaneously: storage code check (1536Kbps), retrieval code check (128Kbps)
● can receive the important program content of local and overseas each main media distribution, include signal and be mainly derived from master control in the platform, master control signal reaches data archive by optical cable.
● support the news network of present CCTV and the program of broadcast system production every day and broadcast directly to go into library storage.
Information reproduction system: the duplication service that is used for carrying out program material according to user's request, by guaranteeing that being hidden program material in the shop is not damaged, realize that in full shop looking the audio storage data does not go out library management, all data informations that the user needs must promptly only be given duplicate plate the user and use through duplicating.The information reproduction system function mainly comprises:
● system can access the video and audio material of storage code check automatically and duplicates according to specified format according to customer requirements.
● support Conference Hall and examine between semaphore request.
● the signal of all data bank outputs is a baseband signal in the native system internal conversion in the shop, feeds back to the matrix input end, and its output is connected to the video recorder of multiple form or carves disc apparatus and duplicate.
System also can realize the belt translation function, with platform master control signal function of exchange.
3. the catalogue of data and retrieval
The purpose of making a catalogue is that the deep description generation final program material metadata record of the source book of generation by the catalogue personnel gathered in arrangement.System mainly contains following requirement to catalogue:
● system can handle the various program material that surpass more than 400 hours every day.
● cataloging syytem fully discloses by the intension to various data and the index of carrying out standard is recorded, for retrieval provides necessary multiple search channel and retrieval as much as possible point.
● cataloging syytem is mainly by manually-operated, therefore must meet to have customized the catalogue standardized administration system of finishing at present, is used for catalogue work.By the working routine of complete science and standard, set up the modernized data cataloging syytem of a data production line form.
● the non-book materials catalogue standard that the catalogue standard is released according to the relevant industry of country and unit, or set up a catalogue standard of overlapping the suitable program material characteristics of establishing one's own system.
● whole cataloging syytem has good data protection and safety management function.Need set up scientific and normal data security mechanism.All has corresponding security mechanisms in each aspects such as database storing, retrieval, extraction, management and angle.
● friendly user interface is provided, possesses easy-to-use human-computer interaction interface and various online help directly perceived.Make full use of the auxiliary index of the corresponding robotization of existing techniques in realizing.
● because the idiosyncratic gap of various video and audio materials is bigger, coverage rate is wider, therefore requires cataloging syytem in flexible easy-to-use catalogue mode, dynamic cataloging structure, and the catalogue production procedure of combining is the requirement of cataloging syytem.
Retrieval is the data issue and the output stage of data archive, and the value of data archive just is embodied in the retrieval of data and utilizes.The retrieval user of system mainly is divided into: in the shop, and in the platform, platform border and society.
● searching system must be able to provide the retrieval service of various approach.
● the searching terminal by data archive inside provides corresponding retrieval service and retrieval of content to the user of different brackets; The all-around service of different brackets is provided to TV station's internal user by network; Provide paid information service by the internet to society.
● can realize that telereference browses service; Can carry out ecommerce, video request program, business such as remote copy; Connect with the world or domestic other audio and video files shops, realize visit mutually.
4. audiovisual is examined
Audiovisual is examined system and is divided into Conference Hall and data audiovisual system two parts.The design of Conference Hall is a purpose with professional purpose such as business report, empathic learning and academic exchange, and is not close with the main business interconnection of data archive, do not do detailed argumentation here.The argumentation of these chapters and sections and this paper back is all based on computer network relevant portion in the data audiovisual system.
● audiovisual system both can be used as that inside information is reviewed music programme before public showing, data check, source investigation and view and emulate use, also can externally carry out the authorization service of above content.
● the computer inquery terminal that data check is retrieved for examination by each audiovisual studio is selected to access, to insert IC-card as the authority audit of query calls and charge and ASSOCIATE STATISTICS.
● data is examined system and is established 3 of medium-and-large-sized audiovisual studio, 3 of medium-sized audiovisual studio, can hold 1 of the self-service audiovisual studio of 16~20 people.Place 2 in large-scale, the medium-sized audiovisual studio and examine terminal (considering the processing of backup and unscheduled event), self-service audiovisual studio has 16~20 to examine terminal.
Management service of the present invention comprises:
The data archive process system is in large scale, complex structure, and for guaranteeing the normal operation of system, relevant management work is essential.Management system mainly is made of four parts: equipment control; Personal management; Workflow management and statistical study.
● equipment control: be used for all devices to system, resource is distributed, and management is safeguarded and monitoring.Main contents comprise: store management; Resources allocation; Monitoring of tools etc.
● personal management: be used for system user is managed and the access control of data.Main contents comprise: expenses management; User management; Data access control etc.
● workflow management: be used for the operation flow control and the management of system's operation, main contents comprise: task management; Work Process Management etc.
● statistical study: be used for the various service datas that system's operational process produces are carried out statistics and analysis, and generate various statistical study forms, be convenient to the user and carry out above-mentioned various management service.
NOT-function requires general introduction
Need some non-functional requirements are taken in the native system design process, these non-functional requirements comprise security of system, opening and extensibility, flow control, load balancing etc.
1. security of system
System is very high to the requirement of security, and the network exchange platform need adopt the equipment of reliable structure, stable performance and perfect redundancy backup measure; Host computer system adopts full reliability services device cluster and many CPU concurrent working pattern, it is main that operating system adopts UNIX, Windows NT is the combination mode of assisting, and when a certain node broke down, another node can be immediately or taken over the work of malfunctioning node at short notice.
Online memory bank uses the RAID technology to guarantee the safety of data, should use mirror image technology to carry out data protection for the emphasis data.System need adopt technological means such as multiple duplication, remote backup, incremental backup that data is carried out backup protection, makes the expendable disaster of the unlikely generation of system.In addition, system should also provide complete prevention and cure of viruses and the objective means of cracking down upon evil forces guarantee that system can not paralyse because of external attack.
2. opening and extendability
Native system should be the system of an opening, and network communicating system should be supported talk various network protocols, can connect the computer equipment of each producer and seamless interconnected with CCTV's existing network communication system.Host computer system should adopt open platform, can support many producers system software.Native system also should fully take into account extensibility when design, be required to be development in the future and leave sufficient leeway.
3. load balancing
Native system need be considered load balancing when network design and server cluster design, make Internet resources and server computational resource obtain rationally and fully utilizing.
4. flow control
For all working station in the assurance system all can obtain enough network bandwidths to satisfy the operate as normal demand, be necessary when network design, to carry out service quality control and flow control.Simultaneously,, cause normal service can't be provided, also be necessary the flow control that conducts interviews for avoiding the overweight or Denial of Service attack (DOS) of load for server key in the system.
On the platform of overall framework building networkization of the present invention, wherein main destructuring media data object can be by gigabit Ethernet at a high speed or FC transmission, other management information, data directory information, structured messages such as request of data information are by the Ethernet support.Storage administration is the core of system data scheduling migration, and Content Management is system management, the basic platform that control and application are supported, and the arrangement of data is duplicated, and examines, catalogue, retrieval and service management etc. all are the business systems that is based upon on storage administration and the Content Management.
Overall system is divided into the media article arrangement and gathers three main systems of Content Management and data multiplex.
● arrangement is gathered: arrangement collection is the first of system of the present invention, and this part can be with various conventional video media, and audio media and video/audio signal are handled by capturing and coding and generated the datumization media article.The datumization media object that the arrangement collecting part generates comprises: storage code stream quality data, examine qualitative data in the code stream, and browse the code stream low quality data.In addition, also generate the associated metadata index information of datumization media object in the arrangement gatherer process simultaneously, these index informations are directly used in object-based Content Management of system and data multiplex.
● Content Management: in the native system scheme, adopt object-based Content Management solution to realize the storage of datumization media object and utilization again.By Content Management, each application layer workstation can be retrieved, visits, the various data objects (content) of use, browing system management.Content Management is the core link of system, and all application of system all are structured on the Content Management based on media object.
● data multiplex: data multiplex is the data issue and the output of system of the present invention, the solution of this part can be duplicated the datumization media object of system management through the data multiplex link, exchange is examined, and browse and editing etc. specifically used.
Software architecture of the present invention adopts the three-layer architecture based on client software (application layer), Content Management Platform (middle layer), database (data Layer), client software sends object requests message by message to content management server, content management server is handled various request message formations, by server-side application and service logic database server is sent request of data and processing messages result, after finishing dealing with the result is returned to client.Storage administration is used to finish the storage and the migration of media data object, and in fact it provides the storage administration support of unstructured data for Content Management.
Client can adopt the B/S pattern, also can be C/S model.
● application layer
Application layer mainly comprises all application software relevant with business of system, as: catalogue, retrieval, data compilation, collection, document copying exchange etc.Application layer is sent data object request according to the demand of business and actual workflow to the middle layer, and the middle layer is received and handled accordingly after the request and result is returned application layer.
● the middle layer
The core content in middle layer is exactly Content Management and storage administration.Content Management is responsible for system architecture data object (index class data object) is managed, and the storage migration of system's unstructured data object (media data object) is then finished in storage administration.Content Management is responsible for the request of data of all applications of system, and by user management, realizations such as resource workflow management application separates with data.Storage administration is then carried out the storage administration of unstructured data by the storage policy of customization generation and the request of data of Content Management generation, and directly data is sent to application layer.
● data Layer
Data Layer is the data platform support to system, mainly refer to database platform in software systems, and in system, data Layer mainly comprises abstract structural data storage and unstructured data storage.Below data Layer, need the support of hardware system platform, as classification storage platform, the network platform.
The invention has the beneficial effects as follows:
The operation flow of the asset management system of broadcasters and regulate and control method thereof is that catalogue is compiled, stored to collection audio and video files, retrieval exchanges and multiple service function is datumization one and that adopt the modern management means, networked audio and video files media asset management system, system internally makes to broadcast for station synchronization provides audio and video files information to support and service, and query and search service, audiovisual service and the information service of radio and television audio and video files externally are provided for numerous media audiences.Simultaneously, system also provides environmental basis and condition guarantee for the carrying out of effective preservation, scientific management and market management business of audio and video files.Digitizing audio and video files process for producing line efficiently of picture, all audio and video files that enter data bank through arrangement gather, operations such as catalogue index finish its datumization process, and then by issue retrieval easily and quickly and data application.
Below in conjunction with drawings and Examples the present invention is done a detailed explanation.
Description of drawings
Fig. 1 is an overall system business structure synoptic diagram
Fig. 2 is the overall traffic schematic flow sheet
Fig. 3 is overall frame structure and workflow synoptic diagram
Fig. 4 is the system software hierarchical chart
Fig. 5 is the system global structure synoptic diagram
Fig. 6 is the hierarchical stor structural representation
Fig. 7 is each module relation diagram of classification storing software
Fig. 8 looks Audio Processing subsystem module figure for last download
Fig. 9 is a pretreatment module service logic process flow diagram
Figure 10 is a collection of server modular service logical flow chart
Figure 11 is a collection of server module QC service logic process flow diagram
Figure 12 is a workstation capturing service logical flow chart
Figure 13 is a workstation acquisition module QC service logic process flow diagram
Figure 14 is an audio collection service logic process flow diagram
Figure 15 is for downloading subsystem module service logic process flow diagram
Figure 16 is for uploading the subsystem network structural representation
Figure 17 is the download system schematic network structure
Figure 18 is the sub modular structure figure of catalogue retrieval system
Figure 19 is a news category program too many levels serial catalogue process flow diagram
Figure 20 is a news category program too many levels serial parallel catalogue process flow diagram
Figure 21 downloads for retrieval and business process map is examined in audiovisual
Figure 22 is long-range issue structural representation
Figure 23 examines the service logic process flow diagram for audiovisual
Figure 24 examines the subsystem network structural representation for audiovisual
Figure 25 is a collection of server transcoding service logic process flow diagram
Figure 26 is a remote data transmission service logic process flow diagram
Figure 27 is a transcoding service business logical process process flow diagram
Figure 28 is a key-frame extraction service logic process flow diagram
Figure 29 is a transcoding central site network structural drawing
Figure 30 is an application server system Integrated Solution design drawing
Figure 31 is the mid-tier system schematic network structure
Figure 32 is the NDMP of a NAS system backup scenario synoptic diagram
Figure 33 is the LAN Free backup scenario synoptic diagram of NAS gateway
Figure 34 is system's operational management module diagram
Figure 35 is system network architecture figure of the present invention
Figure 36 is the brief description table of each module of system, and each module sequence number is arranged and be there is no sequencing in this table, and is also not related with each figure number in this instructions.
Embodiment
Fig. 1 is an overall system business structure synoptic diagram, and overall traffic structure of the present invention is by management service; Applied business; The storage service three parts are formed.Applied business wherein, storage service comprises: memory transactions, look the Audio Processing center, the catalogue of data and retrieval, audiovisual is examined; Management service of the present invention comprises: equipment control, personal management, workflow management, statistical study.Among the figure: 1.1 service management, 1.1.1 equipment control, 1.1.2 workflow management, 1.1.3 user management, 1.1.4 statistical study, 1.2 applied business, 1.2.1 master control signal conventional video data exchange, 1.2.2 puts collection in order, the 1.2.3 index of making a catalogue, 1.2.4 issue retrieval, 1.2.5 data are used, the exchange of 1.2.6 master control signal conventional video data, 1.3 storage services, 1.3.1 memory scheduling, the 1.3.2 data migtation.
Operation flow of the present invention is as shown in Figure 2: among the figure, 2.0.1 broadcast items storehouse/CCTV is by former data, 2.0.2 tape source, 2.0.3 the production schedule, 2.0.4 transport tape, 2.0.5 transports back the tape after the digitizing, the 2.0.6 empty tape provides, 2.0.7 Call center backstage, 2.0.8 duplicate the dead zone request, 2.0.9 power user, 2.0.10 user, 2.1 tape pool management, 2.1.1 go into library management, 2.1.2 transports tape, 2.1.3 is digitizing tape framed bent not, 2.1.4 transport tape, 2.1.5 produce library management, 2.1.6 produces back library management, 2.1.7 transports tape, 2.1.8 tape framed bent after the digitizing, 2.2 upload 2.2.1 audio collection, 2.2.2 pre-service, 2.2.3 workstation collection, 2.2.4 transport tape, the control of 2.2.5 collection of server, 2.2.6 mechanical arm tape pool, 2.2.7 workstation is gathered QC, 2.2.8 video server, 2.2.9 acquisition management, 2.2.10 collection of server QC, 2.3 transcoding center, 2.3.1 the transcoding center, the management of 2.3.2 transcoding, 2.4 catalogues, 2.4.1 program layer catalogue, 2.4.2 the slice layer catalogue, 2.4.3 camera lens layer catalogue, 2.4.4 copyright authentication, 2.4.5 catalogue audit, 2.4.6 the catalogue management, 2.5 download the 2.5.1 download management, 2.5.2 download workstation, 2.5.3 download request, 2.6 storage centers, 2.6.1 storage administration, 2.6.2 examine request, 2.7 audiovisual is examined, 2.7.1 examines grand entrance, 2.7.2 user, 2.7.3 user, 2.7.4 examine management, 2.8 retrievals, 2.8.1 client provides empty tape for oneself, download the tape that finishes 2.8.2 send back to, 2.8.3 the Call center foreground, 2.8.4 saloon searching terminal, the 2.8.5 service request is submitted to, 2.8.6 the user, 2.8.7 user.
The library management 2.1.1 that goes into that tape 2.0.2 at first enters into tape pool management 2.1 carries out the scanning of tape accent sign indicating number; The preliminary classification; Framed bent distributes, and then these is not digitizedly sent tape to deliver to 2.1.3 to carry out framed bent, and the dead zone request of the duplicating 2.0.8 by the backstage 2.0.7 of Call center comes carries out magnetic code scanning by producing library management 2.1.5 behind production schedule 2.0.3; The outbound registration; The tape outbound.
Wherein one the tunnel not digitized tape is delivered to mounting area 2.2 carry out audio collection 2.2.1: bar code scanning; Input catalogue metadata; High-quality audio collection.Pre-service 2.2.2: bar code scanning; Input catalogue metadata; Create acquisition tasks.Workstation is gathered 2.2.3: bar code scanning; Input catalogue metadata; Create acquisition tasks; High-low code flow is gathered; The key frame time-code extracts.Collection of server control 2.2.5: control mechanical arm tape pool scanning tape obtains task; Intelligent allocating task; Intelligent Resources allocation; Control of video server and video tape recorder are gathered.Mechanical arm tape pool 2.2.6: load tape; Bar code scanning; Fill out tape to player.Workstation is gathered QC2.2.7: the data content to the workstation collection is examined; Make the QC authentication; Submit to the acquisition management workstation to do wrong the processing to substandard product.Acquisition management 2.2.9: acquisition monitoring management; Data statistics; Fault processing; Be responsible for the careful task of closing that the Broadcast Control partial data imports by broadcast items storehouse and the existing source data 2.0.1 of TV station.Collection of server QC2.2.10: the content to collection of server is examined by 2.2.8; Make the QC authentication; Submit to the acquisition management workstation to do wrong the processing to substandard product.To return library management 2.1.6 and carry out the tape bar code scan by uploading production that tape after the digitizing sends back to tape pool management 2.1 then; Return the storehouse registration; Redistribute framed bent.Send back to tape framed bent 9 after the digitizing.To be sent to transcoding center 2.3 by the data of QC authentication simultaneously handles.
Transcoding center processing 2.3.1: the original metadata of TV station imports; The video server file transfer; The low code stream transcoding; The conversion of high code stream encoding file format; Key frame extracts.Transcoding management 2.3.2: transcoding Mission Monitor management; Data statistics; Operation management.
Enter into catalogue 2.4 then and make a catalogue, program layer catalogue 2.4.1: the crucial metadata of the pretreated program layer of updates; Create slice layer structure (the fragment definition is got ready, name etc.).Slice layer catalogue 2.4.2: according to the crucial metadata of slice layer structure input slice layer; Judging whether needs to create camera lens layer catalogue, need then create camera lens layer structure (the camera lens definition is got ready, name etc.).Camera lens layer catalogue 2.4.3: the crucial metadata of input camera lens.Copyright authentication 2.4.4: copyright audit.Copyright audit 2.4.5: catalogue final review.Catalogue management 2.4.6: catalogue task prison blank pipe reason; Data statistics; Operation management.
Download area 2.5 is delivered to, download management 2.5.1 with empty tape from tape pool directorial area 2.1 and the foreground 2.8.3 of Call center in another road: the acquisition tasks monitoring management; Data statistics; Fault processing.Download workstation 2.5.2: the download request 2.5.3 of the process backstage 2.0.7 of Call center controls the download matrix and finishes downloading task.To download good tape then and send the meeting foreground 2.8.3 of Customer Service Center.
Storage center 2.6 is carried out storage administration 2.6.1: data storage; The migration scheduling.With download request data migtation is dispatched to download area 2.5 and audiovisual according to examining of the backstage 2.0.7 of Call center and examines district 2.7.Examine management 2.7.4: examine the Mission Monitor management; Data statistics; Operation management.Power user 2.0.9: being that online reservation is relevant examines but also will be through the user of Customer Service Center's foreground authentication power user's exception.
Retrieval district 2.8 comprises the foreground 2.8.3 of Customer Service Center: authentication; Certificates handling; The download tape is got.Saloon searching terminal 2.8.4: the retrieval of giving information.Service request is submitted 2.8.5 to: request is examined in download/audiovisual.
Fig. 3 is overall frame structure and workflow synoptic diagram, and overall system is divided into the media article arrangement and gathers three main systems of Content Management and data multiplex.Among the figure: 3.1 arrangements are gathered, and 3.1.1 generates many bit stream dataizations media article 3.1.2 tradition by the arrangement collection to traditional data and looks audio cassette, and the online signal of 3.1.3 is included, 3.1.4 arrangement and collection, 3.2 Content Management, the asset management system of 3.2.1 Digital Media, 3.2.2 catalogue retrieval, 3.2.3 data storing, 3.3 data multiplex, the 3.3.1 Digital Media utilizes again, the 3.3.2 document copying, 3.3.3 signal output, 3.3.4 generates tradition and looks audio media.
Fig. 4 is the system software hierarchical chart, software architecture of the present invention adopts the three-layer architecture based on client software (application layer), Content Management Platform (middle layer), database (data Layer), client can adopt the B/S pattern, also can be C/S model.Among the figure: 4.1 application layers, the 4.1.1 storage policy, 4.1.2 puts collection in order, the 4.1.3 index of making a catalogue, the 4.1.4 audiovisual is examined, and 4.1.5 duplicates output, 4.2 middle layers, 4.2.1 storage administration, 4.2.2 Content Management, 4.3 data Layers, 4.3.1 data.
Fig. 5 is the system global structure synoptic diagram, and by data compilation, document copying is examined, catalogue, and retrieval, management, storage system is formed.Among the figure: 5.01 transcoding/transmission, 5.02 migration filings, 5.1 data compilation, 5.1.1 task management, 5.1.2 acquisition workstation, 5.1.3 video server, 5.1.4 acquisition workstation, 5.2 document copyings, 5.2.1 task management, 5.2.2 video server, 5.2.3 replication work station, 5.2.4 video/audio matrix, 5.2.5DVD/CD imprinting, 5.3 examine, and 5.3.1 retrieves workstation, 5.4 catalogue, 5.4.1 the catalogue workstation, 5.5 retrievals, 5.5.1 retrieves workstation, 5.6 management, 5.6.1 management work station, 5.7 databases and application server, 5.7.1WER server, 5.7.2 database server, 5.7.3 streaming media server, 5.8 storage systems, the online storage of 5.8.1,5.8.2 nearline storage, the 5.8.3 offline storage.
The present invention has storage subsystem, uploads and looks the Audio Processing subsystem, and download and look the Audio Processing subsystem, the catalogue retrieval subsystem, subsystem is examined in audiovisual, transcoding subsystem, middleware subsystem.
One. storage subsystem structure of the present invention is as shown in Figure 6,6.1 online FC dish battle arrays (storage code check) among the figure, 6.2 online FC dish battle array (database, TRS HA), 6.3 online NAS storages (low code check, key frame), 6.5MDC server, 6.6 migration server cluster, 6.7 the near line tape pool, 6.8 off-lines management (streaming tape), 6.9 backup tape pools, the control of 6.10 memory scheduling tactical management tape pools, 6.11 storage administration GUI, 6.12 off-lines management (traditional tape).
1. structure explanation
Online storage is unique external interface of whole storage system, therefore can store all system datas, and according to the data type difference, on-line system will be selected different storage device and dispose the corresponding network interface.The code check video/audio is all stored in nearline storage, adopts single big tape pool, it and online between carry out exchanges data by the SAN network.Offline storage comprises the storage of traditional tape storage and streaming tape, and wherein streaming tape is mainly from the tape backup of near line.
The storage management system functional module comprises: SAN file-sharing management, the migration of LAN Free distributed data, storage appoints the storage management system functional module to comprise: SAN file-sharing management, the migration of LAN Free distributed data, store tasks scheduling, tactical management, tape pool device control, system management GUI, off-line medium management etc.
To carry out design of hardware and software according to the difference of using to above-mentioned module, to satisfy the requirement of aspects such as performance, stable, safety, expansion, cost.
Online memory bank comprises two FC disk arrays and a NAS equipment in the native system design, and one of them FC disk array is used for preserving the storage code check and looks audio material, the shared dish when another is used for stored data base and full-text search data and is used as cluster.NAS equipment is mainly used in the memory scan code check and looks audio material and deposit key frame.
The main cause of two FC disk arrays of configuration is that system belongs to the streaming visit to the visit of looking audio material, bandwidth is greatly more than 400MB/s, under the impact of so big bandwidth, the Cache of FC array is very fast being taken, thereby begins to carry out the exchanges data of Cache to disk.Database and full-text search are used very high to the IOPS Capability Requirement of array, and the size of array IOPS and array Cache's is big or small closely related, satisfy Database Requirements for guaranteeing array IOPS ability, the bigger Cache of necessary outfit.But existing FC array can't be accomplished at using or Different L UN divides mutually independently Cache, all-access is all shared same Cache, like this, looking the audio material read and write access and will taking the Cache space of using for database significantly of high bandwidth makes the database access performance be subjected to obvious influence.Therefore, for guaranteeing the entire system performance, this programme design places two FC array stores respectively with video/audio and database, full-text search data.
Because retrieval code check material code check is 300Kbps, and is very low to bandwidth requirement, uses Ethernet to be enough to satisfy transmission requirement.Simultaneously, retrieval code check material storage capacity requirement is very big, and first phase requires 12.6TB, also can carry out capacity extension as required later on, and therefore using this low-cost storage solution of NAS equipment is more reasonably to select.In addition, also need preserve a large amount of key frame files in the system, these file sizes are all little, but number of files finally can reach several ten million.One of characteristics of Ethernet are exactly the transmission that relatively is suitable for small documents, and NAS equipment is used this class small documents read-write and also all done performance optimization usually, so this programme design also is stored in the key frame file in the NAS equipment.
2. classification storing software
Whole storage system mainly is made of storage server, storage migrator, file library management, storage GUI and five modules of storage policy server, carries out resource distribution, scheduling of resource, task execution and the progress monitoring etc. that communication realizes system by storage API, message-oriented middleware and database between these five modules.
Relation as shown in Figure 7 between each module: among the figure: 7.1 monitor clients, 1,7.2 monitor client, 2,7.3 strategic servers, 7.4 system call servers, 7.5 data movers, 1,7.6 data mover, 2,7.7 storehouse controllers, 1,7.8 storehouse controller 2.
● storage server (Server): storage server is the maincenter of whole software, internally is responsible for the allocation schedule of resources such as magnetic tape station, tape pool mechanical arm, transference apparatus in the storage system, externally is responsible for receiving and responding various types of requests and task.
● storage migrator (Actor): Actor is responsible for specifically moving of data, and it receives the task that Server sends, and specifically carries out this task.
● file library management (LibCtrl): tape pool control and management server is responsible for the control in streaming tape storehouse and is read relevant information.
● storage GUI: the storage gui program is mainly realized two functions, i.e. configuration of system resource and system resource state, Task Progress monitoring.
● the storage policy server: the storage policy relevant with application that the storage policy server is formulated according to the external world realized generation, the submission of task automatically.This inside modules has three threads to realize four kinds of different strategies respectively: filing strategy, migration strategy, retention strategy and deletion strategy.
3. store management software
Store management adopts the BS structure to design and develop, and core business is that the medium of storehouse goes into outbound, safeguards that framed bent distributes, and formulates the production schedule etc.
● blank medium management: be responsible for the blank medium management function of storehouse, mainly comprise the blank medium warehouse-in, medium statistics, production outbound etc.
● go into library management: be responsible for the warehouse-in flow process of All Media, comprise that streaming tape and tradition look audio media.Groundwork comprises: tape bar code scan (bar code generation), generate medium recording, and send metadata and import request, framed bent distribution etc.
● the production schedule: formulate the digital collection plan.Formulate corresponding acquisition plan according to the storehouse medium situation and the collection condition of production.Plan can be as accurate as concrete medium, also can only formulate production.
● go out library management: mainly refer to the production outbound registration of medium.
● return library management: refer to that mainly medium production finishes, return the storehouse registration and carry out framed bent again.
● framed bent management: the framed bent of being responsible for storehouse distributes, and framed bent is set and fallen the storehouse and falls related service operations such as frame.
● medium is safeguarded: stock's medium is unified maintenance and management.
● statistical query: the medium query statistic function of various aspects is provided, comprises: on content, on the maintenance condition, the condition of production is first-class.
Two. download in the present invention and look the Audio Processing subsystem
Up and down the carrier system module as shown in Figure 8, among the figure: 8.1 store managements, 8.2 gather pretreatment module, 8.3 workstation acquisition process, 8.4 workstation is gathered QC, 8.5 collection of server are handled, 8.6 collection of server QC, 8.7 audio collection is handled, 8.8 audio collection QC, 8.9 retrieval process, 8.10 download management module, 8.11 workstation is downloaded output and handled, 8.12DVD downloads output and handles.
1. module declaration
Pretreatment module:
The preprocessing part main task is to finish the establishment of traditional tape metadata generation and acquisition tasks.
The pre-service operation flow as shown in Figure 9, among the figure: 9.1 traditional tapes, 9.2 pre-service begin, 9.3 scannings, 9.4 fill out band, 9.5 have metadata, 9.6.1 grandfather tape warehouse-in, 9.6.2 bar code scan, 9.7.1 there is metadata in the CCTV, 9.7.2 data importing, 9.8 tapes are examined, 9.9 defective returning, 9.10 tape sorting, 9.11 metadata imports, 9.12 metadata import, and 9.13 tapes are got ready, 9.14 acquisition tasks is created, 9.15 the metadata after the arrangement, 9.16 datumization acquisition tasks, the traditional tape after 9.17 arrangements.
The collection of server module:
Collection of server is mainly used in finishes the automatic lot collection.Be the full automatic acquisition process flow process of hyperchannel with workstation collection difference.
The collection of server operation flow as shown in figure 10,10.1 video-tape, 10.2 acquisition tasks, 10.3 collection of server begins, 10.4 filling tape, 10.5 scanning mechanical arm tape pool extracts task, 10.6 Task Distribution, 10.7 the notice operation management server, log record/fault processing, 10.8 artificial treatment, 10.9 control mechanical arm tape pool is grabbed band and is filled into video recorder, 10.10 control of video server and video recorder are gathered automatically, 10.11 gather successfully, and 10.12 video server formatted files are finished traditional tape of collection.
Collection of server quality of service control QC flow process as shown in figure 11, the beginning of work of 11.1 video server files, 11.2QC, 11.3 task lists, the broadcast of 11.4 control of video servers, 11.5 quality audits, 11.6 heavy collection/artificial treatment, 11.7QC authentication information.
Workstation is gathered:
Workstation capturing service link is accepted the acquisition tasks that data pre-service link issues, the key distinction that it and server are uploaded is: can upload work by manually finishing data, its process need manual intervention, as loading, bar code scan, tape swapping work (collection of server is finished by mechanical arm fully), also need manually to control acquisition workstation and player in some cases.Workstation capturing service flow process as shown in figure 12, among the figure: 12.1 video recorders, 12.2 acquisition tasks, 12.3 the workstation collecting work begins, 12.4 bar code scan is loaded tape, 12.5 extraction mission bit stream, 12.6 the timely code type of open any browser creation task 12.7 tasks is judged, 12.8 single channel collection (automatic/hand), 12.9 gather successfully, 12.10 data and also, 12.11 high code stream data are finished traditional tape of collection, and the key frame time-code is extracted in 12.12 two-way collections (automatic/hand), 12.13 gather successfully, 12.14 heavily adopt/notify operation management server, log record/return pre-service, 12.15 high code stream data low code stream data key frame time-code information are finished traditional tape of collection.
Workstation capturing service quality control QC flow process as shown in figure 13, among the figure: 13.1 high code stream data, the 13.2QC beginning of working, 13.3 task lists, 13.4 materials are play, 13.5 quality audits, 13.6 heavy collection/artificial treatment, 13.7QC authentication information.
Audio collection:
Audio collection adopts the audio workstation of specialty, finishes the collection of independent audio data by professional audio software, carries out the audio editing housekeeping simultaneously, submits to the back to carry out quality audit by audio quality control QC workstation.
The audio collection operation flow as shown in figure 14,14.1 audio media, 14.2 audio collections begin, 14.3 system's setting, 14.4 gather, and 14.5 gather successfully, 14.6 editor, 14.7QC 14.8 import voice data, 14.9 create metadata, 14.10 high-quality voice data, audio frequency transcoding task, high-quality audio metadata is finished the audio media of collection.
Three. the present invention downloads and looks the Audio Processing subsystem
Download subsystem module service logic flow process as shown in figure 15, among the figure: 15.1 download management are printed the download request document, 15.2 audit and affirmation, line data is prepared 15.3 cancellation downloading task and resource, 15.4 submission download requests are gone forward side by side, and 15.5 requests confirm to be ranked the download odd numbers, 15.6 data are ready to complete, download the staff and finish download according to request, 15.7 notify the client, and 15.8 download end.
The download subsystem carries out multiple medium with media data in the data archive and duplicates or transcribe and many belts conversion work.The downloading task inquiry is retrieved for examination by each retrieval station terminal and is selected retrieval, and the download workstation obtains downloading task and makes respective handling, and the download management workstation provides perfect Mission Monitor, statistical study and data processing function.
Carrier system network architecture figure up and down:
Upload subsystem as shown in figure 16, among the figure: 16.1 mechanical arm tape pools, 16.2 upload video recorder X10,16.3 video server, 16.4 collection of server Control Server X2,16.5 video/audio matrixes, 16.6 acquisition management workstations, 16.7 collection of server QCX2,16.8 look audio collection workstation X10,16.9 audio collections/housekeeping station X2,16.10 workstations are gathered QC workstation X3,16.11 database and application server, 16.12 storage centers.
Download subsystem as shown in figure 17, among the figure: 17.1 download management workstations, 17.2 download workstation X6,17.3 database and application server, 17.4VCD/DVD imprinting workstation X3,17.5DVD video recorder, 17.6 video/audio matrix, 17.7 422 gating matrixs, 17.8 download video recorder X8,17.9 storage centers.
Four. the catalogue retrieval subsystem
Subsystem module as shown in figure 18, among the figure: 18.1 system Rs, 18.2 application server, 18.3Web server, 18.4 storage administrations, 18.5 catalogue workstation, 18.6CKM server, 18.7CKM proof-reading station, 18.8 catalogue management, 18.9 the retrieval workstation, 18.10 streaming media servers.
1. module declaration:
● DBMS: system core database server;
● Application Server: the system applies server comprises J2EE application server and Workflow workflow server;
● Web Server: page publisher server;
● the catalogue workstation: be used to realize the station client end of system's list processing, adopt the Browser mode to realize that the service logic of list processing is deployed in the application server end, the task items of each catalogue workstation is dispatched by workflow server.
● the CKM server: realize the automatic indexing work of treatment server based on semantic analysis, CKM handles and comprises the Automatic Extraction keyword, classifies automatically etc.
● CKM proof-reading station: be used for the result of automatic indexing is carried out desk checking.
● catalogue management: catalogue is carried out omnidistance management, comprise Task Distribution, process monitoring, catalogue statistical study etc.
● retrieval workstation: adopt the Browser mode to realize the data retrieval workstation of system.
● streaming media server: realize the network online browse of system's low code stream data by the broadband, and adopt the mode of Streaming Media issue.
● storage administration: realize the storage platform of cataloging syytem, comprise metadata store, key frame, Streaming Media etc.
2. catalogue Business Process Analysis:
The catalogue and the arrangement of the data that is of working greatly in the operation system of the present invention, because catalogue work is mainly carried out by hand by the catalogue personnel, when making a catalogue level more for a long time, catalogue efficient is lower.According to demand 400 hours/day data production requirement of proposition at present, the catalogue production line of a multi-node collaborative job of planning, each node of this catalogue production line can be adjusted to adapt to the catalogue needs of dissimilar programs by the operational management configuration.By catalogue operational management workstation cataloging syytem is carried out operational management and statistical study simultaneously.
Be the design of example explanation catalogue flow process below with the news category program, this catalogue flow process is just illustrated at the catalogue flow process of news category program, in actual cataloged procedure, can carry out the adjustment of flow process and link at any time, so that improve catalogue production efficiency according to the condition of production.
Scheme one: too many levels serial catalogue flow process, see Figure 19, among the figure: the index of 19.1.1 program layer, 19.1.2 program index audit, 19.1.3 fragment clauses and subclauses are set up and the slice layer index, 19.1.4 fragment index audit, 19.1.5 the camera lens clauses and subclauses are set up and the index of camera lens layer, 19.1.6 camera lens index audit, 19.1.7CKM handles, and 19.1.8CKM manually proofreads, examine 19.1.9 catalogue is total, 19.1.10 catalogue finishes, 19.2 elementary catalogue metadata informations, and 19.3 extract key frame information automatically, 19.4 low code stream video/audio, the metadata information 19.5 finally make a catalogue, 19.6 final key frame pictures, 19.7 cataloging syytem operational managements.
According to demand and meet following catalogue standard, to its column of program of news category elementary cell as the program catalogue, promptly according to program in the catalogue standard, fragment, scene, the division of camera lens, the news column is as the program layer, news item is as slice layer, and the scene index does not need, and needs index to arrive concrete news camera lens for highlight.Therefore, in above-mentioned workflow, whole cataloged procedure is divided into: the index of program layer, the audit of program layer, fragment definition and index, the fragment audit, camera lens definition and index, the camera lens audit, CKM handles, and always examines this several catalogue links.
The index of program layer:
For the news category program, its catalogue elementary cell is decided to be the news column, and for example: index programme information on this aspect of news hookup comprises: name of tv column, just to inscribe one's name, and the column phase is inferior, age, broadcast time, information responsible etc.Also comprise some technical parameters in addition, as: channel format, colour/black and white, picture the ratio of width to height, image quality, sound quality, bearer type, standard, video data code check, video sampling form, video code model, file layout etc.
The information spinner of this aspect will be gathered from pre-service, and the metadata information that front end production links such as transcoding just exist (for some technical parameters, mainly come from and gather and the transcoding link) also can be imported by hand by the catalogue personnel.
The program audit:
Need just can enter next catalogue link through audit to the metadata of finishing after the program index, groundwork one in the audit is to judge whether inventory information is correct, the 2nd, judge whether to carry out the catalogue of next level, if need then transmission task to fragment index node; CKM handles and the total audit of catalogue if do not need then directly to carry out.
Fragment definition and index:
For the news category program, fragment means each news item.The definition index of fragment comprises by browsing video/audio gets the location ready, identify an independently news footage, and to its index of making a catalogue accordingly, here mainly be based on the index of content, and the notes that do not relate to technological layer are recorded, as: just inscribeing one's name, data provides, information responsible, synopsis (mouth is broadcast original text) etc.The index of slice layer also comprises arrangement and the modification to contained key frame information in each fragment in addition.
The fragment audit:
Automatically carry out segment after the fragment index is finished and examine, similar with the program audit, except that carrying out the inventory information audit, also need to analyze and judge whether to carry out lower floor and make a catalogue, root division border situation transmission task factually arrives camera lens index link or CKM and total link of examining.
Camera lens definition and index:
For some valuable news, some camera lens wherein need carry out independent index so that later-stage utilization.The index and the segment of camera lens are similar, need get the location ready by browsing audiovisual information, and create shot record.Though it is the indexing content of camera lens is less, professional very strong.
The camera lens audit:
Automatically enter camera lens audit node after the camera lens index is finished, carry out camera lens index information check, check by after enter CKM processing links and total examining automatically.
CKM handles:
The CKM software package of TRS can be classified automatically to Chinese written historical materials, abstract extraction, and the auxiliary automatically indexing work of computing machines such as cluster, but because its Word message of video and audio material is limited, so the CKM treatment effect needs checking.In the native system scheme, adopt 1 CKM server to carry out automatic cluster and abstract extraction work, and set 2 workstations the result is verified.
Catalogue is total to be examined:
After above-mentioned task is all finished, enter the total link of examining of catalogue.Catalogue is total to be examined whole tree-shaped programme information (program, fragment, fragment, scene, camera lens) is carried out complete audit and browses, in case examine by total, then data become final catalogue metadata, otherwise return corresponding processing links.
According to top flow scheme design as can be seen, whole catalogue flow process mainly adopts too many levels work in series mode, and its great advantage is the flow process compactness, division of labor careful, and dissimilar personnel can be engaged in different catalogue work respectively.In addition, the infiltration of audit link is set up successive check in the catalogue flow process.
Scheme two: too many levels serial parallel catalogue flow process, see Figure 20, among the figure: the material record of 20.1 all uncatalogs, 20.2 program predeterminations justice and look audio parsing, 20.3 program layer catalogue, 20.4 slice layer definition and first catalogue, 20.5 camera lens layers catalogue, 20.6 slice layer depth indexings and key frame audit, 20.7 camera lens layer depth index, 20.8CKM handle, 20.9 catalogues are total to be examined, 20.10 final catalogue metadata.
By this process design plan as can be seen, at the program in the scheme one, fragment, the catalogue of three aspects of camera lens adopts parallel mode to carry out, and can improve catalogue efficient greatly like this.In the catalogue of certain aspect, the work in series mode that can adopt many people to coordinate to make a catalogue too.
In sum: the design of catalogue flow process must be carried out dynamic-configuration by workflow management, adjusts flexibly and assembly according to different program categories and catalogue requirements of one's work.80 catalogue workstations have been disposed in the system schema and 10 catalogue examination stations need form the catalogue production line of the complete science efficiently of a cover through the configuration of workflow management.
3. searching system
System is provided with the retrieval that 20 searching terminals are used to the data that realizes, the user can inquire about at searching terminal, browses, and submits corresponding request of data to.Searching terminal adopts the working method of browser.The searching, managing workstation mainly is to the operational management of searching system and analysis, and comprises that the retrieval download request that the user is submitted to examines and check.
Retrieval, the integrated service flow process that download and audiovisual are examined as shown in figure 21, among the figure: 21.1 submit retrieval request to, 21.2 according to asking organize results and returning retrieval of content, 21.3 result for retrieval is browsed the submission request of data, 21.4 request of data type, 21.5 download management is printed the download request document, examine resource 21.6 be ranked automatically and return and examine the reservation result, 21.7 the user confirms (paying the fees), examine the request document 21.8 examine managing printing, line data is prepared 21.9 the submission download request is gone forward side by side, 21.10 without affirmation, cancellation downloading task and resource, 21.11 cancellation is examined reserve resource and is ranked, 21.12 (paying the fees) confirmed in request, 21.13 request confirms to fix side by side a year odd numbers, examine resource 21.14 be ranked and comprise the room, time etc. also provide and examine odd numbers, 21.15 data are ready to complete, download the staff and finish download according to request, 21.16 cancellation is examined request release and is examined resource, notify the user 21.17 surpass scheduled start tine 21.18,21.19 users input is examined odd numbers and is accessed and examines resource and begin to examine, and 21.20 can submit to data to download application according to the situation of examining, 21.21 cancellation is examined request release and is examined resource, 21.22 surpass scheduled closing time, 21.23 examine end, 21.24 download end, 21.25 low code stream video/audio, 21.26 the key frame pictorial information, 21.27 final catalogue metadata, 21.28 download the medium of finishing, 21.29 classical signal output, 21.30 retrievals are downloaded and operational management is examined in audiovisual.
4. long-range issue
Long-range issue structural representation is referring to Figure 22, among the figure: 22.1 externally issues, 22.1.1 external user, 22.1.2 outer net fire wall, 22.1.3 long-range issue application server (master), the long-range issue application server of 22.1.4 (being equipped with), system in 22.2 shops, 22.2.1 shop inner core application server (master), 22.2.2 data archive data message.
5. the explanation of long-range issue structure
Long-range issue is the interface that data archive system external (wide area network) carries out the issue of video-audio program data information, considers security of system and data security, and externally issue and internal issue are isolated by remote releasing system.
1: the application server that long-range issue is adopted obtains corresponding program metadata information by the search engine of calling data archive internal core application server deployment;
2: long-range issue has own independent database and buffer storage, is used to store program fragment and key frame information content distributed and that part is used to issue;
3: delivery system can enter the retrieval and inquisition system of data archive by the mode that is redirected, and retrieves by the search engine of data archive inside, but must be by the authentification of user of data archive inside.
Five. subsystem is examined in audiovisual
Audiovisual is examined shown in operation flow Figure 23, among the figure: retrieval is examined in 23.1 audiovisual, examine resource 23.2 be ranked automatically and return and examine the reservation result, 23.3 examine managing printing examines the request document, and 23.4 cancellations are examined reserve resource and are ranked, 23.5 audit and affirmation, examine resource 23.6 be ranked and comprise the room, the time etc. also provide and examine odd numbers, and 23.7 cancellations are examined request and discharged and examine resource, 27.8 surpass the schedule time, 23.9 users input is examined odd numbers and is accessed and examines resource and begin to examine.
1. process description
Audiovisual examines that subsystem both can be used as that inside information is reviewed music programme before public showing, data check, source investigation and view and emulate use, also can externally carry out the authorization service of above content.The computer inquery terminal that data check is retrieved for examination by each audiovisual studio is selected to access, and audiovisual is examined management work station and provided perfect Mission Monitor, statistical study and charging means.
The user obtains desired data information by the retrieval workstation to existing data retrieval, makes reserve requests;
Audiovisual is examined management work station to the go out on missions rationality examination of all precontract tasks, critical-path analysis, and make the user at last according to task significance and priority and examine the task arrangement, send the media data that needs are examined migrates to the online memory bank in center from the nearline storage body task requests to storage center.Finally send the feedback information of it being examined precontract task to the client;
The user examines business in the time of task arrangement information appointment to the enterprising line data of workstation of examining of appointment after obtaining to examine the task confirmation;
Audiovisual is examined management work station and is monitored examining task, the statistics of chargeing; Having finished of task is made statistical study.
2. audiovisual is examined network structure as shown in figure 24, and among the figure: 24.1 have the card audiovisual to examine workstation X5, and 24.2 no cassettes are listened and examined workstation X10, and management work station is examined in 24.3 audiovisual, 24.4 databases and application server, 24.5 storage centers.
Six. the transcoding subsystem:
The collection of server operation flow as shown in figure 25, among the figure: 25.1 video server files, 25.2 transmission work begins, 25.3 the task of obtaining, 25.4 file transfer demultiplexing transcoding key frame time-code extracts, 25.5 heavy collection/artificial treatment, 25.6 successes, 25.7 high code stream data low code stream data key frame time-code information word data messages.
Remote data transmission as shown in figure 26, among the figure: 26.1 Broadcast Control data, 26.2 transmission work begin, 26.3 the task of obtaining, 26.4 carry out metadata according to program code imports the audit of 26.5 metadata, 26.6 file transfer, 26.7 successes, 26.8 high code stream data metadata information.
The transcoding service as shown in figure 27, among the figure: 27.1 select input file, 27.2 the high code stream video/audio goes to low code stream video/audio key frame time-code and extracts, 27.3 high code stream independent audio data go to low code stream independent audio data, 27.4 the high code stream video/audio goes to high code stream video encoding file, 27.5 success, 27.6 notice operation management server, log record/fault processing, 27.7 success, 27.8 notice operation management server, log record/fault processing, 27.9 successes, 27.10 low code stream video/audio metadata information key frames are looked a yard information, 27.11 low code stream independent audio data metadata information, 27.12 high code streams are looked audio tones frequency sign indicating number file metadata information.
Key-frame extraction as shown in figure 28, among the figure: 28.1 take out the frame mission bit stream, 28.2 key frame time-code information, 28.3 low code stream video/audios, 28.4 take out frame work begins, 28.5 extract key frames, 28.6 key frames.
The operation flow explanation:
Transcoding transmission and the main task of taking out the frame link are:
Metadata imports the tape scanning acquisition tape ID that go into library management of software module from storehouse, and arrives the respective meta-data of the corresponding tape ID of retrieval in CCTV's data automatically, if metadata exists then imports the data archive database automatically; If metadata does not exist then do not deal with, gather the typing work that link is finished basic metadata by pre-service or workstation;
File transfer/transcoding server takes out the file that has obtained the QC authentication in the video server, and transmission is done simultaneously and looked the audio frequency demultiplexing, generates 25M IBP high code stream ODML formatted file, the online memory bank in the center that deposits in; The low code stream transcoding generates Windows Media 300Kbps retrieval code stream format, deposits NAS in; Extract the key frame time-code, deposit database in;
Finish of the conversion of OPEN DML form, support that form comprises: SONY, PROFILE video server form etc. to the video server file layout;
The broadcast items storehouse sends transfer request message to data bank, Ftp server receive the request back according to the program code in the request to the station synchronization library inquiry and extract corresponding metadata information.Metadata is confirmed through the acquisition management personnel in the acquisition management workstation after importing and finishing, generate Broadcast Control program transmission task, and carry out the transmission of broadcast items data by Ftp server, and program data is stored on the spider battle array, corresponding transcoding task created simultaneously;
Transcoding server can generate WindowsMedia 300Kbps retrieval code stream format with storage code stream (mainly being the audio file formats of looking of workstation identification), finishes the work of extracting the key frame time-code simultaneously, uses for subsequent handling;
Transcoding server is supported the conversion between the multiple coded format, can in the data bank, in the TV station and the outer application demand of platform exchanges data is provided.
Transcoding server can support wide area network data is browsed the transcoding request of retrieval, realizes the very transcoding support of low code stream is comprised WMV, forms such as Real.
Transcoding server carries out the key frame analysis in carrying out the low code stream transcoding process, obtain all key frame time-code information, and be stored in the database.
Taking out the frame server data that all productions are finished to system carries out low code stream and takes out frame, carry out key-frame extraction according to low code stream data that generate in transcoding process or the gatherer process and key frame time-code information, and, be kept in the file system with file mode by JPG compression generation key frame image data.
Transcoding server, file transfer/transcoding server, Broadcast Control data transfer server and take out the frame server and all adopt no interface background program mode of operation, automatically after database obtains corresponding task, carrying out transcoding and taking out frame work, with associated metadata, height code rate data and key frame pictorial information are sent to respectively in database and the central store body at last.Wherein transcoding server and file transfer/transcoding server working load is higher, and system configuration is close, and work role is interchangeable, and the portfolio that managerial personnel are taken place according to reality is adjusted flexibly and arranged.
Transcoding management and monitoring workstation carries out transcoding, file transfer/transcoding, Broadcast Control data transmission/metadata importing and takes out work such as monitoring, the false alarm of frame task, the demonstration of task completion status, statistical study, log management.
Transcoding central site network structure as shown in figure 29, among the figure: 29.1 transcoding servers, 29.2 video server transmission server, 29.3 take out the frame server, 29.4 Broadcast Control data transfer server (contain metadata and import module), 29.5 transcoding monitoring management workstation, 29.6 databases and application server, 29.7 storage centers.
Seven. the middleware subsystem:
1. workflow server
Data bank operation system node is numerous, complex process.Comprise the management and the scheduling of flow process between each service sub-system, each subsystem inside also comprises the management and the scheduling of flow process.Consider in this programme to adopt unified flow process control and management middleware to be responsible for the unified Workflow Management platform of system, its function comprises:
The Workflow Management platform is responsible in the data bank project from linking and coordination between several big business modules such as pre-service, acquisition process, transcoding service, list processing, retrieval issue, media article download and is unified control, simultaneously also the operation flow of single module is carried out the control and the management of flow process, as the workflow management of list processing inside modules.
Because data bank project operation flow complexity, and on some independent link such as list processing link, actual workflow may constantly be summed up in the data production run and be perfect, therefore, workflow must be able to dispose and change flexibly, produces needs to satisfy user's data.On the basis of this principle, the mode of Workflow Management middleware has been adopted in design in the scheme, with the management and the actual client software logical out of operation flow, to realize the demand of user flexibility configuration effort flow process.
2. workflow platform job description
The Workflow Management middleware is installed in the unix server, and the logical data of workflow management service and storage system workflow is provided.In system, must include the client of the existing employing of the node BS structure of Workflow Management in, the client software that adopts the CS structure is also arranged.
For the application of B/S structure, its concrete workflow is:
1.B/S the client of using is by browser access Web Server;
2. browser calls Java.Component on the JAVA Application Server (for example JSP) earlier by Web Server;
3.Java Component (for example JSP) calls the API of Workflow, visit Workflow startup of server operation flow;
Carry out professional 4.Workflow server generates orchestration instance;
5. in the process of orchestration instance operation,
A) call the processing that application program (the Java Component on the JAVA Application Server) in the corresponding link is finished robotization;
B) or according to the definition of procedure links, the business processing request is issued a certain system user by the Java Component (for example JSP) that issues on the JAVA Application Server, realize artificial treatment: after system user is received the service request that requires to handle by browser, it can appear in user's the task list, the user has selected a certain task, calls Java Component on the JAVA Application Server (for example JSP) earlier by Web Server again and comes complete artificial treatment; Flow process is proceeded;
6.Workflow the state of server Stored Procedure operation in the process of orchestration instance operation is recorded into relational database;
7. behind the flow instance end of run, withdraw from automatically;
For the application of C/S structure, its concrete workflow is:
1.C/S the client of using is by Workflow client-access Workflow startup of server operation flow;
Carry out professional 2.Workflow server generates orchestration instance;
3. in the process of orchestration instance operation,
A) call the processing that application program in the corresponding link is finished robotization;
B) or according to the definition of procedure links, the business processing request by issuing a certain system user, is realized artificial treatment;
After system user was received the service request that requires to handle, it can appear in user's the task list, and the user has selected a certain task, called the client corresponding program by Workflow again and came complete artificial treatment; Flow process is proceeded;
4.Workflow the state of server Stored Procedure operation in the process of orchestration instance operation is recorded into relational database;
Behind the flow instance end of run, withdraw from automatically;
3.AVA application server
The JAVA application server mainly is responsible for the activity request that treatments B rowser client is sent by Web Server, upgrade as data, inquire about etc., and carry out data access and corresponding data processing, simultaneously the result is returned to client by WebServer according to request.The JAVA application server must be supported the J2EE System Framework.Popular in the market JAVA application server software has the Websphere software of IBM Corporation and the Weblogic software of BEA company.
The application server system scenario-frame as shown in figure 30, among the figure: 30.1 common customer terminals, 30.1.1 workflow clients, 30.1.2 client application, 30.2 browsing clients, 30.3 load-equalizing switch, 30.4 fire wall, 30.5 servers 1,30.5.1Web server, 30.5.2 plug-in unit, 30.6. server 2,30.6.1Web server, 30.6.2 plug-in unit, 30.7 server 3 (production machine), 30.7.1 workflow engine, 30.7.2 application server, 30.8 servers 4 (backup machine), 30.8.1 workflow engine, 30.8.2 application server, 30.9 servers 5,30.9.1 database, 30.10 server 6, the 30.10.1 database.
The mid-tier system network as shown in figure 31, among the figure: 31.1 outer nets, retrieval in the 31.1.1 platform, 31.1.2 retrieval X20 in the pipe, 31.2 demilitarized zones, 31.2.1 fire wall, 31.2.2 load balancing, 31.2.3 load balancing, 31.2.4Web server, 31.2.5Web server, 31.2.6 streaming media server, 31.2.7 streaming media server, 31.3 Intranet server areas, 31.3.1NAS31.3.2 application server X2,31.3.3 database server X2,31.3.4TRS server X2,31.3.5TRS gateway machine, 31.3.6 fire wall, the X80 31.4 Intranet transaction area, 31.4.1 are made a catalogue, 31.4.2CKM server X2,31.4.3 the catalogue statistical management, 31.4.4CKM verification X4.
Retrieval, WEB server and streaming media server are positioned at the demilitarized zone, and by at WEB server and streaming media server the isolation that two network interface cards are realized physics being installed, the Core server in the protection military area is avoided external attack.
Because the catalogue workstation need carry out the immediate data visit to the low code stream data of storing among the NAS, but also to limit of the direct visit of the node of catalogue link, consider to implement to limit its visit resources such as military area inner core servers by security mechanisms such as IP filtrations to Core servers such as databases.
5. system backup
NAS NDMP backs up shown in figure 32, among the figure: 32.1 databases, 31.2 databases, 32.3TRS server, 32.4TRS server, 32.5 application servers, 32.6 application servers, 32.7NAS, 32.8 backup servers, 32.9 disks, 32.10 backup tape pools.
The LAN Free of NAS gateway backs up as shown in figure 33, among the figure: 33.1 databases, 33.2 databases, 33.3TRS server, 33.4TRS server, 33.5 application servers, 33.6 application servers, 33.7NAS300 C, 33.8 backup server, 33.9 disks, 33.10 backup tape pools.
6. system's operational management:
System's operational management comprises the management of overall system, statistics, analyze and operational monitoring, because in large scale, service sub-system is more, therefore the operational management module is arranged separately in each service sub-system, as the acquisition management workstation, the catalogue management work station, retrieval and audiovisual are examined management work station, storage administration workstation etc.Remove and in each subsystem, set up separately outside the operational management workstation, the operation of overall system, management, monitoring and statistical study also need the setting system operational management.
The operational management module as shown in figure 34, among the figure: 34.1 management subsystem, 34.1.1 gather the operational management node, 34.1.2 transcoding operational management node, 34.1.3 retrieval operational management node, 34.1.5 storage running management node CS), 34.1.6 the store management node, 34.2 middlewares and database, 34.2.1 application server+database, 34.3 the overall operation management, the operational management of 34.3.1 overall system.
The overall system operational management only is the service operation management work station that is provided with according to the system service management situation, and software adopts the B/S structure, by the application server access data, carries out the statistics of overall traffic, analyzes, and inquiry waits operational management work.
The overall operation management is with the key distinction of subsystem operational management workstation:
● the overall operation management work station only makes the statistics of data, analyzes, and gathers and running state monitoring, can not intervene or disposes the concrete business of each service sub-system.
● the overall operation management work station can inter-subsystemly carry out data access, and to overall business data processing situation Macro or mass analysis.
Overall system operational management workstation can set according to actual user's needs, as the senior management staff, and guardian technique responsible official etc., and dissimilar personnel are carried out data access limit.
System network architecture as shown in figure 35.
Advantageous characteristic of the present invention:
OO LAN Free memory technology
For the digital media asset management system, the storage of media data is a very important sport technique segment. This System adopts dual code stream technology medium data file in design. Adopt the OO classification storage of independent development Management software (DYStorage) is realized the migration of large object data based on the mode of LAN Free, and take object as the unit, Be convenient to the recycling of data. Its main feature is as follows:
1. distributed frame
DYStorage stores archive software adopts the distributed architecture of server+many transference apparatus, and transference apparatus is structured in Under the SAN environment, and can expand arbitrarily as required, the network structure of whole storage management software adopts FC+LAN Two web frames.
2. the data recording on tape storage format of opening
DYStorage supports two kinds of data file filing storage formats, own form DYTF and MTF reference format. DYTF Form comparatively speaking its efficient is higher, and form is underground; MTF is the streaming tape data memory format that Microsoft publishes, Form is open, and the user can support the software of MTF to read and write data by any one.
3. two-stage API development interface
DYStorage provides the interface of two-stage API and other system, and the one, memory scheduling API provides standard C ++ connects The mouth plug-in unit. Another level is that system provides streaming tape read-write API, and the user can be by this API self-developing to data flow The maintenance of magnetic tape file and the exploitation of other associative operations.
4. excellent disaster tolerance performance
Because the design of system adopts distributed frame and task transmission to support issued transaction, therefore comes for storage system Say that the damage of arbitrary node all can not cause catastrophic results in the course of work.
5. the parallel processing of tape group and store tasks
For the processing of the big object of big capacity, system supports the pattern that a plurality of tasks in parallel are processed, and namely working as certain tape group needs When storing several tasks, system can according to circumstances distribute different drivers, and (on the same group) simultaneously on several tapes File.
6. support the segmentation readjustment of video/audio
By create frame index and second index in archiving process, system can support the segmentation readjustment of Large Volume Data, i.e. root According to request enter a little and length is cut big file automatically, and generate a new data file.
The segmentation readjustment is very useful for the big obj ect file that is similar to video/audio, and the data of general storage or material be phase all To bigger, 1 hour material also needs the memory capacity of 12GB nearly, and actual reporter may be only when using material Use 10 seconds wherein, namely less than the file of 40MB. If there is not the segmentation readjustment, then must be with whole file readjustment Use to hard disk, not only take the on-line storage capacity, also take in a large number data readjustment bandwidth and tape drive equipment. By the segmentation callback function, can look one section useful data of only adjusting back in the audio file wherein at one, like this, just Can save in a large number bandwidth and on-line storage resource.
7. flexible configurable tactical management
The user can set various classification storage policies according to oneself storage and backup requirements, such as artificial appointment, according to content Or according to access times etc., the management of on-line storage then can be carried out strategy by the memory capacity waterline and trigger, and is full-automatic The memory scheduling of finishing the online of data and carrying out.
8. open
DYStorage software all adopts the equipment control model based on standard SCSI agreement, can support in the market All streamer tape devices that meets the FC consensus standard, the nearline storage equipment such as tape library and DVD CD player. In addition, General database mode is adopted in the design of software, therefore can support the database software of main flow, such as SQL Server, DB2, Oracle etc.
Based on the workflow integration of business processes
The present invention totally is divided into up and down carrier system, the transcoding center, and the classification storage subsystem, system is examined in audiovisual, the catalogue inspection Cable system, long distance service system, a plurality of service sub-systems such as treasury management system, the data transmission between the subsystems Exchange and miscellaneous service flow process are comparatively flexible and changeable. Therefore in system, by adopting the workflow engine middleware Realize the integration of data bank core business process.
Workflow engine be responsible in the data archive system from preliminary treatment, acquisition process, transcoding service, list processing (LISP), retrieval issue, Data is downloaded, and audiovisual linking and the coordination between several big business modules such as is examined and unified control, and the while is also to single The operation flow of module is carried out the control and management of flow process, such as the workflow management of list processing (LISP) inside modules. Because the present invention The operation flow complexity, and on some independent link such as list processing (LISP) link, actual workflow may counted According to constantly summary and perfect in the production process, therefore, workflow must be able to dispose and change flexibly, uses to satisfy The data need of production at family. We have adopted the mode of Workflow Management middleware, with the management of operation flow with actual The client software logical out is to realize the demand of user flexibility configuration effort flow process.
By adopting workflow middleware, system is at reliability and stability, flexibility, and the aspects such as extensibility improve greatly, and it is mainly manifested in the following aspects:
1. the operation flow of flexibility and changeability
By adopting workflow engine and carrying out the design of process-based model for system, the system that can realize flexibly can The operation flow that becomes. After operation flow changes for some reason, by adopting the integration of workflow engine, be System can be realized the change of software is controlled in the littler scope.
2. realize normalized operation management
By setting up Work flow model, introduce workflow engine and realize that each operation flow is conducive to the prison of service operation state Control, and can adjust post and task according to actual conditions. Be conducive to simultaneously personal management, and for the process flow operation data Statistics can be used for aid decision. Good service management means are conducive to improve the program quality of production.
3. cross-system is interconnected
By adopting the workflow engine middleware, can realize the loose couplings of system, and be easy to expansion and cross-system interconnected.
4. raising system reliability
By adopting the ripe operation system of workflow middleware foundation take procedural model as core, have great advantage in the security of system reliability:
● the loose couplings of systems soft ware is so that software interface is relatively simple, and complicated service logic is drawn by the workflow of maturation Hold up and serve as, improve the reliability of system;
● adopt cross-platform software middleware, in security, the reliability aspect has certain advantage;
The change of operation flow and model can not cause system to revise on a large scale, has improved to a certain extent the steady of system yet Qualitative;
Distributed transcoding platform
The core of system of the present invention is for the long preservation of video and audio material and management, at present various audio standard and the codings looked Form is very many, and common form comprises: MPEG2 I frame, MPEG2 IBP, DV, DVSD, MPEG1, MPEG4, Motion JPEG, PS stream, ES stream, TS stream, D10 also comprises various low bit rate stream media formats, such as REAL, WMV, ASF, Quick Time and multiple audio format are such as WAV, MP2, MP3, MPEG-AAC, RMA, WMA etc.
Transcoding server operation daemon software can be realized various video form type code stream translation, and the various audio formats of looking can be mutual Turn to, and can finish the work of Automatic Extraction key frame. Transcoding mode is supported while uploading transcoding (video server), is propped up Hold file fragmentation and merge transcoding. System adopts server cluster technique construction transcoding center, and many transcoding servers are passable The a plurality of transcoding tasks of parallel processing and single transcoding task.
System of the present invention adopts the mode at distributed trans-coding center, realizes that the cluster of transcoding task is processed, and carries out automatic distribution and the load balancing of transcoding task by the transcoding dispatch server, and its characteristics are mainly reflected in:
1. distributed frame is expanded easily
Transcoding platform of the present invention adopts the running background mode, carries out task scheduling by workflow engine, and adopts distributed The All Files format conversion of the mode completion system of cluster, the task that coded format conversion and key frame analysis are extracted. Structure opening, interface definition is simple, can very easily realize the expansion of transcoding scale.
2. various standards are looked audio format turns to mutually
Support that all existing standards are looked audio format at present, also comprise form such as MXF lattice that some are developing and are studying Formula, AAF form etc. Whole transcoding software adopts modularity in design, in case support a kind of format, only need to increase Add a plug-in unit and can realize system upgrade.
3. key frame extracts automatically
Software has also realized looking the automatic analysis of audio frequency transition frames except realizing arbitrarily code/decode format and file format conversion And extraction, support shear frames, fast moving frame, the automatic extraction of gradual change and the transition picture by various stunts realizations. Key-frame extraction efficient be 6~8 times in real time.
Full-automatic video and audio material collection
Project of the present invention is because it is in large scale, therefore in design, adopt analog mechanical hand time tape pool realize programme acquisition from Moving filling band adopts video server to realize parallel the uploading of automation of multi-channel program (present 6 tunnel), and passes through file Transmission server uploads to the program of gathering the central store district of system automatically.
Whole full-automatic capturing service also is to dispatch by workflow engine, the biography that the collector only need finish preliminary treatment The system video-tape is put into analog mechanical hand strap storehouse, can realize full-automatic collection.
Three layers of software architecture
The needed software of the miscellaneous service of system of the present invention has their own characteristics each, and the retrieval software of using based on wide area network is arranged, and has strong Transfer the hierarchical storage management software of efficient and stability, also have need the integrated circuit board support look audio collection/download output software. For guaranteeing the security of system reliability, system has carried out different frameworks with data center with client software in design and has established Meter.
All client softwares of system comprise: workstation collection, download output, catalogue, retrieval, preliminary treatment, storehouse pipe Reason, audiovisual is examined, and the three-layer architecture based on BS is all adopted in operational management, flow monitoring etc., and adopts Struts WEB application framework technology realizes, meets the J2EE standard.
The foundation of Content Management Platform
Because the video and audio material content of data bank storage is very abundant, the programme content of warehouse-in comprises news program, the variety joint Order, sports cast, the polytypes such as the acute program of film and television, the program of multiple subject matter. Therefore for data storage management , the core missions of Content Management Platform are the various unstructured data objects (medium class object) with system storage By the description generating structured data of index class object, and realize unstructured data pair by the structural data object Effective management of elephant.
The project organization of Content Management Platform of the present invention is flexibly reasonable, is mainly reflected in the following aspects:
1. flexible structure is powerful
Because structure and the emphasis of its metadata description of program material of the different classification of data bank data on file are all different, because of This requires very flexible to the metadata structure in the Content Management Platform. Content Management Platform of the present invention is with its powerful merit Can be fully competent. The user can carry out online flexibly configuration by various tool, and deploy content comprises:
● the catalogue metadata structure of various program material;
● support arbitrarily a plurality of independently metadata structures;
● the metadata structure according to data on file generates corresponding catalogue operation interface automatically, or by a graphic interface Interface configurations is carried out in configuration tool; Realize multinode serialization Catalog operation etc. in conjunction with workflow engine.
2. meet and look audio frequency standards of cataloguing and relevant criterion
By the present international audiovisual metadata standard SMPTE of catalogue metadata structure support of configuration tool configuration, simultaneously Also support the video-audio program Reference materials cataloging standard of domestic new promulgation. By program, fragment, scene, camera lens many levels Three-dimensional tree carries out omnibearing description to program material. In addition, software is also supported the cutting of standard, and the user can Needs according to oneself dispose corresponding metadata structure, and need not indiscriminately imitate huge standard definition fully.
3. efficient search engine is provided
Content Management Platform except the metadata store management is provided flexibly, also individual packages one externally the retrieval issue draw Hold up, this engine adopts the JAVA technology to realize, and supports prominent domestic global search technology TRS. Retrieval mode is flexible Powerful, support full-text search, the parameter retrieval, the column retrieval, the responsibility retrieval, the multiple retrieval mode such as systematic searching, and Can at any time expand by corresponding interface. In addition, can also support the correlation retrieval by full-text search engine, Synonym retrieval etc. Result for retrieval can directly show on the one hand, also can carry out first number by meeting standard x ML file According to exchange.
The Streaming Media issue
System of the present invention adopts the dual code stream technology to realize real-time high code stream collection and low code when the video-audio program data collection The collection of stream Streaming Media. The Streaming Media collection generates the files in stream media of the 300Kbps of Windows Media form. By stream Media server is issued. The user can directly carry out by the broadband online browse of Streaming Media.
Streaming media server adopts the power PC server, and software adopts the Windows Media Server of Microsoft, every Configuration dual gigabit ethernet streaming media server satisfies the bandwidth needs. Disposing two gigabit ethernet cards can be effectively with input Output channel separately promotes the IO performance of streaming media server. Realize adopting the inspection under the load-balancing technique guarantee high capacity Without hesitation can: streaming media server is symmetrical working method, and every station server all possesses status of equal value, can be separately right Service is provided outward and need not other servers auxiliary. Realize the stream matchmaker by the load-equalizing switch based on the fourth layer The body server load balancing can increase or reduce the node in trooping so easily, has not only improved the performance of system, Also simultaneously safeguards system safety and system scalability.
SAN and NAS merge
Because the low code check video/audio code check of system is 300Kbps, and is very low to bandwidth requirement, uses Ethernet to be enough to satisfy Transmission requirement. Simultaneously, low code rate data storage capacity requirement is very big, and first phase requires 12.9TB, also can as required later on Carry out capacity extension. Adopted the comprehensive storage solution of SAN+NAS according to this characteristics of demand.
The writing and file by the FC network and realize, the displaying live view of low code rate data (comprising key frame) of low code rate data Realize at Ethernet that by the NAS gateway these file sizes are all little, but number of files finally can reach several ten million, Should be used as performance optimization by NAS equipment to this class small documents read-write. So not only satisfied mass data readwrite performance but also Reduced system cost.
Unified system user authentication
Data archive system business complexity, system is huge. Existing being closely connected between each service sub-system also has by work Stream carries out loose couplings. In the native system design, adopted the unifying user authentication mechanism based on the application server intermediate layer, Can guarantee the systematic unity authentication, the way to manage of Decentralized Delegation. The advantage of major embodiment comprises:
● login system of user does not need repeat logon during handover operation;
● administering and maintaining of unification user information, improve security of system;
● each operation system Decentralized Delegation, can not cause authorization conflict each other.

Claims (2)

1. an asset management system of broadcasters is characterized in that: mainly be made of arrangement acquisition subsystem, content disposal subsystem, data multiplex subsystem and supporting with it software architecture;
Dispose in the described arrangement acquisition subsystem and comprise: the data pre-service, look audio workstation collection, audio collection processing, full-automatic video collection of server, acquisition tasks management, several parts of remote data transmission;
The arrangement acquisition subsystem passes through arrangement with simulation audio and video files such as traditional video media, audio media, video/audio signals, digital coding, remote data transmission, pre-catalogues etc. are handled and are generated many bit stream datas media article, and this data medium data and corresponding metadata information are sent to content disposal subsystem;
Configuration comprises in the described content disposal subsystem: list processing, retrieval issue,, workflow schedule,, application server middleware, core database service (DBMS), full-text search engine, transcoding center, graded memory management system, store management, workflow management and catalogue application management;
Content disposal subsystem is that the core business of system is handled support platform, mission critical is by the non-structured audio frequency media data of looking is set up structurized catalogue metadata information, and employing workflow management, multiple means such as classification storage are effectively stored the data medium data that system generates and are managed, so that the utilization again of data;
Dispose in the described data multiplex subsystem and comprise: audiovisual is examined, workstation is downloaded, DVD imprinting, remote data transmission, and Streaming Media is issued several parts; The data medium data that the data multiplex subsystem stores the content disposal subsystem inediting is handled externally output through data multiplex and is generated reproducible, exchange, the audio and video files of examining, browsing;
Full-automatic video collection of server and remote data transmission in the described arrangement acquisition subsystem, all be to realize transmission of media data by the transcoding center service that Content Management Platform provides, tasks such as storage and coded format conversion, and its associated metadata information also enters the content management database of core simultaneously;
Described software architecture adopts the three-layer architecture based on client software (application layer), Content Management Platform (middle layer), database (data Layer), and client can adopt the B/S pattern, also can be C/S model.
2. broadcasters' assets control method, it is characterized in that: use the arrangement acquisition subsystem traditional audio media of looking, simulation audio and video files such as signal carry out acquisition process, and generate the digital media data of multiple code stream and multiple form by digital coding, and by the related media data is made a catalogue, the classification storage, effective means such as transcoding make these digitized unstructured datas effectively include Content Management Platform in and effectively manage by setting up structured index, become corresponding medium by the output of means such as issue, data or signal are used for exchange and utilize.In case these non-structured media datas enter Content Management Platform, generated relevant data message by system, then these data just become the media asset of effective management;
Use the data multiplex subsystem that described media asset is carried out data recycle and handle, externally output generates reproducible, exchange, the audio and video files of examining, browsing.
CNB2004100836626A 2004-10-15 2004-10-15 The asset management system of broadcasters and regulate and control method thereof Expired - Fee Related CN100552709C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2004100836626A CN100552709C (en) 2004-10-15 2004-10-15 The asset management system of broadcasters and regulate and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2004100836626A CN100552709C (en) 2004-10-15 2004-10-15 The asset management system of broadcasters and regulate and control method thereof

Publications (2)

Publication Number Publication Date
CN1760900A true CN1760900A (en) 2006-04-19
CN100552709C CN100552709C (en) 2009-10-21

Family

ID=36706963

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2004100836626A Expired - Fee Related CN100552709C (en) 2004-10-15 2004-10-15 The asset management system of broadcasters and regulate and control method thereof

Country Status (1)

Country Link
CN (1) CN100552709C (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075696A (en) * 2011-01-07 2011-05-25 卢泳 Signal acquisition, transmission, signal editing and integration, broadcasting and viewing method and system
CN102164229A (en) * 2010-02-24 2011-08-24 北大方正集团有限公司 Link task processing method and device
CN102368802A (en) * 2011-08-17 2012-03-07 丁文华 Television station production system and method thereof for realizing construction and operation
CN101707543B (en) * 2009-11-30 2012-03-28 北京中科大洋科技发展股份有限公司 Enterprise media bus system supporting multi-task type and enterprise media bus method supporting multi-task type
CN102681883A (en) * 2011-03-17 2012-09-19 新奥特(北京)视频技术有限公司 Resource calling method and system in media asset searching and browsing system
CN102750299A (en) * 2011-11-30 2012-10-24 新奥特(北京)视频技术有限公司 Method for converging information on internet
CN102769730A (en) * 2012-04-27 2012-11-07 新奥特(北京)视频技术有限公司 Off-line cataloging method for broadcast and television audio-visual materials
CN102035999B (en) * 2009-09-25 2012-12-26 北大方正集团有限公司 Control method, devices and system for uploading video and audio signals
CN101754056B (en) * 2008-12-17 2013-01-02 中国科学院自动化研究所 Digital content inventory management system supporting automatic mass data processing and the method thereof
CN102929566A (en) * 2012-10-24 2013-02-13 中国资源卫星应用中心 Multilevel self-adaptive storage method
CN103108029A (en) * 2012-12-13 2013-05-15 中国科学院深圳先进技术研究院 Data access method of video-on-demand (vod) system
CN103458278A (en) * 2013-09-17 2013-12-18 上海美琦浦悦通讯科技有限公司 System and method for achieving copyright control on basis of audio and video file deep processing
CN103686228A (en) * 2013-09-18 2014-03-26 南信大影像技术工程(苏州)有限公司 A network terminal publishing system oriented towards public services
CN106649867A (en) * 2016-12-30 2017-05-10 北京亚控科技发展有限公司 Object data organization method
CN102750598B (en) * 2011-09-23 2017-09-19 新奥特(北京)视频技术有限公司 It is a kind of to realize the categorization and system inherited between Multi-workflow
CN107276985A (en) * 2017-05-16 2017-10-20 德基网络科技南京有限公司 One kind is based on e-commerce platform Online Video management method
CN107948165A (en) * 2017-11-29 2018-04-20 成都东方盛行电子有限责任公司 A kind of safety based on proprietary protocol send broadcast system and method
CN111221870A (en) * 2019-10-17 2020-06-02 北京农信通科技有限责任公司 Management platform and method for rural collective property right reform
CN111353048A (en) * 2020-01-08 2020-06-30 浙江省新华书店集团信息技术有限公司 Cataloguing system
CN111459940A (en) * 2020-04-02 2020-07-28 中电工业互联网有限公司 Efficient and reliable data integration method
CN112511613A (en) * 2020-11-19 2021-03-16 深圳市风云实业有限公司 Cross-domain transmission system and method based on content analysis
CN112768046A (en) * 2021-01-27 2021-05-07 深圳市智莱科技股份有限公司 Data processing method, medical management system and terminal
CN115665108A (en) * 2022-10-20 2023-01-31 深圳市全景网络有限公司 Full-media content production data management platform applied to financial system
CN111221870B (en) * 2019-10-17 2024-05-31 北京农信通科技有限责任公司 Management platform and method for rural collective title reform

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101754056B (en) * 2008-12-17 2013-01-02 中国科学院自动化研究所 Digital content inventory management system supporting automatic mass data processing and the method thereof
CN102035999B (en) * 2009-09-25 2012-12-26 北大方正集团有限公司 Control method, devices and system for uploading video and audio signals
CN101707543B (en) * 2009-11-30 2012-03-28 北京中科大洋科技发展股份有限公司 Enterprise media bus system supporting multi-task type and enterprise media bus method supporting multi-task type
CN102164229A (en) * 2010-02-24 2011-08-24 北大方正集团有限公司 Link task processing method and device
CN102164229B (en) * 2010-02-24 2013-09-04 北大方正集团有限公司 Link task processing method and device
US9584878B2 (en) 2011-01-07 2017-02-28 Yong Lu Method and system for collecting, transmitting, editing and integrating, broadcasting, and receiving signal
CN102075696B (en) * 2011-01-07 2013-03-27 卢泳 Signal acquisition, transmission, signal editing and integration, broadcasting and viewing method and system
CN102075696A (en) * 2011-01-07 2011-05-25 卢泳 Signal acquisition, transmission, signal editing and integration, broadcasting and viewing method and system
CN102681883A (en) * 2011-03-17 2012-09-19 新奥特(北京)视频技术有限公司 Resource calling method and system in media asset searching and browsing system
CN102681883B (en) * 2011-03-17 2017-02-08 新奥特(北京)视频技术有限公司 Resource calling method and system in media asset searching and browsing system
CN102368802B (en) * 2011-08-17 2013-08-21 丁文华 Television station production system and method thereof for realizing construction and operation
CN102368802A (en) * 2011-08-17 2012-03-07 丁文华 Television station production system and method thereof for realizing construction and operation
CN102750598B (en) * 2011-09-23 2017-09-19 新奥特(北京)视频技术有限公司 It is a kind of to realize the categorization and system inherited between Multi-workflow
CN102750299A (en) * 2011-11-30 2012-10-24 新奥特(北京)视频技术有限公司 Method for converging information on internet
CN102750299B (en) * 2011-11-30 2018-03-16 新奥特(北京)视频技术有限公司 A kind of method of network information convergence
CN102769730A (en) * 2012-04-27 2012-11-07 新奥特(北京)视频技术有限公司 Off-line cataloging method for broadcast and television audio-visual materials
CN102929566A (en) * 2012-10-24 2013-02-13 中国资源卫星应用中心 Multilevel self-adaptive storage method
CN102929566B (en) * 2012-10-24 2015-07-08 中国资源卫星应用中心 Multilevel self-adaptive storage method
CN103108029A (en) * 2012-12-13 2013-05-15 中国科学院深圳先进技术研究院 Data access method of video-on-demand (vod) system
CN103108029B (en) * 2012-12-13 2016-06-29 中国科学院深圳先进技术研究院 The data access method of vod system
CN103458278A (en) * 2013-09-17 2013-12-18 上海美琦浦悦通讯科技有限公司 System and method for achieving copyright control on basis of audio and video file deep processing
CN103686228A (en) * 2013-09-18 2014-03-26 南信大影像技术工程(苏州)有限公司 A network terminal publishing system oriented towards public services
CN106649867A (en) * 2016-12-30 2017-05-10 北京亚控科技发展有限公司 Object data organization method
CN106649867B (en) * 2016-12-30 2018-05-18 北京亚控科技发展有限公司 A kind of method for organizing of object data
CN107276985A (en) * 2017-05-16 2017-10-20 德基网络科技南京有限公司 One kind is based on e-commerce platform Online Video management method
CN107948165B (en) * 2017-11-29 2023-10-20 成都东方盛行电子有限责任公司 Secure broadcast system and method based on private protocol
CN107948165A (en) * 2017-11-29 2018-04-20 成都东方盛行电子有限责任公司 A kind of safety based on proprietary protocol send broadcast system and method
CN111221870A (en) * 2019-10-17 2020-06-02 北京农信通科技有限责任公司 Management platform and method for rural collective property right reform
CN111221870B (en) * 2019-10-17 2024-05-31 北京农信通科技有限责任公司 Management platform and method for rural collective title reform
CN111353048A (en) * 2020-01-08 2020-06-30 浙江省新华书店集团信息技术有限公司 Cataloguing system
CN111353048B (en) * 2020-01-08 2023-11-10 浙江省新华书店集团信息技术有限公司 Cataloging system
CN111459940B (en) * 2020-04-02 2023-09-19 中电工业互联网有限公司 Efficient and reliable data integration method
CN111459940A (en) * 2020-04-02 2020-07-28 中电工业互联网有限公司 Efficient and reliable data integration method
CN112511613B (en) * 2020-11-19 2022-07-12 深圳市风云实业有限公司 Cross-domain transmission system and method based on content analysis
CN112511613A (en) * 2020-11-19 2021-03-16 深圳市风云实业有限公司 Cross-domain transmission system and method based on content analysis
CN112768046A (en) * 2021-01-27 2021-05-07 深圳市智莱科技股份有限公司 Data processing method, medical management system and terminal
CN115665108A (en) * 2022-10-20 2023-01-31 深圳市全景网络有限公司 Full-media content production data management platform applied to financial system
CN115665108B (en) * 2022-10-20 2024-04-02 深圳市全景网络有限公司 All-media content production data management platform applied to financial system

Also Published As

Publication number Publication date
CN100552709C (en) 2009-10-21

Similar Documents

Publication Publication Date Title
CN1760900A (en) Assets management system for broadcast television media, and method of adjust and control
CN1249590C (en) Method of computer controlled portable personal device and operation method of such device
CN100346254C (en) Content sharing system, content reproduction apparatus, content recording apparatusand server managing apparatus groups
CN1909103A (en) Information-processing apparatus, reproduction apparatus, communication method and computer program
CN1617152A (en) Content sharing system, content processing apparatus, information processing apparatus and content sharing method
CN1677387A (en) Information processing apparatus, information processing method, and program
CN1783140A (en) Information content transmission apparatus
CN1751506A (en) A system for remotely controlling client recording and storage behavior
CN101048732A (en) Object oriented architecture for data integration service
CN1855284A (en) Reproducing device, reproducing control method and program
CN101021856B (en) Distributing speech searching system
CN1650274A (en) Operation managing method and operation managing server
CN1476613A (en) Information processing apparatus and method
CN1967695A (en) Information processing apparatus, reproduction apparatus, communication method, reproduction method and computer program
CN1717054A (en) Data structure of metadata and reproduction method of the same
CN1722108A (en) Disk drive, control method thereof and disk-falsification detection method
CN1381055A (en) Identifying and processing of audio and/or video material
CN1759389A (en) System and method utilizing virtual folders
CN1815612A (en) Information processing apparatus and method and program
CN1321277A (en) Database system
CN1613047A (en) File system housing
CN1690993A (en) Information processing apparatus, information processing method, program and recording medium used therewith
CN1742484A (en) Video signal processor, video signal recorder, video signal reproducer, video signal processor processing method, video signal recorder processing method, video signal reproducer processing method, re
CN1203430C (en) Data management system for using multiple data operation modules
CN1871850A (en) Reproducing apparatus, method and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091021

Termination date: 20191015