CN102447841A

CN102447841A - Terminal device of television station production system

Info

Publication number: CN102447841A
Application number: CN2011102979713A
Authority: CN
Inventors: 丁文华; 宋宜纯; 刘万铭; 余军; 王炜
Original assignee: Chengdu Sobey Digital Technology Co Ltd
Current assignee: Chengdu Sobey Digital Technology Co Ltd
Priority date: 2011-09-27
Filing date: 2011-09-27
Publication date: 2012-05-09

Abstract

The invention discloses a terminal device of a television station production system, wherein in a nonlinear editing mobile work station terminal device, parallel processing devices are interactive with corresponding business subsystems of business layer equipment of the production system to transmit program materials; the parallel processing devices are used for performing editing and format conversion processing on program data received through program interactive interfaces modules based on the architecture of multiple CUPs (Central Processing Unit)s and multiple graph processing units, and the treated program data or materials are returned through the program interactive interfaces. According to the invention, the capacity for calculating and integrating IT (Information Technology) resources in a service manner of distribution according to needs, and multiple businesses orienting to broadcast television program production are provided, and thus, a business product production and delivery mode of plug and play can be supplied to users of the television station production station.

Description

Terminal device of television station production system

Technical Field

The invention relates to a system and a method for producing broadcast television programs, in particular to a terminal device of a television station production system.

Background

The existing television station production system is based on a whole station network architecture and a networking manufacturing technology, corresponds to a core architecture of intra-station services and each service subsystem, basically realizes standardized network production construction and specification of television stations, and realizes production automation and whole-course paperless and non-banding. Each level of television station can basically realize building block system construction according to the scale and service condition of the television station, as shown in figure 1.

However, the existing tv station production system with the whole station network architecture has the following disadvantages:

(1) there is a limitation to meeting the demand of distributed business models

The television station system of the whole station network structure mainly faces the intra-station service at the beginning of design, so the support consideration of the extra-station service is insufficient. Such as: private network connection technology used among several scattered television station units cannot effectively utilize increasingly rapidly developed public network resources; resources such as storage, calculation and the like contained in the production system in different places are designed relatively independently in different places, so that unified allocation and management cannot be carried out, and therefore, in most cases, a production system user can only operate local limited resources; data operation with other units and interaction of materials and programs mainly adopt an indirect operation mode (including file retrieval, migration copy, file warehousing and other operations); due to the lack of unified management portal planning, the requirements of access of branch systems, mobile users and the like need to be planned and processed independently, so that the construction complexity of the existing production system is high, and the later maintenance is difficult.

(2) Has limitations to simultaneously satisfy multiple core requirements

One is the limitation of support for new media distribution. Under the same unit construction, since the station-network linkage (i.e. resource sharing and synchronous broadcasting between the production network in the television station and the internet) cannot be realized, the existing resources cannot be quickly utilized to seamlessly support the new media system, and thus, the video and audio content data in the new media system cannot be efficiently introduced back, which constitutes waste of equipment and personnel. Under different unit construction, the efficiency of externally providing the video and audio contents is low, and the secondary format conversion and the content transmission and exchange are carried out for a long time, thereby causing resource waste.

The second is the limitation of content collection and distribution support. Video and audio content convergence is mainly recorded based on a Digital Serial Interface (SDI), so that the source of program materials is limited; because of the lack of a data transaction portal, the popularization of valuable data only stays in participation in program alliances and program transaction meetings, so that potential users (such as professional television program production organizations, advertising organizations and the like) lack a channel for knowing information, and the channel for recycling the data is very limited.

And thirdly, the support of new program forms is limited. The future television program form and watching mode need to be more flexible, and audiences can develop from watching television to participating in television and joining in a television community. Some new program modalities emphasize user engagement, desire to interact with other viewers simultaneously using multiple distribution channels, desire to transmit communication content through multiple distribution pathways, and obtain feedback information for the television user. However, the service system of the existing whole platform network architecture is relatively closed, and it is difficult to provide support for this mode.

(3) Has limitations to quickly react to business

The demand of instantly making and reporting programs can not be met, so as to quickly respond to the social hotspot to quickly collect resources (equipment and manpower) to make and produce corresponding programs anytime and anywhere and report the programs.

(4) Has limitations on the balance of resource utilization and business scalability

For each production subsystem, a storage space, a database, a synthesis server and a transcoding server are provided; none of these resources can be flexibly expanded as needed and their utilization is unbalanced. If the overall planning of basic equipment resources can be carried out to a certain extent, the equipment investment can be greatly saved, and the maintenance cost of each television station production system can be reduced to a certain extent.

For interconnected and intercommunicated core platforms, various network protocol connections exist among production service subsystems; in order to realize intercommunication, the core platform realizes subsystem routing intercommunication and video and audio data file relocation copy work through a large number of migration servers. The routing of the mode is too complex, the sharing degree of the migration resources is poor, and the efficiency is lower; the resources such as storage, transcoding and the like on the core platform are low in utilization rate and uneconomical because the management and routing factors can only be provided to each subsystem as a near line resource but not as an online resource of each subsystem, and the calling process of the resources is very complicated.

In summary, the future television programs have features of multi-modality fusion, active audience participation, multi-channel distribution, and cross-media link, and these modalities are still in the process of continuous development and creation. This requires that the television station production system have sufficient flexibility and strain capacity to support the development of production and production services with these features. The existing television station program production system can support services reluctantly, but obviously cannot meet the requirements of rapid and efficient production, so that a strong production tool cannot be provided for supporting, a large amount of repeated system construction is caused, and the system is caused to run at high carbon.

Disclosure of Invention

The technical problem to be solved by the invention is to provide a terminal device of a television station production system, which can meet the requirements of rapid and efficient production of television programs.

In order to solve the technical problem, the invention provides a nonlinear editing mobile workstation terminal device used by a television station production system, which comprises a parallel processing device and a program interaction interface module; wherein:

the program interaction interface module is used for interacting with a service subsystem corresponding to the service layer equipment of the production system to transmit program materials;

and the parallel processing device is used for editing and format conversion processing the program data received through the program interaction interface module in parallel based on the multi-CPU and multi-graphic processing unit architecture, and returning the processed program data or material through the program interaction interface module.

Further, the parallel processing device comprises one or more of a program high standard definition conversion module, a program format conversion module and a program editing module, wherein:

the program high-definition and high-definition conversion module is used for converting a high-definition material into a standard-definition material on a standard-definition time line in real time or converting the standard-definition material into the high-definition material on the high-definition time line in real time in parallel; the converted program material is transmitted back through the program interactive interface module;

the program format conversion module is used for performing mixed editing on the multi-format material and converting the edited material into a format required by transmission; the program material after being converted is transmitted and edited through a program interaction interface module;

the program editing module is used for carrying out one or more processing operations of clipping, splicing, caption inserting and special effect arrangement on collected or imported program materials of videos, audios, images and texts, and directly exporting or synthesizing a processing result as a finished program into the finished program; and importing program materials or exporting finished programs through a program interaction interface module.

In order to solve the above technical problem, the present invention provides a universal mobile terminal device used in a television station production system, which includes a data interaction module, and further includes a service processing device and/or a program auditing device, wherein:

the data interaction module is used for interacting with a service subsystem corresponding to the service layer equipment and transmitting the program data;

the service processing device is used for completing the creation, assignment and claiming of the selected questions, auditing manuscripts edited on line around the selected questions or manuscripts edited in an off-line mode, and uploading the audited manuscripts to corresponding service subsystems through the data interaction module;

and the program auditing device is used for loading the program to be audited through the data interaction module, converting the program to be audited into a streaming media format suitable for auditing, auditing and broadcasting, and feeding auditing opinions back to the corresponding service subsystem through the data interaction module.

Furthermore, the service processing device comprises a selected topic defining module, a selected topic assigning module, a selected topic claiming module, a manuscript loading editing module and a manuscript loading auditing module which are connected in sequence, wherein:

the selected question definition module is used for creating a selected question;

the system comprises a topic assignment module, a topic selection module and a topic selection module, wherein the topic selection module is used for assigning the newly-built topics to users of a terminal device;

a topic search module for searching for the assigned topic by the user;

a manuscript loading editing module, which is used for off-line editing manuscripts or on-line editing manuscripts loaded by a service terminal user aiming at the claimed selection questions, wherein the editing comprises one or more operations of generation, clipping, splicing, subtitle processing and special effect processing of the manuscripts, and the manuscripts which are edited are uploaded to a corresponding service subsystem;

and the manuscript loading and checking module is used for loading manuscripts which are edited in an off-line or on-line mode aiming at the claimed selected questions by a user of the terminal device, and uploading the manuscripts to the corresponding service subsystem after the loaded manuscripts are checked.

Further, the program auditing device comprises a program loading module to be audited, a media format conversion module, an auditing broadcasting module and an auditing suggestion feedback module which are connected in sequence, wherein:

the pending program loading module is used for loading the pending program through the data interaction module;

the media format conversion module is used for converting the format of the loaded program to be examined into a streaming media format suitable for examination;

the auditing and broadcasting module is used for auditing the program to be audited converted into the streaming media format through one or more operations of playing, pausing, rewinding, advancing and stopping;

and the audit opinion feedback module is used for feeding the audit opinion of the program to be audited back to the corresponding service subsystem through the data interaction module through voice and/or characters.

In order to solve the technical problem, the invention provides a streaming media live broadcast terminal device used by a television station production system, which comprises a special interface module and a wireless network transmission module which are sequentially connected, wherein:

the special interface module is used for receiving audio and video signals shot by the shooting device in real time through the professional audio and video interface of the radio and television, forming audio and video files and transmitting the audio and video files to the wireless network transmission module;

and the wireless network transmission module is used for converting the audio and video data in the audio and video file into wireless signals through a built-in signal transmitting module and transmitting the wireless signals to a corresponding service subsystem of the service layer equipment.

Further, a code rate adaptive adjustment module is further included between the dedicated interface module and the wireless network transmission module, wherein:

the special interface module comprises one or more of an audio/video interface, a serial digital interface, a high-definition multimedia interface, a composite video broadcast signal, a card and agriculture interface and an RJ45 interface, a Wifi interface, a Bluetooth interface and DV 1394; transmitting the formed audio and video file to a code rate self-adaptive adjusting module;

the code rate self-adaptive adjusting module is used for self-adaptively adjusting the code rate of the audio/video file to the code rate of the streaming media file according to the signal fluctuation of the wireless communication network and outputting the streaming media file to the wireless network transmission module;

the wireless network transmission module converts audio and video data in the streaming media file into wireless signals through the signal transmitting module and transmits the wireless signals to the service subsystem, and the wireless signals of the service subsystem are received through the built-in signal receiving module and are converted into digital signals which serve as signal fluctuation of the wireless communication network and are provided to the code rate self-adaptive adjusting module.

Further, an encoding module is further included between the dedicated interface module and the code rate adaptive adjustment module, wherein:

the broadcasting and television professional audio and video interface in the special interface module also comprises an analog audio and video interface which directly transmits audio and video signals shot by the shooting device in real time to the coding module;

and the coding module is used for coding the audio and video signals by adopting an H.264 coding format, converting the audio and video signals into a digital audio and video file and transmitting the digital audio and video file to the code rate adaptive adjustment module for code rate adjustment.

Furthermore, the system also comprises a global positioning system module connected with the wireless network transmission module and used for providing information data of the geographic position for the corresponding service subsystem so as to position the place where the terminal device holder is.

In order to solve the technical problem, the invention provides a portable full-function editing terminal device used by a television station production system, which comprises an audio and video signal acquisition device, a professional interface module, an audio and video signal editing management module and a network transmission module which are sequentially connected, wherein:

the audio and video signal acquisition device is used for transmitting the acquired audio and video signals to the audio and video signal editing management module through the professional interface module;

the professional interface module is used for transmitting the audio and video signals acquired by the audio and video signal acquisition device to the audio and video signal editing management module through the professional audio and video interface of the radio and television;

the audio and video signal editing management module is used for carrying out field editing and/or storage management on the input audio and video signals;

and the network transmission module is used for transmitting the audio and video signals edited and/or stored and managed on site by the audio and video signal editing and managing module to the corresponding service subsystem of the service layer equipment through the wireless signal transmitting module or the internet signal transmission module.

Further, the air conditioner is provided with a fan,

one or more of a broadcast television professional audio/video interface serial digital interface, a high-definition digital multimedia interface, a digital audio/video interface and an analog audio/video interface in the audio/video signal acquisition device;

the audio and video signal editing management module converts the analog audio and video transmitted by the analog audio and video interface in the audio and video signal acquisition device into a digital audio and video file through a built-in coding module, and performs field editing and/or storage management; or, the digital audio and video files transmitted by the audio and video signal acquisition device are directly edited and/or stored and managed on site;

the wireless signal transmitting module of the network transmission module converts the audio and video signals into corresponding wireless signals and transmits the wireless signals through a 3G or 4G wide area network and/or a Wifi metropolitan area network; or the internet signal transmission module directly transmits the audio and video signals.

The invention utilizes the technologies of resource pool, virtualization and distribution of cloud computing, realizes the scheduling of production resources as required through a layered architecture of hardware resource pooling, core service platformization and production system virtualization, separates production processing from service scheduling, realizes the definition and monitoring of production flow as required, constructs an efficient resource pool on the basis of the technologies of unified resource scheduling, media processing centralized operation and network storage resource allocation, provides the capability of computing and integrating IT resources in a service form distributed as required, provides multiple services for the production application of broadcast television programs, and can provide plug and play service product production and delivery modes for television station production system users.

Drawings

Fig. 1 is a schematic structural diagram of a conventional television station production system based on a whole station network architecture;

fig. 2 is a schematic structural diagram of an embodiment of a cloud computing-based television station production system according to the present invention;

FIG. 3 is a block diagram of an embodiment of a media processing platform in the platform layer shown in FIG. 2;

FIG. 4 is a block diagram of an embodiment of a production management platform in the platform layer shown in FIG. 2;

FIG. 5 is a block diagram of an embodiment of a content management platform in the platform tier shown in FIG. 2;

FIG. 6 is a schematic structural diagram of an embodiment of a service subsystem configuration apparatus in the service layer shown in FIG. 2;

FIG. 7 is a schematic diagram of an embodiment of a non-linear editing mobile workstation apparatus in the terminal layer shown in FIG. 2;

fig. 8 is a schematic structural diagram of an embodiment of a generic service terminal in the terminal layer shown in fig. 2;

fig. 9 is a schematic structural diagram of an embodiment of a streaming media live terminal in the terminal layer shown in fig. 2;

fig. 10 is a schematic structural diagram of an embodiment of the portable editing terminal in the terminal layer shown in fig. 2.

Detailed Description

The technical solution of the present invention will be described in detail below with reference to the accompanying drawings and preferred embodiments. It should be understood that the following specific examples are only for illustrating the present invention and are not to be construed as limiting the technical aspects of the present invention.

Cloud Computing (Cloud Computing) is a product of merging traditional computer and Network technology developments such as Grid Computing (Grid Computing), Distributed Computing (Distributed Computing), Parallel Computing (Parallel Computing), Utility Computing (Utility Computing), Network Storage (Network Storage Technologies), Virtualization (Virtualization), and Load balancing (Load Balance).

In recent years, with the development of "cloud computing", the IT industry is undergoing the development of technologies such as virtualization, distribution, mobile internet, and network storage, and the flexibility, mobility, and maintainability of IT systems have been greatly improved.

The invention provides an embodiment of a television station production system based on cloud computing based on the development of the most advanced IT technology and by combining the characteristics of the television station production system, wherein the layered architecture of the television station production system is shown in figure 2 and comprises the following components: resource layer equipment, platform layer equipment, business layer equipment and terminal layer equipment, wherein:

the resource layer equipment is used for virtualizing and pooling the bottom-layer physical hardware, performing virtualized resource management on the resource pool, and scheduling and allocating virtual resources in the resource pool according to the requirements of the platform layer equipment;

the platform layer equipment is used for providing core services of media processing, production and content management according to the requirements of the business layer equipment;

the service layer equipment is used for acquiring core services required by the requested service from the platform layer according to the service request of the terminal layer equipment and configuring corresponding service subsystems for the terminal layer equipment;

and the terminal layer is used for facing terminal devices under different application service scenes and performing corresponding operation of television station program production through the service subsystem acquired from the service layer.

In the above system embodiment, the resource layer device includes a media processing resource pool, a media storage resource pool, and an IT basic resource pool, where:

the media processing resource pool is used for integrating the media processing resources into a corresponding service array in a virtualization mode and providing the corresponding service resources for media processing, wherein the service resources comprise one or more of service resources such as media file migration, media file rendering and synthesis, media file transcoding and package unpacking;

the media storage resource pool is used for uniformly planning and providing shared media storage resources, and comprises one or more of IP-based cluster storage, Distributed File System (DFS) and trillion, remote (internet-based and dedicated line-based) exchange and routing service resources;

the IT basic resource pool is used for virtualizing IT physical resources such as a server, a network switch and the like into logic resources and providing various logic resources, including one or more corresponding logic resources such as hardware virtualization, I/O virtualization and Graphic Processing Unit (GPU) virtualization.

In the embodiment of the system described above,

the service array provided by the media processing resource pool comprises one or more service arrays of migration resources (migration servers), rendering synthetic resources (rendering synthetic servers), transcoding and unpacking resources;

the virtualization mode refers to abstracting the physical resources at the bottom layer into logical resources, and accessing the abstract logical resources is not limited by the physical resources at the bottom layer, the geographic position of the physical resources and the physical configuration of the physical resources.

For example, aiming at a very representative program rendering and synthesizing application in the production of programs of a television station, a typical scene of rendering and synthesizing resource virtualization and centralized computation is realized: under the unified scheduling of the task scheduling center device, a plurality of rendering synthesis servers generate a service array in a clustering mode, and cluster rendering synthesis and/or intelligent segmented synthesis are/is completed on one video and audio program in a coordinated mode, so that the rendering synthesis speed is improved.

Wherein,

the cluster rendering synthesis is to divide a video-audio program into a plurality of sections and to deliver the rendering synthesis of each section of program to the corresponding synthesis service in the service array, thereby greatly improving the program generation efficiency and shortening the program broadcasting time.

The intelligent segmented composition is that the system intelligently judges the segments needing to be rendered and synthesized in a video and audio program, and automatically performs corresponding synthesis (such as caption synthesis, special effects and the like) on the segments, and does not perform the synthesis operation on the segments needing not to be rendered and synthesized, thereby improving the program generation efficiency.

Therefore, the media processing resource pool can provide corresponding computing resources for the actual requirements of media processing dynamically, quickly and flexibly according to needs.

In the embodiment of the system described above,

the IP-based cluster storage provided by the media storage resource pool is an open storage architecture adopting a distributed operating system, and aggregates storage spaces in a plurality of physical storage devices into a storage pool (also called a uniform naming space) with a uniform access interface and a management interface, all disks on the physical storage devices in the storage pool can be managed through the access interface, and data can be accessed from the plurality of storage devices according to a load balancing policy, so as to obtain higher security storage performance and sufficient utilization rate.

The advantages of the IP-based cluster storage are mainly embodied in that the overall performance of parallel or partitioned I/O is improved, particularly the access of workflow, reading intensive type and large files is improved, the overall cost is reduced by adopting a service unit with lower cost and IP Ethernet access, and the method is very suitable for application mainly based on unstructured data; therefore, the method is an ideal choice for storing system plans in the production system architecture of the next generation television station.

The distributed file system provided by the media storage resource pool refers to that physical storage resources managed by the file system are connected through a computer network in a node mode.

The trillion, remote switching and routing service provided by the media storage resource pool refers to link optimization for access of storage resources after the storage resources are integrated.

For the production subsystem of the service layer, no specific disk or tape can be seen, and the path of data passing and the physical storage device to which the data is led do not need to be concerned; the platform layer dynamically allocates the storage resources which are managed in a centralized way in the media storage resource pool according to the requirements of the business layer.

In the embodiment of the system described above,

hardware virtualization provided by the IT basic resource pool refers to virtualization of a computer or an operating system, shows an abstract computing platform and is realized by the cooperative support of a CPU, a mainboard chipset, a BIOS and software; by using software to create multiple Virtual Machines (VMs) and their operating systems, multiple operating systems are run simultaneously on a single physical server, reducing the number of physical servers and the associated costs and administrative and maintenance costs associated therewith, and balancing workloads.

The I/O virtualization provided by the IT basic resource pool mainly refers to a virtualization network card, and the virtualization network card can provide independent access and virtual channels for different virtual machines and provide corresponding security isolation and Quality of Service (QoS) strategies according to different virtual machine flows.

Wherein,

through the label used in the virtual access, different VM flows are distinguished in the whole network range, and a targeted security isolation and QoS strategy is deployed on a platform layer.

Aiming at a physical channel of an upper layer software system of a physical network card, simulating a plurality of corresponding virtual channels for a plurality of VMs, wherein each virtual channel has an independent I/O function and can reproduce all network mechanisms in an actual physical environment; data generated by the virtual machine enters the virtualization network card through an independent virtual channel, and then is labeled to be sent to an external network; or, the data packet transmitted from the external network through the virtualization network card is sent to the corresponding virtual machine through the independent virtual channel.

Only in the virtual channel environment, the change of the network environment is not needed to be made in the process of migrating the upper-layer application service to virtualization, so that the migration cost is reduced as much as possible, and the migration process is accelerated. The application service of the upper layer can not sense the change of the I/O, and the data behaviors of all services do not have any difference with the data behaviors of the services running on an independent physical server.

The GPU virtualization provided by the IT basic resource pool means that integrated GPU resources or independent GPU resources can be uniformly virtualized into logic GPU resources through dynamic allocation; and the platform layer uses the logic GPU resources in the virtual environment through the visual application program according to the service requirement of the service layer.

The GPU virtualization provides an independent logic GPU for each virtual machine, so that the virtual machines can obtain various graphics acceleration capabilities, complete various high-fidelity videos, 2D and 3D graphics processing, perform graphics rendering operation or large-scale parallel computation and transmit vivid 2D graphics or 3D images to the client side of the terminal layer. And the server of the business layer uses a virtual logic GPU to render a high-quality image to be transmitted back according to a request sent by the client, or transmits a 3D image back in an online streaming media mode.

In the above system embodiment, the platform layer device includes a media processing platform, a content management platform, and a production management platform, where:

the media processing platform is used for realizing the scheduling and distribution of virtual resources in various resource pools of the resource layer through the interaction with the content management platform and the production management platform, and coordinating and scheduling and executing the media processing services of a plurality of application service subsystems of the service layer;

the content management platform is used for providing content and storage management service thereof for the business layer, and comprises one or more of life cycle management and file content prompt, retrieval, access and authority control of the program material file and the metadata information thereof, the full media file and the metadata information thereof, and one or more of file content prompt, retrieval, access and authority control;

and the production management platform is used for providing production line organization and business process management according to the requirements of various application businesses in the business layer, and comprises one or more of the management of modeling, curing, monitoring, analyzing and optimizing the business process.

In the foregoing system embodiment, the structure of the media processing platform embodiment is as shown in fig. 3, and further includes a task scheduling center device and a media processing interaction module, which are connected to each other, and the task scheduling center device further includes a resource scheduling allocation module and a media processing scheduling module, which are connected to each other, where:

the media processing interaction module is used for respectively transmitting a media processing request and a resource allocation request which are sent by the production management platform in the operation of the business process to the media processing scheduling module and the resource scheduling allocation module; virtual resources returned by the resource scheduling and distributing module and a media processing result returned by the media processing and scheduling module are sent to the production management platform;

the resource scheduling and distributing module is used for scheduling corresponding virtual resources from each resource pool of the resource layer equipment according to the received resource allocation request and returning the corresponding virtual resources to the media processing interaction module;

and the media processing scheduling module is used for coordinating and scheduling and executing corresponding media processing according to the received media processing request, wherein the media processing comprises one or more of the processes of migration, rendering composition, transcoding/unpacking, verification, content cataloging and accessing and content publishing of a media file, and the corresponding media processing result is returned to the media processing interaction module.

In the above system embodiment, the structure of the production Management platform embodiment is as shown in fig. 4, and includes an embodiment of a production interaction module and a Business Process Management (BPM) device, which are connected to each other, where the embodiment of the BPM device includes at least a Process modeling module and a Process solidification module, which are connected to each other, where:

the production interaction module is used for forwarding the service request received from the service layer equipment to the process curing module of the BPM device;

the flow modeling module is used for defining corresponding business flows according to various application services of the business layer equipment and outputting the business flows to the flow curing module;

and the flow curing module is used for curing each production role and the production task thereof in the business flow, starting the corresponding business flow to run according to the received business request, and driving a next production role to enter the business flow according to the task completion condition of the current production role.

The BPM device embodiment further comprises a process monitoring module, a process analysis module and a process optimization module

The flow monitoring module is used for monitoring the operation of the business flow driven by the flow solidifying module and providing monitoring information including one or more of basic, graphical flow monitoring, flow logs, repeated flows and overtime flows to a production manager and/or a flow analyzing module;

the flow analysis module is used for analyzing various data generated by the operation of the business flow and/or monitoring information provided by the flow monitoring module, and comprises the analysis of one or more dimensions of quantity, cost, efficiency and bottleneck; and presenting the generated analysis result information to a production manager, wherein the analysis result information comprises one or more of a pie chart, a column chart, a broken line chart and a scatter chart;

the process optimization module is used for providing various operation interfaces for optimizing the business process for the production manager and returning the business process optimized by the production manager through the operation interfaces to the process modeling module;

and the flow modeling module stores the optimized business flow returned by the flow optimizing module and outputs the optimized business flow to the flow solidifying module.

In the above system embodiment, the structure of the content management platform embodiment is as shown in fig. 5, and includes a storage resource partitioning module, a storage resource access module, and a content lifecycle management module, where:

the storage resource partitioning module is used for partitioning each storage resource space according to the characteristics of the life cycle of the production content, and comprises one or more of a high code stream online area, a low code stream online area, a lead-in working area, a lead-out working area, an upload working area and a tape library area, and corresponding access authority is set for each partition;

the storage resource access module is used for uniformly naming and managing all storage resource spaces, distributing the storage resource spaces with fixed positions aiming at all media data, and realizing the migration of the material files and the media files by changing the tag information additionally arranged in the metadata information, wherein the storage resource spaces comprise storage resource spaces for storing program material file entities and metadata information thereof, and all media file entities and metadata information thereof;

the service flow driven by the production management platform only causes the change of the label information in the metadata of the program material file or the full media file, but the entity storage position of the program material file or the full media file is not changed (such as the program broadcasting service), thereby greatly saving the expenses of a large amount of file migration and file verification of the traditional television station under the network architecture of the whole station, improving the production efficiency and reducing the safety risk of the system.

The content life cycle management module is used for setting a production material imported or exported from the partition of the storage resource space for online production storage according to the project of the life cycle and generating corresponding metadata information; and forming a material hot spot area or a freezing area according to one or more statistical data of retrieval, return and application times of the media data material of the production line, and calculating and executing storage and migration of each stage of the life cycle of the material, wherein the storage comprises one or more of online storage, near-line storage and offline storage and mutual migration of the storage.

For example, for a material which has obviously entered a decay period in online storage and is rarely accessed within a certain period of time, after the content management platform automatically detects the state, the material is automatically migrated to online storage, and a production subsystem user is prompted to perform offline storage processing on the material.

The content management platform embodiment further includes a full media access interface module, which is used as an interface for publishing or playing full media, and manages access to a full media file entity and a storage resource space of metadata information thereof through the storage resource access module, including management of one or more of uploading, archiving, classifying, cataloguing, retrieving and recalling of the full media file to the storage resource space.

In the above system embodiment, the service layer device includes a service subsystem configuration apparatus and one or more service subsystems (1-n) established by the service subsystem configuration apparatus, where:

the service subsystem configuration device is used for configuring a corresponding service subsystem according to the request of the terminal device of the terminal layer for the installation and operation of the terminal device;

and the service subsystem is used for being installed on the terminal device to realize application services corresponding to the production system, including one or more application services in news production, media asset management, program production and production.

The structure of the embodiment of the service subsystem configuration apparatus is shown in fig. 6, and includes a subsystem resource configuration module and a subsystem building module, which are connected to each other, where:

the subsystem resource allocation module is used for allocating corresponding service subsystem resources according to a service subsystem request provided by the terminal device and outputting the corresponding service subsystem resources to the subsystem building module;

the subsystem building module is used for building a corresponding service subsystem according to the input service subsystem resources and returning the service subsystem resources to the terminal device which makes the request;

and the service subsystems (1-n) are used for being installed and operated on the corresponding terminals of the terminal layer to realize the operation of the corresponding application services.

In the foregoing system embodiment, the service subsystem configuration apparatus embodiment further includes a subsystem request/response module connected to the subsystem resource configuration module and the subsystem building module, respectively, where:

and the subsystem request/response module is used for providing a service subsystem interface for the terminal layer, outputting the service subsystem request input by the terminal layer through the interface to the subsystem resource allocation module, and returning the service subsystem constructed by the system construction module to the corresponding terminal layer through the interface.

In the embodiment of the system described above,

the service subsystem interface provided by the subsystem request/response module comprises a request interface and a response interface of the service subsystem; the request interface comprises one or more request items of the service subsystem type, the type and the number of special equipment required by the service subsystem of the corresponding type, storage capacity, running bandwidth, the requirement of a studio and the size of finished product program volume; the response interface comprises one or more response items in installation, operation and uninstallation of the executable software module of the corresponding type of the service subsystem;

the subsystem resource allocation module allocates corresponding resources according to each request item in the service subsystem request, wherein the resources comprise one or more resources of the number of special equipment, storage capacity, running bandwidth, whether a studio is needed or not and the size of finished product program volume;

the business subsystem formed by the subsystem forming module comprises one or more executable software modules of a news subsystem, a media resource subsystem, a making subsystem and a production subsystem, and is used for being installed and operated on a corresponding terminal of a terminal layer to respectively and correspondingly realize news making, media resource making, program making and program production.

In the above system embodiment, the terminal layer device includes one or more terminal apparatuses corresponding to the corresponding service subsystems in the service layer, including a universal mobile terminal and a broadcast and television industry dedicated terminal, where the universal mobile terminal includes: notebook computer, intelligent panel computer and the smart mobile phone in one or more, broadcasting and TV trade special terminal includes: one or more of a mobile nonlinear editing workstation device, a streaming media live broadcast terminal and a portable full-function editing terminal. Wherein,

the mobile nonlinear editing workstation device is used for receiving program data to be processed from a corresponding service subsystem of a service layer, performing high-definition conversion on the received program data in parallel based on a CPU + GPUs + I/O architecture, and/or completing mixed editing on multi-format program materials, and transmitting the processed program data or materials back to the corresponding service subsystem.

The structure of an embodiment of the mobile nonlinear editing workstation device is shown in fig. 7, and comprises a parallel processing device and a program interaction interface module; the parallel processing device comprises one or more of a program high standard definition conversion module, a program format conversion module and a program editing module, wherein:

the program interactive interface module is used for connecting with a corresponding service subsystem of the service layer to carry out interactive transmission of program materials or finished programs;

the program high-definition and high-definition conversion module is used for converting a high-definition material into a standard-definition material on a standard-definition time line in real time or converting the standard-definition material into the high-definition material on the high-definition time line in real time in parallel; transmitting unconverted or converted program materials through a program interaction interface module;

the program format conversion module is used for performing mixed editing on the program materials with multiple formats and converting the edited program materials into a format required by transmission; transmitting the unedited and converted or edited and converted program materials through a program interaction interface module;

An embodiment structure of a general mobile terminal device, such as a service terminal based on a laptop, a tablet computer, or a smart phone, is shown in fig. 8, and includes a data interaction module, a service processing device, and/or a program auditing device, where:

the data interaction module is used for connecting with the service subsystem corresponding to the service layer and carrying out interactive transmission of program data;

and the program auditing device is used for loading the program to be audited from the corresponding service subsystem through the data interaction module, converting the loaded program to be audited into a streaming media format suitable for auditing, auditing and broadcasting, and feeding auditing opinions back to the corresponding service subsystem through the data interaction module.

The embodiment of the service processing apparatus shown in fig. 8 further includes a topic selection definition module, a topic selection assignment module, a topic selection claim module, a manuscript loading editing module, and a manuscript loading auditing module, which are connected in sequence, where:

the system comprises a topic selection assignment module, a service terminal user and a service selection module, wherein the topic selection assignment module is used for assigning the newly-built topic selection to the service terminal user;

the system comprises a selection question receiving module, a selection question receiving module and a selection question receiving module, wherein the selection question receiving module is used for receiving a selection question assigned to a service terminal user;

a manuscript loading editing module, which is used for the service terminal user to load offline editing manuscripts or online editing manuscripts aiming at the claimed selection questions, wherein the editing comprises one or more operations of manuscript generation, editing, splicing, subtitle processing and special effect processing, and the manuscripts which are edited are uploaded to a corresponding service subsystem;

and the manuscript loading and checking module is used for loading manuscripts which are edited in an off-line or on-line mode aiming at the claimed selected questions by a service terminal user, and uploading the loaded manuscripts to a corresponding service subsystem after the loaded manuscripts are checked.

The embodiment of the program auditing apparatus shown in fig. 8 further includes a pending program loading module, a media format conversion module, an auditing broadcast module, and an auditing suggestion feedback module, which are connected in sequence, where:

the auditing and broadcasting module is used for auditing the program to be audited converted into the streaming media format through one or more operation operations of playing, pausing, rewinding, advancing and stopping;

and the audit opinion feedback module is used for feeding the audit opinion of the program to be audited back to the corresponding service subsystem through the data interaction module by voice and/or characters.

The system comprises a streaming media live broadcast terminal device and a full-function portable collecting and editing terminal device which are based on professional coding and wireless transmission in a special terminal in the radio and television industry, wherein the streaming media live broadcast terminal device is used for receiving audio and video signals shot by a shooting device (comprising a camera or a digital camera device) in real time and converting the audio and video signals into real-time streaming media files, and the real-time streaming media files are transmitted to a corresponding service subsystem of a service layer through a wireless communication network (a 3G or 4G wireless network); the latter is used for collecting and receiving audio and video signals, and editing the audio and video signals into audio and video files and transmitting the audio and video files to corresponding service subsystems of a service layer through a wireless network (a metropolitan area network or a wide area network) or the Internet.

The structure of the embodiment of the streaming media live broadcast terminal is shown in fig. 9, and includes a dedicated interface module, a coding module, a code rate adaptive adjustment module, a wireless network transmission module and a GPS module, which are connected in sequence, wherein:

the special interface module is used for transmitting audio and video signals or audio and video files shot by a shooting device (a camera) in real time to the coding module or the code rate self-adaptive adjusting module through a professional audio and video interface of the radio and television;

the encoding module is used for encoding the audio and video signals by adopting an H.264 encoding format, converting the audio and video signals into digital audio and video files and transmitting the digital audio and video files to the code rate self-adaptive adjusting module;

the code rate self-adaptive adjusting module is used for carrying out self-adaptive code rate adjustment on the digital audio and video files according to signal fluctuation of the mobile communication network to form streaming media files and outputting the streaming media files to the wireless network transmission module;

the wireless network transmission module is used for converting the streaming media file into a wireless signal (3G or 4G wireless signal) through the signal transmitting module and transmitting the wireless signal to the production system; or a signal receiving module is used for receiving wireless signals (3G or 4G wireless signals) of the production system, converting the wireless signals into digital signals serving as signal fluctuation of a mobile communication network and outputting the digital signals to a code rate self-adaptive adjusting module;

and the GPS module is used for providing information data of the geographic position for the production system so as to position the place where the terminal holder is located.

In the above embodiment of the streaming media live broadcast terminal, the professional audio/video interface of the radio and television comprises: one or more of an Audio Video (AV) interface, a Serial Digital Interface (SDI), a High Definition SDI (HDSDI), a High Definition Multimedia Interface (HDMI), a Composite Video Broadcast Signal (CVBS), a Carnon interface and RJ45 interface, a Wifi interface, a Bluetooth interface, and a DV 1394.

The structure of the portable full-function editing terminal embodiment is shown in fig. 10, and comprises an audio and video signal acquisition device, a professional signal transmission module, an audio and video signal editing management module and a network transmission module, wherein:

the audio and video signal acquisition device (such as a digital audio and video camera or a video camera) is used for transmitting acquired audio and video signals to the audio and video signal editing management module through the professional signal transmission module;

the professional signal transmission module is used for transmitting the audio and video signals acquired by the audio and video signal acquisition device to the audio and video signal editing management module through the professional audio and video interface of the radio and television;

and the network transmission module is used for transmitting the audio and video signals edited and/or stored and managed on site by the audio and video signal editing and managing module through a wireless network or the Internet.

In the above-described fully functional portable editing terminal embodiment,

the professional audio and video interfaces of the radio and television in the professional signal transmission module comprise one or more of AV interfaces, SDI, HDSDI, HDMI, CVBS, Cannon interfaces, RJ45 interfaces, Wifi interfaces, Bluetooth interfaces and DV 1394;

in the network transmission module, the wireless network comprises a 3G or 4G wide area network or a Wifi metropolitan area network, and the Internet comprises an Ethernet.

The invention correspondingly provides a method for realizing construction and operation of a television station production system based on the system embodiment, which comprises the following steps:

a television station production system is constructed in a layering mode, wherein the layering mode comprises a resource layer, a platform layer, a service layer and a terminal layer from low to high;

virtualizing and pooling the bottom physical hardware through a resource layer, and performing virtualized resource management on the resource pool;

providing core services for media processing, production and content management through a platform layer;

acquiring core service from a platform layer through a service layer, and configuring a service subsystem required by the service;

and acquiring a corresponding service subsystem from the service layer to perform corresponding operation of program production by facing the user terminal under different application service scenes through the terminal layer.

In the above-described embodiment of the method,

virtualizing and pooling bottom-layer physical hardware through a resource layer, and performing virtualized resource management on the resource pool, specifically comprising:

dividing the bottom layer physical resources into IT basic resources, media processing resources and media storage resources according to types;

respectively virtualizing physical IT basic resources, media processing resources and media storage resources into corresponding logical resources which are not limited by geographical positions and physical configurations, and correspondingly placing the logical resources in an IT basic resource pool, a media processing resource pool and a media storage resource pool.

In the above-described embodiment of the method,

the media processing resource pool integrates the media processing resources into a corresponding service array by adopting a virtualization mode, and provides the corresponding resources for media processing, including one or more of the service resources such as media file migration, media file rendering and composition, media file transcoding and package unpacking and the like;

the media storage resource pool uniformly plans and provides shared media storage resources, including one or more storage resources of IP-based cluster storage, DFS and trillion, remote (based on internet and special line) exchange and routing service;

the IT basic resource pool provides logic resources for virtualizing IT physical resources such as a server and a network switch, and the logic resources comprise one or more corresponding logic resources of hardware virtualization, I/O interface virtualization and GPU virtualization.

In the embodiment of the method, configuring the required service subsystem through the service layer specifically includes:

the service layer provides a service subsystem construction interface for the terminal layer;

and configuring a corresponding service subsystem according to a request of the terminal device from a service subsystem construction interface, and providing the corresponding service subsystem for the requested terminal device.

In the above-described embodiment of the method,

the service layer constructs interfaces for the service subsystem provided by the terminal layer, wherein the interfaces comprise a request interface and a response interface of the service subsystem; the request interface comprises one or more request items of the service subsystem type, the type and the number of special equipment required by the service subsystem of the corresponding type, storage capacity, running bandwidth, the requirement of a studio and the size of finished product program volume; the response interface comprises one or more response items in installation, operation and uninstallation of the executable software module of the corresponding type of the service subsystem;

the service layer configures a corresponding service subsystem according to a request provided by the terminal device at a service subsystem construction interface, and provides the corresponding service subsystem to a requesting user terminal, and specifically comprises the following steps:

configuring corresponding service subsystems comprising one or more of a news subsystem, a media resource subsystem, a production subsystem and a production subsystem according to request items sent by a terminal device through a request interface;

each configured service subsystem is provided to the user terminal for installation and operation in the form of an executable software module through the response interface.

In the above-described embodiment of the method,

through the terminal device oriented to different application service scenes in the terminal layer, the method for acquiring the corresponding service subsystem from the service layer to perform the corresponding operation of program production specifically comprises the following steps:

the terminal device requests an executable software module of a corresponding service subsystem from the service layer according to the requirement of the application service and installs the executable software module;

and operating the installed executable software module to perform one or more operations in the processes of news production, media asset management, program production and production.

In the above-described embodiment of the method,

the core service for media processing, production and content management is provided through a platform layer, and the core service specifically comprises the following steps:

the business layer sends a production management service request to the platform layer through the running executable software module according to the terminal device;

the platform layer provides production line organization and business process management for the executable software module through the production management platform according to a production management service request sent by the business layer, wherein the production management service request comprises one or more of modeling, curing, monitoring, analyzing and optimizing the business process;

the executable software module sends a resource scheduling request and/or a media processing request to the platform layer through the production management platform in the process of executing the corresponding business process;

the platform layer dispatches corresponding virtual resources from each resource pool of the resource layer through the media processing platform according to the resource dispatching request, and returns the corresponding virtual resources to the corresponding business process through the production management platform; and/or coordinating and scheduling and executing corresponding media processing services according to the media processing request, wherein the corresponding media processing services comprise one or more of migration, rendering and composition, transcoding/unpacking, verification, content cataloging and accessing and content publishing of media files, and corresponding media processing results are returned to corresponding service processes through the production management platform.

The executable software module sends a production content management service request to the platform layer through the production management platform in the process of executing the corresponding business process;

the platform layer provides content and storage management services thereof through the content management platform according to the production content management service request, and comprises one or more of life cycle management and file content prompt, retrieval, access and authority control of the program material files and metadata information thereof, the full media files and the metadata information thereof, and management of file content.

Claims

1. A non-linear editing mobile workstation terminal device used by a television station production system is characterized by comprising a parallel processing device and a program interaction interface module; wherein:

2. The terminal apparatus of claim 1, wherein the parallel processing means comprises one or more of a program highdefinition conversion module, a program format conversion module, and a program editing module, wherein:

the program high-definition and high-definition conversion module is used for converting a high-definition material into a standard-definition material on a standard-definition time line in real time or converting the standard-definition material into the high-definition material on the high-definition time line in real time in parallel; the transformed program material is transmitted back through the program interaction interface module;

the program format conversion module is used for performing mixed editing on the multi-format material and converting the edited material into a format required by transmission; the program material after being converted is transmitted and edited through the program interaction interface module;

the program editing module is used for carrying out one or more processing operations of clipping, splicing, caption inserting and special effect arrangement on collected or imported program materials of videos, audios, images and texts, and directly exporting or synthesizing a processing result as a finished program into the finished program; and importing program materials or exporting finished programs through the program interaction interface module.

3. A universal mobile terminal device used in a television station production system is characterized by comprising a data interaction module, a service processing device and/or a program auditing device, wherein:

4. The terminal device according to claim 3, wherein the service processing device comprises a topic definition module, a topic assignment module, a topic search module, a manuscript loading and editing module, and a manuscript loading and auditing module, which are connected in sequence, wherein:

a topic assignment module for assigning the newly created topic to a user of the terminal device;

a topic search module for searching for the assigned topic by the user;

a manuscript loading editing module, which is used for the service terminal user to edit the manuscript offline or online according to the claimed selected topic loading, wherein the editing comprises one or more operations of manuscript generation, editing, splicing, subtitle processing and special effect processing, and the edited manuscript is uploaded to a corresponding service subsystem;

and the manuscript loading and checking module is used for loading manuscripts which are edited in an off-line or on-line mode aiming at the claimed questions by a user of the terminal device, and uploading the manuscripts to the corresponding service subsystem after the loaded manuscripts are checked.

5. The terminal device according to claim 3, wherein the program auditing device comprises a program loading module to be audited, a media format conversion module, an auditing broadcast module and an auditing opinion feedback module, which are connected in sequence, wherein:

6. Terminal device according to any of claims 3 to 5, characterized in that said universal mobile terminal device comprises: one or more of a notebook computer, an intelligent tablet computer and a smart phone.

7. The utility model provides a live terminating set of streaming media that TV station production system used which characterized in that includes dedicated interface module and the wireless network transmission module that connects gradually at least, wherein:

8. The live streaming media terminal device of claim 7, further comprising a code rate adaptive adjusting module between the dedicated interface module and the wireless network transmission module, wherein:

the code rate self-adaptive adjusting module is used for self-adaptively adjusting the code rate of the audio and video file to the code rate of the streaming media file according to the signal fluctuation of the wireless communication network and outputting the streaming media file to the wireless network transmission module;

the wireless network transmission module converts the audio and video data in the streaming media file into wireless signals through the signal transmitting module and transmits the wireless signals to the service subsystem, and also receives the wireless signals of the service subsystem through a built-in signal receiving module and converts the wireless signals into digital signals serving as signal fluctuation of the wireless communication network and provides the digital signals to the code rate self-adaptive adjusting module.

9. The live streaming media terminal device of claim 8, further comprising an encoding module between the dedicated interface module and the code rate adaptive adjusting module, wherein:

the professional audio and video interface of the radio and television in the special interface module also comprises an analog audio and video interface, and audio and video signals shot by the shooting device in real time are directly transmitted to the coding module;

and the coding module is used for coding the audio and video signals by adopting an H.264 coding format, converting the audio and video signals into a digital audio and video file and transmitting the digital audio and video file to the code rate self-adaptive adjusting module for code rate adjustment.

10. A live streaming media terminal device according to any one of claims 7 to 9, further comprising a global positioning system module connected to the wireless network transmission module for providing information data of geographical position to the corresponding service subsystem to locate the location of the terminal device holder.

11. The utility model provides a portable full function adopts and compiles terminal equipment that TV station production system used which characterized in that, including audio video signal collection system, professional interface module, audio video signal editing management module and the network transmission module that connects gradually, wherein:

12. The portable full-function editing terminal device according to claim 11,

one or more of the radio and television professional audio and video interface serial digital interface, the high-definition digital multimedia interface, the digital audio and video interface and the analog audio and video interface in the audio and video signal acquisition device;

the audio and video signal editing management module converts the analog audio and video transmitted by the analog audio and video interface in the audio and video signal acquisition device into a digital audio and video file through a built-in coding module, and performs the field editing and/or storage management; or, the digital audio/video file transmitted by the audio/video signal acquisition device is directly subjected to the field editing and/or storage management;