WO2008106884A1 - Procédé, entité et système d'enregistrement d'un flux de données multimédia - Google Patents

Procédé, entité et système d'enregistrement d'un flux de données multimédia Download PDF

Info

Publication number
WO2008106884A1
WO2008106884A1 PCT/CN2008/070387 CN2008070387W WO2008106884A1 WO 2008106884 A1 WO2008106884 A1 WO 2008106884A1 CN 2008070387 W CN2008070387 W CN 2008070387W WO 2008106884 A1 WO2008106884 A1 WO 2008106884A1
Authority
WO
WIPO (PCT)
Prior art keywords
recording
user
media stream
conversion
attribute
Prior art date
Application number
PCT/CN2008/070387
Other languages
English (en)
French (fr)
Inventor
Zhong Luo
Original Assignee
Huawei Technologies Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co., Ltd. filed Critical Huawei Technologies Co., Ltd.
Publication of WO2008106884A1 publication Critical patent/WO2008106884A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/4147PVR [Personal Video Recorder]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23106Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25833Management of client data involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • H04N21/274Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2747Remote storage of video programs received via the downstream path, e.g. from the server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47214End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6581Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application

Definitions

  • the present invention relates to the field of communications, and in particular to a recording technique for media streams. Background of the invention
  • the main technical problem to be solved by various embodiments of the present invention is to provide a recording method, entity and system for a media stream, so that the network television video can be recorded more efficiently and flexibly.
  • an embodiment of the present invention provides a method for recording a media stream, including the following steps:
  • the network side entity directly records the media stream to the network storage space. Otherwise, the media is recorded according to the recording attribute. The body stream is converted and then recorded to the network storage space.
  • An embodiment of the present invention further provides a media stream recording entity, including:
  • a judging module configured to determine whether an attribute of the media stream to be recorded matches a recording attribute configured by the user
  • a conversion module configured to: when the determining module determines that the attribute of the media stream to be recorded does not match the recording attribute configured by the user, convert the media stream according to the recording attribute;
  • the recording module is configured to record the media stream converted by the conversion module to the network storage space, or directly record the media stream to the network storage space when the determining module determines that the media stream to be recorded matches the recording attribute configured by the user. .
  • Embodiments of the present invention also provide a recording system for a media stream, including a media stream recording entity and a PVR control subsystem according to the above;
  • the PVR control subsystem is used for controlling and managing the PVR service, and notifying the media stream to record the recording attribute configured by the entity user through the control instruction.
  • the network side entity first determines whether the attribute of the media stream to be recorded matches the recording attribute configured by the user. If the match is matched, the media stream is directly recorded to the network storage space. Otherwise, the user is configured to record.
  • the attribute converts the media stream and records it to the network storage space. Enables IPTV videos to be recorded more efficiently and flexibly.
  • FIG. 1 is a schematic diagram of a basic working principle of a PVR service in a network television according to an application scenario of an embodiment of the present invention
  • FIG. 2 is a flow chart of a method for recording a media stream according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a method for recording a media stream according to an embodiment of the present invention
  • FIG. 4 is a configuration of video processing according to an embodiment of the present invention. sample graph
  • FIG. 5 is a schematic diagram of a method for recording a media stream according to an embodiment of the present invention
  • FIG. FIG. 6 is a schematic diagram of a recording method of a media stream according to an embodiment of the present invention
  • FIG. 7 is a schematic diagram of a media stream recording entity according to an embodiment of the present invention. Mode for carrying out the invention
  • Mobile multimedia services can be divided into three categories: streaming media, multimedia messaging, and video communications.
  • streaming media technology is a multimedia application technology developed from the Internet.
  • the so-called streaming technology is that data is transmitted from the server to the client in an uninterrupted stream, and plays when the first packet arrives.
  • Streaming media technology does not require the download of multimedia files, so users do not need to wait for a long time. The traditional way to do this is to download the multimedia file to the user terminal before playing it.
  • Streaming media is a new technology that integrates communication and the Internet. It can play multimedia content such as audio and video through streaming media services. It can also be on-demand and interactive. For example, based on mobile video services, streaming media technology is used. Implemented mobile streaming video services. The flexibility of mobile streaming services and the very short latency of streaming media playback allow users to instantly view and listen to mobile video and audio. Therefore, streaming media will become the basic form of communication on the Next Generation Network (NGN).
  • NTN Next Generation Network
  • streaming media has spawned many forms of multimedia communication services: conference TV/videophone, IPTV, VOD (on-demand), instant messaging and more.
  • FIG. 1 is a schematic diagram of a basic working principle of a PVR service in a network television according to an application scenario of an embodiment of the present invention. As shown in FIG.
  • the PVR service allows a user to select a certain part of a recorded program by a user input and control device such as a remote controller as needed while watching a network television program broadcast, under the control of the user instruction, the network television
  • the user terminal writes the video/audio stream from the network television network to the local storage device for storage, and usually saves the form as a multimedia file, such as AVI, mpg, and the like.
  • the online storage space for a fee.
  • This storage space is also generally provided by the network TV operator.
  • the video/audio stream can be sent directly from the content source (ie the streaming server) to the online storage device for storage.
  • users can also perform automatic personal video recording by setting certain conditions, such as timed recording, or recording certain channels.
  • Network storage Since network storage is developed from the perspective of technology or telecom/Internet value-added services, the development is very rapid. Network storage expands the personal storage space, enabling IPTV user terminals to download more content without worrying about the need to constantly upgrade their own hard drives. This kind of consumer behavior can lead operators to get more content downloads and traffic increases. Service income.
  • the PVR control subsystem sends a control instruction to the network side entity for recording the media stream, and the network side entity determines, according to the received control instruction, whether the media stream to be recorded and the recording attribute configured by the user are Match, if yes, record the media stream directly to the network storage space. Otherwise, convert the media stream to the network storage space according to the recording properties.
  • the method for converting the media stream according to the recording attribute includes at least one of the following: media format conversion, media format conversion, selection and extraction of intelligent conversion of part of the media stream;
  • the audio media stream, the manner in which the media stream is converted according to the recording attribute includes: media format conversion and/or media format conversion.
  • the media format conversion of the video stream may include a compression encoding format conversion.
  • the intra-media format conversion of the video stream can include bit rate conversion, frame rate conversion, image resolution conversion, color channel number conversion, or a combination thereof, and the like.
  • the media format conversion of the video stream may also include other transformation modes, which are not limited in the embodiment of the present invention.
  • Intelligent conversion of video streams may include extracting and recording scene key frames, extracting recordings of intra-coded frames, extracting recordings of classified scenes, extracting recordings of specific person-related scenes, or combinations thereof, and the like.
  • the intelligent conversion of the video stream may also include other transformations, which are not limited by the embodiments of the present invention.
  • the inter-media format conversion of the audio stream can include a compression encoding format transform.
  • the intra-media format conversion of the audio stream includes bit rate conversion.
  • the media format conversion of the audio stream may also include other transformation modes, which are not limited in this embodiment of the present invention.
  • the embodiment relates to a method for recording a media stream.
  • the media stream in this embodiment is a network television media stream.
  • the specific process is shown in FIG. 2 .
  • the PVR control subsystem sends a control command to the network side entity for recording the media stream, that is, the PVR support function entity, to notify the user of the configured recording attribute.
  • the PVR control subsystem supports the following functions:
  • the user terminal's request includes the following aspects:
  • the user terminal requests to record according to the input parameters for the currently playing content; B2. The user terminal requests to start recording and end recording;
  • the B3 user terminal selects a group of configuration items from the service configurations already existing in the database as recording attributes for recording;
  • D. From the user's input, automatically learn and analyze the user's usage habits, preferences, etc., and supplement the user's service configuration.
  • the PVR control subsystem needs to notify the PVR to support the recording attribute of the user-configured function entity through the control command, the PVR control subsystem first needs to obtain the recording attribute of the user configuration first.
  • the PVR control subsystem first acquires the user-configured recording attributes currently used to record the media stream in one of the following ways:
  • the recording properties configured for the user with the default recording properties.
  • the user specifies to the PVR control subsystem which data items in the service configuration are used as recording attributes.
  • the PVR control subsystem retrieves the corresponding data from the user database, and controls the PVR support function entity to perform recording through the control command.
  • the user assigns a new recording attribute to the PVR control system.
  • the PVR controls the PVR support function entity to record according to the new recording attribute specified by the user through the control command.
  • the PVR control subsystem first goes to the user. In the database, find a data item that best matches the attribute of the program to be recorded (like the attribute recorded before the class program) as the recording attribute; if the user service configuration is empty for the new user, the PVR control subsystem adopts a set of default Recording properties, the PVR control subsystem controls the PVR support function entity to record according to the recording attribute through control commands.
  • Program Type 1 A set of recording parameters
  • Program Type 2 Group Recording Parameters
  • Program Type N Group Recording Parameters
  • Combination condition 2 Group recording parameters Combination condition P A group of recording parameters
  • the PVR support function entity determines whether the media stream to be recorded matches the recording attribute configured by the user.
  • the PVR support function entity obtains the recording attribute of the user configuration according to the control instruction from the PVR control subsystem, and determines whether the attribute of the broadcast media stream from the network television content source to be recorded matches the recording attribute configured by the user. If yes, proceed to step 230, and directly record the media stream to the network storage space, that is, record the media stream to the network storage space; if not, proceed to step 240, and the PVR supports the function entity to record the attribute according to the user configuration. Convert the media stream. The trend of media streams between entities in the system is shown in Figure 3.
  • the manner in which the PVR support function entity converts the media stream of the video according to the recording attribute configured by the user includes one of the following or any combination thereof: media format conversion, media format conversion, selection, and extraction.
  • Intelligent conversion of part of the media stream; the way to convert the audio media stream includes media format conversion and/or media format conversion. That is to say, the PVR support function entity first copies the media stream, obtains a copy stream, and then converts the copy stream to a recording stream that matches the recording attribute configured by the user.
  • the conversion of the video stream and the audio stream will be described in detail below.
  • the basic functions of the PVR support function entity for media format conversion and media format conversion include:
  • Compression encoding format conversion such as conversion from MPEG-2 to H.264.
  • Bit rate conversion for example, from 3072kbps to 768kbps.
  • Frame rate conversion, or adjustment such as from 25fps to 15fps.
  • Image resolution conversion or adjustment, such as from HD 1080i resolution to SD D1 resolution.
  • Color channel number conversion, or adjustment such as reducing from 3 channels to one channel (reducing to 2 channels, although not practical, but within the scope of this embodiment), that is, from color to black and white.
  • A6 A combination of any two or more of the above, such as from MPEG-2 3072kbps 1080i HD, to H.264, 768kbps, D1 SD.
  • the PVR supports the functional entity to select an optimal transformation order according to the processing complexity and the information loss of the processing. For example, if you need to perform compression format conversion and then adjust the bit rate, then you need to configure.
  • the principle of configuration is to combine different conversions in the optimal order.
  • the so-called optimal order means that if two or more (including two) types of conversions are involved, which ones are first and which ones are later, the effects may be different in terms of processing complexity, information loss of processing, etc., then it is necessary to select One of the best performing configurations. If the compression format conversion is performed first, then the bit rate adjustment is performed, etc., the result of the configuration is as shown in FIG.
  • Bit rate conversion or adjustment, such as from 128kbps to 32kbps.
  • the PVR support functional entity also needs to select the optimal transformation order according to the processing complexity and the information loss of the processing.
  • the basic functions of the PVR support function entity for intelligent conversion include:
  • Extract and record scene keyframes Filter and analyze a copy stream of the broadcast stream (processing complex The flow is to ensure the real-time nature of the broadcast stream.
  • the key frames of each scene are extracted (you can set the ratio of key frames to all frames, such as 1/20), and only the key frame sequence is recorded.
  • Extract recording of intra-coded frames ie, Intra frames or I-frames: Filters and analyzes a copy stream of the broadcast stream, and extracts the intra-coded frames for recording.
  • Extracting and recording the classified scene Filtering and analyzing a copy stream of the broadcast stream, extracting the classified scenes, such as soccer shots, action shots, natural scenery, etc.
  • Extracting records of specific people-related scenes Filtering and analyzing a copy stream of the broadcast stream, extracting content related to a celebrity, such as a presidential visit piece in the news.
  • the PVR support function entity needs to select an optimal extraction recording order according to the processing complexity and the information loss of the processing.
  • the PVR support function entity saves the converted recording stream to the network storage space, so that the network television video can be recorded more efficiently and flexibly.
  • the storage space required for recording the network television program is reduced, thereby achieving efficient and flexible recording of the network television.
  • the purpose of video has broadened the scope of application of PVR in current network TV, attracting more network TV users to provide operators with new types of services, thus opening up new sources of income.
  • the PVR support function entity is controlled by the PVR control subsystem to convert the media stream to the network storage space after the user-configured recording attribute is converted, but the PVR control subsystem controls the functional entity. It may be direct or indirect, that is, indirect control by other functional entities in the middle.
  • the recording stream and the broadcast stream generally have the following attributes:
  • Media compression encoding format such as H.264, SMPTE VC1, MPEG-2/MPEG-4, etc., bit rate (eg 384kbps, 512kbps, 1024kbps, 3072kbps, etc.), frame rate (eg 25fps, 30fps, etc.), image resolution (eg 1080i HD, D1 SD, CIF, etc.), color Number of channels (such as color, black and white, etc.);
  • Audio compression encoding formats eg MP-3, MPEG-2/MPEG-4 A AC, OGG Vorbis, etc.
  • bit rate eg 32kbps, 64kbps, 128kbps, 192kbps, etc.
  • the attributes in which the recording stream and the broadcast stream exist are the same, but in the present embodiment, the two streams may have different attributes. Because the broadcast stream is sent by the content source, it is impossible for the user to take care of the special needs of each user.
  • the recording stream can be "tailor-made" for each user.
  • Another embodiment of the present invention relates to a method for recording a media stream, which is in the figure
  • a communication network in a communication network, it can generally be divided into two layers: a service control layer and a bearer layer, and each layer has several functional entities.
  • the bearer layer two or more bearer networks may be involved, such as a bearer network belonging to two operators. Then among these different bearer networks, there is a Network Interworking Functional Entity. In practical applications, the corresponding device form may be a border media gateway.
  • the network interconnection function entity that is, the PVR support function entity is located in the network interconnection function entity, and the network interconnection function entity includes the PVR support function entity, It is a part of it.
  • the network interconnection function entity has to undertake 4 multimedia processing such as compression coding format conversion, such as support for VoIP applications or video communication applications. Therefore, by implementing all functions of the P VR supporting function entity in the network interconnection function entity, multiple existing parts of the network interconnection function entity can be reused, thereby improving resource utilization efficiency and reducing the cost of the entire system. Moreover, since the network location of the network interconnection function entity is very special and is located between different bearer networks, when the advertisement flow needs to span different bearer networks, the network interconnection function entity must pass through. Therefore, the PVR support function entity becomes the only way to broadcast the media stream.
  • the PVR control subsystem can indirectly control the network interconnection function entity through the network interconnection control function entity forwarding control instruction, and perform various PVR related processing, as shown in FIG. 5.
  • Another embodiment of the present invention relates to a method for recording a media stream.
  • the present embodiment is specifically applied to a method for processing a functional entity by using the embodiment shown in FIG.
  • a communication network in a communication network, it can generally be divided into two layers: a service control layer and a bearer layer, and each layer has several functional entities.
  • the media processing function entity is a functional entity in the bearer layer, and its main function is to perform various media related processing, which may include: media compression coding format conversion, speech recognition, speech synthesis, video stream composition (formation in multi-party conferences) Screen), media enhancement processing, etc.
  • the corresponding device form may be a media resource server.
  • all functions of the PVR support function entity are implemented by the media processing function entity, that is, the PVR support function entity is located in the media processing function entity, and the media processing function entity includes the PVR support function entity, It is a part of it.
  • the media processing function entity has to undertake many media processing such as compression coding format conversion, such as support for VoIP applications or video communication applications. Therefore, by implementing all the functions of the PVR support function entity in the media processing function entity, multiple existing parts of the media processing function entity can be reused, thereby improving resource utilization efficiency and reducing the cost of the entire system.
  • the PVR control subsystem can indirectly control the media processing function by forwarding control commands through the network media resource control function entity. Entity, perform various PVR related processing, as shown in Figure 6.
  • FIG. 7 Another embodiment of the present invention relates to a media stream recording entity, as shown in FIG. 7, comprising: a determining module, configured to determine whether a media stream to be recorded matches a recording attribute configured by a user; and a conversion module, configured to be used in the determining module When it is determined that the attribute of the media stream to be recorded does not match the recording attribute configured by the user, the media stream is converted according to the recording attribute.
  • the conversion module further includes: a video conversion module for converting the video stream, an audio conversion module for converting the audio stream, and an intelligent conversion module for selecting a portion of the media stream.
  • the video conversion module, the audio conversion module, and the intelligent conversion module are specifically described below.
  • the video conversion module further includes: a video compression coding format conversion module for performing video compression coding format conversion, a video bit rate adjustment module for performing bit rate conversion, a video frame rate adjustment module for performing frame rate conversion, An image resolution adjustment module for image resolution conversion, a color channel adjustment module for performing color channel number conversion, and a combination for converting a video stream into at least two transformations, according to processing complexity, processing Information loss Select the video distribution and configuration module for the optimal transformation order.
  • the video distribution and configuration module determines, according to the recording attributes in the control signaling from the PVR control subsystem, what processing is performed on the copied playback media stream, and then inputs the copy stream to the corresponding module, such as a video compression encoding format conversion. Module.
  • a combination process such as compression format conversion and bit rate adjustment
  • configuration is required.
  • the principle of configuration is to combine different modules in an optimal order.
  • the so-called optimal order means that if the combination involves two modules, which is first and which is later, the effect may be different in terms of processing complexity, information loss of the processing, etc., then it is necessary to select the group with the best effect. state.
  • the audio conversion module further includes: an audio compression encoding format conversion module for performing audio compression encoding format conversion, an audio bit rate adjustment module for performing bit rate conversion, and a conversion for converting two or more types in the audio stream
  • the audio distribution and configuration module of the optimal transformation order is selected according to the processing complexity and the information loss of the processing.
  • the audio The distribution and configuration module determines what to do with the copied playback media stream based on the recording properties in the control signaling from the PVR control subsystem, and then inputs the replication stream to the corresponding module, such as the compression encoding format conversion module. If combination processing is required, such as first performing compression format conversion, then bit rate adjustment, etc., then configuration is required.
  • the principle of configuration is to combine different modules in an optimal order.
  • the so-called optimal order means that if the combination involves two modules, which is first and which is later, the effect may be different in terms of processing complexity, information loss of the processing, etc., then it is necessary to select the group with the best effect. state.
  • the intelligent conversion module further includes: a scene key module for extracting and recording key frames of the scene, a classification scene extraction recording module for extracting and recording the classified scene, and a specific person related scene for extracting and recording the specific person related scene.
  • the intelligent allocation configuration module that selects the optimal extraction recording order is selected according to the processing complexity and the information loss of the processing.
  • the intelligent distribution configuration module determines, according to the recording attribute in the control signaling from the PVR control subsystem, what kind of processing is performed on the copied broadcast media stream, and then inputs the copy stream to the corresponding module, if necessary, to combine Processing, then configuration is required, the principle of configuration is to combine different modules in the optimal order.
  • the so-called optimal order means that if the combination involves two modules, which is first and which is later, the effect may be different in terms of processing complexity, information loss of the processing, etc., then it is necessary to select the group with the best effect. state.
  • the media stream recording entity needs to save the converted recording stream that matches the user-configured recording attribute to the network storage space, or directly, when the determining module determines that the media stream to be recorded matches the recording attribute configured by the user, directly
  • the stream is recorded to the network storage space, which can be realized by the recording module.
  • the media stream recording entity in this embodiment can be regarded as a PVR support function entity in each embodiment.
  • the user is allowed to follow his own needs and personality.
  • the preference is to record network TV programs to the network storage space, reducing the storage space required for recording network TV programs, thereby achieving the purpose of recording network TV videos efficiently and flexibly, broadening the application range of PVR in current network television, attracting More IPTV users have provided operators with new types of services, opening up new sources of revenue.
  • the media stream recording entity may be located in a network interconnection function entity, such as a media application gateway; or may be located in a media processing function entity, such as a media resource server. That is to say, for device manufacturers, it is possible to develop new products by adding types of devices such as media gateways or media resource processing, adding new product features, and making profits, which brings huge business opportunities.
  • Another embodiment of the present invention is directed to a recording system for a media stream, including the PVR service configuration of the media stream recording entity, the PVR control subsystem, and the user database in the above embodiments.
  • the PVR control subsystem is configured to control and manage the PVR service, and notify the media stream to record the recording attribute configured by the entity user through the control instruction; the PVR service configuration of the user database is used to save the recording attribute of the user. Enables IPTV videos to be recorded more efficiently and flexibly.
  • the PVR control subsystem obtains the recording attribute configured by the user in one of the following ways: According to the request sent by the user terminal of the user, the recording attribute specified by the user is obtained from the PVR service configuration of the user database, as the recording of the user configuration. Attributes;
  • the recording properties configured for the user with the default recording properties.
  • the PVR service configuration saves the recording properties in one of the following ways or any combination thereof: Save the recording properties according to the program type, save the recording properties according to the specific program, and save the recording properties according to the conditions. It should be noted that the PVR control subsystem is further configured to save the added recording attribute of the user to the PVR service configuration, and improve the recording attribute of the saved user by analyzing the recorded attribute of the saved user.
  • the network side entity first determines whether the attribute of the media stream to be recorded matches the recording attribute configured by the user, and if so, directly records the media stream to the network storage space. Otherwise, The media stream is converted to the network storage space according to the recording attribute configured by the user. This allows IPTV videos to be recorded more efficiently and flexibly.
  • the compression encoding format of the media stream to be recorded is MPEG-2, but according to the recording attribute of the user configuration, the compression encoding format is H.264, then the network side entity converts the compression encoding format from MPEG-2 to H. After .264, it is recorded to the network storage space, which reduces the storage space required for recording network TV programs, thus achieving the purpose of recording network TV videos efficiently and flexibly, broadening the application range of PVR in current network TV, and attracting More such conversions may be conversion between media stream formats, conversion within media stream formats such as bit rate conversion, frame rate conversion, image resolution conversion, color channel number conversion, etc., or intelligent conversion, such as extracting and recording scenes.
  • Key frames, extracted recording of intra-coded frames, extracted recording of classified scenes, extracted recording of scenes related to specific people, etc., provide a more personalized recording method, further broadening the application range of personal video recording in current network television , thus attracting more Internet TV users.
  • IPTV programs By allowing users to record IPTV programs to the network storage space according to their own needs and personal preferences, operators have opened up new types of services by opening up new revenue streams.
  • the network side entity may be located in a network interconnection function entity, such as a media gateway. Since the network interconnection function entity itself has to undertake many media processing such as compression coding format conversion work, such as supporting VoIP (packet voice) applications or video communication applications, Reusing multiple existing parts of the network interconnection function entity improves resource utilization efficiency and reduces the cost of the entire system. Moreover, since the network location of the network interconnection function entity is special and is located between different bearer networks, when the media stream needs to span different bearer networks, the network interconnection functional entity must pass through, so that the network side entity becomes the media stream. The only way to go.
  • a network interconnection function entity such as a media gateway. Since the network interconnection function entity itself has to undertake many media processing such as compression coding format conversion work, such as supporting VoIP (packet voice) applications or video communication applications, Reusing multiple existing parts of the network interconnection function entity improves resource utilization efficiency and reduces the cost of the entire system. Moreover, since the network location of the network interconnection function entity is special and is located
  • the network side entity may also be located in a media processing function entity, such as a media resource server. Since the media processing function entity itself has to undertake many media processing such as compression coding format conversion, such as supporting VoIP applications or video communication applications. Therefore, multiple existing parts of the media processing function entity can be reused, which improves resource utilization efficiency and reduces the cost of the entire system.
  • a media processing function entity such as a media resource server. Since the media processing function entity itself has to undertake many media processing such as compression coding format conversion, such as supporting VoIP applications or video communication applications. Therefore, multiple existing parts of the media processing function entity can be reused, which improves resource utilization efficiency and reduces the cost of the entire system.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Description

媒体流的录制方法、 实体及系统
技术领域
本发明涉及通信领域, 特别涉及媒体流的录制技术。 发明背景
随着计算机网络的日益发展, 基于网络的多媒体传输已经越来越普 及,而且人们对多媒体通信内容的要求日益增高,人们不再满足于单一、 被动的传统媒体娱乐方式, 而真正需要的是个性化、 互动化的宽带流媒 体娱乐, 特别是随着移动通信网络技术的进一步发展, 移动多媒体已经 越来越显示其未来广泛和日趋成熟的用户认知以及接受度。
在网络电视的研究和标准化过程中, 网络电视中的一些典型业务受 到高度重视。
但是, 目前的网络电视业务尚未考虑到许多潜在的应用场景, 如高 效和个性化录制、 有选择地自动智能录制、 以及根据用户的使用习惯和 其它参数, 网络自动学习和自动提供量身定做服务等。 因此现有技术中 无法高效而灵活地录制网络电视视频。 发明内容
本发明各实施方式要解决的主要技术问题是提供一种媒体流的录制 方法、 实体及系统, 使得网络电视视频可以被更高效而灵活地录制。
为解决上述技术问题, 本发明的实施方式提供了一种媒体流的录制 方法, 包含以下步骤:
如果待录制的媒体流的属性与用户配置的录制属性相匹配, 则网络 侧实体直接将该媒体流录制到网络存储空间, 否则, 按录制属性对该媒 体流进行转换后再录制到网络存储空间。
本发明的实施方式还提供了一种媒体流录制实体, 包含:
判断模块, 用于判断待录制的媒体流的属性与用户配置的录制属性 是否匹配;
转换模块, 用于在判断模块判定待录制的媒体流的属性与用户配置 的录制属性不匹配时, 按该录制属性对该媒体流进行转换;
录制模块,用于将经转换模块转换后的媒体流录制到网络存储空间, 或者, 在判断模块判定待录制的媒体流与用户配置的录制属性匹配时, 直接将该媒体流录制到网络存储空间。
本发明的实施方式还提供了一种媒体流的录制系统, 包含根据上文 中所述的媒体流录制实体、 和 PVR控制子系统;
PVR控制子系统用于对于 PVR业务进行控制和管理, 并通过控制 指令通知媒体流录制实体用户配置的录制属性。
应用本发明实施例后, 网络侧实体先判断待录制的媒体流的属性与 用户配置的录制属性是否匹配, 如果匹配, 则直接将该媒体流录制到网 络存储空间, 否则, 按用户配置的录制属性对该媒体流进行转换后录制 到网络存储空间。 使得网络电视视频可以被更高效而灵活地录制。 附图简要说明
图 1是本发明实施例一个应用场景的网络电视中 PVR业务的基本工 作原理示意图;
图 2是根据本发明一个实施例的媒体流的录制方法流程图; 图 3是根据本发明一个实施例的媒体流的录制方法示意图; 图 4是根据本发明一个实施例中视频处理的组态示例图;
图 5是根据本发明一个实施例的媒体流的录制方法示意图; 图 6是根据本发明一个实施例的媒体流的录制方法示意图; 图 7是根据本发明一个实施例的媒体流录制实体示意图。 实施本发明的方式
移动多媒体业务可以分为流媒体 ( streaming media )、 多媒体消息、 视频通信等三类。 其中, 流媒体技术是从互联网上发展起来的一种多媒 体应用技术。 所谓流媒体技术是数据从服务器端向客户端以不间断的流 方式传送, 当第一个数据包到达时就开始播放。 流媒体技术不需要下载 多媒体文件, 因此用户不需要长时间等待。 与之相对应的传统方式, 是 将多媒体文件下载到用户终端之后才能播放。 流媒体是一项将通信、 Internet等融合到一起新技术, 通过流媒体业务能够播放音频以及视频 等多媒体内容, 也可对其进行点播, 具有交互性, 例如基于移动视频业 务采用流媒体技术所实现的移动流媒体视频业务。 移动流媒体业务的灵 活性, 以及流媒体启动播放的延时非常短等特性, 使得用户能够即时收 看收听到移动视频和音频。 因此流媒体将成为下一代网络 (Next Generation Network, 筒称" NGN" )上的基本的通信形式。
流媒体 ( streaming media )作为一种基本的多媒体通信形式, 派生 出了众多的多媒体通信业务形式: 会议电视 /可视电话, 网络电视, VOD (点播), 即时通信等等。
网络电视业务的一项典型业务是所谓的"个人视频录制"( Personal Video Recording, 筒称" PVR" )。就是把来自网络电视的视频 /音频内容在 网络电视用户终端所连接的本地存储设备上(比如硬盘), 或者网络存 储空间(需要付费使用)进行存储, 以供以后观看或者服务于其它用途。 网络电视用户终端可以是 STB (网络机顶盒), 也可以是 PC机(个人计 算机)。 图 1是本发明实施例一个应用场景的网络电视中 PVR业务的基本工 作原理示意图。 如图 1所示, PVR业务允许用户在观看网络电视节目播 出的时候, 根据需要通过遥控器等用户输入和控制设备来选择录制节目 中的某个片断, 在用户指令的控制下, 网络电视用户终端将来自网络电 视网络的视频 /音频流写入到本地存储设备, 进行保存, 通常保存的形式 为多媒体文件, 比如 AVI, mpg等。
当然还可以通过付费使用网上的存储空间, 这种存储空间一般也是 由网络电视运营商提供的。 如果使用网上存储空间, 那么视频 /音频流可 以从内容源 (即流媒体服务器)直接发送到网上存储设备进行保存。 当 然用户也可以通过设定某些条件, 比如定时录制, 或者录制某些指定频 道等, 实现自动的个人视频录制。
由于网络存储不论从技术还是电信 /Internet增值服务的角度来看, 发展都是很迅速的。 网络存储扩大了个人的存储空间, 使得网络电视用 户终端可以下载更多的内容而不必担心需要不断升级自己的硬盘, 这种 消费行为可以导致运营商获得更多的由内容下载和流量增加带来的服 务收入。
在本发明的实施方式中,由 PVR控制子系统向用于录制媒体流的网 络侧实体发送控制指令, 该网络侧实体根据收到的控制指令判断待录制 的媒体流与用户配置的录制属性是否匹配, 如果是, 则直接将该媒体流 录制到网络存储空间, 否则, 按录制属性对该媒体流进行转换后录制到 网络存储空间。 其中, 对于待录制的视频媒体流, 按录制属性对媒体流 进行转换的方式至少包含以下之一:媒体格式间转换、媒体格式内转换、 选择并提取部分媒体流的智能转换; 对于待录制的音频媒体流, 按录制 属性对媒体流进行转换的方式包含:媒体格式间转换和 /或媒体格式内转 换。 其中,视频流的媒体格式间转换可以包含压缩编码格式变换。 而且, 视频流的媒体格式内转换可以包含比特率变换、 帧率变换、 图像分辨率 变换、 颜色通道数变换或其组合, 等等。 视频流的媒体格式内转换也可 以包括其它的变换方式, 本发明实施例对此并无限定。
视频流的智能转换可以包括提取和录制场景关键帧、 帧内编码帧的 提取录制、 分类场景的提取录制、 特定人物相关场景的提取录制或其组 合, 等等。 视频流的智能转换也可以包括其它的变换方式, 本发明实施 例对此并无限定。
另外,音频流的媒体格式间转换可以包含压缩编码格式变换。 而且, 音频流的媒体格式内转换包含比特率转换。 音频流的媒体格式内转换也 可以包括其它的变换方式, 本发明实施例对此也并无限定。
下面对本发明的一个实施例进行详细说明, 本实施例涉及媒体流的 录制方法, 本实施例中的媒体流为网络电视媒体流, 具体流程如图 2所 示。
在步骤 210中, PVR控制子系统向用于录制媒体流的网络侧实体, 也就是 PVR支持功能实体,发送控制指令,通知该实体用户配置的录制 属性。 其中, PVR控制子系统支持以下功能:
A.对于 PVR业务进行全面控制和管理。
B.接收来自网络电视用户终端的请求, 并且进行处理。 用户终端的 请求包括如下方面:
B1.用户终端请求对于当前播放内容按照输入参数进行录制; B2.用户终端请求开始录制和结束录制;
B3用户终端从已经存在于数据库中的服务配置中选择一个一组 配置项作为录制属性进行录制;
C.用户输入新的录制属性, 加入到该用户的服务配置中去。 D.从用户的输入中, 自动学习分析用户的使用习惯, 喜好等, 补充 完善该用户的服务配置。
E. 从用户数据库中提取用户服务配置数据, 变成控制指令来控制 PVR支持功能实体。
由于 PVR控制子系统需要通过控制指令通知 PVR支持功能实体该 用户配置的录制属性,因此 PVR控制子系统首先需要先获取该用户配置 的录制属性。
具体地说, PVR控制子系统先通过以下方式之一获取当前用于录制 媒体流的用户配置的录制属性:
根据该用户的用户终端发送的请求,从用户数据库的 PVR服务配置 中获取该用户指定的录制属性, 作为该用户配置的录制属性;
从该用户的用户终端发送的请求中获取该用户最新指定的录制属 性, 作为该用户配置的录制属性;
从用户数据库的 PVR服务配置中获取同类节目以前录制的属性,作 为该用户配置的录制属性;
采用缺省的录制属性为用户配置的录制属性。
筒单地说, 用户在对于某个特定节目进行录制的时候, 可以有三种 可能:
A.用户向 PVR控制子系统指定采用其服务配置中的哪些数据项作 为录制属性, 此时, PVR控制子系统从用户数据库中取出相应的数据, 通过控制指令控制 PVR支持功能实体进行录制。
B.用户向 PVR控制系统指定新的录制属性,这种情况下, PVR通过 控制指令控制 PVR 支持功能实体按照用户指定的新的录制属性进行录 制。
C.用户没有指定任何录制属性, 此时, PVR控制子系统首先去用户 数据库中找到一个和需要录制节目属性最为匹配数据项 (如同类节目以 前录制的属性), 作为录制属性; 如果是新用户, 其用户服务配置为空, 则 PVR控制子系统采用一组缺省的录制属性, PVR控制子系统通过控 制指令控制 PVR支持功能实体按照该录制属性进行录制。
在用户数据库的 PVR服务配置,可以按以下方式之一或其任意组合 保存录制属性:
A.根据节目类型保存录制属性: 不同节目类型对应的录制属性, 这 部分数据按照不同节目类型来组织, 比如新闻节目有一组录制参数, 电 影有另外一组录制参数, 如:
节目类型 1 一组录制参数
节目类型 2 —组录制参数 节目类型 N —组录制参数
B.根据特定节目保存录制属性: 不同的特定节目对应的录制属性, 这部分数据按照不同特定节目来组织。 这里就要按照特定节目名称来指 定录制属性, 比如 <<新闻联播>>这个特定节目对应一组录制参数, << 动物世界>>对应一组另外的录制参数, 如:
特定节目 1 一组录制参数
特定节目 2 —组录制参数 特定节目 M —组录制参数
C.根据条件选择保存录制属性: 这部分数据按照不同组合条件来组 织不同参数, 组合条件可以任意定义, 采用逻辑运算符号如 AND, OR, NOT等来组合(比如说, 组合条件 1=动作片 AND 国外电影 AND 片 长小于 150分钟), 如: 组合条件 1 一组录制参数
组合条件 2 —组录制参数 组合条件 P 一组录制参数
接着, 进入步骤 220, PVR支持功能实体判断待录制的媒体流与用 户配置的录制属性是否匹配。
具体地说, PVR支持功能实体根据来自 PVR控制子系统的控制指 令得到用户配置的录制属性后, 判断待录制的来自网络电视内容源的播 发媒体流的属性是否与用户配置的录制属性相匹配, 如果匹配, 则进入 步骤 230, 直接将该媒体流录制到网络存储空间, 也就是将该媒体流录 制到网络存储空间; 如果不匹配, 则进入步骤 240, PVR支持功能实体 按用户配置的录制属性对该媒体流进行转换。 媒体流在系统中各实体间 的走向如图 3所示。
具体地说, 在步骤 240中, PVR支持功能实体按用户配置的录制属 性对视频的媒体流进行转换的方式包含以下之一或其任意组合: 媒体格 式间转换、 媒体格式内转换、 选择并提取部分媒体流的智能转换; 对音 频的媒体流进行转换的方式包含媒体格式间转换和 /或媒体格式内转换。 也就是说, PVR支持功能实体先对该媒体流进行复制,得到一个复制流, 再将该复制流转换到与用户配置的录制属性相匹配的录制流。 下面先对 视频流和音频流的转换进行详细说明。
PVR支持功能实体用于进行媒体格式间转换和媒体格式内转换的基 本的功能包括:
A. 对于视频流, 包括以下属性的转换:
A1. 压缩编码格式变换, 比如从 MPEG-2转换到 H.264.
A2. 比特率变换, 或称调整: 比如从 3072kbps降低到 768kbps。 A3. 帧率变换, 或称调整, 比如从 25fps调整到 15fps。
A4. 图像分辨率变换, 或称调整, 比如从高清 1080i分辨率调整到 标清 D1分辨率。
A5. 颜色通道数变换, 或称调整, 比如从 3个通道降低到一个通道 (降低到 2 个通道虽然没有实际意义, 但也在本实施方式的范围内), 即从彩色到黑白的变换。
A6. 以上任何两种或者多种变换的组合, 比如从 MPEG-2 3072kbps 1080i高清, 变换到 H.264, 768kbps, D1标清。
如果需要进行的转换为至少两种变换的组合,则 PVR支持功能实体 根据处理复杂度, 处理过程的信息损失选择最优的变换顺序。 比如说, 需要先进行压缩格式变换, 再进行比特率调整等, 那么就要进行组态, 组态的原则是把不同的转换按照最优顺序组合起来。 所谓最优顺序的意 思是, 如果涉及到两种以上(包括两种)的转换, 哪个在前, 哪个在后, 可能在处理复杂度, 处理过程的信息损失等方面效果不同, 那么就要选 择效果最好的一种组态。 如果先进行压缩格式变换, 再进行比特率调整 等, 则组态的结果如图 4所示。
B. 对于音频流, 包括以下属性的转换:
B 1. 压缩编码格式变换, 比如从 MPEG AAC转换到 MP3。
B2. 比特率变换, 或称调整, 比如从 128kbps降低到 32kbps。
B3. 以上任何两种或者多种变换的组合。
如果需要进行的转换为至少两种变换的组合,则 PVR支持功能实体 同样需要根据处理复杂度, 处理过程的信息损失选择最优的变换顺序。
下面再对智能转换进行详细说明, PVR支持功能实体用于进行智能 转换的基本的功能包括:
1. 提取和录制场景关键帧: 过滤分析播发流的一个复制流(处理复 制流是为了保证播发流的实时性), 提取其中的每个场景的关键帧 (可 以设定关键帧占所有帧的比例, 比如 1/20 ), 只录制关键帧序列。
2. 帧内编码帧(即 Intra帧或称 I帧)的提取录制: 过滤分析播发流 的一个复制流, 提取其中的帧内编码帧进行录制。
3. 分类场景的提取录制: 过滤分析播发流的一个复制流, 提取其中 的分类场景, 比如足球射门, 动作片的打斗镜头, 自然风光等。
4. 特定人物相关场景的提取录制: 过滤分析播发流的一个复制流, 提取其中和某个名人相关的内容, 比如新闻中的总统出访片断。
5. 以上任何两种或者多种方式的组合。
同样地, 如果需要进行的智能转换为至少两种方式的组合, 则 PVR 支持功能实体需要根据处理复杂度, 处理过程的信息损失选择最优的提 取录制顺序。
接着, 进入步骤 250, PVR支持功能实体将转换后的录制流保存到 网络存储空间, 使得网络电视视频可以被更高效而灵活地录制。
由于在本实施例中, 由于允许用户按照自己的需要和个性化喜好来 录制网络电视节目到网络存储空间, 减少了录制网络电视节目所需的存 储空间, 从而达到了高效而灵活地录制网络电视视频的目的, 拓宽了当 前网络电视中 PVR的应用范围,吸引了更多的网络电视用户为运营商提 供了新的业务类型, 从而开辟了新的收入来源。
值得一提的是, PVR支持功能实体是在 PVR控制子系统的控制下, 实现按用户配置的录制属性对媒体流进行转换后录制到网络存储空间, 但 PVR控制子系统对于该功能实体的控制可能是直接的,也可能是间接 的, 即通过居于中间的其它功能实体来进行间接的控制。
另外, 录制流和播发流一般存在以下属性:
A. 对于视频流: 媒体压缩编码格式 (如 H.264, SMPTE VC1 , MPEG-2/MPEG-4等),比特率(如 384kbps, 512kbps, 1024kbps, 3072kbps 等), 帧率(如 25fps, 30fps等), 图像分辨率(如 1080i高清, D1标清, CIF等), 颜色通道数(如彩色, 黑白等);
B. 对于音频流: 音频压缩编码格式(如 MP-3, MPEG-2/MPEG-4 A AC, OGG Vorbis等), 比特率(如 32kbps, 64kbps, 128kbps, 192kbps 等)。
也就是说, 一般而言, 录制流和播发流存在的属性是相同的, 但是 在本实施方式中, 这两种流可以具有不同属性。 因为播发流是由内容源 发出的, 服务千万用户的, 不可能照顾到每个用户的特殊需求。 而录制 流是可以为每个用户 "量身定做"的。
本发明的另一实施例式涉及媒体流的录制方法, 本实施方式是在图
1所示实施例的基础上, 具体应用于网络互联功能实体的方法。
具体地说, 如图 5所示, 在通信网络中, 一般可以分成两个层面: 业务控制层和承载层, 每个层中都有若干功能实体。
对于在承载层中, 可能涉及两个或者两个以上的承载网络, 比如属 于两个运营商的承载网络。 那么在这些不同的承载网络中间, 存在网络 互联功能实体( Network Interworking Functional Entity )。 在实际应用中, 可能对应的设备形态是边界媒体网关。 在这种情况下, 由这个网络互联 功能实体来实现 PVR支持功能实体的所有功能, 也就是说, PVR支持 功能实体位于该网络互联功能实体中, 网络互联功能实体包含了 PVR 支持功能实体, 做为其一个部分。
由于网络互联功能实体要承担 4艮多媒体处理比如压缩编码格式转化 的工作, 如支持 VoIP应用或者视频通信应用。 因此, 通过在网络互联 功能实体中实现 P VR支持功能实体的所有功能,可以重用网络互联功能 实体中多个已有的部分,提高了资源使用效率,降低了整个系统的成本。 而且, 由于网络互联功能实体的网络位置很特殊, 位于不同的承载 网络之间, 当播发流需要跨越不同的承载网时, 必然经过网络互联功能 实体。 因此, 使得 PVR支持功能实体成为播发媒体流的必经之路。
由于在业务控制层中, 存在对应的网络互联控制功能实体, 负责控 制网络互联功能实体。 因此, 在本实施方式中, PVR控制子系统可以通 过网络互联控制功能实体转发控制指令来间接控制网络互联功能实体, 执行各种 PVR相关的处理, 如图 5所示。
本发明的另一实施例涉及媒体流的录制方法, 本实施方式是在图 2 所示实施例的基础上, 具体应用于媒体处理功能实体的方法。
具体地说, 如图 6所示, 在通信网络中, 一般可以分成两个层面: 业务控制层和承载层, 每个层中都有若干功能实体。
媒体处理功能实体是承载层中的一个功能实体, 其主要功能是进行 各种媒体相关的处理, 可能包括: 媒体压缩编码格式变换, 语音识别, 语音合成, 视频流复合(在多方会议中形成多画面), 媒体增强处理等。 在实际应用中,可能对应的设备形态是媒体资源服务器。在这种情况下, 由这个媒体处理功能实体来实现 PVR支持功能实体的所有功能,也就是 说, PVR支持功能实体位于该媒体处理功能实体中, 媒体处理功能实体 包含了 PVR支持功能实体, 做为其一个部分。
由于媒体处理功能实体要承担很多媒体处理比如压缩编码格式转化 的工作, 如支持 VoIP应用或者视频通信应用。 因此, 通过在媒体处理 功能实体中实现 PVR支持功能实体的所有功能,可以重用媒体处理功能 实体中多个已有的部分,提高了资源使用效率,降低了整个系统的成本。
由于在业务控制层中, 存在对应的媒体资源控制功能实体, 负责控 制媒体处理功能实体。 因此, 在本实施方式中, PVR控制子系统可以通 过网络媒体资源控制功能实体转发控制指令来间接控制媒体处理功能 实体, 执行各种 PVR相关的处理, 如图 6所示。
本发明的另一实施例涉及媒体流录制实体, 如图 7所示, 包含: 判 断模块, 用于判断待录制的媒体流与用户配置的录制属性是否匹配; 转 换模块, 用于在该判断模块判定待录制的媒体流的属性与用户配置的录 制属性不匹配时, 按该录制属性对该媒体流进行转换。 转换模块中进一 步包含: 用于对视频流进行转换的视频转换模块、 用于对音频流进行转 换的音频转换模块、 和用于选择部分媒体流的智能转换模块。 下面分别 对视频转换模块、 音频转换模块、 和智能转换模块进行具体说明。
视频转换模块进一步包含: 用于进行视频压缩编码格式变换的视频 压缩编码格式变换模块、 用于进行比特率变换的视频比特率调整模块、 用于进行帧率变换的视频帧率调整模块、 用于进行图像分辨率变换的图 像分辨率调整模块、 用于进行颜色通道数变换的颜色通道调整模块、 和 用于在视频流的转换为至少两种变换的组合时, 根据处理复杂度, 处理 过程的信息损失选择最优变换顺序的视频分配和组态模块。 该视频分配 和组态模块根据来自 PVR控制子系统的控制信令中的录制属性,决定对 复制的播放媒体流进行何种处理, 然后把复制流输入到相应的模块, 比 如视频压缩编码格式变换模块。 如果需要进行组合处理, 比如先进行压 缩格式变换, 再进行比特率调整等, 那么就要进行组态, 组态的原则是 把不同模块按照最优顺序组合起来。 所谓最优顺序的意思是, 如果组合 涉及两个模块, 哪个在前, 哪个在后, 可能在处理复杂度, 处理过程的 信息损失等方面效果不同, 那么就要选择效果最好的一种组态。
音频转换模块进一步包含: 用于进行音频压缩编码格式变换的音频 压缩编码格式变换模块、 用于进行比特率变换的音频比特率调整模块、 和用于在音频流的转换为两种或多种变换的组合时, 根据处理复杂度, 处理过程的信息损失选择最优变换顺序的音频分配和组态模块。 该音频 分配和组态模块根据来自 PVR控制子系统的控制信令中的录制属性,决 定对复制的播放媒体流进行何种处理, 然后把复制流输入到相应的模 块, 比如压缩编码格式变换模块。 如果需要进行组合处理, 比如先进行 压缩格式变换, 再进行比特率调整等, 那么就要进行组态, 组态的原则 是把不同模块按照最优顺序组合起来。 所谓最优顺序的意思是, 如果组 合涉及两个模块, 哪个在前, 哪个在后, 可能在处理复杂度, 处理过程 的信息损失等方面效果不同, 那么就要选择效果最好的一种组态。
智能转换模块进一步包含: 用于提取和录制场景关键帧的场景关键 制模块、 用于进行分类场景的提取录制的分类场景提取录制模块、 用于 进行特定人物相关场景的提取录制的特定人物相关场景提取录制模块、 和用于在智能转换的方式为至少两种方式的组合时, 根据处理复杂度, 处理过程的信息损失选择最优的提取录制顺序的智能分配组态模块。 同 样地,该智能分配组态模块根据来自 PVR控制子系统的控制信令中的录 制属性, 决定对复制的播发媒体流进行何种处理, 然后把复制流输入到 相应的模块, 如果需要进行组合处理, 那么就要进行组态, 组态的原则 是把不同模块按照最优顺序组合起来。 所谓最优顺序的意思是, 如果组 合涉及两个模块, 哪个在前, 哪个在后, 可能在处理复杂度, 处理过程 的信息损失等方面效果不同, 那么就要选择效果最好的一种组态。
媒体流录制实体需将转换后的与用户配置的录制属性相匹配的录制 流保存到网络存储空间, 或者, 在判断模块判定待录制的媒体流与用户 配置的录制属性匹配时, 直接将该媒体流录制到网络存储空间, 该功能 可通过录制模块实现。
本实施例中的媒体流录制实体即可视为上述各实施方式中的 PVR 支持功能实体。 由于在本实施方式中, 允许用户按照自己的需要和个性 化喜好来录制网络电视节目到网络存储空间, 减少了录制网络电视节目 所需的存储空间, 从而达到了高效而灵活地录制网络电视视频的目的, 拓宽了当前网络电视中 PVR的应用范围,吸引了更多的网络电视用户为 运营商提供了新的业务类型, 从而开辟了新的收入来源。
媒体流录制实体可以位于网络互联功能实体内,如媒体应用网关内; 也可以位于媒体处理功能实体内, 如媒体资源服务器内。 也就是说, 对 于设备制造商来说, 可以通过在媒体网关或者媒体资源处理等设备类型 上开发新的产品,增加新的产品特性, 获得利润,从而带来巨大的商机。
本发明的另一实施例涉及媒体流的录制系统, 包含上述实施例中的 媒体流录制实体、 PVR控制子系统和用户数据库的 PVR服务配置。 该 PVR控制子系统用于对于 PVR业务进行控制和管理, 并通过控制指令 通知媒体流录制实体用户配置的录制属性;该用户数据库的 PVR服务配 置用于保存用户的录制属性。 使得网络电视视频可以被更高效而灵活地 录制。
其中, PVR控制子系统通过以下方式之一获取用户配置的录制属性: 根据该用户的用户终端发送的请求,从用户数据库的 PVR服务配置 中获取该用户指定的录制属性, 作为该用户配置的录制属性;
从该用户的用户终端发送的请求中获取该用户最新指定的录制属 性, 作为该用户配置的录制属性;
从用户数据库的 PVR服务配置中获取同类节目以前录制的属性,作 为该用户配置的录制属性;
采用缺省的录制属性为用户配置的录制属性。
PVR服务配置按以下方式之一或其任意组合保存录制属性: 根据节 目类型保存录制属性、 根据特定节目保存录制属性、 根据条件选择保存 录制属性。 需要说明的是, PVR控制子系统还用于将用户增加的录制属性保存 至 PVR服务配置中,并通过对保存的用户的录制属性的分析,完善该用 户的录制属性。
综上所述, 在本发明实施例中, 网络侧实体先判断待录制的媒体流 的属性与用户配置的录制属性是否匹配, 如果匹配, 则直接将该媒体流 录制到网络存储空间, 否则, 按用户配置的录制属性对该媒体流进行转 换后录制到网络存储空间。 使得网络电视视频可以被更高效而灵活地录 制。
比如说, 待录制的媒体流的压缩编码格式为 MPEG-2, 但根据用户 配置的录制属性要求压缩编码格式为 H.264, 那么, 网络侧实体在将压 缩编码格式从 MPEG-2转换到 H.264后, 再录制到网络存储空间, 减少 了录制网络电视节目所需的存储空间, 从而达到了高效而灵活地录制网 络电视视频的目的,拓宽了当前网络电视中 PVR的应用范围,吸引了更 这种转换可以是媒体流格式间的转换、 媒体流格式内的转换如比特 率变换、 帧率变换、 图像分辨率变换、 颜色通道数变换等, 还可以是智 能转换, 如提取和录制场景关键帧、 帧内编码帧的提取录制、 分类场景 的提取录制、 特定人物相关场景的提取录制等等, 提供了更为个性化的 录制方式, 进一步拓宽了当前网络电视中个人视频录制的应用范围, 从 而吸引了更多的网络电视用户。 由于允许用户按照自己的需要和个性化 喜好来录制网络电视节目到网络存储空间, 为运营商提供了新的业务类 型, 从而开辟了新的收入来源。
上述网络侧实体可以位于网络互联功能实体内, 如媒体网关内。 由 于网络互联功能实体本身就要承担很多媒体处理比如压缩编码格式转 化的工作, 如支持 VoIP (分组语音)应用或者视频通信应用, 因此, 可 以重用网络互联功能实体中多个已有的部分, 提高了资源使用效率, 降 低了整个系统的成本。而且, 由于网络互联功能实体的网络位置 4艮特殊, 位于不同的承载网络之间, 当媒体流需要跨越不同的承载网时, 必然经 过网络互联功能实体, 因此,使得该网络侧实体成为媒体流的必经之路。
上述网络侧实体也可以位于媒体处理功能实体内, 如媒体资源服务 器内。 由于媒体处理功能实体本身就要承担很多媒体处理比如压缩编码 格式转化的工作, 如支持 VoIP应用或者视频通信应用。 因此, 可以重 用媒体处理功能实体中多个已有的部分, 提高了资源使用效率, 降低了 整个系统的成本。
也就是说, 对于设备制造商来说, 可以通过在媒体网关或者媒体资 源处理等设备类型上开发新的产品, 增加新的产品特性, 获得利润, 从 而带来巨大的商机。
虽然通过参照本发明的某些优选实施方式, 已经对本发明进行了图 示和描述, 但本领域的普通技术人员应该明白, 可以在形式上和细节上 对其作各种改变, 而不偏离本发明的精神和范围。

Claims

权利要求书
1、 一种媒体流的录制方法, 其特征在于, 包含以下步骤: 如果待录制的媒体流的属性与用户配置的录制属性相匹配, 则网络 侧实体直接将该媒体流录制到网络存储空间, 否则, 按所述录制属性对 该媒体流进行转换后再录制到网络存储空间。
2、 根据权利要求 1所述的媒体流的录制方法, 其特征在于, 对于待录制的视频媒体流, 所述按录制属性对所述媒体流进行转换 的方式包含以下之一或其任意组合:
媒体格式间转换、 媒体格式内转换、 选择并提取部分媒体流的智能 转换。
3、 根据权利要求 1所述的媒体流的录制方法, 其特征在于, 对于待录制的音频媒体流, 所述按录制属性对所述媒体流进行转换 的方式包含: 媒体格式间转换和 /或媒体格式内转换。
4、 根据权利要求 2所述的媒体流的录制方法, 其特征在于, 所述视频流的媒体格式间转换包含压缩编码格式变换;
所述视频流的媒体格式内转换包含以下之一或者至少两个的任意组 合: 比特率变换、 帧率变换、 图像分辨率变换、 颜色通道数变换; 所述视频流的智能转换包含以下方式之一或者至少两个的任意组 合: 提取和录制场景关键帧、 帧内编码帧的提取录制、 分类场景的提取 录制、 特定人物相关场景的提取录制。
5、 根据权利要求 3所述的媒体流的录制方法, 其特征在于, 所述音频流的媒体格式间转换包含压缩编码格式变换;
所述音频流的媒体格式内转换包含比特率转换。
6、根据权利要求 4或 5所述的媒体流的录制方法, 其特征在于, 如 果所述媒体格式间转换和 /或媒体格式内转换为至少两种变换的组合,则 所述网络侧实体根据处理复杂度, 处理过程的信息损失选择最优的变换 顺序。
7、根据权利要求 4所述的媒体流的录制方法, 其特征在于, 如果所 述智能转换为至少两种方式的组合, 则所述网络侧实体根据处理复杂 度, 处理过程的信息损失选择最优的提取录制顺序。
8、根据权利要求 1所述的媒体流的录制方法, 其特征在于, 所述网 络侧实体根据来自个人视频录制 PVR控制子系统的控制指令得到所述 用户配置的录制属性。
9、 根据权利要求 8 所述的媒体流的录制方法, 其特征在于, 所述 PVR控制子系统通过以下方式之一获取所述用户配置的录制属性: 根据所述用户的用户终端发送的请求,从用户数据库的 PVR服务配 置中获取该用户指定的录制属性, 作为该用户配置的录制属性;
从所述用户的用户终端发送的请求中获取该用户最新指定的录制属 性, 作为该用户配置的录制属性;
从用户数据库的 PVR服务配置中获取同类节目以前录制的属性,作 为所述用户配置的录制属性;
采用缺省的录制属性为所述用户配置的录制属性。
10、 根据权利要求 9所述的媒体流的录制方法, 其特征在于, 所述 用户数据库的 PVR服务配置按以下方式之一或其任意组合保存录制属 性:
根据节目类型保存录制属性、 根据特定节目保存录制属性、 根据条 件选择保存录制属性。
11、 根据权利要求 1至 5, 7至 10中任一项所述的媒体流的录制方 法, 其特征在于, 所述网络侧实体位于网络互联功能实体或媒体处理功 能实体内。
12、 一种媒体流录制实体, 其特征在于, 包含:
判断模块, 用于判断待录制的媒体流的属性与用户配置的录制属性 是否匹配;
转换模块, 用于在所述判断模块判定所述待录制的媒体流的属性与 用户配置的录制属性不匹配时, 按该录制属性对该媒体流进行转换; 录制模块, 用于将经所述转换模块转换后的媒体流录制到网络存储 空间, 或者, 在所述判断模块判定所述待录制的媒体流的属性与用户配 置的录制属性匹配时, 将该媒体流录制到网络存储空间。
13、根据权利要求 12所述的媒体流录制实体, 其特征在于, 所述转 换模块包含:
用于对视频流进行转换的视频转换模块、 用于对音频流进行转换的 音频转换模块、 和用于选择并提取部分媒体流的智能转换模块。
14、根据权利要求 13所述的媒体流录制实体, 其特征在于, 所述视 频转换模块包含: 用于进行视频压缩编码格式变换的视频压缩编码格式 变换模块、 用于进行比特率变换的视频比特率调整模块、 用于进行帧率 变换的视频帧率调整模块、 用于进行图像分辨率变换的图像分辨率调整 模块、 用于进行颜色通道数变换的颜色通道调整模块、 和用于在所述视 频流的转换为至少两种不同变换的组合时, 根据处理复杂度, 处理过程 的信息损失选择最优变换顺序的视频分配和组态模块;
所述音频转换模块包含: 用于进行音频压缩编码格式变换的音频压 缩编码格式变换模块、 用于进行比特率变换的音频比特率调整模块、 和 用于在所述音频流的转换为两种不同变换的组合时, 根据处理复杂度, 处理过程的信息损失选择最优变换顺序的音频分配和组态模块;
所述智能转换模块包含: 用于提取和录制场景关键帧的场景关键帧 模块、 用于进行分类场景的提取录制的分类场景提取录制模块、 用于进 行特定人物相关场景的提取录制的特定人物相关场景提取录制模块、 和 用于在所述智能转换的方式为至少两种不同方式的组合时, 根据处理复 杂度, 处理过程的信息损失选择最优的提取录制顺序的智能分配组态模 块。
15、根据权利要求 12所述的媒体流录制实体, 其特征在于, 所述判 断模块根据从来自 PVR控制子系统的控制指令中得到的所述用户配置 的录制属性, 判断待录制的媒体流的属性与用户配置的录制属性是否匹 配。
16、根据权利要求 12所述的媒体流录制实体, 其特征在于, 所述媒 体流录制实体位于网络互联功能实体或媒体处理功能实体内。
17、 一种媒体流的录制系统, 其特征在于, 包含根据权利要求 12 至 16中任一项所述的媒体流录制实体和 PVR控制子系统;
所述 PVR控制子系统用于对于 PVR业务进行控制和管理, 并通过 控制指令通知所述媒体流录制实体所述用户配置的录制属性。
18、根据权利要求 17所述的媒体流的录制系统, 其特征在于, 还包 含用户数据库的 PVR服务配置, 用于保存用户的录制属性, 所述 PVR 控制子系统通过以下方式之一获取所述用户配置的录制属性:
根据所述用户的用户终端发送的请求,从所述 PVR服务配置中获取 该用户指定的录制属性, 作为该用户配置的录制属性;
从所述用户的用户终端发送的请求中获取该用户最新指定的录制属 性, 作为该用户配置的录制属性;
从所述 PVR服务配置中获取同类节目以前录制的属性,作为所述用 户配置的录制属性; 采用缺省的录制属性为所述用户配置的录制属性。
19、根据权利要求 18所述的媒体流的录制系统, 其特征在于, 所述 PVR控制子系统还用于将用户增加的录制属性保存至所述 PVR服务配 置中,并通过对保存的用户的录制属性的分析,完善该用户的录制属性。
20、根据权利要求 18所述的媒体流的录制系统, 其特征在于, 所述
PVR服务配置按以下方式之一或其任意组合保存录制属性:
根据节目类型保存录制属性、 根据特定节目保存录制属性、 根据条 件选择保存录制属性。
PCT/CN2008/070387 2007-03-05 2008-02-29 Procédé, entité et système d'enregistrement d'un flux de données multimédia WO2008106884A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2007100859551A CN101262583B (zh) 2007-03-05 2007-03-05 媒体流的录制方法、实体及系统
CN200710085955.1 2007-03-05

Publications (1)

Publication Number Publication Date
WO2008106884A1 true WO2008106884A1 (fr) 2008-09-12

Family

ID=39737798

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2008/070387 WO2008106884A1 (fr) 2007-03-05 2008-02-29 Procédé, entité et système d'enregistrement d'un flux de données multimédia

Country Status (2)

Country Link
CN (1) CN101262583B (zh)
WO (1) WO2008106884A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010051058A1 (en) * 2008-11-03 2010-05-06 At&T Intellectual Property I, L.P. System and method for recording and distributing media content
WO2010051059A1 (en) * 2008-11-03 2010-05-06 At&T Intellectual Property I, L.P. System and method for distributing media content
CN105657424A (zh) * 2015-12-30 2016-06-08 深圳市云宙多媒体技术有限公司 一种电影场景的色度编码方法和系统

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101588342A (zh) * 2008-05-19 2009-11-25 华为技术有限公司 一种实现录制业务的方法、装置及系统
CN103166913B (zh) * 2011-12-09 2015-10-21 华为技术有限公司 加密媒体流的录制方法及交换控制设备
CN103167317A (zh) * 2011-12-19 2013-06-19 上海市闸北区信息化服务中心 一种网络视频采集播放系统及采集播放方法
CN103327361B (zh) * 2012-11-22 2018-09-04 南京中兴软件有限责任公司 实时视频通讯回放数据流的获取方法、装置及系统
CN103139602B (zh) * 2013-02-20 2016-11-23 广东欧珀移动通信有限公司 自动录制网络视频的方法及终端
CN103841348B (zh) * 2014-03-31 2017-03-08 华为技术有限公司 视音频录制效果的调节方法、装置和系统
CN105099990B (zh) * 2014-04-28 2018-11-20 华为技术有限公司 媒体录制方法、装置和系统
CN105163133B (zh) * 2015-07-07 2019-01-01 深圳Tcl数字技术有限公司 节目信息的播放方法及装置
CN109548060B (zh) * 2018-12-29 2022-05-13 广州敬信药草园信息科技有限公司 一种针对录播网络异常断开的处理方法
CN114679550A (zh) * 2022-03-18 2022-06-28 上海赛连信息科技有限公司 通用录制的装置及其方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1529503A (zh) * 2003-10-17 2004-09-15 清华大学 一种选择视频网关中视频流转码的方法
US20050097451A1 (en) * 2003-11-03 2005-05-05 Cormack Christopher J. Annotating media content with user-specified information
CN1798328A (zh) * 2004-12-30 2006-07-05 华为技术有限公司 一种实现电视节目内容定制的系统及方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1529503A (zh) * 2003-10-17 2004-09-15 清华大学 一种选择视频网关中视频流转码的方法
US20050097451A1 (en) * 2003-11-03 2005-05-05 Cormack Christopher J. Annotating media content with user-specified information
CN1798328A (zh) * 2004-12-30 2006-07-05 华为技术有限公司 一种实现电视节目内容定制的系统及方法

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010051058A1 (en) * 2008-11-03 2010-05-06 At&T Intellectual Property I, L.P. System and method for recording and distributing media content
WO2010051059A1 (en) * 2008-11-03 2010-05-06 At&T Intellectual Property I, L.P. System and method for distributing media content
US9918036B2 (en) 2008-11-03 2018-03-13 At&T Intellectual Property I, L.P. System and method for recording and distributing media content
CN105657424A (zh) * 2015-12-30 2016-06-08 深圳市云宙多媒体技术有限公司 一种电影场景的色度编码方法和系统

Also Published As

Publication number Publication date
CN101262583B (zh) 2011-06-15
CN101262583A (zh) 2008-09-10

Similar Documents

Publication Publication Date Title
WO2008106884A1 (fr) Procédé, entité et système d&#39;enregistrement d&#39;un flux de données multimédia
US10893322B2 (en) Method of displaying multiple content streams on a user device
US20050125838A1 (en) Control mechanisms for enhanced features for streaming video on demand systems
WO2009140922A1 (zh) 频道信息生成、访问控制、交付方法、iptv系统及装置
US8930442B2 (en) Apparatus and method for playing media content data
CN107534792A (zh) 接收设备、发送设备以及数据处理方法
CN105992013A (zh) 一种rtsp直播录像方法及系统
CN117812346A (zh) 一种显示设备及媒资播放方法
KR101684705B1 (ko) 미디어 컨텐츠 재생 장치 및 방법
KR101507993B1 (ko) 컨텐츠 부분 동기화를 통한 스트리밍 방법 및 시스템
Mauthe et al. MPEG standards in media production, broadcasting and content management
Yim et al. Implementation of a Prototype Personal Live Broadcasting System
Heredia Media Description and Distribution in Content Home Networks
KR20070019670A (ko) VOD(video-on-demand) 스트리밍을 위해향상된 특징을 제공하는 시스템 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08715123

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08715123

Country of ref document: EP

Kind code of ref document: A1