CN107770601A - A kind of method and system towards the personalized presentation of content of multimedia component - Google Patents

A kind of method and system towards the personalized presentation of content of multimedia component Download PDF

Info

Publication number
CN107770601A
CN107770601A CN201610674633.XA CN201610674633A CN107770601A CN 107770601 A CN107770601 A CN 107770601A CN 201610674633 A CN201610674633 A CN 201610674633A CN 107770601 A CN107770601 A CN 107770601A
Authority
CN
China
Prior art keywords
layer
presentation
content
signaling information
layout
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610674633.XA
Other languages
Chinese (zh)
Other versions
CN107770601B (en
Inventor
徐异凌
张文军
李腾
陈浩
王延峰
孙军
柳宁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Jiaotong University
Original Assignee
Shanghai Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to CN202011554495.4A priority Critical patent/CN112601121B/en
Application filed by Shanghai Jiaotong University filed Critical Shanghai Jiaotong University
Priority to CN201610674633.XA priority patent/CN107770601B/en
Priority to CA3026533A priority patent/CA3026533C/en
Priority to US16/319,516 priority patent/US11212592B2/en
Priority to JP2018567837A priority patent/JP6736699B2/en
Priority to KR1020187037922A priority patent/KR102186790B1/en
Priority to PCT/CN2017/097417 priority patent/WO2018033051A1/en
Publication of CN107770601A publication Critical patent/CN107770601A/en
Application granted granted Critical
Publication of CN107770601B publication Critical patent/CN107770601B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866—Management of end-user data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26291—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for providing content or additional data updates, e.g. updating software modules, stored at the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H04N21/6547—Transmission by server directed to the client comprising parameters, e.g. for client setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8543—Content authoring using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Library & Information Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention provides a kind of towards the personalized method and system presented of content of multimedia component, including：In server end, media content component presentation is carried out using the presentation pattern of one or more layers presentation layer superposition, and the signaling information for describing to present layout layer is sent to client；In client, content of multimedia component is presented according to the signaling information of the presentation layer is personalized.The present invention can solve existing content supplier in the good business model for being handed down to user again of integration of the source to content of multimedia, so that content supplier can instruct user terminal to be combined presentation to content by all kinds of means in client device business, and the more new command by simplifying carries out appropriate adjustment to layout, and, solve the problems, such as that existing system can not flexibly provide more personalized digital media service, media services can be made to be applied to the situation that terminal device is different, user's request is different.

Description

A kind of method and system towards the personalized presentation of content of multimedia component
Technical field
The present invention relates to the personalized rendering method of Internet technology and technical field of digital media, in particular it relates to one Method and system of the kind towards the personalized presentation of content of multimedia component.
Background technology
Internet technology and Digital Media development become better and approaching perfection day by day maturation background under, media services also towards abundantization, Complication and individualized development.Content supplier needs the presentation to media content to carry out more careful description, and user is also right Service content presents more selections with it and required.Content of multimedia component refers to can be only in multimedia service or program Stand encoding and decoding and belong to the content of a certain type.In new media services, content supplier can carry from different passages The media content component presented individually need to be presented or combine for diversified video, word, advertisement etc..These components are needed in spy The fixed time appears in the display that AD HOC is carried out in specific region, and this just needs content supplier to inform user equipment, Should in what region, corresponding media content when is presented.Meanwhile user is in the same of consuming multimedia content components When, also have to a certain extent and oneself change the demands such as layout, this also requires that content supplier informs whether user can be to certain The presentation of one content makes a change.
Multiple media contents were often only just assembled into one by traditional service provider before server end transmission Media content, therefore without the consumer-oriented presentation of signaling mechanism of complexity.This does not meet multi-pipeline, diversified new matchmaker not only Hold consumption demand in vivo, be also unsatisfactory for the personalized presentation demand of user.
Through retrieval, Publication No. CN104471953A, Application No. 201380035794.9 application for a patent for invention, it is public A kind of method for being used to provide the individualized content of the sequence of the determination with media content is opened, is comprised the steps of：Controlling The controlling stream of the time control information comprising description content sequence is received in channel；Receive the media of the media content comprising sequence Stream；And the presentation of individualized content is controlled by using the control information, wherein, ranked package contains the first Live Program, The second Live Program is followed by, methods described also includes the overlapping step of the first and second Live Programs of detection.The patent is The presentation of individualized content is controlled by way of the sequence of media content, but is not just solved the above problems still.
The content of the invention
For in the prior art the defects of, the present invention provides a kind of towards the personalized method presented of content of multimedia component And system, the presentation for new content of multimedia component design a set of new signaling mechanism, the mechanism is used to help content and carried Position, size, types of adaptations that client device media content is presented are informed for business, could be adjusted, the information such as transparency, and energy Layout is presented in the renewal that enough letters save so that media content component can be played out accurately in client device business.
According to the first aspect of the invention, there is provided it is a kind of towards the personalized method presented of content of multimedia component, including：
In server end, media content component presentation is carried out using the presentation pattern of one or more layers presentation layer superposition, and The signaling information for describing to present layout layer is sent to client；
In client, content of multimedia component is presented according to the signaling information of the presentation layer is personalized.
Preferably, the signaling information of layout layer is presented in the description, and content includes following one or more：Each layer of sequence Row number, playback equipment number, viewing area center and length and width, floor display order, media content with respect to viewing area adaptation Type, the layer could adjust, transparency.
Further, when needing to update layout, the signaling information for updating presentation layout is sent to by the server end Client.
Preferably, the signaling information of layout is presented in the renewal, and content includes following one or more：Delete layer, addition New layer, the display order for changing layer, the display variable for changing layer, inform how client changes to current presentation.
Preferably, when needing to update layout, server end is changed current by changing all layers of signaling information table Layout.
Preferably, the server end informs the presentation layer signaling information of the corresponding consumption of client media content components, visitor Correct present is realized after family end parsing signaling information.
Preferably, the server end further corresponds to description of presentation layer, description comprising description media content The corresponding level number presented of the media content, level number, the level number of reproducible presentation of commutative presentation clearly should be described accurately Etc. information, replaceable positional information, reproducible positional information that user can be by the media content component that server end is informed Deng the free presentation layer replaced, replicate media, and the label that this layer could adjust for can with when, it is big to the display location of layer Small, display order, adaptation mode, transparency etc. carry out presentation of the personalized adjustment without influenceing other users.
According to the second aspect of the invention, there is provided a kind of server end for being used to realize the above method, including：
Signal deployment interface and generation module, for obtain present layout layer layout information or layout updates information and Content components corresponding informance, and the described information of acquisition is fabricated to signaling information；
Signaling version management module, for the version number of managing signaling information, correct signaling information is sent to visitor Family end；
Signaling sending module, for signaling information to be packaged into packet according to host-host protocol, and it is sent to given client End.
According to the third aspect of the invention we, there is provided a kind of client device for being used to realize the above method, including：
Signaling receives and parsing module, and for receiving the packet containing signaling information, parsing turns into signaling information, and core To version number, correct signaling information is passed into rendering module；
Rendering module, for receiving the signaling information with parsing module transmission according to signaling, by each presentation layer according to cloth Office is correct to be presented, and is shown corresponding media content component is corresponding with presentation layer.
The client device further comprises user interface module, wherein：
The user interface module, for according to presentation layer changeable indicia in signaling information, informing user's presentation layer Variable classification and scope, and personalized adjustment order of the user of acquisition for presentation layer is passed into rendering module and carries out phase Close adjustment；
The rendering module, changed at any time according to the personalized adjustment order of user interface module and layout is presented.
According to the fourth aspect of the invention, there is provided a kind of towards content of multimedia component personalization presentation system, including institute The server-side devices and described client device stated, wherein：
The server-side devices, carrying out media content component using the presentation pattern of one or more layers presentation layer superposition is in It is existing, and the signaling information for describing to present layout layer is sent to client；
The client device, the signaling information of the presentation layer sent according to server end is personalized to be presented multimedia Content components.
Compared with prior art, the present invention has following beneficial effect：
Technical scheme is employed, can solve existing content supplier in integration of the source to content of multimedia The good business model for being handed down to user again so that content supplier can instruct user terminal in client device business to content by all kinds of means Presentation is combined, and the more new command by simplifying carries out appropriate adjustment to layout.And the technical scheme is used, is solved Existing system can not flexibly provide the problem of more personalized digital media service, media services can be made to be applied to terminal device each Situation different, user's request is different.
It is related to some terms in present specification, explains hereby：
MMT：Multi Media Transmission, a media transport protocol defined by MPEG.
PA message：Bag access information file, the information understandable are (the updating for every 0.5 second) periodically sent in MMT agreements For transmitting the message file of the information such as Packet analyzing, presentation；
MP tables：MP tables should be included in PA message, the main essential information for describing media content consumption；
Asset：For building the multi-medium data intersection of multimedia presentation, a video flowing can be simply interpreted as herein Or audio stream file etc., an Asset media data and are shared identical Asset ID MPU and patrolled after one group of carrying coding Compile conjunction；
MPU：The independent minimum media data member that can be solved specified in MMT agreements.
Brief description of the drawings
The detailed description made by reading with reference to the following drawings to non-limiting example, further feature of the invention, Objects and advantages will become more apparent upon：
Fig. 1 is that signalling diagram is presented in one embodiment of the invention；
Fig. 2 is that adaptation schematic diagram is presented in one embodiment of the invention, wherein：To be paved with, b is adapted to a for amplification, and c is Adaptation is reduced, d is original painting；
Fig. 3 is that modules of the present invention transmit signaling and realize personalized presentation flow chart；
Fig. 4 (a) -4 (e) is a concrete application embodiment realization procedure chart of the invention；
Fig. 5 is system architecture diagram in one embodiment of the invention.
Embodiment
With reference to specific embodiment, the present invention is described in detail.Following examples will be helpful to the technology of this area Personnel further understand the present invention, but the invention is not limited in any way.It should be pointed out that the ordinary skill to this area For personnel, without departing from the inventive concept of the premise, various modifications and improvements can be made.These belong to the present invention Protection domain.
Multiple media contents were often only just assembled into one by traditional service provider before server end transmission Media content, therefore without the consumer-oriented presentation of signaling mechanism of complexity.This does not meet multi-pipeline, diversified new matchmaker not only Hold consumption demand in vivo, be also unsatisfactory for the personalized presentation demand of user.
In view of the above-mentioned problems, in server end, the superposition that interpretation of scheme is one or more layers presentation layer will be presented in the present invention Present, have viewing area inside presentation layer to show respective media content, viewing area, layer to each of which layer show suitable The information such as sequence, media content are with respect to the types of adaptations of viewing area, the layer could adjust, transparency are described, and are sent to Client.
When needing to update layout, server end can select to delete layer, the new layer of addition, the display order for changing layer, Change the modes such as the display variable of layer, inform how client changes to current presentation.Meanwhile server end can also pass through Change all layers of information table to change current arrangements.
In terms of media content docking, client need to only inform user, the layer of the corresponding consumption of the media content component being connected to Number, you can realize correct present.User can also by the replaceable positional information of the media content component that server end is informed, Reproducible positional information etc. freely replace, replicate media presentation layer, and the label that this layer could adjust for can with when, it is right Display location size, display order, adaptation mode, transparency etc. of layer carry out personalized adjustment without influenceing other users Present.
Below in conjunction with specific implementation details, the present invention will be described, to further understand technical scheme.
1. the signaling table of layout is presented in a description.
The signaling table clearly should accurately describe the sequence number, playback equipment number, viewing area of each presentation layer presented Domain center and length and width, display order, adaptation mode, could adjust, details, the information field such as transparency are not limited to this It is several, can be according to actual displayed increase in demand description field.In a particular application, the signaling table is used to instruct to present, can be with Made, provided by program provider, for example the signaling information is generated by server end and passes to user.As shown in Figure 1.
By taking ISO/IEC 23008-1 MPEG Media Transport (MMT) standard as an example, introduce description layout is in The description method of existing signaling information.Being there is provided in MMT in the PA message of signaling increases the signaling table, specifically mainly includes following 14 Individual field：
● table number (table_id)：Describe the identifier of the table.
● version number (version)：The version of the table is described, the signaling table of renewal has new version number, can replaced Original signaling table.
● table length (length)：The byte length of the table is described, to description since the next byte of this field Untill last byte.
● display layer number (number_of_layer)：Describe the quantity of the presentation layer described by the table.
● level number (layer_id)：Describe the label of presently described presentation layer in the table.
● device number (device_id)：Describe the corresponding device number presented of presently described presentation layer in the table.Should Represent to be presented on Default device when number being " 0 ".
● viewing area center abscissa (center_x)：Describe in the table and presented in presently described presentation layer The center abscissa in the region of media content.With percentage of the pixel at viewing area center in whole layer horizontal pixel To demarcate.
● viewing area center ordinate (center_y)：Describe in the table and presented in presently described presentation layer The center ordinate in the region of media content.With percentage of the pixel at viewing area center in whole layer vertical pixel To demarcate.
● viewing area width (width)：Describe the area that media content is presented in the table in presently described presentation layer The width in domain.Demarcated with percentage of the pixel of viewing area in whole layer horizontal pixel.
● viewing area height (height)：Describe the area that media content is presented in the table in presently described presentation layer The height in domain.Demarcated with percentage of the pixel of viewing area in whole layer vertical pixel.
● display order (display_order)：Presently described presentation layer is described in the table in all presentation layers Display order.Acquiescence layer is represented when this is sequentially " 0 ", label is small in bottom, label it is big on upper strata.Middle number can be empty Lack, but can not repeat.
● types of adaptations (fitting_type)：Describe when presently described presentation layer in the table plays media content Picture types of adaptations.Types of adaptations is that " 0 " represents to be paved with, that is, changes MPU resolution ratio length-width ratios, whole finger is paved with after stretched Determine region；Types of adaptations is that " 1 " represents amplification adaptation, i.e., does not change the length-width ratio of MPU resolution ratio, and picture is amplified from minimum, Until being adapted on the high Zuo You with screen of Kuan on next direction, remainder mends black surround；Types of adaptations is that " 2 " represent to reduce Adaptation, i.e., do not change the length-width ratio of MPU resolution ratio, picture is reduced from maximum, until next on the high Zuo You with screen of Kuan It is adapted on individual direction, remainder is cut；Types of adaptations is that " 3 " represent original painting, i.e., does not change MPU resolution ratio and length-width ratio, position Put in designated area center, if not being inconsistent with viewing area, insufficient section is mended black or beyond partly cutting out；Types of adaptations is " 5 " represent panorama, i.e., according to the broadcast request of panoramic video, are fitted in layer and play out.Types of adaptations is not limited to the above 5 Kind.
● changeable indicia (adjust_enable_flag)：Describe whether presently described presentation layer in the table can adjust Mark.When should be labeled as " 0 ", represent that user terminal can not be adjusted to the layer；When should be labeled as " 1 ", represent that user terminal can Equipment, viewing area size, position, transparency, types of adaptations etc. are carried out to this layer to be adjusted.
● transparency (transparency)：Describe the transparency of presently described presentation layer in the table.
Generally suggest only adding this signaling table when presentation mode has great change, to reduce redundancy, but be not added with To limit.It is recommended that a kind of form it is as shown in the table, but not limited to this form：
2. the signaling table of layout is presented in a renewal.
The signaling table can be on the basis of layout be presented, and the layer that presents more deleted, added, it is suitable to change display The operations such as sequence, adjustment display parameters.It updates mode of operation and is not limited to that this is several, can be according to actual displayed increase in demand or thin Change mode of operation.The signaling table that layout is presented with the description above for the signaling table is similar, and the letter can also be generated by server end Make information and pass to user.
By taking ISO/IEC 23008-1 MPEG Media Transport (MMT) standard as an example, introduce renewal and layout is presented Signaling information method is described.Being there is provided in MMT in the PA message of signaling increases the signaling table, in addition to the field introduced, Mainly include following 4 fields：
● layer deletes mark (layer_delete_flag)：Whether describe has deletion layer.It should be labeled as representing when " 0 " Layer is not deleted, should be labeled as indicating deletion layer when " 1 ".If any layer is deleted, then the level number for deleting layer should be provided.
● layer increase mark (layer_add_flag)：Whether describe has increase layer.Represented do not have when should be labeled as " 0 " Increase layer, should be labeled as indicating increase layer when " 1 ".If any increase layer, then the complete information for increasing layer should be provided.
● layer order changes mark (layer_display_order_flag)：Whether describe has layer to need to change display Sequentially.Represented there is no layer to need change order when should be labeled as " 0 ", should be labeled as indicating that layer needs change order when " 1 ".Such as There is layer to need change order, then should provide the level number for needing adjustment layer and the layer display order newly provided.
● layer adjustment mark (layer_adjust_flag)：Whether describe has adjustment layer.It should be labeled as representing when " 0 " There is no adjustment layer, should be labeled as indicating adjustment layer when " 1 ".If any adjustment layer, then the parameter after adjustment layer adjustment should be provided Information.
Generally suggest adding this signaling table when presentation mode has small part change, to reduce redundancy, but be not added with To limit.It is recommended that a kind of form it is as shown in the table, but not limited to this form：
3. a description media content corresponds to description of presentation layer.
Description clearly should accurately describe the corresponding level number presented of the media content, commutative presentation level number, The information such as the level number of reproducible presentation, information field are not limited to that this is several, increase in demand description field can be presented according to actual. The signaling table that layout is presented with the description above for the signaling table is similar, and the signaling information can also be generated by server end and is transmitted To user.
By taking ISO/IEC 23008-1 MPEG Media Transport (MMT) standard as an example, it is corresponding to introduce media content The description method of presentation layer.Content components MPU description is provided in MMT MP tables, in addition to the field introduced, mainly Including following 14 fields：
● description subtab (descriptor_tag), the tag name for describing subtype is identified, the description can be positioned Type belonging to son.
● sub- length (descriptor_length) is described, the byte length of description is identified, from the next word of this field Section starts untill last sub byte of the description.
● MPU quantity (number_of_mpu)：Identify the layer number that current MPU should be presented.
● MPU sequence numbers (mpu_sequence_number)：Identify current MPU sequence number, first MPU in Asset Sequence number should be " 0 ", and follow-up each MPU increases " 1 ", sequence number is unique in an Asset.
● MPU shows the number of plies (number_of_layer)：Identify the level number that current MPU should be presented.
● the commutative marks of MPU (layer_exchange_flag)：Certain layer could be correctly presented to by identifying current MPU In the case of, the MPU presented with other layers exchanges presentation layer.Represented only enumerate according to description when should be labeled as " 0 " Level number present, should represent that user terminal can change the MPU and other MPU layer presentation when be labeled as " 1 ".
● the reproducible marks (layer_copy_flag) of MPU：Certain layer of feelings could be correctly presented to by identifying current MPU Under condition, duplication is presented to other layers.It should be labeled as representing only present according to the level number that description is enumerated when " 0 ", the mark Represent that user terminal can replicate the MPU when being designated as " 1 " and be presented to other layers.When replicating presentation, client should cover former layer MPU contents.
● the commutative numbers of plies of MPU (number_of_exchange_layer)：Mark can change layer presentation with current MPU Layer number.
● the commutative level numbers of MPU (exchange_layer_id)：Mark can change the level number of layer presentation with current MPU.
● the reproducible numbers of plies of MPU (number_of_copy_layer)：Represent that the number of plies presented can be replicated by current MPU Amount.
● the reproducible level numbers of MPU (copy_layer_id)：Represent that the level number presented can be replicated by current MPU.
It is recommended that a kind of form it is as shown in the table, but not limited to this form：
Based on the explanation of above-mentioned technical characteristic, in one embodiment, the personalized method presented of content of multimedia is mainly real Applying flow is：
1. service provider knows the media content to all sources, and the service provided as needed is established in media Hold the layout that combination is presented.
2. the layout information presented required for service provider and multimedia server analysis, and according to above-mentioned signaling table Form makes signaling information, and is sent to client using the signaling information as content components.
3. signaling information is presented in client parsing, the signaling table that layout is presented according to description is presented each layer in sequence On client display device, media content is played to corresponding layer by description that presentation layer is corresponded to further according to media content In.
4. in the case where signaling information allows, client can inform that some presentation layers of user can be adjusted, visitor Family end carries out personalized adjustment according to user instruction to presenting.
As shown in figure 5, in an embodiment of the present invention, for realizing the server-side devices of the above method, comprising：
Signal deployment interface and generation module.The module need to open figure or procedural language interface to service provider, So as to obtain the layout information of presentation (or layout updates information) and content components corresponding informance, and the information is special according to this Require to be fabricated to signaling information in profit.
Signaling version management module.The module is responsible for the version number of signaling information, it is ensured that by correct signaling information It is sent to client.
Signaling sending module.The module needs signaling information being packaged into packet according to host-host protocol, will by channel Signaling information is sent to given client end.
As shown in figure 5, in an embodiment of the present invention, for realizing the client device of the above method, comprising：
Signaling receives and parsing module.Packet containing signaling information should be able to be properly received by the module from channel And parsing turns into signaling information, and version number is checked, ensure correct signaling information passing to rendering module.
Rendering module.Each layer correctly should be able to be presented on visitor by the module according to the requirement of signaling information according to layout On the display device of family end, and by the display corresponding with layer of corresponding media content component, while it should also be operated and connect according to user The operation information of mouth mold block changes presentation layout at any time.
User interface module.The module should be according to the requirement of signaling information middle level changeable indicia, according to client The executive mode of software, client layer variable classification and scope are informed, and the user of acquisition is changed to the information transmission of layer presentation Related adjustment is carried out to rendering module.
Further, in a concrete application embodiment, each field of signaling information in each scene is listed respectively Assignment situation.Wherein, the dark media resource for representing Asset1.Light color represents Asset2 media resource.
(1) shown in initial layout such as Fig. 4 (a), it is the part MPU in Asset1 to play content, and adaptation mode is suitable for amplification Match somebody with somebody.
(2) renewal layout is new to add one layer such as shown in Fig. 4 (b), plays content as the part MPU in Asset2, adaptation side Formula is to be paved with.
(3) due to all describing commutative layer letter respectively in two Asset MPU_consumption_descriptor Breath, therefore two layers of content can be swapped display by client according to the information, update signaling information without server end, its Shown in schematic diagram such as Fig. 4 (c).
(4) because in Layer_display_update_table 1, its changeable indicia is in being described to layer1 " 1 ", that is, represent that this layer of user can be changed.Therefore, user can change the size of this layer of viewing area, center, Transparency etc., shown in its schematic diagram such as Fig. 4 (d).
(5) when the Asset2 resources in layer1 finish, corresponded to therewith without corresponding MPU in the layer It has been shown that, therefore the layer automatically removes in client, shown in its schematic diagram such as Fig. 4 (e).
The present invention uses the presentation pattern of one or more layers presentation layer superposition and is based on signaling mechanism, to being carried by server end The presentation in multimedia service to multiple content components supplied is instructed, can not so as to solve multimedia multicompartment content It is effective to play, it is impossible to which that the deficiency of personalized digital media service is flexibly provided.
The specific embodiment of the present invention is described above.It is to be appreciated that the invention is not limited in above-mentioned Particular implementation, those skilled in the art can make various deformations or amendments within the scope of the claims, this not shadow Ring the substantive content of the present invention.

Claims (11)

  1. It is 1. a kind of towards the personalized method presented of content of multimedia component, it is characterised in that including：
    In server end, media content component presentation is carried out using the presentation pattern of one or more layers presentation layer superposition, and will retouch The signaling information for stating presentation layout layer is sent to client；
    In client, content of multimedia component is presented according to the signaling information of the presentation layer is personalized.
  2. It is 2. according to claim 1 towards the personalized method presented of content of multimedia component, it is characterised in that；Description institute The signaling information that layout layer is presented is stated, content includes following one or more：The sequence number of each floor, playback equipment number, display Regional center position and length and width, layer display order, media content could adjust, thoroughly with respect to the types of adaptations of viewing area, the layer Lightness.
  3. It is 3. according to claim 1 towards the personalized method presented of content of multimedia component, it is characterised in that to need During renewal layout, the signaling information for updating presentation layout is sent to client by the server end.
  4. It is 4. according to claim 3 towards the personalized method presented of content of multimedia component, it is characterised in that when, The signaling information of layout is presented in the renewal, and content includes following one or more：Layer is deleted, new layer is added, changes layer Display order, the display variable for changing layer, inform how client changes to current presentation.
  5. It is 5. according to claim 3 towards the personalized method presented of content of multimedia component, it is characterised in that to need During renewal layout, server end changes the signaling information for describing that layout layer is presented to instruct client to change current cloth by sending Office.
  6. 6. existing towards the personalized method presented of content of multimedia component, its feature according to claim any one of 1-5 In the server end informs the presentation layer signaling information of the corresponding consumption of client media content components, client parsing signaling Correct present is realized after information.
  7. 7. existing towards the personalized method presented of content of multimedia component, its feature according to claim any one of 1-5 In, the server end further comprising description media content correspond to presentation layer description son, the description son clearly it is accurate The corresponding level number presented of the media content, level number, the layernumber information of reproducible presentation of commutative presentation are described, client passes through Replaceable positional information, the reproducible positional information for the media content component that server end is informed, it is free to replace, replicate media Presentation layer, and the label that this layer could adjust for can with when, to the display location size of layer, display order, adaptation mode, Transparency carries out presentation of the personalized adjustment without influenceing other users.
  8. A kind of 8. server-side devices for being used to realize any one of the claims 1-7 method, it is characterised in that：Including：
    Signal deployment interface and signaling generation module, presented for obtaining layout layer layout information or layout updates information and Content components corresponding informance, and the described information of acquisition is fabricated to signaling information；
    Signaling version management module, for the version number of managing signaling information, correct signaling information is sent to client Equipment；
    Signaling sending module, for signaling information to be packaged into packet according to host-host protocol, and it is sent to given client end and sets It is standby.
  9. A kind of 9. client device for being used to realize any one of the claims 1-7 method, it is characterised in that：Including：
    Signaling receives and parsing module, the packet containing signaling information sent for the reception server end equipment, is parsed into For signaling information, and version number is checked, correct signaling information is passed into rendering module；
    Rendering module, for according to signaling receive with the signaling information of parsing module transmission, by each presentation layer according to layout just Really present, and by corresponding media content component it is corresponding with presentation layer show.
  10. 10. client device according to claim 9, it is characterised in that：Further comprise user interface module：
    The user interface module, for according to presentation layer changeable indicia in signaling information, informing that user's presentation layer is variable Classification and scope, and personalized adjustment order of the user of acquisition for presentation layer is passed into rendering module and carries out related tune It is whole；
    The rendering module, change presentation layout at any time according to the adjustment order of user interface module.
  11. A kind of 11. system for realizing any one of the claims 1-7 method, it is characterised in that：Including claim 8 institute The client device described in server-side devices and any one of claim 9 or 10 stated, wherein：
    The server-side devices, media content component presentation is carried out using the presentation pattern of one or more layers presentation layer superposition, And the signaling information for describing to present layout layer is sent to client；
    The client device, the signaling information of the presentation layer sent according to server end is personalized to be presented content of multimedia Component.
CN201610674633.XA 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components Active CN107770601B (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
CN201610674633.XA CN107770601B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components
CN202011554495.4A CN112601121B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components
US16/319,516 US11212592B2 (en) 2016-08-16 2017-08-14 Method and system for personalized presentation of multimedia content assembly
JP2018567837A JP6736699B2 (en) 2016-08-16 2017-08-14 Method and system for customized display for multimedia content elements
CA3026533A CA3026533C (en) 2016-08-16 2017-08-14 Method and system for personalized presentation of multimedia content assembly
KR1020187037922A KR102186790B1 (en) 2016-08-16 2017-08-14 Personalization expression method and system for multimedia contents widget
PCT/CN2017/097417 WO2018033051A1 (en) 2016-08-16 2017-08-14 Method and system for personalized presentation of multimedia content assembly

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610674633.XA CN107770601B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202011554495.4A Division CN112601121B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components

Publications (2)

Publication Number Publication Date
CN107770601A true CN107770601A (en) 2018-03-06
CN107770601B CN107770601B (en) 2021-04-02

Family

ID=61196372

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201610674633.XA Active CN107770601B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components
CN202011554495.4A Active CN112601121B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202011554495.4A Active CN112601121B (en) 2016-08-16 2016-08-16 Method and system for personalized presentation of multimedia content components

Country Status (6)

Country Link
US (1) US11212592B2 (en)
JP (1) JP6736699B2 (en)
KR (1) KR102186790B1 (en)
CN (2) CN107770601B (en)
CA (1) CA3026533C (en)
WO (1) WO2018033051A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063850A1 (en) * 2018-09-27 2020-04-02 华为技术有限公司 Method for processing media data and terminal and server

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101379823A (en) * 2006-02-07 2009-03-04 东京电力株式会社 Content edition/generation system
CN102143231A (en) * 2011-04-01 2011-08-03 奇智软件（北京）有限公司 Terminal application networked management method and system
US20130021431A1 (en) * 2011-03-28 2013-01-24 Net Power And Light, Inc. Information mixer and system control for attention management
US20130096926A1 (en) * 2011-08-26 2013-04-18 Dts Llc Audio adjustment system
CN104094539A (en) * 2011-11-29 2014-10-08 沃驰特公司 System and method for synchronized interactive layers for media broadcast
CN105339881A (en) * 2013-03-14 2016-02-17 维克斯网有限公司 Device, system, and method of website building by utilizing data lists

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3927713B2 (en) * 1998-12-08 2007-06-13 キヤノン株式会社 Broadcast receiving apparatus and method thereof
EP1228453A4 (en) * 1999-10-22 2007-12-19 Activesky Inc An object oriented video system
WO2001043431A2 (en) * 1999-12-09 2001-06-14 Morecom, Inc. Enhanced display of world wide web pages on television
US8769395B2 (en) * 2002-12-13 2014-07-01 Ricoh Co., Ltd. Layout objects as image layers
US8930561B2 (en) * 2003-09-15 2015-01-06 Sony Computer Entertainment America Llc Addition of supplemental multimedia content and interactive capability at the client
US20100225815A1 (en) * 2009-03-05 2010-09-09 Vishal Vincent Khatri Systems methods and apparatuses for rendering user customizable multimedia signals on a display device
CN101794189A (en) * 2009-09-22 2010-08-04 俞长根 Method for displaying image
US11070855B2 (en) * 2011-10-13 2021-07-20 Samsung Electronics Co., Ltd. Apparatus and method for configuring control message in broadcasting system
US20130147787A1 (en) * 2011-12-12 2013-06-13 Sergey Ignatchenko Systems and Methods for Transmitting Visual Content
KR101501344B1 (en) * 2012-05-02 2015-03-10 삼성전자주식회사 Method and apparatus for transmitting and receiving multimedia service
EP2680599A1 (en) * 2012-06-29 2014-01-01 Thomson Licensing Provision of a personalized media content
PT3457654T (en) * 2012-10-11 2021-03-04 Samsung Electronics Co Ltd Apparatus and method for delivering and receiving multimedia data in hybrid network
ITTO20120901A1 (en) * 2012-10-15 2014-04-16 Rai Radiotelevisione Italiana PROCEDURE FOR CODING AND DECODING A DIGITAL VIDEO AND ITS CODIFICATION AND DECODING DEVICES
US9774927B2 (en) * 2012-12-21 2017-09-26 Telefonaktiebolaget L M Ericsson (Publ) Multi-layer video stream decoding
US10009658B2 (en) * 2013-03-11 2018-06-26 Sony Corporation Multiview TV template creation and display layout modification
US9648326B2 (en) * 2013-07-02 2017-05-09 Qualcomm Incorporated Optimizations on inter-layer prediction signalling for multi-layer video coding
JP6462566B2 (en) * 2013-07-05 2019-01-30 サターン ライセンシング エルエルシーＳａｔｕｒｎ Ｌｉｃｅｎｓｉｎｇ ＬＬＣ Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
KR20150008739A (en) * 2013-07-15 2015-01-23 주식회사 케이티 Server and method for providing personalize display based on video, and device
US9106929B2 (en) * 2014-01-02 2015-08-11 Vidyo, Inc. Overlays using auxiliary pictures
US20150261425A1 (en) * 2014-03-14 2015-09-17 Apple Inc. Optimized presentation of multimedia content
JP5725242B1 (en) * 2014-06-04 2015-05-27 ソニー株式会社 Transmitting apparatus, transmitting method, receiving apparatus, and receiving method
CN105323220B (en) * 2014-07-10 2019-02-22 上海交通大学 A kind of mapping of IP-based multimedia programming and access signaling and method
JP2016082541A (en) * 2014-10-22 2016-05-16 日本放送協会 Receiver and program

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101379823A (en) * 2006-02-07 2009-03-04 东京电力株式会社 Content edition/generation system
US20130021431A1 (en) * 2011-03-28 2013-01-24 Net Power And Light, Inc. Information mixer and system control for attention management
CN102143231A (en) * 2011-04-01 2011-08-03 奇智软件（北京）有限公司 Terminal application networked management method and system
US20130096926A1 (en) * 2011-08-26 2013-04-18 Dts Llc Audio adjustment system
CN104094539A (en) * 2011-11-29 2014-10-08 沃驰特公司 System and method for synchronized interactive layers for media broadcast
CN105339881A (en) * 2013-03-14 2016-02-17 维克斯网有限公司 Device, system, and method of website building by utilizing data lists

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063850A1 (en) * 2018-09-27 2020-04-02 华为技术有限公司 Method for processing media data and terminal and server

Also Published As

Publication number Publication date
US20210168465A1 (en) 2021-06-03
US11212592B2 (en) 2021-12-28
JP6736699B2 (en) 2020-08-05
CN112601121B (en) 2022-06-10
JP2019527496A (en) 2019-09-26
KR20190012215A (en) 2019-02-08
CN107770601B (en) 2021-04-02
WO2018033051A1 (en) 2018-02-22
KR102186790B1 (en) 2020-12-04
CA3026533C (en) 2023-01-24
CA3026533A1 (en) 2018-02-22
CN112601121A (en) 2021-04-02

Similar Documents

Publication Publication Date Title
CN100437453C (en) Tag information display control apparatus, information processing apparatus, display apparatus, tag information display control method and recording medium
US8745660B2 (en) Mechanism for rendering advertising objects into featured content
WO2016127862A1 (en) Method for implementing personalized presentation of associated multimedia content, and application
CN107483460A (en) A kind of method and system of multi-platform parallel instructor in broadcasting's plug-flow
US20110107368A1 (en) Systems and Methods for Selecting Ad Objects to Insert Into Video Content
CN101674423B (en) Method for generating caption broadcasting list driven by on-line program
CN108804694B (en) Automatic scheduling method, equipment and system for film
CN109906611A (en) Characteristic spectrum for content characteristic map is laid out
CN101431682A (en) Advertisement system suitable for IPTV and implementing method thereof
CN101017493A (en) Device and method for generating index information with link information
CN106658114A (en) Video playing method and device
CN109951728A (en) A kind of advertisement distributing system and method
KR101843815B1 (en) method of providing inter-video PPL edit platform for video clips
JP4434094B2 (en) Tag information generation apparatus, tag information generation method and program
CN101674422B (en) Method for updating caption broadcasting list driven by on-line program
CN101909162A (en) Method for formulating programme schedule
CN107770601A (en) A kind of method and system towards the personalized presentation of content of multimedia component
US20100257188A1 (en) Method and apparatus for providing/receiving stereoscopic image data download service in digital broadcasting system
CN101674455A (en) Information interaction method based on WEB services between heterogeneous systems of main control broadcasting line
CN107925491A (en) Reception device, dispensing device and data processing method
KR20210122959A (en) Title of invention
US20150156560A1 (en) Apparatus for transmitting augmented broadcast metadata, user terminal, method for transmitting augmented broadcast metadata, and reproducing augmented broadcast metadata
Devlin et al. Reports from the SMPTE Technology Committees
CN105554586B (en) A kind of new business rendering method
CN101674454A (en) Interconnection system among heterogeneous business segments of main control broadcasting line

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant