WO2012034441A1 - 实现可伸缩视频编码业务协同传输的方法及系统 - Google Patents

实现可伸缩视频编码业务协同传输的方法及系统 Download PDF

Info

Publication number
WO2012034441A1
WO2012034441A1 PCT/CN2011/076618 CN2011076618W WO2012034441A1 WO 2012034441 A1 WO2012034441 A1 WO 2012034441A1 CN 2011076618 W CN2011076618 W CN 2011076618W WO 2012034441 A1 WO2012034441 A1 WO 2012034441A1
Authority
WO
WIPO (PCT)
Prior art keywords
service
layer
information
scalable video
video coding
Prior art date
Application number
PCT/CN2011/076618
Other languages
English (en)
French (fr)
Inventor
童登金
钟宏
戴志军
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2012034441A1 publication Critical patent/WO2012034441A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/633—Control signals issued by server directed to the network components or client
    • H04N21/6332—Control signals issued by server directed to the network components or client directed to client
    • H04N21/6336—Control signals issued by server directed to the network components or client directed to client directed to decoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8451—Structuring of content, e.g. decomposing content into time segments using Advanced Video Coding [AVC]

Definitions

  • the present invention relates to a transmission technology in a mobile multimedia broadcast system, and more particularly to a method and system for implementing coordinated transmission of Scalable Video Coding (SVC) services in China Mobile Multimedia Broadcasting (CMMB) .
  • SVC Scalable Video Coding
  • CMMB China Mobile Multimedia Broadcasting
  • CMMB China Mobile Multimedia Broadcasting System
  • Mobile Multimedia Broadcasting Part 2 Multiplexing stipulates that multiplexed sub-frames are used to encapsulate streaming media data such as video and audio for transmission.
  • Figure 1 shows the structure of a CMMB channel frame.
  • Scalable Video Coding is a video grading coding method.
  • the encoder encodes the video content source to generate a plurality of layers of code streams, and the base layer code stream can be separately decoded.
  • the enhancement layer code stream includes additional information for improving the quality of the lower layer code stream, and needs a low layer including the base layer. Decode together.
  • SVC technology can provide scalable and scalable services, differentiate services with differentiated quality of service, and adapt to the capabilities of various terminals. It has many advantages. It is necessary to transmit SVC services in CMMB systems. How to effectively transmit the hierarchical services of the SVC service and ensure that the terminal is accurately received and processed is a technical problem that needs to be solved.
  • the technical problem to be solved by the present invention is to provide a method and system for implementing coordinated transmission of a scalable video coding service, which effectively transmits each layered service of the SVC service while ensuring accurate reception and processing by the terminal.
  • the embodiment of the present invention provides a transmission method, including: encapsulating a base layer code stream and an enhancement layer code stream in a video stream of a scalable video coding service in different multiplex subframes in a broadcast channel frame, respectively. , encapsulating the collaborative auxiliary information for correctly decoding the multi-layer video stream
  • the broadcast channel frame is sent to the terminal together; the terminal parses the cooperative auxiliary information from the received broadcast channel frame, and receives the self-video stream processing capability according to the cooperative auxiliary information and belongs to the
  • the multi-layer code stream of the video coding service is scaled and decoded; thereby implementing coordinated transmission of the scalable video coding service.
  • the above method may also have the following features:
  • the cooperative auxiliary information is encapsulated in the broadcast channel frame
  • the cooperative auxiliary information is encapsulated in the control information table, or encapsulated in the electronic service guide data stream, or partially encapsulated in the control information table and partially encapsulated in the electronic service.
  • the guide data stream is encapsulated in the same multiplex subframe as the base layer media data of the scalable video coding service, or partially encapsulated in the same multiplex subframe as the control information in the same multiplex subframe.
  • Table and / or electronic business guide data stream is encapsulated in the same multiplex subframe as the base layer media data of the scalable video coding service.
  • the above method may also have the following features:
  • the cooperative assistance information includes service layer information, inter-layer dependency, layer service transmission location information, and layer service parameter information in the scalable video coding service.
  • the above method may also have the following features:
  • Setting a service information table for indicating the service layering information and the inter-layer dependency relationship in the collaborative assistance information; setting the service identifier for the scalable video coding service includes: setting a full service identifier for the scalable video coding service, And setting a layer service identifier for each layer of the service included in the scalable video coding service; and when the service identifier carried in the service information table is a full service identifier, indicating each layer corresponding to each layer service in the scalable video coding service The service identifier; when the service identifier carried in the service information table is a layer service identifier, the layer service identifier of the other layer service on which the layer service corresponding to the layer service identifier depends.
  • the above method may also have the following features:
  • the above method may also have the following features:
  • the service layering information, the inter-layer dependency relationship, and the layer service transmission location in the collaborative auxiliary information is encapsulated in the control information table in the time slot 0 of the broadcast channel frame, including: encapsulating the service identifier of the scalable video coding service in a persistent service configuration table or a short-time service configuration table;
  • the layer service identifier of each layer service in the video coding service and the information of the multiplex subframe used for transmitting the layer service are encapsulated in a persistent service multiplexing configuration table or a short-time service multiplexing configuration table;
  • the service identifier and the related electronic service guide information, the service identifier of each layer of the service in the scalable video coding service, and related electronic service guide information are encapsulated in an electronic service guide basic description table; and the coordinated auxiliary information middle layer service parameter information
  • the encapsulation in the electronic service guide data stream specifically includes: encapsulating the layer service parameter information in the electronic service guide service parameter information.
  • the above method may also have the following features:
  • an embodiment of the present invention provides a transmission system, including a mobile multimedia broadcast device and a terminal.
  • the mobile multimedia broadcast device is configured to: use a base layer code stream and an enhancement layer code in a video stream of the scalable video coding service.
  • the flows are respectively encapsulated in different multiplexed subframes in the broadcast channel frame, and the cooperative auxiliary information for correctly decoding the multi-layer video stream is encapsulated in the broadcast channel frame and sent to the terminal;
  • the terminal is configured as: And parsing the coordinated auxiliary information from the received broadcast channel frame, and receiving, according to the cooperative auxiliary information, a multi-layer code stream that is in accordance with the video stream processing capability and belongs to the scalable video coding service, and performs decoding; Scalable video coding service coordinated transmission.
  • the above system may also have the following characteristics:
  • the coordinated auxiliary information includes service layering information, inter-layer dependency relationship, layer service transmission location information, and layer service parameter information in the scalable video coding service;
  • the mobile multimedia broadcast device is further configured to:
  • the service layer information, the inter-layer dependency relationship, and the layer service transmission location information are encapsulated in the control information table and sent in the time slot 0 of the broadcast channel frame;
  • the middle layer service parameter information of the cooperative auxiliary information is encapsulated in the electronic service.
  • the guide is sent in the data stream.
  • the above system may also have the following characteristics:
  • the mobile multimedia broadcast device is further configured to: set a service information table for indicating service layering information and an inter-layer dependency relationship in the collaborative assistance information; and setting a service identifier for the scalable video coding service, including:
  • the scalable video coding service sets a full service identifier, and sets a layer service identifier for each layer of the service included in the scalable video coding service.
  • the service identifier carried in the service information table is a full service identifier, the scalable video is also indicated.
  • the service identifier of each layer corresponding to each layer of the service in the coding service when the service identifier carried in the service information table is a layer service identifier, the layer service identifier of the other layer service on which the layer service corresponding to the layer service identifier depends is also indicated.
  • the mobile multimedia broadcast device is configured to: encapsulate the base layer code stream and the enhancement layer code stream in the video stream of the scalable video coding service into different multiplex subframes in the broadcast channel frame, respectively, and be used for correctly decoding the multi-layer video.
  • the coordinated auxiliary information of the flow is encapsulated in the broadcast channel frame and sent to the terminal together;
  • the coordination assistance information includes service layering information, inter-layer dependency relationship, layer service transmission location information, and layer service parameter information in the scalable video coding service;
  • the mobile multimedia broadcast device is further configured to: encapsulate the service layer information, the inter-layer dependency relationship, and the layer service transmission location information in the coordination assistance information in a control information table and send in time slot 0 of the broadcast channel frame. Transmitting the collaborative service information middle layer service parameter information in an electronic service guide data stream for transmission.
  • the mobile multimedia broadcast device is further configured to: set a service information table for indicating service layering information and an inter-layer dependency relationship in the collaborative assistance information; and setting a service identifier for the scalable video coding service, including: And setting a full service identifier for the scalable video coding service, and setting a layer service identifier for each layer of the service included in the scalable video coding service; and when the service identifier carried in the service information table is a full service identifier, indicating the same
  • the service layer identifier of each layer corresponding to the service of each layer in the scalable video coding service; when the service identifier carried in the service information table is a layer service identifier, the layer of other layer services on which the layer service corresponding to the layer service identity depends is also indicated.
  • the embodiments of the present invention can effectively transmit the hierarchical services of the SVC service and ensure the accurate receiving and processing of the terminal, thereby ensuring the application of the SVC service.
  • FIG. 1 is a schematic structural diagram of a structure of a CMMB channel frame in the prior art
  • FIG. 2 is a flowchart of a method for implementing coordinated transmission of a scalable video coding service in an embodiment
  • FIG. 3 is a schematic diagram of a resource usage manner in a broadcast channel frame in a specific embodiment
  • FIG. 4 is a diagram showing an example of a service information table in a specific embodiment.
  • the SVC video service includes a base layer code stream and at least one enhancement layer code stream, and the base layer code stream can be separately decoded.
  • the enhancement layer code stream includes additional information for improving the quality of the lower layer code stream, and needs to be combined with the lower layer including the base layer. decoding.
  • the embodiment provides a broadcast service including SVC video and one channel audio, and the SVC video uses a spatial layering mode, which is encoded as a QVGA (Quad VGA, 320x240 pixel image) elementary stream and a VGA (Video Graphic Array, 640 ⁇ 480 pixels). Image) Enhanced video stream, audio is encoded as an audio stream. It should be noted that the method of the present invention is equally applicable to the case of multiple enhanced streams and other SVC coding modes.
  • a system for implementing coordinated transmission of scalable video coding services including mobile multimedia broadcast devices and terminals.
  • the mobile multimedia broadcast device is configured to separately encapsulate a base layer code stream and an enhancement layer code stream in a video stream of the scalable video coding service in different multiplex subframes in a broadcast channel frame, and is used to correctly decode the multi-layer video.
  • the coordinated auxiliary information of the stream is encapsulated in the broadcast channel frame and sent to the terminal.
  • the terminal is configured to parse the coordinated auxiliary information from the received broadcast channel frame, and receive, according to the coordinated auxiliary information, a multi-layer code stream that is in accordance with its own video stream processing capability and belongs to the scalable video coding service, And decode it.
  • the mobile multimedia broadcast device is further configured to separate the SVC service media data from the SVC service media data when the cooperative auxiliary information is encapsulated in the broadcast channel frame, and not in the same multiplex subframe as the SVC service media data.
  • the packet is encapsulated in the control information table, or encapsulated in the electronic service guide data stream, or partially encapsulated in the control information table and partially encapsulated in the electronic service guide data stream. It can also be in the same multiplex subframe as the SVC service base layer media data.
  • the combination of the foregoing two methods may also be used, and partially encapsulated in the same multiplex subframe as the base layer media data of the scalable video coding service, and partially encapsulated in the control information table and/or the electronic service guide data stream.
  • the collaboration assistance information includes service layer information, inter-layer dependency, layer service transmission location information, and layer service parameter information in the scalable video coding service.
  • the mobile multimedia broadcast device is specifically configured to encapsulate the service layer information, the inter-layer dependency relationship, and the layer service transmission location information in the coordinated assistance information in a control information table, and send the information in the time slot 0 of the broadcast channel frame;
  • the layer of service parameter information in the collaborative assistance information is encapsulated and sent in an electronic service guide data stream.
  • the mobile multimedia broadcast device is further configured to set a service information table for indicating the service layer information and the inter-layer dependency relationship in the collaborative assistance information; and setting a service identifier for the scalable video coding service, specifically, the The scalable video coding service sets a full service identifier, and sets a layer service identifier for each layer of the service included in the scalable video coding service.
  • the service identifier carried in the service information table is a full service identifier, the scalable video coding is simultaneously indicated.
  • the terminal is further configured to determine a layer of the highest level that needs to be processed, all the low-level information that the layer depends on is obtained from the collaborative auxiliary information, including an inter-layer dependency relationship, a layer service transmission location information, and each Layered layer service parameter information, according to the information, receiving the layered multiplex subframe corresponding to each lower layer, and extracting each layered data from each multiplex subframe to perform synchronous merge And decoding.
  • a method for implementing coordinated transmission of a scalable video coding service includes:
  • Step 201 Encapsulate the base layer code stream and the enhancement layer code stream in the video stream of the scalable video coding service in different multiplex subframes in the broadcast channel frame, and use the coordinated auxiliary information for correctly decoding the multi-layer video stream.
  • the packet is encapsulated in the broadcast channel frame and sent to the terminal.
  • the cooperative assistance information includes service layered information (that is, which layer services are included in one service) and inter-layer dependencies (other levels depended on each layer) in the scalable video coding service, Layer service transmission location information (ie, which multiplex subframe transmission layer services are respectively), layer service parameter information (including but not limited to spatial layer identification, time layered identification, quality layered identification, video indicating the limited parameter range)
  • Layer service transmission location information ie, which multiplex subframe transmission layer services are respectively
  • layer service parameter information including but not limited to spatial layer identification, time layered identification, quality layered identification, video indicating the limited parameter range
  • the pre-encoding level of the codec subset the frame rate, the resolution, the code rate.
  • the terminal cooperatively receives and processes the respective SVC layers transmitted in different multiplex subframes according to the cooperative assistance information.
  • the cooperative auxiliary information When the cooperative auxiliary information is encapsulated in the broadcast channel frame, it may be separated from the SVC service media data, and not transmitted in the same multiplex subframe as the SVC service media data, but encapsulated in the control information table or encapsulated in the electronic service.
  • the guide data stream, or partially encapsulated in the control information table is partially encapsulated in the electronic service guide data stream. It can also be in the same multiplex sub-frame as the SVC service base layer media data.
  • the combination of the foregoing two methods may also be used, and partially encapsulated in the same multiplex subframe as the basic layer media data of the scalable video coding service, and partially encapsulated in the control information table and/or the electronic service guide data stream.
  • a service information table is set to represent service layer information and inter-layer dependencies in the collaborative assistance information.
  • a service identifier is set for the SVC service. Specifically, a full service identifier is set for the SVC service, and a layer service identifier is set for each layer of the service included in the SVC service.
  • the service identifier carried in the service information table is a full service identifier
  • the service identifier of each layer corresponding to each layer service in the SVC service is also indicated;
  • the service identifier carried in the service information table is a layer service identifier
  • the layer is also indicated.
  • the type of the service identifier is classified into the normal service, the SVC service, and the SVC layered service.
  • the type of the service identifier is 0, it indicates the normal service. If the value is 1, the full service identifier corresponds to the SVC service. The value is 2.
  • the time indicating layer service identity corresponds to the SVC layer service.
  • the method includes: encapsulating the service identifier of the SVC service and the corresponding frequency point information in a persistent service configuration table or a short-time service configuration table; and using the layer service identifier of each layer service in the SVC service and transmitting the layer service
  • the information of the multiplexed subframe is encapsulated in a persistent service multiplexing configuration table or a short-time service multiplexing configuration table; the service identifier of the SVC service and related electronic service guide information, and services of each layer service in the SVC service
  • the identification and associated electronic service guide information is encapsulated in an electronic service guide basic description table.
  • the cooperative auxiliary information middle layer service parameter information is encapsulated and sent in an electronic service guide data stream.
  • the method includes: encapsulating layer service parameter information in an electronic service guide service parameter information.
  • ESG data related to the SVC service such as service information, service orchestration, and content
  • service information such as service information, service orchestration, and content
  • content information are encapsulated in ESG service information, service orchestration information, and content information.
  • the control information table such as the service information table, the persistent service configuration table or the short-time service configuration table, the persistent service multiplexing configuration table, the short-time service multiplexing configuration table, and the ESG basic description table, is transmitted in the CMMB broadcast channel frame time slot 0.
  • ESG data information such as ESG service information, service scheduling information, content information, and ESG service parameter information is transmitted in the ESG data stream.
  • the SVC layered self-parameter information is transmitted through the ESG service parameter information
  • the control information table is transmitted in the CMMB broadcast channel frame time slot 0
  • the ESG data information is transmitted through the ESG data stream, backward compatible.
  • Step 202 The terminal parses the coordinated auxiliary information from the received broadcast channel frame, and receives a multi-layer code stream that belongs to the SVC service according to the self-video stream processing capability according to the coordinated auxiliary information, and performs decoding.
  • the terminal listens to the broadcast channel frame, and extracts the coordinated auxiliary information in the broadcast channel frame slot 0 and the ESG data stream, and parses out the service layer information of the SVC service, the SVC inter-layer dependency relationship, the SVC layer transmission information, and the SVC layer itself. Parameter information.
  • the terminal After the terminal determines the highest level of hierarchy to be processed, all the low-level information that the layer depends on is obtained from the collaborative auxiliary information, including the inter-layer dependency, the layer service transmission location information, and the layered
  • the layer service parameter information receives the layered multiplex subframe corresponding to each lower layer, and extracts each layered data from each multiplex subframe to perform synchronous combining and decoding.
  • the terminal obtains information such as the service identifier and service parameters of the current service and the ESG information related to other service identifiers through the ESG basic description table and the ESG data information.
  • the terminal determines, according to the current service identifier, that the processed service is an SVC service, and obtains information such as a layered service identifier of the SVC layer included in the SVC service; in the process, combining the ESG information of step 1 , the layer itself parameter information of the SVC layer can be known. 3) The terminal determines the highest level SVC layer that it needs to receive the processing, and determines the layer service identity of all the low-level SVC layers that it depends on according to the layered service identifier of the layer. The determination of the highest level SVC layer that needs to be processed may be used as a constraint condition for the layer self parameter information of the SVC layer.
  • the terminal learns the multiplex subframe corresponding to each layer from the persistent service multiplexing configuration table or the short-time service multiplexing configuration table, and receives the layer determined by step 3) and the low-level layers that it depends on.
  • FIG. 3 is a schematic structural diagram of a structure of a broadcast channel frame in a specific embodiment.
  • time slot 0 multipleplex frame 0
  • time slot 1 to time slot 39 are used to transmit service information.
  • the mobile multimedia broadcast device configures the video base layer code stream, audio, and data information in the SVC video service S into the multiplex frame 1, occupying slot 1 to slot 4, and multiplexing the subframe number to 1.
  • the video enhancement layer code stream is configured to multiplex frame 2, occupying slot 5 to slot 6, and multiplexing the subframe number to 1. No other services are transmitted in the multiplex frame 1 and the multiplex frame 2.
  • the mobile multimedia broadcast device obtains the base layer code stream VI of the SVC video service S, encapsulates it into the multiplex subframe 1 of the multiplex frame 1, and acquires the enhancement layer code stream V2 of the video service S, and encapsulates it into the multiplexing of the multiplex frame 2.
  • the front-end transmitting device acquires the audio code stream and the data segment information of the video service S, and adds it to the multiplex subframe 1 of the multiplex frame 1, that is, is carried in the same multiplex subframe together with the base layer code stream.
  • the cooperative auxiliary information includes service layering information.
  • the SVC video in this embodiment uses spatial layered SVC coding, including two layers of a QVGA basic layer and a VGA enhancement layer, and the QVGA basic layer identifier is LO, and the VGA is enhanced.
  • the layer identification is L1; the inter-layer dependency, the QVGA base layer L0 can be independently decoded, the decoding of the VGA enhancement layer L1 depends on L0, and the terminal must receive the video data of L0 and L1 at the same time if it wants to receive and decode the VGA video;
  • the QVGA base layer L0 is transmitted by multiplexing the multiplex subframe 1 of the frame 1
  • the VGA enhancement layer L1 is transmitted by multiplexing the multiplex subframe 1 of the frame 2;
  • the self-parameter information of the layer, such as the parameter of the QVGA base layer L0 includes a layer
  • the frame rate is 25, the resolution is 640x480, and the code rate is 360kbps.
  • the QVGA basic layer service identifier is SID10
  • the VGA enhancement layer service identifier is SID11.
  • a service information table is generated by using the control information table transmitted by the CMMB broadcast channel frame time slot 0, and the information table indicates the service type and service association relationship of a certain service identifier.
  • the service identifier includes the full service identifier of the SVC service and the layer service identifier of the SVC layered service.
  • the service type corresponding to the service identifier is divided into a common service (represented by 0), an SVC service (represented by 1), and an SVC layered service (represented by 2); if the service identifier corresponding type is an SVC service, the SVC service is also indicated. If the service identifier is of the SVC layered service, the layer service identifier of the other layer SVC layered service that the SVC layer service depends on is also indicated.
  • the service information table may be as shown in FIG. 4, for example, SIDx is an SVC service, and includes two SVC layer services: SID10 and SID11; SID10 is an SVC layered service, which can be independently decoded; SID11 is an SVC point. Layer business, depending on SID10 layering.
  • the service identifiers of the SVC service are encapsulated into a persistent service configuration table or a short-time service configuration table.
  • the service identifier of the SVC layered service and the information about the multiplex subframe used for transmitting the layer are encapsulated into a persistent service multiplexing configuration table or a short time service multiplexing configuration table.
  • SID10 corresponds to the multiplex subframe 1 of the multiplex frame 1
  • SID11 corresponds to the multiplex subframe 1 of the multiplex frame 2.
  • the service identifier of the SVC service and related ESG information, the service identifier of the SVC layered service, and related ESG information are encapsulated into the ESG basic description table.
  • the self-parameter information of the SVC layer is encapsulated by the ESG service parameter information; other ESG data information related to the SVC service, such as service information, service arrangement, content, and other ESG information, using ESG service information, service scheduling information, content information, etc. Specifications are packaged separately.
  • the terminal monitors the cooperative auxiliary information related to the SVC video stream in the broadcast channel frame, and receives the service information table, the persistent service configuration table or the short-time service configuration table, the persistent service multiplexing configuration table, or the short-time service complex from the broadcast channel frame time slot 0.
  • Control information table with configuration table, ESG basic description table, etc., from ESG receives ESG data information.
  • the terminal receives and processes the related SVC layered code stream according to its own capability, and according to the coordinated auxiliary information, the data of different layers belonging to the same SVC service is cooperatively received and processed, and then the video decoding is performed.
  • the base layer video unit and the enhancement layer video unit participating in the synthesis must ensure a cooperative relationship, and the SVC video frame synthesis process requires the coordination relationship related information.
  • the terminal receives a service information table, a persistent service configuration table or a short-time service configuration table, a persistent service multiplexing configuration table, a short-time service multiplexing configuration table, an ESG basic description table, and the like, from the broadcast channel frame time slot 0, Receiving ESG data information from the ESG data stream, and obtaining collaborative auxiliary information related to the SVC service.
  • the terminal After the terminal determines the highest level SVC layer that it needs to receive, it acquires relevant information of all low-level SVC layers that the layer depends on from the collaborative auxiliary information, and receives the layer and the dependent each The multiplexed sub-frame to which the low-level SVC layer belongs, extracts each layered data from each multiplex sub-frame, and performs synchronous merging and decoding according to information such as inter-layer relationship and layer self-parameter.
  • Step 2) can be further described as:
  • the 1» terminal obtains the service identification SIDx, service parameters and other information of the current service through the ESG basic description table and the ESG data information, and the ESG information related to other service identifiers such as SID10 and SID11.
  • the terminal determines, according to the current service identifier SIDx, that the processed service is an SVC service from the service information table, and obtains SVC layered layer service identifiers SID10, SID11 and the like included in the SVC service; in this process, combining steps
  • the ESG information of 1 can be used to know the layer self-parameter information of the relevant SVC layer SID10 and SID11.
  • the terminal knows that the SID11 is an SVC layer from the layer self-parameter information of the SVC layer SID10 and SID11, and compares the other layer's own parameter information of the layer to determine the highest level SVC score that the layer needs to receive and process.
  • the layered layer service identifier SID11 it is determined from the service information table that all the low-level SVC layered layer service identifiers that it depends on are (SID10), that is, the two SVC layers of processing SID11 and SID10 need to be received at the same time.
  • the terminal learns from the persistent service multiplexing configuration table or the short-time service multiplexing configuration table that the multiplex subframes corresponding to SID10 and SID11 are multiplex subframe 1 and multiplex frame 2 of multiplex frame 1, respectively. Multiplexed subframe 1. Receive the two multiplex subframes together.
  • the layer self-parameter information of SID10 and SID11 can be used as the control parameter on which the processing is based.
  • the embodiments of the present invention can effectively transmit the hierarchical services of the SVC service and ensure the accurate receiving and processing of the terminal to ensure the application of the SVC service.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了传输方法及系统，此方法包括：将可伸缩视频编码业务的视频流中基本层码流和增强层码流分别封装于广播信道帧中的不同复用子帧中，将用于正确解码多层视频流的协同辅助信息封装于所述广播信道帧中，一并发送至终端；所述终端从接收到的广播信道帧中解析出所述协同辅助信息，并根据所述协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩视频编码业务的多层码流，并进行解码；从而实现可伸缩视频编码（SVC）业务协同传输。本发明可以有效的传送SVC业务的各分层业务同时保证终端准确接收及处理，保证SVC业务的应用。

Description

实现可伸缩视频编码业务协同传输的方法及系统
技术领域
本发明涉及移动多媒体广播系统中传输技术， 尤其涉及一种中国移动多 媒体广播系统（ China Mobile Multimedia Broadcasting, 简称 CMMB )中实现 可伸缩视频编码（ Scalable Video Coding, 简称 SVC )业务协同传输的方法及 系统。
背景技术
随着通信技术的发展， 移动多媒体广播技术的应用越来越广。 目前， 中 国移动多媒体广播系统（CMMB)标准规定了在广播业务频率范围内， 移动多 媒体广播系统广播信道传输信号的帧结构、 信道编码和调制等。 CMMB标准
《移动多媒体广播 第 2部分： 复用》中规定， 釆用复用子帧来封装视频、 音 频等流媒体数据， 进行传送。 图 1所示的是 CMMB信道帧的组成结构。
可伸缩视频编码（SVC )是一种视频分级编码方式。 编码器对视频内容 源进行编码， 产生多个层次的码流， 基本层码流可以单独解码， 增强层码流 包含用于提高低层码流质量的附加信息， 需要和包括基本层在内的低层一起 解码。 SVC技术可以提供可分级可伸缩的业务， 实现有服务质量差别的区分 业务、 实现各种终端的能力适配，具有诸多优点，在 CMMB系统中传送 SVC 业务是艮有必要的。具体如何有效的传送 SVC业务的各分层业务以及保证终 端准确接收并处理是需要解决的一个技术问题。
发明内容
本发明要解决的技术问题是提供实现可伸缩视频编码业务协同传输的方 法及系统，有效的传送 SVC业务的各分层业务同时保证终端准确接收及处理。
为了解决上述技术问题， 本发明实施例提供了传输方法， 包括： 将可伸 缩视频编码业务的视频流中基本层码流和增强层码流分别封装于广播信道帧 中的不同复用子帧中， 将用于正确解码多层视频流的协同辅助信息封装于所 述广播信道帧中， 一并发送至终端； 所述终端从接收到的广播信道帧中解析 出所述协同辅助信息， 并根据所述协同辅助信息接收符合自身视频流处理能 力而且属于所述可伸缩视频编码业务的多层码流， 并进行解码； 从而实现可 伸缩视频编码业务协同传输。
优选地， 上述方法还可以具有以下特点：
将所述协同辅助信息在广播信道帧内封装时， 将所述协同辅助信息封装 于控制信息表中， 或者封装于电子业务指南数据流中， 或者部分封装于控制 信息表中部分封装于电子业务指南数据流中， 或者与可伸缩视频编码业务基 本层媒体数据封装在同一复用子帧中， 或者部分与可伸缩视频编码业务基本 层媒体数据封装在同一复用子帧中部分封装在控制信息表和 /或电子业务指 南数据流中。
优选地， 上述方法还可以具有以下特点：
所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信息、 层间 依赖关系、 层业务传输位置信息和层业务参数信息。
优选地， 上述方法还可以具有以下特点：
设置一业务信息表用于表示所述协同辅助信息中业务分层信息和层间依 赖关系； 为所述可伸缩视频编码业务设置业务标识包括： 为所述可伸缩视频 编码业务设置全业务标识， 为所述可伸缩视频编码业务所包含各层业务设置 层业务标识； 所述业务信息表中携带的业务标识为全业务标识时， 同时指示 此可伸缩视频编码业务中各层业务对应的各层业务标识； 所述业务信息表中 携带的业务标识为层业务标识时， 同时指示此层业务标识对应的层业务所依 赖的其它层业务的层业务标识。
优选地， 上述方法还可以具有以下特点：
将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务传输位置 信息封装在控制信息表中在所述广播信道帧的时隙 0中发送； 将所述协同辅 助信息中层业务参数信息封装在电子业务指南数据流中发送。
优选地， 上述方法还可以具有以下特点：
将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务传输位置 信息封装在控制信息表中在所述广播信道帧的时隙 0中包括： 将所述可伸缩 视频编码业务的业务标识封装在持续业务配置表或短时间业务配置表中； 将 所述可伸缩视频编码业务中各层业务的层业务标识以及传输此层业务所用的 复用子帧的信息封装在持续业务复用配置表或短时间业务复用配置表中； 将 所述可伸缩视频编码业务的业务标识以及相关电子业务指南信息、 所述可伸 缩视频编码业务中各层业务的业务标识以及相关电子业务指南信息封装在电 子业务指南基本描述表中； 将所述协同辅助信息中层业务参数信息封装在电 子业务指南数据流中具体包括： 将层业务参数信息封装在电子业务指南业务 参数信息中。
优选地， 上述方法还可以具有以下特点：
终端确定所需要处理的最高层级的分层后， 从所述协同辅助信息中获取 这一分层所依赖的所有低层级的信息， 包括层间依赖关系、 层业务传输位置 信息以及各分层的层业务参数信息， 根据这些信息， 接收这一分层及其所依 赖的各低层级所对应的复用子帧， 从各复用子帧中提取出各分层数据， 进行 同步合并和解码。 为了解决上述技术问题， 本发明实施例提供了传输系统， 包括移动多媒 体广播设备和终端； 所述移动多媒体广播设备设置为： 将可伸缩视频编码业 务的视频流中基本层码流和增强层码流分别封装于广播信道帧中的不同复用 子帧中， 将用于正确解码多层视频流的协同辅助信息封装于所述广播信道帧 中， 一并发送至终端； 所述终端设置为： 从接收到的广播信道帧中解析出所 述协同辅助信息， 并根据所述协同辅助信息接收符合自身视频流处理能力而 且属于所述可伸缩视频编码业务的多层码流， 并进行解码； 实现可伸缩视频 编码业务协同传输。
优选地， 上述系统还可以具有以下特点：
所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信息、 层间 依赖关系、 层业务传输位置信息和层业务参数信息； 所述移动多媒体广播设 备还设置为： 将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务 传输位置信息封装在控制信息表中在所述广播信道帧的时隙 0中发送； 将所 述协同辅助信息中层业务参数信息封装在电子业务指南数据流中发送。 优选地， 上述系统还可以具有以下特点：
所述移动多媒体广播设备还设置为： 设置一业务信息表用于表示所述协 同辅助信息中业务分层信息和层间依赖关系； 为所述可伸缩视频编码业务设 置业务标识包括： 为所述可伸缩视频编码业务设置全业务标识， 为所述可伸 缩视频编码业务所包含各层业务设置层业务标识； 所述业务信息表中携带的 业务标识为全业务标识时， 同时指示此可伸缩视频编码业务中各层业务对应 的各层业务标识； 所述业务信息表中携带的业务标识为层业务标识时， 同时 指示此层业务标识对应的层业务所依赖的其它层业务的层业务标识。
移动多媒体广播设备， 设置为： 将可伸缩视频编码业务的视频流中基本 层码流和增强层码流分别封装于广播信道帧中的不同复用子帧中， 将用于正 确解码多层视频流的协同辅助信息封装于所述广播信道帧中， 一并发送至终 端；
由终端从接收到的广播信道帧中解析出所述协同辅助信息， 并根据所述 协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩视频编码业 务的多层码流， 并进行解码， 以实现可伸缩视频编码业务协同传输。
优选地， 所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信 息、 层间依赖关系、 层业务传输位置信息和层业务参数信息；
所述移动多媒体广播设备还设置为： 将所述协同辅助信息中业务分层信 息、 层间依赖关系、 层业务传输位置信息封装在控制信息表中在所述广播信 道帧的时隙 0中发送； 将所述协同辅助信息中层业务参数信息封装在电子业 务指南数据流中发送。
优选地， 所述移动多媒体广播设备还设置为： 设置一业务信息表用于表 示所述协同辅助信息中业务分层信息和层间依赖关系； 为所述可伸缩视频编 码业务设置业务标识包括： 为所述可伸缩视频编码业务设置全业务标识， 为 所述可伸缩视频编码业务所包含各层业务设置层业务标识； 所述业务信息表 中携带的业务标识为全业务标识时， 同时指示此可伸缩视频编码业务中各层 业务对应的各层业务标识； 所述业务信息表中携带的业务标识为层业务标识 时，同时指示此层业务标识对应的层业务所依赖的其它层业务的层业务标识。 本发明实施例可以有效的传送 SVC 业务的各分层业务同时保证终端准 确接收及处理， 保证 SVC业务的应用。 附图概述
图 1是现有技术中 CMMB信道帧的组成结构示意图；
图 2是实施例中实现可伸缩视频编码业务协同传输的方法流程图； 图 3是具体实施例中广播信道帧中资源使用方式示意图；
图 4具体实施例中业务信息表的示例图。
本发明的较佳实施方式
SVC视频业务包括基本层码流和至少一个增强层码流， 基本层码流可以 单独解码， 增强层码流包含用于提高低层码流质量的附加信息， 需要和包括 基本层在内的低层一起解码。 为便于描述， 实施例设广播业务包含了 SVC视 频和一路音频， SVC 视频釆用空间分层模式， 被编码为一路 QVGA ( QuarterVGA, 320x240像素图像）基本流和一路 VGA( Video Graphic Array, 640X480像素图像）增强视频流， 音频被编码为一路音频流。 需要说明的是， 本发明所述方法同样适用于多路增强流及其它 SVC编码模式的情况。
实现可伸缩视频编码业务协同传输的系统， 包括移动多媒体广播设备和 终端。
所述移动多媒体广播设备用于将可伸缩视频编码业务的视频流中基本层 码流和增强层码流分别封装于广播信道帧中的不同复用子帧中， 将用于正确 解码多层视频流的协同辅助信息封装于所述广播信道帧中，一并发送至终端。
所述终端用于从接收到的广播信道帧中解析出所述协同辅助信息， 并根 据所述协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩视频 编码业务的多层码流， 并进行解码。
移动多媒体广播设备还用于将协同辅助信息在广播信道帧内封装时， 可 与 SVC业务媒体数据分开， 不与 SVC业务媒体数据在同样的复用子帧内传 送， 而是封装于控制信息表中， 或者封装于电子业务指南数据流中， 或者部 分封装于控制信息表中部分封装于电子业务指南数据流中。还可以与 SVC业 务基本层媒体数据在同一个复用子帧内。 还可以釆用上述两种方式的组合， 部分与可伸缩视频编码业务基本层媒体数据封装在同一复用子帧中部分封装 在控制信息表和 /或电子业务指南数据流中。
具体应用中， 所述协同辅助信息包括所述可伸缩视频编码业务中业务分 层信息、 层间依赖关系， 层业务传输位置信息， 层业务参数信息。 移动多媒 体广播设备具体的用于将所述协同辅助信息中业务分层信息、层间依赖关系、 层业务传输位置信息封装在控制信息表中在所述广播信道帧的时隙 0 中发 送； 将所述协同辅助信息中层业务参数信息封装在电子业务指南数据流中发 送。
移动多媒体广播设备还用于设置一业务信息表用于表示所述协同辅助信 息中业务分层信息和层间依赖关系； 为所述可伸缩视频编码业务设置业务标 识， 具体的， 为所述可伸缩视频编码业务设置全业务标识， 为所述可伸缩视 频编码业务所包含各层业务设置层业务标识； 所述业务信息表中携带的业务 标识为全业务标识时， 同时指示此可伸缩视频编码业务中各层业务对应的各 层业务标识； 所述业务信息表中携带的业务标识为层业务标识时， 同时指示 此层业务标识对应的层业务所依赖的其它层业务的层业务标识。 终端还用于确定所需要处理的最高层级的分层后， 从所述协同辅助信息 中获取这一分层所依赖的所有低层级的信息， 包括层间依赖关系、 层业务传 输位置信息以及各分层的层业务参数信息， 根据这些信息， 接收这一分层及 其所依赖的各低层级所对应的复用子帧，从各复用子帧中提取出各分层数据 , 进行同步合并和解码。
如图 2所示， 实现可伸缩视频编码业务协同传输的方法包括：
步骤 201 , 将可伸缩视频编码业务的视频流中基本层码流和增强层码流 分别封装于广播信道帧中的不同复用子帧中， 将用于正确解码多层视频流的 协同辅助信息封装于所述广播信道帧中， 一并发送至终端。
所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信息 （即一 个业务中包括哪几层层业务）、 层间依赖关系 （每一层所依赖的其它层级）， 层业务传输位置信息 （即分别在哪些复用子帧传送层业务） ， 层业务参数信 息 （包括但不限于空间分层标识、 时间分层标识、 质量分层标识、 指示限定 参数范围内的视频编解码的子集的编码前层级别标识、帧率、分辨率、码率 )。 终端根据此协同辅助信息协同接收并处理分开在不同的复用子帧传送的各个 SVC分层。
将协同辅助信息在广播信道帧内封装时， 可与 SVC业务媒体数据分开， 不与 SVC业务媒体数据在同样的复用子帧内传送，而是封装于控制信息表中， 或者封装于电子业务指南数据流中， 或者部分封装于控制信息表中部分封装 于电子业务指南数据流中。还可以与 SVC业务基本层媒体数据在同一个复用 子帧内。 还可以釆用上述两种方式的组合， 部分与可伸缩视频编码业务基本 层媒体数据封装在同一复用子帧中部分封装在控制信息表和 /或电子业务指 南数据流中。
设置一业务信息表用于表示所述协同辅助信息中业务分层信息和层间依 赖关系。 为 SVC业务设置业务标识， 具体的， 为所述 SVC业务设置全业务 标识， 为 SVC业务所包含各层业务设置层业务标识。 业务信息表中携带的业 务标识为全业务标识时， 同时指示此 SVC业务中各层业务对应的各层业务标 识； 所述业务信息表中携带的业务标识为层业务标识时， 同时指示此层业务 标识对应的层业务所依赖的其它层业务的层业务标识。 例如， 业务标识的类 型分为普通业务、 SVC业务、 SVC分层业务， 业务标识的类型取值 0时表示 普通业务， 取值为 1时表示全业务标识即对应于 SVC业务， 取值为 2时表示 层业务标识即对应于 SVC层业务。
将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务传输位置 信息封装在控制信息表中在所述广播信道帧的时隙 0中发送。 具体包括： 将 所述 SVC业务的业务标识以及对应的频点信息封装在持续业务配置表或短时 间业务配置表中；将所述 SVC业务中各层业务的层业务标识以及传输此层业 务所用的复用子帧的信息封装在持续业务复用配置表或短时间业务复用配置 表中； 将所述 SVC业务的业务标识以及相关电子业务指南信息、 所述 SVC 业务中各层业务的业务标识以及相关电子业务指南信息封装在电子业务指南 基本描述表中。 将所述协同辅助信息中层业务参数信息封装在电子业务指南数据流中发 送。 具体包括： 将层业务参数信息封装在电子业务指南业务参数信息中。 将
SVC业务相关的其它 ESG数据信息如业务信息、 业务编排、 内容等 ESG信 息， 用 ESG的业务信息、 业务编排信息、 内容信息等规格分别封装。
其中， 将业务信息表、 持续业务配置表或短时间业务配置表、 持续业务 复用配置表或短时间业务复用配置表、 ESG基本描述表等控制信息表在 CMMB广播信道帧时隙 0传送， 将 ESG的业务信息、 业务编排信息、 内容 信息、 ESG业务参数信息等 ESG数据信息， 用 ESG数据流传送。 除上述的 业务信息表扩展、 SVC分层的自身参数信息通过 ESG业务参数信息传送外， 控制信息表在 CMMB广播信道帧时隙 0的传送、 ESG数据信息通过 ESG数 据流的传送， 后向兼容于现有标准和技术。
步骤 202 , 终端从接收到的广播信道帧中解析出所述协同辅助信息， 并 根据所述协同辅助信息接收符合自身视频流处理能力而且属于所述 SVC业务 的多层码流， 并进行解码。
终端监听广播信道帧， 并广播信道帧时隙 0和 ESG数据流中提取协同辅 助信息， 解析出 SVC业务的业务分层信息、 SVC层间依赖关系、 SVC层传 输信息以及 SVC各分层的自身参数信息。
终端确定所需要处理的最高层级的分层后， 从所述协同辅助信息中获取 这一分层所依赖的所有低层级的信息， 包括层间依赖关系、 层业务传输位置 信息以及各分层的层业务参数信息， 根据这些信息， 接收这一分层及其所依 赖的各低层级所对应的复用子帧， 从各复用子帧中提取出各分层数据， 进行 同步合并和解码。
具体的：
1 )终端通过 ESG基本描述表、 ESG数据信息得到当前业务的业务标识、 业务参数等信息， 以及其他业务标识相关的 ESG信息。
2 )终端根据当前业务标识确定从业务信息表确定所处理业务是一 SVC 业务， 并得到该 SVC业务所包含的 SVC分层的层业务标识等信息； 在此过 程中， 结合步骤 1的 ESG信息， 可得知 SVC分层的层自身参数信息。 3 )终端确定其所需要接收处理的最高层级 SVC分层， 4艮据该分层的层 业务标识，从业务信息表确定其所依赖的所有低层级 SVC分层的层业务标识。 所需要接收处理的最高层级 SVC分层的确定， 可以将 SVC分层的层自身参 数信息作为约束条件。
4 )终端从持续业务复用配置表或短时间业务复用配置表中， 得知各分层 所对应的复用子帧， 接收步骤 3 )所确定的分层及其所依赖的各低层级 SVC 分层所属的复用子帧。
5)从各复用子帧中提取出各分层数据， 协同进行同步合并、 解码。 在此 过程中， 可以将 SVC分层的层自身参数信息作为处理所依据的参数。
下面通过具体实施例详细说明本发明。
图 3是具体实施例中广播信道帧的组成结构示意图。某频点 F上有 40个 时隙， 其中时隙 0 (复用帧 0 )用于传送控制信息， 时隙 1至时隙 39用于传 送业务信息。 移动多媒体广播设备将 SVC视频业务 S中的视频基本层码流、 音频以及数据信息配置为复用帧 1中，占用时隙 1至时隙 4,复用子帧号为 1。 视频增强层码流配置为复用帧 2, 占用时隙 5至时隙 6, 复用子帧号为 1。 复 用帧 1和复用帧 2中不再传输其他业务。移动多媒体广播设备获取 SVC视频 业务 S的基本层码流 VI , 封装到复用帧 1的复用子帧 1中， 获取视频业务 S 的增强层码流 V2, 封装到复用帧 2的复用子帧 1中。 前端发送设备获取视频 业务 S的音频码流及数据段信息， 添加到复用帧 1的复用子帧 1中， 即与基 本层码流一起 载于同一个复用子帧中。 所述协同辅助信息， 包括业务分层信息， 本实施例中的 SVC视频釆用空 间分层 SVC编码， 包括 QVGA基本层和 VGA增强层两个层， 设 QVGA基 本层层标识为 LO, VGA增强层层标识为 L1 ; 层间依赖关系， QVGA基本层 L0可独立解码， VGA增强层 L1的解码依赖于 L0,终端如果要接收解码展现 VGA视频必须同时接收 L0和 L1的视频数据； 层传输信息， QVGA基本层 L0通过复用帧 1的复用子帧 1传输， VGA增强层 L1通过复用帧 2的复用子 帧 1传输； 层的自身参数信息， 如 QVGA基本层 L0的参数包括层标识 L0、 空间分层标识 DO、 时间分层标识 TO、 质量分层标识 TO、 Profile Level ID参 数为 (profile— idc = 0x42, level— idc = 0x0d),帧率为 25, 分辨率为 320x240,码率 为 480kbps; VGA增强层 LI的参数包括层标识 LI、 空间分层标识 Dl、 时间 分层标识 TO、 质量分层标识 TO、 Profile Level ID参数为 (profile— idc = 0x42, level— idc = 0x0d),帧率为 25 , 分辨率为 640x480, 码率为 360kbps。
将协同辅助信息在广播信道帧内封装时， 釆用以下方法：
为 SVC业务设定一全业务标识 SIDx, 为 SVC业务所包含的各分层， 设 定一层业务标识， QVGA基本层层业务标识为 SID10, VGA增强层层业务标识 为 SID11。
利用 CMMB广播信道帧时隙 0传送的控制信息表， 生成一业务信息表， 该信息表指示某个业务标识的业务类型及业务关联关系。 业务标识包括了 SVC业务的全业务标识和 SVC分层业务的层业务标识。业务标识对应的类务 类型分为普通业务（由 0表示）、 SVC业务（由 1表示）、 SVC分层业务（由 2表示）； 如果业务标识对应类型为 SVC业务， 则同时指示该 SVC业务所包 含的层业务标识； 如果业务标识对应类型为 SVC分层业务， 则同时指示该 SVC分层业务所依赖的其它层级 SVC分层业务的层业务标识。 对于本实施 例， 业务信息表可如图 4所示， 如 SIDx为一 SVC业务， 包含 SID10、 SID11 两个 SVC分层业务； SID10为一 SVC分层业务，可独立解码； SID11为一 SVC 分层业务， 依赖于 SID10分层。
将 SVC业务的业务标识如 SIDx、 对应的频点信息封装到持续业务配置 表或短时间业务配置表中。 将 SVC分层业务的业务标识、 传送该分层所用的 复用子帧的有关信息， 封装到持续业务复用配置表或短时间业务复用配置表 中。 本实施例中 SID10对应复用帧 1的复用子帧 1 , SID11对应复用帧 2的复 用子帧 1。 将 SVC业务的业务标识及相关 ESG信息、 SVC分层业务的业务 标识及相关的 ESG信息， 封装到 ESG基本描述表中。 将前述 SVC分层的自 身参数信息， 用 ESG业务参数信息封装； SVC业务相关的其它 ESG数据信 息如业务信息、 业务编排、 内容等 ESG信息， 用 ESG的业务信息、 业务编 排信息、 内容信息等规格分别封装。
终端上监听广播信道帧中 SVC视频流相关的协同辅助信息，从广播信道 帧时隙 0接收业务信息表、 持续业务配置表或短时间业务配置表、 持续业务 复用配置表或短时间业务复用配置表、 ESG基本描述表等控制信息表,从 ESG 数据流接收 ESG数据信息。终端根据自身能力接收处理与之适应的相关 SVC 分层码流， 才艮据协同辅助信息， 将属于同一 SVC业务的不同分层的数据协同 接收处理， 然后进行视频解码展现。
终端进行 SVC视频帧合成时，参与合成的基本层视频单元和增强层视频 单元必须保证具有协同关系， SVC视频帧合成处理需要协同关系相关信息。
具体包括：
1 )终端从广播信道帧时隙 0接收业务信息表、持续业务配置表或短时间 业务配置表、 持续业务复用配置表或短时间业务复用配置表、 ESG基本描述 表等控制信息表， 从 ESG数据流接收 ESG数据信息， 获得 SVC业务相关的 协同辅助信息。
2 )终端确定其所需要接收处理的最高层级 SVC分层后， 从协同辅助信 息获取这一分层所依赖的所有低层级 SVC分层的有关信息，接收这一分层及 其所依赖的各低层级 SVC分层所属的复用子帧，从各复用子帧中提取出各分 层数据， 根据层间关系、 层自身参数等信息， 协同进行同步合并、 解码。
步骤 2 )可进一步描述为：
1»终端通过 ESG基本描述表、 ESG数据信息得到当前业务的业务标识 SIDx、业务参数等信息，以及其他业务标识如 SID10、 SID11相关的 ESG信息。
2》终端根据当前业务标识 SIDx确定从业务信息表确定所处理业务是一 SVC业务，并得到该 SVC业务所包含的 SVC分层的层业务标识 SID10、 SID11 等信息；在此过程中，结合步骤 1的 ESG信息，可得知相关的 SVC分层 SID10、 SID11的层自身参数信息。
3》 终端从 SVC分层 SID10、 SID11 的层自身参数信息得知 SID11为一 SVC分层， 比较该分层的其它层自身参数信息后， 确定该层为其所需要接收 处理的最高层级 SVC分层。 根据该分层的层业务标识 SID11 , 从业务信息表 确定其所依赖的所有低层级 SVC分层的层业务标识为 （SID10 ) , 即需要同 时接收处理 SID11和 SID10这两个 SVC分层。
4》 终端从持续业务复用配置表或短时间业务复用配置表中，得知 SID10、 SID11所对应的复用子帧分别为复用帧 1的复用子帧 1和复用帧 2的复用子帧 1 , 一并接收这两个复用子帧。
5》从复用帧 1的复用子帧 1和复用帧 2的复用子帧 1这两路复用子帧中 提取出 QVGA基本层和 VGA增强层的视频媒体数据， 进行同步合并， 解码 输出 VGA视频。 在此过程中， 可以将 SID10、 SID11的层自身参数信息作为 处理所依据的控制参数。
当然， 本发明还可有其他多种实施例， 在不背离本发明精神及其实质的 但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。
本领域普通技术人员可以理解上述方法中的全部或部分步骤可通过程序 来指令相关硬件完成， 所述程序可以存储于计算机可读存储介质中， 如只读 存储器、 磁盘或光盘等。 可选地， 上述实施例的全部或部分步骤也可以使用 一个或多个集成电路来实现。 相应地， 上述实施例中的各模块 /单元可以釆用 硬件的形式实现， 也可以釆用软件功能模块的形式实现。 本发明不限制于任 何特定形式的硬件和软件的结合。
工业实用性 本发明实施例可以有效的传送 SVC 业务的各分层业务同时保证终端准 确接收及处理， 保证 SVC业务的应用。

Claims

权 利 要 求 书
1、 传输方法， 包括：
将可伸缩视频编码业务的视频流中基本层码流和增强层码流分别封装于 广播信道帧中的不同复用子帧中， 将用于正确解码多层视频流的协同辅助信 息封装于所述广播信道帧中， 一并发送至终端；
所述终端从接收到的广播信道帧中解析出所述协同辅助信息， 并根据所 述协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩视频编码 业务的多层码流， 并进行解码；
从而实现可伸缩视频编码业务协同传输。
2、 如权利要求 1所述的方法， 其中，
将所述协同辅助信息在广播信道帧内封装时， 将所述协同辅助信息封装 于控制信息表中， 或者封装于电子业务指南数据流中， 或者部分封装于控制 信息表中部分封装于电子业务指南数据流中， 或者与可伸缩视频编码业务基 本层媒体数据封装在同一复用子帧中， 或者部分与可伸缩视频编码业务基本 层媒体数据封装在同一复用子帧中部分封装在控制信息表和 /或电子业务指 南数据流中。
3、 如权利要求 1所述的方法， 其中，
所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信息、 层间 依赖关系、 层业务传输位置信息和层业务参数信息。
4、 如权利要求 3所述的方法， 其中，
设置一业务信息表用于表示所述协同辅助信息中业务分层信息和层间依 赖关系；
为所述可伸缩视频编码业务设置业务标识包括： 为所述可伸缩视频编码 业务设置全业务标识， 为所述可伸缩视频编码业务所包含各层业务设置层业 务标识；
所述业务信息表中携带的业务标识为全业务标识时， 同时指示此可伸缩 视频编码业务中各层业务对应的各层业务标识； 所述业务信息表中携带的业 务标识为层业务标识时， 同时指示此层业务标识对应的层业务所依赖的其它 层业务的层业务标识。
5、 如权利要求 3所述的方法， 其中， 将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务传输位置 信息封装在控制信息表中在所述广播信道帧的时隙 0中发送；
将所述协同辅助信息中层业务参数信息封装在电子业务指南数据流中发 送。
6、 如权利要求 5所述的方法， 其中， 将所述协同辅助信息中业务分层信息、 层间依赖关系、 层业务传输位置 信息封装在控制信息表中在所述广播信道帧的时隙 0中包括：
将所述可伸缩视频编码业务的业务标识封装在持续业务配置表或短时间 业务配置表中； 将所述可伸缩视频编码业务中各层业务的层业务标识以及传 输此层业务所用的复用子帧的信息封装在持续业务复用配置表或短时间业务 复用配置表中； 将所述可伸缩视频编码业务的业务标识以及相关电子业务指 南信息、 所述可伸缩视频编码业务中各层业务的业务标识以及相关电子业务 指南信息封装在电子业务指南基本描述表中；
将所述协同辅助信息中层业务参数信息封装在电子业务指南数据流中包 括：
将层业务参数信息封装在电子业务指南业务参数信息中。
7、 如权利要求 2至 6中任一权利要求所述的方法， 其中，
终端确定所需要处理的最高层级的分层后， 从所述协同辅助信息中获取 这一分层所依赖的所有低层级的信息， 包括层间依赖关系、 层业务传输位置 信息以及各分层的层业务参数信息， 根据这些信息， 接收这一分层及所依赖 的各低层级所对应的复用子帧， 从各复用子帧中提取出各分层数据， 进行同 步合并和解码。
8、 传输系统， 包括移动多媒体广播设备和终端， 其中，
所述移动多媒体广播设备设置为： 将可伸缩视频编码业务的视频流中基 本层码流和增强层码流分别封装于广播信道帧中的不同复用子帧中， 将用于 正确解码多层视频流的协同辅助信息封装于所述广播信道帧中， 一并发送至 终端；
所述终端设置为： 从接收到的广播信道帧中解析出所述协同辅助信息， 并根据所述协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩 视频编码业务的多层码流， 并进行解码；
从而实现可伸缩视频编码业务协同传输。
9、 如权利要求 8所述的系统， 其中，
所述协同辅助信息包括所述可伸缩视频编码业务中业务分层信息、 层间 依赖关系、 层业务传输位置信息和层业务参数信息；
所述移动多媒体广播设备还设置为： 将所述协同辅助信息中业务分层信 息、 层间依赖关系、 层业务传输位置信息封装在控制信息表中在所述广播信 道帧的时隙 0中发送； 将所述协同辅助信息中层业务参数信息封装在电子业 务指南数据流中发送。
10、 如权利要求 9所述的系统， 其中，
所述移动多媒体广播设备还设置为： 设置一业务信息表用于表示所述协 同辅助信息中业务分层信息和层间依赖关系； 为所述可伸缩视频编码业务设 置业务标识包括： 为所述可伸缩视频编码业务设置全业务标识， 为所述可伸 缩视频编码业务所包含各层业务设置层业务标识； 所述业务信息表中携带的 业务标识为全业务标识时， 同时指示此可伸缩视频编码业务中各层业务对应 的各层业务标识； 所述业务信息表中携带的业务标识为层业务标识时， 同时 指示此层业务标识对应的层业务所依赖的其它层业务的层业务标识。
11、 移动多媒体广播设备， 设置为： 将可伸缩视频编码业务的视频流中 基本层码流和增强层码流分别封装于广播信道帧中的不同复用子帧中， 将用 于正确解码多层视频流的协同辅助信息封装于所述广播信道帧中， 一并发送 至终端；
由终端从接收到的广播信道帧中解析出所述协同辅助信息， 并根据所述 协同辅助信息接收符合自身视频流处理能力而且属于所述可伸缩视频编码业 务的多层码流， 并进行解码， 以实现可伸缩视频编码业务协同传输。
12、 如权利要求 11所述的移动多媒体广播设备， 其中， 所述协同辅助信 息包括所述可伸缩视频编码业务中业务分层信息、 层间依赖关系、 层业务传 输位置信息和层业务参数信息；
所述移动多媒体广播设备还设置为： 将所述协同辅助信息中业务分层信 息、 层间依赖关系、 层业务传输位置信息封装在控制信息表中在所述广播信 道帧的时隙 0中发送； 将所述协同辅助信息中层业务参数信息封装在电子业 务指南数据流中发送。
13、 如权利要求 12所述的移动多媒体广播设备， 其中， 所述移动多媒体 广播设备还设置为： 设置一业务信息表用于表示所述协同辅助信息中业务分 层信息和层间依赖关系； 为所述可伸缩视频编码业务设置业务标识包括： 为 所述可伸缩视频编码业务设置全业务标识， 为所述可伸缩视频编码业务所包 含各层业务设置层业务标识； 所述业务信息表中携带的业务标识为全业务标 识时， 同时指示此可伸缩视频编码业务中各层业务对应的各层业务标识； 所 述业务信息表中携带的业务标识为层业务标识时， 同时指示此层业务标识对 应的层业务所依赖的其它层业务的层业务标识。
PCT/CN2011/076618 2010-09-17 2011-06-30 实现可伸缩视频编码业务协同传输的方法及系统 WO2012034441A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010287806.5 2010-09-17
CN 201010287806 CN102404560B (zh) 2010-09-17 2010-09-17 实现可伸缩视频编码业务协同传输的方法及系统

Publications (1)

Publication Number Publication Date
WO2012034441A1 true WO2012034441A1 (zh) 2012-03-22

Family

ID=45830985

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/076618 WO2012034441A1 (zh) 2010-09-17 2011-06-30 实现可伸缩视频编码业务协同传输的方法及系统

Country Status (2)

Country Link
CN (1) CN102404560B (zh)
WO (1) WO2012034441A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102685494A (zh) * 2012-04-10 2012-09-19 中国联合网络通信集团有限公司 移动视频业务处理方法、装置和系统
GB2519746B (en) * 2013-10-22 2016-12-14 Canon Kk Method, device and computer program for encapsulating scalable partitioned timed media data
CN105580376A (zh) * 2014-09-05 2016-05-11 华为技术有限公司 一种业务流的控制方法及装置
HK1221373A2 (zh) * 2016-03-29 2017-05-26 萬維數碼有限公司 種提升視頻分辨率和視頻質量的方法、編碼器及解碼器
CN107592555A (zh) * 2016-07-08 2018-01-16 北京信威通信技术股份有限公司 一种动态获取视频数据的方法、装置及系统
CN116015553B (zh) * 2022-12-29 2024-09-27 重庆御芯微信息技术有限公司 信号编码方法和装置、信号解码方法和装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005112464A1 (en) * 2004-05-12 2005-11-24 Nokia Corporation, Multiple interoperability points for scalable media coding and transmission
CN101390399A (zh) * 2006-01-11 2009-03-18 诺基亚公司 可伸缩视频编码中的图片的后向兼容聚合
WO2010014211A1 (en) * 2008-07-28 2010-02-04 Thomson Licensing Method and apparatus fast channel change using a scalable videdo coding (svc) stream
CN101783935A (zh) * 2009-01-19 2010-07-21 财团法人工业技术研究院 可调性视频编码标准的比特流封装方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005112464A1 (en) * 2004-05-12 2005-11-24 Nokia Corporation, Multiple interoperability points for scalable media coding and transmission
CN101390399A (zh) * 2006-01-11 2009-03-18 诺基亚公司 可伸缩视频编码中的图片的后向兼容聚合
WO2010014211A1 (en) * 2008-07-28 2010-02-04 Thomson Licensing Method and apparatus fast channel change using a scalable videdo coding (svc) stream
CN101783935A (zh) * 2009-01-19 2010-07-21 财团法人工业技术研究院 可调性视频编码标准的比特流封装方法

Also Published As

Publication number Publication date
CN102404560B (zh) 2013-12-18
CN102404560A (zh) 2012-04-04

Similar Documents

Publication Publication Date Title
US20120198501A1 (en) Method and device for hierarchical transmission and reception in mobile multimedia broadcasting system
CN1973545B (zh) 用于可缩放媒体编码和传输的多个互操作性点
CN101951506B (zh) 实现可伸缩视频编码业务同步发送、接收的系统和方法
WO2012034441A1 (zh) 实现可伸缩视频编码业务协同传输的方法及系统
US11343549B2 (en) Reception apparatus, reception method, transmission apparatus, and transmission method
CN108347492B (zh) 再现装置以及再现方法
WO2017122544A1 (ja) データ処理装置、及び、データ処理方法
EP2433278A1 (en) Method and arrangement for providing a backwards compatible payload format
WO2009114557A1 (en) System and method for recovering the decoding order of layered media in packet-based communication
WO2012079402A1 (zh) 一种多媒体数据传输的方法、系统和装置
US20230188767A1 (en) Transmission device, transmission method, reception device, and reception method
US10412422B2 (en) Apparatus for transmitting broadcasting signal, apparatus for receiving broadcasting signal, method for transmitting broadcasting signal, and method for receiving broadcasting signal
JP7553188B2 (ja) パケット化メディアストリームのサイドロード処理のための方法、機器、およびシステム
CN102763364A (zh) 使用超级帧收发多信道音频信号的方法及装置
KR101697385B1 (ko) 채널 적응형 계층적 방송 장치 및 방법
CN101754024A (zh) 一种复用装置及复用方法
WO2013040996A1 (zh) 分级编码复用的发送端、终端、系统及方法
CN102480634A (zh) 移动多媒体广播中分级业务同步的方法、设备和系统
WO2014047938A1 (zh) 数字视频码流的解码方法拼接方法和装置
WO2015115253A1 (ja) 受信装置、受信方法、送信装置、及び、送信方法
US20130191133A1 (en) Apparatus for audio data processing and method therefor
CN107005745B (zh) 封装视听内容流的方法和设备
KR20100060449A (ko) 수신 시스템 및 오디오 데이터 처리 방법
CN118842873A (zh) 一种基于无线广播的传输优化系统
KR20090078044A (ko) 방송 수신기의 방송 신호 처리 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11824511

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11824511

Country of ref document: EP

Kind code of ref document: A1