WO2020011208A1 - 异构网络下媒体的传输方法及系统 - Google Patents
异构网络下媒体的传输方法及系统 Download PDFInfo
- Publication number
- WO2020011208A1 WO2020011208A1 PCT/CN2019/095460 CN2019095460W WO2020011208A1 WO 2020011208 A1 WO2020011208 A1 WO 2020011208A1 CN 2019095460 W CN2019095460 W CN 2019095460W WO 2020011208 A1 WO2020011208 A1 WO 2020011208A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- media
- heterogeneous network
- stream
- network according
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/40—Network security protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
Definitions
- the present invention relates to the field of multimedia transmission, and in particular, to a method and system for transmitting and serving media in a heterogeneous network.
- the format of video media content is intelligently developed with higher definition and higher dimensions such as 4K / VR; the transmission mode changes from a single wired / wireless / satellite live broadcast mode to interactive collaboration, especially the accelerated integration with the Internet; terminal services are received from a traditional single fixed
- the device shifts to a high-quality, personalized multi-screen synchronous interactive service model that supports any time, any place.
- these changes bring new opportunities for the development of multimedia services, they also pose huge challenges to the intelligent organization, transmission and consumption of media services.
- Dynamic media is effectively organized and efficient content distribution is achieved through multi-network collaboration.
- the MMT (MPEG Media Transport) protocol is an application layer protocol for packet switching formulated by the International Standards Organization (MPEG) Moving Pictures Experts Group. It aims to provide transmission and distribution services for media data in heterogeneous networks, including one-way physical networks. (Such as a digital broadcast network) and a two-way physical network (such as an IP network), which can dynamically adapt to different network conditions in heterogeneous networks.
- the technologies such as multi-network integration and multi-screen interaction supported by the MMT protocol provide a perfect solution to the above problems, expand the service field of traditional TV, and improve the viewing experience of Internet videos.
- MMT can expand and enhance traditional video services, including the association, indexing and synchronization of diverse content, coupled presentation of diverse content with multiple users, and multiple terminals, thereby enabling interaction and collaboration between multiple users and multiple terminals.
- SMT Smart Media Transport
- the MPEG-2TS (Transport Stream) stream transmitted through the broadcast network is still an important content transmission method.
- TS supports a variety of basic media streams and a variety of media coding standards. It is widely used and has become a common standard in the media industry.
- a large number of existing equipment can only support TS streams.
- With the continuous integration of broadcast and other transmission methods such as the Internet how to upgrade broadcast transmission methods while enabling a large number of users who have not upgraded their equipment to continue to use existing equipment to enjoy normal media services has become a problem that must be solved. Therefore, when new media transmission protocols such as MMT and SMT are implemented on the broadcast network, if they can be compatible with TS streams, new users can only enjoy richer and more personalized media services without upgrading their devices. Users receiving TS streams can still enjoy normal media services.
- an object of the present invention is to provide a method and system for transmitting media in a heterogeneous network.
- a method for transmitting media in a heterogeneous network according to the present invention includes:
- Mapping and cue point insertion step performing data mapping and corresponding cue point insertion on the media data encapsulated by the first protocol
- TS stream packing step packing media data inserted through mapping and indication points into a TS stream
- Signaling insertion step insert signaling information in the TS stream.
- the first protocol is an MMT protocol.
- the mapping and indication point insertion step includes: placing a sample in the MMT package structure into a payload of a PES packet in a TS package structure, inserting a PES packet data mapping indicator point in a PES packet header, and inserting in a TS packet header TS packet data mapping indication point;
- the PES packet data mapping indication point indicates a data structure of an MMTP packet corresponding to the PES packet
- the TS packet data mapping indication point indicates to which MFU the data carried by the TS packet belongs.
- the TS stream packaging step includes: mapping information in the MMTP header to the TS header.
- the signaling information includes: time synchronization information, stream mapping information, main stream presentation information, and auxiliary stream related information.
- a system for transmitting media in a heterogeneous network according to the present invention includes:
- Mapping and cue point insertion module performing data mapping and corresponding cue point insertion on media data encapsulated by the first protocol
- TS stream packing module packs media data inserted through mapping and cue points into TS stream
- Signaling insertion module inserts signaling information in the TS stream.
- the first protocol is an MMT protocol.
- the mapping and cue point insertion module includes: placing a sample in the MMT package structure into a payload of a PES packet in a TS package structure, inserting a PES packet data mapping cue point in a PES packet header, and inserting in a TS packet header TS packet data mapping indication point;
- the PES packet data mapping indication point indicates a data structure of an MMTP packet corresponding to the PES packet
- the TS packet data mapping indication point indicates to which MFU the data carried by the TS packet belongs.
- the TS stream packing module includes: mapping information in the MMTP header to the TS header.
- the signaling information includes: time synchronization information, stream mapping information, main stream presentation information, and auxiliary stream related information.
- the present invention has the following beneficial effects:
- the present invention enables MMT and other protocols to be compatible with TS streams when implemented on a broadcast network, so that a large number of users who can only receive TS streams can continue to enjoy normal media services.
- FIG. 1 is a schematic diagram of a system frame according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of data mapping and cue point insertion according to an embodiment of the present invention.
- This embodiment uses the MMT protocol as an example for description, but the present invention is not limited thereto, and the present invention can also be applied to other new protocols such as SMT.
- the media resources of the same scene in the server include multiple related media resources, such as the primary and secondary perspectives.
- the primary perspective media resources are packaged into TS streams and inserted into the multi-view related signaling in the MMT protocol. It is sent from the broadcast channel via the DTMB exciter.
- MMT-related signaling will be automatically ignored, and a single main-view media service will be presented at the playback terminal; for a new generation of set-top boxes that can analyze the MMT protocol, it will be compatible with TS streams and parse out Present relevant information from multiple perspectives, and then send a request to the server through the broadband network based on this information.
- the server packs the secondary-view media resources into an MMTP packet and sends them to the user terminal via the broadband network.
- the multi-view media resources are presented synchronously at the playback terminal.
- a method for transmitting media in a heterogeneous network includes the following steps:
- mapping and cue point insertion step perform data mapping and corresponding cue point insertion on the media data encapsulated by the first protocol.
- the largest segment unit in each video stream is a PES packet.
- the PES packet is selected to correspond to MMT.
- the sample corresponding to the PES packet is the movie fragment. Therefore, in order to recover the data structure required for MMT presentation from the TS stream at the receiving end, the package information above the sample layer needs to be added to the PES packet, that is, MPU_sequence_number, movie_fragment_sequence_number, and sample_number in the MMTP packet payload.
- a field MFU_number needs to be inserted to indicate the corresponding MFU.
- the packet_id in the MMTP packet header that is, a field indicating different media resources, should correspond to the PID in the TS packet.
- the sample in the MMT package structure is put into the payload of the PES packet in the TS package structure.
- sample # n is put into the payload of PES packet #n.
- a PES packet data mapping indication point is inserted into the PES packet header to indicate the data structure of the MMTP packet corresponding to the PES packet.
- a TS packet data mapping indication point is inserted in the TS packet header to indicate to which MFU the data carried by the TS packet belongs.
- one TS packet can only carry one MFU data at most, but one MFU can be carried by multiple TS packets.
- MFU # 1 is carried by TS packet # 1 and TS packet # 2
- MFU # 3 is carried by TS packet # 3.
- PES_extension_field is used to carry MPU_sequence_number, movie_fragment_sequence_number, and sample_number; in the TS header, adaptation_field is used to carry MFU_number.
- TS stream packing step Pack the media data inserted through the mapping and indication points into a TS stream.
- the MMT-encapsulated main-view media resources need to be packaged into a TS stream for transmission.
- the relevant information in the MMTP header needs to be mapped into the TS header.
- Table 1 shows the mapping relationship between the corresponding fields in the header of the TS and MMTP headers.
- MPEG-2TS package MMTP package payload_unit_start_indicator f_i transport_priority priority PID packet_id continuity_counter packet_sequence_number random_access_indicator R (RAP_flag)
- payload_unit_start_indicator the payload data unit start indicator.
- transport_priority transport priority indicator, set according to the priority field of the MMTP packet.
- PID indicates the type of data stored in the payload, which is the same as the value of the packet_id field of the MMTP packet.
- continuity_counter The continuity counter is incremented with each packet with the same PID value.
- the PID corresponds to packet_id, so this field corresponds to packet_sequence_number.
- random_access_indicator Random access indicator, located in the Adaptation Field (AF) of the TS header, corresponding to the R (RAP_flag) field of the MMTP header. Set to “1" when R is "1"
- Signaling insertion step Insert signaling information in the TS stream.
- the information related to the multi-view presentation that should be inserted in the main TS stream mainly includes the following four aspects:
- Time synchronization information For TS parsing devices, the TS stream is directly parsed and presented; for MMT parsing devices, the TS stream needs to be parsed, and the UTC time in the MMT main perspective media resource needs to be converted to PTS (Presentation Time Stamp) Or DTS (Decode Time Stamp) timestamp, and recover the UTC time at the terminal.
- PTS Presentation Time Stamp
- DTS Decode Time Stamp
- Mainstream presentation information including information such as the position and layout of the main perspective picture.
- the TS stream corresponding to the primary perspective media resource should include the secondary perspective media resource acquisition method (such as URL), time stamp, and the spatial layout and playback instruction information of each secondary perspective screen.
- the present invention embeds it in the TS stream in the form of external media information (Timeline and External Media Information, TEMI).
- TEMI Timeline and External Media Information
- “External” in the external media information (TEMI) is relative to the TS stream, that is, the MMT stream and the like that need to be presented synchronously with the TS stream.
- TEMI is expressed in the form of AF_descriptor.
- the AF tag descriptor assignment in the TS protocol is shown in Table 2.
- AF Descriptor contains a variety of newly defined descriptors such as Timeline Descriptor, Location Descriptor, and so on.
- the Timeline Descriptor can be used to carry the time synchronization information of the secondary perspective media resources
- the Location Descriptor can be used to carry the type and URL of the external media resource
- the User Private can carry other information such as presentation.
- has_timestamp indicates whether the external media resource contains a timestamp. '0' indicates no time stamp, '1' indicates a 32-bit time stamp, and '2' indicates a 64-bit time stamp. Obviously, the MMT stream is a 32-bit NTP time stamp based on UTC, and the value of has_timestamp should be equal to '1'.
- has_ntp indicates whether it is an NTP timestamp. '1' indicates an NTP timestamp.
- the MMT stream uses NTP time and has_ntp value is '1'.
- timeline_id indicates to which external media resources the time information carried by the Timeline Descriptor is valid, and corresponds to the timeline_id in the Location Descriptor. That is, if the values are the same, the external media resource indicated by location_descriptor uses the time information indicated by Timeline_descriptor.
- the value range of the field is [0,0x7F].
- timescale indicates the time scale of the external media together with media_timestamp.
- the conversion relationship between the timestamp media_timestamp and the TS timestamp is:
- MTi timescale * (PTSi-PTS0) / 90000 + MT0.
- Timeline Descriptor can be used to carry the time information of the MMT auxiliary view stream. Since these MMT flows all use the NTP timestamp, they have the same timeline_id.
- the value range of timeline_id is [0,0x7F], which can be allocated for the MMT auxiliary view stream as required.
- timeline_id Corresponds to timeline_id in Timeline Descriptor. The same value indicates that the external media resource indicated by the Location Descriptor uses the corresponding timeline information.
- url_scheme indicates the URL scheme used by the external media resource location.
- url_path_length together with url_path, indicates the base URL length and value.
- Base URL refers to the common part of the URL of each external media.
- nb_addons indicates the number of external media resources, that is, the number of MMT secondary view streams.
- TEMI Service Type Add-on type 0 Specified with Mime Type 1 MPEG-DASH 2 ISO / IEC14496-12file 3 Rec.ITU-T H.222.0
- url_subpath_length together with addon_location, indicates the length and value of the private part of the URL corresponding to each external media resource.
- the Location Descriptor can provide the URL scheme and specific URL value corresponding to each MMT auxiliary perspective stream.
- the MMT receiver can obtain the URL information of all MMT auxiliary perspective streams by parsing the Location Descriptor contained in the TS stream, and then pull it through the broadband network.
- presentation information corresponding to each perspective is also required, such as layout.
- This information can be defined by the new AF Descriptor and embedded in the TS stream.
- 0x80 is selected from the User Private corresponding to 0x80-0xFF in the AF Descriptor Tag, and a presentation information descriptor MMT indicating a primary view and a secondary view MMT stream is defined, which is used to carry multi-view presentation information included in the MMT main view stream (Ie MPI table).
- MMT PI Descriptor is shown in Table 6.
- the time (synchronization) information and URL information of the MMT auxiliary view stream can be indicated.
- the TS stream corresponding to the main view stream is first converted to an MMT stream.
- the URL information of multiple MMT auxiliary view streams can be obtained by parsing the above two descriptors.
- Perspective media resources Combined with the time information in the Timeline Descriptor, the MMT parsing device can synchronize the MMT streams corresponding to the primary and secondary views.
- the relevant presentation and layout information of each media resource in the MMT stream of the primary and secondary MMT streams is obtained through the MMT PI Descriptor defined in the present invention.
- the receiving terminal requests the media resources of the secondary perspective from the broadband network after analyzing the media resources of the primary perspective, thereby defining and using all signaling for multi-view presentation.
- TEMI information namely AF Descriptor
- TEMI can be added as an extension to the Adaptation Field in the TS header
- Table 7 is the AdaptationField syntax format with the AFDescriptor extension added. Set adaptation_field_extension_flag to "1" to indicate that there is an extension;
- TEMI can also be transmitted as a separate PES packet, which is called TEMI stream.
- TEMI uses private_stream_1 (stream_id is 10111101) for transmission, and stream_type is 0x26.
- TEMI constitutes the payload of the PES packet in the form of TEMI Access Unit (TEMI_AU).
- TEMI_AU TEMI Access Unit
- One AF Descriptor can be carried by one or more TEMI_AUs, and one TEMI_AU can also carry one or more AFD Descriptors.
- the syntax structure of TEMI_AU is shown in Table 10.
- the present invention further provides a system for transmitting media in a heterogeneous network, including:
- Mapping and cue point insertion module perform data mapping and corresponding cue point insertion on the media data encapsulated by the first protocol
- TS stream packing module packs media data inserted through mapping and cue points into TS stream
- Signaling insertion module inserts signaling information in the TS stream.
- the first protocol is the MMT protocol.
- the mapping and cue point insertion module includes: placing a sample in the MMT package structure into the payload of the PES packet in the TS package structure, inserting a PES packet data mapping cue point in the PES header, and inserting a TS packet data mapping cue point in the TS header ;
- the PES packet data mapping indication point indicates the data structure of the MMTP packet corresponding to the PES packet
- the TS packet data mapping indication point indicates to which MFU the data carried by the TS packet belongs.
- the TS stream packing module includes: mapping information in the MMTP header to the TS header.
- the signaling information includes: time synchronization information, stream mapping information, mainstream presentation information, and auxiliary stream related information.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明提供了一种异构网络下媒体的传输方法及系统,包括:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入;将经过映射与指示点插入的媒体数据打包成TS流;在TS流中插入信令信息。本发明使得MMT等协议在广播网上实现时,可以兼容TS流,让大量只能接收TS流的用户,能够继续享受正常的媒体服务。
Description
本发明涉及多媒体传输领域,具体地,涉及异构网络下媒体的传输与服务方法及系统。
随着传统媒体与新兴媒体的加速融合,媒体的业务形态、传输分发、接收服务等全流程都发生了巨大变化。视频媒体内容格式向4K/VR等更高清晰度更高维度的智能化发展;传输方式从有线/无线/卫星单一直播方式,向交互协同,尤其与互联网加速融合;终端服务从传统单一固定接收设备向支持任何时间、任何地点的高质量,个性化多屏同步互动服务模式转变。然而,这些变化带来多媒体服务发展新机遇的同时,也对媒体服务的智能组织、传输与消费带来了巨大的挑战。为解决此问题,需要广播网与宽带网优势互补、深度融合,从而构建一个可管、可控、可信的智能媒体融合网络,通过可表示、可处理、可信赖的方式将海量、多元、动态的媒体有效组织起来,并通过多网协同的方式进行高效内容分发。
MMT(MPEG Media Transport)协议是国际标准组织MPEG(Moving Picture Experts Group)制定的为面向包交换的应用层协议,旨在为异构网络中的媒体数据提供传输与分发服务,包括单向物理网络(如数字广播网络)和双向物理网络(如IP网络)组成的混合网络,能动态地自适应于异构网络中的不同网络条件。MMT协议支持的多网融合、多屏互动等技术为解决以上问题提供了完美的解决方案,拓展了传统电视的服务领域,同时提升了互联网视频的观看体验。MMT能够对传统视频业务进行拓展和提升,包括多元内容间的关联、索引与同步,多元内容与多用户、多终端的耦合呈现,从而实现多用户、多终端之间的互动与协同。在国内,数字音视频编解码技术标准工作组也已制定的相应的标准,即智能媒体传输(Smart Media Transport,SMT)协议。
在内容的传送技术方面,通过广播网发送的MPEG-2TS(Transport Stream)流仍是一种重要内容传输方式。TS支持多种基本媒体流和多种媒体编码标准,并普 遍应用并成为媒体行业通用标准,目前大量现有设备仍然只能支持TS流。在广播与互联网等其他传输方式不断融合的当下,如何在升级广播传输方式的同时,让大量未进行设备更新换代的用户能够继续使用现有设备享受正常的媒体服务成为一个必须要解决的问题。因此,当以MMT和SMT等为代表的新型媒体传输协议在广播网上实现时,如果可以兼容TS流,那么新用户在享受更加丰富和个性化的媒体服务的同时,未进行设备升级的只能接收TS流的用户,仍能享受正常的媒体服务。
发明内容
针对现有技术中的缺陷,本发明的目的是提供一种异构网络下媒体的传输方法及系统。
根据本发明提供的一种异构网络下媒体的传输方法,包括:
映射与指示点插入步骤:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入;
TS流打包步骤:将经过映射与指示点插入的媒体数据打包成TS流;
信令插入步骤:在TS流中插入信令信息。
较佳的,所述第一协议为MMT协议。
较佳的,所述映射与指示点插入步骤包括:把MMT封装结构中的sample放入TS封装结构中PES包的负载中,并在PES包头插入PES包数据映射指示点,在TS包头中插入TS包数据映射指示点;
所述PES包数据映射指示点指示PES包所对应的MMTP包的数据结构;
所述sample中有至少一个MFU,所述TS包数据映射指示点指示TS包所负载的数据属于哪一个MFU。
较佳的,所述TS流打包步骤包括:将MMTP包头中的信息映射到TS包头中。
较佳的,所述信令信息包括:时间同步信息、stream映射信息、主流呈现信息和辅流相关信息。
根据本发明提供的一种异构网络下媒体的传输系统,包括:
映射与指示点插入模块:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入;
TS流打包模块:将经过映射与指示点插入的媒体数据打包成TS流;
信令插入模块:在TS流中插入信令信息。
较佳的,所述第一协议为MMT协议。
较佳的,所述映射与指示点插入模块包括:把MMT封装结构中的sample放入TS封装结构中PES包的负载中,并在PES包头插入PES包数据映射指示点,在TS包头中插入TS包数据映射指示点;
所述PES包数据映射指示点指示PES包所对应的MMTP包的数据结构;
所述sample中有至少一个MFU,所述TS包数据映射指示点指示TS包所负载的数据属于哪一个MFU。
较佳的,所述TS流打包模块包括:将MMTP包头中的信息映射到TS包头中。
较佳的,所述信令信息包括:时间同步信息、stream映射信息、主流呈现信息和辅流相关信息。
与现有技术相比,本发明具有如下的有益效果:
本发明使得MMT等协议在广播网上实现时,可以兼容TS流,让大量只能接收TS流的用户,能够继续享受正常的媒体服务。
通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:
图1为本发明实施例的系统框架示意图;
图2为本发明实施例的数据映射与指示点插入示意图。
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变化和改进。这些都属于本发明的保护范围。
本实施例以MMT协议为例进行说明,但本发明并不以此为限,本发明也可适用于SMT等其他新型协议。
如图1所示,服务器中同一场景的媒体资源包括主视角和辅视角等多种相互关联的媒体资源,其中主视角媒体资源打包成TS流,同时插入MMT协议中多视角相关的信令,经DTMB激励器从广播通道发送出去。对于普通机顶盒,由于只能解析TS流,将自动忽 略MMT相关信令,并在播放终端呈现单一的主视角媒体服务;对于能够解析MMT协议的新一代机顶盒,将兼容TS流,并解析出与多视角呈现相关的信息,然后根据这些信息,通过宽带网向服务器发送请求。服务器收到请求后,将辅视角媒体资源打包成MMTP包,经宽带网发送至用户终端,最后在播放终端实现多视角媒体资源同步呈现。
本发明提供的一种异构网络下媒体的传输方法,包括如下步骤:
1、映射与指示点插入步骤:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入。
在MPEG-2TS的封装结构中,每个视频流中最大的分割单元为PES包,为减少开销,选择PES包与MMT对应。在MMT的封装结构中,与PES包对应的是movie fragment下的sample。因此,为了在接收端从TS流中恢复MMT呈现所需的数据结构,需要在PES包中加入sample层以上的封装信息,即MMTP包负载中的MPU_sequence_number、movie_fragment_sequence_number以及sample_number。同时,在TS包中,需要插入字段MFU_number,用于指示对应的MFU。另外,MMTP包头中的packet_id,即指示不同媒体资源的字段,应与TS包中的PID对应。
具体实现为两步,首先,把MMT封装结构中的sample放入TS封装结构中PES包的负载(payload)中。例如,在图2中,把sample#n放入PES包#n的负载中。同时,在PES包头中插入PES包数据映射指示点,用于指示该PES包所对应的MMTP包的数据结构。其次,在TS包头中插入TS包数据映射指示点,用于指示该TS包所负载的数据属于哪一个MFU。其中,一个TS包最多只能携带一个MFU数据,但一个MFU可被多个TS包携带。例如,在图2中,MFU#1被TS包#1和TS包#2携带,MFU#2被TS包#3携带。
具体地,在插入数据映射指示点时,在PES包头中,使用PES_extension_field承载MPU_sequence_number、movie_fragment_sequence_number以及sample_number;在TS包头中,使用adaptation_field承载MFU_number。
2、TS流打包步骤:将经过映射与指示点插入的媒体数据打包成TS流。
在完成数据映射和相应的指示点插入后,经MMT封装的主视角媒体资源需打包成TS流进行传输。在进行TS流打包时,需要将MMTP包头中的相关信息映射到TS包头中。表1给出了TS和MMTP包头部分对应字段的映射关系。
表1
| MPEG-2TS包 | MMTP包 |
| payload_unit_start_indicator | f_i |
| transport_priority | priority |
| PID | packet_id |
| continuity_counter | packet_sequence_number |
| random_access_indicator | R(RAP_flag) |
各字段含义如下:
payload_unit_start_indicator:负载数据单元起始指示符,当MMTP包f_i字段为“00”或“01”时,此字段置“1”;否则置“0”。
transport_priority:传输优先级指示符,根据MMTP包priority字段指示设置。
PID:指示负载中存储的数据类型,与MMTP包packet_id字段值相同。
continuity_counter:连续性计数器,随着每个具有相同PID值的包而递增,PID与packet_id对应,故此字段与packet_sequence_number对应。
random_access_indicator:随机接入指示符,位于TS包头的Adaption Field(AF),与MMTP包头的R(RAP_flag)字段对应,R为“1”时置“1”。
3、信令插入步骤:在TS流中插入信令信息。
要实现多视角同步呈现等服务,实现MMT协议的设备不仅要能解析TS流,还应在TS流中包含多视角呈现相关的信息。如图1中信令插入模块所示,主要TS流中应插入的多视角呈现相关的信息主要包括以下四个方面:
1)时间同步信息:对于TS解析设备,直接对TS流进行解析呈现;对于MMT解析设备,需要对TS流进行解析,需要将MMT主视角媒体资源中的UTC时间转换为PTS(Presentation Time Stamp)或DTS(Decode Time Stamp)时间戳,并在终端恢复出UTC时间。转换公式如下(其中PCR为MPEG-2TS 90kHz系统时钟):
2)stream映射信息:将MMT协议中的asset_id(PA message)转换成为TS包中的stream_id(PMT表),MMT主视角流只包含一个节目,因此不需要使用PAT表。
3)主流呈现信息:包括主视角画面的位置与布局等信息。
4)辅流相关信息:主视角媒体资源对应的TS流中应当包含辅视角媒体资源的获取方式(如URL等)、时间戳,以及每个辅视角画面的空间布局、播放指示信息。
对于上述信令信息,本发明通过外部媒体信息(Timeline and External Media Information,TEMI)的形式将其嵌入TS流中。外部媒体信息(TEMI)中的“外部”是相对于TS流而言的,即需要和TS流进行同步呈现的MMT流等。TEMI以AF_descriptor形式表示,在TS协议中的AF descriptor tag分配如表2所示。
表2
| AF Descriptor Tag | Identification |
| 0x00-0x03 | Rec.ITU-T H.222.0|ISO/IEC 13818-1Reserved |
| 0x04 | Timeline Descriptor |
| 0x05 | Location Descriptor |
| 0x06 | BaseURL Descriptor |
| 0x07 | Cets_byte_range_descriptor(see note 1) |
| 0x08-0x7F | Rec.ITU-T H.222.0|ISO/IEC 13818-1Reserved |
| 0x80-0xFF | User Private |
从表2可以看出,AF Descriptor包含Timeline Descriptor、Location Descriptor等多种新定义的描述符。其中,Timeline Descriptor可用于携带辅视角媒体资源的时间同步信息,Location Descriptor可用于携带外部media resource的类型、URL等信息,而User Private则可携带呈现等需要的其他信息。
具体地,Timeline Descriptor的语法结构如表3所示:
表3
其中,与MMT流相关的主要字段含义如下:
has_timestamp:指示外部媒体资源是否含有时间戳。‘0’表示没有时间戳,‘1’表示有32比特时间戳,‘2’表示有64比特时间戳。显然,MMT流是基于UTC的32比特 NTP时间戳,has_timestamp的值应当等于‘1’。
has_ntp:指示是否为NTP时间戳。‘1’表示NTP时间戳。MMT流使用NTP时间,has_ntp值为‘1’。
timeline_id:表示Timeline Descriptor携带的时间信息对哪些外部媒体资源有效,与Location Descriptor中的timeline_id对应。即如果二者取值相同,那么location_descriptor所指示的外部媒体资源使用Timeline_descriptor指示的时间信息。字段取值范围是[0,0x7F]。
timescale:与media_timestamp一起指示外部媒体的时间尺度。其时间戳media_timestamp与TS时间戳的换算关系为:
MTi=timescale*(PTSi-PTS0)/90000+MT0。
MMT流的timestamp为32比特NTP时间,timescale=1/232,因此时间换算关系如下:
由此可知,可以使用Timeline Descriptor携带MMT辅视角流的时间信息。由于这些MMT流均使用NTP时间戳,因此具有相同的timeline_id。timeline_id的取值范围是[0,0x7F],可根据需要为MMT辅视角流进行分配。
Location Descriptor语法结构如表4所示。
表4
其中,与MMT流相关的主要字段含义如下:
timeline_id:与Timeline Descriptor中的timeline_id对应。二者取值相同则表明Location Descriptor所指示的外部媒体资源使用对应的timeline信息。
url_scheme:指示外部媒体资源位置使用的URL方案。
url_path_length:与url_path一起,指示base URL长度和取值。其中,Base URL 指的是各个外部媒体的URL的共同部分。
nb_addons:指示外部媒体资源的数目,即MMT辅视角流的数目。
service_type:外部媒体资源服务类型。如表5所示,可以利用其0x80-0xFF对应的User private定义对MMT流的支持。
表5
| TEMI Service Type | Add-on type |
| 0 | Specified with Mime Type |
| 1 | MPEG-DASH |
| 2 | ISO/IEC 14496-12file |
| 3 | Rec.ITU-T H.222.0|ISO/IEC 13818-1Transport Stream |
| 0x04-0x7E | Rec.ITU-T H.222.0|ISO/IEC 13818-1Reserved |
| 0x7F | Unknown service type |
| 0x80–0xFF | User Private |
url_subpath_length:与addon_location一起,指示各个外部媒体资源对应URL的私有部分的长度和取值。
由此可知,Location Descriptor可以给出各个MMT辅视角流对应的URL方案和具体的URL取值。MMT接收端通过解析TS流中包含的Location Descriptor就可以获取全部MMT辅视角流的URL信息,进而通过宽带网进行拉取。
另外,要实现多视角同步呈现还需要各个视角对应的呈现信息,例如布局等。这些信息可以通过定义新的AF Descriptor,并嵌入TS流中。本发明在AF Descriptor Tag中0x80-0xFF对应的User Private中选择0x80,定义指示主视角和辅视角MMT流的呈现信息描述符MMT PI Descriptor,用于承载MMT主视角流中包含的多视角呈现信息(即MPI table)。MMT PI Descriptor如表6所示。
表6
综上所述,通过在TS流中携带TEMI信息中的Timeline Descriptor和Location Descriptor,可以指示出MMT辅视角流的时间(同步)信息和URL信息。对于MMT接收设备,首先将主视角流对应的TS流转换为MMT流;同时,通过对以上两个描述符的解析,可以获取多个MMT辅视角流的URL信息,进而可以通过宽带网请求辅视角的媒体资源。结合Timeline Descriptor中时间信息,MMT解析设备就可以将主视角和辅视角对应的MMT流进行同步。另外,通过本发明定义的MMT PI Descriptor获取主视角和辅视角MMT流中各个媒体资源的相关呈现和布局信息。至此,已经实现了通过TS流传输主视角媒体资源,接收终端解析主视角媒体资源后从宽带网请求辅视角媒体资源,从而进行多视角呈现的全部信令的定义与使用。
上述各种TEMI信息,即AF Descriptor,可以通过两种方式前嵌入TS流:
(1)TEMI可以作为扩展添加到TS包头中的Adaptation Field中
表7是加入了AF Descriptor扩展的Adaptation Field语法格式。令adaptation_field_extension_flag置为“1”表示存在扩展;
令af_descriptor_not_present_flag置为“0”表示Adaptation Field存在AF Descriptor。
表7
(2)TEMI还可以作为一个单独的PES包进行传输,称为TEMI stream。
在这种模式下,其stream_id和stream_type的分配分别如表8和表9所示。其中TEMI使用private_stream_1(stream_id为10111101)传输,stream_type为0x26。此时,TEMI以TEMI Access Unit(TEMI_AU)的形式构成PES包的payload。一个AF Descriptor可以由一个或者多个TEMI_AU携带,一个TEMI_AU也可携带一个或者多个AF Ddescriptor。TEMI_AU的语法结构如表10所示。
表8
表9
表10
基于上述一种异构网络下媒体的传输方法,本发明还提供一种异构网络下媒体的传输系统,包括:
映射与指示点插入模块:对经过第一协议封装的媒体数据进行数据映射和相应的指 示点插入;
TS流打包模块:将经过映射与指示点插入的媒体数据打包成TS流;
信令插入模块:在TS流中插入信令信息。
在本实施例中,第一协议为MMT协议。
映射与指示点插入模块包括:把MMT封装结构中的sample放入TS封装结构中PES包的负载中,并在PES包头插入PES包数据映射指示点,在TS包头中插入TS包数据映射指示点;
PES包数据映射指示点指示PES包所对应的MMTP包的数据结构;
sample中有至少一个MFU,TS包数据映射指示点指示TS包所负载的数据属于哪一个MFU。
TS流打包模块包括:将MMTP包头中的信息映射到TS包头中。
信令信息包括:时间同步信息、stream映射信息、主流呈现信息和辅流相关信息。
本领域技术人员知道,除了以纯计算机可读程序代码方式实现本发明提供的系统及其各个装置、模块、单元以外,完全可以通过将方法步骤进行逻辑编程来使得本发明提供的系统及其各个装置、模块、单元以逻辑门、开关、专用集成电路、可编程逻辑控制器以及嵌入式微控制器等的形式来实现相同功能。所以,本发明提供的系统及其各项装置、模块、单元可以被认为是一种硬件部件,而对其内包括的用于实现各种功能的装置、模块、单元也可以视为硬件部件内的结构;也可以将用于实现各种功能的装置、模块、单元视为既可以是实现方法的软件模块又可以是硬件部件内的结构。
以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变化或修改,这并不影响本发明的实质内容。在不冲突的情况下,本申请的实施例和实施例中的特征可以任意相互组合。
Claims (32)
- 一种异构网络下媒体的传输方法,其特征在于,包括:映射与指示点插入步骤:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入;TS流打包步骤:将经过映射与指示点插入的媒体数据打包成TS流;信令插入步骤:在TS流中插入信令信息。
- 根据权利要求1所述的异构网络下媒体的传输方法,其特征在于,所述第一协议为MMT协议。
- 根据权利要求2所述的异构网络下媒体的传输方法,其特征在于,所述TS流打包步骤包括:将MMTP包头中的信息映射到TS包头中。
- 根据权利要求2所述的异构网络下媒体的传输方法,其特征在于,所述信令信息包括:时间同步信息、主流呈现信息和辅流相关信息。
- 根据权利要求2所述的异构网络下媒体的传输方法,其特征在于,所述信令信息还包括:stream映射信息。
- 根据权利要求4所述的异构网络下媒体的传输方法,其特征在于,所述时间同步信息是基于UTC(Universal Time Coordinated)的时间和基于PCR(Program Clock Reference)的时间的同步,基于PCR的值和基于UTC的绝对值之间互换。
- 根据权利要求6所述的异构网络下媒体的传输方法,其特征在于,所述PCR时间包括PTS(Presentation Time Stamp)和DTS(Decode Time Stamp)。
- 根据权利要求4所述的异构网络下媒体的传输方法,其特征在于,所述辅流相关信息为主视角媒体资源对应的TS流中包含的辅视角媒体资源的获取方式、时间戳,以及每个辅视角画面的空间布局、播放指示信息。
- 根据权利要求2所述的异构网络下媒体的传输方法,其特征在于,所述信令信息是通过外部媒体信息(Timeline and External Media Information,TEMI)的形 式嵌入TS流中的。
- 根据权利要求10所述的异构网络下媒体的传输方法,其特征在于,所述外部媒体信息包括AF描述符定义的信息。
- 根据权利要求10所述的异构网络下媒体的传输方法,其特征在于,在所述外部媒体信息中或在所述AF描述符信息中包括时间描述符定义的信息、地点描述符定义的信息、用户自定义信息。
- 根据权利要求12所述的异构网络下媒体的传输方法,其特征在于,所述时间描述符定义的信息是用于携带辅视角媒体资源的时间同步信息;所述地点描述符定义的信息是用于携带演示信息,所述演示信息包括:每个辅助流的位置、URL和布局。
- 根据权利要求12所述的异构网络下媒体的传输方法,其特征在于,所述用户自定义信息包括承载主视角流中包含的多视角呈现信息。
- 根据权利要求14所述的异构网络下媒体的传输方法,其特征在于,所述承载主视角流中包含的多视角呈现信息包括:描述符标签;描述符长度;描述符负载长度;描述符负载数据。
- 根据权利要求2所述的异构网络下媒体的传输方法,其特征在于,所述映射与指示点插入步骤包括:把MMT封装结构中的sample放入TS封装结构中PES包的负载中,并在PES包头插入PES包数据映射指示点,在TS包头中插入TS包数据映射指示点;所述PES包数据映射指示点指示PES包所对应的MMTP包的数据结构;所述sample中有至少一个MFU,所述TS包数据映射指示点指示TS包所负载的数据属于哪一个MFU。
- 一种异构网络下媒体的传输系统,其特征在于,包括:映射与指示点插入模块:对经过第一协议封装的媒体数据进行数据映射和相应的指示点插入;TS流打包模块:将经过映射与指示点插入的媒体数据打包成TS流;信令插入模块:在TS流中插入信令信息。
- 根据权利要求17所述的异构网络下媒体的传输系统,其特征在于,所述第一协议为MMT协议。
- 根据权利要求18所述的异构网络下媒体的传输系统,其特征在于,所述TS流打包模块包括:将MMTP包头中的信息映射到TS包头中。
- 根据权利要求18所述的异构网络下媒体的传输系统,其特征在于,所述信令信息包括:时间同步信息、主流呈现信息和辅流相关信息。
- 根据权利要求18所述的异构网络下媒体的传输系统,其特征在于,所述信令信息还包括:stream映射信息。
- 根据权利要求20所述的异构网络下媒体的传输系统,其特征在于,所述时间同步信息是基于UTC(Universal Time Coordinated)的时间和基于PCR(Program Clock Reference)的时间的同步,基于PCR的值和基于UTC的绝对值之间可以根据公式转换。
- 根据权利要求22所述的异构网络下媒体的传输系统,其特征在于,所述PCR时间由PTS(Presentation Time Stamp)和DTS(Decode Time Stamp)两种表示方法组成。
- 根据权利要求20所述的异构网络下媒体的传输系统,其特征在于,所述辅流相关信息为主视角媒体资源对应的TS流中包含的辅视角媒体资源的获取方式、时间戳,以及每个辅视角画面的空间布局、播放指示信息。
- 根据权利要求18所述的异构网络下媒体的传输系统,其特征在于,所述信令信息是通过外部媒体信息(Timeline and External Media Information,TEMI)的形式嵌入TS流中的。
- 根据权利要求26所述的异构网络下媒体的传输系统,其特征在于,所述外部媒体信息包括AF描述符定义的信息。
- 根据权利要求26所述的异构网络下媒体的传输系统,其特征在于,在所述外部媒体信息中或在所述AF描述符信息中包括时间描述符定义的信息、地点描述符定义的信息、用户自定义信息。
- 根据权利要求28所述的异构网络下媒体的传输系统,其特征在于,所述时间描述符定义的信息是用于携带辅视角媒体资源的时间同步信息;所述地点描述符定义的信息是用于携带演示信息,所述演示信息包括:每个辅助流的位置、URL和布局。
- 根据权利要求28所述的异构网络下媒体的传输系统,其特征在于,所述用户自定义信息包括承载主视角流中包含的多视角呈现信息。
- 根据权利要求30所述的异构网络下媒体的传输系统,其特征在于,所述承载主视角流中包含的多视角呈现信息包括:描述符标签;描述符长度;描述符负载长度;描述符负载数据。
- 根据权利要求18所述的异构网络下媒体的传输系统,其特征在于,所述映射与指示点插入模块包括:把MMT封装结构中的sample放入TS封装结构中PES包的负载中,并在PES包头插入PES包数据映射指示点,在TS包头中插入TS包数据映射指示点;所述PES包数据映射指示点指示PES包所对应的MMTP包的数据结构;所述sample中有至少一个MFU,所述TS包数据映射指示点指示TS包所负载的数据属于哪一个MFU。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810759336.4A CN110719244B (zh) | 2018-07-11 | 2018-07-11 | 异构网络下媒体的传输方法及系统 |
| CN201810759336.4 | 2018-07-11 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020011208A1 true WO2020011208A1 (zh) | 2020-01-16 |
Family
ID=69142287
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/095460 Ceased WO2020011208A1 (zh) | 2018-07-11 | 2019-07-10 | 异构网络下媒体的传输方法及系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (2) | CN110719244B (zh) |
| WO (1) | WO2020011208A1 (zh) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016031914A1 (ja) * | 2014-08-29 | 2016-03-03 | シャープ株式会社 | 放送信号送信装置、放送信号受信装置、テレビジョン受像機、放送信号伝送システム、制御プログラム、および記録媒体 |
| CN107223334A (zh) * | 2015-02-13 | 2017-09-29 | 三星电子株式会社 | 用于将mmtp流转换为mpeg‑2ts的方法和装置 |
| JP6302274B2 (ja) * | 2014-02-07 | 2018-03-28 | 日本放送協会 | 送信装置及び受信装置 |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20120083747A (ko) * | 2011-01-18 | 2012-07-26 | 삼성전자주식회사 | 방송통신 융합형 서비스를 위한 전송 방법 및 장치 |
| CN102510534B (zh) * | 2011-10-31 | 2013-08-28 | 四川长虹电器股份有限公司 | 一种数据广播网ts数据包的smt信息传输方法 |
| WO2014014305A1 (ko) * | 2012-07-19 | 2014-01-23 | 한국전자통신연구원 | 동일 포트에 멀티플렉싱 된 다중 패킷 스트림의 패킷오류 구분을 선택적으로 수행하는 방법 및 그 장치 |
| KR20160052313A (ko) * | 2014-11-04 | 2016-05-12 | 삼성전자주식회사 | 송신 장치, 수신 장치 및 그 신호 처리 방법 |
| CN105827361B (zh) * | 2015-01-08 | 2019-02-22 | 上海交通大学 | 一种基于媒体内容的fec方法 |
| CN106603192B (zh) * | 2015-10-16 | 2019-07-19 | 上海交通大学 | 一种基于媒体内容的自适应fec方法 |
| CN106603193B (zh) * | 2015-10-16 | 2019-11-15 | 上海交通大学 | 一种基于媒体内容的fec方法 |
| CN105991586B (zh) * | 2015-02-13 | 2019-04-26 | 上海交通大学 | 一种异构网络下的多媒体时钟协调同步方法 |
| CN106034262B (zh) * | 2015-03-13 | 2021-01-22 | 中兴通讯股份有限公司 | 自适应流媒体处理方法及装置 |
-
2018
- 2018-07-11 CN CN201810759336.4A patent/CN110719244B/zh active Active
- 2018-07-11 CN CN202110449973.3A patent/CN113179262B/zh active Active
-
2019
- 2019-07-10 WO PCT/CN2019/095460 patent/WO2020011208A1/zh not_active Ceased
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6302274B2 (ja) * | 2014-02-07 | 2018-03-28 | 日本放送協会 | 送信装置及び受信装置 |
| WO2016031914A1 (ja) * | 2014-08-29 | 2016-03-03 | シャープ株式会社 | 放送信号送信装置、放送信号受信装置、テレビジョン受像機、放送信号伝送システム、制御プログラム、および記録媒体 |
| CN107223334A (zh) * | 2015-02-13 | 2017-09-29 | 三星电子株式会社 | 用于将mmtp流转换为mpeg‑2ts的方法和装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113179262B (zh) | 2022-12-06 |
| CN110719244B (zh) | 2021-08-20 |
| CN113179262A (zh) | 2021-07-27 |
| CN110719244A (zh) | 2020-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11665384B2 (en) | Method and apparatus for transmitting media data in multimedia transport system | |
| US10313738B2 (en) | Dynamic time window and cache mechanism under the heterogeneous network transmission | |
| US9729762B2 (en) | Method for synchronizing multimedia flows and corresponding device | |
| CN102685588B (zh) | 同步通过不同网络接收的内容的呈现的解码器及其方法 | |
| US10104406B2 (en) | Transmission apparatus, transmission method, reproduction apparatus, reproduction method and reception apparatus | |
| US20150181003A1 (en) | Method and apparatus for transmitting and receiving packets in hybrid transmission service of mmt | |
| CN108881927A (zh) | 一种视频数据合成方法和装置 | |
| CN104350760A (zh) | 通过mmt包格式扩展的混合传输方法 | |
| CN105393548A (zh) | 广播发射设备、广播接收设备、操作广播发射设备的方法和操作广播接收设备的方法 | |
| CN106790044B (zh) | Ts码流转换为rtp码流的方法和装置 | |
| Park et al. | Delivery of ATSC 3.0 services with MPEG media transport standard considering redistribution in MPEG-2 TS format | |
| CN101511013A (zh) | 视频报文的处理方法、设备和系统 | |
| KR20190018142A (ko) | Mmt 전송 패킷의 설정 방법 및 전송 방법 | |
| CN112738645A (zh) | 用于在多媒体系统中发送和接收信号的方法和装置 | |
| JP2026012515A (ja) | 送信方法および送信装置 | |
| CN113179262B (zh) | 异构网络下媒体的传输方法及系统 | |
| CN101540897B (zh) | 一种用于有线电视网络的交互电视节目流时间戳下发方法 | |
| CN101193290A (zh) | 一种mpeg-4的传输码流到互联网流媒体联盟流的实时转换系统 | |
| CN114554242B (zh) | 直播方法和可读存储介质 | |
| Crinon | ATSC data broadcast services: protocols, application signaling, buffer models, profiles and levels | |
| WO2020011205A1 (zh) | 基于广播系统的传输协议转换方法及系统 | |
| Kordelas et al. | Transport Protocols for 3D Video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19835128 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 12.05.2021) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 19835128 Country of ref document: EP Kind code of ref document: A1 |






