CN101124570A - 根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备 - Google Patents

根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备 Download PDF

Info

Publication number
CN101124570A
CN101124570A CNA2004800330345A CN200480033034A CN101124570A CN 101124570 A CN101124570 A CN 101124570A CN A2004800330345 A CNA2004800330345 A CN A2004800330345A CN 200480033034 A CN200480033034 A CN 200480033034A CN 101124570 A CN101124570 A CN 101124570A
Authority
CN
China
Prior art keywords
modality
content
conversion
multimedia
converting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2004800330345A
Other languages
English (en)
Inventor
鲁勇满
童从尚
洪镇祐
金在坤
南济镐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics and Telecommunications Research Institute ETRI
Korea Advanced Institute of Science and Technology KAIST
Original Assignee
Coulonges Ltd By Share Ltd
University Information & Communication Of Icu Res And Industry Cooperation
Electronics and Telecommunications Research Institute ETRI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Coulonges Ltd By Share Ltd, University Information & Communication Of Icu Res And Industry Cooperation, Electronics and Telecommunications Research Institute ETRI filed Critical Coulonges Ltd By Share Ltd
Publication of CN101124570A publication Critical patent/CN101124570A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/957—Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/127—Prioritisation of hardware or computational resources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234336—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/611—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for multicast or broadcast

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明涉及基于媒体资源的、支持质量服务(QoS)的模态转换，其包括以下步骤：接收描述多媒体内容的模态转换的特性的模态转换描述符；接收多媒体内容；以及将多媒体内容的模态转换为根据媒体资源和模态转换描述符确定的模态。根据本发明，提供一种针对重叠内容值模型的设计的系统方法，以使模态之间的转换边界可以被定量计算。其结果是，可以在单一模型中建立各种模态之间的相互关系，并且可以执行支持最佳QoS的模态转换。

Description

根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备
技术领域
本发明涉及一种根据媒体资源来转换多媒体内容的模态以支持质量服务的方法和装置，尤其涉及多媒体内容的模态转换，以支持在普遍存在的计算环境中使用的多媒体内容的质量服务。
背景技术
终端不支持相同种类的内容资源，但访问和使用(consume)通用多媒体的情况是多媒体通信中的新趋势。在用于通用多媒体访问(UMA)的系统中，内容的自适应转换是对使用者支持质量服务(Quality of Service，QoS)的最重要的处理。内容的自适应转换可以从两个角度考虑。一个是内容译码(transcoding)，即，改变内容的位速率(或质量)而不转换内容的模态；另一个是模态转换，即，将内容从一个模态(例如，视频)转换到另一模态(例如，静止图像)。
在一些近来的研究中，已经讨论了表示内容值(或内容质量)与资源之间的相互关系的内容值模型(或内容值曲线)。在S.Chandra和C.S.Ellis在1999年10月的“2nd Symp.InternetTechnologies and Systems”中发表的论文“JPEG CompressionMetric as a Quality Aware Image Transcoding”中，以及在S.Chandra和C.S.Ellis的论文“JPEG Compression Metric as aQulity Aware Image Tramscoding，2nd Symp. InternetTechnologies and Systems”Boulder CO：USENIX，Oct.1999中，基于与资源量密切相关的压缩率，对JPEG图像特有的质量度量(measure)进行了广泛探究。在Rakesh Mohan、John R.Smith和Chung-Sheng Li在IEEE Trans.Multimedia，Vol.1，No.1，pp.104-114中发表的论文“Adapting Multimedia InternetContent for Universal Access，IEEE Trans.Multimedia，Vol.1，No.1，pp.104-114，Mar.1999”中，当内容表示设计(representation design)包括具有不同模态的内容版本时，讨论了使用单调凹函数表示内容值与资源之间的相互关系的情况。然而，凹函数不能正确地表示具有不同模态的内容值之间的相互关系。
目前，大部分QoS用内容值必须根据具体模态来分别计算。这样做的原因是每个模态具有特定的特性，并且不同模态的质量可能以不同的维(dimension)来度量。然而，简单的执行模态转换的系统方法和内容缩放(scaling)需要不同模态的内容值的组合。
直观上，如果给出几个资源的内容特性即限制，服务提供者(向下)缩放内容以适应资源的特性，直到向使用者提供最佳的QoS。然而，在一些情况下，所缩放的内容的质量可能不适合使用者。在这种情况下，针对以上问题的解决方案是将内容的模态转换为另一模态。例如，当带宽过窄时，与低质量视频的流动(streaming)和传输相比，一连串不同图像的传输可能更适合。这种方法是将模态从视频转换为图像的典型例子。
当从QoS的角度看时，模态转换中的最重要的问题是“哪个资源特性需要将当前模态转换为不同的模态”。支持模态转换的大多数当前系统只有当终端不支持特定模态时才工作。然而，当终端支持模态但资源被限制时，任何现有技术的发明均不提供确保最佳QoS的模态转换的系统解决方案。本发明针对基于模态的QoS的以上解决方案，提供查找模态转换边界(boundary)的方法。
发明内容
因此，本发明的目的是提供模态转换的时点和方法，其在各种内容和装置环境下，在不同模态以及相同模态中，从QoS的角度保证最佳QoS。
关于该目的，本发明提出(1)使用不同内容模态的比例因子来为QoS设计重叠内容模型的方法，以及(2)为了模态转换的自动化，将模态转换的QoS描述为可扩充标记语言(XML)。
本发明提供一种根据媒体资源来转换多媒体内容的模态以支持多媒体内容的QoS的方法，包括以下步骤：接收描述多媒体内容的模态转换的特性的模态转换描述符；接收多媒体内容；以及将多媒体内容的模态转换为根据媒体资源和模态转换描述符确定的模态。
模态转换描述符描述多媒体内容的模态的内容值曲线和比例因子。每个内容值曲线是通过对根据两个或更多个不同的质量而度量的内容值曲线进行合并而获得的。
优选地，模态转换步骤包括以下步骤：使用模态的内容值曲线和比例因子来获得转换边界；使用转换边界确定针对媒体资源的最佳模态；以及将多媒体内容转换为所确定的最佳模态。
此外，本发明提供一种根据媒体资源来转换多媒体内容的模态以支持多媒体内容的QoS的设备，该设备包括：接收装置，用于接收描述多媒体内容的模态转换的特性的模态转换描述符；以及模态转换装置，用于将多媒体内容的模态转换为根据媒体资源和模态转换描述符确定的模态。
本发明提出的方法由表示内容值与资源之间的相互关系以支持QoS的重叠内容值模型、以及对重叠内容值模型的设计构成。在本发明中，内容在不同种类的网络环境中传输，并被各种终端使用。首先，接收数据描述结构，在该数据描述结构中，描述用于保证QoS的多媒体内容的模态转换的特性。之后，根据所输入的数据描述结构，将多媒体内容的模态转换为提供QoS的模态。
优选地，当根据所输入的数据描述结构对多媒体内容的模态进行转换以提供QoS时，使用不同内容模态之间的转换边界来转换多媒体内容的模态。使用不同内容模态之间的转换边界来转换内容的模态的步骤包括：(A)查找表示内容值与资源之间的相互关系的模态的内容值曲线(模态曲线)，(B)查找表示模态的重要性的模态的比例因子，(C)根据比例因子将模态曲线映射为单一重叠内容值模型，(D)在重叠内容值模型中，获得作为模态曲线的交点的转换边界，以及(E)在限制下，使用所获得的模态转换边界将当前模态转换为不同的模态以支持QoS。
在查找表示内容值与资源之间的相互关系的模态的内容值曲线(模态曲线)的步骤中，可以根据不同的质量(PSNR、MOS等)来度量内容值。当内容值与多种资源有关时，将模态曲线变为模态面。
在查找表示模态的重要性的模态的比例因子的步骤中，可以由内容作者或提供者自动或手动地提供比例因子。在根据比例因子将模态曲线映射为单一重叠内容值模型的步骤中，通过对根据不同质量度量的值进行合并来获得内容值。
附图说明
图1是示出根据本发明实施例的转换多媒体内容的模态的装置的框图；
图2是示出根据本发明内容项目(content item)的重叠内容值模型的概念的视图；
图3是示出根据本发明内容项目的最终内容值函数的概念图；
图4是示出视频内容模态从两个质量曲线到单一最终模态曲线的构建(映射)的概念图，其中，图4a是示出以峰值信号与噪声的比(PSNR)度量的质量曲线的曲线图，图4b是示出以平均判分法(Mean Opinion Score，MOS)度量的质量曲线的曲线图，图4c是示出在每个比例因子均是1的情况下，组合的单一最终模态曲线的曲线图；以及
图5是示出转换内容的模态以支持Q oS的处理的流程图。
具体实施方式
以下，参考附图来详细说明本发明的实施例。在附图中，相同的附图标记用来表示相同或相似的组成部分或信号。
图1是示出根据本发明实施例的转换多媒体内容的模态的装置的框图。多媒体内容和模态转换描述符接收单元102通过网络接收多媒体内容和多媒体内容的模态转换描述符，并且将所接收的多媒体内容和描述符提供给模态转换描述符提取单元104和多媒体内容模态转换单元108。模态转换描述符提取单元104提取所输入的多媒体内容的模态转换描述符，并将模态转换描述符提供给多媒体内容模态转换单元108。媒体资源信息提供单元106将与多媒体内容的提供有关的、由网络或终端提供的限制提供给多媒体内容模态转换单元108。多媒体内容模态转换单元108为由模态转换描述符和媒体资源信息提供的媒体资源确定最佳模态，并将多媒体内容的模态转换为最佳模态。通过输出单元110，将转换为新模态的多媒体内容提供给网络或终端。
本发明提供的重叠内容值模型可以表示内容值、资源和模态之间的相互关系。可以根据不同的内容模态，与表示内容值的重叠内容值模型一起表示内容。
图2示出具有视频模态的内容的内容值模型的例子。在图2中，可以由内容提供者或作者，或者通过终端中的计算来分配各种模态的内容值曲线。
图3是示出根据本发明内容项目的最终内容值函数的视图。如图3的虚线所示，模态曲线的交点表示模态之间的转换边界。基于转换边界，可以定量确定模态转换，以维持最大的容许QoS。本发明包括以图3所示的重叠模型来表示各种内容模态并基于QoS来确定模态转换点的方法。
单一模态曲线是由内容缩放器(scaler)所使用的内容缩放操作形成的。例如，考虑到空间分辨率、时间分辨率和每像素代码位(coded bit)，视频内容被缩放，以与特定资源的特性相匹配。为了从这种单一内容模型来形成重叠内容模型，必须在单一重叠内容模型上生成包括各种模型的单一曲线。
假定内容i的模态j的内容值曲线是VMij。在这种情况下，j＝1，...，Ji，Ji是内容i可使用的模态的数量。此外，对于全部j＝1，...，Ji，必须满足VMij≥0，j＝1是表示内容的初始模态的指标。在这种情况下，由以下方程1表示内容i的内容值函数：
Vi＝max{WijVMij|j＝1，...，Ji}    (1)
在方程1中，Wij是内容i的模态j的比例因子。为了将不同模态合并为如方程1所示的单一模型，内容的作者或提供者自动或手动地为每个模态分配适当的比例因子Wij，以使得不同形式的内容值必须反映其相对重要性，并且对公用的内容值具有公用的度量单位。
此外，可以根据各种质量来度量模态的内容值曲线。例如，视频模态可以通过计算PSNR和MOS来获得内容值曲线。因此，为了表示根据特定质量而度量的内容值曲线，使用术语“质量曲线”。其结果是，可以由各种质量曲线形成单一模态曲线。
VM ij = Σ k z k · V M k ij - - - ( 2 )
在方程2中，VMk ij是根据内容的质量类型k度量的质量曲线。此外，zk是用于确保QoS的质量类型k的比例因子。图4是示出获得模态曲线的例子的曲线图，其示出从分别具有不同度量的内容值(PSNR和MOS)的两个质量曲线形成单一模态曲线的过程。比例因子zk是将不同度量的内容值合并为单一模态曲线的参数，其可以根据QoS进度表(schedule)由内容提供者事先提供，或可自动计算。
此时，当内容涉及多种资源时，将模态曲线转换为多维空间中的模态面(modality surface)。此外，可将本发明提出的上述方法有效应用到很多资源。总体上，在QoS的模态转换中，重叠内容值模型的解析特征可以概括如下：
(1)模型包括多种模态曲线。
(2)最终内容值函数由重叠模型的上部组成。
(3)每个模态曲线可由一个或更多内容缩放操作来构造。
(4)每个模态曲线的特征在于，当资源的数量增加时，模态曲线不减少且不增加。
图5的流程图中示出概述的整个模态转换过程。在步骤10和11，使用各种测量方法为n个模态计算质量曲线。在步骤20和21，基于依赖于质量类型的比例因子，使用方程2将为每个模态计算的质量曲线合并为单一模态曲线。在这种情况下，其结果是在步骤30和31获得n个模态曲线。在步骤40，在粗略计算模态的比例因子后，基于所获得的比例因子，将模态曲线映射为单一模型，以形成单一重叠内容值模型。在内容的单一重叠内容值模型中(步骤50)，在步骤60，可以找到模态曲线的交点。可以使用最终获得的模态转换边界来获得当前模态应该在何种限制下转换为支持QoS的不同模态的解决方案(步骤70)。
在该系统中形成重叠内容模型中，表示所使用的参数的元数据(metadata)信息需要以例如可扩充标记语言(eXtendedMarkup Language，XML)的结构化形式来表示。表1表示XML形式的本发明提出的模态转换QoS技术。
表1
<！--#######################################################--><！--Definition of Modality ConversionQoSType               --><！--#######################################################--><complexType name＝″ModalityConversionQoSType″><complexContent><extension base＝″dia:DIABaseType″><sequence><element name＝″ModalityCurve″type＝″ModalityCurveType″maxOccurs＝″unbounded″/></sequence></extension></complexContent></complexType><complexType name＝″ModalityCurveType″><complexContent><extension base＝″dia:DIABaseType″><sequence><element name＝″Modality″type＝″mpeg7:controlledTerm″minOccurs＝″0″/><element name＝″ModScale″type＝″float″/><element name＝″QualityCurve″minOccurs＝″0″maxOccurs＝″unbounded″><complexType><sequence><element name＝″UtilityRef″type＝″IDREF″/><element name＝″UtiScale″type＝″float″/></sequence></complexType></element></sequence></extension></complexContent></complexType>
在表1中，“Modality Curve Type”的语义的定义如表2所示。
表2
    名称     定义
  Modality     描述资源的模态
  ModScale     描述资源模态的比例因子
  QualityCurve     描述资源模态的内容值曲线
  UtilityRef     描述资源模态的质量曲线
  UtiScale     描述质量曲线的比例因子
上述实施例仅用于使本领域技术人员便于理解本发明，而并非意在限制本发明的范围。本领域技术人员必须注意，可以对上述实施例做出各种变化和修改。原则上，本发明的范围由所附权利要求书限定。
工业应用性
根据本发明的结构，提供一种针对重叠内容值模型的设计的系统方法，以使模态之间的转换边界可以被定量计算。其结果是，可以在单一模型中建立各种模态之间的相互关系，并且可以执行支持最佳QoS的模态转换。此外，使用本发明作为精确确定模态转换和内容缩放的基础，从而有效实现UMA。

Claims (11)

1.一种根据媒体资源来转换多媒体内容的模态以支持所述多媒体内容的质量服务(QoS)的方法，包括以下步骤：
接收描述所述多媒体内容的模态转换的特性的模态转换描述符；
接收所述多媒体内容；以及
模态转换步骤，用于将所述多媒体内容的模态转换为根据媒体资源和所述模态转换描述符确定的模态。
2.根据权利要求1所述的方法，其特征在于，所述媒体资源是所述多媒体内容被提供到的网络或终端。
3.根据权利要求1所述的方法，其特征在于，所述模态转换描述符描述所述多媒体内容的模态的内容值曲线和比例因子。
4.根据权利要求3所述的方法，其特征在于，所述模态转换步骤包括以下步骤：
使用模态的所述内容值曲线和所述比例因子来获得转换边界；
使用所述转换边界确定针对所述媒体资源的最佳模态；以及
将所述多媒体内容转换为所确定的最佳模态。
5.根据权利要求4所述的方法，其特征在于，所述转换边界是与如下交点对应的媒体资源的值，所述交点是当模态的所述内容值曲线根据所述比例因子彼此重叠时，所述内容值曲线彼此相交的交点。
6.根据权利要求3所述的方法，其特征在于，每个所述内容值曲线是通过对根据两个或更多个不同的质量而度量的内容值曲线进行合并而获得的。
7.一种根据媒体资源来转换多媒体内容的模态以支持所述多媒体内容的QoS的设备，该设备包括：
接收装置，用于接收描述所述多媒体内容的模态转换的特性的模态转换描述符；以及
模态转换装置，用于将所述多媒体内容的模态转换为根据媒体资源和所述模态转换描述符确定的模态。
8.根据权利要求7所述的设备，其特征在于，所述模态转换描述符描述所述多媒体内容的模态的内容值曲线和比例因子。
9.根据权利要求8所述的设备，其特征在于，所述模态转换装置包括：
使用模态的所述内容值曲线和所述比例因子来获得转换边界的装置；以及
将所述多媒体内容的模态转换为所确定的最佳模态的装置。
10.根据权利要求9所述的设备，其特征在于，所述转换边界是与如下交点对应的媒体资源的值，所述交点是当模态的所述内容值曲线根据所述比例因子彼此重叠时，所述内容值曲线彼此相交的交点。
11.根据权利要求8所述的设备，其特征在于，每个所述内容值曲线是通过对根据两个或更多个不同的质量而度量的内容值曲线进行合并而获得的。
CNA2004800330345A 2003-10-10 2004-10-08 根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备 Pending CN101124570A (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020030070499 2003-10-10
KR1020030070499A KR20050034811A (ko) 2003-10-10 2003-10-10 이질적 환경 하에서 멀티미디어 서비스의 서비스질 지원을위한 시스템적인 형식 변환 방법 및 시스템

Publications (1)

Publication Number Publication Date
CN101124570A true CN101124570A (zh) 2008-02-13

Family

ID=36353931

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2004800330345A Pending CN101124570A (zh) 2003-10-10 2004-10-08 根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备

Country Status (5)

Country Link
US (1) US7925721B2 (zh)
EP (1) EP1671495A4 (zh)
KR (2) KR20050034811A (zh)
CN (1) CN101124570A (zh)
WO (1) WO2005036893A2 (zh)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101233150B1 (ko) * 2005-07-19 2013-02-15 엘지전자 주식회사 서비스 연결 설정 및 제어 방법
US9509618B2 (en) * 2007-03-13 2016-11-29 Skype Method of transmitting data in a communication system
GB0704834D0 (en) 2007-03-13 2007-04-18 Skype Ltd Method of transmitting data in a communication system
KR100873210B1 (ko) * 2007-04-24 2008-12-10 주식회사 케이티프리텔 컨텐츠 제공 방법 및 시스템
KR101012245B1 (ko) * 2007-12-31 2011-02-08 엔에이치엔비즈니스플랫폼 주식회사 사용자 단말기 환경을 고려한 광고 제공 방법 및 상기방법을 수행하기 위한 시스템
US8578259B2 (en) 2008-12-31 2013-11-05 Microsoft Corporation Media portability and compatibility for different destination platforms
CN105122795A (zh) * 2013-02-19 2015-12-02 特克特朗尼克公司 用于数字图像创建和显示的图像外观框架和应用
KR102444712B1 (ko) 2016-01-12 2022-09-20 한국전자통신연구원 다중-모달리티 특징 융합을 통한 퍼스널 미디어 자동 재창작 시스템 및 그 동작 방법
KR102081727B1 (ko) 2019-02-01 2020-02-26 최재원 서비스 최적화 운영관리 및 의사결정 지원을 위한 서비스 제공 시스템 및 방법
KR20210099906A (ko) 2020-02-05 2021-08-13 최재원 서비스 최적화 운영관리 및 의사결정 지원을 위한 서비스 제공 시스템 및 방법
KR20200096175A (ko) 2020-02-05 2020-08-11 최재원 서비스 최적화 운영관리 및 의사결정 지원을 위한 서비스 제공 시스템 및 방법

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6084584A (en) * 1996-10-01 2000-07-04 Diamond Multimedia Systems, Inc. Computer system supporting portable interactive graphics display tablet and communications systems
US6959318B1 (en) * 1998-03-06 2005-10-25 Intel Corporation Method of proxy-assisted predictive pre-fetching with transcoding
US6310601B1 (en) * 1998-05-12 2001-10-30 International Business Machines Corporation Resizing images to improve network throughput
US6487566B1 (en) 1998-10-05 2002-11-26 International Business Machines Corporation Transforming documents using pattern matching and a replacement language
US6970602B1 (en) 1998-10-06 2005-11-29 International Business Machines Corporation Method and apparatus for transcoding multimedia using content analysis
US6314569B1 (en) * 1998-11-25 2001-11-06 International Business Machines Corporation System for video, audio, and graphic presentation in tandem with video/audio play
US6195088B1 (en) * 1998-12-04 2001-02-27 France Telecom Method and system for controlling multimedia streams using dynamic prototypes
US6507857B1 (en) 1999-03-12 2003-01-14 Sun Microsystems, Inc. Extending the capabilities of an XSL style sheet to include components for content transformation
US6345279B1 (en) * 1999-04-23 2002-02-05 International Business Machines Corporation Methods and apparatus for adapting multimedia content for client devices
US6565609B1 (en) 1999-06-15 2003-05-20 Microsoft Corporation Translating data into HTML while retaining formatting and functionality for returning the translated data to a parent application
JP2001319069A (ja) 2000-05-12 2001-11-16 Melco Inc ファイル変換システム、ウェブサーバ、ファイル変換方法およびファイル変換プログラムを記録した媒体
KR100404282B1 (ko) * 2000-07-21 2003-11-01 (주)에스오엔코리아 다양한 통신망 환경에서 최적의 인터넷 서비스를 제공할수 있는 개인 통신 지원 시스템 및 이를 이용하는 개인통신 클라이언트
JP2002169785A (ja) * 2000-08-29 2002-06-14 Matsushita Electric Ind Co Ltd コンテンツ流通システムの制御方法、システム、コンテンツの流通制御プログラム、および、そのプログラムを記録した記録媒体
KR100398610B1 (ko) 2001-01-30 2003-09-19 한국전자통신연구원 멀티미디어 컨텐츠에 동기화된 메타데이터 전송 장치 및방법
JP4045757B2 (ja) 2001-06-13 2008-02-13 富士ゼロックス株式会社 ファイル転送システム
KR200263830Y1 (ko) 2001-11-13 2002-02-09 엘지전자주식회사 휴대용 단말기의 발광장치
JP3826043B2 (ja) * 2002-01-31 2006-09-27 キヤノン株式会社 情報処理装置及び方法
US6816805B1 (en) * 2003-02-28 2004-11-09 Charles Wilder Wadell Computer generated scale and conversion instrument

Also Published As

Publication number Publication date
KR20050034811A (ko) 2005-04-15
JP4447605B2 (ja) 2010-04-07
US7925721B2 (en) 2011-04-12
WO2005036893A3 (en) 2007-01-25
EP1671495A2 (en) 2006-06-21
JP2007517270A (ja) 2007-06-28
KR100839582B1 (ko) 2008-06-19
US20070214410A1 (en) 2007-09-13
EP1671495A4 (en) 2008-12-31
WO2005036893A2 (en) 2005-04-21
KR20060095902A (ko) 2006-09-04

Similar Documents

Publication Publication Date Title
JP6928041B2 (ja) 動画を処理するための方法および装置
CN105052107B (zh) 使用质量信息进行媒体内容自适应传输
Mohan et al. Adapting multimedia internet content for universal access
Smith et al. Scalable multimedia delivery for pervasive computing
US7142599B2 (en) Method and device for selecting a transcoding method from a set of transcoding methods
US6693645B2 (en) Optimized BIFS encoder
CN110460871B (zh) 直播视频的生成方法、装置、系统及设备
CN101842812B (zh) 用于数字图像转码中的参数质量感知选择的系统和方法
CN101124570A (zh) 根据媒体资源转换多媒体内容的模态以支持质量服务的方法和设备
US7853864B2 (en) Device and method for modality conversion of multimedia contents
WO2024017106A1 (zh) 一种码表更新方法、装置、设备及存储介质
Lee et al. Multimedia contents adaptation by modality conversion with user preference in wireless network
US9674523B2 (en) Methods and apparatus for transcoding digital video
JP4447605B6 (ja) メディア資源に応じてサービス品質をサポートするためのマルチメディア・コンテンツの様式変換方法および装置
US9559929B2 (en) Network bandwidth measurement
Mohan et al. Adapting content to client resources in the internet
CN114741198B (zh) 视频流处理方法及装置、电子设备、计算机可读介质
CN100366077C (zh) 基于实用函数描述的最优视频解码的方法和系统
Thang et al. Modality conversion: Toward the semantic frontier of UMA
CN114615501A (zh) 视频编码转换方法、装置、设备及存储介质
CN115134583A (zh) 视频会议质量评价方法及系统
CN112492305A (zh) 一种数据处理方法、装置及计算机可读存储介质
KR20100006745A (ko) 멀티미디어데이터 네트워크 분할/압축방법 및 실시간멀티미디어데이터 제공시스템
Lee et al. An Adaptive Multimedia Content Agent for Heterogeneous Client Device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
ASS Succession or assignment of patent right

Owner name: COULON LTD. SCIENCE AND TECHNOLOGY INSTITUTE, SOUT

Free format text: FORMER OWNER: COULON LTD. INDUSTRY-STUDY COOPERATION AGENCY, INFORMATION AND COMMUNICATION UNIVERSITY, SOUTH KOREA

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20101028

Address after: Daejeon, South Korea

Applicant after: Korea Electronic Communication Institute

Co-applicant after: Kulong Co.,Ltd.

Co-applicant after: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Address before: Daejeon, South Korea

Applicant before: Korea Electronic Communication Institute

Co-applicant before: Kulong Co.,Ltd.

Co-applicant before: University Information & Communication of Icu Res and Industry Cooperation

C41 Transfer of patent application or patent right or utility model
TA01 Transfer of patent application right

Effective date of registration: 20110214

Address after: Daejeon, South Korea

Applicant after: Korea Electronic Communication Institute

Co-applicant after: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Address before: Daejeon, South Korea

Applicant before: Korea Electronic Communication Institute

Co-applicant before: Kulong Co.,Ltd.

Co-applicant before: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20080213