TW201401849A - 在通訊網路中發信三維視訊資訊 - Google Patents

在通訊網路中發信三維視訊資訊 Download PDF

Info

Publication number
TW201401849A
TW201401849A TW102111699A TW102111699A TW201401849A TW 201401849 A TW201401849 A TW 201401849A TW 102111699 A TW102111699 A TW 102111699A TW 102111699 A TW102111699 A TW 102111699A TW 201401849 A TW201401849 A TW 201401849A
Authority
TW
Taiwan
Prior art keywords
format
frame
video
readable media
computer readable
Prior art date
Application number
TW102111699A
Other languages
English (en)
Other versions
TWI578756B (zh
Inventor
Ozgur Oyman
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Publication of TW201401849A publication Critical patent/TW201401849A/zh
Application granted granted Critical
Publication of TWI578756B publication Critical patent/TWI578756B/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W24/00Supervisory, monitoring or testing arrangements
    • H04W24/10Scheduling measurement reports ; Arrangements for measurement reports
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L27/00Modulated-carrier systems
    • H04L27/26Systems using multi-frequency codes
    • H04L27/2601Multicarrier modulation systems
    • H04L27/2647Arrangements specific to the receiver only
    • H04L27/2655Synchronisation arrangements
    • H04L27/2657Carrier synchronisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L5/00Arrangements affording multiple use of the transmission path
    • H04L5/003Arrangements for allocating sub-channels of the transmission path
    • H04L5/0048Allocation of pilot signals, i.e. of signals known to the receiver
    • H04L5/0051Allocation of pilot signals, i.e. of signals known to the receiver of dedicated pilots, i.e. pilots destined for a single user or terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/58Message adaptation for wireless communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10Architectures or entities
    • H04L65/1016IP multimedia subsystem [IMS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066Session management
    • H04L65/1069Session establishment or de-establishment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/612Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/61Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
    • H04L65/613Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for the control of the source by the destination
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/70Media network packetisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/756Media network packet handling adapting media to device capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • H04L65/762Media network packet handling at the source 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/156Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164Feedback from the receiver or from the transmission channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2404Monitoring of server processing errors or hardware failure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25825Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808Management of client data
    • H04N21/25833Management of client data involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4424Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6125Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61Network physical structure; Signal processing
    • H04N21/6106Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6131Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a mobile phone network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12Messaging; Mailboxes; Announcements
    • H04W4/14Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/50Service provisioning or reconfiguring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W40/00Communication routing or communication path finding
    • H04W40/24Connectivity information management, e.g. connectivity discovery or connectivity update
    • H04W40/248Connectivity information update
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W48/00Access restriction; Network selection; Access point selection
    • H04W48/18Selecting a network or a communication service
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W60/00Affiliation to network, e.g. registration; Terminating affiliation with the network, e.g. de-registration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W60/00Affiliation to network, e.g. registration; Terminating affiliation with the network, e.g. de-registration
    • H04W60/04Affiliation to network, e.g. registration; Terminating affiliation with the network, e.g. de-registration using triggered events
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W64/00Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • H04W76/15Setup of multiple wireless link connections
    • H04W76/16Involving different core network technologies, e.g. a packet-switched [PS] bearer in combination with a circuit-switched [CS] bearer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/02Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks
    • H04W8/06Registration at serving network Location Register, VLR or user mobility server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W80/00Wireless network protocols or protocol adaptations to wireless operation
    • H04W80/08Upper layer protocols
    • H04W80/12Application layer protocols, e.g. WAP [Wireless Application Protocol]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/189Arrangements for providing special services to substations for broadcast or conference, e.g. multicast in combination with wireless systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/172Processing image signals image signals comprising non-image signal components, e.g. headers or format information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/147Data rate or code amount at the encoder output according to rate distortion criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • H04N19/463Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W76/00Connection management
    • H04W76/10Connection setup
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/02Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W8/00Network data management
    • H04W8/22Processing or transfer of terminal data, e.g. status or physical capabilities
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Library & Information Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computing Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本揭示之實施例描述的裝置、方法、電腦可讀取媒體及系統組構用於在通訊網路中發送裝置之立體3維視訊內容能力之信號。描述及主張其它的實施例。

Description

在通訊網路中發信三維視訊資訊 相關申請案交互參考
本申請案主張2012年4月9日提出申請之No.61/621,939名稱為“ADVANCED WIRELESS COMMUNICATION SYSTEMS AND TECHNIQUES”的美國臨時專利申請案及2012年8月3日提出申請之名稱為“ADVANCED WIRELESS COMMUNICATION SYSTEMS AND TECHNIQUES”之美國臨時專利申請案的優先權,其全部揭示併入本文參考。
一般言之,本發明之實施例與通訊的領域相關,更特定地說,與在通訊網路中發信三維視訊資訊相關。
三維(3-D)視訊提供高品質與身歷其境的多媒體經驗,其僅於最近才由於先進的顯示技術、信號處理、傳送技術、及電路設計而在消費性電子產品及行動平台上變為可行。其目前經由各種通道導入家庭,包括藉由藍光碟、 電纜及衛星傳送等,以及導入行動網路通過具3-D能力的智慧型手機等。與經由無線網路傳送此類內容相關的概念也已在發展中。
100‧‧‧網路環境
104‧‧‧使用者設備
108‧‧‧無線電接取網路
120‧‧‧內容管理模組
124‧‧‧媒體播放器
126‧‧‧串流應用軟體
128‧‧‧顯示器
112‧‧‧增強型節點基地台
116‧‧‧媒體伺服器
132‧‧‧內容遞送模組
134‧‧‧串流應用軟體
136‧‧‧內容管理模組
140‧‧‧內容儲存器
144‧‧‧裝置設定檔伺服器
204‧‧‧HTTP伺服器
208‧‧‧DASH用戶端
212‧‧‧伺服器
216‧‧‧用戶端
304‧‧‧使用者設備
308‧‧‧IP多媒體核心網路子系統
312‧‧‧服務發現功能
700‧‧‧系統
712‧‧‧系統記憶體
724‧‧‧邏輯
704‧‧‧處理器
708‧‧‧系統控制邏輯
716‧‧‧非揮發性記憶體/儲存器
732‧‧‧輸入/輸出(I/O)裝置
720‧‧‧網路介面
722‧‧‧收發器
藉由以上配合附圖的詳細描述將可很容易瞭解實施例。為便於此描述,類似的參考數字指示類似的結構元件。實施例係藉由附圖中之圖式的實例來說明而非藉其來限制。
圖1示意地說明按照各實施例的無線通訊網路。
圖2a-b說明按照各實施例之串流內容的調適及/或相關的對話描述與元資料檔。
圖3說明按照各實施例之串流對話的建立。
圖4說明按照各實施例之幀相容包裝格式。
圖5說明按照各實施例之發信3-D視訊裝置能力之方法。
圖6說明按照各實施例之發信3-D視訊裝置內容之方法。
圖7說明按照各實施例之示意地描繪例示的系統。
本揭示的說明實施例包括但不限於方法、系統、電腦可讀取媒體及設備用於發送用戶端之裝置在通訊網路中之立體三維視訊內容能力之信號。關於此點,本發明的某些 實施例為用於發送行動裝置在無線通訊網路中之立體三維視訊內容能力的方法、系統、電腦可讀取媒體及設備。
說明之實施例的各種態樣,將以熟悉此方面技術之人士表達其工作實質內容給其他熟悉此方面技術之人士時一般所使用的術語來描述。不過,熟悉此方面技術之人士將可明瞭,僅以所描述的某些態樣即可實行另些實施例。為解釋之目的,特定數字、材料、及配置係闡述以提供說明之實施例的徹底了解。不過,熟悉此方面技術之人士將可明瞭,沒有該些特定的細節仍可實行另些實施例。在其它實例中,為不致模糊了說明的實施例,習知的特徵被省略或簡化。
此外,各種的操作將以多個分立的操作依次描述,按此方式最有助於瞭解說明的實施例;不過,描述的順序不應被解釋成暗示這些操作必然按其順序。特別是,這些操作不需要按所呈現的順序實施。
“在某些實施例中”之片語被不斷地使用。該片語通常不是指相同的實施例;不過,其也可指相同的實施例。除非特別指明,否則,“包含”、“具有”、及“包括”等名詞為同義詞。片語“A及/或B”意指(A)、(B)、或(A與B)。片語“A/B”與“A或B”意指(A)、(B)、或(A與B),與“A及/或B”類似。片語A、B與C至少其中之一意指(A)、(B)、(C)、(A與B)、(A與C)、(B與C)、或(A,B與C)。片語(A)B意指(B)或(A與B),亦即,A為選擇性的。
雖然本文已說明及描述了特定的實施例,但熟悉一般技術之人士將可明瞭,有各種各樣的替代及/或相等實施可取代所顯示及描述的特定實施例,不會偏離本揭示之實施例的範圍。本申請案意欲涵蓋本文所討論之實施例的任何調適或衍生。因此,很明顯意欲本揭示的實施例僅被申請專利範圍及其相等物所限制。
如本文所使用,名詞“模組”意指或包括執行一或多個軟體或韌體程式之特殊用途積體電路(Application Specific Integrated Circuit;ASIC)、電子電路、電路(共用、專用、或群組)、及/或記憶體(共用、專用、或群組);組合邏輯電路、及/或提供所述功能的其它適合組件。
H.264/MPEG-4先進視訊編碼(advanced video coding;AVC)標準之導入已展現視訊壓縮能力的重大增進。由於正在發展的標準,ITU-T視訊編碼專家小組(Video Coding Experts Group;VCEG)與標準化國際組織(ISO)/國際電工協會(IEC)動畫專家小組(Moving Picture Experts Group;MPEG)聯合視訊團隊也標準化AVC的延伸,其稱為多視圖視訊編碼(multiview video coding;MVC)。MVC提供視訊場景之多視圖的緊密表示,諸如多部同步視訊攝影機。
在立體3-D視訊應用中顯示分別用於左眼與右眼的兩個視圖。格式化立體3-D影像內容之視圖有各種不同的方法。在一實施例中,立體對3-D視訊可以是MVC的特 例,其左與右眼視圖係經由MVC產生。其它編碼格式也可能產生3-D影像內容。至於解碼與描繪這些不同格式,各種的裝置具有不同的能力。本文所描述的實施例提供裝置能力交換的各種參數,其有利於3-D影像內容在諸如如無線網路之通訊網路中的遞送與觀看,例如,演進的通用陸面無線接取網路(evolved universal terrestrial radio access network;EUTRAN))。
圖1示意說明按照各實施例的網路環境100。網路環境100包括使用者設備(UE)104,其也被稱為用戶端或行動裝置,與無線電接取網路(radio access network;RAN)108無線地耦接。RAN 108可包括增強型節點基地台(enhanced node base station;eNB)112,被組構成經由無線傳輸(over-the-air;OTA)介面與UE 104通訊。RAN 108可以是第三代伙伴計畫(3GPP)長期演進技術(long-term evolution;LTE)先進網路的部分,且可稱為EUTRAN,在其他實施例中,可利用其他無線電接取網路技術。
UE 104可以經由RAN 108與遠端媒體伺服器116通訊。而所顯示的eNB 112與媒體伺服器直接通訊,須瞭解,在各種不同的實施例中,通訊可流過許多中間網路組件,例如,交換機、路由器、閘道等。例如,在某些實施例中,RAN 108可與核心服務網路(core services network;CSN)耦接,其以較大的網路與RAN 108通訊地耦接,例如,廣域網路,媒體伺服器116可視為其一部 分。
雖然圖1描述的網路環境為無線通訊網路,但其它實施例可用於其它類型的網路,例如,纜線網路。須瞭解,使用在其它網路環境中之本發明的實施例可包括比圖1所描繪之實例中所明示的那些組件更多、更少、或不同的組件。例如,本發明的實施例用於纜線網路,可具有媒體伺服器116與UE 104彼此通訊,而沒有RAN 108。
UE 104與媒體伺服器116可具有若干組件被組構成便於3-D視訊內容的接取、儲存、傳送、與顯示。例如,UE 104可包括內容管理模組120、具有串流應用軟體126的媒體播放器124、及顯示器128。串流應用軟體126具有足夠的功能性來接收3-D視訊內容及相關資訊;解碼;拆解封包;及以其它方式再組合3-D視訊;並在顯示器128上描繪3-D視訊。在各不同的實施例中,串流應用軟體126與使用的串流技術有關。例如,在內容是藉由封包交換式串流服務(packet-switched streaming service;PSS)來串流的實施例中,串流應用軟體126可被稱為PSS應用軟體。內容管理模組120可協商或用別的方式傳送串流參數,例如包括裝置能力參數,以致使能夠以最有利於媒體播放器124操作的方式接收資料。
媒體伺服器116可包括具有串流應用軟體134的內容遞送模組132、內容管理模組136、及內容儲存器140。內容遞送模組132可編碼、包裝、或以其它方式組合儲存在內容儲存器140中的3-D視訊內容,用以傳送給一或多 個UE,例如,UE 104。內容管理模組136可協商或用別的方式傳送串流參數,例如包括裝置能力參數,並控制內容遞送模組132以最有利的方式遞送3-D視訊內容。
在某些實施例中,所顯示之做為媒體伺服器116之一部分的一或多個組件之配置可獨立於媒體伺服器116,並透過通訊鏈結與媒體伺服器通訊地耦接。例如,在某些實施例中,內容儲存器140之配置可遠離內容遞送模組132及內容管理模組136。
在某些實施例中,內容遞送模組132在一實例中可按照3GPP串流標準經由eNB 112遞送3-D視訊內容給UE 104。例如,傳送3-D視訊內容可按照PSS標準,例如,3GPP TS 26.234 V11.0.0(2012年3月16日)、超文字傳輸協定動態自適性串流(dynamic adaptive streaming over hypertext transport protocol;DASH)標準,例如,3GPP TS 26.247 V11.0.0(2012年3月16日)、多媒體廣播及多重播送服務(multimedia broadcast/multicast service;MBMS)標準,例如,TS 26.346 V11.0.0(2012年6月29日)、及/或IMS-式PSS與MBMS服務(IMS_PSS_MBMS)標準,例如,TS 26.237 V.11.0.0(2012年6月29日)。串流應用軟體126可被組態成透過任何多種的傳輸協定來接收3-D視訊內容,例如,即時傳輸協定(real-time transport protocol;RTP)、超文字傳輸協定(hypertext transport protocol;HTTP)等。
能力交換致使媒體串流伺服器(諸如媒體伺服器 116)能夠以適合某特定裝置的視訊內容提供給各式各樣的裝置。為便於對於串流的伺服器側內容協商,媒體伺服器116可決定UE 104特有的能力。
內容管理模組120與內容管理模組136可協商或用別的方式傳送3-D視訊內容串流對話的參數。此協商可經由RAN 108通過對話層的發信而發生。在某些實施例中,對話層發信可包括傳送與關於裝置能力的資訊,其包括媒體播放器124的立體3-D視訊解碼與描繪能力。在各不同的實施例中,裝置能力資訊可進一步包括預解碼器緩衝區之大小、初始緩衝、解碼器能力、顯示器特性(螢幕尺寸、解析度、位元深度等)、串流方法(即時串流協定(real-time streaming protocol;RTSP)、HTTP等)調適支援、體驗品質(quality of experience;QoE)支援、延伸的即時傳輸協定(real-time transport protocol;RTCP)報告支援、快速內容切換支援、支援的RTP設定檔、對話描述協定(session description protocol;SDP)屬性等。
在串流對話的建立期間,內容管理模組136可使用裝置能力資訊來控制內容遞送模組132,以提供適當類型的多媒體內容給UE 104。例如,媒體伺服器116可根據UE 104的實際能力決定視訊串流之多個可用的衍生型式中哪些衍生是所要的型式,而為該終端決定最適合的串流。此允許增進3-D視訊內容及相關對話描述與元資料檔對UE 104的遞送,例如,SDP檔或媒體呈現描述(media presentation description;MPD)檔。
內容遞送模組132可接取內容儲存器140中的內容,並在內容/相關檔案的遞送之前,按照經協商的對話參數調適該內容及/或相關的對話描述與元資料檔,例如,SDP/MPD檔。當內容遞送到UE 104時,該內容會被媒體播放器124解碼並在顯示器128上描繪。
內容及/或相關的對話描述與元資料檔之調適顯示於按照參考圖2a-b的一些特定實例,而串流對話的建立顯示於按照參考圖3的特定實例。
圖2a說明DASH式的串流實施例,包含按照某一些實施例的3-D視訊格式的調適。特別是,圖2a說明HTTP伺服器204與DASH用戶端208通訊並實施拉式串流的實施例,其中,串流控制係由用戶端而非伺服器來保持,在MPD的檢查之後,用戶端通過一連串的HTTP式請求-回應處理從伺服器下載內容。在DASH式的串流中,MPD元資料檔提供關於結構與表示儲存在HTTP伺服器204中之媒體內容之不同版本的資訊(包括不同的位元資料檔率、幀率、解析度、編碼解碼類型等)。根據描述片段之關係與這些片段如何形成媒體呈現的此MPD元資料資訊,DASH用戶端208使用HTTP GET或部分GET法請求媒體片段。HTTP伺服器204與DASH用戶端208分別類似於媒體伺服器116與UE 104,且可實質地互換。
在DASH中,3-D視訊格式與對應之內容資訊組可在MPD中發信給DASH用戶端208。HTTP伺服器204可依DASH用戶端208之能力設定檔及其所支援的3-D格式而 提供不同的格式化內容,例如,HTTP伺服器204可在MPD中排除不被DASH用戶端208所支援的3-D格式,且僅包括那些被DASH用戶端208所支援的格式。關於此,HTTP伺服器204可提供為不同3-D視訊格式最佳化的內容給DASH用戶端208。按此做法,HTTP伺服器204可使用來自DASH用戶端208之描述各種被支援之3-D視訊格式的裝置能力交換發信。接著,DASH用戶端208可請求DASH用戶端208所支援之3-D視訊內容的對應版本。此外,當以HTTP擷取MPD時,DASH用戶端208可在GET請求中包括3-D視訊編碼解碼與格式資訊,包括根據設定檔差別(ProfDiff)而對3-D視訊格式之任何暫時的調整。在一實例中,此差異可被組態成為內容呈現對話暫時修改一或多個MPD參數。例如,該差別可被組態成修改MPD直到內容呈現對話結束,或後續發生的差異(對應於第一次傳遞的差別)被傳遞給HTTP伺服器204。按此方式,HTTP伺服器204可遞送最佳化的MPD給DASH用戶端208。
圖2b說明按照某些實施例之包含3-D視訊格式調適的RTSP式串流實施例。特別是,圖2b說明伺服器212與用戶端216實施推式串流法,其中,串流與對話控制係由伺服器212而非用戶端216來保持。伺服器212與用戶端216可分別類似於媒體伺服器116與UE 104,且實質地可互換。
推式串流的實例包括分別根據RTSP及對話起始協定 (session initiation protocol;SIP)的PSS與IMS_PSS_MBMS服務。關於此,伺服器212接收來自用戶端216之被支援的3-D視訊編碼解碼及格式組,並根據此資訊調適內容,例如,伺服器212在所儲存的內容版本之中選擇最適合的內容版本,或根據被支援之3-D視訊格式動態地將內容轉碼並將內容串流給用戶端216。與對話相關的元資料載於SDP中,可攜載該串流內容的3-D視訊格式資訊。
圖3說明按照某些實施例之包含對於IMS_PSS_MBMS服務之訂閱/通知的服務發現。特別是,圖3說明UE 304、IP多媒體(IM)核心網路(CN)子系統308、與服務發現功能(service discovery function;SDF)312之間的互動。UE 304可與UE 104類似或實質地互換。IM CN子系統308與SDF 312可以是核心網域的一部分,其與接取網域介接,例如,RAN 108。
在IMS_PSS_MBMS服務中,在服務發現期間,UE 304在SIP SUBSCRIBE訊息中將諸如所支援之3-D視訊編碼解碼及格式的裝置能力資訊發送給IM CN子系統308。接著,IM CN子系統308將訊息向前送到SDF 312。SDF 312決定適當的服務發現資訊,例如,按照使用者之設定檔中所描述的UE 304之能力(個人化的服務發現)。接著,SDF 312可發送SIP 200 OK訊息給IM CN子系統308,其被中繼到UE 304以根據所發送的裝置能力資訊確認對話起始,該資訊也包括被支援的3-D視訊編碼解碼與格式。然後,SDF 312發送包含服務發現資訊 的SIP NOTIFY訊息給IM CN子系統308,其將SIP NOTIFY訊息中繼回到UE 304。接著,UE 304發送SIP 200 OK訊息給IM CN子系統308做為回應,接著,其被中繼給SDF 312。
此架構利用在IMS式PSS與MBMS使用者服務中被支援的3-D視訊格式致使服務發現能夠最佳化。在IMS對話期間後,UE 304也可使用SIP發信以指示更新,包括根據ProfDiff對被支援之3-D視訊編碼解碼與格式組做任何暫時的調整(例如,如果目前的裝置取向與原設的裝置取向不同)。此可藉由通過包括有關於更新3-D視訊格式資訊之資訊之另外的SIP SUBSCRIBE訊息來更新訂閱。
現請再參閱圖1,在某些實施例中,媒體伺服器116可與具有UE 104設定檔資訊的裝置設定檔伺服器144耦接。設定檔資訊可包括某些或全部的裝置能力資訊。在這類實施例中,媒體伺服器116可接收來自UE 104的識別資訊,並接著擷取來自裝置設定檔伺服器144的設定檔資訊。此可做為對話層發信的一部分。
在某些實施例中,UE 104可根據ProfDiff發信而用額外的屬性來補充擷取自裝置設定檔伺服器144的設定檔資訊,或覆蓋已定義於其本身裝置能力設定檔內的屬性。在一實施例中,此暫時性的調整可藉由使用者喜好來觸發,例如,即使終端機具有描繪3-D視訊之能力,但如果使用者於某特定的對話中僅想接收2維(2-D)視訊。
串流應用軟體134可按照許多不同的串流類型為在網路環境100中傳送的3-D視訊內容編碼,每一串流類型具有相關的幀類型。幀類型可包括、聯播、或2-D加輔助幀類型。
幀包裝可包括幀相容包裝格式與每視圖全解析(full-resolution per view;FRPV)包裝格式。在幀相容包裝格式中,串流應用軟體134可將立體對的成分幀空間地包裝成單幅幀,並對單幅幀編碼。串流應用軟體126所產生的輸出幀包含立體對的成分幀。每一視圖之原始幀的空間解析度與經包裝之單幅幀可以相同。在此情況,串流應用軟體134可在包裝操作前降低取樣該兩個成分幀。幀相容包裝格式可使用垂直交錯、水平交錯、併列、上下、或棋盤等格式,分別如圖4a-e之說明,且可相應地實施降低取樣。
在某些實施例中,串流應用軟體134可在位元流中指示幀包裝格式,幀包裝格式為包括一或多個幀包裝配置補充增強資訊(supplemental enhancement information;SEI)訊息所使用,如H.264/AVC標準中所規定。串流應用軟體126可將幀解碼、拆解來自解碼器之輸出幀的兩成分幀,提高對幀的取樣以回復編碼器側之降低取樣的處理,並在顯示器128上描繪該成分幀。
FRPV包裝格式可包括時間交錯。在時間交錯中,3-D視訊可用包含構成立體對(左與右視圖)之每一個母與後續圖像之原始視訊的雙幀率來編碼。典型上,以高幀率來 實施時間交錯立體視訊的描繪,使用主動(快門)式眼鏡來混合每一隻眼中之不正確的視圖。此仰賴眼鏡與螢幕間的精確同步。
在使用聯播幀類型的實施例中,左與右眼視圖聯播串流可分開傳送。被分開傳送的串流可藉由串流應用軟體126結合,並聯合解碼。
在使用2-D加輔助幀類型的實施例中,2-D視訊內容可連同輔助資訊藉由串流應用軟體134一起發送,而輔助資訊可供串流應用軟體126用來在顯示器128上描繪3-D視訊。此輔助資訊例如是深度/視差圖,其為2-D圖,具有每一個像素定義一或多個像素在相關聯之2-D視訊幀中的深度/視差。
在某些實施例中,也可使用其它的幀類型。例如,在某些實施例中,串流應用軟體134有能力將立體視圖編碼成基本視圖串流與非基本視圖串流,其可在相同或不同的串流中傳送。在某些實施例中,此被稱為MVC式的立體視訊。非基本視圖串流可包括中間視圖預測幀,其提供空間/時間的預測資訊。基本視圖串流足夠供單視圖(例如,2-D)解碼器將基本視圖描繪成2-D視訊,而非基本視圖串流可提供3-D解碼器(例如,串流應用軟體126)足夠的資訊來描繪3-D視訊。如果媒體伺服器116知道UE的能力,其可省略發送非基本視圖串流給不支援3-D視訊或不具有足夠之位元率支援3-D視訊的裝置。
在各不同的實施例中,從內容管理模組120及/或裝 置設定檔伺服器144傳送給內容管理模組136的裝置能力資訊可包括3-D格式屬性,其包括被串流應用軟體126所支援,與在相關傳輸協定(例如,RTP或HTTP)上之立體3-D視訊之串流相關之一或多個格式的清單。在某些實施例中,3-D格式屬性可以是RTP或HTTP的串流幀包裝格式,具有整數值“1”為垂直交錯、“2”為水平交錯、“3”為併列、“4”為上下、“0”為棋盤、“5”為時間交錯。在某些實施例中,相同的3-D格式屬性可用來指示特定檔案中所支援的幀包裝格式或封裝格式(container format)。在某些實施例中,3-D格式屬性可包括更概括的值,例如,“FP”用於幀包裝。
在某些實施例中,3-D格式屬性可以是另一具有值“SC”(用於聯播)或值“2DA”(用於2-D視訊加輔助資訊)的串流格式。
在UE 104支援一或多個格式類型的實施例中,其可進一步指示一或多個較佳的格式類型。此可藉由按喜好之順序來表列格式類型而完成,與包含選擇格式類型的喜好指示器相關。
在某些實施例中,除了提供格式類型屬性,內容管理模組120及/或裝置設定檔伺服器144可提供一或多個組件類型屬性。組件類型屬性可提供關於被串流應用軟體126所支援及/或優選之特定類型視訊組件的額外細節,這些組件係立體3-D視訊的成分元件。
組件類型屬性可具有值“C”用以指示中央視圖串流、 “CD”用以指示中央視圖串流與深度圖、“CP”用以指示中央視圖串流與視差圖、“D”用以指示深度圖、“P”用以指示視差圖、“L”用以指示左視圖串流、“LD”用來指示左視圖串流與深度圖、“LIL”用以指示包括來自左視圖與右視圖之交替掃描線的視訊幀、“LP”用以指示左視圖串流與視差圖、“R”用以指示右視圖串流、“Seq”用以指示幀序列(例如,包括來自左串流與右串流交替之幀的視訊串流-也許需要附加的發信,例如,AVC SEI訊息,以發信號通知哪些幀包含左與右視圖)、“SbS”用以指示併列、以及“TaB”用以指示上下。
每一個格式類型屬性可與各自的組件類型屬性組相關聯。例如,如果格式類型為SC,則相關聯的組件類型可為L或R,以分別指示左視圖與右視圖。
PSS規範3GPP TS 24.234中的裝置能力交換發信能力,使伺服器能夠提供各式各樣裝置中適合於所述特定裝置的內容。為增進立體3-D視訊內容對用戶端的遞送,本揭示描述一組新的屬性,其可包括在裝置能力交換發信所用的PSS詞彙中。所提出的這些屬性,可描述用戶端的3-D視訊解碼與描繪能力,包括用戶端所支援的3-D視訊幀包裝格式。例如,此可允許伺服器與網路提供最佳化的RTSP SDP或DASH MPD給用戶端,以及為了所傳送的3-D視訊內容匹配用戶端裝置的能力而實施適當的轉碼與3-D格式轉換。
在3GPP TS 26.234中以包含於PSS詞彙中的3個新 屬性致能被支援之3-D視訊編碼解碼與格式的裝置能力交換發信能力:(1)對於串流組件,分別以兩個屬性指示與在RTP及HTTP上之立體3-D視訊之串流相關之被支援之幀包裝格式的清單,以及(2)對於ThreeGPFileFormat組件,以一個屬性指示與立體3-D視訊相關之被支援之幀包裝格式的清單,其可包括在3GPP檔案格式(3GP)檔中,其為通常用於3GPP式多媒體服務的多媒體封裝格式。以下為按照某些實施例之屬性定義的細節。
屬性名稱:串流幀包裝格式RTP
屬性定義:與在RTP上被PSS應用軟體所支援之立體3-D視訊之串流相關之被支援之幀包裝格式的清單。在立體3-D視訊之範圍內的幀包裝格式包括: 幀相容包裝格式:1=垂直交錯、2=水平交錯、3=併列、4=上下、0=棋盤
每視圖之全解析包裝格式:5=時間交錯
組件:串流
類型:文字(袋)
合法值:對應於被支援之幀包裝格式的整數值清單。
分解規則:附加
實例:
屬性名稱:串流幀包裝格式HTTP
屬性定義:與在HTTP上被PSS應用軟體所支援之立體3-D視訊之串流相關之被支援之幀包裝格式的清單。在立體3-D視訊之範圍內的幀包裝格式包括:幀相容包裝格式:1=垂直交錯、2=水平交錯、3=併列、4=上下、0=棋盤
每視圖之全解析包裝格式:5=時間交錯
組件:串流
類型:文字(袋)
合法值:對應於被支援之幀包裝格式的整數值清單。
分解規則:附加
實例:
屬性名稱:三GP幀包裝格式
屬性定義:與可被包括在3GP檔中之立體3-D視訊相關且被PSS應用軟體所處理之被支援的幀包裝格式的清單。
組件:3GP檔格式
類型:文字(袋)
合法值:對應於被支援之幀包裝格式之整數值的清單。整數值應為分別對應於併列及上下幀包裝格式的3或4。
分解規則:附加
實例:
在某些實施例中,如MPD中所描述媒體呈現,例如,可包括共用於調適組、表現、及子表現的屬性與元件。這樣的共用元件之一是FramePacking元件。FramePacking元件可指定視訊媒體組件類型的幀包裝配置資訊。當沒有FramePacking元件提供給視訊組件時,視訊媒體組件可能不使用幀包裝。
FramePacking元件可包括@schemeIdUri屬性,其包括統一資源指示器(uniform resource indicator;URI)以識別所使用的幀包裝組態方案。在某些實施例中,FramePacking元件可進一步包括@value屬性,以提供值 給描述器元件。
在某些實施例中,會存在多個FramePacking元件。如果是這樣,每一個元件皆可包含足夠的資訊來選擇或拒絕所描述的表現。
如果所有FramePacking元件的方案或值都無法辨識,則用戶端可忽略所描述的表現。用戶端可基於觀察FramePacking元件而拒絕調適組。
對於包含符合ISO/IEC資訊技術-視聽物件解碼-Part 10:先進視訊編碼(ISO/IEC 14496-10:2012)之視訊組件的調適組或表現,關於FramePackin@schemeIdUri的統一資源編號可以是urn:mpeg:dash:14496:10:frame_packing_arrangement_type:2011,其被定義來指示如ISO/IEC 14496-10:2012之表D-8所定義(‘frame_packing_arrangement_type之定義’)要被包含在FramePacking元件內的幀包裝配置。@value可以是如ISO/IEC 14496-10:2012表D-8中所規定的“值”行,且可按照同表中“解譯”行來解譯。
圖5說明按照某些實施例之發信3-D視訊裝置能力的方法500。方法500可藉由UE的組件來實施,例如,UE 104。在某些實施例中,UE可包括及/或存取一或多個其上儲存的指令的電腦可讀取媒體,當該等指令被執行時,致使UE或其組件實施方法500。
在504,UE決定裝置能力資訊。如前文之描述,裝置能力資訊可包括關於媒體播放器之解碼與描繪能力的資 訊。在某些實施例中,位於UE上或它處的內容管理模組可藉由在UE上運行一或多個程式碼(script)以直接測試能力來判斷此資訊。在其它實施例中,內容管理模組可存取包含相關資訊的一或多個被儲存檔案。
在508,UE可提供裝置能力資訊給媒體伺服器116或裝置設定檔伺服器144,其包括位於UE之媒體播放器的立體3-D視訊解碼及描繪能力。如前所述,裝置能力資訊可包括一或多個格式類型屬性,其代表UE之串流應用軟體所支援之幀類型的清單。在某些實施例中,裝置能力資訊可於512的請求之前或之後提供。
在某些實施例中,某些或全部的裝置能力資訊可藉由另一實體提供給媒體伺服器,例如,裝置設定檔伺服器。
在512,UE請求3-D視訊內容。在某些實施例中,該請求可按照適當的串流/傳輸協定,例如,HTTP、RTP、RTSP、DASH、MBMS、PSS、IMS_PSS_MBMS等。請求可直達媒體伺服器,且可包括統一資源定位器(uniform resource locator;URL)或所請求之內容或其部分內容的某些其它指示器。在某些實施例中,在508,可連同請求提供對裝置能力資訊的暫時性調整(例如,經由發送ProfDiff信號)。因此,UE可根據ProfDiff發信,用額外的屬性來補充擷取自裝置設定檔伺服器的設定檔資訊,或置換已定義於其裝置能力設定檔中的屬性。在一實例中,此種暫時性調整可由使用者喜好觸發,例如,即使終端裝置具有描繪3-D視訊的能力,但使用者的特定 對話僅想接收2維(2-D)視訊。
在516,UE接收被請求的3-D視訊內容,並在UE的顯示器上描繪該內容。內容的描繪可包括各式各樣的處理,諸如但不限於解碼、向上轉換、拆解包裝、定序等。
圖6說明按照某些實施例發信3-D視訊內容之方法600。方法600可藉由媒體伺服器的組件來實施,例如,媒體伺服器116。在某些實施例中,媒體伺服器可包括及/或存取一或多個其上儲存的指令的電腦可讀取媒體,當該等指令被執行時,致使媒體伺服器或其組件實施方法600。
在604,媒體伺服器決定裝置能力資訊。在某些實施例中,媒體伺服器可藉由接收(例如,對話層發信的一部分)來自UE或裝置設定檔伺服器的資訊來決定裝置能力資訊。
在608,媒體伺服器可接收對於3-D視訊內容的請求。在某些實施例中,該請求可按照適當的串流/傳輸協定,例如,HTTP、RTP、RTSP、DASH、MBMS、PSS、IMS_PSS_MBMS等。請求可來自UE,且可包括適用資源定位器(universal resource locator;URL)或被請求之內容或其部分內容的某些其它指示器。在某些實施例中,在608接收的請求,可在604之裝置能力資訊的決定之前,或決定之後,或與決定同時發生。在某些實施例中,對裝置能力資訊的暫時性調整(例如,經由ProfDiff發信)也可在608處連同請求一起接收。因此,根據ProfDiff發 信,媒體伺服器可被擷取自裝置設定檔伺服器之包含額外屬性的設定檔資訊補充,或置換已定義於其裝置能力設定檔中的屬性。
在612,根據考慮位於UE之媒體播放器之立體3-D視訊編碼及描繪能力的裝置能力資訊,媒體伺服器可產生對話描述及/或元資料檔以建立串流對話,例如,SDP檔或媒體呈現描述(MPD)。
在616,媒體伺服器以UE在裝置能力資訊中所指示之被支援的格式類型編碼3-D視訊內容。接著,3-D視訊內容被串流給行動裝置。
本文所描述的組件,例如,UE 104、媒體伺服器116、及/或裝置設定檔伺服器144可使用任何適當的硬體及/或軟體按所想要的架構實施成系統。圖7說明一實施例,例示性的系統700包含一或多個處理器704,系統控制邏輯708與至少一個處理器704耦接,系統記憶體712與系統控制邏輯708耦接,非揮發性記憶體(NVM)/儲存器716與系統控制邏輯708耦接,網路介面720與系統控制邏輯708耦接,輸入/輸出(I/O)裝置732與系統控制邏輯708耦接。
處理器704可包括一或多個單核心或多核心處理器。處理器704可包括通用處理器與專用處理器(例如,繪圖處理器、應用程式處理器、基頻處理器等)的任何組合。
關於一實施例的系統控制邏輯708可包括任何適合的介面控制器,用以提供至少一個處理器704及/或任何適 合之裝置或組件與系統控制邏輯708通訊之任何適合的介接。
關於一實施例的系統控制邏輯708可包括一或多個記憶體控制器,用以提供給系統記憶體712的介面。系統記憶體712可用來負載與儲存資料及/或指令,例如,邏輯724。關於一實施例的系統記憶體712可包括任何適合的揮發性記憶體,諸如,例如適合的動態隨機存取記憶體(DRAM)。
NVM/儲存器716可包括一或多個用來儲存資料及/或指令之實體非暫時的電腦可讀取媒體,例如,邏輯724。NVM/儲存器716可包括任何適合的非揮發性記憶體,諸如,例如,快閃記憶體,及/或可包括任何適合的非揮發性儲存裝置,諸如,例如,一或多個硬式磁碟機(HDD)、一或多個光碟(CD)機、及/或一或多個數位多功能光碟(DVD)機。
NVM/儲存器716可包括裝置之儲存資源的實體部分,系統700被安裝於其上,或其可被裝置存取,但不必然是該裝置的一部分。例如,NVM/儲存器716可經由網路介面720及/或透過輸入/輸出(I/O)裝置732在網路上被存取。
邏輯724當被至少一個處理器704執行時,可致使系統實施本文所描述之關於UE104、媒體伺服器116、及/或裝置設定檔伺服器144的操作。邏輯724可被額外地/選擇地配置在系統的其它組件中,例如,配置在系統控制邏 輯708中,且可包括硬體、軟體、或韌體組件的任何組合。
網路介面720可具有收發器722,以提供系統700透過一或多個網路及/或與任何其它適合之裝置通訊的無線電介面。在各不同的實施例中,收發器722可與系統700的其它組件整合。例如,收發器722可包括處理器704的處理器、系統記憶體712的記憶體、及NVM/儲存器716的NVM/儲存器。網路介面720可包括任何適合的硬體及/或韌體。網路介面720可包括複數個天線,以提供多輸入、多輸出無線電介面。關於一實施例的網路介面720可包括,例如,有線網路配接器、無線網路配接器、電話數據機、及/或無線數據機。
關於一實施例,至少其中一個處理器704可與邏輯封裝在一起,用做為系統控制邏輯708的一或多個控制器。關於一實施例,至少其中一個處理器704可與邏輯封裝在一起,用做為系統控制邏輯708的一或多個控制器,以形成系統級封裝(System in Package;SiP)。關於一實施例,至少其中一個處理器704可與邏輯整合在同一晶粒上,用做為系統控制邏輯708的一或多個控制器。關於一實施例,至少其中一個處理器704可與邏輯整合在同一晶粒上,用做為系統控制邏輯708的一或多個控制器,以形成單晶片系統(System on Chip;SoC)。
在各不同實施例中,I/O裝置732可包括設計用來致使使用者能夠與系統700互動的使用者介面,設計用來致 使周邊組件能夠與系統700互動的周邊組件介面,及/或設計用來決定環境情況及/或與系統700有關之位置資訊的感測器。
在各不同實施例中,使用者介面可包括但不限於用於描繪3-D視訊的顯示器(例如,液晶顯示器、觸控螢幕顯示器、自動立體顯示器等)、喇叭、麥克風、一或多個攝影機(例如,照相機及/或攝影機)、閃光燈(例如,發光二極體閃光燈)、及鍵盤。
在各不同實施例中,周邊組件介面可包括但不限於非揮發性記憶體埠、通用序列匯流排(USB)埠、音響插孔、及電源介面。
在各不同實施例中,感測器可包括但不限於迴轉儀感測器、加速儀、接近感測器、環境光感測器、與定位單元。定位單元也可以是網路介面720的一部分或與其互動,以與定位網路之組件(例如,全球定位系統(GPS)衛星)通訊。
在各不同實施例中,系統700可以是行動計算裝置,諸如但不限於膝上型計算裝置、平板計算裝置、小筆電、智慧型手機等。在各不同實施例中,系統700可具有多些或少些組件及/或不同的架構。
基於描述之目的,雖然本文已說明及描述了某些實施例,但有可能獲致相同目的之各樣替代及/或相等實施例或實施可用來取代所顯示及描述的實施例,不會偏離本揭示的範圍。本申請案意欲涵蓋本文所討論之實施例的任何 修改或衍生。因此,本文所描述的實施例顯然意欲僅受申請專利範圍及其相等物的限制。
500‧‧‧方法

Claims (30)

  1. 一種具有指令的一或多個電腦可讀取媒體,當該等指令被執行時,致使裝置:從網路實體獲得串流幀包裝格式屬性,其包括被無線通訊網路之用戶端所支援,與在被該用戶端上之封包交換式串流服務(packet-switched streaming service;PSS)應用軟體所支援之傳輸協定上之立體3-D視訊串流相關之幀包裝格式的清單,其中,該傳輸協定係即時傳輸協定(real-time transport protocol;RTP)或超文字傳輸協定(hypertext transfer protocol;HTTP);根據該串流幀包裝格式屬性來調適內容;根據該串流幀包裝格式屬性產生對話描述或元資料檔以建立串流對話;以及將該經調適的內容及該產生的對話描述或元資料檔傳送給該用戶端。
  2. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,幀包裝格式之該清單包括垂直交錯幀相容包裝格式、水平交錯幀相容包裝格式、並列幀相容包裝格式、上下幀相容包裝格式、棋盤幀相容包裝格式、或每視圖之時間交錯全解析包裝格式的指示。
  3. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該清單包含分別對應一或多個被支援之幀包裝格式之一或多個整數值的清單。
  4. 如申請專利範圍第3項之一或多個電腦可讀取媒 體,其中,該一或多個整數值的清單包括:1,對應於垂直交錯幀相容包裝格式;2,對應於水平交錯幀相容包裝格式;3,對應於並列幀相容包裝格式;4,對應於上下幀相容包裝格式;0,對應於棋盤幀相容包裝格式;或5,對應於每視圖之時間交錯全解析包裝格式。
  5. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該傳輸協定包含即時傳輸協定(RTP)。
  6. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該傳輸協定包含超文字傳輸協定(HTTP)。
  7. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該對話描述或元資料檔係即時串流協定(real-time streaming protocol;RTSP)對話描述協定(session description protocol;SDP)檔或超文字傳輸協定動態自適性串流(dynamic adaptive streaming over hypertext transport protocol;DASH)媒體呈現描述(media presentation description;MPD)檔。
  8. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該內容係3-D視訊內容,且當該指令被執行時,進一步致使該裝置:根據該串流幀包裝格式屬性來轉碼該3-D視訊內容或轉換該3-D視訊內容的格式。
  9. 如申請專利範圍第1項之一或多個電腦可讀取媒體,其中,該網路實體係裝置設定檔伺服器或包含該用戶端的使用者設備。
  10. 一種具有指令的一或多個電腦可讀取媒體,當該等指令被執行時,致使裝置:從網路實體獲得幀包裝格式屬性,其包括一或多個幀包裝格式的清單,其係被使用者設備所支援、與可包括在第三代合作伙伴計畫檔案格式(3rd Generation Partnership Project;3GP)檔中之立體3-D視訊串流相關、並為使用者設備上之封包交換式串流服務(PSS)應用軟體來處理;以及根據該幀包裝格式屬性,將內容傳送給該使用者設備。
  11. 如申請專利範圍第10項之一或多個電腦可讀取媒體,其中,幀包裝格式之該清單包括並列幀包裝格式或上下幀包裝格式之指示。
  12. 如申請專利範圍第10項之一或多個電腦可讀取媒體,其中,該清單包含分別對應一或多個幀包裝格式之一或多個整數值的清單。
  13. 如申請專利範圍第12項之一或多個電腦可讀取媒體,其中,一或多個整數值的清單包括:3,以對應於並列幀相容包裝格式,或4,以對應於上下幀相容包裝格式。
  14. 一種設備,包含:媒體播放器,用以解碼並在行動裝置之顯示器上描繪為該行動裝置無線接收的立體3維(3-D)視訊內容;以及 內容管理模組,用以:決定包括該媒體播放器所支援之3-D視訊編碼解碼及格式的裝置能力資訊;將一或多個訊息傳送給媒體伺服器或裝置設定檔伺服器,該一或多個訊息包括該裝置能力資訊;將至少一個訊息傳送給媒體伺服器,該至少一個訊息包括請求立體3-D視訊內容及對該裝置能力資訊之任何暫時的調整。
  15. 如申請專利範圍第14項之設備,其中,該裝置能力資訊具有3-D格式屬性,其包括被該媒體播放器電路所支援的格式類型。
  16. 如申請專利範圍第15項之設備,其中,該格式類型係對應於幀相容包裝格式或每視圖之全解析包裝格式的幀包裝格式類型、聯播格式類型、或2維加輔助格式類型。
  17. 如申請專利範圍第16項之設備,其中,該格式類型係幀包裝格式類型,其為具有用來指示垂直交錯、水平交錯、併列、上下、或棋盤之值的幀相容包裝格式。
  18. 如申請專利範圍第14項之設備,其中,該3-D視訊內容係為該行動裝置經由封包交換式串流服務無線地接收。
  19. 如申請專利範圍第14項之設備,其中,該內容管理模組係用以在服務發現期間,在對話啟動協定(session initiation protocol;SIP)SUBSCRIBE訊息中傳送裝置能 力資訊給網際網路協定多媒體核心網路子系統。
  20. 如申請專利範圍第19項之設備,其中,該內容管理模組在服務發現之後接著使用對話啟動協定(SIP)發信號來更新所支援的3-D視訊編碼解碼及格式組。
  21. 如申請專利範圍第14項之設備,其中,該媒體播放器被進一步組構成:接收包括被請求之立體3-D視訊內容的串流,其中,該媒體播放器被進一步組構成按照超文字傳輸協定動態自適性串流(DASH)協定;封包交換式串流(PSS)協定;或網際網路協定多媒體子系統(IMS)式封包交換式串流(PSS)及多媒體廣播/多重播送(multimedia broadcast/multicast;MBMS)服務協定接收該串流。
  22. 如申請專利範圍第21項之設備,其中,該媒體播放器被進一步組構成接收與該串流相關的對話描述協定(session description protocol;SDP)檔或媒體呈現描述(media presentation description;MPD)元資料檔。
  23. 一種包含如申請專利範圍第14項之設備的行動裝置。
  24. 如申請專利範圍第23項之行動裝置,進一步包含:自動立體顯示器,用以在該媒體播放器的控制之下描繪該3-D視訊內容。
  25. 一種具有指令的一或多個電腦可讀取媒體,當該等指令被執行時,致使裝置: 獲得與使用者設備相關之3-D能力資訊的請求;以及提供串流幀包裝格式屬性,其包括幀包裝格式的清單,其係被使用者設備所支援、與在被該使用者設備上之封包交換式串流服務(PSS)應用軟體所支援之傳輸協定上之立體3-D視訊串流相關,其中,該傳輸協定係即時傳輸協定(RTP)或超文字傳輸協定(HTTP)。
  26. 如申請專利範圍第25項之一或多個電腦可讀取媒體,其中,幀包裝格式之該清單包括垂直交錯幀相容包裝格式、水平交錯幀相容包裝格式、並列幀相容包裝格式、上下幀相容包裝格式、棋盤幀相容包裝格式、或每視圖之時間交錯全解析包裝格式的指示。
  27. 如申請專利範圍第25項之一或多個電腦可讀取媒體,其中,該傳輸協定包含即時傳輸協定(RTP)。
  28. 如申請專利範圍第25項之一或多個電腦可讀取媒體,其中,該傳輸協定包含超文字傳輸協定(HTTP)。
  29. 如申請專利範圍第25項之一或多個電腦可讀取媒體,其中,該清單包含分別對應一或多個被支援之幀包裝格式之一或多個整數值的清單。
  30. 如申請專利範圍第29項之一或多個電腦可讀取媒體,其中,該一或多個整數值的清單包括:1,對應於垂直交錯幀相容包裝格式;2,對應於水平交錯幀相容包裝格式;3,對應於並列幀相容包裝格式;4,對應於上下幀相容包裝格式;0,對應於棋盤幀相容包裝格式;或5,對應於每視圖之時間交錯全解析包裝格式。
TW102111699A 2012-04-09 2013-04-01 在通訊網路中發信三維視訊資訊的電腦可讀取媒體、設備與行動裝置 TWI578756B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201261621939P 2012-04-09 2012-04-09
US201261679627P 2012-08-03 2012-08-03
US13/626,767 US9584793B2 (en) 2012-04-09 2012-09-25 Signaling three-dimensional video information in communication networks

Publications (2)

Publication Number Publication Date
TW201401849A true TW201401849A (zh) 2014-01-01
TWI578756B TWI578756B (zh) 2017-04-11

Family

ID=74551320

Family Applications (2)

Application Number Title Priority Date Filing Date
TW106101014A TW201720149A (zh) 2012-04-09 2013-04-01 在通訊網路中發信三維視訊資訊的媒體伺服器、設備與使用者設備
TW102111699A TWI578756B (zh) 2012-04-09 2013-04-01 在通訊網路中發信三維視訊資訊的電腦可讀取媒體、設備與行動裝置

Family Applications Before (1)

Application Number Title Priority Date Filing Date
TW106101014A TW201720149A (zh) 2012-04-09 2013-04-01 在通訊網路中發信三維視訊資訊的媒體伺服器、設備與使用者設備

Country Status (19)

Country Link
US (3) US9584793B2 (zh)
EP (2) EP2837192B8 (zh)
JP (2) JP6248330B2 (zh)
KR (3) KR101727875B1 (zh)
CN (2) CN103369467B (zh)
AU (1) AU2016203175B2 (zh)
BE (1) BE1021405B1 (zh)
CA (2) CA2957198C (zh)
FI (2) FI126988B (zh)
FR (1) FR2993426B1 (zh)
HK (1) HK1187769A1 (zh)
IT (1) ITMI20130537A1 (zh)
MX (2) MX341486B (zh)
MY (1) MY168796A (zh)
NL (1) NL2010602C2 (zh)
RU (2) RU2643446C1 (zh)
SE (1) SE537942C2 (zh)
TW (2) TW201720149A (zh)
WO (1) WO2013155110A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9161013B2 (en) 2012-04-09 2015-10-13 Intel Corporation Quality of experience reporting for combined unicast-multicast/broadcast streaming of media content

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9584793B2 (en) 2012-04-09 2017-02-28 Intel Corporation Signaling three-dimensional video information in communication networks
CN103294767A (zh) * 2013-04-22 2013-09-11 腾讯科技(深圳)有限公司 浏览器的多媒体信息显示方法及装置
MY182878A (en) * 2013-05-31 2021-02-05 Sony Corp Information processing device and information processing method
KR20150083429A (ko) * 2014-01-08 2015-07-17 한국전자통신연구원 Dash를 사용하는 비디오 재생을 위한 비트 깊이 표현 방법
TWI510911B (zh) * 2014-01-14 2015-12-01 Wistron Corp 行動電話及內核除錯訊息之輸出方法
EP3107288B1 (en) * 2014-02-10 2020-09-09 LG Electronics Inc. Method and apparatus for transmitting/receiving broadcast signal for 3-dimensional (3d) broadcast service
WO2015167177A1 (ko) * 2014-04-30 2015-11-05 엘지전자 주식회사 방송 전송 장치, 방송 수신 장치, 방송 전송 장치의 동작 방법 및 방송 수신 장치의 동작 방법
MY194189A (en) * 2015-02-11 2022-11-18 Vid Scale Inc Systems and methods for generalized http headers in dynamic adaptive streaming over http (dash)
US20170026431A1 (en) * 2015-07-20 2017-01-26 Intel IP Corporation Multicast mechanism for wireless devices
JP2017092646A (ja) * 2015-11-06 2017-05-25 株式会社リコー 情報処理システム、情報処理装置、情報処理方法及びプログラム
CN106454317B (zh) * 2016-11-15 2018-04-13 天津大学 基于模糊控制的立体视频质量自适应算法
EP3603083A4 (en) * 2017-03-26 2020-12-16 SHARP Kabushiki Kaisha INFORMATION SIGNALING SYSTEMS AND METHODS FOR VIRTUAL REALITY APPLICATIONS
CN108668179B (zh) * 2017-03-27 2021-05-14 华为技术有限公司 媒体索引文件的传输方法及相关设备
US10484308B2 (en) 2017-03-31 2019-11-19 At&T Intellectual Property I, L.P. Apparatus and method of managing resources for video services
US10819763B2 (en) 2017-03-31 2020-10-27 At&T Intellectual Property I, L.P. Apparatus and method of video streaming
US20190104326A1 (en) * 2017-10-03 2019-04-04 Qualcomm Incorporated Content source description for immersive media data
KR102476204B1 (ko) * 2017-10-19 2022-12-08 삼성전자주식회사 멀티 코덱 인코더 및 이를 포함하는 멀티 코덱 인코딩 시스템
WO2019151798A1 (ko) * 2018-01-31 2019-08-08 엘지전자 주식회사 무선 통신 시스템에서 이미지에 대한 메타데이터를 송수신하는 방법 및 장치
WO2019167633A1 (ja) * 2018-02-28 2019-09-06 ソニー株式会社 コンテンツ配信制御装置、コンテンツ配信制御方法、プログラム、およびコンテンツ配信システム
US11425433B2 (en) 2018-02-28 2022-08-23 Sony Corporation Content delivery control apparatus, content delivery control method, program, and content delivery control system
CN109743281A (zh) * 2018-11-19 2019-05-10 视联动力信息技术股份有限公司 一种通信方法及装置
US11044185B2 (en) 2018-12-14 2021-06-22 At&T Intellectual Property I, L.P. Latency prediction and guidance in wireless communication systems
US11320725B2 (en) 2019-11-22 2022-05-03 Canon Kabushiki Kaisha Projection type display apparatus, projection type display system, control method of projection type display apparatus, and storage medium
CN113382227A (zh) * 2021-06-03 2021-09-10 天翼阅读文化传播有限公司 一种基于智能手机的裸眼3d全景视频渲染装置及方法
US20230007067A1 (en) * 2021-06-30 2023-01-05 Tencent America LLC Bidirectional presentation datastream
JP2023044353A (ja) 2021-09-17 2023-03-30 セイコーエプソン株式会社 電気光学装置および電子機器

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8463912B2 (en) * 2000-05-23 2013-06-11 Media Farm, Inc. Remote displays in mobile communication networks
US6407680B1 (en) 2000-12-22 2002-06-18 Generic Media, Inc. Distributed on-demand media transcoding system and method
KR100420601B1 (ko) * 2001-11-22 2004-03-02 에스케이 텔레콤주식회사 비디오 데이터 스트리밍 서비스 방법
JP2004282462A (ja) 2003-03-17 2004-10-07 Nippon Telegr & Teleph Corp <Ntt> 3次元映像情報配信システム
KR100556826B1 (ko) 2003-04-17 2006-03-10 한국전자통신연구원 Mpeg-4 기반의 양안식 3차원 동영상을 서비스하기 위한 인터넷 방송 시스템 및 그 방법
US7392316B2 (en) 2003-06-30 2008-06-24 Microsoft Corporation Client to server streaming of multimedia content using HTTP
US7426734B2 (en) 2003-10-24 2008-09-16 Microsoft Corporation Facilitating presentation functionality through a programming interface media namespace
US8537204B2 (en) 2004-07-08 2013-09-17 Gyoung Il Cho 3D television broadcasting system
TWI242382B (en) 2004-08-31 2005-10-21 Sunplus Technology Co Ltd Three-dimensional video composite signal demodulating method and system capable of inhibiting pseudo-color noises
JP2008530835A (ja) 2005-02-08 2008-08-07 テレフオンアクチーボラゲット エル エム エリクソン(パブル) パケット交換ネットワーク上のオンデマンドマルチチャネルストリーミングセッション
ES2557295T3 (es) 2005-04-28 2016-01-25 Arenanet, Llc Sistema y método para la distribución selectiva de información
JP2006331199A (ja) 2005-05-27 2006-12-07 Ntt Docomo Inc サービス決定装置及びサービス決定方法
JP2007036874A (ja) * 2005-07-28 2007-02-08 Univ Of Tokyo 視聴者情報測定システム及びこれを用いたマッチングシステム
US8970680B2 (en) * 2006-08-01 2015-03-03 Qualcomm Incorporated Real-time capturing and generating stereo images and videos with a monoscopic low power mobile device
US20080228912A1 (en) 2007-03-16 2008-09-18 Ramakrishna Vedantham Enhanced Quality Reporting for Transmission Sessions
KR100962696B1 (ko) 2007-06-07 2010-06-11 주식회사 이시티 부호화된 스테레오스코픽 영상 데이터 파일의 구성방법
WO2009013438A2 (fr) 2007-07-17 2009-01-29 France Telecom Appropriation dynamique d'au moins un equipement multimedia lors d'une mise en communication
US20100134494A1 (en) 2008-12-02 2010-06-03 Electronics And Telecommunications Research Institute Remote shading-based 3d streaming apparatus and method
US9083958B2 (en) * 2009-08-06 2015-07-14 Qualcomm Incorporated Transforming video data in accordance with three dimensional input formats
US20110032333A1 (en) 2009-08-07 2011-02-10 Darren Neuman Method and system for 3d video format conversion with inverse telecine
US8380878B2 (en) * 2009-08-13 2013-02-19 Cox Communications, Inc. Side loading
US8310520B2 (en) 2009-08-19 2012-11-13 Avaya Inc. Flexible decomposition and recomposition of multimedia conferencing streams using real-time control information
US8976871B2 (en) 2009-09-16 2015-03-10 Qualcomm Incorporated Media extractor tracks for file format track selection
CN102714715B (zh) * 2009-09-22 2016-01-20 高通股份有限公司 用于文件格式轨迹选择的媒体提取器轨迹
DK2491720T3 (en) 2009-10-20 2018-06-06 Ericsson Telefon Ab L M PROVIDING SUPPLEMENTARY TREATMENT INFORMATION
US20110138018A1 (en) 2009-12-04 2011-06-09 Qualcomm Incorporated Mobile media server
KR20120125246A (ko) * 2010-01-07 2012-11-14 톰슨 라이센싱 비디오 컨텐츠의 디스플레이를 제공하는 방법 및 장치
KR101694821B1 (ko) 2010-01-28 2017-01-11 삼성전자주식회사 다시점 비디오스트림에 대한 링크 정보를 이용하는 디지털 데이터스트림 전송 방법와 그 장치, 및 링크 정보를 이용하는 디지털 데이터스트림 전송 방법과 그 장치
WO2011136621A2 (en) 2010-04-30 2011-11-03 Lg Electronics Inc. An apparatus of processing an image and a method of processing thereof
US8402502B2 (en) * 2010-06-16 2013-03-19 At&T Intellectual Property I, L.P. Method and apparatus for presenting media content
US9131033B2 (en) 2010-07-20 2015-09-08 Qualcomm Incoporated Providing sequence data sets for streaming video data
US9560406B2 (en) * 2010-07-20 2017-01-31 At&T Intellectual Property I, L.P. Method and apparatus for adapting a presentation of media content
US9596447B2 (en) 2010-07-21 2017-03-14 Qualcomm Incorporated Providing frame packing type information for video coding
US9226045B2 (en) 2010-08-05 2015-12-29 Qualcomm Incorporated Signaling attributes for network-streamed video data
US8677428B2 (en) 2010-08-20 2014-03-18 Disney Enterprises, Inc. System and method for rule based dynamic server side streaming manifest files
CN103069817A (zh) 2010-08-23 2013-04-24 Lg电子株式会社 用于在3dtv中提供3d视频数据的方法
US8896664B2 (en) 2010-09-19 2014-11-25 Lg Electronics Inc. Method and apparatus for processing a broadcast signal for 3D broadcast service
EP2706755A4 (en) * 2011-05-27 2014-07-16 Huawei Tech Co Ltd MEDIA TRANSMISSION PROCEDURE, MEDIA RECEPTION PROCEDURE, CLIENT AND SYSTEM THEREFOR
EP2597876A1 (en) * 2011-11-24 2013-05-29 Koninklijke Philips Electronics N.V. Interlaced 3D video
US9584793B2 (en) 2012-04-09 2017-02-28 Intel Corporation Signaling three-dimensional video information in communication networks

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9161013B2 (en) 2012-04-09 2015-10-13 Intel Corporation Quality of experience reporting for combined unicast-multicast/broadcast streaming of media content
US9438883B2 (en) 2012-04-09 2016-09-06 Intel Corporation Quality of experience reporting for combined unicast-multicast/broadcast streaming of media content
US10200668B2 (en) 2012-04-09 2019-02-05 Intel Corporation Quality of experience reporting for combined unicast-multicast/broadcast streaming of media content

Also Published As

Publication number Publication date
SE1350444A1 (sv) 2013-10-10
CN105915882B (zh) 2019-04-30
EP2837192A1 (en) 2015-02-18
MY168796A (en) 2018-12-04
HK1187769A1 (zh) 2014-04-11
TWI578756B (zh) 2017-04-11
CA2957198C (en) 2019-05-07
MX362598B (es) 2019-01-25
MX341486B (es) 2016-08-23
CN103369467A (zh) 2013-10-23
FI20135313A (fi) 2013-10-10
CN103369467B (zh) 2016-06-22
US10194134B2 (en) 2019-01-29
KR101727875B1 (ko) 2017-04-17
RU2591174C2 (ru) 2016-07-10
US20150113572A1 (en) 2015-04-23
FI126988B (en) 2017-09-15
FR2993426A1 (fr) 2014-01-17
JP2015515830A (ja) 2015-05-28
KR20140136007A (ko) 2014-11-27
US20130266289A1 (en) 2013-10-10
RU2643446C1 (ru) 2018-02-01
TW201720149A (zh) 2017-06-01
FI20175391L (fi) 2017-05-04
MX2014011579A (es) 2015-06-23
EP2837192B8 (en) 2021-01-20
FI129521B (en) 2022-03-31
US9787967B2 (en) 2017-10-10
RU2014138947A (ru) 2016-04-10
ITMI20130537A1 (it) 2013-10-10
US9584793B2 (en) 2017-02-28
AU2016203175B2 (en) 2017-10-19
NL2010602C2 (en) 2015-04-09
NL2010602A (en) 2013-10-15
WO2013155110A1 (en) 2013-10-17
JP6248330B2 (ja) 2017-12-20
KR20160075787A (ko) 2016-06-29
KR101881265B1 (ko) 2018-07-23
BE1021405B1 (fr) 2015-11-17
EP2966875A1 (en) 2016-01-13
AU2013246041A1 (en) 2014-10-02
CA2957198A1 (en) 2013-10-17
CA2868038A1 (en) 2013-10-17
BR112014024061A2 (zh) 2017-06-20
SE537942C2 (sv) 2015-12-01
US20170353709A1 (en) 2017-12-07
EP2837192A4 (en) 2015-08-19
EP2837192B1 (en) 2020-10-28
AU2016203175A1 (en) 2016-06-09
CN105915882A (zh) 2016-08-31
KR20170044205A (ko) 2017-04-24
JP6428885B2 (ja) 2018-11-28
CA2868038C (en) 2017-03-28
FR2993426B1 (fr) 2018-03-16
KR101630108B1 (ko) 2016-06-13
JP2018014746A (ja) 2018-01-25

Similar Documents

Publication Publication Date Title
TWI578756B (zh) 在通訊網路中發信三維視訊資訊的電腦可讀取媒體、設備與行動裝置
ES2482605B2 (es) Señalización de información de vídeo tridimensional en redes de comunicación
CA2880588C (en) Streaming with coordination of video orientation
AU2013246041B2 (en) Signaling three dimensional video information in communication networks
FI20225190A1 (en) Signaling of three-dimensional video information in communication networks
BR112014024061B1 (pt) Meio legível por computador, método, aparelho e sistema para sinalização de informação de vídeo tridimensional em redes de comunicação