WO2011030811A1 - 配信システム、ゲートウェイ、配信方法及びプログラム - Google Patents
配信システム、ゲートウェイ、配信方法及びプログラム Download PDFInfo
- Publication number
- WO2011030811A1 WO2011030811A1 PCT/JP2010/065480 JP2010065480W WO2011030811A1 WO 2011030811 A1 WO2011030811 A1 WO 2011030811A1 JP 2010065480 W JP2010065480 W JP 2010065480W WO 2011030811 A1 WO2011030811 A1 WO 2011030811A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal
- file
- stream
- content
- unit
- Prior art date
Links
- 238000002716 delivery method Methods 0.000 title description 2
- 238000006243 chemical reaction Methods 0.000 claims abstract description 150
- 238000000605 extraction Methods 0.000 claims abstract description 46
- 238000000034 method Methods 0.000 claims abstract description 41
- 230000005540 biological transmission Effects 0.000 claims abstract description 31
- 238000012545 processing Methods 0.000 claims abstract description 9
- 230000008569 process Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 13
- 239000000284 extract Substances 0.000 claims description 12
- 230000004044 response Effects 0.000 claims description 11
- 230000007774 longterm Effects 0.000 claims description 5
- 238000012986 modification Methods 0.000 abstract description 5
- 230000004048 modification Effects 0.000 abstract description 5
- 230000006835 compression Effects 0.000 abstract description 2
- 238000007906 compression Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 14
- 239000000470 constituent Substances 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000006866 deterioration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000007634 remodeling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000005641 tunneling Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/102—Gateways
- H04L65/1023—Media gateways
- H04L65/103—Media gateways in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/10—Architectures or entities
- H04L65/102—Gateways
- H04L65/1033—Signalling gateways
- H04L65/104—Signalling gateways in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
- H04L65/612—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio for unicast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
- H04L65/765—Media network packet handling intermediate
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
- H04L67/303—Terminal profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/565—Conversion or adaptation of application format or content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
Definitions
- the present invention relates to a distribution system, a gateway, a distribution method, and a program, and more particularly, to a distribution system, a gateway, a distribution method, and a program for distributing content that has been compression-encoded by a hierarchical encoding method.
- NGN Next Generation Network
- IPTV Internet Protocol TeleVision
- the mobile network will be increased in speed and capacity in the future by using LTE (Long Term Evolution) and EPC (Evolved Packet Core) technologies.
- LTE Long Term Evolution
- EPC Evolved Packet Core
- Patent Document 1 discloses a server client system including a server that executes transmission processing of hierarchically encoded data and a client that receives hierarchically encoded data from the server.
- the client has a configuration for executing a process of storing and transmitting request data mode identification information indicating a hierarchical encoded data mode requested by the client in a data request message transmitted to the server.
- the server extracts or generates encoded data corresponding to the request data mode identification information from the storage unit based on the request data mode identification information included in the data request message received from the client, and the client It is supposed that it has the structure which performs the process transmitted with respect to.
- the decoding capability information of all the image receiving devices in the system is registered in the configuration management table in the image transmitting device, and the parameter setting unit of the image transmitting device is used for the image receiving device of the image transfer destination.
- the decoding capability information is read from the configuration management table, and the parameters of the encoding processing unit are set according to the decoding capability information.
- an image transmission apparatus is disclosed.
- Patent Document 3 is another example of a hierarchically encoded video distribution system.
- the gateway of Patent Document 3 receives each second video stream using m first multicast channels, and based on the desired number of integrated layers presented from the user terminal, m second videos.
- the stream is integrated and distributed to each of the third video streams for n user terminals.
- Patent Document 4 is another example of a hierarchically encoded video distribution system.
- the gateway of Patent Document 3 receives each second video stream using m first multicast channels, and based on the desired number of integrated layers presented from the user terminal, m second videos.
- the stream is integrated and distributed to each of the third video streams for n user terminals.
- Patent Document 5 discloses an image transmission apparatus that enables transmission of an image whose scalability is dynamically changed according to the traffic congestion state of a communication path.
- Patent Documents 1 to 5 are incorporated herein by reference. The following analysis is given by the present invention.
- bit rate, resolution, codec, file format, protocol, etc. do not match. In this case, the terminal cannot perform decoding.
- the content is converted and processed in advance for each terminal, such as for TV, PC, and portable, and content suitable for each terminal is created. It is conceivable that these conversions and processings are performed in accordance with the requirements. However, such a measure has a problem in that each time the content increases and the number of types of terminals increases, enormous work is required, and labor and cost become enormous.
- the server client system of Patent Document 1 needs to store and transmit request data mode identification information indicating a hierarchical encoded data mode requested by a client in a request message from the client to the server.
- request data mode identification information indicating a hierarchical encoded data mode requested by a client in a request message from the client to the server.
- a conventional client cannot be used as it is, and modifications of the client, new introduction of a client storing the request data mode identification information, etc. It becomes necessary.
- the image transmission device of Patent Document 2 needs to prepare the decoding capability information of all the image reception devices in the system, and a terminal whose decoding capability information is not registered in the image transmission device still has decoding or the like as described above. There may be cases where this is not possible.
- the present invention has been made in view of the above-described circumstances, and the object of the present invention is to provide various contents for the above-mentioned TV distribution without requiring remodeling or content processing on the terminal side.
- the object is to provide a distribution system, a gateway, a distribution method, and a program for distribution so as to be viewed on a terminal.
- a capability information storage unit that stores therein model information of a terminal included in a content request message and capability information of a terminal related to reception capability of hierarchically encoded data in association with each other; Based on content information of the terminal corresponding to the model information of the terminal included in the reception unit that receives the stream or file compressed and encoded by the hierarchical encoding method based on the content request message, and the content request message, A change instruction unit that creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file, and a conversion unit that performs conversion of the stream or file received from the request destination according to the extraction information; A packet transmission unit for transmitting the converted stream or file. Distribution system comprising Ntsu conversion device is provided.
- a capability information storage unit that stores the model information of the terminal included in the content request message and the capability information of the terminal related to the capability of receiving hierarchically encoded data in association with each other; Based on content information of the terminal corresponding to the model information of the terminal included in the reception unit that receives the stream or file compressed and encoded by the hierarchical encoding method based on the content request message, and the content request message, A change instruction unit that creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file, and a conversion unit that performs conversion of the stream or file received from the request destination according to the extraction information; A packet transmission unit for transmitting the converted stream or file. Ntsu conversion apparatus is provided.
- a distribution method including a step of converting a stream or file received from a request destination and a step of distributing the converted stream or file to a transmission source of the content request message. This method is linked to a specific machine called a computer that converts and distributes content to be distributed to a terminal in response to a request from the outside.
- a process for creating extraction information for extracting at least one hierarchically encoded portion from the input stream or file, a process for converting the stream or file received from the request destination according to the extraction information, and The process of outputting the converted stream or file Program to be executed by the computer is provided.
- This program can be recorded on a computer-readable storage medium. That is, the present invention can be embodied as a computer program product.
- the present invention it is possible to distribute content to various terminals from a mobile phone to a television without changing specifications on the terminal side or converting content in advance.
- the reason is, for example, H.
- a content conversion apparatus that creates a stream including a plurality of hierarchically encoded portions using a compression encoding scheme such as H.264 / AVC SVC and converts the content according to the model information included in the content request message from these terminals. It is in having adopted the composition including.
- Hierarchical coding means that a source signal is divided into a plurality of hierarchies and coded for each hierarchy.
- the content conversion device (corresponding to the gateway 110 in FIG. 1) is adapted to the capability information storage unit that stores capability information related to the reception capability of hierarchically encoded data for each terminal model, and to match the capability information of the terminal.
- a change instruction unit that creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file, and a conversion unit that performs conversion of the stream or file received from the request destination according to the extraction information; It is equipped with.
- the content conversion apparatus includes a content request message and the request requested from the terminal via the distribution server 120 that accepts a content request message from various terminals (the portable terminal 170 in FIG. 1 is an example of a terminal). Receive a compressed encoded stream or file.
- the content conversion apparatus (corresponding to the gateway 110 in FIG. 1) reads the capability information of the terminal that requested the distribution of the content from the capability information storage unit using the model information included in the content request message.
- the content conversion apparatus (corresponding to the gateway 110 in FIG. 1) creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file based on the read capability information.
- the content conversion device (corresponding to the gateway 110 in FIG.
- the converted stream or file is distributed to the requesting terminal (corresponding to the portable terminal 170 in FIG. 1) via the distribution server 120, for example.
- content can be distributed to various terminals ranging from mobile phones to televisions without changing the specifications on the terminal side or prior conversion of the content.
- the protocol or file format can be converted after extracting at least one hierarchically encoded portion from the compression-encoded stream or file.
- FIG. 1 is a block diagram showing a connection configuration according to the first embodiment of the present invention.
- a distribution server 120 connected to a content providing apparatus 100 and a gateway 110, and a mobile terminal 170 are shown.
- the solid arrows in FIG. 1 indicate the flow of data, and the broken lines indicate the flow of control signals.
- the content providing apparatus 100 accumulates a bitstream that is compression-encoded by a hierarchical encoding method for content including at least one of a moving image, a still image, audio, and audio, or a file that stores the bitstream.
- a hierarchical encoding method for content including at least one of a moving image, a still image, audio, and audio, or a file that stores the bitstream.
- H.264 is used as a hierarchical encoding method for moving image content.
- 264 / AVC SVC Scalable Video Coding
- the first network 130 may be any of an IP (Internet Protocol) network, a broadband network, an NGN (Next Generation Network), and an Internet network.
- IP Internet Protocol
- NGN Next Generation Network
- the mobile network 140 may be any of a mobile packet network, a WiMax (Worldwide Interoperability for Microwave Access) network, and an LTE (Long Term Evolution) network, but here it is assumed to be a mobile packet network.
- WiMax Worldwide Interoperability for Microwave Access
- LTE Long Term Evolution
- the distribution server 120 When the distribution server 120 receives a connection request from the mobile terminal 170 via the mobile network 140, the distribution server 120 acquires the model information of the mobile terminal included in the connection request protocol and outputs this to the gateway 110.
- HTTP Hyper Text Transfer Protocol
- SIP Session Initiation Protocol
- the distribution server 120 acquires the information of the selected content from the mobile terminal 170 after acquiring the model information, and receives the H.264 for the selected content from the content providing apparatus 100.
- the H.264 / SVC compressed encoded stream or file is read and output to the gateway 110.
- the distribution server 120 obtains capability information of the selected content itself (for example, information such as a codec, a video screen resolution, a bit rate, a frame rate, a stream or a file when the content is compression-encoded),
- the data is sent to the gateway 110 using a protocol such as SDP (Session Description Protocol).
- the distribution server 120 distributes the output packet from the gateway 110 to the mobile terminal 170 via the network.
- Gateway 110 is H.264.
- H.264 / AVC compressed stream or file and model information of portable terminal 170 are input from distribution server 120, and at least one hierarchically encoded portion is extracted from the stream stored in the stream or file according to the capability of portable terminal 170 Then, it is sent to the mobile terminal 170 via the distribution server 120.
- the gateway 110 functions as a content conversion device that converts content to conform to the model information of the mobile terminal 170.
- FIG. 2 is a block diagram showing a detailed configuration of the gateway 110 that functions as a content conversion apparatus.
- the gateway 110 includes a reception unit 112, a transcoder unit 113, a file conversion unit 114, a protocol conversion unit 115, a packet transmission unit 116, a conversion instruction unit 117, and the capability information storage described above. And a capability table 118 corresponding to the section.
- the conversion instruction unit 117 receives a content request message according to a specific protocol and the terminal model information from the portable terminal 170 via the distribution server 120.
- a specific protocol for example, in the case of HTTP, the terminal model information described in the User Agent header can be acquired.
- the conversion instruction unit 117 may acquire network information (for example, network type, bandwidth, etc.) used for connection.
- a well-known protocol such as SDP (Session Description Protocol) can also be used.
- the capability table 118 the following capability information is held in advance for each terminal model.
- Receivable codec (2) Receivability of hierarchical coding (reception availability) (3-1) Receivable level of hierarchically encoded stream (when hierarchical encoding is receivable) (3-2) Receivable resolution, bit rate, frame rate (when layered encoding is not possible) (4) Receivable protocol (5) Receivable file format and file size
- information other than the above (1) to (5) may be added to the capability information.
- the conversion instruction unit 117 includes capability information corresponding to the terminal model information read from the capability table 118 as described above, and capability information of the content itself sent from the distribution server 120 (for example, when the content is compressed and encoded) On the basis of the codec, video resolution, bit rate, frame rate, stream or file information), whether or not the video content received from the distribution server 120 needs to be converted, Extraction information indicating what kind of conversion is performed by the transcoder unit 113 is created.
- the video content is H.264.
- Basement Layer is 1 layer
- Enhancement Layer is N layer (N is an integer of 1 or more)
- resolution is maximum HD (1440x1080 pixels)
- frame rate is 30fps, Consider the case where the frame rate is 15 fps at the minimum with QCIF (176 ⁇ 144).
- the mobile terminal 170 is a new mobile phone. It is assumed that capability information of 512 kbps with H.264 / AVC SVC encoding, screen resolution of QVGA (320 ⁇ 240 pixels), and frame rate of 30 fps is obtained.
- the conversion instruction unit 117 uses the H.264 standard to adapt the selected content to the capability information of the delivery destination terminal.
- Extraction information for extracting at least one layer-coded portion from the H.264 / AVC SVC bitstream (for example, by extracting the Basement Layer bitstream and Enhancement Layer1 from the H.264 / AVC SVC bitstream Are converted from HD to QVGA, and the bit rate and frame rate are converted to 512 kbps, 30 fps, etc.), and this extracted information is output to the transcoder unit 113.
- the read capability information is also output to the reception unit 112, the file conversion unit 114, the protocol conversion unit 115, and the packet transmission unit 116.
- the model information of the mobile terminal 170 indicates the old model, and 264 / AVC SVC encoding cannot be decoded and only MPEG-4 baseband profile 128 kbps 15 fps can be decoded
- the conversion instruction unit 117 uses H.264 as extracted information and conversion information. Only the basement Layer is extracted from the H.264 / AVC SVC stream, and the content of the codec conversion to MPEG-4 Baseband Profile, 128 kbps, 15 fps is output to the transcoder unit 113.
- the read capability information is also output to the reception unit 112, the file conversion unit 114, the protocol conversion unit 115, and the packet transmission unit 116.
- the receiving unit 112 receives a file or stream of the selected video content from the distribution server 120, and in the case of the file, extracts and outputs the stream stored in the file. In the case of a stream, the stream stored in the packet payload is extracted and output to the transcoder unit 113.
- the transcoder unit 113 receives the stream extracted by the receiving unit 112, and extracts information output from the conversion instruction unit 117 (for example, from the H.264 / AVC SVC bit stream, the Basement Layer bit stream and the Enhancement Layer 1)
- the transcoder operating in real time is operated according to H.
- At least one layer portion is extracted from the H.264 / AVC SVC stream, and the extracted stream is output to the file conversion unit 114.
- the transcoder unit 113 is connected to the H.264.
- the transcoder unit 113 For example, only Basement Layer is extracted from the H.264 / AVC SVC stream in accordance with the extraction information, and this is converted to MPEG-4 Baseband Profile 128 kbps 15 fps, and the converted stream is output to the file conversion unit 114. .
- the file conversion unit 114 outputs the stream after extraction processing output from the transcoder unit 113 according to the above (5) receivable file format and file size of the capability information of the mobile terminal 170 output from the conversion instruction unit 117. Conversion to a file format for transmission to the portable terminal 170 is performed. For example, in the case of a mobile terminal, there are file formats such as 3GPP, 3GPP2, and MP4, and the file format can be determined depending on the model of the mobile terminal.
- the file conversion unit 114 generates a file according to the file format determined as described above, stores the extracted stream therein, and outputs the file to the protocol conversion unit 115.
- details of the 3GPP file format can refer to the 3GPP TS26.244 standard.
- the protocol conversion unit 115 determines a protocol that can be received by the mobile terminal 170 in accordance with the (4) receivable protocol of the capability information output from the conversion instruction unit 117, and is output from the file conversion unit 114 by this protocol. Send the file.
- HTTP is assumed to be used, but other well-known protocols such as RTP (Real-time Transport Protocol) may be used.
- the packet transmission unit 116 sends the file output from the protocol conversion unit 115 to the mobile network 140 using HTTP / UDP / IP packets according to the capability information output from the conversion instruction unit 117.
- the packet format used by the packet transmission unit 116 for transmission other well-known packet formats such as RTP / UDP / IP packets can be used.
- the mobile network 140 may be a WiMax network, an LTE network, or the like in addition to the mobile packet network, and can be implemented with the same configuration. Further, it may be a network using femtocell access points, and in this case, it can be implemented with the same configuration.
- 3GPP, 3GPP2, MP4, etc. are exemplified as the file format of the conversion destination of the file conversion unit 114, but other file formats may be used.
- HTTP and RTP are exemplified as the conversion destination protocol of the protocol conversion unit 115, but other protocols can also be used.
- FIG. 3 is a block diagram showing a connection configuration according to the second embodiment of the present invention.
- the constituent elements having the same numbers as those in FIG. 1 are the same constituent elements as those in the first embodiment, and thus the description thereof will be omitted. Differences will be described below.
- a PC (personal computer) 180 and a game terminal 190 are connected to the distribution server 120 via the Internet 160.
- the PC 180 and the game terminal 190 are shown, but by registering model information in the capability table, other Internet such as a notebook PC or a mobile data card storing a digital photo frame, a mobile data card, etc.
- a device having a connection function can be a delivery destination.
- the PC 180 and the game terminal 190 transmit a connection request signal to the distribution server 120 via the Internet 160 using a specific protocol (for example, HTTP). Since subsequent exchanges between the distribution server 120 and the gateway 110 are the same as those in the first embodiment, description thereof will be omitted.
- a specific protocol for example, HTTP
- FIG. 4 is a block diagram showing a connection configuration according to the third embodiment of the present invention.
- the constituent elements having the same numbers as those in FIG. 1 are the same constituent elements as those in the first embodiment, and thus the description thereof will be omitted. Differences will be described below.
- GPRS Global System for Mobile communications
- GTP GPRS Tunneling Protocol
- the protocol conversion unit 115 of the gateway 110 reads the file format by the GTP / UDP / IP protocol, and sends the GTP / UDP to the xGSN device 195 on the mobile network 150 from the packet transmission unit 116 via the distribution server 120. / Sent as an IP packet.
- the xGSN device 195 converts the file output from the distribution server 120 into the Iu-PS protocol and outputs it to the RNC device 196.
- the RNC device 196 converts the Iu-PS protocol into the TCP / IP protocol, selects a radio base station in the area where the mobile terminal 170 is located, and transmits a packet to the mobile terminal 170 via the radio base station. .
- the portable terminal 170 receives a content file by the TCP / IP protocol via the mobile network 150, extracts a stream from the file, performs decoding, reproduction, and display.
- the wireless function of the mobile terminal 170 is not only W-CDMA (Wideband Code Division Multiple Access) and CDMA2000, but also HSDPA (High Speed Downlink Packet Access), HSPA + (High SpeedLedEcL). Or WiMax can be used.
- W-CDMA Wideband Code Division Multiple Access
- CDMA2000 Code Division Multiple Access 2000
- HSDPA High Speed Downlink Packet Access
- HSPA + High SpeedLedEcL
- WiMax can be used.
- FIG. 5 is a block diagram showing the connection configuration of the fourth embodiment of the present invention.
- the constituent elements having the same numbers as those in FIG. 1 are the same constituent elements as those in the first embodiment, and thus the description thereof will be omitted. Differences will be described below.
- the distribution server 120 receives a request from the mobile terminal 170 via the mobile network 140. In addition, the distribution server 120 receives a request from the television 220 in the home 200 through the set top box 210.
- the distribution server 120 reads the model information from the request message transmitted from the mobile terminal 170 or the television 220 and notifies the gateway 110 of the model information.
- the set-top box 210 and the television 220 can receive and play back a 30 fps video stream in HD resolution, when the capability information corresponding to the corresponding model information is acquired from the capability table 118, Extraction information for extracting all layer portions of the H.246 / AVC SVC stream is obtained. As a result, the stream extracted by the reception unit 112 is output to the protocol conversion unit 115, bypassing the transcoder unit 113 and the file conversion unit 114.
- the protocol conversion unit 115 the UPnP / IP protocol defined by DLNA (Digital Living Network Alliance) is used, and the packet transmission unit 116 stores the protocol in the packet, and sends it to the set top box 210 through the NGN. To do.
- DLNA Digital Living Network Alliance
- the gateway 110 performs extraction and conversion using the estimated value of the bandwidth of the mobile network and the model information of the mobile terminal, as in the first embodiment.
- the present invention can perform content distribution to the TV via the NGN and content distribution to the mobile terminal 170 via the mobile network 140 with the same configuration. .
- the content conversion apparatus (corresponding to the gateway 110 in FIG. 1) transmits a capability information storage unit that stores capability information related to the capability of receiving hierarchically encoded data and a request message for the content for each terminal model.
- a bandwidth estimation unit for estimating a bandwidth of a network used for distribution to a terminal, and at least one hierarchically encoded portion extracted from an input stream or file so as to conform to the capability information of the terminal A stream that is generated from the request destination in accordance with the extraction information and the instruction content, and a change instruction unit that creates extraction information and instructs a change in bit rate and file size so as not to exceed the estimated network bandwidth Or a conversion unit that performs file conversion.
- the content conversion apparatus includes a content request message and the request requested from the terminal via the distribution server 120 that accepts a content request message from various terminals (the portable terminal 170 in FIG. 1 is an example of a terminal). Receive a compressed encoded stream or file.
- the content conversion device (corresponding to the gateway 110 in FIG. 1) reads out the capability information of the terminal that requested the distribution of the content from the capability information storage unit using the model information of the terminal included in the content request message. .
- the content conversion apparatus creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file based on the read capability information.
- the content conversion apparatus (corresponding to the gateway 110 in FIG.
- the converted stream or file is distributed to the requesting terminal (corresponding to the portable terminal 170 in FIG. 1) via the distribution server 120, for example.
- the protocol or file format can be converted after extracting at least one hierarchically encoded portion from the compression-encoded stream or file.
- FIG. 7 is a block diagram showing a detailed configuration of the gateway 110 that functions as a content conversion apparatus.
- the gateway 110 includes a reception unit 112, a transcoder unit 113, a file conversion unit 114, a protocol conversion unit 115, a packet transmission unit 116, a conversion instruction unit 117, and the capability information storage described above.
- a capability table 118 corresponding to a bandwidth and a bandwidth estimation unit 119.
- the conversion instruction unit 117 receives a content request message and response according to a specific protocol from the mobile terminal 170 via the distribution server 120.
- a specific protocol for example, in the case of HTTP, the terminal model information described in the User Agent header can be acquired.
- the conversion instruction unit 117 may acquire network information (for example, network type, bandwidth, etc.) used for connection.
- a well-known protocol such as SDP (Session Description Protocol) can also be used.
- the capability table 118 the following capability information is held in advance for each terminal model.
- Receivable codec (2) Receivability of hierarchical coding (reception availability) (3-1) Receivable level of hierarchically encoded stream (when hierarchical encoding is receivable) (3-2) Receivable resolution, bit rate, frame rate (when layered encoding is not possible) (4) Receivable protocol (5) Receivable file format and file size
- information other than the above (1) to (5) may be added to the capability information.
- the bandwidth estimation unit 119 estimates the bandwidth of the mobile network 140 based on the response from the mobile terminal 170 via the distribution server 120.
- the estimated bandwidth value Wj at a certain time j can be calculated using, for example, the following expressions (1) and (2) using a response message from the mobile terminal 170.
- Equation (1) and (2) ACK (j) represents a response message received at time j, and ACK (j-1) was received at time j-1 one unit later than time j. Represents a response message.
- ⁇ j in equation (1) indicates the difference in response message reception time at time j, and R indicates the bitstream amount per unit time delivered at time j ⁇ 1 or the file size per unit time delivered. .
- the bandwidth estimation unit 119 calculates the estimated bandwidth value Wj of the mobile network 140 at every predetermined time and outputs it to the conversion instruction unit 117.
- the conversion instruction unit 117 includes capability information corresponding to the terminal model information read from the capability table 118 as described above, and capability information of the content itself sent from the distribution server 120 (for example, when the content is compressed and encoded) On the basis of the codec, video resolution, bit rate, frame rate, stream or file information), whether or not the video content received from the distribution server 120 needs to be converted, Extraction information indicating what kind of conversion is performed by the transcoder unit 113 is created.
- the conversion instruction unit 117 receives the bandwidth estimation value Wj output from the bandwidth estimation unit 119, and determines the bit rate to be distributed or the file size to be distributed so as not to exceed the bandwidth estimation value Wj. .
- the video content is H.264.
- Basement Layer is 1 layer
- Enhancement Layer is N layer (N is an integer of 1 or more)
- resolution is maximum HD (1440x1080 pixels)
- frame rate is 30fps, Consider the case where the frame rate is 15 fps at the minimum with QCIF (176 ⁇ 144).
- the mobile terminal 170 is a new mobile phone. It is assumed that capability information of 512 kbps with H.264 / AVC SVC encoding, screen resolution of QVGA (320 ⁇ 240 pixels), and frame rate of 30 fps is obtained.
- the conversion instruction unit 117 uses the H.264 standard to adapt the selected content to the capability information of the delivery destination terminal. Extraction information for extracting at least one layered encoded portion from the H.264 / AVC SVC bitstream (for example, by extracting the Basement Layer bitstream and Enhancement Layer1 from the H.264 / AVC SVC bitstream Are converted from HD to QVGA, and the bit rate and frame rate are converted to 512 kbps, 30 fps, etc.). Further, when 384 kbps is obtained as the bandwidth estimation value Wj, the conversion instruction unit 117 determines that the distribution will exceed the network bandwidth even if the terminal capability information indicates 512 kbps, and the bit rate is set.
- the read capability information is also output to the reception unit 112, the file conversion unit 114, the protocol conversion unit 115, and the packet transmission unit 116.
- the model information of the mobile terminal 170 indicates the old model, and 264 / AVC SVC encoding cannot be decoded and only MPEG-4 baseband profile 128 kbps 15 fps can be decoded
- the conversion instruction unit 117 uses H.264 as extracted information and conversion information. Only basement Layer is extracted from the H.264 / AVC SVC stream, and the content to be codec converted to MPEG-4 Baseband Profile, 128 kbps, 15 fps is determined. Since the estimated bandwidth value Wj indicates 512 kbps, the conversion instruction unit 117 determines that the bandwidth is not exceeded if it is 128 kbps and 15 fps, and outputs the determined content to the transcoder unit 113 as it is. The read capability information is also output to the reception unit 112, the file conversion unit 114, the protocol conversion unit 115, and the packet transmission unit 116.
- the receiving unit 112 receives a file or stream of the selected video content from the distribution server 120, and in the case of the file, extracts and outputs the stream stored in the file. In the case of a stream, the stream stored in the packet payload is extracted and output to the transcoder unit 113.
- the transcoder unit 113 receives the stream extracted by the receiving unit 112, and extracts information output from the conversion instruction unit 117 (for example, from the H.264 / AVC SVC bit stream, the Basement Layer bit stream and the Enhancement Layer 1) And the transcoder operating in real time is operated according to the instruction to reduce the bit rate to 384 kbps and 30 fps. At least one layer portion is extracted from the H.264 / AVC SVC stream, and the extracted stream is output to the file conversion unit 114.
- the conversion instruction unit 117 for example, from the H.264 / AVC SVC bit stream, the basement Layer bit stream and the Enhancement Layer 1
- the transcoder operating in real time is operated according to the instruction to reduce the bit rate to 384 kbps and 30 fps.
- At least one layer portion is extracted from the H.264 / AVC SVC stream, and the extracted stream is output to the file conversion unit 114.
- the transcoder unit 113 is connected to the H.264.
- the transcoder unit 113 For example, only Basement Layer is extracted from the H.264 / AVC SVC stream in accordance with the extraction information, and this is converted to MPEG-4 Baseband Profile 128 kbps 15 fps, and the converted stream is output to the file conversion unit 114. .
- the file conversion unit 114 outputs the stream after extraction processing output from the transcoder unit 113 in accordance with the above (5) receivable file format and file size of the capability information of the mobile terminal 170 output from the conversion instruction unit 117. Conversion to a file format for transmission to the portable terminal 170 is performed. For example, in the case of a mobile terminal, there are file formats such as 3GPP, 3GPP2, and MP4, and the file format can be determined depending on the model of the mobile terminal.
- the file conversion unit 114 generates a file according to the file format determined as described above, stores the extracted stream therein, and outputs the file to the protocol conversion unit 115.
- details of the 3GPP file format can refer to the 3GPP TS26.244 standard.
- the protocol conversion unit 115 determines a protocol that can be received by the mobile terminal 170 in accordance with the (4) receivable protocol of the capability information output from the conversion instruction unit 117, and is output from the file conversion unit 114 by this protocol. Send the file.
- HTTP is assumed to be used, but other well-known protocols such as RTP (Real-time Transport Protocol) may be used.
- the packet transmission unit 116 sends the file output from the protocol conversion unit 115 to the mobile network 140 using HTTP / UDP / IP packets according to the capability information output from the conversion instruction unit 117.
- the packet format used by the packet transmission unit 116 for transmission other well-known packet formats such as RTP / UDP / IP packets can be used.
- the mobile network 140 may be a WiMax network, an LTE network, or the like in addition to the mobile packet network, and can be implemented with the same configuration. Further, it may be a network using femtocell access points, and in this case, it can be implemented with the same configuration.
- 3GPP, 3GPP2, MP4, etc. are exemplified as the file format of the conversion destination of the file conversion unit 114, but other file formats may be used.
- HTTP and RTP are exemplified as the conversion destination protocol of the protocol conversion unit 115, but other protocols can also be used.
- a stream including a plurality of hierarchically encoded parts is created, and the gateway 110 automatically extracts the encoded part of the hierarchical part. Therefore, pre-compilation work considering the capability of the terminal of the delivery destination and modification of the terminal are not required, and the stream received by any terminal can be reproduced.
- the bandwidth estimation unit 119 is provided as in the fifth embodiment, image quality degradation due to fluctuations in network bandwidth is suppressed.
- Patent Document 1 it is necessary to store and transmit request data mode identification information indicating the hierarchical encoded data mode requested by the client in a request message from the client to the server.
- request data mode identification information indicating the hierarchical encoded data mode requested by the client in a request message from the client to the server.
- the gateway 110 has been described as including the file conversion unit 114 and the protocol conversion unit 115. However, when file conversion or protocol conversion is not necessary, the gateway 110 is illustrated in FIGS. In addition, it is possible to adopt a configuration in which the conversion process using the extracted information is performed and the file conversion and the protocol conversion are omitted.
- the content conversion apparatus is a distribution system that performs protocol or file format conversion on the extracted hierarchically encoded portion based on the capability information.
- the content conversion device extracts at least one hierarchically encoded part from the input stream or file and then reads the terminal from the capability information storage unit System that converts to a codec that can be received by the terminal based on the capability information.
- H.264 As a hierarchical coding system for video signals, H.264 is used. H.264 / AVC SVC distribution system.
- the distribution system in which the capability table includes capability information of at least two types of mobile phones, personal computers, game terminals, digital photo frames, set-top boxes, home gateways, and televisions.
- a distribution system comprising a distribution server that relays between the content conversion device and the terminal.
- the network includes an IP (Internet Protocol) network, a broadband network, an NGN (Next Generation Network), an Internet network, a W-LAN (Wireless Local Area Network), a mobile packet network, a WiMax (Worldwide Internet Network).
- IP Internet Protocol
- NGN Next Generation Network
- W-LAN Wireless Local Area Network
- WiMax Worldwide Internet Network
- a capability information storage unit that stores the model information of the terminal included in the content request message and the capability information of the terminal related to the reception capability of the hierarchically encoded data in association with each other;
- a receiving unit that receives a stream or file that has been compression-encoded by a hierarchical encoding method based on the content request message;
- a bandwidth estimation unit for estimating a network bandwidth used for distribution to a terminal that has transmitted the content request message;
- a change instruction unit that creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file based on terminal capability information corresponding to terminal model information included in the content request message;
- a conversion unit that performs conversion of the stream or file received from the request destination according to the extraction information;
- a packet transmission unit for transmitting the converted stream or file,
- a distribution system including a content conversion apparatus, wherein the change instruction unit instructs the conversion unit not to exceed a network bandwidth estimated by the bandwidth estimation unit.
- the content conversion apparatus is a distribution system that performs protocol or file format conversion on the extracted hierarchically encoded portion based on the capability information.
- the content conversion device extracts at least one hierarchically encoded part from the input stream or file and then reads the terminal from the capability information storage unit System that converts to a codec that can be received by the terminal based on the capability information.
- the said bandwidth estimation part is a delivery system which estimates the network bandwidth used for delivery using the response information from the terminal of a delivery destination.
- H.264 As a hierarchical coding system for video signals, H.264 is used. H.264 / AVC SVC distribution system.
- the distribution system in which the capability table includes capability information of at least two types of mobile phones, personal computers, game terminals, digital photo frames, set-top boxes, home gateways, and televisions.
- a distribution system comprising a distribution server that relays between the content conversion device and the terminal.
- the network includes an IP (Internet Protocol) network, a broadband network, an NGN (Next Generation Network), an Internet network, a W-LAN (Wireless Local Area Network), a mobile packet network, a WiMax (Worldwide Internet Network).
- IP Internet Protocol
- NGN Next Generation Network
- W-LAN Wireless Local Area Network
- WiMax Worldwide Internet Network
- a capability information storage unit that stores the model information of the terminal included in the content request message and the capability information of the terminal related to the reception capability of the hierarchically encoded data in association with each other;
- a receiving unit that receives a stream or file that has been compression-encoded by a hierarchical encoding method based on the content request message;
- a bandwidth estimation unit for estimating a network bandwidth used for distribution to a terminal that has transmitted the content request message;
- a change instruction unit that creates extraction information for extracting at least one hierarchically encoded portion from the input stream or file based on terminal capability information corresponding to terminal model information included in the content request message;
- a conversion unit that performs conversion of the stream or file received from the request destination according to the extraction information;
- a packet transmission unit for transmitting the converted stream or file, The content conversion apparatus in which the change instruction unit instructs the conversion unit not to exceed the network bandwidth estimated by the bandwidth estimation unit.
- [20th form] Receiving a stream or file compressed and encoded by a hierarchical encoding scheme based on a content request message; Estimating the network bandwidth used for delivery to the terminal that sent the content request message; Extraction for extracting at least one hierarchically encoded portion from the input stream or file based on the capability information of the terminal regarding the capability of receiving the hierarchically encoded data determined from the model information of the terminal included in the content request message Creating information, Performing the conversion of the stream or file received from the request destination according to the extraction information; Delivering the converted stream or file to the terminal; A distribution method of performing distribution after performing conversion so as not to exceed the estimated network bandwidth in the step of performing the conversion.
- the content providing apparatus 110 gateway (content converting apparatus) 112 reception unit 113 transcoder unit 114 file conversion unit 115 protocol conversion unit 116 packet transmission unit 117 conversion instruction unit 118 capability table (capability information storage unit) 119 Bandwidth estimation unit 120 Distribution server 130 First network 140, 150 Mobile network 160 Second network (Internet) 170 Mobile terminal 180 PC (personal computer) 190 Game terminal 195 xGSN device 196 RNC device
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Graphics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Communication Control (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
本発明は、日本国特許出願:特願2009-212222号(2009年9月14日出願)並びに、日本国特許出願:特願2009-212223号(2009年9月14日出願)の優先権主張に基づくものであり、同出願の全記載内容は引用をもって本書に組み込み記載されているものとする。
続いて、本発明の第1の実施形態について、図面を参照して詳細に説明する。なお、以下の実施形態では、コンテンツとして動画像コンテンツを配信するものとして説明するが、静止画、オーディオ、音声のコンテンツについても場合も同様に適用することが可能である。
(1)受信可能なコーデック
(2)階層符号化の受信可能性(受信可否)
(3-1)受信可能な階層符号化ストリームのレベル(階層符号化が受信可の場合)
(3-2)受信可能な解像度、ビットレート、フレームレート(階層符号化が受信不可の場合)
(4)受信可能なプロトコル
(5)受信可能なファイル形式とファイルサイズ
その他、上記(1)~(5)以外の情報を能力情報に加えても良い。
続いて、コンテンツの配信先に変更を加えた本発明の第2の実施形態について、図面を参照して詳細に説明する。
続いて、コンテンツの配信先に変更を加えた本発明の第3の実施形態について、図面を参照して詳細に説明する。
続いて、コンテンツの配信先に変更を加えた本発明の第4の実施形態について、図面を参照して詳細に説明する。
続いて、本発明の第5の実施形態の概要について説明する。本実施形態のコンテンツ変換装置(図1のゲートウェイ110に相当)は、端末の機種毎に、階層符号化データの受信能力に関する能力情報を記憶する能力情報記憶部と、前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する帯域幅推定部と、前記端末の能力情報に適合するように、入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成するとともに、前記推定したネットワークの帯域幅を超えないように、ビットレートやファイルサイズの変更を指示する変更指示部と、前記抽出情報および指示内容に従って、前記要求先から受信したストリームまたはファイルの変換を実施する変換部と、を備えている。
続いて、本発明の第5の実施形態について、上記した第1~第4の実施形態との相違点を中心に説明する。
(1)受信可能なコーデック
(2)階層符号化の受信可能性(受信可否)
(3-1)受信可能な階層符号化ストリームのレベル(階層符号化が受信可の場合)
(3-2)受信可能な解像度、ビットレート、フレームレート(階層符号化が受信不可の場合)
(4)受信可能なプロトコル
(5)受信可能なファイル形式とファイルサイズ
その他、上記(1)~(5)以外の情報を能力情報に加えても良い。
Wj = R / △j ・・・(2)
なお、式(1)、式(2)において、ACK(j)はj時刻に受信した応答メッセージを表し、ACK(j-1)は、時刻jより1単位遡った時刻j-1に受信した応答メッセージを表す。式(1)の△jは時刻jにおける応答メッセージの受信時刻の差分を示し、Rは、j-1時刻に配信した単位時間あたりのビットストリーム量または、配信した単位時間あたりのファイルサイズを示す。
(上記第1の視点による配信システム参照)
第1の形態の配信システムにおいて、
前記コンテンツ変換装置は、前記抽出した階層符号化部分について、前記能力情報に基づいてプロトコルまたはファイル形式の変換を行う配信システム。
第1または第2の形態の配信システムにおいて、
前記コンテンツ変換装置は、前記端末が階層符号化データを受信できない端末である場合、前記入力したストリームまたはファイルから、少なくとも一つの階層符号化部分を抽出した上で前記能力情報記憶部から読み出した端末の能力情報に基づき当該端末が受信できるコーデックに変換する配信システム。
第1から第3いずれか一の形態の配信システムにおいて、
ビデオ信号に対する階層符号化方式としてH.264/AVC SVC方式を含む配信システム。
第1から第4いずれか一の形態の配信システムにおいて、
前記能力テーブルには、携帯電話、パーソナルコンピュータ、ゲーム端末、デジタルフォトフレーム、セットトップボックス、ホームゲートウェイ、テレビのいずれか2機種以上の能力情報が含まれる配信システム。
第1から第5いずれか一の形態の配信システムにおいて、
さらに、前記コンテンツ変換装置と前記端末と中継する配信サーバを備える配信システム。
第1から第6いずれか一の形態の配信システムにおいて、
前記ネットワークは、IP(Internet Protocol)網、ブロードバンド網、NGN(Next Generation Network)、インターネット網、W-LAN(Wireless Local Area Network)、モバイルパケット網、WiMax(Worldwide Interoperability for Microwave Access)網、LTE(Long Term Evolution)網のいずれかである配信システム。
(上記第2の視点によるコンテンツ変換装置参照)
(上記第3の視点による配信方法参照)
(上記第4の視点によるプログラム参照)
コンテンツの要求メッセージに含まれる端末の機種情報と、階層符号化データの受信能力に関する端末の能力情報とを対応付けて記憶する能力情報記憶部と、
前記コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する受信部と、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する帯域幅推定部と、
コンテンツの要求メッセージに含まれる端末の機種情報に対応する端末の能力情報に基づいて、前記入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する変更指示部と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施する変換部と、
前記変換したストリームまたはファイルを送信するパケット送信部と、を備え、
前記変更指示部が、前記帯域幅推定部にて推定されたネットワークの帯域幅を超えないよう前記変換部に対して指示するコンテンツ変換装置を含む配信システム。
第11の形態の配信システムにおいて、
前記コンテンツ変換装置は、前記抽出した階層符号化部分について、前記能力情報に基づいてプロトコルまたはファイル形式の変換を行う配信システム。
第11または第12の形態の配信システムにおいて、
前記コンテンツ変換装置は、前記端末が階層符号化データを受信できない端末である場合、前記入力したストリームまたはファイルから、少なくとも一つの階層符号化部分を抽出した上で前記能力情報記憶部から読み出した端末の能力情報に基づき当該端末が受信できるコーデックに変換する配信システム。
第11から第13いずれか一の形態の配信システムにおいて、
前記帯域幅推定部は、配信先の端末からの応答情報を用いて、配信に使用するネットワークの帯域幅を推定する配信システム。
第11から第14いずれか一の形態の配信システムにおいて、
ビデオ信号に対する階層符号化方式としてH.264/AVC SVC方式を含む配信システム。
第11から第15いずれか一の形態の配信システムにおいて、
前記能力テーブルには、携帯電話、パーソナルコンピュータ、ゲーム端末、デジタルフォトフレーム、セットトップボックス、ホームゲートウェイ、テレビのいずれか2機種以上の能力情報が含まれる配信システム。
第11から第16いずれか一の形態の配信システムにおいて、
さらに、前記コンテンツ変換装置と前記端末と中継する配信サーバを備える配信システム。
第11から第17いずれか一の形態の配信システムにおいて、
前記ネットワークは、IP(Internet Protocol)網、ブロードバンド網、NGN(Next Generation Network)、インターネット網、W-LAN(Wireless Local Area Network)、モバイルパケット網、WiMax(Worldwide Interoperability for Microwave Access)網、LTE(Long Term Evolution)網のいずれかである配信システム。
コンテンツの要求メッセージに含まれる端末の機種情報と、階層符号化データの受信能力に関する端末の能力情報とを対応付けて記憶する能力情報記憶部と、
前記コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する受信部と、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する帯域幅推定部と、
コンテンツの要求メッセージに含まれる端末の機種情報に対応する端末の能力情報に基づいて、前記入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する変更指示部と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施する変換部と、
前記変換したストリームまたはファイルを送信するパケット送信部と、を備え、
前記変更指示部が、前記帯域幅推定部にて推定されたネットワークの帯域幅を超えないよう前記変換部に対して指示するコンテンツ変換装置。
コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信するステップと、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定するステップと、
コンテンツの要求メッセージに含まれる端末の機種情報から割り出した階層符号化データの受信能力に関する当該端末の能力情報に基づいて、入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成するステップと、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施するステップと、
前記変換したストリームまたはファイルを前記端末に配信するステップとを含み、
前記変換を実施するステップにおいて前記推定したネットワークの帯域幅を超えないよう変換してから、配信する配信方法。
外部からの依頼に応じて端末に配信するコンテンツを変換するコンピュータに実行させるプログラムであって、
前記端末からのコンテンツの要求メッセージに基づいて、コンテンツ配信元から、階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する処理と、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する処理と、
コンテンツの要求メッセージに含まれる端末の機種情報から割り出した階層符号化データの受信能力に関する当該端末の能力情報に基づいて、入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する処理と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルを変換する処理と、
前記変換したストリームまたはファイルを出力する処理とを、前記コンピュータに実行させるとともに、
前記ストリームまたはファイルを変換する処理において、前記コンピュータに、前記推定したネットワークの帯域幅を超えないよう前記ストリームまたはファイルを変換させるプログラム。
110 ゲートウェイ(コンテンツ変換装置)
112 受信部
113 トランスコーダ部
114 ファイル変換部
115 プロトコル変換部
116 パケット送信部
117 変換指示部
118 能力テーブル(能力情報記憶部)
119 帯域幅推定部
120 配信サーバ
130 第1のネットワーク
140、150 モバイルネットワーク
160 第2のネットワーク(インターネット)
170 携帯端末
180 PC(パーソナルコンピュータ)
190 ゲーム端末
195 xGSN装置
196 RNC装置
Claims (15)
- コンテンツの要求メッセージに含まれる端末の機種情報と、階層符号化データの受信能力に関する端末の能力情報とを対応付けて記憶する能力情報記憶部と、
前記コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する受信部と、
コンテンツの要求メッセージに含まれる端末の機種情報に対応する端末の能力情報に基づいて、前記入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する変更指示部と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施する変換部と、
前記変換したストリームまたはファイルを送信するパケット送信部と、を備えるコンテンツ変換装置を含む配信システム。 - 前記コンテンツ変換装置は、前記抽出した階層符号化部分について、前記能力情報に基づいてプロトコルまたはファイル形式の変換を行う請求項1の配信システム。
- 前記コンテンツ変換装置は、前記端末が階層符号化データを受信できない端末である場合、前記入力したストリームまたはファイルから、少なくとも一つの階層符号化部分を抽出した上で前記能力情報記憶部から読み出した端末の能力情報に基づき当該端末が受信できるコーデックに変換する請求項1または2の配信システム。
- ビデオ信号に対する階層符号化方式としてH.264/AVC SVC方式を含む請求項1から3いずれか一の配信システム。
- 前記能力テーブルには、携帯電話、パーソナルコンピュータ、ゲーム端末、デジタルフォトフレーム、セットトップボックス、ホームゲートウェイ、テレビのいずれか2機種以上の能力情報が含まれる請求項1から4いずれか一の配信システム。
- さらに、前記コンテンツ変換装置と前記端末と中継する配信サーバを備える請求項1から5いずれか一の配信システム。
- 前記ネットワークは、IP(Internet Protocol)網、ブロードバンド網、NGN(Next Generation Network)、インターネット網、W-LAN(Wireless Local Area Network)、モバイルパケット網、WiMax(Worldwide Interoperability for Microwave Access)網、LTE(Long Term Evolution)網のいずれかである請求項1から6いずれか一の配信システム。
- さらに、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する帯域幅推定部を備え、
前記変更指示部が、前記帯域幅推定部にて推定されたネットワークの帯域幅を超えないよう前記変換部に対して指示するコンテンツ変換装置を含む請求項1から7いずれか一の配信システム。 - 前記コンテンツ変換装置は、前記抽出した階層符号化部分について、前記能力情報に基づいてプロトコルまたはファイル形式の変換を行う請求項8の配信システム。
- コンテンツの要求メッセージに含まれる端末の機種情報と、階層符号化データの受信能力に関する端末の能力情報とを対応付けて記憶する能力情報記憶部と、
前記コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する受信部と、
コンテンツの要求メッセージに含まれる端末の機種情報に対応する端末の能力情報に基づいて、前記入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する変更指示部と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施する変換部と、
前記変換したストリームまたはファイルを送信するパケット送信部と、を備えるコンテンツ変換装置。 - さらに、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する帯域幅推定部を備え、
前記変更指示部が、前記帯域幅推定部にて推定されたネットワークの帯域幅を超えないよう前記変換部に対して指示する請求項10のコンテンツ変換装置。 - コンテンツの要求メッセージに基づいて階層符号化方式により圧縮符号化されたストリームまたはファイルを受信するステップと、
コンテンツの要求メッセージに含まれる端末の機種情報から割り出した階層符号化データの受信能力に関する当該端末の能力情報に基づいて、入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成するステップと、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルの変換を実施するステップと、
前記変換したストリームまたはファイルを前記コンテンツの要求メッセージの送信元に配信するステップとを含む配信方法。 - さらに、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定するステップを含み、
前記変換を実施するステップにおいて前記推定したネットワークの帯域幅を超えないよう変換してから、配信する請求項12の配信方法。 - 外部からの依頼に応じて端末に配信するコンテンツを変換するコンピュータに実行させるプログラムであって、
前記端末からのコンテンツの要求メッセージに基づいて、コンテンツ配信元から、階層符号化方式により圧縮符号化されたストリームまたはファイルを受信する処理と、
前記コンテンツの要求メッセージに含まれる端末の機種情報から割り出した階層符号化データの受信能力に関する当該端末の能力情報に基づいて、入力したストリームまたはファイルから少なくとも一つの階層符号化部分を抽出するための抽出情報を作成する処理と、
前記抽出情報に従って、前記要求先から受信したストリームまたはファイルを変換する処理と、
前記変換したストリームまたはファイルを出力する処理とを、前記コンピュータに実行させるプログラム。 - さらに、
前記コンテンツの要求メッセージを送出した端末への配信に使用するネットワークの帯域幅を推定する処理を前記コンピュータに実行させるとともに、
前記ストリームまたはファイルを変換する処理において、前記コンピュータに、前記推定したネットワークの帯域幅を超えないよう前記ストリームまたはファイルを変換させる請求項14のプログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/395,116 US20120174174A1 (en) | 2009-09-14 | 2010-09-09 | Delivery system, gateway, delivery method, and program |
JP2011530863A JPWO2011030811A1 (ja) | 2009-09-14 | 2010-09-09 | 配信システム、ゲートウェイ、配信方法及びプログラム |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-212223 | 2009-09-14 | ||
JP2009212223 | 2009-09-14 | ||
JP2009-212222 | 2009-09-14 | ||
JP2009212222 | 2009-09-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011030811A1 true WO2011030811A1 (ja) | 2011-03-17 |
Family
ID=43732480
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/065480 WO2011030811A1 (ja) | 2009-09-14 | 2010-09-09 | 配信システム、ゲートウェイ、配信方法及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US20120174174A1 (ja) |
JP (1) | JPWO2011030811A1 (ja) |
WO (1) | WO2011030811A1 (ja) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013060619A1 (en) * | 2011-10-26 | 2013-05-02 | Nokia Siemens Networks Oy | Signaling enabling status feedback and selection by a network entity of portions of video information to be delivered via wireless transmission to a ue |
JP2015095724A (ja) * | 2013-11-11 | 2015-05-18 | Kddi株式会社 | 送信機、データ処理方法及びデータ送受信システム |
US9099151B2 (en) | 2012-02-09 | 2015-08-04 | Panasonic Intellectual Property Management Co., Ltd. | Multimedia content editing server, multimedia content editing method, program, and integrated circuit |
JP2016005264A (ja) * | 2014-06-20 | 2016-01-12 | 船井電機株式会社 | 映像送信装置及び映像送信方法 |
JP5843974B2 (ja) * | 2013-08-22 | 2016-01-13 | 三菱電機株式会社 | 宅内配信装置、宅内配信システム、および宅内配信方法 |
JP2016506105A (ja) * | 2012-11-15 | 2016-02-25 | シーディーネットワークス カンパニー リミテッド | 通信網の種類を区分する方法、装置及び記録媒体 |
JP2017153038A (ja) * | 2016-02-26 | 2017-08-31 | 沖電気工業株式会社 | 通信制御装置、通信制御方法及び通信制御プログラム |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10091553B1 (en) * | 2014-01-10 | 2018-10-02 | Sprint Communications Company L.P. | Video content distribution system and method |
DE102017127075B4 (de) * | 2017-11-17 | 2019-06-06 | Ifm Electronic Gmbh | Kommunikationssystem der Automatisierungs- und Prozesstechnik sowie Y-Weicheneinheit für ein solches Kommunikationssystem |
JP7439556B2 (ja) * | 2020-02-14 | 2024-02-28 | オムロン株式会社 | 画像処理装置、画像センサ、画像処理装置の制御方法 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002374298A (ja) * | 2001-06-13 | 2002-12-26 | Oki Electric Ind Co Ltd | トランスコーダー装置 |
WO2008108379A1 (ja) * | 2007-02-28 | 2008-09-12 | Nec Corporation | メディア配信システム、配信サーバ装置及びそれらに用いるメディア配信方法並びにそのプログラム |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7143432B1 (en) * | 1999-10-01 | 2006-11-28 | Vidiator Enterprises Inc. | System for transforming streaming video data |
JP2004192140A (ja) * | 2002-12-09 | 2004-07-08 | Sony Corp | データ通信システム、データ送信装置、データ受信装置、および方法、並びにコンピュータ・プログラム |
KR20050106393A (ko) * | 2002-12-27 | 2005-11-09 | 닐슨 미디어 리서치 인코퍼레이티드 | 메타데이터를 트랜스코딩하는 방법 및 장치 |
US20130097302A9 (en) * | 2003-10-01 | 2013-04-18 | Robert Khedouri | Audio visual player apparatus and system and method of content distribution using the same |
JP2005333358A (ja) * | 2004-05-19 | 2005-12-02 | Ntt Communications Kk | 画像通信装置、その処理方法及びクライアント装置並びにプログラム |
US7784076B2 (en) * | 2004-10-30 | 2010-08-24 | Sharp Laboratories Of America, Inc. | Sender-side bandwidth estimation for video transmission with receiver packet buffer |
US8090802B1 (en) * | 2004-12-13 | 2012-01-03 | At&T Mobility Ii Llc | Smart super-distribution of rights-protected digital content |
JP2006174045A (ja) * | 2004-12-15 | 2006-06-29 | Ntt Communications Kk | 画像配信装置、プログラム及び方法 |
WO2007040085A1 (ja) * | 2005-10-06 | 2007-04-12 | Nec Corporation | パケット交換網-回線交換網間のメディア通信におけるプロトコル変換システム |
EP2100459B1 (en) * | 2007-01-08 | 2019-04-03 | Nokia Technologies Oy | System and method for providing and using predetermined signaling of interoperability points for transcoded media streams |
WO2010140587A1 (ja) * | 2009-06-04 | 2010-12-09 | 日本電気株式会社 | ゲートウェイ装置と方法とシステム |
JP5561278B2 (ja) * | 2009-07-08 | 2014-07-30 | 日本電気株式会社 | ゲートウェイ装置と方法と通信システム |
US20120206645A1 (en) * | 2009-10-23 | 2012-08-16 | Nec Corporation | Delivery system, gateway, delivery method, and program |
-
2010
- 2010-09-09 US US13/395,116 patent/US20120174174A1/en not_active Abandoned
- 2010-09-09 WO PCT/JP2010/065480 patent/WO2011030811A1/ja active Application Filing
- 2010-09-09 JP JP2011530863A patent/JPWO2011030811A1/ja active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002374298A (ja) * | 2001-06-13 | 2002-12-26 | Oki Electric Ind Co Ltd | トランスコーダー装置 |
WO2008108379A1 (ja) * | 2007-02-28 | 2008-09-12 | Nec Corporation | メディア配信システム、配信サーバ装置及びそれらに用いるメディア配信方法並びにそのプログラム |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013060619A1 (en) * | 2011-10-26 | 2013-05-02 | Nokia Siemens Networks Oy | Signaling enabling status feedback and selection by a network entity of portions of video information to be delivered via wireless transmission to a ue |
US9160778B2 (en) | 2011-10-26 | 2015-10-13 | Nokia Solutions And Networks Oy | Signaling enabling status feedback and selection by a network entity of portions of video information to be delivered via wireless transmission to a UE |
US9099151B2 (en) | 2012-02-09 | 2015-08-04 | Panasonic Intellectual Property Management Co., Ltd. | Multimedia content editing server, multimedia content editing method, program, and integrated circuit |
JP2016506105A (ja) * | 2012-11-15 | 2016-02-25 | シーディーネットワークス カンパニー リミテッド | 通信網の種類を区分する方法、装置及び記録媒体 |
JP5843974B2 (ja) * | 2013-08-22 | 2016-01-13 | 三菱電機株式会社 | 宅内配信装置、宅内配信システム、および宅内配信方法 |
JP2015095724A (ja) * | 2013-11-11 | 2015-05-18 | Kddi株式会社 | 送信機、データ処理方法及びデータ送受信システム |
JP2016005264A (ja) * | 2014-06-20 | 2016-01-12 | 船井電機株式会社 | 映像送信装置及び映像送信方法 |
JP2017153038A (ja) * | 2016-02-26 | 2017-08-31 | 沖電気工業株式会社 | 通信制御装置、通信制御方法及び通信制御プログラム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2011030811A1 (ja) | 2013-02-07 |
US20120174174A1 (en) | 2012-07-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2011030811A1 (ja) | 配信システム、ゲートウェイ、配信方法及びプログラム | |
KR102093618B1 (ko) | 미디어 데이터를 송수신하기 위한 인터페이스 장치 및 방법 | |
WO2011004886A1 (ja) | 配信システムと方法とゲートウェイ装置とプログラム | |
RU2510908C2 (ru) | Описание характеристик агрегированных блоков медиаданных с обратной совместимостью | |
WO2009128515A1 (ja) | ゲートウエイ装置と方法とプログラム | |
WO2009128528A1 (ja) | サーバ装置とコンテンツ配信方法とプログラム | |
WO2011049179A1 (ja) | 配信システム、ゲートウェイ、配信方法及びプログラム | |
KR101764317B1 (ko) | 스트리밍 서버, 스트리밍 시스템 및 스트리밍 방법 | |
WO2011010601A1 (ja) | ゲートウェイ装置、データ変換方法およびプログラム | |
WO2011049193A1 (ja) | 配信システム、ゲートウェイ、配信方法及びプログラム | |
WO2010140587A1 (ja) | ゲートウェイ装置と方法とシステム | |
JP2006166418A (ja) | 連続的なビデオディスプレイのためのビデオデータの送信方法及び受信方法 | |
US20120017249A1 (en) | Delivery system, delivery method, conversion apparatus, and program | |
WO2010035777A1 (ja) | 配信サーバ及び配信システムと方法並びにプログラム | |
Nightingale et al. | Video adaptation for consumer devices: opportunities and challenges offered by new standards | |
US20110188568A1 (en) | Server apparatus, communication method and program | |
JP5561278B2 (ja) | ゲートウェイ装置と方法と通信システム | |
KR101656193B1 (ko) | 이기종 망에서의 uhd 비디오 전송을 위한 mmt 기반 방송 시스템 및 방법 | |
US20110158322A1 (en) | SERVER APPARATUS, COMMUNICATION SYSTEM, AND COMMUNICATION METHOD, AND pROGRAM |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10815406 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13395116 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011530863 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10815406 Country of ref document: EP Kind code of ref document: A1 |