JP5338394B2 - VIDEO DISTRIBUTION SYSTEM, VIDEO DISTRIBUTION METHOD, VIDEO DISTRIBUTION DEVICE, AND VIDEO DISTRIBUTION PROGRAM - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To change video content quality and distribution bit rate adaptably to the video playback ability of a video receiver or a network band to perform distribution and to increase the number of simultaneously distributed video images. <P>SOLUTION: A basic layer signal storage portion 101, a first extension layer signal storage portion 102 and a second extension layer signal storage portion 103 store a basic layer signal, a first extension layer signal and a second extension layer signal obtained by hierarchically encoding video content. A distribution layer determination portion 109 determines the layer configuration of the video content to be distributed to the video receiver and also provides the function of reading a stream configuring a basic layer and an extension layer and instructing the multiplexing. By the determination by the distribution layer determination portion 109, the content of the optimum image quality is distributed to the video receiver in consideration of the video playback ability of the video receiver. A multiplexing portion 110 synchronizes and combines the respective separated layer signals. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a video distribution system, a video distribution method, a video distribution apparatus, and a video distribution program, and in particular, a video distribution system, a video distribution method, a video distribution apparatus, and a video distribution suitable for a video distribution service for a plurality of types of terminals. Regarding the program.

  In recent years, network connection environments that can be used in ordinary homes have become possible to use high-speed and high-quality network services such as FTTH (Fiber To The Home) and NGN (Next Generation Network). VOD (Video on Demand) is a service that can be provided by this high-speed network service. In recent years, the communication speed of mobile phone networks has been increasing, and video distribution services using mobile phones have begun.

  In order to realize a video distribution service for various terminals, a video distribution system needs to have a capability for a video distribution server to change video content in accordance with the type of terminal. The video distribution system described in Patent Document 1 stores content files obtained by hierarchically encoding images according to resolution using JPEG2000 (Joint Photographic Experts Group 2000) and storing the content files, and request resolutions and requests included in content requests from terminals. In accordance with the image range, data for generating an image with the requested resolution is read from the content file, converted into a one-layer image as necessary, and sent to the terminal. As a result, the video distribution system described in Patent Document 1 enables browsing of high-quality video data even in a terminal in which restrictions are imposed on the terminal capability.

  The video distribution system described in Patent Document 2 receives terrestrial TV broadcasts, satellite broadcasts, and the like, hierarchically encodes them, encodes and stores them in a plurality of layers, and distributes them according to the network bandwidth between the distribution server and the terminal. Change the hierarchy. As a result, this video distribution system reduces the processor load and the video distribution delay as compared with the method of converting to a video adapted to the usable network bandwidth after receiving a distribution request.

  Further, Patent Document 3 hierarchically separates a first video stream into m second video streams and distributes the second video stream using a first multicast channel, and the first Receiving a second video stream by using a multicast channel of the same, a gateway for integrating and delivering the third video stream to each of n user terminals, and one third video stream A video distribution system including a user terminal that receives, decodes, and displays the video is disclosed. According to the video distribution system described in Patent Document 3, even a user terminal having a low processing capability such as a portable terminal can display a video stream distributed on the Internet.

  Patent Document 4 discloses that a transmission device divides a hierarchically encoded video stream according to quality or quality and band, transmits the video stream in different channels, groups channels according to quality, and transmits a list thereof. The video distribution system is configured such that each receiving terminal can select and receive video reception quality.

  Further, Patent Document 5 calculates the reception state of hierarchical content data in the receiving device, sends the result in feedback by RTCP, and the control device receives it and within the available throughput from the data reception information for each user. Discloses a video distribution system configured to determine the number of transfer layers that fall within the range.

JP 2006-339972 A Special table 2008-523688 gazette JP 2001-352533 A JP 2004-266503 A JP 2006-246242 A

  However, in the video distribution system described in Patent Document 1, in order to acquire hierarchical data for generating an image with a requested resolution, the entire JPEG2000 file is processed in order to perform data structure analysis and data extraction processing. Must be transferred to memory. For this reason, the amount of transmission data between memory disks increases regardless of the size of image data requested by the terminal.

  Further, in the video distribution system described in Patent Document 2, since all hierarchical data is stored in a single hard disk, when performing a process of distributing a plurality of hierarchical data to a terminal, a plurality of hierarchical data In order to read data alternately, a head seek process between hierarchical data is required, and the throughput of the hard disk is reduced and the video distribution performance is lowered.

  Further, in the video distribution system described in Patent Document 3, the user management function is only for management of distribution destination information and integration target layers for each user, and the same content is arranged in a plurality of storages for load distribution. It is not applicable in such cases. This is because management of content position information is necessary.

  In addition, since the video distribution system described in Patent Document 4 performs layer transmission by multicast or other methods, there is a possibility that the transmission delay between channels varies. In order to absorb the transmission delay, in the video distribution system described in Patent Document 4, it is necessary to implement processing for synchronizing packets between layers before decoding in the client (receiving terminal).

  Furthermore, since the video distribution system described in Patent Document 5 uses hierarchical multicast, it is necessary to perform a plurality of reception processes on the client (reception device) side, which increases necessary resources. Further, in the video distribution system described in Patent Document 5, it is assumed that the reception state of the hierarchical content data is calculated in the reception device, and the result is fed back to the control device by RTCP. As a result, the distribution image quality cannot be determined at the start of reproduction.

  The present invention has been made in view of the above points. It can be distributed by changing the video content quality and the distribution bit rate in accordance with the video reproduction capability or network bandwidth of the video receiving apparatus, and the number of simultaneously distributed videos can be reduced. An object is to provide a video distribution system, a video distribution method, a video distribution apparatus, and a video distribution program that can be improved.

In order to achieve the above object, a video distribution system of the present invention includes a video distribution device that distributes video content that is hierarchically encoded into a basic signal and one or more extended signals, and a video that is distributed from the video distribution device. A video receiving device for receiving content via a network,
The video distribution apparatus includes a basic signal storage unit that stores a basic signal and one or more extension signal storage units that separately store one or more layers of extension signals in units of layers. A signal storage means for outputting a basic signal and an extended signal independently from each other from a part or all of the unit, identification of the basic signal storage unit and the extended signal storage unit, and identification of the basic signal and the extended signal in units of video content Layer arrangement information storage means for holding an identifier for performing, and terminal capability acquisition means for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability, and receivable bit rate of the video reception device from the video reception device When, according to the obtained terminal capability information by the terminal capability acquiring unit, to determine the layer structure of a video Kontetsu to be distributed to the video receiving device, or the layer arrangement information storing means A distribution layer determination means for instructing the reading of the storage unit for storing signals which are necessary to obtain a determined layer structure of the basic signal storage unit of the receiving and signal storage means to provide identifiers and extension signal storage unit, signal storage Multiplexed signals generating means for generating a multiplexed signal by multiplexing the signals required for obtaining the determined layer configuration read out from the means according to the instructions of the distribution layer determining means, according to the instructions of the distribution layer determining means, and multiplexing Transmission means for transmitting the digitized signal to the network for distribution,
The video receiving apparatus includes receiving means for receiving a multiplexed signal transmitted from a distribution apparatus via a network, and decoding means for decoding the multiplexed signal received by the receiving means.

In order to achieve the above object, a video distribution method of the present invention is a video distribution method for distributing video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video receiving device via a network. Then, the terminal capability information acquisition step for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device, and according to the terminal capability information , Determine the layer structure of the video content to be distributed to the video receiver, and determine the basic signal storage unit for storing the basic signal and one or more extended signal storage units for separately storing one or more layers of extension signals in units of layers. When reading out the storage unit that stores the signals necessary for the layer configuration, the basic signal storage unit and the extended signal storage unit Read out of the identification from the storage unit and the delivery layer determination step of instructing receiving a supply of the identifier from the layer arrangement information storing means, for reading the distribution layer determination step is instructed to hold the identifier for performing the video content unit A multiplexed signal generating step for generating a multiplexed signal by multiplexing the signals necessary to obtain the determined layer configuration according to the layer configuration determined in the distribution layer determining step, and for distributing the multiplexed signal And a transmission step of transmitting to the video reception device via the network.

In order to achieve the above object, a video distribution apparatus according to the present invention distributes video content hierarchically encoded into a basic signal and one or more extended signals to a video receiving apparatus via a network. A basic signal storage unit for storing a basic signal and one or more extended signal storage units for separately storing one or more layers of extension signals in units of layers, the basic signal storage unit and the extension signal storage unit A signal storage means for outputting a basic signal and an extended signal independently from part or all of the video signal, identification of the basic signal storage unit and the extended signal storage unit, and identification of the basic signal and the extended signal are performed in units of video content. A layer arrangement information storage means for holding an identifier for the terminal, and a terminal including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device A terminal capability obtaining means for obtaining the force information, according to the obtained terminal capability information by the terminal capability acquiring unit, to determine the layer structure of a video Kontetsu to be distributed to the video receiving apparatus, the provision of identifiers from the layer arrangement information storing means receiving a distribution layer determination means for instructing the reading of the storage unit for storing signals which are necessary to obtain a layer structure determined of the basic signal storage unit and the extension signal storage unit of the signal storage means, the delivery layer from the signal storage means Multiplexed signal generating means for generating a multiplexed signal by multiplexing the signals necessary for the determined layer configuration read by the determining means instruction according to the instruction of the distribution layer determining means, and distributing the multiplexed signal And transmitting means for transmitting to the network.

Furthermore, in order to achieve the above object, the video distribution program of the present invention performs video distribution for distributing video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video receiving device via a network. A terminal distribution information acquisition step for acquiring terminal capability information including a maximum resolution, a maximum frame rate, a decoding capability, and a receivable bit rate of the video receiving device from the video receiving device, which is a video distribution program executed by a computer; According to the terminal capability information , the layer structure of the video content to be distributed to the video receiving device is determined, and the basic signal storage unit for storing the basic signal and one or more extensions for separately storing one or more extended signals in units of layers Among the signal storage units, the basic signal storage is read out from the storage unit that stores the signals necessary for the determined layer configuration. Parts and the identification of the extension signal storage unit, a distribution layer determination step of instructing receiving a supply from the layer arrangement information storing means for storing an identifier for performing an identification of the basic signal and the extended signal in the video content unit identifier, Multiplexed signals necessary for the determined layer configuration read from the storage unit instructed to be read in the distribution layer determination step according to the layer configuration determined in the distribution layer determination step to generate a multiplexed signal And a transmission step of transmitting the multiplexed signal to the video receiving device via a network for distribution by a computer.

  According to the present invention, the quality of the distribution content and the distribution bit rate are changed according to the video reproduction capability of the video reception apparatus that distributes the video content or according to the usable network bandwidth, and the video reception apparatus is realized. It is possible to distribute the highest quality video content that can be decoded by the Internet, and without overloading the network. In addition, according to the present invention, it is possible to reduce the total amount of data from the signal storage unit to the multiplexing unit in the video distribution apparatus and to improve the number of simultaneous video distributions.

1 is a block diagram of a first embodiment of a video distribution system of the present invention. It is a block diagram which shows the structure of 1st Embodiment of the video delivery apparatus of this invention. It is a block diagram which shows the structure of 1st Embodiment of the video receiver of this invention. It is a figure which shows an example of the video content information of the 1st Embodiment of this invention. It is a figure which shows an example of the video content storage information which the layer arrangement information storage part 107 in FIG. 1 has memorize | stored. It is a block diagram of an example of an internal structure of the multiplexing part 110 in FIG. It is a figure which shows an example of a process of the layer synchronization means 604 in FIG. It is a figure which shows an example of a process of the layer combination means 605 in FIG. It is explanatory drawing of an example of a process of the depacketizing part 202 in FIG. It is a figure which shows an example of the terminal video reproduction capability information which the video receiver of the 1st Embodiment of this invention hold | maintains. It is a figure which shows an example of the terminal capability information notification of the 1st Embodiment of this invention. It is a figure which shows an example of the effect of the 1st Embodiment of this invention. It is a block diagram of the video delivery apparatus in 2nd Embodiment of the video delivery system of this invention. It is a figure which shows the process of the layer synchronization means 604 in Example 1 of this invention. It is a figure which shows the process of the layer combination means 605 in Example 1 of this invention. It is a figure which shows the process of the depacketizing means 202 in Example 1 of this invention.

  Next, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

(First embodiment)
In the video distribution system of the present embodiment, a video distribution apparatus that holds video content encoded by a scalable video codec receives a video distribution request from a video reception apparatus, analyzes the request and terminal capability, Based on the analysis result, the stream accumulated for each layer is read out in units of layers, multiplexed, and distributed to the video receiving apparatus.

  That is, in the video distribution system according to the present embodiment, the video distribution apparatus stores each layer signal of the hierarchically encoded video content as a content file, and transfers it by the terminal capability (video reproduction capability) of the video reception device. The number of layers to be determined is determined, only the content files corresponding to the determined number of layers are read out, and when the data of each layer is multiplexed, the packets constituting each layer are converted into time information included in the packets. It is the structure which combines and produces | generates a multiplexed signal and distributes to a video receiver.

  FIG. 1 shows a block diagram of a first embodiment of a video distribution system according to the present invention. The video distribution system 10 according to the present embodiment includes a video distribution device 100 that distributes video content and a video reception device 200 that receives and displays the video content, which are connected to each other via a network 300. .

  In the video distribution system 10, the video distribution apparatus 100 holding the video content encoded by the scalable video codec receives the video distribution request from the video receiving apparatus 200 through the network 300, analyzes the request and the terminal capability, Based on the analysis result, the streams accumulated for each layer are read out in units of layers, multiplexed, and distributed to the video receiving apparatus 200 through the network 300.

  In the present embodiment, the Internet is assumed as the network 300. However, the present invention is not limited to this, and NGN (Next Generation Network), wireless LAN (Local Area Network), mobile phone network, USB (Universal Serial Bus) A bus that connects devices such as a bus may be used. Further, although the video distribution apparatus 100 is assumed to be a PC server, it may be a hard disk recorder or the like. The video receiving apparatus 200 is assumed to be a television (TV) receiver that can be connected to a network. However, a mobile terminal, a PC (Personal Computer), an STB (Set Top Box), a PDA (Personal Digital Assistants), a game, etc. It may be a machine.

  Next, the configuration of the video distribution device 100 will be described. FIG. 2 shows a block diagram of the first embodiment of the video distribution apparatus according to the present invention. As shown in the figure, the video distribution apparatus 100 includes a base layer signal storage unit 101, a first enhancement layer signal storage unit 102, a second enhancement layer signal storage unit 103, a base layer signal acquisition unit 104, 1 enhancement layer signal acquisition unit 105, second enhancement layer signal acquisition unit 106, layer arrangement information storage unit 107, terminal capability acquisition unit 108, distribution layer determination unit 109, multiplexing unit 110, and packetizing unit 111 And the transmission unit 112. Each of these operates as follows. Here, for ease of explanation, the audio processing and error handling processing are omitted.

  In the present embodiment, the video content is composed of one or more layers as shown in the video content information 400 of FIG.

  4, the video content information 400 includes a video content 401 whose video content name is “NEWS”, a video content 402 whose video content name is “WEATHER”, and a video content 403 whose video content name is “MOVIE”. It consists of. Video contents 401 and 402 are each composed of a base layer and one enhancement layer (first enhancement layer), and video content 403 is composed of a base layer and two enhancement layers (first enhancement layer and second enhancement layer). It is configured.

  The video content 400 is set with a bit rate (encoding bit rate) in units of layers during encoding. Referring to FIG. 4, for example, video content 401 is encoded with an encoding bit rate of the base layer being 1 Mbps and an encoding bit rate of the first enhancement layer being 2 Mbps. In the video content 402, the encoding bit rate of the base layer is 3 Mbps, and the encoding bit rate of the first enhancement layer is 4 Mbps. In the video content 403, the encoding bit rate of the base layer is 3 Mbps, the encoding bit rate of the first enhancement layer is 4 Mbps, and the encoding bit rate of the second enhancement layer is 5 Mbps.

  In this embodiment, the video content is scalable video coding according to Recommendation H.264 Annex.G established by ITU-T (International Telecommunication Union-Telecommunication Standardization Sector). It is assumed that it is encoded by an encoder compliant with H.264 / SVC).

  However, the encoding type of the present invention is not limited to this embodiment. For example, ISO (International Organization for Standardization) and IEC (International Electrotechnical Commission) are jointly established. Other video scalable codecs such as a scalable profile of an encoding standard ISO / IEC 13818-2 (hereinafter referred to as MPEG2) or ISO / IEC 14496-2 (hereinafter referred to as MPEG4) may be used. Further, the content name, resolution setting, encoding bit rate, number of divisions of layers, and the like of the video content described above are examples, and other values may be used. Further, in the present embodiment, it is assumed that the video content constituting each layer is packetized in the ISO / IEC 13818-1 MPEG2-TS (Transport Stream) format and a different PID (Packet Identifier) is assigned to each layer. However, the present invention is not limited to this, and other packetization methods or elementary streams divided by layer without packetization may be used.

  The base layer is a lowermost stream constituting the video content. When decoding is performed on the base layer alone, a minimum video quality can be obtained. The first enhancement layer is a stream located above the base layer, and the first enhancement layer is decoded together with the base layer, so that an image quality higher than the result of decoding only the base layer can be obtained. Similarly, the second enhancement layer is a stream located above the first enhancement layer, and the second enhancement layer decodes the first enhancement layer and the base layer together, thereby allowing the first enhancement layer and the base layer to be decoded. It is possible to obtain an image quality that is higher than the result of decoding together.

  Returning again to FIG. The layer arrangement information storage unit 107 provides a function of storing information related to encoding, information on the number of divisions, video quality at the time of reproduction, bit rate for each layer, and the like for each video content. Further, the layer arrangement information storage unit 107 manages in which storage unit the layer-by-layer stream constituting the video content is arranged, and an identifier for accessing the layer-by-layer stream. The layer arrangement information storage unit 107 provides such information in response to a request from the distribution layer determination unit 109.

  FIG. 5 shows an example of the video content storage information 500 stored in the layer arrangement information storage unit 107. In the present embodiment, the layer-specific streams constituting the video content are filed and a file name is added. In FIG. 5, the video content storage information 500 includes video content arrangement information 501 having a video content name “NEWS”, video content arrangement information 502 having a video content name “WEATHER”, and a video content name “MOVIE”. Video content arrangement information 503.

  The video content arrangement information 501 whose video content name is “NEWS” is composed of two layers, and the file “NEWS_BASE.svc” in which the base layer is stored is placed in the base layer signal storage unit 101 and is decoded. The resolution is 320 pixels in the horizontal direction and 240 pixels in the vertical direction (hereinafter referred to as 320 × 240 pixels. The same applies to others), the frame rate is 30 frames per second, the encoding bit rate is 1 Mbps, and the PID assigned to the layer is “100 ". The file “NEWS_EXT1.svc” for storing the first enhancement layer is arranged in the first enhancement layer signal storage unit 102, the resolution at the time of decoding is 640 × 480 pixels, the frame rate is 30 frames per second, and the encoding bit rate is 2 Mbps. The PID assigned to the layer is “101”.

  The video content arrangement information 502 whose video content name is “WEATHER” is that the video content is composed of two layers, and the file “WEATHER_BASE.svc” storing the base layer is arranged in the base layer signal storage unit 101, The resolution at the time of decoding is 640 × 360 pixels, the frame rate is 30 frames per second, the encoding bit rate is 3 Mbps, and the PID assigned to the layer is “200”. The file “WEATHER_EXT1.svc” for storing the first enhancement layer is arranged in the first enhancement layer signal storage unit 102, the resolution at the time of decoding is 1280 × 720 pixels, the frame rate is 30 frames per second, the encoding bit rate is 4 Mbps, the layer This indicates that the PID assigned to is “201”.

  Similarly, in the video content arrangement information 503 whose video content name is “MOVIE”, the video content is composed of three layers, and the file “MOVIE_BASE.svc” storing the base layer is arranged in the base layer signal storage unit 101. The decoding resolution is 640 × 360 pixels, the frame rate is 30 frames per second, the encoding bit rate is 3 Mbps, and the PID assigned to the layer is “300”. The file “MOVIE_EXT1.svc” for storing the first enhancement layer is arranged in the first enhancement layer signal storage unit 102, the resolution at the time of decoding is 1280 × 720 pixels, the frame rate is 30 frames per second, the encoding bit rate is 4 Mbps, The PID assigned to the layer is “301”. The file “MOVIE_EXT2.svc” for storing the second enhancement layer is arranged in the second enhancement layer signal storage unit 103, the resolution at the time of decoding is 1920 × 1080 pixels, the frame rate is 30 frames per second, the encoding bit rate is 5 Mbps, the layer This indicates that the PID assigned to is “302”.

  The base layer signal storage unit 101 is a storage medium that stores a stream for each layer. The base layer signal storage unit 101 stores a base layer extracted from video content encoded by an encoder compliant with H.264 / SVC. Similarly, the first enhancement layer signal storage unit 102 is a storage medium that stores a first enhancement layer extracted from video content encoded by an encoder compliant with H.264 / SVC. The second enhancement layer signal storage unit 103 is a storage medium that stores a second enhancement layer extracted from video content encoded by an encoder compliant with H.264 / SVC.

  As shown in FIG. 2, each storage medium is a storage medium 121 in the base layer signal storage unit 101, a storage medium 122 in the first enhancement layer signal storage unit 102, and a storage medium 123 in the second enhancement layer signal storage unit 103. As independent. These storage media 121 to 123 can perform stream read processing in parallel.

  In the present embodiment, it is assumed that three independent hard disk drives are used as storage media. In each storage medium, each layer is stored on the medium as a file. The data sequence constituting the stream is arranged in a continuous physical sector or address, and the data organization that can maximize the read rate at the time of distribution by reducing the occurrence frequency of the head seek process and the page table change process. In this embodiment, since the video content is composed of a maximum of three layers, three hard disks are used for each layer. In the present embodiment, the storage medium is arranged inside the video distribution apparatus 100 as shown in FIG.

  The present invention is not limited to this, and the number of layer signal storage units and layer signal acquisition units is four or more, and files that are not accessed simultaneously during distribution are arranged on the same disk regardless of the layers. It may be configured, or a part or all of it may be arranged on an SSD (Solid State Drive) or RAM (Random Access Memory). Further, the storage medium may be stored not in the video distribution device 100 but in a storage device independent of the video distribution device 100, and each storage device and the video distribution device 100 may be connected via a cable or a network.

  The base layer signal acquisition unit 104 provides a function of reading the base layer data constituting the video content from the stored base layer signal storage unit 101. When the base layer signal acquisition unit 104 is instructed by the distribution layer determination unit 109 about the file name or identifier to be read, the base layer signal acquisition unit 104 performs reading from the layer file and sends the stream to the multiplexing unit 110.

  Similarly, the first enhancement layer signal acquisition unit 105 provides a function of reading the first enhancement layer data constituting the video content from the accumulated first enhancement layer signal storage unit 102. The second enhancement layer signal acquisition unit 106 provides a function of reading data of the second enhancement layer constituting the video content from the accumulated second enhancement layer signal storage unit 103. When the file name or identifier to be read is instructed from the distribution layer determination unit 109, the first enhancement layer signal acquisition unit 105 and the second enhancement layer signal acquisition unit 106 respectively read out from the target layer file. The stream is transmitted to the multiplexing unit 110.

  The layer signal acquisition units 104 to 106 operate in parallel, and the operation of one layer signal acquisition unit does not affect the operation of other layer signal acquisition units. In the present embodiment, the layer signal acquisition units 104 to 106 are assumed to be independent disk controllers connected to three hard disk drives. However, the present invention is not limited to this, and a plurality of processors may access the memory.

  The terminal capability acquisition unit 108 provides a function of acquiring the video playback capability of the video receiving device 200 connected to the network 300.

  The distribution layer determination unit 109 determines a layer configuration of video content to be distributed to the video reception device 200, and provides a function of instructing to read and multiplex the streams constituting the base layer and the enhancement layer. By the determination of the distribution layer determination unit 109, it is possible to distribute the content having the optimum image quality to the video reception device 200 in accordance with the video reproduction capability of the video reception device 200.

  Here, the processes of the layer arrangement information storage unit 107, the terminal capability acquisition unit 108, and the distribution layer determination unit 109 will be described with examples.

  Assume that the video receiving apparatus 200 is capable of decoding H.264 / SVC, the maximum displayable video is 1920 × 1080, 30 frames per second, and the receivable bit rate is 20 Mbps. When this video reception device 200 requests distribution of video content with the video content name “MOVIE”, a terminal capability notification message 1101 shown in FIG. 11 is sent from a terminal capability notification unit 206 (to be described later) in the video reception device 200 to FIG. And it notifies to the terminal capability acquisition part 108 shown in FIG. The terminal capability acquisition unit 108 can receive from the terminal capability notification message 1101 that the video receiving device 20 has the decoding capability of the H.264 codec, the maximum displayable resolution is 1920 × 1080, and the maximum frame rate is 30 frames per second. The terminal capability information of the video receiving apparatus 200 that the bit rate is 20 Mbps is acquired.

  As described above, the distribution layer determination unit 109 acquires the terminal capability information of the codec type supported by the video reception device 200, the displayable content resolution and frame rate, and the receivable bit rate from the terminal capability acquisition unit 108 as described above. Subsequently, the distribution layer determination unit 109 acquires the video content arrangement information 503 that is the distribution information of the video content name “MOVIE” from the layer arrangement information storage unit 107. Thereby, the delivery layer determination unit 109 can deliver the enhancement layer because the video reception device 200 can decode the H.264 / SVC based on the terminal capability information from the terminal capability acquisition unit 108. to decide.

  Subsequently, the distribution layer determining unit 109 obtains 1920 × 1080 video from the video content arrangement information 503 by decoding the second enhancement layer, the frame rate at the time of reproduction is 30 fps, and the bit rate at the time of distribution. Is determined to be 12 Mbps, which is the total value of the bit rates of each layer, and the terminal capability (video reproduction capability) of the acquired video receiving device 200 is not exceeded, and the basic layer of the content A decision is made to distribute the first enhancement layer and the second enhancement layer.

  The terminal capability acquisition unit 108 acquires the determination result of the distribution layer determination unit 109, and notifies the terminal capability notification unit 206 in the video reception device 200 described later as a distribution content notification message 1102 shown in FIG. This distribution content notification message 1102 includes the resolution, frame rate, and distribution bit rate of the video content to be distributed.

  Subsequently, the distribution layer determining unit 109 sets the base layer of the video content name “MOVIE” as the file name “MOVIE_BASE.svc” in the base layer signal storage unit 101 from the video content arrangement information 503 and the first extension layer as the first extension. It can be seen that the file name “MOVIE_EXT1.svc” is stored in the layer signal storage unit 102 and the second extension layer is stored in the second extension layer signal storage unit 103 as the file name “MOVIE_EXT2.svc”.

  Accordingly, the distribution layer determination unit 109 instructs the base layer signal acquisition unit 104 to read the file name “MOVIE_BASE.svc”, and instructs the first enhancement layer signal acquisition unit 105 to read the file name “MOVIE_EXT1.svc”. Is read, and the second enhancement layer signal acquisition unit 106 is instructed to read the file name “MOVIE_EXT2.svc”.

  Subsequently, the distribution layer determining unit 109 instructs the multiplexing unit 110 to multiplex the base layer signal, the first enhancement layer signal, and the second enhancement layer signal. Also, the distribution layer determination unit 109 notifies the multiplexing unit 110 of information regarding which layer the PID of the input stream corresponds to.

  With the above processing, when distributing the requested video content, the preparation of reading and multiplexing of the layers constituting the video of quality not exceeding the terminal capability of the video receiving device 200 is completed.

  The multiplexing unit 110 provides a multiplexing function necessary for transmitting the layer signal read by each of the layer signal acquisition units 104 to 106 to the video reception device 200. The multiplexing unit 110 performs a process of combining the separated layer signals in synchronization and converting them into a format that can be reproduced by the video reception device 200.

  FIG. 6 is a block diagram illustrating an example of an internal configuration of the multiplexing unit 110. As shown in the figure, the multiplexing unit 110 includes a base layer buffering means 601, a first enhancement layer buffering means 602, a second enhancement layer buffering means 603, a layer synchronization means 604, a layer combining means 605, additional information. A packet insertion unit 606 and a transmission unit 607 are included. The multiplexing unit 110 receives the identification information (identification information 821 in FIG. 8 described later) corresponding to which layer the PID of the input stream supplied from the distribution layer determination unit 109 corresponds to the layer combining unit 605. The

  The base layer buffering means 601 is a means for buffering the layer signal read by the base layer signal acquisition unit 104 in FIG. Similarly, the first enhancement layer buffering means 602 uses the layer signal read out by the first enhancement layer signal acquisition section 105 in FIG. 2, and the second enhancement layer buffering means 603 uses the second enhancement layer signal acquisition section in FIG. Reference numeral 106 denotes a means for buffering the read layer signal.

  FIG. 7 shows an example of processing of the layer synchronization means 604 in FIG. As shown in FIG. 7, the base layer buffering means 601 buffers the layer signal 701, the layer signal 702, the layer signal 703, and the layer signal 704. Similarly, the first enhancement layer buffering means buffers layer signal 711, layer signal 712, and layer signal 713, and the second enhancement layer buffering means 603 buffers layer signal 721, layer signal 722, and layer signal 723. It's ringing. Each of the layer buffering units 601 to 603 performs processing for transmitting a layer signal in response to a request from the layer synchronization unit 604.

  The layer synchronization means 604 is a means for extracting a layer signal constituting the same picture or slice from the layer signals stored in the respective layer buffering means 601 to 603. The layer synchronization means 604 acquires the added time information from the layer signals buffered in the layer signal buffering means 601 to 603. Thereafter, layer signals having the same time information are obtained from the respective layer signal buffering means 601 to 603.

  That is, as shown in FIG. 7, the layer synchronization means 604 converts the layer signal sequence 701 having time information t1 out of the layer signals buffered in the base layer buffering means 601 into the first enhancement layer buffering means 602. Layer signal sequence 711 having time information t1 among the layer signals buffered in, and layer signal having time information t1 among the layer signals buffered in the second enhancement layer buffering means 603 Get column 712. The layer synchronization unit 604 sends the layer signal sequence group 731 having the same time information t 1 to the layer combination unit 605. After the transmission, the layer synchronization means 604 performs the acquisition process of the layer signal sequence having the next time information t2.

  The layer combining unit 605 is a unit that combines the layer signal groups constituting the same picture or slice acquired by the layer synchronization unit 604. For example, in the case of H.264 / SVC content, at the time of decoding, the stream needs to be arranged in order from the base layer to the upper enhancement layer. In this way, processing for combining the information of each layer is performed according to the data arrangement pattern required at the time of decoding.

  FIG. 8 is an explanatory diagram of an example of the combining process of the layer combining unit 605. As shown in FIG. 8, the layer combining unit 605 acquires the type of layer signal and identification information 821 for identifying the layer from the distribution layer determining unit 109 in advance. The layer combining unit 605 acquires the layer signal identification information of the layer signal group 801 having the same time information t1 acquired from the layer synchronization unit 604. In FIG. 8, since the layer signal 811 has the identifier A, the layer signal 812 has the identifier B, and the layer signal 813 has the identifier C, the layer signal 811 is the basic layer signal from the information of the identification information 821, and the layer signal 812 Is the first enhancement layer signal, and the layer signal 813 is the second enhancement layer signal.

  Subsequently, the layer combining unit 605 obtains arrangement order information indicating how the layers are to be combined from the identification information 821 and performs a combining process. The layer signal 811 obtained as a result of the combination is sent to the sending means 607.

  Returning again to FIG. The additional information packet inserting unit 606 is a unit that adds necessary information to the signal by performing multiplexing. This information is periodically inserted into or between layer signals, or inserted before a specific layer signal such as a layer signal corresponding to a key frame. The additional information packet inserting unit 606 can notify the video receiving terminal 200 of layer configuration and combination information.

  In this embodiment, the additional information packet insertion unit 606 periodically inserts PSI (Program Specific Information) describing content information of an MPEG2-TS stream such as a PAT (Program Association Table) or a PMT (Program Map Table). Means. The additional information packet insertion means 606 can notify the video receiving apparatus 200 of the H.264 / SVC layer configuration information (SVC extension descriptor, etc.).

  The sending means 607 is a means for sending a signal completed as a result of the processing of the layer combining means 605 and the additional information packet inserting means 606 to the packetizing unit 111 in FIG.

  By the above means, it is possible to multiplex the layer signals read by the layer signal acquisition units 104 to 106.

  Returning again to FIG. The packetizing unit 111 provides a packetizing function necessary for sending the layer signal multiplexed by the multiplexing unit 110 to the network 300. In this embodiment, as a packetization format, an IETF RFC2250 RTP (Real-Time) standardized by the Internet Engineering Task Force (IETF) that transmits ISO / IEC 13818-1 MPEG2-TS format packets is used. time Transport Protocol) packetization format ("RTP Payload Format for MPEG1 / MPEG2 Video") but IETF draft-ietf-avt-rtp-svc-08 packetization format ("RTP Other formats such as Payload Format for SVC Video ”) may be used.

  The transmission unit 112 provides a function of transmitting a packet to the network 300. In this embodiment, processing for transmitting a UDP / IP format packet via a network interface card is performed, but other network devices and packet formats may be used.

  In the present embodiment, the video distribution apparatus 100 has been described as the operation of automatically distributing the highest quality video content among the video qualities supported by the video reception apparatus 200. For example, it is possible to allow the user to select from reproducible video quality. Alternatively, video distribution that is not the highest quality may be automatically selected according to the load state of the video receiving device 200 or the like. In this embodiment, the terminal capability value is described directly in the terminal capability notification message 1101. However, the terminal capability notification message includes only the ID indicating the terminal type, and the terminal capability acquisition unit 108 includes a database, You may acquire a terminal capability value from ID which shows a classification.

  In this embodiment, the layer synchronization unit 604 performs synchronization of the layer signal based on the same time information. However, the layer synchronization unit 604 is not limited to the time information, but other information such as a sequence number added to the layer signal. May be. In the above embodiment, layer signals are synchronized in units of the same picture or slice. However, synchronization may be performed in units of a plurality of pictures or slices by giving a range of synchronization accuracy. In that case, even the depacketizing unit of the video receiving terminal 200 can realize accurate synchronization by performing layer synchronization processing based on time information.

  Further, in the present embodiment, the layer combining unit 605 in the multiplexing unit 110 illustrated in FIG. 6 performs the combining process based on the arrangement order of the identification information 821 in FIG. It is assumed that it will be placed or instructed. However, the present invention is not limited to this, and the processing may be performed in a predetermined combination order without using an arrangement instruction. Further, the layer to which each layer signal belongs is determined based on the identifier of the identification information 821, but the layer signal is output from the layer signal buffering means that has output the layer signal without using this identifier. The type of the layer signal may be determined.

  Next, the configuration of the video reception device 200 shown in FIG. 1 will be described. FIG. 3 is a block diagram of the first embodiment of the video reception device 200. As shown in FIG. 3, the video receiving apparatus 200 of the present embodiment includes a receiving unit 201, a depacketizing unit 202, a decoding unit 203, a display unit 204, a terminal capability management unit 205, and a terminal capability notification unit 206. Consists of.

  These operations will be described below. In the following, for ease of explanation, the audio data processing and error processing are omitted. In the present embodiment, the video receiving device 200 notifies the terminal capability (video playback capability) of the video receiving terminal 200 when requesting the distribution of the video content, and receives the distribution of the decodable video content from the video distribution device 200. Perform playback processing.

  In FIG. 3, the terminal capability management unit 205 holds a capability value related to video playback of the video receiving device 200. In the present embodiment, the terminal capability management unit 205 holds video playback capability information 1000 shown in FIG. 10 as terminal capability information. The video playback capability information 1000 includes a codec type 1001, a maximum display resolution 1002, a maximum display frame rate 1003, and a receivable maximum reception bit rate 1004 as capability values related to video playback and reception.

  Here, the codec type 1001 is the type of codec supported by the decoding unit 203 of the video receiving apparatus 200, and the capability values thereof are, for example, H.264 / SVC and H.264 as shown in FIG. The maximum display resolution 1002 and the maximum display frame rate are the maximum display resolution and the maximum display frame rate that can be displayed by the display unit 204. Here, as shown in FIG. 10, the capability value of the maximum display resolution 1002 is 1920 pixels in the horizontal direction, 1080 pixels (1920 × 1080) in the vertical direction, and the capability value of the maximum display frame rate 1003 is 30 fps. The maximum reception bit rate 1004 is the maximum reception bit rate that can be received by the reception unit 201. Here, as shown in FIG. 10, the capability value is 20 Mbps.

  Note that the video playback capability information held by the terminal capability management unit 205 is not limited to the example in FIG. 10, and each information 1001 to 1004 in FIG. 10 may include other information. This video reproduction capability information 1000 is provided in response to a request from the terminal capability notification unit 206.

  When the video reception device 200 requests video distribution, the terminal capability notification unit 206 shown in FIG. 3 acquires the video playback capability information 1000 of the video reception device 200 from the terminal capability management unit 205, and notifies the terminal capability notification The video distribution apparatus 100 is notified as a message. In this embodiment, as described with reference to FIG. 11, this terminal capability notification message is a message independent of a content request (not shown) from the terminal capability notification unit 206 to the terminal capability acquisition unit 108 in the video distribution device 100. It is assumed that a message is notified to.

  This notification makes it possible to request the video distribution apparatus 100 to distribute the video content corresponding to the video reception apparatus 200. Further, the terminal capability notification unit 206 acquires the distribution content notification message 1102 from the terminal capability acquisition unit 108 as described with reference to FIG. 11, and confirms that the request has been recognized.

  The notification method of the terminal capability notification message and the format included in the terminal capability notification message are examples, and other methods may be used. For example, it may be included as a message in a distribution control protocol such as the IETF RFC2326 protocol (“Real Time Streaming Protocol”), or may be described in the IETF RFC4566 protocol (“Session Description Protocol”) and notified.

  The receiving unit 201 provides a function of receiving a video packet sent from the sending unit 112 in the video distribution apparatus 100 via the network 300. In the present embodiment, it is assumed that processing for receiving a UDP / IP format packet via a network interface card is performed. However, the present invention is not limited to this, and other network devices and packet formats may be used.

  The depacketizing unit 202 is a unit that analyzes the video packet received by the receiving unit 201, acquires video data to be decoded, and converts the video data into a format that can be decoded. FIG. 9 shows processing of the depacketizing unit 202. In the present embodiment, the depacketizing unit 202 acquires the payload from the packet received by the receiving unit 201 and performs a process of changing to a data format that can be decoded by the decoding unit 203.

  In FIG. 9, the depacketizing unit 202 temporarily buffers a packet to be transmitted in the packet buffer 901. Subsequently, the depacketizing unit 202 acquires time information of the packets stored in the packet buffer 901, and collects the packets in logical units that form the same picture or slice. In the example of FIG. 9, the acquired packets are grouped as a packet group 911, a packet group 912, a packet group 913, and a packet group 914.

  Subsequently, the depacketizing unit 202 extracts payloads as a payload 921, a payload 922, a payload 923, and a payload 924 from each of the packet groups 911 to 914. Next, the depacketizing unit 202 acquires time information of each of the payloads 921 to 924, recognizes the payload having the same time information as the payload constituting the same picture, and combines them as picture data 931 and picture data 932 To do. Then, the depacketizing unit 202 adds time information to the combined picture data 931 and 932, and sends it to the decoding unit 203.

  In the present embodiment, it is assumed that the depacketizing unit 202 acquires data in units of PES and acquires elementary streams in units of pictures from MPEG2-TS format packets stored in RTP packets. However, the present invention is not limited to this, and is effective even in other formats such as a packetizing method in which an elementary stream is directly stored in an RTP packet.

  Returning to FIG. The decoding unit 203 provides a function of acquiring bitmap data by decoding the obtained elementary stream for one picture using a video codec provided therein. Time information is added to the input elementary stream. The decoding unit 203 sends the bitmap data obtained by decoding to the display unit 204 together with the time information added to the elementary stream. In the present embodiment, it is assumed that the time information added to the bitmap data uses the time information added to the elementary stream. However, the present invention is not limited to this, and the decoding unit 203 may use new time information obtained from the video codec as a result of decoding.

  The display unit 204 provides a function of displaying bitmap data. The display unit 204 compares the time information added to the bitmap data acquired from the decoding unit 203 with the clock value provided in the display unit 204, and indicates the timing when the clock value becomes equal to the time information. It is determined that the time should be displayed, and the bitmap data is displayed on a screen provided in the display unit 204. In the present embodiment, it is assumed that the display unit 204 includes a screen such as a liquid crystal monitor, but the display unit 204 may be output means to an external video display device such as an HDMI output terminal.

  Next, the effect of this embodiment will be described. In the present embodiment, the video reception device 200 is configured to notify the video distribution device 100 of the terminal capability (video reproduction capability) via the network 300 and change the distribution layer according to the terminal capability. You can always receive the highest quality video stream that can be decoded. In addition, the synchronization processing in the video reception device 200 can be made unnecessary while the configuration in which the video reception device 200 can receive one stream is maintained.

  Further, since the video distribution apparatus 100 is configured such that the distribution layer determination unit 109 instructs to read out only necessary layer data from the independent layer signal storage units 101 to 103 for each layer data. The total data amount from the units 101 to 103 to the multiplexing unit 110 can be reduced. In addition, since layer signals are continuously arranged in each of the layer signal storage units 101 to 103, the occurrence frequency of head seek and the like can be reduced and the access load can be reduced. Thereby, the video delivery apparatus 100 can improve the number of simultaneous video delivery.

  FIG. 12 is an explanatory diagram showing that the number of distributions can be improved at the time of video distribution from a plurality of video reception devices according to the present embodiment. In FIG. 12, three types of video receiving devices (640 × 360 video playback device, 1280 × 720 video playback device, 1920 × 1080 video playback device) distribute 100 video content to “MOVIE”. When required, a comparison of theoretical performance between the present embodiment and the existing method is shown.

  That is, as shown in FIG. 12A, for the video content “MOVIE”, there are 100 first video receivers with a required resolution of 640 × 360 and second video receivers with a required resolution of 1280 × 720. And 100 third video receivers with a required resolution of 1920 × 1080 request distribution at the same time, the bit rate per distribution of video content per unit is first, second, second Since the 3 video receiving devices are 3 Mbps, 7 Mbps, and 12 Mbps, respectively, the total distribution bit rates of the 100 first, second, and third video receiving devices are 300 Mbps, 700 Mbps, and 1200 Mbps, respectively.

  In the existing method, a content file with a bit rate of 12 Mbps including a layer with the highest image quality is read out, a necessary layer is extracted and distributed to a total of 300 video receivers. The amount is 3600 Mbps (= 300 × 12 Mbps) as shown in FIG. In this case, when three disks having a transfer capacity of 1000 Mbps are used in parallel, the maximum disk transfer performance is 3000 Mbps as shown in FIG. 12B, but the existing system still has a 600 Mbps ( = 3600Mbps-300Mbps) disk bandwidth is insufficient.

  In contrast, in this embodiment, a disk having a maximum disk transfer performance of 1000 Mbps is used for each of the layer signal storage units 101, 102, and 103 that stores the base layer file, the first enhancement layer file, and the second enhancement layer file, respectively. In this case, the total disk transfer performance is the same as that of the existing method, but the transfer request amount by disk and the free disk bandwidth are as shown in FIG.

  That is, in FIG. 12B, since the base layer file of this embodiment has a layer bit rate of 3 Mbps and is indispensable data for decoding, the transfer request amount for each disk requires 900 Mbps reading. (= 300 × 3Mbps) Required. In addition, since the first enhancement layer file of this embodiment has a layer bit rate of 4 Mbps and data required for reproduction with a required resolution of 1280 × 720 and 1920 × 1080, the transfer request amount for each disk is 200. 800 Mbps (= 200 × 4 Mbps) is required. Furthermore, since the second enhancement layer file of this embodiment has a layer bit rate of 5 Mbps and is data required only for reproduction with a required resolution of 1920 × 1080, the transfer request amount for each disk can be read as 100. Necessary 500 Mbps (= 100 × 5 Mbps) is required.

  Therefore, as shown in FIG. 12B, in this embodiment, a free bandwidth of 100 Mbps is provided on the disk storing the base layer file, which is essential data for decoding the video stream encoded by the hierarchical video codec. As a result, the number of distributions can be further improved as compared with the existing method. Note that according to the present embodiment, a free bandwidth of 200 Mbps is generated on the disk storing the first enhancement layer file and a free bandwidth of 500 Mbps is generated on the disk storing the second enhancement layer file. The number of data distributions of 1280 × 720 and 1920 × 1080 can also be improved.

  Note that this embodiment is a preferred embodiment of the present invention, and various modifications can be made without departing from the scope of the present invention. For example, the processing for realizing the functions of each device may be performed by causing each device to read and execute a program for realizing the functions of the video distribution device 100 and the video receiving device 200. Further, the program is transmitted to another computer system by a transmission wave through a CD-ROM or a magneto-optical disk as a computer-readable recording medium, or through the Internet or a telephone line as a transmission medium. Also good. In addition, it is also within the scope of the present invention that the functions of each device are realized by other devices collectively or the functions are distributed by additional devices.

(Second Embodiment)
Next, a configuration example of the second embodiment of the present invention will be described with reference to the drawings.

  The video distribution system according to the present embodiment is a stream in which a video distribution apparatus that stores video content encoded by a scalable video codec accumulates by layer according to the network available bandwidth between the video distribution apparatus and the video reception apparatus. Is read out in units of layers, multiplexed and distributed to the video receiver.

  That is, in the video distribution system of the present embodiment, the video distribution apparatus stores each layer signal of the hierarchically encoded video content as a content file, determines the number of layers to be transferred according to the network bandwidth, When only the content files corresponding to the determined number of layers are read out and the data of each layer is multiplexed, the packets constituting each layer are combined in accordance with the time information included in those packets and multiplexed signals Is generated and distributed to the video receiving apparatus.

  FIG. 13: shows the block diagram of the video delivery apparatus in 2nd Embodiment of the video delivery system which becomes this invention. In the figure, the same components as those in FIG. The video distribution system according to the present embodiment is configured to connect to the video reception apparatus 200 via the network 300 using the video distribution apparatus 1600 illustrated in FIG. 13 instead of the video distribution apparatus 100 illustrated in FIG.

  In FIG. 13, a video distribution apparatus 1600 differs from the video distribution apparatus 100 of the first embodiment in that a network (NW) usable bandwidth acquisition unit 1608 and a distribution layer determination unit 1609 are different from those in the first embodiment. This is the same as the embodiment.

  In FIG. 13, an NW available bandwidth acquisition unit 1608 provides a function of acquiring a network available bandwidth between the video distribution device 1600 and the video reception device 200. In this embodiment, it is assumed that the means for acquiring the available network bandwidth uses the measurement result of the network bandwidth by means not shown. However, the present invention is not limited to this, and the means for obtaining an available network bandwidth may be a network bandwidth requested to be secured by NGN or a method of specifying a numerical value via a user interface.

  The distribution layer determination unit 1609 determines the layer configuration of the video content to be distributed to the video reception device 200, and provides a function of instructing the reading of the streams constituting the base layer and the enhancement layer and the multiplexing thereof. The distribution layer determining unit 1609 determines that content having an optimal bit rate is distributed to the video receiving apparatus 200 in accordance with the available network bandwidth between the video distributing apparatus 1600 and the video receiving apparatus 200.

  Next, the processes of the layer arrangement information storage unit 107, the NW usable bandwidth acquisition unit 1608, and the distribution layer determination unit 1609 will be described with examples. Here, for ease of explanation, the audio processing and error handling processing are omitted.

  Assume that the available network bandwidth between the video distribution device 1600 and the video reception device 200 is 10 Mbps. At this time, when the video distribution device 1600 receives a distribution request for the video content “MOVIE” from the video reception device 200, the NW available bandwidth acquisition unit 1608 notifies the distribution layer determination unit 1609 of 10 Mbps as the available bandwidth. The

  From the notification of the available bandwidth from the NW available bandwidth acquisition unit 1608, the distribution layer determination unit 1609 knows that the maximum bit rate of content that can be sent to the video reception device 200 is 10 Mbps.

  Subsequently, the distribution layer determination unit 1609 acquires the video content arrangement information 503 having the video content name “MOVIE” in the video content storage information 500 illustrated in FIG. 5 stored in the layer arrangement information storage unit 107. .

  The distribution layer determination unit 1609 obtains a distribution bit rate of 12 Mbps in total by including the second enhancement layer from the video content arrangement information 503 shown in FIG. 5, and delivers 7 Mbps in total by distribution to the first enhancement layer. It turns out that it becomes a bit rate. From these things, the delivery layer determination part 1609 determines performing the delivery to the 1st enhancement layer which does not exceed 10 Mbps which is the maximum bit rate of the content which can be sent out.

  Subsequently, the distribution layer determination unit 1609 determines that the base layer of the video content with the video content name “MOVIE” from the video content arrangement information 503 is stored in the base layer signal storage unit 101 as the file name “MOVIE_BASE.svc”, and the first extension layer is It can be seen that the first extension layer signal storage unit 102 stores the file name “MOVIE_EXT1.svc”.

  Therefore, the distribution layer determination unit 1609 instructs the base layer signal acquisition unit 104 illustrated in FIG. 13 to read out the file name “MOVIE_BASE.svc” from the base layer signal storage unit 101, and the first enhancement layer signal acquisition unit 105 is instructed to read the file name “MOVIE_EXT1.svc” from the first enhancement layer signal storage unit 102.

  Subsequently, the distribution layer determination unit 1609 instructs the multiplexing unit 110 to multiplex the base layer signal and the first enhancement layer signal. The multiplexing unit 110 is notified of which layer the PID of the input stream corresponds to.

  Through the above processing, when distributing the requested video content, it is possible to realize layer reading and multiplexing processing at a bit rate that does not exceed the network usable bandwidth between the video distribution device 1600 and the video reception device 200.

  In the present embodiment, the operation of automatically distributing the highest quality video content in the network available band between the video distribution device 1600 and the video reception device 200 has been described. However, the present invention is not limited to this. For example, it is also possible for the user to make a selection by an operation on the video receiving apparatus 200 side or the like. Further, the present invention may automatically select video distribution that does not have the maximum bit rate that can be transmitted according to the load state of the video receiving device 200 or the like.

  In the above description of the present embodiment, the notification of the terminal capability between the video distribution device 1600 and the video receiving device 200 as described in the first embodiment and the layer selection process based on the capability are not described. It is also possible to implement together with these. Further, the available network bandwidth may be measured by the video receiving device 200 and notified as a capability value.

  Next, the effect of this embodiment will be described. In this embodiment, since the distribution layer is changed according to the bandwidth of the network between the video distribution device 1600 and the video reception device 200, the video reception is performed without imposing an excessive load on the network. Video can be distributed to the apparatus 200, and video disturbance due to occurrence of packet loss or the like can be prevented.

  In addition, in the video distribution apparatus 1600, each layer signal storage unit is arranged in an independent layer signal storage unit for each layer data, and the distribution layer determination unit 1609 instructs to read out only necessary layer data. To the multiplexing unit 110 can be reduced.

  Next, Example 1 will be described. Example 1 corresponds to the first embodiment of the present invention and relates to the multiplexing unit 110 and the depacketizing unit 202.

  The operation of the multiplexing unit 110 will be described with reference to specific examples in FIGS. In this embodiment, processing for combining the three layer data layered in the MPEG2-TS format based on the time information included in the MPEG2-TS is performed, but other packetizing methods supported by the video receiving apparatus 200 are also used. It is valid.

  Each layer of H.264 / SVC content packetized in the MPEG2-TS format is divided into units called PES (Packetized Elementary Stream) in units of pictures, and information called a PES header is added to the head. Time information called PTS or DTS is added to the PES header. The PTS and DTS indicate the time when the decoding result of the PES is displayed on the screen and the time when the PES is decoded by the decoder. The PES of each layer having the same value constitutes the same picture. Represents that.

  Each layer divided as PES is divided into fixed length MPEG2-TS packets. When the beginning of the PES is stored in the payload of the MPEG2-TS packet, “1” is set in a predetermined field (pay_load_unit_start_indicator) of the MPEG2-TS header.

  FIG. 14 shows an example of processing in which the layer synchronization means 604 synchronizes MPEG2-TS packets. In this embodiment, three layer data are read from each storage unit and buffered by the basic layer buffering means 601, the first enhancement layer buffering means 602, and the second enhancement layer buffering means 603.

  In FIG. 14, in the base layer buffering means 601, MPEG2-TS packets acquired from the file MOVIE_BASE.svc in which the base layer is stored are buffered. This TS packet holds a common PID = 300. Similarly, in the first enhancement layer buffering means 602, an MPEG2-TS packet having PID = 301 acquired from the file MOVIE_EXT1.svc storing the first enhancement layer is buffered, and the second enhancement layer buffering means In 603, an MPEG2-TS packet having PID = 302 acquired from the file MOVIE_EXT2.svc in which the first enhancement layer is stored is buffered.

  The layer synchronization unit 604 searches for an MPEG2-TS packet in which a predetermined field (pay_load_unit_start_indicator) of the buffered MPEG2-TS header is “1”. By this search, the MPEG2-TS packet storing the PES header can be identified, and the PES header can be acquired from the payload. In the base layer buffering means 601, the PES header 1301 and the PES header 1303 correspond to the PES header of the identified MPEG2-TS packet. In the first enhancement layer buffering means 602, the PES header 1311 and the PES header 1313 are added to the PES header of the MPEG2-TS packet in which the PES header 1321 and the PES header 1323 are identified. Applicable.

  The layer synchronization means 604 acquires PTS and DTS as time information from these PES headers. From the PES header 1301, time information 1301a is acquired. Similarly, the layer synchronization means 604 obtains time information 1303a from the PES header 1303, time information 1311a from the PES header 1311, time information 1313a from the PES header 1313, time information 1321a from the PES header 1321, and PES header. Time information 1323a is acquired from 1323, respectively.

  The layer synchronization means 604 searches for a PES header in which PTS and DTS match, which is time information between layers. In the example of FIG. 14, the PTS included in the time information 1301a, the time information 1311a, and the time information 1321a is “6000”, and the DTS is “0”. Also, no other PES header has the same PTS and DTS. Therefore, the layer synchronization means 604 extracts from each buffering means the MPEG2-TS packet including the PES header to the packet immediately before the MPEG2-TS packet including the PES header having different time information.

  In FIG. 14, the layer synchronization means 604 receives the MPEG2-TS packet group 1302 from the base layer buffering means 601, the MPEG2-TS packet group 1312 from the first enhancement layer buffering means 602, and the second enhancement layer buffering. The MPEG2-TS packet group 1322 is acquired from the means 603. The acquired MPEG2-TS packet groups 1302, 1312, and 1322 are sent to the layer combining unit 605.

  FIG. 15 shows an example of processing in which the layer combining means 605 combines MPEG2-TS packets. At the time of video distribution, the layer combination unit 605 acquires stream multiplexing information 1401 as information on layer multiplexing from the distribution layer determination unit 109. The stream multiplexing information 1401 includes the type of layer data and the PID of the MPEG2-TS stream as information for identifying the basic layer that is the basic signal and the first and second enhancement layers that are the extension signal, The arrangement order is described as identification information including the combination order information of each signal in the multiplexing process.

  The stream multiplexing information 1401 in FIG. 15 indicates that an MPEG2 stream with PID = 300 is input as a base layer, and that the base layer is arranged first in the combining process. Similarly, it is instructed to place the MPEG2 stream with PID = 301 input as the first enhancement layer second and the MPEG2 stream with PID = 302 input as the second enhancement layer third.

  The layer combining means 605 is an MPEG2-TS packet group 1402 (same as 1302 in FIG. 14) and MPEG2-TS packet group 1412 (same as 1312 in FIG. 14) which are MPEG2-TS streams constituting the same picture from the layer synchronization means 604. The same), an MPEG2-TS packet group 1422 (same as 1322 in FIG. 14) is acquired. Subsequently, the layer combining unit 605 reads the PID from the MPEG2-TS header of each MPEG2-TS packet. As a result, it is found that the MPEG2-TS packet group 1402 has PID = 300, the MPEG2-TS packet group 1412 has PID = 301, and the MPEG2-TS packet group 1422 has PID = 302.

  Subsequently, the layer combining unit 605 determines that PID = 300 is the first, PID = 301 is the second, and PID = 302 is the third, based on the PID information and the arrangement order information included in the stream multiplexing information 1401. The MPEG2-TS packet groups are arranged in the arrangement order and combined. In this example, the layer combining unit 605 arranges the MPEG2-TS packet group 1402 at the head because it can be seen that the base layer is included in the stream of PID = 300 and the arrangement order is first. Similarly, a PID = 301 MPEG2-TS packet group 1412 constituting the first enhancement layer is arranged behind the PID = 302 MPEG2-TS packet group 1422 constituting the second enhancement layer. And combine.

  A new MPEG2 packet group 1431 obtained as a result of the combination is transmitted via the packet transmission means 607. Through the above processing, it is possible to synchronize and combine the three layer data packetized and divided as MPEG1-TS.

  Next, the operation of the depacketizing unit 202 of the video reception device 200 will be described with reference to FIG.

  The depacketizing unit 202 is means for analyzing the video packet received by the receiving unit 201 and acquiring video data to be decoded. In this example, three-layered data packetized and combined in the MPEG2-TS format is delivered to the video receiver 200 on the network 300 using RTP / UDP packets. An MPEG2-TS packet is acquired from the RTP packet, and an elementary stream for one picture is acquired.

  In FIG. 16, the depacketizing unit 202 extracts the payload portion of the RTP packet 1501, RTP packet 1502, and RTP packet 1503 sent from the receiving unit 201 in order by the depacketizing unit 202, and MPEG2-TS packet group 1511 Conversion into TS packet group 1512, MPEG2-TS packet group 1513, and MPEG2-TS packet group 1514.

  Subsequently, the depacketizing unit 202 searches for an MPEG2-TS packet whose predetermined field (pay_load_unit_start_indicator) of the MPEG2-TS header is “1”. By this search, the MPEG2-TS packet storing the PES header is identified. PTS and DTS are acquired as time information from the PES header. In FIG. 16, the PES header stored in the payload of the MPEG2-TS packet group 1511, the MPEG2-TS packet group 1512, and the MPEG2-TS packet group 1513 has time information 1511a of PTS = 6000 and DTS = 0. Show. Further, the PES header stored in the payload of the MPEG2-TS packet group after the MPEG2-TS packet group 1514 has another time information 1514a of PTS = 18000 and DTS = 3000.

  Since PESs having common time information form the same picture, the depacketizing unit 202 performs PES stored in each payload of the MPEG2-TS packet group 1511, the MPEG2-TS packet group 1512, and the MPEG2-TS packet group 1513. Are extracted, and an elementary stream 1521, an elementary stream 1522, and an elementary stream 1523 are obtained.

  Since the multiplexing process 110 of the video distribution apparatus 100 has already completed the synchronization processing of the streams necessary for decoding, the depacketizing unit 202 combines the elementary stream 1511, the elementary stream 1512, and the elementary stream 1513 in the order of arrival. Then, an elementary stream 1531 constituting one picture is newly generated.

  Subsequently, the depacketizing unit 202 adds time information 1531 a to the generated new elementary stream 1531. Since the decoding time and the display time are the same as the elementary stream 1521, the elementary stream 1522, and the elementary stream 1523, the same value as the time information 1511a is added to the time information 1531a.

  The elementary stream 1531 obtained as a result of depacketization is sent to the decoding unit 203 together with time information 1531a.

  Through the above processing, video data received as an RTP packet can be depacketized.

  The present invention can be applied to applications such as a video distribution device such as a VOD server and an nPVR (network personal video recorder).

DESCRIPTION OF SYMBOLS 10 Video delivery system 100 Video delivery apparatus 101 Base layer signal storage part 102 1st enhancement layer signal storage part 103 2nd enhancement layer signal storage part 104 Basic layer signal acquisition part 105 1st enhancement layer signal acquisition part 106 2nd enhancement layer signal Acquisition unit 107 Layer arrangement information storage unit 108 Terminal capability acquisition unit 109 Distribution layer determination unit 110 Multiplexing unit 111 Packetization unit 112 Transmission unit 200 Video reception device 201 Reception unit 202 Depacketization unit 203 Decoding unit 204 Display unit 205 Terminal capability management unit 206 Terminal capability notification unit 300 Network 400 Content encoding information 500 Content information and layer arrangement information 601 Basic layer buffering means 602 First enhancement layer buffering means 603 Second enhancement layer buffering means 604 Synchronization means 605 Layer combination means 606 Additional information insertion means 607 Sending means

Claims (42)

A video distribution device that distributes video content that has been hierarchically encoded into a basic signal and an extension signal of one or more layers, and a video reception device that receives the video content distributed from the video distribution device via a network;
The video distribution device includes:
A basic signal storage unit for storing the basic signal; and one or more extended signal storage units for separately storing the extension signals of one or more layers in units of layers, the basic signal storage unit and the extension signal storage unit Signal storage means for outputting the basic signal and the extended signal independently from each other from a part or all of
Layer arrangement information storage means for holding identifiers for identifying the basic signal storage unit and the extension signal storage unit and identifying the basic signal and the extension signal in units of video content;
Terminal capability acquisition means for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information acquired by the terminal capability acquisition means, a layer configuration of the video content to be distributed to the video reception device is determined, and the identifier is provided from the layer arrangement information storage means to receive the signal storage. Distribution layer determination means for instructing to read out a storage section for storing a signal necessary for the determined layer configuration among the basic signal storage section and the extended signal storage section of the means;
Multiplexing for generating a multiplexed signal by multiplexing the signals necessary for obtaining the determined layer configuration read from the signal storage unit according to the instruction of the distribution layer determination unit according to the instruction of the distribution layer determination unit Signal generating means;
Transmitting means for transmitting the multiplexed signal to the network for distribution;
The video receiver is
Receiving means for receiving the multiplexed signal transmitted from the distribution device via the network;
Decoding means for decoding the multiplexed signal received by the receiving means. A video distribution device that distributes video content that has been hierarchically encoded into a basic signal and an extension signal of one or more layers, and a video reception device that receives the video content distributed from the video distribution device via a network;
The video distribution device includes:
A basic signal storage unit for storing the basic signal; and one or more extended signal storage units for separately storing the extension signals of one or more layers in units of layers, the basic signal storage unit and the extension signal storage unit Signal storage means for outputting the basic signal and the extended signal independently from each other from a part or all of
Layer arrangement information storage means for holding identifiers for identifying the basic signal storage unit and the extension signal storage unit and identifying the basic signal and the extension signal in units of video content;
Terminal capability acquisition means for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information acquired by the terminal capability acquisition means, a layer configuration of the video content to be distributed to the video reception device is determined, and the identifier is provided from the layer arrangement information storage means to receive the signal storage. Distribution layer determination means for instructing to read out a storage section for storing a signal necessary for the determined layer configuration among the basic signal storage section and the extended signal storage section of the means;
Signal acquisition means for acquiring in parallel the signals necessary for the determined layer configuration read from the signal storage means according to the instruction of the distribution layer determination means;
The signals obtained from the signal acquisition means and multiplexed by an instruction of the distribution layer determination unit, a multiplexing means for generating a multiplexed signal,
Packetizing means for converting the multiplexed signal into packets of a predetermined packet format;
Transmitting means for transmitting the packetized multiplexed signal output from the packetizing means to the network for distribution;
The video receiver is
Receiving means for receiving the packetized multiplexed signal transmitted from the distribution device via the network;
Depacketizing means for obtaining a decodable signal from the packetized multiplexed signal received by the receiving means;
Video distribution system characterized in that it comprises a decoding means for decoding the decodable signal acquired by the departure Ke Tides means. The signal acquisition unit of the video distribution apparatus is connected to the basic signal storage unit and the one or more extended signal storage units that constitute the signal storage unit on a one-to-one basis, and the basic signal or 3. The video distribution system according to claim 2, further comprising a plurality of signal acquisition units that read the extension signals independently from each other and output the signals to the multiplexing unit . The multiplexing means of the video distribution device includes:
A layer buffering means for buffering the basic signal and the extension signal by layer when the basic signal and the extension signal are read as signals necessary for the determined layer configuration ;
The time information added to the basic signal acquired from the layer buffering means and the time information added to one or more of the extension signals acquired from the layer buffering means are acquired, and the same time the basic signal and the extended signal video distribution system according to claim 2 or 3, wherein further comprising a layer synchronization means for determining a unit of multiplexed with information. The multiplexing means of the video distribution device comprises layer combining means for combining the basic signal and one or more extension signals in a multiplexing unit determined by the layer synchronization means to generate a combined signal. 5. The video distribution system according to claim 4, wherein The multiplexing unit of the video distribution apparatus acquires information for identifying the basic signal and the extension signal and identification information including combination order information of each signal in the multiplexing process from the distribution layer determining unit. video delivery system of any one of claims 2 to 5, characterized in that. The layer arrangement information storage unit of the video distribution apparatus holds codec information of the basic signal and the extension signal, and the distribution layer determination unit includes terminal capability information obtained from the terminal capability acquisition unit, and the layer The video distribution system according to claim 1 or 2 , wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video reception device from the codec information obtained from the arrangement information storage means. The layer arrangement information storage unit of the video distribution apparatus holds video quality information of the basic signal and the extended signal, and the distribution layer determination unit includes terminal capability information obtained from the terminal capability acquisition unit, 3. The video distribution according to claim 1 or 2 , wherein the video distribution information is determined from the video quality information obtained from the layer arrangement information storage means so as to distribute a video in a range not exceeding the video reproduction capability of the video reception device. system. The layer arrangement information storage unit of the video distribution apparatus holds bit rate information of the basic signal and the extension signal, and the distribution layer determination unit includes terminal capability information obtained from the terminal capability acquisition unit, The video distribution according to claim 1 or 2 , wherein a decision is made to distribute video within a range not exceeding the video reproduction capability of the video reception device from the bit rate information obtained from the layer arrangement information storage means. system. The video distribution apparatus includes an available network bandwidth acquisition unit that measures an available network bandwidth of the network, the layer arrangement information storage unit holds bit rate information of the basic signal and the extension signal, The distribution layer determination means is a range in which the available network bandwidth obtained from the available network bandwidth acquisition means does not exceed the available network bandwidth from the bit rate information obtained from the layer arrangement information storage means. The video distribution system according to claim 1 , wherein the video distribution system determines to distribute the video. The video distribution system according to any one of claims 1 to 10 , wherein the basic signal is a basic layer of a video scalable codec, and the extension signal is an extension layer of a video scalable codec. A video distribution method for distributing video content hierarchically encoded into a basic signal and one or more extended signals to a video receiver via a network,
Terminal capability information acquisition step for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information , a layer configuration of the video content to be distributed to the video receiving device is determined, and a basic signal storage unit for storing the basic signal and the extension signals of one or more layers are separately stored in units of layers. Among the one or more extended signal storage units that perform the reading of the storage unit that stores a signal necessary for the determined layer configuration, the basic signal storage unit and the extended signal storage unit are identified, and the basic signal And a distribution layer determining step for receiving and instructing the provision of the identifier from a layer arrangement information storage unit that holds an identifier for performing identification of the extension signal in units of video content ;
The signals required for the determined layer configuration read from the storage unit instructed to be read by the distribution layer determination step are multiplexed according to the layer configuration determined in the distribution layer determination step, and multiplexed. A multiplexed signal generating step for generating a signal;
Video distribution method characterized by comprising a transmission step of transmitting to the video receiving device via the network for distributing the multiplexed signal. A video distribution method for distributing video content hierarchically encoded into a basic signal and one or more extended signals to a video receiver via a network,
Terminal capability information acquisition step for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information , a layer configuration of the video content to be distributed to the video receiving device is determined, and a basic signal storage unit for storing the basic signal and the extension signals of one or more layers are separately stored in units of layers. Among the one or more extended signal storage units that perform the reading of the storage unit that stores a signal necessary for the determined layer configuration, the basic signal storage unit and the extended signal storage unit are identified, and the basic signal And a distribution layer determining step for receiving and instructing the provision of the identifier from a layer arrangement information storage unit that holds an identifier for performing identification of the extension signal in units of video content ;
A signal acquisition step of acquiring in parallel the signals necessary for the determined layer configuration read from the storage unit instructed to be read by the distribution layer determination step ;
The signal acquired by the signal acquiring step, multiplexed according to the layer configuration determined by the distribution layer determination step, the multiplexing step of generating a multiplexed signal,
A packetizing step for converting the multiplexed signal into a packet of a predetermined packet format;
Video distribution method characterized by comprising a transmission step of transmitting via the network a multiplexed signal packetized in the packetized step for delivery to the video receiving apparatus. Before Kio redundant step,
A layer buffering step of buffering the basic signal and the extension signal by layer when the basic signal and the extension signal are read as signals necessary for the determined layer configuration ;
The time information added to the basic signal acquired in the layer buffering step and the time information added to one or more of the extension signals acquired in the layer buffering are acquired, and the same time information The video distribution method according to claim 13 , further comprising: a layer synchronization step for determining the basic signal having the above and the extension signal as a unit of multiplexing. The multiplexing step includes a layer combining step of generating a combined signal by combining the basic signal and one or more extension signals in a multiplexing unit determined by the layer synchronization step. 14. The video distribution method according to 14 . The multiplexing step acquires the information for identifying the basic signal and the extension signal obtained in the distribution layer determining step and the identification information including the combination order information of each signal in the multiplexing process. 16. The video delivery method according to claim 13 , wherein multiplexing is performed. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step and the codec information obtained from a layer arrangement information storage unit that holds codec information of the basic signal and the extension signal. 14. The video distribution method according to claim 12, wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video receiver. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step, and the video quality information obtained from a layer arrangement information storage unit that holds video quality information of the basic signal and the extension signal. 14. The video distribution method according to claim 12 or 13 , wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video receiver. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step, and the bit rate information obtained from a layer arrangement information storage unit that holds bit rate information of the basic signal and the extension signal. 14. The video distribution method according to claim 12 or 13 , wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video receiver. An available network bandwidth acquisition step of measuring an available network bandwidth of the network,
The distribution layer determination step, the resulting available network bandwidth with the available network bandwidth acquisition step, obtained from the basic signal and Relais ear placement information storage unit to hold the bit rate information of the extension signal 20. The video delivery method according to any one of claims 12 to 19 , wherein a decision is made to deliver video in a range not exceeding an available network bandwidth from the bit rate information. 21. The video distribution method according to claim 12 , wherein the basic signal is a basic layer of a video scalable codec, and the extension signal is an extension layer of a video scalable codec. A video distribution device that distributes video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video reception device via a network,
A basic signal storage unit for storing the basic signal; and one or more extended signal storage units for separately storing the extension signals of one or more layers in units of layers, the basic signal storage unit and the extension signal storage unit Signal storage means for outputting the basic signal and the extended signal independently from each other from a part or all of
Layer arrangement information storage means for holding identifiers for identifying the basic signal storage unit and the extension signal storage unit and identifying the basic signal and the extension signal in units of video content;
Terminal capability acquisition means for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information acquired by the terminal capability acquisition means, a layer configuration of the video content to be distributed to the video reception device is determined, and the identifier is provided from the layer arrangement information storage means to receive the signal storage. Distribution layer determination means for instructing to read out a storage section for storing a signal necessary for the determined layer configuration among the basic signal storage section and the extended signal storage section of the means;
Multiplexing for generating a multiplexed signal by multiplexing the signals necessary for obtaining the determined layer configuration read from the signal storage unit according to the instruction of the distribution layer determination unit according to the instruction of the distribution layer determination unit Signal generating means;
Transmitting means for transmitting the multiplexed signal to the network for distribution. A video distribution device that distributes video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video reception device via a network,
A basic signal storage unit for storing the basic signal; and one or more extended signal storage units for separately storing the extension signals of one or more layers in units of layers, the basic signal storage unit and the extension signal storage unit Signal storage means for outputting the basic signal and the extended signal independently from each other from a part or all of
Layer arrangement information storage means for holding identifiers for identifying the basic signal storage unit and the extension signal storage unit and identifying the basic signal and the extension signal in units of video content;
Terminal capability acquisition means for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information acquired by the terminal capability acquisition means, a layer configuration of the video content to be distributed to the video reception device is determined, and the identifier is provided from the layer arrangement information storage means to receive the signal storage. Distribution layer determination means for instructing to read out a storage section for storing a signal necessary for the determined layer configuration among the basic signal storage section and the extended signal storage section of the means;
Signal acquisition means for acquiring in parallel the signals necessary for the determined layer configuration read from the signal storage means according to the instruction of the distribution layer determination means;
The signals obtained from the signal acquisition means and multiplexed by an instruction of the distribution layer determination unit, a multiplexing means for generating a multiplexed signal,
Packetizing means for converting the multiplexed signal into packets of a predetermined packet format;
Transmitting means for transmitting the packetized multiplexed signal output from the packetizing means to the network for distribution. The signal acquisition means includes
A plurality of one-to-one connections with the basic signal storage unit and the one or more extension signal storage units, and the basic signal or the extension signal are read from the connected storage units independently of each other and output to the multiplexing unit. 24. The video distribution apparatus according to claim 23, comprising: a signal acquisition unit . The multiplexing means includes
A layer buffering means for buffering the basic signal and the extension signal by layer when the basic signal and the extension signal are read as signals necessary for the determined layer configuration ;
The time information added to the basic signal acquired from the layer buffering means and the time information added to one or more of the extension signals acquired from the layer buffering means are acquired, and the same time 25. The video distribution apparatus according to claim 23 , further comprising: layer synchronization means for determining the basic signal having information and the extension signal as a multiplexing unit. The multiplexing means comprises layer combining means for combining the basic signal and one or more extension signals in a multiplexing unit determined by the layer synchronization means to generate a combined signal. 25. The video distribution device according to 25 . The multiplexing means obtains information for identifying the basic signal and the extension signal and identification information including combination order information of each signal in the multiplexing process from the distribution layer determining means, 27. The video distribution apparatus according to any one of claims 23 to 26 . The layer arrangement information storage unit holds codec information of the basic signal and the extension signal, and the distribution layer determination unit includes the terminal capability information obtained from the terminal capability acquisition unit and the layer arrangement information storage unit. 24. The video distribution apparatus according to claim 22 or 23 , wherein a determination is made to distribute a video in a range not exceeding the video reproduction capability of the video reception apparatus from the obtained codec information. The layer arrangement information storage unit holds video quality information of the basic signal and the extended signal, and the distribution layer determination unit includes terminal capability information obtained from the terminal capability acquisition unit, and the layer arrangement information storage unit 24. The video distribution apparatus according to claim 22 , wherein a determination is made to distribute a video in a range not exceeding the video reproduction capability of the video reception apparatus from the video quality information obtained from the video quality information. The layer arrangement information storage unit holds bit rate information of the basic signal and the extension signal, and the distribution layer determination unit includes terminal capability information obtained from the terminal capability acquisition unit, and the layer arrangement information storage unit 24. The video distribution apparatus according to claim 22 or 23 , wherein the video distribution apparatus determines to distribute a video in a range that does not exceed the video reproduction capability of the video reception apparatus from the bit rate information obtained from. An available network bandwidth acquisition unit that measures an available network bandwidth of the network, the layer arrangement information storage unit holds bit rate information of the basic signal and the extension signal, and a distribution layer determination unit includes: Deciding to distribute the available network bandwidth obtained from the available network bandwidth acquisition means from the bit rate information obtained from the layer arrangement information storage means so as not to exceed the available network bandwidth The video delivery apparatus according to any one of claims 22 to 30 , wherein 32. The video distribution apparatus according to claim 22 , wherein the basic signal is a basic layer of a video scalable codec, and the extension signal is an extension layer of a video scalable codec. A video distribution program for causing a computer to execute video distribution for distributing video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video receiving device via a network,
Terminal capability information acquisition step for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information , a layer configuration of the video content to be distributed to the video receiving device is determined, and a basic signal storage unit for storing the basic signal and the extension signals of one or more layers are separately stored in units of layers. Among the one or more extended signal storage units that perform the reading of the storage unit that stores a signal necessary for the determined layer configuration, the basic signal storage unit and the extended signal storage unit are identified, and the basic signal And a distribution layer determining step for receiving and instructing the provision of the identifier from a layer arrangement information storage unit that holds an identifier for performing identification of the extension signal in units of video content ;
The signals required for the determined layer configuration read from the storage unit instructed to be read by the distribution layer determination step are multiplexed according to the layer configuration determined in the distribution layer determination step, and multiplexed. A multiplexed signal generating step for generating a signal;
Video distribution program characterized by a transmission step of transmitting via the network for distributing the multiplexed signal to the video receiving apparatus, is executed by a computer. A video distribution program for causing a computer to execute video distribution for distributing video content hierarchically encoded into a basic signal and an extension signal of one or more layers to a video receiving device via a network,
Terminal capability information acquisition step for acquiring terminal capability information including the maximum resolution, maximum frame rate, decoding capability and receivable bit rate of the video receiving device from the video receiving device;
In accordance with the terminal capability information , a layer configuration of the video content to be distributed to the video receiving device is determined, and a basic signal storage unit for storing the basic signal and the extension signals of one or more layers are separately stored in units of layers. Among the one or more extended signal storage units that perform the reading of the storage unit that stores a signal necessary for the determined layer configuration, the basic signal storage unit and the extended signal storage unit are identified, and the basic signal And a distribution layer determining step for receiving and instructing the provision of the identifier from a layer arrangement information storage unit that holds an identifier for performing identification of the extension signal in units of video content ;
A signal acquisition step of acquiring in parallel the signals necessary for the determined layer configuration read from the storage unit instructed to be read by the distribution layer determination step ;
The signal acquired by the signal acquiring step, multiplexed according to the layer configuration determined by the distribution layer determination step, the multiplexing step of generating a multiplexed signal,
A packetizing step for converting the multiplexed signal into a packet of a predetermined packet format;
Video distribution program characterized a transmission step of transmitting via the network a multiplexed signal packetized in the packetized step for delivery to the video receiving apparatus, be executed by a computer. Before Kio redundant step,
A layer buffering step of buffering the basic signal and the extension signal by layer when the basic signal and the extension signal are read as signals necessary for the determined layer configuration ;
The time information added to the basic signal acquired in the layer buffering step and the time information added to one or more of the extension signals acquired in the layer buffering are acquired, and the same time information 35. The video distribution program according to claim 34 , further comprising: a layer synchronization step for determining the basic signal having the above and the extension signal as a unit of multiplexing. The multiplexing step includes a layer combining step of generating a combined signal by combining the basic signal and one or more extension signals in a multiplexing unit determined by the layer synchronization step. 35. The video distribution program according to 35 . The multiplexing step acquires the information for identifying the basic signal and the extension signal obtained in the distribution layer determining step and the identification information including the combination order information of each signal in the multiplexing process. 36. The video distribution program according to claim 34 or 35, wherein multiplexing is performed. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step and the codec information obtained from a layer arrangement information storage unit that holds codec information of the basic signal and the extension signal. 35. The video delivery program according to claim 33 or 34, wherein a decision is made to deliver video in a range not exceeding the video playback capability of the video receiver. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step, and the video quality information obtained from a layer arrangement information storage unit that holds video quality information of the basic signal and the extension signal. 35. The video distribution program according to claim 33 or 34 , wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video reception device. The distribution layer determination step includes the terminal capability information obtained in the terminal capability acquisition step, and the bit rate information obtained from a layer arrangement information storage unit that holds bit rate information of the basic signal and the extension signal. 35. The video distribution program according to claim 33 or 34 , wherein a determination is made to distribute video in a range not exceeding the video reproduction capability of the video reception device. An available network bandwidth acquisition step of measuring an available network bandwidth of the network,
The distribution layer determination step, the resulting available network bandwidth with the available network bandwidth acquisition step, obtained from the basic signal and Relais ear placement information storage unit to hold the bit rate information of the extension signal 41. The video delivery program according to claim 33 , wherein the video delivery program determines from the bit rate information to deliver a video in a range not exceeding an available network bandwidth. The video delivery program according to any one of claims 33 to 41 , wherein the basic signal is a basic layer of a video scalable codec, and the extension signal is an extension layer of a video scalable codec.