JP5449241B2 - Video decoding apparatus, video transmission / reception apparatus, video decoding method, and video transmission / reception method - Google Patents

Description

  The present invention relates to a video decoding device, a video transmission / reception device, a video decoding method, and a video transmission / reception method.

  Research has been conducted on video systems that display only a part of a high-definition display on a very high-resolution video that exceeds high-definition. According to such a system, it is possible to designate an area that the user wants to view and view an image in the designated area with a sufficient resolution.

  In order to realize the system, the video compression transmission method is important. As a compression transmission method, generally, a high-resolution video is divided into a plurality of tiles, and each tile video is compressed and encoded. A method for decoding and displaying a stream of a part of tile video during video playback has been studied.

  For example, according to Non-Patent Document 1, when panoramic video is divided into tiles of the same size, one tile is regarded as one camera video, compressed, and those streams are multiplexed and reproduced. A method has been proposed in which a plurality of tiles are selected and decoded, and a part of a video composed of the decoded tiles is cut out and displayed.

  For example, as shown in FIG. 18, Non-Patent Document 1 shows an example in which nine tiles are decoded, one video is formed from them, and a part thereof is cut out and output / displayed. In this case, the video reproduction device needs to decode nine multiplexed video streams in order to obtain nine tile videos.

  The number of tiles has a characteristic that changes depending on the size of the display area. If the number of tiles to be decoded is determined in advance, the number of tiles to be decoded can be dynamically changed in a range from 1 to the maximum number. In order to cope with such a dynamic change in the number of tiles to be decoded, this document describes the international standard method H.264. H.264 uses a mechanism for partially decoding a video stream multiplexed using H.264 Annex H (MVC). Generally, since it is necessary to decode a plurality of tiles, a decoding method for decoding a plurality of streams has been essential.

  When decoding and displaying such a stream, as described in the same document, a part of a plurality of tiles are cut out and displayed. If it is in the middle, the edge of the displayed image will not be cut off. Also, when the position exceeds the tile, decoding of another tile is started, so that the video to be displayed is not lost.

  Through the processing as described above, a video system that allows a user to freely designate and display a partial area of a high-resolution video can be configured.

  Also, since the transparency information and depth information of an image can be defined at each pixel position of the image, a format that handles gray scale information has been proposed. That is, in this format, not only color signals but also transparency information and depth information are handled together as image information.

  Thereby, for example, the transparency information can be used for processing the color signal, or a stereoscopic video can be generated from the color signal and the depth information (see, for example, Non-Patent Document 2). As a method for generating a stereoscopic video from depth information and color signals, there is a method called 3D warping.

  As shown in FIG. 19, a color signal from another viewpoint is generated by using depth information. Such information in which image information is defined in a format having transparency information and depth information together with a color signal can also be used as panoramic video image information as shown in Non-Patent Document 1. In the case of having transparency information as well, a part of the panoramic video can be cut out as a foreground and synthesized with a separately prepared background image. When the depth information is included, a part of the panoramic video can be displayed as a stereoscopic video. Alternatively, it is possible to display an image with a slightly different viewpoint in three dimensions.

Hideaki Kimata, Shinya Shimizu, Yutaka Kunita, Megumi Isogai, and Yoshimitsu Ohtani: `` Panorama video coding for user-driven interactive video application '', IEEE International Symposium on Consumer Electronics (ISCE) 2009, 2009 Hideaki Kizen: "Trends in standardization for 3D video-MPEG standardization for 3D video and multi-view video-", High Reality Display Forum 2007, 2007

  As described in Non-Patent Document 1, the decoding method in which the number of tiles to be decoded is dynamically changed for the video stream divided and multiplexed into a plurality of tiles described above is performed on a general-purpose computer. Can be implemented using software.

  However, if a computer with low processing capacity cannot decode the required number of tiles, or if the dedicated hardware changes the number of tiles dynamically, all target tiles must be decoded. The problem that cannot be done.

  For example, in the case of a device having dedicated hardware for decoding one video stream for a stream that constitutes one video with nine tiles, only one of the nine video streams is decoded. Therefore, there arises a problem that it is impossible to obtain a video of the viewing area belonging to other tiles.

  The present invention has been made in consideration of such circumstances, and the object of the present invention is to use a computer that has a low processing capacity and can decode only one video stream when viewing only a partial area of the video. Even when viewing, a video decoding device, a video transmitting / receiving device, a video decoding method, and a video decoding device capable of decoding a video stream so that the number of pixels to be displayed is maximized with respect to the position of an output image specified by the user And providing a video transmission / reception method.

  In order to solve the above-described problem, the present invention corresponds to area video position information indicating N different coordinate positions with respect to a reference position on a surface expressed in two dimensions, and each area video position information. A video decoding apparatus that obtains an output image by decoding a part of the encoded data from encoded data composed of N video streams, the coordinate position of the output image with respect to the reference position and the region video Based on the position information, a read determination unit that determines to read the i-th (1 ≦ i ≦ N) video stream so that the number of pixels of the output image is the largest, and reads the i-th video stream A reading unit, a decoding unit that decodes the i-th video stream read by the reading unit, an image clipping unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, A cut-out position determination unit that determines a cut-out position in the image cut-out unit so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream; A video decoding device characterized by the above.

  In order to solve the above-described problem, the present invention corresponds to area video position information indicating N different coordinate positions with respect to a reference position on a surface expressed in two dimensions, and each area video position information. A video decoding device that decodes a part of encoded data to obtain an output image from encoded data composed of one stream obtained by multiplexing N video streams and a stream ID for distinguishing each video stream. And reading the i-th (1 ≦ i ≦ N) video stream so that the number of pixels of the output image is maximized based on the coordinate position of the output image with respect to the reference position and the region video position information. The i-th video stream determined by the read determination unit based on the stream ID in the encoded data, and the i-th video stream A search readout unit for reading out a video stream, a decoding unit for decoding the i-th video stream obtained by the search readout unit, an image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit, A cut-out position determining unit that determines a cut-out position in the image cut-out unit using the region video position information of the i-th video stream so that the coordinate position of the output image with respect to the reference position is the same. A video decoding device characterized by the above.

  In order to solve the above-described problem, the present invention transmits region video position information which is the coordinate position of N partial region images with respect to a reference position of an original image defined on a plane expressed in two dimensions. A video transmission device comprising: an area video position information transmission unit for transmitting; and a stream transmission unit for transmitting an i-th (1 ≦ i ≦ N) video stream among video streams of N region videos; An area image position information receiving unit that receives area image position information that is a coordinate position of a partial area image, a stream receiving unit that receives the i th image stream, and the i th received by the stream receiving unit A video reading stream, a decoding unit for decoding the i-th video stream read by the reading unit, and a part of the decoded image obtained by the decoding unit. The cutout position for determining the cutout position in the image cutout unit so that the coordinate position of the output image with respect to the reference position is the same using the image cutout unit and the area video position information of the i-th video stream A determination unit, an output image coordinate designating unit for designating a coordinate position of the next output image with respect to the reference position, a coordinate position of the next output image designated by the output image coordinate designating unit, and the region video position information And a transmission request determination unit that determines to request transmission of a j-th (1 ≦ j ≦ N) video stream so that the number of pixels of the next output image is the largest, and the j-th video A video transmission / reception apparatus comprising: a video reception apparatus including a transmission request unit that requests the video transmission apparatus to transmit a stream.

In order to solve the above-described problem, the present invention transmits region video position information which is the coordinate position of N partial region images with respect to a reference position of an original image defined on a plane expressed in two dimensions. M (M ≦ N) a ₁ from one stream obtained by multiplexing the N partial area video streams and the stream ID for distinguishing each video stream. a video transmitter and a stream transmission unit for transmitting to extract one stream obtained by multiplexing a stream ID corresponding to a _m-th video stream from a region image position of the N partial region image An area video position information receiving unit for receiving information, a stream receiving unit for receiving the M a ₁ to a _m th video streams, a coordinate position of the output image with respect to the reference position, and a previous position Based on the serial area image position information, i th as the number of pixels to obtain most of the output image (i is any one of a _m from a ₁₎ and the reading determination unit determines that reading the video stream, Search readout for searching and reading out the i-th video stream determined by the readout determination unit based on the stream IDs in the M a ₁ to a _m- th video streams received by the stream receiving unit A decoding unit that decodes the i-th video stream read by the search reading unit, an image cut-out unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, and the i-th video stream The cutout position in the image cutout unit is determined so that the coordinate position of the output image with respect to the reference position is the same using the area video position information of the region. The next output based on the cutout position determination unit to be determined, the output image coordinate designation unit that designates the coordinate position of the next output image, the coordinate position of the next output image with respect to the reference position, and the region video position information A transmission request determination unit that determines to request transmission of M (M ≦ N) b ₁ to b _m th video streams so that a large number of pixels of an image can be obtained; and b ₁ to b _m th A video transmission / reception apparatus comprising: a video reception apparatus including a transmission request unit that requests the video transmission apparatus to transmit the video stream.

  In order to solve the above-described problem, the present invention transmits region video position information which is the coordinate position of N partial region images with respect to a reference position of an original image defined on a plane expressed in two dimensions. A video transmission apparatus comprising: an area video position information transmission unit that performs encoding, and a stream transmission unit that encodes an i-th (1 ≦ i ≦ N) region video from a part of image information of the original video and transmits a video stream; , An area image position information receiving unit that receives N area image position information, a stream receiving unit that receives the i-th image stream, and reading out the i-th image stream received by the stream receiving unit A decoding unit that decodes the i-th video stream read by the reading unit, and an image cutout unit that cuts out and outputs a part of the decoded image obtained by the decoding unit A cut-out position determination unit that determines a cut-out position in the image cut-out unit using the region video position information of the i-th video stream so that the coordinate position of the output image with respect to the reference position is the same; Based on the output image coordinate designating unit for designating the coordinate position of the output image, the coordinate position of the next output image with respect to the reference position, and the region video position information, j is obtained so that the next output image is obtained most. A transmission request determining unit that determines to request transmission of a video stream of the first (1 ≦ j ≦ N), and transmission of the jth video stream determined by the transmission request determining unit to the video transmission device A video transmission / reception apparatus comprising: a video reception apparatus including a transmission request unit for requesting.

In order to solve the above-described problem, the present invention transmits region video position information which is the coordinate position of N partial region images with respect to a reference position of an original image defined on a plane expressed in two dimensions. And a stream ID corresponding to a video stream obtained by encoding M (M ≦ N) a ₁ to a _m- th area videos from a part of image information of the original video. A stream transmission unit that multiplexes and transmits the video data, a region video position information reception unit that receives the N pieces of region video position information, and the M pieces (M ≦ N) of a ₁ a stream receiving unit that receives the _m th stream, and the i th (i is the number i) so that the number of pixels of the output image can be maximized based on the coordinate position of the output image with respect to the reference position and the region video position information. a from a ₁ Any) and reading determination unit determines that reading the video stream, based on the stream ID in the coded data, search reading to read to search the i-th video stream as determined by the reading determination unit A decoding unit that decodes the i-th video stream read by the search reading unit, an image cut-out unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, and the i-th video stream Using the region video position information of the video stream, the cutout position determining unit that determines the cutout position in the image cutout unit so that the coordinate position of the output image with respect to the reference position is the same, and the coordinates of the next output image Based on the output image coordinate designating unit for designating the position, the coordinate position of the next output image with respect to the reference position, and the area video position information As the number of pixels in the next output image is obtained much, and the transmission request determining unit that determines to request transmission of b _m-th video stream from b ₁ of M (M <= N), the transmission A video transmission / reception device comprising: a video reception device including a transmission request unit that requests the video transmission device to transmit the b ₁ to b _m -th video streams determined by a request determination unit. is there.

In order to solve the above-described problem, the present invention relates to _Nk (1 ≦ k ≦ L) reference positions on each surface for L (L ≧ 2) surfaces expressed in two dimensions. And decoding a part of the encoded data based on encoded data composed of area video position information indicating different coordinate positions of the video and a plurality of video streams corresponding to the area video position information. A video decoding device for obtaining an output image, wherein a pixel of the output image is based on the coordinate position of the output image with respect to the reference position and the region video position information on a plane c (1 ≦ c ≦ L) where the output image is cut out A read determination unit that determines to read out the i-th (1 ≦ i ≦ N _c ) video stream so that the number can be obtained most, and a read-out unit that reads out the i-th video stream determined by the read determination unit A decoding unit that decodes the i-th video stream obtained by the reading unit, an image cut-out unit that cuts out a part of the decoded image obtained by the decoding unit, and an area of the i-th video stream A video decoding apparatus, comprising: a cut-out position determination unit that determines a cut-out position in the image cut-out unit so that the coordinate position of the output image with respect to the reference position is the same using the video position information is there.

In order to solve the above-described problem, the present invention relates to _Nk (1 ≦ k ≦ L) reference positions on each surface for L (L ≧ 2) surfaces expressed in two dimensions. Encoded data composed of one stream obtained by multiplexing area video position information indicating different coordinate positions, a plurality of video streams corresponding to each area video position information, and a stream ID for distinguishing each video stream. The video decoding device that obtains an output image by decoding a part of the encoded data based on the above, and the coordinates of the output image with respect to the reference position in the plane c (1 ≦ c ≦ L) where the output image is cut out Based on the position and the region video position information, a read determining unit that determines to read out the i-th (1 ≦ i ≦ N _c ) video stream so that the number of pixels of the output image is the largest, and the code Conversion Based on the stream ID in the data, a search reading unit for searching and reading the i-th video stream determined by the read determination unit, and decoding for decoding the i-th video stream read by the search and reading unit And the image cutout unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, and the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream And a cutout position determination unit that determines a cutout position in the image cutout unit.

In order to solve the above-described problem, the present invention relates to N _k (1 ≦ k ≦ L) with respect to a reference position defined on each surface for L (L ≧ 2) surfaces expressed in two dimensions. An area image position information transmitting unit for transmitting all area image position information, which are coordinate positions of a plurality of partial area images, and a video stream of Nc area images in a plane c (1 ≦ c ≦ L) a video transmission apparatus comprising: a stream transmission unit that transmits an i-th (1 ≦ i ≦ N _c ) stream; an area video position information reception unit that receives all area video position information; and the i-th video stream A stream receiver that receives the i-th video stream received by the stream receiver, a decoder that decodes the i-th video stream read by the reader, Using the image cutout unit that cuts out and outputs a part of the decoded image obtained by the recording / decoding unit, and the i-th region video position information, the coordinate position of the output image with respect to the reference position is the same A cut-out position determining unit that determines a cut-out position in the image cut-out unit, an output image surface specifying unit that specifies a surface d (1 ≦ d ≦ L) from which the next output image is cut out, and a coordinate position of the next output image Based on the coordinate position of the next output image with respect to the reference position and the region image position information on the output image coordinate designating unit to be designated and the surface d designated by the output image surface designating unit, the next output image A transmission request determination unit that determines to request transmission of a j-th (1 ≦ j ≦ N _d ) video stream so that the number of pixels is maximized, and a plane d () determined by the transmission request determination unit 1 ≦ The transmission of the video stream ≦ L) j th in _{(1 ≦ j ≦ N d)} , the video receiving apparatus characterized by comprising a video receiver and a transmission request unit for requesting the image transmission device is there.

In order to solve the above-described problem, the present invention relates to N _k (1 ≦ k ≦ L) with respect to a reference position defined on each surface for L (L ≧ 2) surfaces expressed in two dimensions. Multiple area video position information transmission units that transmit all the area video position information that is the coordinate position of each partial area video, and the stream ID that distinguishes each video stream from the video stream of all the area videos are multiplexed. A video transmission apparatus comprising: a stream transmission unit that extracts and transmits one stream obtained by multiplexing M a ₁ to a _m th video streams and a corresponding stream ID from one stream; a region image positional information receiving unit that receives the area image position information, the M and the stream receiving unit for receiving a _m-th stream from a _1, the surface c (1 ≦ c ≦ L cutting the output image In, based on the coordinate position of the output image and the area image position information with respect to the reference position, the most i th so as to obtain the number of pixels of the output image (i is any one of a ₁ to a _m) A read determination unit that determines to read a video stream, a search read unit that searches for and reads the i-th video stream determined by the read determination unit based on a stream ID in the encoded data, and the search A decoding unit that decodes the i-th video stream read by the reading unit, an image cut-out unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, and an area video of the i-th video stream The position information is used to determine the cutout position in the image cutout unit so that the coordinate position of the output image with respect to the reference position is the same. An output position determining unit; an output image surface designating unit for designating one or more surfaces d (1 ≦ d ≦ L) for cutting out the next output image; and an output image coordinate designating for designating the coordinate position of the next output image And the number of pixels of the next output image can be obtained based on the coordinate position of the next output image with respect to the reference position and the area video position information on the plane d designated by the output image plane designation unit. the transmission and the transmission request determining unit that determines to request the transmission from M b ₁ of b _m-th video stream, from the b ₁ determined by the transmission request determining unit of b _m-th video stream A video receiving device comprising a transmission requesting unit for requesting the video transmitting device to transmit the video to the video transmitting device.

In order to solve the above-described problem, the present invention relates to N _k (1 ≦ k ≦ L) with respect to a reference position defined on each surface for L (L ≧ 2) surfaces expressed in two dimensions. An area image position information transmitting unit that transmits all area image position information, which is the coordinate position of each partial area image, and a partial image of the original image on one or more planes c (1 ≦ c ≦ L) A video transmission device including a stream transmission unit that encodes an i-th (1 ≦ i ≦ N _c ) region video from information and transmits a video stream, and a region video position information reception unit that receives all region video position information A stream receiving unit that receives the i-th video stream, a reading unit that reads the i-th video stream received by the stream receiving unit, and the i-th video stream that is read by the reading unit. The output image coordinates with respect to the reference position using the decoding unit for decoding, the image clipping unit for cutting out and outputting a part of the decoded image obtained by the decoding unit, and the region video position information of the i-th video stream A cutout position determining unit that determines a cutout position in the image cutout unit so that the positions are the same, an output image surface specifying unit that specifies a surface d (1 ≦ d ≦ L) to cut out the next output image, Based on the output image coordinate designating unit for designating the coordinate position of the next output image, the coordinate position of the next output image with respect to the reference position on the surface d designated by the output image surface designating unit, and the region video position information A transmission request determination unit that determines to request transmission of a j-th (1 ≦ j ≦ N _d ) video stream so that the number of pixels of the next output image is maximized; Yo The transmission of the determined the j-th video stream Te, a video receiving apparatus characterized by comprising a video receiver and a transmission request unit for requesting the image transmission apparatus.

In order to solve the above-described problem, the present invention relates to N _k (1 ≦ k ≦ L) with respect to a reference position defined on each surface for L (L ≧ 2) surfaces expressed in two dimensions. An area image position information transmitting unit that transmits all area image position information, which is the coordinate position of each partial area image, and a partial image of the original image on one or more planes c (1 ≦ c ≦ L) A video transmission apparatus comprising: a stream transmission unit that multiplexes and transmits a video stream obtained by encoding M a ₁ to a _m- th region videos from information and a corresponding stream ID; and all region videos The reference in the area image position information receiving unit for receiving position information, the stream receiving unit for receiving the M a ₁ to a _m th streams, and the plane c (1 ≦ c ≦ L) for cutting out an output image Output image position relative to position On the basis of the position and said area image position information, the most i th so as to obtain the number of pixels of the output image (i is any one of a _m from a ₁₎ reading determination unit determines that reading the video stream And a search read unit that searches for and reads the i-th video stream determined by the read determination unit based on a stream ID in the encoded data, and the i-th read by the search read unit. A decoding unit that decodes the video stream, an image cutout unit that cuts out and outputs a part of the decoded image obtained by the decoding unit, and an output for the reference position using the region video position information of the i-th video stream A cut-out position determining unit that determines a cut-out position in the image cut-out unit and a next output image are cut out so that the image coordinate positions are the same. An output image plane designating unit for designating one or more planes d (1 ≦ d ≦ L), an output image coordinate designating unit for designating the coordinate position of the next output image, and a plane d designated by the output image plane designating unit Based on the coordinate position of the next output image with respect to the reference position and the region video position information, the M b ₁ to b _m th video streams are obtained so that the number of pixels of the next output image can be increased. A transmission request determination unit that determines to request transmission of the video transmission device, and a transmission request unit that requests the video transmission device to transmit the b1 to bm-th video streams determined by the transmission request determination unit. A video transmission / reception device comprising a video reception device.

  In order to solve the above-described problem, the present invention corresponds to area video position information indicating N different coordinate positions with respect to a reference position on a surface expressed in two dimensions, and each area video position information. A video decoding method for obtaining an output image by decoding a part of the encoded data from encoded data composed of N video streams, the coordinate position of the output image with respect to the reference position and the region video Based on the position information, a read determination step for deciding to read the i-th (1 ≦ i ≦ N) video stream so that the number of pixels of the output image is maximized, and reading the i-th video stream A reading step, a decoding step for decoding the i-th video stream read in the reading step, and a part of the decoded image obtained in the decoding step The image cut-out position in the image cut-out step is determined so that the coordinate position of the output image with respect to the reference position is the same using the image cut-out step to be output and the region video position information of the i-th video stream. A video decoding method including a cut-out position determination step.

  In order to solve the above-described problem, the present invention corresponds to area video position information indicating N different coordinate positions with respect to a reference position on a surface expressed in two dimensions, and each area video position information. A video decoding method for obtaining an output image by decoding a part of encoded data from encoded data composed of one stream obtained by multiplexing N video streams and a stream ID for distinguishing each video stream. And reading the i-th (1 ≦ i ≦ N) video stream so that the number of pixels of the output image is maximized based on the coordinate position of the output image with respect to the reference position and the region video position information. A reading determination step for determining the i-th video stream determined in the reading determination step based on a stream ID in the encoded data; A search and read step for reading the i-th video stream, a decoding step for decoding the i-th video stream obtained in the search and read step, and an image cut-out for cutting out and outputting a part of the decoded image obtained in the decoding step A cut-out position determining step for determining a cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream; The video decoding method characterized by including.

  In order to solve the above-described problem, the present invention provides an area in which a video transmission apparatus is a coordinate position of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions. An area image position information transmitting step for transmitting image position information; and a stream transmitting step for transmitting an i-th (1 ≦ i ≦ N) image stream of the image streams of N area images by the image transmitting apparatus; A video image receiving apparatus that receives video image position information that is the coordinate position of the N partial video images; and the video receiver receives the i-th video stream. A stream receiving step, a reading step in which the video receiving device reads the i-th video stream received in the stream receiving step, and the video receiving device A decoding step of decoding the i-th video stream read in the reading step, an image cutting-out step in which the video receiving apparatus cuts out and outputs a part of the decoded image obtained in the decoding step, and the video A cut-out position determining step in which the receiving apparatus uses the region video position information of the i-th video stream to determine the cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same. An output image coordinate designation step in which the video reception device designates a coordinate position of a next output image with respect to the reference position; and the video reception device designates a next output image designated in the output image coordinate designation step. Based on the coordinate position and the area image position information, the maximum number of pixels of the next output image can be obtained. a transmission request determining step for determining to request transmission of a j-th (1 ≦ j ≦ N) video stream, and the video reception device requests the video transmission device to transmit the j-th video stream. And a transmission requesting step.

In order to solve the above-described problem, the present invention provides an area in which a video transmission apparatus is a coordinate position of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions. An area image position information transmission step for transmitting image position information, and the image transmission apparatus from one stream obtained by multiplexing the N partial area image image streams and a stream ID for distinguishing each image stream. A stream transmission step of extracting and transmitting one stream obtained by multiplexing M (M ≦ N) a ₁ to a _m th video streams and corresponding stream IDs; and An area image position information receiving step for receiving area image position information of a plurality of partial area images; and the image receiving apparatus includes the M a ₁ to a _m th image streams The i th (i is from a ₁ to a _m) so that the number of pixels of the output image can be maximized based on the stream receiving step of receiving the image, the coordinate position of the output image with respect to the reference position, and the region video position information And a read determination step for determining to read the video stream, and the video reception device sets the stream ID in the M a ₁ to a _m th video streams received in the stream reception step. And a search readout step for searching and reading out the i-th video stream determined in the readout determination step, and a decoding for decoding the i-th video stream read out by the video reception device in the search and readout step. And the video receiving apparatus cuts out a part of the decoded image obtained in the decoding step. In the image clipping step, the image receiving step uses the region image position information of the i-th video stream so that the coordinate position of the output image with respect to the reference position is the same. A cut-out position determining step for determining a cut-out position; an output image coordinate specifying step in which the video receiving apparatus specifies a coordinate position of a next output image; and a coordinate of the next output image with respect to the reference position. Based on the position and the region video position information, the transmission of M (M ≦ N) b ₁ to b _m th video streams is requested so as to obtain a large number of pixels of the next output image. A transmission request determining step for determining, and a transmission request for requesting the video transmitting apparatus to transmit the b ₁ to b _m th video streams by the video receiving apparatus. A method for transmitting and receiving video.

  In order to solve the above-described problem, the present invention provides an area in which a video transmission apparatus is a coordinate position of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions. An area image position information transmitting step for transmitting image position information, and the image transmitting apparatus encodes an i-th (1 ≦ i ≦ N) area image from a part of image information of the original image and transmits an image stream. A stream transmission step, a region video position information reception step in which the video reception device receives N pieces of region video position information, a stream reception step in which the video reception device receives the i-th video stream, and the video A reading step in which the receiving device reads the i-th video stream received in the stream receiving step; and the video receiving device in the reading step. A decoding step of decoding the extracted i-th video stream, an image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step, and the video reception device, A cut-out position determining step for determining a cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream; Based on the output image coordinate designating step in which the receiving device designates the coordinate position of the next output image, and the video receiving device based on the coordinate position of the next output image with respect to the reference position and the region video position information. A transmission request for determining to request transmission of the j-th (1 ≦ j ≦ N) video stream so that the largest number of output images can be obtained. And a transmission request step for requesting the video transmission device to transmit the j-th video stream determined in the transmission request determination step. It is.

In order to solve the above-described problem, the present invention provides an area in which a video transmission apparatus is a coordinate position of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions. An area image position information transmitting step for transmitting image position information, and the image transmitting apparatus encodes M (M ≦ N) a ₁ to a _m area images from a part of image information of the original image. A stream transmission step of multiplexing and transmitting a corresponding stream ID and a corresponding stream ID; an area image position information receiving step in which the image receiving apparatus receives the N area image position information; and the image A stream receiving step in which the receiving apparatus receives the M (M ≦ N) a ₁ to a _m th streams; and the video receiving apparatus determines whether the output image coordinate position relative to the reference position Based on the serial area image position information, i th as the number of pixels to obtain most of the output image (i is any one of a ₁ a _m) and the reading determining step of determining that the read out video stream, The video reception device searches for and reads out the i-th video stream determined in the read determination step based on the stream ID in the encoded data, and the video reception device performs the search readout. A decoding step of decoding the i-th video stream read in step, an image cutting-out step in which the video receiving apparatus cuts out and outputs a part of the decoded image obtained in the decoding step, and the video receiving apparatus Is the coordinate position of the output image with respect to the reference position using the region video position information of the i-th video stream. A cutout position determining step for determining a cutout position in the image cutout step so as to be the same, an output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image, and the video receiving device However, based on the coordinate position of the next output image with respect to the reference position and the region image position information, the number of pixels of the next output image is obtained from M (M <= N) b _1. b a transmission request determination step for determining to request transmission of the _m- th video stream, and the video reception device transmits the b ₁ to b _m- th video streams determined in the transmission request determination step. And a transmission requesting step for requesting the video transmitting apparatus.

In order to solve the above-described problem, the present invention relates to _Nk (1 ≦ k ≦ L) reference positions on each surface for L (L ≧ 2) surfaces expressed in two dimensions. And decoding a part of the encoded data based on encoded data composed of area video position information indicating different coordinate positions of the video and a plurality of video streams corresponding to the area video position information. A video decoding method for obtaining an output image, wherein a pixel of the output image is based on a coordinate position of the output image with respect to the reference position and the region video position information on a plane c (1 ≦ c ≦ L) where the output image is cut out A read decision step for deciding to read the i-th (1 ≦ i ≦ N _c ) video stream so that the largest number can be obtained, and a read for reading the i-th video stream determined in the read decision step A decoding step for decoding the i-th video stream obtained in the reading step, an image clipping step for cutting out and outputting a part of the decoded image obtained in the decoding step, and the i-th video And a cut-out position determining step for determining a cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the stream. Decoding method.

In order to solve the above-described problem, the present invention relates to _Nk (1 ≦ k ≦ L) reference positions on each surface for L (L ≧ 2) surfaces expressed in two dimensions. Encoded data composed of one stream obtained by multiplexing area video position information indicating different coordinate positions, a plurality of video streams corresponding to each area video position information, and a stream ID for distinguishing each video stream. And a coordinate position of the output image with respect to the reference position in a plane c (1 ≦ c ≦ L) where the output image is cut out. And the region video position information, a read determination step for determining to read out the i-th (1 ≦ i ≦ N _c ) video stream so that the number of pixels of the output image is maximized; Based on the stream ID in the encoded data, a search / read step for searching and reading the i-th video stream determined in the read determination step, and decoding the i-th video stream read in the search / read step A decoding step of cutting out, an image cutting out step of cutting out and outputting a part of the decoded image obtained in the decoding step, and a coordinate position of the output image with respect to the reference position using region video position information of the i-th video stream And a cut-out position determining step for determining a cut-out position in the image cut-out step so as to be the same.

In order to solve the above-described problem, the present invention is directed to a video transmission apparatus that performs N _k (1) with respect to a reference position defined on each plane for L (L ≧ 2) planes expressed in two dimensions. ≦ k ≦ L) an area image position information transmitting step for transmitting all area image position information that is the coordinate positions of the partial area images, and the image transmitting apparatus includes a plane c (1 ≦ c ≦ L). A stream transmission step of transmitting an i-th (1 ≦ i ≦ N _c ) stream among Nc region image image streams, and region image position information reception in which the image receiving apparatus receives all region image position information. A stream receiving step in which the video receiving apparatus receives the i-th video stream; and the i-th video stream received in the stream receiving step by the video receiving apparatus. A read step, the video receiving device decoding the i-th video stream read in the read step, and the video receiving device cutting out a part of the decoded image obtained in the decoding step And the image cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same by using the i-th region image position information. A cut-out position determining step for determining the next output image, an output image plane designating step for designating a plane d (1 ≦ d ≦ L) from which the video receiving device cuts out the next output image, and the video receiving device for performing the next output. An output image coordinate designating step for designating the coordinate position of the image, and the video receiving device designating in the output image plane designating step In the plane d, the reference position based on the coordinate position and the area image position information of the next output image with respect to, the following output j th such that the number of pixels of the image are obtained most (1 ≦ j ≦ N _d ) A transmission request determining step for determining that transmission of a video stream is requested, and the video receiving apparatus is determined to be j-th (1 ≦ 1) in the plane d (1 ≦ d ≦ L) determined in the transmission request determining step. and a transmission requesting step for requesting the video transmission apparatus to transmit a video stream of j ≦ N _d ).

In order to solve the above-described problem, the present invention is directed to a video transmission apparatus that performs N _k (1) with respect to a reference position defined on each plane for L (L ≧ 2) planes expressed in two dimensions. ≦ k ≦ L) an area image position information transmission step for transmitting all area image position information, which are coordinate positions of partial area images, and the image transmitting apparatus includes image streams of all area images and each image Stream transmission step of extracting and transmitting one stream obtained by multiplexing M number of a ₁ to a _m th video streams and corresponding stream IDs from one stream obtained by multiplexing stream IDs for distinguishing streams When, the video receiving apparatus, and all the areas area image positional information receiving step of receiving the video location information, the video receiving apparatus, from the M a ₁ a _m-th stream A stream receiving step for receiving the image, and the video receiving device based on the coordinate position of the output image with respect to the reference position and the area video position information on the plane c (1 ≦ c ≦ L) where the output image is cut out i-th as the number of pixels to obtain most of the output image (i is any one of a ₁ a _m) and the reading determining step of determining that the read out video stream, the video receiving apparatus, encoded data in A search readout step for searching and reading out the i-th video stream determined in the readout determination step based on the stream ID of the video, and the video reception device reading out the i-th video stream in the search readout step. A decoding step of decoding the video stream; and the video receiving apparatus extracts a part of the decoded image obtained in the decoding step. And the image cutout step so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream. A cut-out position determining step for determining a cut-out position at, an output image plane designating step for designating one or more planes d (1 ≦ d ≦ L) from which the video receiving apparatus cuts out the next output image, An output image coordinate designating step in which the receiving device designates a coordinate position of the next output image, and a coordinate of the next output image with respect to the reference position on the surface d designated by the video receiving device in the output image surface designating step on the basis of the position and said area picture position information, as the number of pixels in the next output image is obtained often sent from M b ₁ of b _m-th video stream A transmission request determining step of determining to request transmission of the video receiving apparatus, a transmission from said transmission request determining the b ₁ determined in step b _m-th video stream, requesting the image transmission device A video transmission / reception method including a request unit.

In order to solve the above-described problem, the present invention is directed to a video transmission apparatus that performs N _k (1) with respect to a reference position defined on each plane for L (L ≧ 2) planes expressed in two dimensions. ≦ k ≦ L) an area image position information transmitting step for transmitting all area image position information which are coordinate positions of partial area images, and the image transmitting apparatus includes one or more planes c (1 ≦ c). ≦ L) a stream transmission step of encoding the i-th (1 ≦ i ≦ N _c ) region video from a part of the image information of the original video and transmitting the video stream; Region video position information receiving step for receiving information, a stream receiving step for receiving the i-th video stream by the video receiving device, and the i received by the video receiving device in the stream receiving step. A read step for reading the th video stream; a decoding step for decoding the i th video stream read by the video reception device in the read step; and a decoded image obtained by the video reception device in the decoding step. The image cut-out step of cutting out and outputting a part, and the video reception device uses the region video position information of the i-th video stream so that the coordinate position of the output image with respect to the reference position is the same. A cut-out position determining step for determining a cut-out position in the image cut-out step, an output image plane designating step for designating a plane d (1 ≦ d ≦ L) from which the video receiving apparatus cuts out the next output image, and the video receiving An output image coordinate designating step in which the device designates a coordinate position of the next output image; Based on the coordinate position of the next output image with respect to the reference position and the region image position information on the surface d designated in the output image surface designation step, the j-th so as to obtain the largest number of pixels of the next output image. A transmission request determining step for determining that transmission of a video stream of (1 ≦ j ≦ N _d ) is requested, and the video receiving device transmits the j-th video stream determined in the transmission request determining step. And a transmission requesting step for requesting the video transmission apparatus.

In order to solve the above-described problem, the present invention is directed to a video transmission apparatus that performs N _k (1) with respect to a reference position defined on each plane for L (L ≧ 2) planes expressed in two dimensions. ≦ k ≦ L) an area image position information transmitting step for transmitting all area image position information which are coordinate positions of partial area images, and the image transmitting apparatus includes one or more planes c (1 ≦ c). A stream transmission step of multiplexing and transmitting a video stream obtained by encoding M a ₁ to a _m th region videos from a part of image information of the original video in ≦ L) and a corresponding stream ID; video receiving apparatus, and all the areas area image positional information receiving step of receiving the video location information, the video receiving apparatus, a stream receiving step of receiving a _m-th stream from the M a _1, the movies Based on the coordinate position of the output image with respect to the reference position and the region video position information on the surface c (1 ≦ c ≦ L) where the receiving device cuts out the output image, the largest number of pixels of the output image can be obtained. the i-th (i is any one of a ₁ a _m) and the reading determining step of determining that the read out video stream, the video receiving apparatus, based on the stream ID in the coded data, the read decision step A search and readout step for searching and reading out the i-th video stream determined in step (a), a decoding step in which the video reception device decodes the i-th video stream read out in the search and readout step, and the video An image cut-out step in which the receiving device cuts out and outputs a part of the decoded image obtained in the decoding step; and the video reception A cut-out position determining step in which the apparatus determines the cut-out position in the image cut-out step so that the coordinate position of the output image with respect to the reference position is the same using the region video position information of the i-th video stream; An output image plane designating step in which the video receiving apparatus designates one or more planes d (1 ≦ d ≦ L) from which the next output image is cut out; and the video receiving apparatus sets the coordinate position of the next output image. Based on the coordinate position of the next output image relative to the reference position and the area video position information on the surface d designated by the output image coordinate designation step and the video receiving device designated in the output image plane designation step, as the number of pixels in the next output image is obtained much, and the transmission request determining step of determining that the requesting transmission of b _m-th video stream from M b ₁ A video transmission / reception method comprising: the video reception device including a transmission request step for requesting the video transmission device to transmit the b1 to bm-th video streams determined in the transmission request determination step. .

  According to the present invention, when only a partial area of a video is viewed, the position of the output image specified by the user, even when viewing with a computer that has a low processing capacity and can only decode one video stream. The video stream can be decoded so that the number of pixels to be displayed is the largest.

It is a block diagram which shows the structure of the video decoding apparatus by this 1st Embodiment. It is a conceptual diagram which shows an example of the positional relationship of an area | region image | video and an output image used by this 1st Embodiment. It is a conceptual diagram which shows the format of the multiplexed encoded data used in the second embodiment. It is a block diagram which shows the structure of the video decoding apparatus by this 2nd Embodiment. It is a block diagram which shows the structure of the video transmission apparatus by this 3rd Embodiment. It is a block diagram which shows the structure of the video receiver by this 3rd Embodiment. It is a block diagram which shows the structure of the video transmission apparatus by the modification of this 3rd Embodiment. It is a block diagram which shows the structure of the video transmission apparatus by this 4th Embodiment. It is a block diagram which shows the structure of the video receiver by 4th Embodiment. It is a block diagram which shows the structure of the video decoding apparatus by this 5th Embodiment. It is a conceptual diagram which shows an example of the positional relationship of an area | region image | video and an output image in this 5th Embodiment. It is a conceptual diagram which shows the format of the multiplexed encoded data used in the sixth embodiment. It is a block diagram which shows the structure of the video decoding apparatus by this 6th Embodiment. It is a block diagram which shows the structure of the video transmission apparatus by this 7th Embodiment. It is a block diagram which shows the structure of the video receiver by this 7th Embodiment. It is a block diagram which shows the structure of the video receiver by this 8th Embodiment. It is a conceptual diagram which shows an example of the positional relationship of an area | region image | video and an output image used by this 8th Embodiment. It is a conceptual diagram which shows the example of the positional relationship of the conventional tile structure and an output image. It is a conceptual diagram which shows the example of the method of producing | generating the image | video of another viewpoint from a color signal and depth information.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
The present invention relates to a technique for extracting and decoding a video stream of an output image from a plurality of region videos. A feature of the present invention is that even if a computer with low processing capability is capable of decoding only one video stream by not using the conventional tile division format for a plurality of input region videos, the output image position specified by the user can be reduced. It is possible to view with the largest number of pixels displayed.

A. First Embodiment In the first embodiment, one stream is decoded from encoded data of video information composed of three (A, B, C) area video streams for a two-dimensional plane. An example of a video decoding apparatus that obtains image information will be described.

  FIG. 1 is a block diagram showing the configuration of the video decoding apparatus according to the first embodiment. In FIG. 3, the video decoding device 10 includes an area video stream switching unit 100, a reading unit 101, a reading determination unit 102, a decoding unit 103, an image cutout unit 104, and a cutout position determination unit 105. The area video stream switching unit 100 selects one area video stream from among the three area video streams A, B, and C. The reading unit 101 reads one area video stream determined by the reading determination unit 102 via the area video stream switching unit 100.

  The read determination unit 102 determines one area video stream to be read out of the three area video streams A, B, and C based on the output image coordinate position and the area video position information. The decoding unit 103 decodes the area video stream read by the reading unit 101. The image cutout unit 104 cuts out and outputs a part of the decoded area video according to the cutout position determined by the cutout position determination unit 105. The cutout position determination unit 105 determines the cutout position of the encoded region video based on the output image coordinate position and the region video position information.

  FIG. 2 is a conceptual diagram showing an example of the positional relationship between the region video and the output image used in the first embodiment. Here, the position of the area image relative to the image may be set so that there is an overlap between the area images A, B, and C, as shown in FIG. If there is an overlap in this way, it is possible to select a stream of area video that includes more pixels with respect to the position of the designated output image. Further, it is assumed that the three video streams and the region video position information are given to the video decoding device in advance.

  Next, an operation for decoding an area video and acquiring an output image in the first embodiment will be described. First, assume that the user sets the position of the output image. The read determination unit 102 determines, as the area video to be read, the area video having the largest number of pixels of the output image for each area video according to the output image coordinate position on the two-dimensional plane and the area video position information. In the case of the example illustrated in FIG. 2, the area video B is the largest, so the read determination unit 102 determines the area video B as the area video stream to be read.

  Then, the reading unit 101 reads the area video stream B determined by the reading determination unit 102, and the decoding unit 103 decodes the area video stream B and acquires a decoded image. The cutout position determination unit 105 determines a position to cut out the output image from the decoded image according to the output image coordinate position and the region video position information. The image cutout unit 104 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  According to the first embodiment described above, N area videos are set for a video, and the video stream is prepared so that the number of display pixels is maximized when the video stream is prepared and decoded. Can be decrypted after selecting. Then, an image can be cut out and output in accordance with the position of the region video.

B. Second Embodiment Next, a second embodiment of the present invention will be described.
In the second embodiment, a specific area video stream is read out from encoded data in which three (A, B, C) area video streams are multiplexed with a stream ID with respect to a two-dimensional plane. It is characterized by obtaining information.

  FIG. 3 is a conceptual diagram showing a format of multiplexed encoded data used in the second embodiment. Each area video stream is divided into a plurality of appropriate portions, and each divided stream is multiplexed with a status code (start code information) and a stream ID at the head. To do. The status code is a code word having a unique encoded sequence, and the position of each divided stream can be determined by searching for the code word in the stream.

  FIG. 4 is a block diagram showing the configuration of the video decoding apparatus according to the second embodiment. It should be noted that portions corresponding to those in FIG. The search reading unit 106 searches for and reads a stream of a specific area video from the multiplexed encoded data according to the area video to be read determined by the read determination unit 102. It is assumed that the position of the three area images on the surface and the position of the output image are the same as those in FIG. Further, it is assumed that the encoded data and the region video position information are given in advance to the video decoding device.

  Next, an operation for decoding an area video and acquiring an output image in the second embodiment will be described. First, assume that the user sets the position of the output image. The read determination unit 102 determines an area image in which the number of pixels of the output image is the largest for each area image according to the output image coordinate position on the two-dimensional plane and the area image position information. In the case of the example illustrated in FIG. 2, the area video B is the largest, so the read determination unit 102 determines the area video B as the area video stream to be read.

  Then, the search reading unit 106 searches for the status code from the encoded data, reads the subsequent stream ID, determines the position of the region video stream B determined by the read determination unit 102, and determines the region video stream Read B. The decoding unit 103 decodes the area video stream B and acquires a decoded image. The cutout position determination unit 105 determines a position to cut out the output image from the decoded image according to the output image coordinate position and the region video position information. The image cutout unit 104 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  According to the second embodiment described above, when the area video stream is multiplexed, the ID is used to distinguish the area video stream from the multiplexed encoded data. The area video stream can be specified and extracted. Thereby, it is possible to select and decode the region video so that the number of pixels of the output image is the largest even for the multiplexed stream.

C. Third Embodiment Next, a third embodiment of the present invention will be described.
In the third embodiment, the video transmission device requests from the video reception device among the encoded data of the video information composed of three (A, B, C) area video streams for the two-dimensional plane. One stream is transmitted, and the video receiving apparatus decodes the stream to obtain image information.

  FIG. 5 is a block diagram showing the configuration of the video transmission apparatus according to the third embodiment. In FIG. 5, the video transmission device 20 includes an area video stream switching unit 200, a stream transmission unit 201, and an area video position information transmission unit 202. The area video stream switching unit 200 selects one area video stream from among the three area video streams A, B, and C. The stream transmission unit 201 transmits one selected area video stream. The area video position information transmission unit 202 transmits area video position information.

  FIG. 6 is a block diagram showing the configuration of the video receiving apparatus according to the third embodiment. In FIG. 6, the video receiving device 30 includes an area video position information receiving unit 301, a cutout position determining unit 302, a stream receiving unit 303, a reading unit 304, a decoding unit 305, an image cutout unit 306, an output image coordinate designating unit 307, and transmission. The request determination unit 308 and the transmission request unit 309 are included.

  The area video position information receiving unit 301 receives area video position information. The cutout position determination unit 302 determines the cutout position according to the output image coordinate position transmitted from the video transmission device 20. The stream receiving unit 303 receives a stream transmitted from the video transmission device 20. The reading unit 304 reads the received stream. The decoding unit 305 decodes the read stream. The image cutout unit 306 cuts out a part from the decoded image according to the cutout position determined by the cutout position determination unit 302 and outputs the cutout image.

  The output image coordinate designation unit 307 designates the coordinate position of the next output image according to the output image coordinate position transmitted from the video transmission device 20. The transmission request determination unit 308 determines the requested area video according to the area video position information and the coordinate position of the next output image. The transmission request unit 309 requests the determined area video.

  It is assumed that the position of the three area images on the surface and the position of the output image are the same as those in FIG. In the video transmission device 20, it is assumed that three video streams and area video position information are given in advance.

  Further, there is an area video ID (any one of A, B, and C) as information for distinguishing the area video, and the transmission request unit 309 of the video receiving apparatus 30 transmits the area video ID and the stream of the video transmitting apparatus 20. The transmission unit 201 receives the region video ID. In addition, the stream transmission unit 201 of the video transmission device 20 transmits the area video stream A when there is no request from the video reception device 30.

  Next, an operation for acquiring an output image by transmitting and receiving an area video stream and decoding the area video in the third embodiment will be described. First, in the video transmission device 20, the area video position information transmission unit 202 transmits area video position information. In the video receiving device 30, the region video position information receiving unit 301 receives the region video position information transmitted from the video transmitting device 20.

  Next, in the video transmission apparatus 20, the stream transmission unit 201 transmits the area video stream A because there is no request from the video reception apparatus 30. In the video reception device 30, the stream reception unit 303 receives the regional video stream A from the video transmission device 20, reads the regional video stream A received by the reading unit 304, and the decoding unit 305 decodes the regional video stream A. To obtain a decoded image.

  The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the coordinate position of the area video stream A and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  The output image coordinate position designation unit 307 designates the coordinate position of the next output image. The transmission request determination unit 308 determines the area video stream C (in the example of FIG. 2) from the coordinate position of the next output image. The transmission request unit 309 transmits the area video ID of the area video stream C.

  Subsequently, in the video transmission device 20, the stream transmission unit 201 receives the area video ID of the area video stream C as the area video ID, and therefore transmits the area video stream C. In the video receiving device 30, the stream receiving unit 303 receives the stream (in this case, the region video stream C) from the video transmitting device 20, reads the stream received by the reading unit 304, and the decoding unit 305 decodes the stream. To obtain a decoded image.

  The cutout position determination unit 302 determines a position to cut out the output image from the decoded image according to the coordinate position of the area video stream C and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

The above processing is repeatedly executed every time the position of the output image is designated.
Note that the video transmission apparatus 20 may not be prepared in advance with a video stream, but may be a method of cutting out and encoding an area video when transmitting and transmitting the obtained stream. The configuration of the video transmission apparatus in this case is shown in FIG. In FIG. 7, the stream enhancement unit 201a reads the original video 203 when transmitting, cuts out and encodes the region video, and transmits the obtained stream. In this case, it is possible to transmit after encoding the area video stream on the video transmission apparatus side. Thereby, it is not necessary to prepare the encoded data of the area video stream in advance on the video transmitting apparatus side, and it is possible to encode and transmit only the necessary area video on the video receiving side.

  According to the above-described third embodiment, there are also a video transmission device that transmits a video stream and a video reception device that receives the video stream, so that the number of pixels of an image to be output next on the video reception device side is maximized. A stream request can be made to the video transmission apparatus. As a result, the transmission amount between the video transmission device and the video reception device can be reduced by requesting the video transmission device only for a necessary region video stream without receiving all the region videos.

D. Fourth Embodiment Next, a fourth embodiment of the present invention will be described.
In the fourth embodiment, a video transmission apparatus requests a stream of three (A, B, C) area videos for a two-dimensional plane from encoded data multiplexed with a stream ID from a video reception apparatus. A plurality of region video streams are transmitted, and the video reception device decodes the streams to obtain image information.

  FIG. 8 is a block diagram showing the configuration of the video transmission apparatus according to the fourth embodiment. In FIG. 8, the format of the multiplexed encoded data is the same as that shown in FIG. The video transmission device 20b includes a stream transmission unit 201b that searches for and transmits a stream of a specific area video from the multiplexed encoded data, and an area video position information transmission unit 202 that transmits area video position information. Yes.

  FIG. 9 is a block diagram showing the configuration of the video receiving apparatus according to the fourth embodiment. Note that portions corresponding to those in FIG. 6 are denoted by the same reference numerals and description thereof is omitted. In FIG. 9, the reading determination unit 310 determines a stream to be read according to the output image coordinate position and the area video position information. The search / read unit 311 searches for and reads the stream determined by the read determination unit 310 from the received stream.

  It is assumed that the position of the three area images on the surface, the position of the output image, and the position of the next output image are the same positions as in FIG. Also, in the video transmission device 20, it is assumed that the encoded data and the region video position information are given in advance. In addition, the stream transmission unit 201b of the video transmission device 20b transmits the area video streams A and B when there is no request from the video reception device 30a. In the video reception device 30a, the transmission request determination unit 308 determines to request two area videos having a large number of pixels in the output image.

  Next, in the fourth embodiment, an operation of transmitting and receiving a region video stream, decoding the region video, and obtaining an output image will be described. First, in the video transmission device 20b, the area video position information transmission unit 202 transmits area video position information. In the video receiving device 30a, the region video position information receiving unit 301 receives the region video position information transmitted from the video transmitting device 20b.

  Next, in the video transmission device 20b, the stream transmission unit 201b transmits the area video streams A and B because there is no request from the video reception device 30a. In the video reception device 30a, the stream reception unit 303 receives the regional video streams A and B from the video transmission device 20b. The read determining unit 310 determines, as the area video stream to be read, the area video having the largest number of pixels of the output image for each area video according to the coordinate position of the output image on the two-dimensional plane and the area video position information. . In the case shown in FIG. 2, since the area video B is the largest, the area video B is determined as the area video stream to be read.

  Then, the search reading unit 311 searches for the status code from the encoded data, reads the subsequent stream ID information, determines the position of the area video stream B, and reads the area video stream B. The decoding unit 305 acquires a decoded image by decoding the stream (in this case, the region video stream B). The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the region video position information of the region video stream B and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  The output image coordinate position designation unit 307 designates the coordinate position of the next output image. The transmission request determination unit 308 determines the area video streams B and C from the coordinate position of the next output image. The transmission request unit 309 transmits the area video IDs of the area video streams B and C.

  Subsequently, in the video transmission device 20b, the stream transmission unit 201b receives the area video IDs of the area video streams B and C as the stream ID, and therefore transmits the area video streams B and C. In the video reception device 30a, the stream reception unit 303 receives a stream (in this case, the region video streams B and C) from the video transmission device 20b, and the read determination unit 310 has the number of pixels of the output image as the region video C. Since it is the largest, the area video C is determined as the area video stream to be read.

  Then, the search reading unit 311 searches for the status code from the encoded data, reads the subsequent stream ID, determines the position of the area video stream C, and reads the area video stream C. The decoding unit 305 acquires a decoded image by decoding the stream (in this case, the region video stream C). The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the region video position information of the region video stream C and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

The above processing is repeatedly executed every time the position of the output image is designated.
Note that the position of the next output image changes from the previous output image until the video receiving device 30a transmits the stream IDs of the area video streams B and C and receives the corresponding stream from the video transmitting device 20b. If there is no position (therefore, the position of the output image does not change), the video receiving device 30a reads the stream received by the stream receiving unit 303, and the read determining unit 310 determines that the number of pixels of the output image is the region video. Since B is the largest, the region video B is determined as a stream to be read, the search reading unit 311 reads the region video B stream, and the decoding unit 305 decodes the stream to obtain a decoded image. The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the coordinate position of the region video stream B and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  Note that the video transmission apparatus 20b may not be prepared in advance with a video stream, but may be a method in which an area video is cut out and encoded when transmitting and the resulting stream is transmitted. In this case, it is possible to transmit after encoding the area video stream on the video transmission apparatus side. Thereby, it is not necessary to prepare the encoded data of the area video stream in advance on the video transmitting apparatus side, and it is possible to encode and transmit only the necessary area video on the video receiving side.

  According to the above-described fourth embodiment, a plurality of area video streams are received from the video transmission apparatus, and the area video can be selected and decoded so that the number of pixels of the output image is maximized by the video reception apparatus. Furthermore, the video receiving apparatus can request a plurality of streams from the video transmitting apparatus so that the number of pixels of the image to be output next is maximized. As a result, there is a time difference between the time when the position of the next output image is set in the video receiving apparatus and the time when the area video stream is received for that, due to the communication delay or the like. Can be selected and decoded from a plurality of area videos so that the number of pixels of the designated output image is maximized.

E. Fifth Embodiment Next, a fifth embodiment of the present invention will be described.
In the fifth embodiment, three (A, B, C) region video streams for a two-dimensional surface with resolution P and two (D, E) regions for a two-dimensional surface with resolution Q Image data is obtained by decoding one stream of encoded data of video information composed of a video stream.

  FIG. 10 is a block diagram showing the configuration of the video decoding apparatus according to the fifth embodiment. It should be noted that portions corresponding to those in FIG. 10, the area video stream switching unit 100a includes a total of five area video streams A to B including three area video streams A, B, and C (surface P) and two area video streams D and E (surface Q). From E, one area video stream is selected. The read determining unit 102a determines one area video stream to be read out of the five area video streams A to E according to the output image coordinate position, the area video position information, and the designated output image resolution.

  Note that the position of each region video on the plane of resolution P and Q and the position of the output image are as shown in FIG. In addition, the position of the output image is set on the surface of the resolution P. Also, it is assumed that all video streams and area video position information are given in advance to the video decoding device 10b.

  Next, an operation for decoding an area video and obtaining an output image in the fifth embodiment will be described. First, it is assumed that the user sets the resolution P and position of the output image. The read determining unit 102a determines, as the region video to be read, the region video having the largest number of pixels of the output image for each region video according to the output image coordinate position on the plane of resolution P and the region video position information. In the case illustrated in FIG. 11, the area video B is the largest on the plane of resolution P, and therefore the area video B is determined as the area video stream to be read.

  Then, the reading unit 101 reads the area video stream B determined by the read determining unit 102a, and the decoding unit 103 decodes the stream to obtain a decoded image. The cutout position determination unit 105 determines a position to cut out the output image from the decoded image according to the output image coordinate position of the region video stream B and the region video position information. The image cutout unit 104 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  In the fifth embodiment, the area video is defined by two planes having different resolutions, but the area video may be defined by two planes separated in spatial positions. The operation in this case may be the same procedure as in the fifth embodiment.

  According to the fifth embodiment described above, for example, a plurality of original videos are set for spatial positions that are far apart, and an area video is set to the original video, thereby selecting the original video corresponding to the spatial position of the output image. You can then select the region video and decode it. Alternatively, by preparing videos of a plurality of resolutions as the original video and setting the area video for them, it is possible to select and decode the area video corresponding to the resolution of the output image. Thereby, the resolution of the output image can also be selected.

F. Sixth Embodiment Next, a sixth embodiment of the present invention will be described.
In the sixth embodiment, three (A, B, C) region video streams for a two-dimensional surface with resolution P and two (D, E) regions for a two-dimensional surface with resolution Q A video stream is obtained by reading a stream of a specific area video from encoded data multiplexed with a stream ID to obtain image information.

  FIG. 12 is a conceptual diagram showing a format of multiplexed encoded data used in the sixth embodiment. It is assumed that each area video stream is divided into a plurality of appropriate portions, and each divided stream is multiplexed with a start code and a stream ID at the head. The start code is a code word having a unique coded sequence, and the position of each divided stream can be determined by searching for the code word in the stream.

  FIG. 13 is a block diagram showing the configuration of the video decoding apparatus according to the sixth embodiment. In addition, the same code | symbol is attached | subjected to the part corresponding to FIG.1, FIG.4, FIG.10. The read determining unit 102a determines a region video to be read according to the output image coordinate position, the region video position information, and the output image resolution. The search reading unit 106 searches for and reads a stream of a specific area video from the multiplexed encoded data in accordance with the determined area video.

  Note that the position of each region video and the position of the output image on the surfaces of resolutions P and Q are the same as those in FIG. In addition, the position of the output image is set on the surface of the resolution P. Also, it is assumed that all video streams and area video position information are given in advance to the video decoding device 10c.

  Next, in the sixth embodiment, an operation for decoding an area video and obtaining an output image will be described. First, it is assumed that the user sets the resolution P and position of the output image. The read determining unit 102a determines, as the region video to be read, the region video having the largest number of pixels of the output image for each region video according to the output image coordinate position on the plane of resolution P and the region video position information. In the case illustrated in FIG. 11, the area video B is the largest on the plane of resolution P, and therefore the area video B is determined as the area video stream to be read.

  Then, the search / read unit 106 searches for the status code from the encoded data, reads the subsequent stream ID, determines the position of the region video stream B determined by the read determination unit 102a, and determines the region video stream Read B. The decoding unit 103 decodes the area video stream B and acquires a decoded image.

  The cutout position determination unit 105 determines a position to cut out the output image from the decoded image according to the output image coordinate position of the region video stream B and the region video position information. The image cutout unit 104 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  In the sixth embodiment, the area video is defined by two planes having different resolutions, but the area video may be defined by two planes separated in spatial position. The operation in this case may be the same procedure as in the sixth embodiment.

  According to the sixth embodiment described above, for example, a plurality of original videos are set for spatial positions that are far apart, and an area video is set to the original video, thereby selecting the original video corresponding to the spatial position of the output image. You can then select the region video and decode it. Alternatively, by preparing videos of a plurality of resolutions as the original video and setting the area video for them, it is possible to select and decode the area video corresponding to the resolution of the output image. Thereby, the resolution of the output image can also be selected.

G. Seventh Embodiment Next, a seventh embodiment of the present invention will be described.
In the seventh embodiment, in the video transmission device, three (A, B, C) area video streams for the two-dimensional plane of resolution P and two (D for the two-dimensional plane of resolution Q) (D , E) Among the encoded data of the video information composed of the area video stream, one stream requested from the video receiving device is transmitted, and the video receiving device decodes the stream to obtain the image information. It is characterized by that.

  FIG. 14 is a block diagram showing the configuration of the video transmission apparatus according to the seventh embodiment. In addition, the same code | symbol is attached | subjected to the part corresponding to FIG.5, FIG.7, FIG.8, and description is abbreviate | omitted. The area video stream switching unit 200a includes a total of five area video streams A to E including three area video streams A, B, and C (plane P) and two area video streams D and E (plane Q). Select one region video stream.

  FIG. 15 is a block diagram showing the configuration of the video receiving apparatus according to the seventh embodiment. Note that portions corresponding to those in FIGS. 6 and 9 are denoted by the same reference numerals and description thereof is omitted. The output image plane designating unit 312 designates the resolution of the next output image. The output image coordinate designating unit 307a designates the coordinate position of the next output image according to the output image coordinate position and the resolution of the designated next output image. The transmission request determination unit 308a determines a requested region image from the region image position information, the resolution of the next output image, and the coordinate position.

  Note that the position of each region video and the position of the output image on the surfaces of resolutions P and Q are the same as those in FIG. The position of the output image is set on the plane of resolution P, and the position of the next output image is set on the plane of resolution Q. Also, it is assumed that all video streams and area video position information are given in advance to the video transmission device 20c.

  The area video position information is position information with respect to a reference position that differs for each resolution, and includes resolution information and position information. In addition, as information for distinguishing region images, there is region image ID (A, B, C, D, or E). The transmission request unit 309 of the video reception device 30b transmits the region video ID, and the stream transmission unit 201 of the video transmission device 20c receives the transmitted region video ID. In addition, the stream transmission unit 201 of the video transmission device 20c transmits the region video stream A having the resolution P when there is no request from the video reception device 30b.

  Next, an operation of acquiring and outputting an output image by transmitting and receiving a stream of region video and decoding the region video in the seventh embodiment will be described. First, in the video transmission device 20c, the area video position information transmission unit 202 transmits area video position information. In the video reception device 30b, the regional video position information receiving unit 301 receives the regional video position information transmitted from the video transmission device 20c.

  Next, in the video transmission device 20c, the stream transmission unit 201 transmits the region video stream A with the resolution P because there is no request from the video reception device 30b. In the video reception device 30b, the stream reception unit 303 receives the regional video stream A from the video transmission device 20c, reads the regional video stream A received by the reading unit 304, and the decoding unit 305 decodes the regional video stream A. To obtain a decoded image.

  The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the coordinate position of the region video stream A having the resolution P and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  The output image plane designating unit 312 designates the resolution Q of the next output image. The output image coordinate position designation unit 307a designates the coordinate position of the next output image. The transmission request determination unit 308 determines the region video E from the coordinate position of the next output image (see the surface Q in FIG. 11). The transmission request unit 309 transmits the area video ID of the area video E.

  Subsequently, in the video transmission device 20c, the stream transmission unit 201 receives the area video ID of the area video E as the area video ID, and therefore transmits the area video stream E of resolution Q. In the video receiving device 30b, the stream receiving unit 303 receives the stream from the video transmitting device 20c, reads the stream received by the reading unit 304, and the decoding unit 305 decodes the stream to obtain a decoded image.

  The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the coordinate position of the region video stream E with the resolution Q and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

The above processing is repeatedly executed every time the position of the output image is designated.
Note that the video transmission apparatus 20c may be a method in which a video stream is not prepared in advance, but a region video is cut out and encoded when transmitting, and the obtained stream is transmitted. In the seventh embodiment, the area video is defined by two planes having different resolutions, but the area video may be defined by two planes separated in spatial positions. The operation in this case may be the same procedure as in the seventh embodiment.

  According to the seventh embodiment described above, on the video transmission device side, for example, by setting a plurality of original videos for spatial positions that are far apart, and setting an area video to the original video, It is possible to select and decode an area image after selecting an original image corresponding to a spatial position. Alternatively, the video transmission device prepares videos with multiple resolutions as the original video, and sets the region video for them, so that the video reception device selects the region video corresponding to the resolution of the output image. Can be decrypted. Thereby, the resolution of the output image can also be selected.

H. Eighth Embodiment Next, an eighth embodiment of the present invention will be described.
In the eighth embodiment, in the video transmission apparatus, three (A, B, C) area video streams for the two-dimensional plane of resolution P and two (D for the two-dimensional plane of resolution Q) (D , E) from the encoded data multiplexed with the stream ID, a plurality of area video streams requested from the video receiving apparatus are transmitted, and the streams are decoded by the video receiving apparatus. It is characterized by obtaining information.

  In the eighth embodiment, the configuration of the video transmission apparatus is the same as that in FIG. That is, the video transmission device 20b includes a stream transmission unit 201b that searches for and transmits a stream of a specific area video from the multiplexed encoded data, and an area video position information transmission unit 202 that transmits area video position information. I have. The format of the multiplexed encoded data used in the eighth embodiment is the same as that in FIG.

  FIG. 16 is a block diagram showing the configuration of the video receiving apparatus according to the eighth embodiment. In addition, the same code | symbol is attached | subjected to the part corresponding to FIG. 9, FIG. In FIG. 16, the video receiving device 30 c includes an area video position information receiving unit 301 that receives area video position information, a cutout position determining unit 302 that determines a cutout position, a stream receiving unit 303 that receives a stream, and a stream to be read. A read determination unit 310 for determining the stream, a search / read unit 311 for searching and reading the stream determined by the read determination unit 310 from the received stream, a decoding unit 305 for decoding the stream, and a part of the decoded image to be output An image cutout unit 306 to output, an output image plane specification unit 312 to specify the resolution of the next output image, an output image coordinate specification unit 307a to specify the coordinate position of the next output image, area video position information and the next output A transmission request determination unit 308 that determines an area image to be requested from the resolution and coordinate position of the image; Consisting the transmission request unit 309 for requesting the band image.

  Note that the position of each region video on the plane of resolution P and Q and the position of the output image are as shown in FIG. The position of the output image is set on the plane of resolution P, and the position of the next output image is set on the plane of resolution Q. Also, it is assumed that the video transmission device 20b is provided with encoded data and area video position information in advance.

  The area video position information is position information with respect to a reference position that differs for each resolution, and includes resolution information and position information. In addition, the stream transmission unit 201b of the video transmission device 20b transmits the region video streams A and B having the resolution P when there is no request from the video reception device 30c. In the video reception device 30c, the transmission request determination unit 308 determines to request two area videos having a large number of pixels of the output image as the next area video.

  Next, an operation of acquiring and outputting an output image by transmitting and receiving a stream of region video and decoding the region video in the eighth embodiment will be described. First, in the video transmission device 20b, the area video position information transmission unit 202 transmits area video position information. In the video reception device 30c, the regional video position information receiving unit 301 receives the regional video position information transmitted from the video transmission device 20b.

  Next, in the video transmission device 20b, the stream transmission unit 201b transmits the region video streams A and B with the resolution P because there is no request from the video reception device 30c. In the video reception device 30c, the stream reception unit 303 receives the regional video streams A and B from the video transmission device 20b. The read determining unit 310 determines, as the area video stream to be read, the area video having the largest number of pixels of the output image for each area video in accordance with the coordinate position of the output image having the resolution P and the area video position information. In the case shown in FIG. 11, since the area video B is the largest, the area video B is determined as the area video stream to be read.

  Then, the search reading unit 311 searches for the status code from the encoded data, reads the subsequent stream ID information, determines the position of the area video stream B, and reads the area video stream B. The decoding unit 305 acquires a decoded image by decoding the stream (in this case, the region video stream B). The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the region video position information of the region video stream B and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  The output image plane designating unit 312 designates the resolution Q of the next output image. The output image coordinate position designation unit 307a designates the coordinate position of the next output image. The transmission request determination unit 308 determines the region videos D and E from the coordinate position of the next output image. The transmission request unit 309 transmits the stream IDs of the area videos D and E.

  Subsequently, in the video transmission device 20b, the stream transmission unit 201b receives the stream IDs of the area videos D and E as the stream ID, and therefore transmits the area video streams D and E. In the video receiving device 30c, the stream receiving unit 303 receives the stream (in this case, the region video streams D and E) from the video transmitting device 20b, and the readout determining unit 310 has the number of pixels of the output image as the region at the resolution Q. Since the video E is the largest, the area video E is determined as the area video stream to be read.

  Then, the search reading unit 311 searches for the status code from the encoded data, reads the subsequent stream ID, determines the position of the area video stream E, and reads the area video stream E. The decoding unit 305 acquires a decoded image by decoding the stream (in this case, the region video stream E). The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the region video position information of the region video stream E and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position. The above processing is repeatedly executed every time the position of the output image is designated.

  According to the above-described eighth embodiment, a plurality of area video streams can be received from the video transmission apparatus, and the area video can be selected and decoded by the video reception apparatus so that the number of pixels of the output image is maximized. . At this time, it is also possible to receive a region video stream of a video of a different plane. In this case, it is possible to select and decode an area image close to the position where the output image is cut out. For example, at this time, it is also possible to receive an area video stream of video with different resolutions. In this case, the region video can be selected and decoded while selecting the resolution of the output image.

  In the eighth embodiment, the region image is defined by two surfaces having different resolutions. However, the region image may be defined by two surfaces having different spatial positions. The operation in this case may be the same procedure as in the eighth embodiment.

  Further, in the video reception device 30c, the transmission request determination unit 308 may determine to request a plurality of resolution area videos. For example, for two resolutions, it may be determined to request an area video with the largest number of pixels in the output image. According to this method, an output image can be obtained even when the resolution of the next output image does not change between the time when the region video is requested and the time when the stream is received.

  FIG. 17 is a conceptual diagram showing an example of the positional relationship between the region video and the output image used in the eighth embodiment. For the next output image, the resolutions P and Q are set. A procedure after the process of designating the resolution of the next output image in this case will be described. In the video reception device 30c, the output image plane designating unit 312 designates the resolutions P and Q of the next output image. The output image coordinate position designation unit 307a designates the coordinate position of the next output image for each resolution. The transmission request determination unit 308 determines the region videos C and E from the coordinate position of the next output image. The transmission request unit 309 transmits the stream IDs of the area videos C and E.

  Subsequently, in the video transmission device 20b, the stream transmission unit 201b receives the stream IDs of the area videos C and E, and therefore transmits the area video streams C and E. In the video reception device 30c, the stream reception unit 303 receives a stream (in this case, the regional video streams C and E) from the video transmission device 20b.

  At this time, when the resolution of the output image is P, the read determination unit 310 determines the area video C as a stream to be read because the number of pixels of the output image is the largest in the area video C. Then, the search reading unit 311 searches for the status code from the encoded data, reads the subsequent stream ID, determines the position of the area video stream C, and reads the area video stream C.

  The decoding unit 305 acquires a decoded image by decoding the stream. The cutout position determination unit 302 determines a cutout position for cutting out the output image from the decoded image according to the coordinate position of the region video C and the coordinate position of the output image. The image cutout unit 306 cuts out and outputs an output image from the decoded image according to the determined cutout position.

  In addition, when the resolution of the output image is Q, the read determining unit 310 determines the area video E as a stream to be read because the number of pixels of the output image is the largest in the area video E. Similarly, the region video stream E is decoded to cut out and output an image. The above processing is repeatedly executed every time the position of the output image is designated.

  Note that the video transmission apparatus 20b may not be prepared in advance with a video stream, but may be a method in which an area video is cut out and encoded when transmitting and the resulting stream is transmitted. In this case, it is possible to transmit after encoding the area video stream on the video transmission apparatus side. Thereby, it is not necessary to prepare the encoded data of the area video stream in advance on the video transmitting apparatus side, and it is possible to encode and transmit only the necessary area video on the video receiving apparatus side.

  According to the present invention, as image information, not only color signals but also information that can be handled as gray scale images such as transparency information and depth information may be handled together. In this case, the video stream includes not only the color signal but also transparency information and depth information, and the decoding unit 305 obtains not only the color signal but also transparency information and depth information. The image information obtained by cutting out from the image cutout unit 306 also includes transparency information and depth information. Display may be performed after the color signal is processed from the color signal of the image information obtained by the video decoding device or the video reception device of the present invention, transparency information, and depth information. For example, when there is depth information, it may be displayed as a stereoscopic video or as a video from another viewpoint.

10, 10a, 10b, 10c Video decoding device 100, 100a Area video stream switching unit 101 Reading unit 102, 102a Read determining unit 103 Decoding unit 104 Image clipping unit 105 Clipping position determining unit 106 Search reading unit 20, 20a, 20b, 20c Video transmission device 200, 200a Area video stream switching unit 201, 201a, 201b Stream transmission unit 202 Area video position information transmission unit 203 Original video 30, 30a, 30b, 30c Video reception device 301 Area video position information reception unit 302 Cutout position determination Unit 303 Stream receiving unit 304 Reading unit 305 Decoding unit 306 Image clipping unit 307, 307a Output image coordinate designation unit 308 Transmission request determining unit 309 Transmission requesting unit 310 Reading determining unit 311 Search reading Part 312 Output image plane designation part

Claims (24)

N areas whose positions are different from each other with respect to a reference position on a surface expressed in two dimensions are determined, and N video streams corresponding to the areas are displayed so as to respectively display the area videos corresponding to the areas. in configured encoded data or al, a video decoding apparatus to obtain the decoded output image a portion of the encoded data,
When the region video obtained by decoding the video stream corresponding to the region video is displayed in the region corresponding to the region video, the number of pixels that can display the region image is maximized at the position where the output image is displayed. i-th video stream (1 ≦ i ≦ N), and a read decision unit to decide based on the location of the area for displaying the area image and the coordinate position of the output image relative to the reference position,
A reading unit for reading the i-th video stream;
A decoding unit for decoding the i-th video stream read by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
Using information of positions relative to the reference position of the region image of the i-th video stream, the video decoding apparatus characterized by comprising an extraction position determination unit for determining the cut-out position in the image clipping unit. N areas whose positions are different from each other with respect to a reference position on a plane expressed in two dimensions are determined, and N video streams corresponding to the areas are displayed so as to respectively display area videos corresponding to the areas. and distinguishing a stream ID for each video stream multiplexed encoded data that consists of a single stream, a video decoding apparatus for obtaining an output image by decoding a part of the coded data and,
When the region video obtained by decoding the video stream corresponding to the region video is displayed in the region corresponding to the region video, the number of pixels that can display the region image is maximized at the position where the output image is displayed. i-th video stream (1 ≦ i ≦ N), and a read decision unit to decide based on the location of the area for displaying the area image and the coordinate position of the output image relative to the reference position,
And on the basis of the stream ID in the coded data, the output readings of the i-th video stream as determined by the reading determination unit to readings out portion,
A decoding unit for decoding the i-th video stream obtained in the previous Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
The i-th using information on the position relative to the reference position of the region image of the video stream, prior SL video decoding apparatus characterized by comprising an extraction position determination unit that determines the extraction position at the image clipping unit. An area video position information transmitting unit for transmitting area video position information indicating coordinate positions of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions;
A video transmission device comprising: a stream transmission unit configured to transmit an i-th (1 ≦ i ≦ N) video stream among N region video streams;
An area image position information receiving unit for receiving area image position information indicating coordinate positions of the N partial area images;
A stream receiver for receiving the i-th video stream;
A reading unit that reads the i-th video stream received by the stream receiving unit;
A decoding unit for decoding the i-th video stream read by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image coordinate designating unit for designating the coordinate position of the next output image with respect to the reference position;
Based on the location of the area for displaying the area image and the coordinate position of the next output image designated by the output image coordinate specifying unit, so that the number of pixels in the next output image becomes most, j-th ( A transmission request determining unit that determines to request transmission of a video stream of 1 ≦ j ≦ N),
A video transmission / reception apparatus comprising: a video reception apparatus including: a transmission request unit that requests the video transmission apparatus to transmit the j-th video stream. An area video position information transmitting unit for transmitting area video position information indicating coordinate positions of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions;
The N partial regions distinguish the video stream and the video stream of the video stream ID Toka et al., Corresponding from a ₁ of M (1 ≦ M ≦ N) to a _M-th video stream and the video stream extracts and stream ID, the video transmitting apparatus and a stream transmission unit for transmitting a stream ID corresponding to the M video stream and the video stream the extracted,
An area image position information receiving unit for receiving area image position information of the N partial area images;
A stream receiver for receiving the _M a ₁ to a _M video streams;
Based on the first and the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of possible pixel display is the most in the first output image (i is a from a ₁ A read determination unit that determines to read a video stream of any one of _M );
Wherein from M a ₁ received by the stream receiving portion based on the stream ID corresponding to a _M-th video stream, to read out readings of the i-th video stream as determined by the reading determination unit A protruding part,
A decoding unit for decoding the i-th video stream read by the front Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image coordinate designating unit for designating a coordinate position of a second output image instructed to be output next to the first output image ;
When the area video obtained by decoding the video stream corresponding to the area video is displayed in the area corresponding to the area video, the coordinate position of the second output image with respect to the reference position and the area video position information are displayed. based on requests transmission from b ₁ of the M number of displayable pixels that region images increases at the second output image displaying the position (1 ≦ M ≦ N) of b _M-th video stream A transmission request determination unit for determining
A video transmission / reception apparatus comprising: a video reception apparatus including: a transmission request unit that requests the video transmission apparatus to transmit the b ₁ to b _M- th video streams. An area video position information transmitting unit for transmitting area video position information indicating coordinate positions of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions;
And a stream transmission unit for transmitting the video stream i-th from the images and information on the original images a region image (1 ≦ i ≦ N) is encoded,
A video transmission device comprising:
An area image position information receiving unit for receiving N area image position information;
A stream receiver for receiving the i-th video stream;
A reading unit that reads the i-th video stream received by the stream receiving unit;
A decoding unit for decoding the i-th video stream read by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image coordinate designating unit for designating the coordinate position of the next output image;
Based on the coordinate position of the next output image and the area image position information with respect to the reference position, it requests transmission of video stream j th so that the next output image becomes the most (1 ≦ j ≦ N) A transmission request determination unit for determining
A video receiving device comprising: a video requesting device comprising: a transmission requesting unit that requests the video transmitting device to transmit the j-th video stream determined by the transmission request determining unit. An area video position information transmitting unit for transmitting area video position information indicating coordinate positions of N partial area videos with respect to a reference position of an original video defined on a plane expressed in two dimensions;
From images information of the original image, to send a stream ID corresponding to the video stream and the video stream obtained by encoding a _M-th region image from a ₁ of M (1 ≦ M ≦ N) A stream transmitter;
A video transmission device comprising:
An area image position information receiving unit for receiving the N area image position information;
A stream receiver for receiving the M ( 1 ≦ M ≦ N) a ₁ to a _M th streams;
Based on the first and the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of possible pixel display is the most in the first output image (i is a from a ₁ A read determination unit that determines to read a video stream of any one of _M );
Based on the stream ID in the coded data, and the output readings of the i-th video stream as determined by the reading determination unit to readings out portion,
A decoding unit for decoding the i-th video stream read by the front Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image coordinate designating unit for designating a coordinate position of a second output image instructed to be output next to the first output image ;
When the region video obtained by decoding the video stream corresponding to the region video is displayed in the region corresponding to the region video, based on the coordinate position of the next output image with respect to the reference position and the region video position information , to request transmission from b ₁ of b _M-th video stream of M that number of displayable pixels that region images increases at the position of displaying the second output image (1 ≦ M ≦ N) A transmission request determination unit to determine;
A video receiving device comprising: a transmission requesting unit that requests the video transmitting device to transmit the b ₁ to b _M- th video streams determined by the transmission request determining unit. apparatus. For L (L ≧ 2) surfaces expressed in two dimensions, N _k (1 ≦ k ≦ L) regions whose positions are different from each other with respect to the reference position on each surface k are determined, Based on region video position information indicating the coordinate position of the region and encoded data composed of a plurality of video streams corresponding to each region video position information, a part of the encoded data is decoded and output. A video decoding device for obtaining an image,
In cutting out the output image plane c (1 ≦ c ≦ L) , based on the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of pixels of the output image becomes the most (1 A read determination unit that determines to read a video stream of ≦ i ≦ N _c );
A reading unit that reads the i-th video stream determined by the reading determination unit;
A decoding unit for decoding the i-th video stream obtained by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
The i-th using area image position information of the video stream, prior SL video decoding apparatus characterized by comprising an extraction position determination unit that determines the extraction position at the image clipping unit. For L (L ≧ 2) surfaces expressed in two dimensions, N _k (1 ≦ k ≦ L) regions whose positions are different from each other with respect to the reference position on each surface k are determined, Encoded data composed of one stream obtained by multiplexing area video position information indicating the coordinate position of the area, a plurality of video streams corresponding to each area video position information, and a stream ID for distinguishing each video stream; A video decoding device that obtains an output image by decoding a part of the encoded data,
In cutting out the output image plane c (1 ≦ c ≦ L) , based on the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of pixels of the output image becomes the most (1 A read determination unit that determines to read a video stream of ≦ i ≦ N _c );
And on the basis of the stream ID in the coded data, the output readings of the i-th video stream as determined by the reading determination unit to readings out portion,
A decoding unit for decoding the i-th video stream read by the front Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
A video decoding device comprising: For L (L ≧ 2) surfaces expressed in two dimensions, the coordinate positions of N _k (1 ≦ k ≦ L) partial area images with respect to a reference position defined on each surface k are shown. An area image position information transmitting unit for transmitting all area image position information;
A stream transmission unit that transmits an i-th (1 ≦ i ≦ N _c ) stream among the video streams of N _c region videos in the plane c (1 ≦ c ≦ L);
A video transmission device comprising:
An area image position information receiving unit for receiving all area image position information;
A stream receiver for receiving the i-th video stream;
A reading unit that reads the i-th video stream received by the stream receiving unit;
A decoding unit for decoding the i-th video stream read by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
Using the i-th area picture position information, and extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image surface designating unit for designating a surface d (1 ≦ d ≦ L) for cutting out the next output image;
An output image coordinate designating unit for designating the coordinate position of the next output image;
In the plane d specified in the output image plane specifying unit, the reference position based on the coordinate position of the next output image and the area image location information for the as the number of pixels following the output image is most j A transmission request determination unit that determines to request transmission of a th (1 ≦ j ≦ N _d ) video stream;
A transmission request unit that requests the video transmission device to transmit the j-th (1 ≦ j ≦ N _d ) video stream in the plane d (1 ≦ d ≦ L) determined by the transmission request determination unit. A video transmission / reception device comprising: a video reception device. For L (L ≧ 2) surfaces expressed in two dimensions, the coordinate positions of N _k (1 ≦ k ≦ L) partial area images with respect to a reference position defined on each surface k are shown. An area image position information transmitting unit for transmitting all area image position information;
One stream obtained by multiplexing M a ₁ to a _M th video streams and corresponding stream IDs from one stream obtained by multiplexing the video streams of all the area videos and the stream IDs for distinguishing the video streams. A stream transmission unit for extracting and transmitting the stream;
A video transmission device comprising:
An area image position information receiving unit for receiving all area image position information;
A stream receiver for receiving the _M a ₁ to a _M th streams;
In cutting out the output image plane c (1 ≦ c ≦ L) , based on the coordinate position of the output image and the area image position information with respect to the reference position, i th such that the number of pixels the output image becomes most ( i is any _one of a ₁ to a _M ), and a read determination unit that determines to read the video stream;
Based on the stream ID in the coded data, and the output readings of the i-th video stream as determined by the reading determination unit to readings out portion,
A decoding unit for decoding the i-th video stream read by the front Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image plane designating unit for designating one or more planes d (1 ≦ d ≦ L) to cut out the next output image;
An output image coordinate designating unit for designating the coordinate position of the next output image;
Based on the coordinate position of the next output image with respect to the reference position and the region image position information on the surface d designated by the output image surface designation unit, the region image can be displayed at the position where the next output image is displayed. a transmission request determining unit that determines to request transmission of a number of pixels increases the M b ₁ from b _M-th video stream,
A video receiving device comprising: a transmission requesting unit that requests the video transmitting device to transmit the b ₁ to b _M- th video streams determined by the transmission request determining unit. apparatus. For L (L ≧ 2) surfaces expressed in two dimensions, the coordinate positions of N _k (1 ≦ k ≦ L) partial area images with respect to a reference position defined on each surface k are shown. An area image position information transmitting unit for transmitting all area image position information;
A stream transmission unit that encodes an i-th (1 ≦ i ≦ N _c ) region video from a part of image information of the original video on one or more planes c (1 ≦ c ≦ L) and transmits a video stream; A video transmission device comprising:
An area image position information receiving unit for receiving all area image position information;
A stream receiver for receiving the i-th video stream;
A reading unit that reads the i-th video stream received by the stream receiving unit;
A decoding unit for decoding the i-th video stream read by the reading unit;
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image surface designating unit for designating a surface d (1 ≦ d ≦ L) for cutting out the next output image;
An output image coordinate designating unit for designating the coordinate position of the next output image;
In the plane d specified in the output image plane specifying unit, based on the coordinate position of the next output image and the area image position information with respect to the reference position, j-th, as the number of pixels in the next output image becomes most A transmission request determination unit that determines to request transmission of a video stream of (1 ≦ j ≦ N _d );
A transmission request unit for requesting the video transmission device to transmit the j-th video stream determined by the transmission request determination unit ;
A video receiving apparatus comprising: a video receiving apparatus comprising: For L (L ≧ 2) surfaces expressed in two dimensions, the coordinate positions of N _k (1 ≦ k ≦ L) partial area images with respect to a reference position defined on each surface k are shown. An area image position information transmitting unit for transmitting all area image position information;
A video stream obtained by encoding _M a ₁ to a _M th region videos from image information of a part of the original video on one or more planes c (1 ≦ c ≦ L) and a corresponding stream ID A stream transmitter for multiplexing and transmitting;
A video transmission device comprising:
An area image position information receiving unit for receiving all area image position information;
A stream receiver for receiving the _M a ₁ to a _M th streams;
In cutting out the output image plane c (1 ≦ c ≦ L) , on the basis of the coordinate position of the output image relative to the reference position and the area image position information, i th so that the number of pixels of the output image becomes most (i Is _one of a ₁ to a _M ), and a read determination unit that determines to read the video stream;
Based on the stream ID in the coded data, and the output readings of the i-th video stream as determined by the reading determination unit to readings out portion,
A decoding unit for decoding the i-th video stream read by the front Ki読 seen out portion,
An image cutout unit for cutting out and outputting a part of the decoded image obtained by the decoding unit;
By using the region image position information of the i-th video stream, the extraction position determination unit for determining the cut-out position in front Symbol image clipping unit,
An output image plane designating unit for designating one or more planes d (1 ≦ d ≦ L) to cut out the next output image;
An output image coordinate designating unit for designating the coordinate position of the next output image;
Based on the coordinate position of the next output image with respect to the reference position and the region image position information on the surface d designated by the output image surface designation unit, the region image can be displayed at the position where the next output image is displayed. a transmission request determining unit that determines to request transmission of a number of pixels increases the M b ₁ from b _M-th video stream,
A transmission request unit that requests the video transmission device to transmit the b ₁ to b _M- th video streams determined by the transmission request determination unit;
A video receiving apparatus comprising: a video receiving apparatus comprising: N areas whose positions are different from each other with respect to a reference position on a surface expressed in two dimensions are determined, and N video streams corresponding to the areas are displayed so as to respectively display the area videos corresponding to the areas. in configured encoded data or al, a video decoding method for obtaining an output image by decoding a portion of the encoded data,
When the region video obtained by decoding the video stream corresponding to the region video is displayed in the region corresponding to the region video, the number of pixels that can display the region image is maximized at the position where the output image is displayed. i-th video stream (1 ≦ i ≦ N), the read-out decision step to decide on the basis of the location of the area for displaying the area image and the coordinate position of the output image relative to the reference position,
A reading step of reading the i-th video stream;
A decoding step of decoding the i-th video stream read in the reading step;
An image cutout step of cutting out and outputting a part of the decoded image obtained in the decoding step;
Video decoding method which comprises using a position relative to the reference position of the region image of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step. N areas whose positions are different from each other with respect to a reference position on a surface expressed in two dimensions are determined, and N video streams corresponding to the areas are displayed so as to respectively display the area videos corresponding to the areas. encoded data that consists of a single stream generated by multiplexing a distinguishing stream ID of each video stream, a video decoding method decodes a part of the coded data to obtain the output image,
When the region video obtained by decoding the video stream corresponding to the region video is displayed in the region corresponding to the region video, the number of pixels that can display the region image is maximized at the position where the output image is displayed. i-th video stream (1 ≦ i ≦ N), the read-out decision step to decide on the basis of the location of the area for displaying the area image and the coordinate position of the output image relative to the reference position,
A step wherein based on the stream ID in the coded data, the i-th video stream determined by said reading determining step heading to read out readings,
A decoding step of decoding the i-th video stream obtained in the previous Ki読 heading step,
An image cutout step of cutting out and outputting a part of the decoded image obtained in the decoding step;
Video decoding method which comprises using a position relative to the reference position of the region image of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step. An area image position information transmitting step in which an image transmission apparatus transmits area image position information indicating coordinate positions of N partial area images with respect to a reference position of an original image defined on a plane expressed in two dimensions; ,
A stream transmission step in which the video transmission device transmits an i-th (1 ≦ i ≦ N) video stream among N area video streams;
An area image position information receiving step in which an image receiving apparatus receives area image position information indicating coordinate positions of the N partial area images;
A stream receiving step in which the video receiving apparatus receives the i-th video stream;
The video receiving device reads out the i-th video stream received in the stream receiving step;
A decoding step in which the video receiving apparatus decodes the i-th video stream read in the reading step;
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image coordinate designation step in which the video receiving device designates a coordinate position of a next output image with respect to the reference position;
The video receiving apparatus, based on the location of the area for displaying the area image and the coordinate position of the next output image designated by the output image coordinates specified step, becomes the most number of pixels of the next output image A transmission request determining step for determining to request transmission of a j-th (1 ≦ j ≦ N) video stream;
A video transmission / reception method comprising: a transmission requesting step in which the video reception device requests the video transmission device to transmit the j-th video stream. An area image position information transmitting step in which an image transmission apparatus transmits area image position information indicating coordinate positions of N partial area images with respect to a reference position of an original image defined on a plane expressed in two dimensions; ,
The video transmitting apparatus, said N partial regions distinguish the video stream and the video stream of the video stream ID Toka et al., And a _M-th video stream from a ₁ of M (1 ≦ M ≦ N) , and exits extracting a stream ID corresponding to the video stream, and M video stream the extracted, and a stream transmission step of transmitting a stream ID corresponding to the video stream,
An area image position information receiving step in which the image receiving apparatus receives area image position information of the N partial area images;
A stream receiving step in which the video receiving apparatus receives the M a ₁ to a _M th video streams;
Based on the first and the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of possible pixel display is the most in the first output image (i is a from a ₁ A read determination step for determining to read a video stream of any of _M );
The i th video stream determined in the read determination step based on stream IDs corresponding to the _M a ₁ to a _M th video streams received by the video reception device in the stream reception step. and step out only to read out read look at,
A decoding step wherein the video receiving device, decoding the i-th video stream read by the front Ki読 heading step,
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image coordinate designating step of designating a coordinate position of a second output image instructed to be output by the video receiving device after the first output image ;
When the video reception device displays the area video obtained by decoding the video stream corresponding to the area video in the area corresponding to the area video, the coordinate position of the second output image with respect to the reference position and the based on the area picture position information, b _M-th image from b ₁ of the second output image M number of number of displayable pixels that region images increases at the position of displaying (1 ≦ M ≦ N) A transmission request determination step for determining to request transmission of a stream;
A video transmission / reception method, wherein the video reception device includes a transmission requesting step for requesting the video transmission device to transmit the b ₁ to b _M th video streams. An area image position information transmitting step in which an image transmission apparatus transmits area image position information indicating coordinate positions of N partial area images with respect to a reference position of an original image defined on a plane expressed in two dimensions; ,
The video transmitting apparatus, a stream transmitting step of transmitting a video stream by encoding the region image of the i-th from the images and information on the original image (1 ≦ i ≦ N),
An area image position information receiving step in which the image receiving apparatus receives N area image position information;
A stream receiving step in which the video receiving apparatus receives the i-th video stream;
The video receiving device reads out the i-th video stream received in the stream receiving step;
A decoding step in which the video receiving apparatus decodes the i-th video stream read in the reading step;
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image;
The video receiving apparatus, based on the coordinate position of the next output image relative to the reference position and the area image position information, the video stream of j-th so that the next output image becomes the most (1 ≦ j ≦ N) A transmission request determination step for determining to request transmission of
A video transmission / reception method, wherein the video reception device includes a transmission request step for requesting the video transmission device to transmit the j-th video stream determined in the transmission request determination step. An area image position information transmitting step in which an image transmission apparatus transmits area image position information indicating coordinate positions of N partial area images with respect to a reference position of an original image defined on a plane expressed in two dimensions; ,
The video transmission apparatus, the images and information on the original image, a video stream obtained by encoding a _M-th region image from a ₁ of M (1 ≦ M ≦ N), corresponding to the video stream and a stream transmission step for sending a stream ID,
An area image position information receiving step in which the image receiving apparatus receives the N area image position information;
A stream receiving step in which the video receiving device receives the M ( 1 ≦ M ≦ N) a ₁ to a _M th streams;
The video receiving apparatus, based on the coordinate position of the output image and the area image position information with respect to the reference position, or i-th, as the number of pixels is most of the output image (i from a ₁ to a _M A read determination step for determining to read the video stream of
A step wherein the video receiving device, based on the stream ID in the coded data, the i-th video stream determined by said reading determining step heading to read out readings,
The video receiving apparatus, a decoding step of decoding the i-th video stream read by the front Ki読 heading step,
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image;
The video receiving apparatus, based on the coordinate position of the next output image and the area image position information with respect to the reference position, the number of displayable pixels that region image number in a position to display the next output image M A transmission request determining step for determining to request transmission of b ₁ to b _M th video streams ( 1 ≦ M ≦ N);
A video transmission / reception method, wherein the video reception device includes a transmission request step for requesting the video transmission device to transmit the b ₁ to b _M- th video streams determined in the transmission request determination step. . For L (L ≧ 2) surfaces expressed in two dimensions, N _k (1 ≦ k ≦ L) regions whose positions are different from each other with respect to the reference position on each surface k are determined, Based on region video position information indicating the coordinate position of the region and encoded data composed of a plurality of video streams corresponding to each region video position information, a part of the encoded data is decoded and output. A video decoding method for obtaining an image,
In cutting out the output image plane c (1 ≦ c ≦ L) , based on the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of pixels of the output image becomes the most (1 A read determination step for determining to read a video stream of ≦ i ≦ N _c );
A reading step of reading the i-th video stream determined in the reading determination step;
A decoding step of decoding the i-th video stream obtained in the reading step;
An image cutout step of cutting out and outputting a part of the decoded image obtained in the decoding step;
Video decoding method which comprises using a region image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step. For L (L ≧ 2) surfaces expressed in two dimensions, N _k (1 ≦ k ≦ L) regions whose positions are different from each other with respect to the reference position on each surface k are determined, Encoded data composed of one stream obtained by multiplexing area video position information indicating the coordinate position of the area, a plurality of video streams corresponding to each area video position information, and a stream ID for distinguishing each video stream; based on, a video decoding method for obtaining an output image by decoding a portion of the encoded data,
In cutting out the output image plane c (1 ≦ c ≦ L) , based on the coordinate position of the output image and the area image position information with respect to the reference position, i th so that the number of pixels of the output image becomes the most (1 A read determination step for determining to read a video stream of ≦ i ≦ N _c );
A step wherein based on the stream ID in the coded data, the i-th video stream determined by said reading determining step heading to read out readings,
A decoding step of decoding the i-th video stream read at step before heading Ki読,
An image cutout step of cutting out and outputting a part of the decoded image obtained in the decoding step;
Video decoding method which comprises using a region image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step. The video transmission apparatus has N _k (1 ≦ k ≦ L) partial area videos with respect to a reference position defined on each plane k for L (L ≧ 2) planes expressed in two dimensions. An area image position information transmission step for transmitting all area image position information indicating the coordinate position of
A stream transmission step in which the video transmission device transmits an i-th (1 ≦ i ≦ N _c ) stream of video streams of N _c area videos in the plane c (1 ≦ c ≦ L);
A region image position information receiving step in which the image receiving device receives all region image position information;
A stream receiving step in which the video receiving apparatus receives the i-th video stream;
The video receiving device reads out the i-th video stream received in the stream receiving step;
A decoding step in which the video receiving apparatus decodes the i-th video stream read in the reading step;
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the i-th area picture position information, and extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image plane designating step in which the video receiving apparatus designates a plane d (1 ≦ d ≦ L) from which a next output image is cut out;
An output image coordinate designating step in which the video receiving device designates a coordinate position of the next output image;
Based on the coordinate position of the next output image with respect to the reference position and the region video position information on the surface d designated by the video image receiving device in the output image plane designating step, the number of pixels of the next output image is determined. A transmission request determining step for determining to request transmission of a j-th (1 ≦ j ≦ N _d ) video stream so as to increase the number of video streams;
The video reception device requests the video transmission device to transmit the j-th (1 ≦ j ≦ N _d ) video stream in the plane d (1 ≦ d ≦ L) determined in the transmission request determination step. A video transmission / reception method comprising: a transmission request step. The video transmission apparatus has N _k (1 ≦ k ≦ L) partial area videos with respect to a reference position defined on each plane k for L (L ≧ 2) planes expressed in two dimensions. An area image position information transmission step for transmitting all area image position information indicating the coordinate position of
From the one stream in which the video transmission device multiplexes the video streams of all the area videos and the stream IDs for distinguishing the video streams, the stream IDs corresponding to the _M a ₁ to a _M- th video streams A stream transmission step of extracting and transmitting one stream obtained by multiplexing
A region image position information receiving step in which the image receiving device receives all region image position information;
A stream receiving step in which the video receiving apparatus receives the M a ₁ to a _M th streams;
The video receiving device has the largest number of pixels of the output image based on the coordinate position of the output image with respect to the reference position and the region video position information on the surface c (1 ≦ c ≦ L) where the output image is cut out i th such that (i is any one of a _M from a ₁₎ and a read determination step of determining that the read out video stream,
A step wherein the video receiving device, based on the stream ID in the coded data, the i-th video stream determined by said reading determining step heading to read out readings,
The video receiving apparatus, a decoding step of decoding the i-th video stream read by the front Ki読 heading step,
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image plane designating step in which the video receiving apparatus designates one or more planes d (1 ≦ d ≦ L) for cutting out the next output image;
An output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image;
At the position where the video receiving device displays the next output image based on the coordinate position of the next output image with respect to the reference position and the region video position information on the surface d specified in the output image plane specifying step . a transmission request determining step of determining that the requesting transmission of b _M-th video stream from M b ₁ to the number of displayable pixels that region image increases,
A video transmission / reception method, wherein the video reception device includes: a transmission request unit that requests the video transmission device to transmit the b ₁ to b _M- th video streams determined in the transmission request determination step. . The video transmission apparatus has N _k (1 ≦ k ≦ L) partial area videos with respect to a reference position defined on each plane k for L (L ≧ 2) planes expressed in two dimensions. An area image position information transmission step for transmitting all area image position information indicating the coordinate position of
The video transmission device transmits a video stream by encoding an i-th (1 ≦ i ≦ N _c ) region video from a part of image information of an original video on one or more planes c (1 ≦ c ≦ L). Stream sending step,
A region image position information receiving step in which the image receiving device receives all region image position information;
A stream receiving step in which the video receiving apparatus receives the i-th video stream;
The video receiving device reads out the i-th video stream received in the stream receiving step;
A decoding step in which the video receiving apparatus decodes the i-th video stream read in the reading step;
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image plane designating step in which the video receiving apparatus designates a plane d (1 ≦ d ≦ L) from which a next output image is cut out;
An output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image;
Based on the coordinate position of the next output image with respect to the reference position and the area video position information on the surface d designated by the output image surface designation step, the video reception device has the largest number of pixels of the next output image. a transmission request determining step of determining that the requesting transmission of video streams often made as j-th _{(1 ≦ j ≦ N d)} ,
A video transmission / reception method, wherein the video reception device includes a transmission request step for requesting the video transmission device to transmit the j-th video stream determined in the transmission request determination step. The video transmission apparatus has N _k (1 ≦ k ≦ L) partial area videos with respect to a reference position defined on each plane k for L (L ≧ 2) planes expressed in two dimensions. An area image position information transmission step for transmitting all area image position information indicating the coordinate position of
A video stream obtained by encoding the _M a ₁ to a _M- th area videos from image information of a part of the original video on one or more planes c (1 ≦ c ≦ L); A stream transmission step of multiplexing and transmitting a corresponding stream ID;
A region image position information receiving step in which the image receiving device receives all region image position information;
A stream receiving step in which the video receiving apparatus receives the M a ₁ to a _M th streams;
The video receiving device, in the plane c of cutting out the output image (1 ≦ c ≦ L), based on the coordinate position of the output image and the area image position information with respect to the reference position, the number of pixels is most of the output image A read determination step for determining to read the i-th (i is any _one of a ₁ to a _M ) video stream,
A step wherein the video receiving device, based on the stream ID in the coded data, the i-th video stream determined by said reading determining step heading to read out readings,
The video receiving apparatus, a decoding step of decoding the i-th video stream read by the front Ki読 heading step,
An image cutout step in which the video reception device cuts out and outputs a part of the decoded image obtained in the decoding step;
The video receiving apparatus, by using the area image position information of the i-th video stream, the extraction position determining step of determining a cut position in front Symbol image extraction step,
An output image plane designating step in which the video receiving apparatus designates one or more planes d (1 ≦ d ≦ L) for cutting out the next output image;
An output image coordinate designating step in which the video receiving device designates a coordinate position of a next output image;
At the position where the video receiving device displays the next output image based on the coordinate position of the next output image with respect to the reference position and the region video position information on the surface d specified in the output image plane specifying step . a transmission request determining step of determining that the requesting transmission of b _M-th video stream from M b ₁ to the number of displayable pixels that region image increases,
A video transmission / reception method, wherein the video reception device includes a transmission request step for requesting the video transmission device to transmit the b ₁ to b _M- th video streams determined in the transmission request determination step. .

Images