JP5941000B2 - Video distribution apparatus and video distribution method - Google Patents

Description

The present invention relates to a Film image distribution apparatus 及 beauty video distribution method.

  In recent years, research has been conducted on technologies that allow viewers to freely view high-definition images with resolutions that greatly exceed high-definition quality, such as 4K resolution, 8K resolution, and huge panoramic images, while freely operating them at their preferred positions and sizes. ing. For example, Non-Patent Document 1 targets a huge panoramic image with a resolution exceeding the high-vision quality.

  According to Non-Patent Document 1, a huge panoramic video is first divided into a plurality of tiles, and video encoding is performed for each tile. In addition, H.I., an international standard. According to the H.264 / MVC format, the video encoded data of each tile is combined to form one panoramic video stream. FIG. 6 is a diagram illustrating an example in which a high-definition video such as a huge panoramic video is divided into a plurality of tiles.

  In addition, when the viewer views from a huge panoramic video while freely manipulating the desired position and size according to the viewing style, the viewer views from this single panoramic video stream. Only some tiles including the area (display area) are read and decoded, and the decoded video is clipped and displayed on the display device. FIG. 7 is a diagram illustrating a relationship between a tile to be decoded and a display image. In the example shown in FIG. 7, three vertical tiles and four horizontal tiles are read and decoded, and the display image surrounded by the frame is clipped and displayed as a display area.

  If the position or size of the display image changes due to the viewer's operation, the position of the tile to be read can be changed following this, or the number can be increased or decreased according to the size, and these can be decoded. In this system, the video can be continuously displayed without interruption.

  Here, with reference to FIG. 8, the structure of the video delivery system by a prior art is demonstrated. FIG. 8 is a block diagram showing the configuration of a video distribution system according to the prior art. The video distribution system includes a server 10 configured by a computer device and a client 20 configured by the computer device. In FIG. 8, when the video / audio information output unit 11 outputs video information and audio information, the video / audio encoding unit 12 encodes the video information and audio information. The video information and audio information may be file information stored in advance in the video / audio information output unit 11 or information input in real time from a camera or the like.

  Next, the video / audio encoding unit 12 divides the video information into a plurality of tiles, for example, as shown in FIG. At this time, the video / audio encoding unit 12 outputs multiple video position information indicating the positions of the divided plurality of tiles to the multiple video position information transmitting unit. For example, in the case of the division shown in FIG. 6, the multiple video position information includes the size of the entire video (if there are multiple resolutions, the video size for each resolution) and the tile size as the video position information, The image position is configured by information that is determined in advance by raster scanning from the upper left and assigning numbers.

  On the other hand, the video / audio information storage unit 14 temporarily stores the encoded video information and audio information. The transmission unit 15 transmits the encoded video information and the encoded audio information temporarily stored in the video / audio information storage unit 14 to the client 20. In response to this, the receiving unit of the client 20 receives the encoded video information and the encoded audio information. The video / audio decoding unit decodes the encoded video information and the encoded audio information. The video / audio reproduction unit reproduces the decoded video information and audio information. As a result, the viewer can view the video / audio.

  The multiple video position information receiving unit 21 outputs the multiple video position information to the screen operation control unit 22. When the gaze area that the viewer is watching (the gaze area is composed of a plurality of tiles including the display area) is changed, the screen operation control unit 22 changes the viewing from the plurality of video position information. The person's gaze area is extracted, and this is transmitted to the gaze area request unit 23. In response to this, the gaze area request unit 23 transmits the gaze area request unit 23 to the gaze area control unit 16 of the server 10. The gaze area control unit 16 outputs the gaze area information to the video / audio information storage unit 14. The video / audio information storage unit 14 outputs a plurality of tiles including the gaze area to the transmission unit 15 so that the encoded video information suitable for the viewer's gaze area is transmitted and the changed viewer's gaze information is changed. The gaze area can be viewed.

  By the way, in order to obtain a display image, a video distribution system according to the prior art usually needs to decode a plurality of tiles. The number of tiles to be decoded usually increases or decreases as the position or size of the display image changes. It has the characteristic of. For this reason, a client 20 capable of performing high-performance decoding capable of decoding a plurality of tiles in real time is required. Therefore, the low-function client 20 lacks the decoding processing capability and obtains a display image. Necessary tiles cannot be decoded, and as a result, there is a problem that the video is missing.

  In addition, in order to solve this problem, when a dedicated decoding device by hardware is introduced, dedicated decoding devices for all the tiles assuming that the entire high-definition video is a display image at the maximum are used. Although it is necessary, the low-functional client 20 generally has about one or two dedicated decoding devices. Even if it is intended to obtain the display image shown in FIG. Since only one or two of the tiles can be decoded, the problem that the video is still missing cannot be solved.

  Therefore, on the premise of the viewing style described above, a technique for generating one video (H.264 / AVC format) from a plurality of tiles (H.264 / MVC format) has been studied (for example, Non-Patent Document 2). reference). With this technology, it is possible to solve the above-mentioned problem by using a dedicated decoding device or the like even in a low-function terminal by decoding only one video without decoding a plurality of tiles. There is a possibility.

Hideaki Kimata, Shinya Shimizu, Yutaka Kunita, Megumi Isogai, and Yoshimitsu Ohtani: `` Panorama video coding for user-driven interactive video application '', IEEE International Symposium on Consumer Electronics (ISCE) 2009,2009 N. Uchihara, H.kasai, "Fast stream joiner for next-generation interactive video", IEEE Int. Conf. Consumer Electronisc 2011 (ICCE), pp. 319-320, 2011

However, the video distribution system described in Non-Patent Document 2 has the following characteristics.
(1) Since the number of tiles to be decoded to obtain one image usually increases or decreases when the position or size of the display image changes, the size of one image changes.
(2) With only one video, when the viewer's favorite position and size change, if the viewer operates faster than expected, the video will be lost.

  The above characteristic (1) is that when decoding is performed by a low-function client terminal, the video size always changes, so that the decoding load of the dedicated decoding apparatus increases, and an event in which decoding cannot be performed easily occurs. There is a problem. Further, the characteristic (2) has a problem that when the viewer's favorite position or size changes, a state in which the video is missing for a time until an appropriate video is delivered occurs.

The present invention has such has been made in view of the circumstances, it is possible to reduce the load of the regeneration process, image movies can allow the viewing of high-definition video with reduced that video lacks distribution device 及 beauty An object is to provide a video distribution method.

  The present invention is a video playback apparatus that receives and plays back encoded video data obtained by encoding a specified part of the entire video data, and displays the video in the display area on a video display screen. Distribution request means for requesting distribution of the first video data having a resolution required for the second video data and the second video data composed of the entire video data having the lowest resolution, the first video data, and the second video data Receiving means for receiving the encoded video data in which each of the video data is encoded, and decoding the received encoded video data, and superimposing the first video data on the second video data Display means for displaying video data on the video display screen.

  In the present invention, when the position or size of the display area on the entire video data is changed, the display means receives the new encoded video data, and receives the received encoded video data. The display area after decoding and changing is displayed on the video display screen.

  The present invention further includes apparatus information transmitting means for transmitting the size of the video display screen to a distribution source of the video data, wherein the receiving means is configured to generate the encoding generated based on the size of the video display screen. It is characterized by receiving video data.

  The present invention is a video distribution device that distributes encoded video data obtained by encoding a specified part of the entire video data, and is necessary for displaying the video data of the display area on a video display screen. Distribution data generating means for generating first video data having resolution and second video data composed of the whole video data having the lowest resolution from the whole video data, the first video data, It comprises encoding means for generating the encoded video data by encoding second video data, and video distribution means for distributing the encoded video data.

  In the present invention, the distribution data generating means uses the entire video data having different resolutions of N (N is an integer of 2 or more) determined based on a specified enlargement ratio, and the first video data and the first video data. 2 video data is generated.

  The present invention is characterized in that the distribution data generating means determines the resolution of the first video data based on the size of the video display screen.

  The present invention relates to a video playback method performed by a video playback device that receives and plays back encoded video data obtained by encoding a specified part of a display area of the entire video data, and includes the display area on the video display screen. A distribution requesting step for requesting distribution of first video data having a resolution necessary for displaying video and second video data including the entire video data having the lowest resolution; and the first video data Receiving the encoded video data in which each of the second video data is encoded, decoding the received encoded video data, and performing the first video on the second video data And a display step of displaying the video data on which the video data is superimposed on the video display screen.

  The present invention is a video distribution method performed by a video distribution apparatus that distributes encoded video data obtained by encoding a specified part of the entire video data, and displays the video data of the display area on a video display screen A distribution data generating step for generating first video data having a resolution necessary for performing the second video data including the whole video data having the lowest resolution from the whole video data; And a video distribution step for generating the encoded video data by encoding the video data and the second video data, respectively, and a video distribution step for distributing the encoded video data. .

  According to the present invention, since it is only necessary to always decode a certain video size, it is possible to reduce the load of playback processing, and to suppress high-definition video even if the viewer's favorite position and size change. There is an effect that it is possible to view the video.

It is a block diagram which shows the structure of one Embodiment of this invention. It is a figure which shows the structural example of the synthetic | combination tile with respect to a high definition image | video. It is a figure which shows the delivery operation | movement of the video stream from the server which has a high definition video stream to a client. It is a figure which shows the example of the minimum resolution of a high-definition image | video, and the aspect-ratio of a reproduction | regeneration terminal. It is a flowchart which shows the processing operation which determines the resolution number n. It is a figure which shows the example which divided | segmented high-definition images, such as a huge panoramic image, into several tiles. It is a figure which shows the relationship between the tile of decoding object, and a display image. It is a block diagram which shows the structure of the video delivery system by a prior art.

  A video distribution system according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the embodiment. In this figure, the same parts as those in the conventional apparatus shown in FIG. The apparatus shown in this figure is different from the conventional apparatus in that a composite tile generation unit 17 and a reproduction terminal information reception unit 18 are provided in the server 10, and a reproduction terminal information transmission unit 27 is provided in the client 20. It is a point.

  In FIG. 1, the gaze area control unit 16 outputs the gaze area to the video / audio information storage unit 14. The video / audio information storage unit 14 outputs video information and audio information of the gaze area to the composite tile generation unit 17. In response to this, the composite tile generation unit 17 generates a composite tile from the received video information, and outputs the video information and audio information encoded again as the composite tile to the transmission unit 15.

  On the other hand, the reproduction terminal information transmission unit 27 transmits the vertical and horizontal sizes of the display for display of the client 20 (reproduction terminal). The reproduction terminal information receiving unit 18 outputs the vertical and horizontal sizes of the display for display to the video / audio encoding unit 12. In this way, by transmitting the vertical and horizontal sizes of the display for display from the playback terminal information transmitting unit 27, the size of the composite tile can be determined on the server 10 side and displayed on the client 20 The minimum resolution video size based on the display size can be determined.

  Next, an example of creating a plurality of resolution videos for high-definition video and a composition tile will be described. FIG. 2 is a diagram illustrating a configuration example of a composite tile for high-definition video. When creating a composite tile, first, a video having a plurality of resolutions (medium resolution and low resolution) is created from the high-definition video having the highest resolution shown in FIG. The medium resolution in FIG. 2B is not limited to one and may be plural. In addition, the minimum resolution in FIG. 2C is a size that allows the entire high-definition video to fit within the size of one composite tile. The video / audio encoding unit 12 generates a video having a plurality of resolutions from the highest resolution video output from the video / audio information output unit 11.

  Next, a fixed composite tile consisting of a fixed number of vertical and horizontal tiles (a composite tile fixed in 3 horizontal and 2 vertical tiles in the example of FIG. 2) for a certain resolution image. Each composite tile is configured by shifting the position of the composite tile one tile at a time from the left end in the right direction and the downward direction. FIG. 2A shows a composite tile in which the positions of two tiles are shifted from the left end to the right (horizontal) by one tile and the downward (vertical) one tile from the left end. Then, a plurality of tiles are synthesized into tiles by the method of Non-Patent Document 2 for each synthesized tile. Alternatively, the video information stored in the video / audio information storage unit 14 may be once decoded (decoded), and the video information at a position matching the combined tile may be encoded (encoded) again.

  Next, the video viewing processing operation will be described. FIG. 3 is a diagram illustrating a video stream distribution operation from the server 10 having the high-definition video stream to the low-function terminal (client 20). As described above, once the image is decomposed into a plurality of resolutions and divided into tiles, and a composite tile is formed. As shown in FIG. , Viewers can watch at any position and size.

  First, an appropriate high-resolution composite tile (composite tile A shown in FIG. 3) and a minimum-resolution composite tile (composite tile B in FIG. 3) including a video display area are included from the client 20 (low function terminal). A distribution request is made (FIG. 3 (i)). In response to this, the server 10 generates and transmits the composite tile A and composite tile B requested by the client 20 (FIG. 3 (ii)).

  Next, the client 20 simultaneously decodes an appropriate high-resolution composite tile (composite tile A) and a lowest-resolution composite tile (composite tile B) (decodes two composite tiles) to obtain a superimposed video. Then, the client 20 clips the video of the position and size requested by the viewer from the obtained video, and displays the clipped display area on the display device (FIG. 3 (iii)).

  Next, when the position and size (video display area) requested by the viewer are changed, an appropriate high-resolution composite tile is changed, and the above-described processing operation is repeated. For example, if there is a change only at a certain position or more, another composite tile of the video with the same resolution is selected. If the display area is enlarged beyond a certain level, a composite tile of a video with a lower resolution is selected.

  Next, the operation for determining the video size of the lowest resolution will be described. First, the vertical and horizontal sizes of the display for display of the client 20 are output to the video / audio encoding unit 12. The video / audio encoding unit 12 compares the aspect ratio of the high-definition video with the aspect ratio of the display for display of the client 20, and determines the minimum resolution size of the plurality of resolutions.

  Specifically, if “horizontal size / vertical size of the display for display” ≧ “horizontal size / vertical size of the high-definition video” is satisfied, the vertical size of the minimum resolution is set to the vertical size of the display for display. Fit to size. The horizontal size of the minimum resolution is determined in accordance with the aspect ratio of the high-definition video based on this vertical size.

  On the other hand, if “horizontal size of display display / vertical size” <“horizontal size of high-definition video / vertical size” is satisfied, the horizontal size of the lowest resolution is adjusted to the vertical size of the display display. . The vertical size of the lowest resolution is determined in accordance with the aspect ratio of the high-definition video based on the horizontal size.

  The distribution operation of the two composite tiles as described above enables the viewer to view at the desired position and size while solving the problem that the video is missing.

Next, an operation for determining the optimum number of resolutions from the viewpoint of the enlargement ratio γw will be described. In order to reduce the load on the client 20 by always decoding with a constant video size, it is necessary to determine the size of the display area and the use of the composite tile having the optimum resolution. First, the following parameters are defined.
Zx: Horizontal size of high-definition original image (pixel)
Zy: Vertical size of high-definition original image (pixel)
Dx: the horizontal size of the display for display of the client 20 (pixel)
Dy: Vertical size (pixel) of the display for display of the client 20
Vx: size next to the tile (pixel)
Vy: vertical size of the tile (pixel)
Cx: Horizontal size of composite tile (pixel)
Cy: Vertical size of the composite tile (pixel)
n: Resolution number (integer satisfying n ≧ 2)
β: Ratio of video size with adjacent resolution (resolution conversion rate (β> 1))

Here, the number of resolutions different from the number of resolutions is represented. For example, in the case of FIG. 2 and FIG. 3, it is 3 (highest resolution, middle resolution, lowest resolution). The size of the composite tile is assumed to satisfy the following condition with an AND condition (hereinafter referred to as a composite tile condition) in order to enable the dot by dot display on the display for display of the client 20.
Composite tile condition: Cx, Cy satisfying Cx ≧ Dx AND Cy ≧ Dy

  Here, since it is assumed that the client 20 has a low function, it is recommended that the size Cx, Cy of the composite tile is the minimum Cx, Cy while satisfying the composite tile condition. Since Cx and Cy are the sizes of the composite tiles, they are integral multiples of the horizontal size (Vx) and vertical size (Vy) of one tile.

  Next, the resolution conversion rate β when the number of resolutions is n is as follows. FIG. 4 is a diagram illustrating an example of the minimum resolution of high-definition video and the aspect ratio of the playback terminal. Here, as shown in FIG. 4, the resolution conversion rate is calculated by classifying into two patterns.

として算出する（図４（ａ））。 The first pattern is a case where (Dx / Dy) ≧ (Zx / Zy) (hereinafter referred to as a first content condition). In this case, since the display for display of the client 20 is horizontally longer than the original content, the vertical size of the lowest resolution is determined as Dy.

(FIG. 4 (a)).

として算出する（図４（ｂ））。 The second pattern is a case of (Dx / Dy) <(Zx / Zy) (hereinafter referred to as a second content condition). In this case, since the display for display of the client 20 is longer than the original content, the horizontal size of the lowest resolution is determined as Dx.

(FIG. 4B).

  Furthermore, the rules for changing the resolution are applied. The rule for changing the resolution is “change to the next lower resolution when the playback terminal is displayed as“ Dot by Dot ”.” In this rule formation, the processing shown in FIG. 5 is applied in order to obtain the optimum resolution number n. FIG. 5 is a flowchart showing a processing operation for determining the resolution number n.

  First, the video / audio encoding unit 12 determines the enlargement ratio γw (step S1). The enlargement ratio γw uses the worst-case digital zoom enlargement ratio defined by the content designer as the video quality (γw> 1). Note that the worst-case digital zoom magnification rate is the largest magnification rate (the worst video quality state) among the digital zoom magnification rates when the composite tile image is displayed on the display of the client 20. . Also, the worst case occurs immediately after one resolution is lowered from a certain resolution.

  Next, the video / audio encoding unit 12 sets an initial value of the resolution number n (step S2). The resolution number n is set to an initial value because the minimum value needs to be “2” from the example of the distribution of the video stream from the server 10 having the high-definition video stream shown in FIG. .

  Next, the video / audio encoding unit 12 checks the constraint condition (step S3). When generating a high-definition video stream, the upper limit of the total number of tiles that can be used is defined by the encoding standard employed as the stream (for example, the upper limit is 1024 when H.264 / MVC is employed). The constraint is that the upper limit of the total number of tiles (hereinafter referred to as Hres) is not exceeded.

  Therefore, the total number of tiles of the high-definition video stream generated with the resolution number n is calculated as follows. First, the image size of a certain resolution na (na = 0, 1, 2, 3,..., N−1) is defined as horizontal Fnax and vertical Fnay. This can be derived from the following equations (3) and (4) from the original image sizes Zx, Zy and the resolution conversion rate β. Here, the resolution 0 is the original image size, and the resolutions 1, 2, 3, 4,. . . , N−1.

ここで、関数Ｅｖｅｎにて偶数化しているが、各解像度の映像符号化時に支障が無ければ他の関数で整数化されても良い。 When the resolution number n is determined, the resolution conversion rate β can be calculated. Specifically, the resolution conversion rate β is calculated from either the first content condition or the second content condition described above, and the resolution na (na = 0, 1, 2, 3,... The image size of 1) is calculated.

Here, the even number is set by the function Even, but it may be converted to an integer by another function as long as there is no problem at the time of video encoding at each resolution.

ここで、Ｒｏｕｎｄｕｐ（ａ，ｂ）は、ａを小数点第ｂ位まで表示して以下切り上げの関数である。 Next, the total number of tiles necessary for encoding at a certain resolution na (na = 0, 1, 2, 3,..., N−1) is calculated from Fnax and Fna by the following formula.

Here, Roundup (a, b) is a function of displaying a up to the second decimal place and rounding up.

Next, the total number of tiles (Hsum) required from the calculated Hnax and Hnay is calculated by the following formula.

  Then, a determination of “Hsum ≦ Hres” is made, and if it is NG, the value (Δγw) of the minute amount is increased (γw ← γw + Δγw) to the enlargement ratio (γw) of the worst case digital zoom (worst case digital zoom The enlargement ratio is slightly increased), and the process returns to step S1.

  On the other hand, if it is OK in step S3, the video / audio encoding unit 12 checks the enlargement ratio (step S4). When the resolution conversion rate β calculated in step S3 is used, the worst-case digital zoom magnification rate (γw_n) when the number of resolutions is n becomes the same value as the resolution conversion rate β.

  Therefore, the enlargement ratio is checked based on whether or not γw_n (= β) ≦ γw is satisfied. As a result, if OK, the number of resolutions n at this time is adopted and the process is terminated. If NG, n is incremented by 1 (n ← n + 1) and the process returns to step S3.

  Next, a threshold for determining whether or not to lower the resolution level by one will be described. When the number of resolutions n is determined by the above-described processing, the resolution conversion rule is changed using the rule for changing the resolution “change to the next lower resolution when the playback terminal is displayed as“ Dot by Dot ””. The threshold can be calculated as follows.

In the case of (Dx / Dy) ≧ (Zx / Zy) (first content condition), first, the threshold for resolution conversion from the highest resolution to the next resolution (resolution 0 → resolution 1) is based on the rule at the time of resolution change. It is defined and calculated below.

In the resolution conversion threshold values of the subsequent resolutions (resolution na → resolution na + 1), the ratio of the size of each resolution is defined by the resolution conversion rate β, and can be calculated as follows.

In the case of (Dx / Dy) <(Zx / Zy) (second content condition), first, the threshold for resolution conversion from the highest resolution to the next resolution (resolution 0 → resolution 1) is based on the rule when changing the resolution. It is defined and calculated below.

In the resolution conversion threshold values of the subsequent resolutions (resolution na → resolution na + 1), the ratio of the size of each resolution is defined by the resolution conversion rate β, and can be calculated as follows.

  In this way, after creating high-definition video with a resolution that greatly exceeds high-definition (HD) quality, such as 4K resolution, 8K resolution, and enormous panoramic video, as multi-view video encoded data, low-performance playback on tablet devices, etc. Assuming that decoding and playback can be performed on the terminal as well, a portion of the high-definition video can be used while reducing the load for decoding by keeping the video size constant even when the viewer expands or reduces the viewing area. Can be partially delivered.

  In order to realize this, the video size at the time of decoding is always set to a constant size even when the video is enlarged / reduced so that it can be decoded even by a low-function playback terminal. Specifically, a high-definition video to be viewed is configured in advance with a plurality of resolutions, and a single video (composite tile) is obtained from tiles with an appropriate resolution that matches the viewer's preferred position and size. did.

  In addition, one image generated from tiles having an appropriate resolution matched to the viewer's preferred position and size so that the image will not be lost even if the position or size displayed during viewing changes. In addition to (first video), a total of two videos of one video (second video) generated from tiles including the entire high-definition video at the same time are decoded.

  In this way, if it has the minimum decoding capability of two videos, even if it is a low function playback terminal, the load is reduced by always decoding with a constant video size, and further viewing and listening. It is possible to view high-definition video without missing the video according to the position and size desired by the user.

  As described above, the concept of “composite tile” is introduced into a high-definition video stream, and only two composite tiles are distributed and reproduced. Also, the relationship between the number of resolutions n required when creating the necessary high-definition video stream and the digital zoom magnification γ during video playback has been clarified. Furthermore, from the relationship between the number of resolutions n and the digital zoom magnification rate γ during video playback, the creation of a high-definition video stream that minimizes the load at the time of tile encoding that can be achieved with the worst-case digital zoom magnification rate γw or less. Made possible.

  This makes it possible to use a low-functional client (4K resolution, 8K resolution, and high-definition video such as a huge panoramic video at a position and size desired by the viewer when viewing high-definition video that greatly exceeds the high-definition (HD) quality. Can be viewed on a playback terminal. In addition, when changing the position and size that the viewer likes, the position and size can be changed without missing the video. In addition, as a method for determining the number of resolutions n, the minimum number of resolutions n can be determined below the worst-case digital zoom magnification rate, and the load at the time of tile encoding can be minimized.

  A program for realizing the functions of the server 10 and the client 20 in FIG. 1 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to execute a video. Distribution processing may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer system” includes a WWW system having a homepage providing environment (or display environment). The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Further, the “computer-readable recording medium” refers to a volatile memory (RAM) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In addition, those holding programs for a certain period of time are also included.

  The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

  As mentioned above, although embodiment of this invention has been described with reference to drawings, the said embodiment is only the illustration of this invention, and it is clear that this invention is not limited to the said embodiment. is there. Accordingly, additions, omissions, substitutions, and other changes of the components may be made without departing from the technical idea and scope of the present invention.

  It is possible to reduce the load of reproduction processing and to be applied to an application indispensable to enable high-definition video viewing without video loss.

  DESCRIPTION OF SYMBOLS 10 ... Server, 11 ... Video / audio information output unit, 12 ... Video / audio encoding unit, 13 ... Multiple video position information transmission unit, 14 ... Video / audio information storage unit, DESCRIPTION OF SYMBOLS 15 ... Transmission part, 16 ... Gaze area control part, 17 ... Synthetic tile production | generation part, 18 ... Reproduction terminal information reception part, 20 ... Client, 21 ... Multiple video position information reception , 22... Screen operation control unit, 23... Gaze area request unit, 24... Reception unit, 25... Video / audio decoding unit, 26. ..Reproducing terminal information transmitter

Claims (4)

A video distribution device that distributes encoded video data obtained by encoding a specified part of the entire video data,
Entire with the lowest resolution based on the first image data having a resolution required, the aspect ratio of the entire image and the aspect ratio of the video display screen for displaying the video data in the table display region on the video display screen Distribution data generating means for generating second video data consisting of video data from the whole video data;
Encoding means for generating the encoded video data by encoding each of the first video data and the second video data;
Video distribution means for distributing the encoded video data ,
The delivery data generating means
When “horizontal size / vertical size of the video display screen” ≧ “horizontal size / vertical size of the entire video” is satisfied, the vertical size of the minimum resolution is set to the vertical size of the video display screen. The horizontal size of the lowest resolution is matched to the aspect ratio of the whole image based on the vertical size of the lowest resolution,
When “horizontal size / vertical size of the video display screen” <“horizontal size / vertical size of the entire video” is satisfied, the horizontal size of the minimum resolution is set to the vertical size of the video display screen. , vertical size of the minimum resolution video distribution device according to claim Rukoto fit the aspect ratio of the entire image based on the size of the lateral of the lowest resolution.   The distribution data generation means uses the whole video data having different resolutions of N (N is an integer of 2 or more) determined based on a specified enlargement ratio, and the first video data and the second video data The video distribution apparatus according to claim 1, wherein:   The video distribution apparatus according to claim 1, wherein the distribution data generation unit determines a resolution of the first video data based on a size of the video display screen. A video distribution method performed by a video distribution apparatus that distributes encoded video data obtained by encoding a specified part of the entire video data,
Entire with the lowest resolution based on the first image data having a resolution required, the aspect ratio of the entire image and the aspect ratio of the video display screen for displaying the video data in the table display region on the video display screen A distribution data generation step of generating second video data composed of video data from the whole video data;
An encoding step of generating the encoded video data by encoding each of the first video data and the second video data;
Have a video distribution step of distributing the coded image data,
In the delivery data generation step,
When “horizontal size / vertical size of the video display screen” ≧ “horizontal size / vertical size of the entire video” is satisfied, the vertical size of the minimum resolution is set to the vertical size of the video display screen. The horizontal size of the lowest resolution is matched to the aspect ratio of the whole image based on the vertical size of the lowest resolution,
When “horizontal size / vertical size of the video display screen” <“horizontal size / vertical size of the entire video” is satisfied, the horizontal size of the minimum resolution is set to the vertical size of the video display screen. , vertical size of the minimum resolution video distribution wherein the Rukoto fit the aspect ratio of the entire image based on the size of the lateral of the lowest resolution.

Images