KR101350915B1 - Multi-view video steaming system and providing method thereof - Google Patents

Abstract

Disclosed are a multi-view video streaming system and a method thereof capable of preventing a disconnection of a screen during a view point movement while reducing a band width which is necessary for streaming a multi-view video. According to an embodiment of the present invention, the provided method for providing the multi-view video streaming system includes the following steps in which: (a) the multi-view video streaming system divides and stores multiple videos of each individual time point composing a multi-view video and photographed at different time points and receives a first bulk stream which corresponds to first bulk data among the multiple bulk data from a multi-view video streaming server which streams by a bulk data unit (herein one of the bulk data includes the multiple videos of adjacent individual time points); and (b) the multi-view video streaming system displays a first individual time point video stream included in the first bulk stream on a user terminal. [Reference numerals] (110) Communication module; (120) Decryption module; (130) Display module; (140) Recognition module; (150) Control module; (300) Multi-view video streaming server; (AA) Internet

Description

[0001] Multi-view video streaming system and providing method [

The present invention relates to a multi-view video streaming system and a method for providing the same. More particularly, the present invention relates to a multi-view video streaming system and a method of providing the multi-view video streaming system capable of preventing screen breakage at the time of moving a view point while reducing bandwidth required for streaming multi-view video.

With the advent of the digital age, various multimedia technologies are rapidly evolving, and the digital contents market based on this is growing year by year. Along with this trend, interest in realistic media is increasing in digital image field. In recent years, multi-view video has been actively studied as one of such realistic media.

In a conventional multi-view video system, multi-view video of one scene is captured using a multi-view camera, and multi-view video encoding is performed for effective transmission of the captured image. At the receiving end, the multi-view video is decoded again in the transmitted bit stream, and various application services are provided according to the viewer's request using the decoded multi-view video.

FIG. 1 is a diagram for explaining such a conventional multi-view video streaming system. 1, in the conventional multi-view video streaming system, the individual view images captured by the plurality of cameras 10 are encoded / multiplexed by the multi-view image encoding unit 20, and the multi-view video files 31 And the multi-view video streaming server 30 can stream the generated multi-view video file 31 to the user terminal 40. [ Meanwhile, the multi-view image decoding unit 41 included in the user terminal 40 may demultiplex and decode the multi-view video stream to be streamed to separate the viewpoint video stream. And outputs the selected viewpoint video stream to the display device 50. The display device 50 displays the selected viewpoint video stream.

When an image of all viewpoints acquired by the plurality of cameras 10 is provided to the user, an image that the user does not want is transmitted along with the image of the desired point of view. Therefore, in a transmission environment having a limited bandwidth, The video streaming is difficult to provide, the initial buffering time is very long, and the use efficiency of the content to be used is very low compared to the data to be transmitted.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems of the prior art, and it is an object of the present invention to reduce the bandwidth required for streaming by streaming only a part of each individual viewpoint video included in multi- Point video streaming system and a method thereof, which can prevent a break-up phenomenon at the time of switching of viewpoint.

According to an aspect of the present invention, (a) a multi-view video streaming system configures a multi-view video and stores a plurality of individual view videos captured at different points of view in a plurality of bulk data. And receiving a first bulk stream corresponding to a first bulk data of the plurality of bulk data from a multi-view video streaming server that streams in bulk data units, wherein one bulk data is a plurality of adjacent individual viewpoint video. And (b) the multiview video streaming system displaying the first individual view video stream included in the first bulk stream on a user terminal. .

In one embodiment, the multi-view video streaming system providing method, (c) the multi-view video streaming system, the step of recognizing the view movement command while displaying the first individual view video stream, (d) the back The point video streaming system, in response to the view movement command, displaying a second individual view video stream adjacent to the first individual view video stream to the user terminal, (e) the multiview video streaming system: Determining whether to request a second bulk stream adjacent to the first bulk stream based on the sequence number of the individual view video stream being displayed on the user terminal; and (f) the multiview video streaming system selects the second bulk stream. If it is determined that the request should be made, the second multi-view video streaming server The step of further receiving the second bulk stream to request a greater stream from the multi-view video streaming server may further include.

In one embodiment, each of the plurality of bulk data stored in the multi-view video streaming server includes a plurality of individual view video coded by MVC (Multi-View Coding), the multi-view video streaming system providing method, When the multiview video streaming system receives the first bulk stream, decoding the plurality of individual view video streams included in the first bulk stream, and the multiview video streaming system includes the second bulk stream. And receiving the plurality of individual view video streams included in the second bulk stream.

In an embodiment, the step (c) may include detecting a movement of an object on the touch screen of the user terminal and determining that the viewpoint movement command is input when the movement of the object is detected. can do.

In one embodiment, the multi-view video streaming system providing method further comprises the step of determining the movement speed of the object, step (e), the multi-view video streaming system is being displayed on the user terminal And determining that the second bulk stream should be requested when the sequence number of the individual view video streams falls within a predetermined limit range, and the limit range may be determined based on the movement speed of the object.

In one embodiment, the multi-view video streaming system providing method, the multi-view video streaming system determines whether to request at least one additional bulk stream adjacent to the second bulk stream based on the movement speed of the object. And if the multiview video streaming system determines that the additional bulk stream should be requested, request the additional bulk stream to the multiview video streaming server to further receive the additional bulk stream from the multiview video streaming server. The number of additional bulk streams requested may be determined based on a movement speed of the object.

In an embodiment, when the view shift command is a view shift command in a first direction, the second individual view video stream is adjacent to the first individual view video stream in the first direction and the second bulk stream. Is adjacent to the first bulk stream in the first direction, and when the view shift command is a view shift command in a second direction opposite to the first direction, the second individual view video stream may include the first stream. An individual view video stream may be adjacent to the second direction, and the second bulk stream may be adjacent to the first bulk stream in the second direction.

In one embodiment, each of the bulk data includes a series of bulk images arranged in chronological order, wherein the bulk image includes the bulk image among images included in a plurality of individual viewpoint videos included in the bulk data. The image corresponding to the time corresponding to the image may be an image of a form connected in one or two dimensions.

The bulk image may include the bulk data when the horizontal size of an image corresponding to the time corresponding to the bulk image among the images included in the plurality of individual view videos included in the bulk data is larger than the vertical size. An image corresponding to a time corresponding to the bulk image among the images included in the plurality of individual view videos included in the image is vertically connected, and the image included in the plurality of individual view videos included in the bulk data. When the vertical size of the image corresponding to the time corresponding to the bulk image is larger than the horizontal size, the image corresponding to the time corresponding to the bulk image among the images included in the plurality of individual view videos included in the bulk data is vertically displayed. It may be an image of a connected form.

In one embodiment, each of the bulk data includes a series of bulk images arranged in chronological order, wherein the bulk images correspond to the bulk images of the images included in the plurality of individual view videos included in the bulk data. The divided images obtained by dividing the image corresponding to the time by a certain number may be images of a sequence.

In an embodiment, the multi-view video streaming system may further include storing all individual view video streams included in the received bulk stream in a cache memory included in the multi-view video streaming system.

According to another aspect of the present invention, the multi-view video streaming system, constituting a multi-view video and stores a plurality of individual viewpoint video shot at different viewpoints divided into a plurality of bulk data, where one bulk The data comprises a plurality of mutually contiguous discrete viewpoint videos; and wherein the multi-view video streaming system includes streaming a first bulk stream corresponding to a first bulk data of the plurality of bulk data to a user terminal; A method for providing a point video streaming system is provided.

In one embodiment, the multi-view video streaming system providing method, the multi-view video streaming system, receiving a view movement command while streaming the first bulk stream, the multi-view video streaming system, the view In response to a movement command, determining the order of the individual view video streams being displayed on the user terminal, wherein the multi-view video streaming system is configured to determine the order of the individual view video streams being displayed on the determined user terminal. Determining whether to transmit the second bulk stream adjacent to the first bulk stream; and if the multi-view video streaming system determines that the second bulk stream should be transmitted, further streaming the second bulk stream to the user terminal. It may further comprise the step.

According to another aspect of the present invention, there is provided a computer-readable recording medium on which a program for performing the above-described method is recorded.

According to another aspect of the present invention there is provided a multi-view video streaming system comprising a processor and a memory for storing a computer program executed by the processor, wherein the computer program, when executed by the processor, A multi-view video streaming system is provided for allowing a video streaming system to perform the method described above.

According to another aspect of the present invention, as a multi-view video streaming system, a multi-view video constituting a multi-view video is divided into a plurality of pieces of bulk data stored in a plurality of pieces of bulk data and stored again in the bulk data unit A communication module for receiving a first bulk stream corresponding to first bulk data of the plurality of bulk data from a point video streaming server, wherein one bulk data includes a plurality of adjacent individual viewpoint video; and the first A multiview video streaming system is provided that includes a display module for displaying a first individual view video stream included in a bulk stream to a user terminal.

In one embodiment, the multi-view video streaming system, based on the sequence of the recognition module for recognizing the view movement command during the display of the first individual view video stream and the individual view video stream being displayed on the user terminal. And a control module for determining whether to request a second bulk stream adjacent to one bulk stream, wherein the display module is configured to, in response to the view movement command, a second individual view video stream adjacent to the first individual view video stream. And display the multi-view video stream by requesting the second bulk stream to the multi-view video streaming server when it is determined that the control module should request the second bulk stream. Can further receive the second bulk stream from a server The.

In one embodiment, each of the plurality of bulk data stored in the multiview video streaming server includes a plurality of individual view video encoded by MVC, and the multiview video streaming system receives the first bulk stream. The decoding module may decode a plurality of individual view video streams included in the first bulk stream and, when receiving the second bulk stream, decode a plurality of individual view video streams included in the second bulk stream. It may further include.

In one embodiment, the recognition module may detect the movement of the object on the touch screen provided in the user terminal, and determine that the viewpoint movement command is input when the movement of the object is detected.

In one embodiment, the recognition module further determines a movement speed of the object, and the control module is further configured to control the second bulk stream when the sequence number of the individual view video stream being displayed on the user terminal falls within a predetermined limit range. It is determined that the need to request, but the limit range may be determined based on the movement speed of the object.

In an embodiment, the control module may further determine whether to request at least one additional bulk stream adjacent to the second bulk stream based on a movement speed of the object, and wherein the communication module is further configured to include the control module. If it is determined that the bulk stream should be requested, the additional bulk stream is requested to the multiview video streaming server to further receive the additional bulk stream from the multiview video streaming server, and the number of additional bulk streams requested is determined by the object. It can be determined based on the speed of movement of.

In one embodiment, each of the bulk data includes a series of bulk images arranged in chronological order, wherein the bulk image includes the bulk image among images included in a plurality of individual viewpoint videos included in the bulk data. The image corresponding to the time corresponding to the image may be an image of a form connected in one or two dimensions.

In one embodiment, each of the bulk data includes a series of bulk images arranged in chronological order, wherein the bulk images correspond to the bulk images of the images included in the plurality of individual view videos included in the bulk data. The divided images obtained by dividing the image corresponding to the time by a certain number may be images of a sequence.

In one embodiment, a method of providing a multiview video streaming system includes storing, by the multiview video streaming system, all individual view video streams included in a received bulk stream in a cache memory provided by the multiview video streaming system. It may further include.

According to another aspect of the present invention, a storage module for constituting a multi-view video and storing a plurality of individual viewpoint videos captured at different viewpoints into a plurality of bulk data, wherein one bulk data is a plurality of adjacent ones. A multi-view video streaming system is provided that includes an individual view video and a streaming module for streaming a first bulk stream corresponding to a first bulk data of the plurality of bulk data to a user terminal.

In one embodiment, the multi-view video streaming system, the command receiving module for receiving a view-movement command while streaming the first bulk stream and the individual view-point video stream being displayed on the user terminal in response to the view-movement command. The control module may further include determining a sequence number and determining whether to transmit the second bulk stream adjacent to the first bulk stream based on the determined sequence number of the individual view video stream being displayed on the user terminal. If the control module determines that the second bulk stream should be transmitted, the second bulk stream may be further streamed to the user terminal.

According to another aspect of the present invention, a multi-view video streaming system, a multi-view video constituting a multi-view video and stored in a plurality of bulk data by storing a plurality of individual viewpoint video shot at different views and streams in bulk data unit Receiving a first bulk stream corresponding to a first bulk data of the plurality of bulk data from a point video streaming server, wherein one bulk data includes a plurality of mutually contiguous individual viewpoint video; Displaying, by the streaming system, a first individual view video stream included in the first bulk stream on a user terminal; while the multiview video streaming system displays the first individual view video stream in a first direction. Recognizing a view movement instruction, the multiview video stream In response to the view movement command in the first direction, a dimming system displaying the first individual view video stream and a second individual view video stream adjacent to the first direction to the user terminal; The streaming system determines whether to request the second bulk stream adjacent to the first bulk stream in the first direction based on the sequence number of the second individual view video stream in response to the view movement command in the first direction. And when the multi-view video streaming system determines that the second bulk stream should be requested, requesting the second bulk stream to the multi-view video streaming server to transmit the second bulk stream from the multi-view video streaming server. A multi-view video streaming system providing method comprising the step of further receiving a stream is provided. It is.

In one embodiment, the multi-view video streaming system providing method, the multi-view video streaming system, while displaying the first individual view video stream command to move the view in a second direction opposite to the first direction And recognizing, by the multi-view video streaming system, in response to the view movement command in the second direction, the user terminal receives a third individual view video stream adjacent to the first individual view video stream in the second direction. Displaying in the multi-view video streaming system adjacent to the first bulk stream in the second direction based on the order of the second individual view video stream in response to the view-shift command in the second direction. Determining whether a third bulk stream is requested and wherein the multi-view video streaming system is configured to: 3 when it is determined that it is necessary to request a bulk stream, it is possible to request the third bulk stream back to the multi-view video streaming server, comprising the step of further receiving said third bulk stream again from the multi-view video streaming server.

The multi-view video streaming system according to an embodiment of the present invention does not receive all the individual viewpoint video streams included in the multi-view video but only a part of the individual viewpoint video streams in bulk stream units, thereby reducing the bandwidth required for streaming .

In addition, by receiving not only the bulk stream including the individual view video stream currently being displayed, but also the adjacent bulk stream in advance, there is an effect of preventing a drop in the viewpoint movement.

In addition, when the view shift command is input slowly, the adjacent bulk stream is received later and the bandwidth occupied by the transmitted bulk stream can be efficiently used. Receive streams earlier to avoid dropouts that can occur when timing is switched.

BRIEF DESCRIPTION OF THE DRAWINGS A brief description of each drawing is provided to more fully understand the drawings recited in the description of the invention.
1 is a view for explaining a conventional multi-view video streaming system.
2 is a block diagram illustrating a multi-view video streaming system in accordance with an embodiment of the present invention.
3 is a diagram for describing a method of streaming a multiview video in bulk data units in a multiview video streaming server according to an embodiment of the present invention.
FIG. 4 is a diagram for describing a method of separating individual view videos from a bulk stream and providing them to a user terminal in a multiview video streaming system according to an embodiment of the present invention.
5 is a view for explaining an example of a view movement command that can be recognized by a multi-view video streaming system according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating an example in which a multi-view video streaming system receives a bulk stream according to an embodiment of the present invention.
7 is a flowchart illustrating a method of providing a multiview video streaming system according to an embodiment of the present invention.
8 is a block diagram illustrating a multiview video streaming system according to another embodiment of the present invention.
9 is a flowchart illustrating a method of providing a multiview video streaming system according to another embodiment of the present invention.
10 is a diagram for explaining an example of bulk data received in a multiview video streaming system according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The present invention is capable of various modifications and various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the detailed description. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

Also, in this specification, when any one element 'transmits' data to another element, the element may transmit the data directly to the other element, or may be transmitted through at least one other element And may transmit the data to the other component. Conversely, when one element 'directly transmits' data to another element, it means that the data is transmitted to the other element without passing through another element in the element.

Hereinafter, the present invention will be described in detail with reference to the embodiments of the present invention with reference to the accompanying drawings. Like reference symbols in the drawings denote like elements.

2 is a block diagram illustrating a multi-view video streaming system in accordance with an embodiment of the present invention.

Referring to FIG. 2, in order to implement a method of providing a multiview video streaming system according to an embodiment of the present invention, a multiview video streaming system 100 may be provided.

In the embodiment according to FIG. 2, the multi-view video streaming system 100 receives a portion of the multi-view video stream (at least one bulk stream to be described later) from a predetermined multi-view video streaming server 300 over a network. In addition, the individual view video stream may be separated and displayed on the user terminal 200.

The multi-view video streaming server 300 may store the multi-view video in a predetermined storage space (for example, the DB 400) and stream the multi-view video streaming to the multi-view video streaming system 100.

The multi-view video may be composed of a plurality of individual view video captured at different viewpoints. The individual viewpoint video may mean an image photographed by one camera at a specific viewpoint, and two separate viewpoint video adjacent to each other may mean individual viewpoint videos photographed by two cameras adjacent to each other.

The multi-view video streaming server 300 or the DB 400 may divide and store the multi-view video into a plurality of bulk data. One bulk data may include a plurality of individual view videos, and the plurality of individual view videos stored in one bulk data may be adjacent to each other. Therefore, the plurality of individual view videos stored in one bulk data may be images captured by a plurality of cameras sequentially arranged. According to an embodiment, the number of individual view videos stored in each bulk data may be all the same or may be different from each other.

In the present invention, one bulk data may be in the form of a single file stored in a hard disk drive (HDD), and according to an embodiment, the bulk data is a data group or buffer memory (eg, RAM) distributed and stored in the cloud. It may mean data stored in. Hereinafter, an example in which bulk data is implemented as a bulk file is described for convenience, but it is to be understood that the present invention can be applied to a case where bulk data is implemented in another form as well, There will be.

For example, N individual viewpoint videos v ₁ to v _N (v _i is video captured by the i th camera (1 <= i <= N), in which multiview video was captured at different points in time by N cameras. The multi-view video is divided into _M bulk files F ₁ to F _M , and the number of individual view videos included in the bulk file F _j (1 <= j <= M) is | F. Let's say _j |

라고 하면, 벌크 파일 F₁은 개별 시점 비디오 v(1, 1), v(1, 2),… v(1, |F₁|)를 포함할 수 있으며, 벌크 파일 F_i는 개별 시점 비디오 v(i, 1), v(i, 2),… v(i, |F_i|)를 포함할 수 있다.Meanwhile,

Suppose, bulk file F ₁ is an individual view video v (1, 1), v (1, 2),... v (1, | F ₁ |), and the bulk file F _i is the individual view video v (i, 1), v (i, 2),... v (i, | F _i |).

In one embodiment, the multi-view video streaming system 100 may sequentially generate a plurality of individual view videos constituting the multi-view video and divide by a predetermined number to generate the plurality of bulk files, or The plurality of files generated in this manner may be stored by a multiview image encoding apparatus (not shown).

In one embodiment, each of the plurality of bulk files may include a plurality of encoded individual view video by MVC (Multi-View Coding), wherein the MVC refers to a plurality of individual view video Any coding scheme may be included, and various standard techniques such as H.264 may be used, depending on the implementation. In addition, each of the bulk files may be implemented as an image obtained by muxing multiple points into a multi-channel container such as an MPEG-2 TS.

Meanwhile, the multiview video streaming server 300 may stream the multiview video in bulk file units.

FIG. 3 is a diagram for describing a method of dividing and storing a multiview video in bulk and streaming in bulk file units in the multiview video streaming server 300 according to an exemplary embodiment. FIG. 3 illustrates an example in which a multiview video is composed of 36 individual viewpoint videos captured by a total of 36 cameras, and is divided and stored in six bulk files. In addition, for convenience of description, in the example of FIG. 3, each split file includes the same number (six) of individual view video.

Referring to FIG. 3, the multi-view video may be composed of individual viewpoint videos (first view video v ₁ to 36 view video v ₃₆ ) captured by cameras 1 to 36 at different views. The video encoder may divide and decode the 36 individual view videos sequentially by six, and generate six split files (first to sixth bulk files). Accordingly, as shown in FIG. 3, the first bulk file may be a file decoded v ₁ to v ₆ , and the second bulk file may be a file decoded v ₇ to v ₁₂ . The sixth bulk file may be a file decoded from v ₃₁ to v ₃₆ .

The multi-view video streaming server 300 may store the multi-view video divided into 6 bulk files in the DB 400, and stream the multi-view video in bulk file units. That is, the multi-view video streaming server 300 transmits the bit stream (ie, the bulk stream) corresponding to the bulk file including the individual view video being displayed on the user terminal 200. Can be streamed. Further, in some cases, an adjacent bulk stream corresponding to the adjacent bulk file adjacent to the bulk file may be further streamed, which will be described later.

On the other hand, the fact that two bulk files (or bulk streams) are adjacent to each other means that the individual view video (or individual view video stream) of the last sequence of one bulk file (or bulk stream) (Or an individual viewpoint video stream) of the first sequential number of the first viewpoint video stream (or the first viewpoint video stream of the first viewpoint video stream) are adjacent to each other.

Referring back to FIG. 2, the multiview video streaming system 100 decodes a bulk stream received from the multiview video streaming server 300 to separate a plurality of individual view video streams included in the bulk stream. One of the individual view video streams may be displayed on the user terminal 200.

Meanwhile, according to another embodiment of the present invention, each of the bulk files includes a series of bulk images arranged in chronological order, and the bulk images are included in a plurality of individual viewpoint videos included in the bulk data. The image corresponding to the time corresponding to the bulk image may be one or two-dimensional images. For example, the bulk file includes a first individual view video to an mth individual view video, and each individual view video includes t ₁ , t ₂ , t ₃ ,. , t _n-1 , and t _n time images (t ₁ <t ₂ <t ₃ ,..., t _n-1 <t _n ), the bulk file includes the respective time t ₁ , t ₂ , t ₃ ,.. , T _n-1, may consist of the bulk image corresponding to t _n, for example, a bulk image corresponding to a certain time _{t i (1 <= i <} = N) are first of t _i each time a video time The video of the second individual viewpoint video at t _i time, the video of the second individual viewpoint video, , And the image at time t _i of the m- _th individual viewpoint video may be connected. In this case, according to the embodiment, an image at a specific time of each individual view video included in one bulk image may be connected in one dimension (for example, in the horizontal or vertical direction) or two-dimensional (for example, ). In particular, when the horizontal size of the video of each individual view video is larger than the vertical size, the video can be vertically connected. On the contrary, when the vertical size is large, the video can be connected horizontally. In this case, since the bulk image has a shape closer to the square, the encoding efficiency of the bulk image can be enhanced. Meanwhile, a predetermined delimiter (for example, a blank, a predetermined color, or a segmented region having a predetermined pattern) may be further disposed between the images of each individual view video included in one bulk image. Therefore, when the bulk stream is played in a general video player, one image in which a plurality of divided images are combined may be output. Meanwhile, in the present embodiment, the multi-view video streaming server 300 extracts images for each view from all the individual view videos included in each bulk file, combines them to generate a bulk image, and regenerates the generated series of bulk images. A bulk file may be generated by encoding using a conventional video encoding method rather than a point video encoding method. The multi-view video streaming system 100 may display an image at a point in time displayed on the user terminal 200 in one bulk image. Only a corresponding portion may be cropped and displayed on the user terminal 200.

Meanwhile, in another embodiment of the present invention, although one bulk file is composed of a series of bulk images as in the above-described embodiment, the image of the specific view of each individual view video to be included in the bulk image of the specific view H may be divided into R divided images having a constant size, and the divided divided images may be sequentially arranged to form a bulk image of the specific time point. In particular, when the horizontal size of the image of the specific time point of each individual view video is larger than the vertical size, the images of the specific time point may be horizontally cut and arranged vertically. Can be listed. In this case, since the bulk image is closer to the square, encoding efficiency of the bulk image may be increased.

Referring to FIG. 10, the bulk file includes a first individual view video to an mth individual view video, and each individual view video includes t ₁ , t ₂ , and t _3. ,… , t _n-1 , and t _n time images (t ₁ <t ₂ <t ₃ ,..., t _n-1 <t _n ), the bulk file includes the respective time t ₁ , t ₂ , t ₃ ,.. , t _n-1 , t _n . On the other hand, when each image constituting each individual view video is divided into R pieces, the bulk image A at a specific time t _i (1 <= i <= N) may be configured as shown in FIG. 10. have.

Meanwhile, the user terminal 200 may include a computer, a laptop, a desktop, a tablet PC, a personal digital assistant (PDA), a workstation, a mobile phone, a satellite phone, a wireless phone, and a session initiation protocol. ), A wireless local device (WLL) station, a smart phone, a wireless computing device including a handheld device with other wireless connectivity, or a processing device coupled to another wireless modem.

As shown in FIG. 2, the multiview video streaming system 100 may be physically separated from the user terminal 200. In this case, the multiview video streaming system 100 and the user terminal may be implemented. The 200 may be connected through various wired / wireless connection methods such as HDMI, USB, and WIFI. In addition, according to the implementation example, the multi-view video streaming system 100 may be included in the user terminal 200 may be implemented.

The multi-view video streaming system 100 may include a communication module 110, a decoding module 120, a display module 130, a recognition module 140, and a control module 150. In accordance with an embodiment of the present invention, some of the above-described components may not necessarily correspond to components necessary for the implementation of the present invention, and in accordance with an embodiment, the multi-view video streaming system 100 Of course, may include more components.

The multi-view video streaming system 100 may include hardware resources and / or software necessary to implement the technical idea of the present invention, and necessarily means one physical component or one device. It is not. That is, the multi-view video streaming system 100 may mean a logical combination of hardware and / or software provided to implement the technical idea of the present invention. If necessary, the multi-view video streaming system 100 may be installed in devices spaced apart from each other. By performing a function may be implemented as a set of logical configurations for implementing the technical idea of the present invention. In addition, the multi-view video streaming system 100 may refer to a set of components that are separately implemented for each function or role for implementing the technical idea of the present invention. For example, the communication module 110, the decoding module 120, the display module 130, the recognition module 140, and / or the control module 150 may be located on different physical devices or may be located on the same physical device. It may be. In addition, according to embodiments, individual modules such as the communication module 110, the decoding module 120, the display module 130, the recognition module 140, or the control module 150 are also located in different physical devices, Configurations located on the physical device may be organically coupled to each other to realize the functions performed by the individual modules.

In this specification, a module may mean a functional and structural combination of hardware for carrying out the technical idea of the present invention and software for driving the hardware. For example, the module may mean a logical unit of a predetermined code and a hardware resource for executing the predetermined code, and it does not necessarily mean a physically connected code or a kind of hardware. Can be easily deduced to the average expert in the field of &lt; / RTI &gt;

The control module 150 may include other components (eg, the communication module 110, the decoding module 120, the display module 130) and the components included in the multi-view video streaming system 100 according to an embodiment of the present invention. And / or the function and / or resource of the recognition module 140).

The communication module 110 may receive a bulk stream corresponding to each of the bulk files of a plurality of bulk files constituting a predetermined multiview video from the multiview video streaming server 300. In particular, the communication module 110 may receive a bulk stream corresponding to a bulk file including an individual view video being displayed on the user terminal 200 among the plurality of bulk files. The control of module 150 may further receive a contiguous bulk stream corresponding to the contiguous bulk file adjacent to the bulk file.

Each of the plurality of bulk files stored in the multi-view video streaming server 300 may include a plurality of individual view videos encoded by MVC. In this case, the decoding module 120 may transmit information to the communication module 110. It is possible to decode a plurality of individual view video streams included in the received bulk stream.

The display module 130 may display any one of a plurality of individual view video streams included in the bulk stream received by the communication module 110 on the user terminal 200.

FIG. 4 is a diagram for describing a method of separating individual view videos from a bulk stream and providing them to the user terminal 200 in the multi-view video streaming system 100 according to an embodiment of the present invention. In the example of FIG. 4, a second bulk stream of the six bulk streams shown in FIG. 3 is received, and the ninth view video stream of the individual view video streams included in the second bulk stream is displayed to the user terminal 200. It shows what to do.

Referring to FIG. 4, when the communication module 110 receives a second bulk stream from the multi-view video streaming system 100, the decoding module 120 decodes / demultiplexes the second bulk stream. The 7-view video stream and the 12-view video stream may be separated. Separate separate view video streams may be stored in buffers, respectively. Then, the display module 130 generates each individual image that can be displayed on the user terminal 200 from the bit streams stored in each buffer, and the image corresponding to the ninth view video stream is generated by the user terminal. It can output to 200.

As described above, according to the spirit of the present invention, the multi-view video streaming system 100 may not receive all the individual view video streams included in the multi-view video, but may receive only a part of them in bulk stream units. Therefore, the multi-view video streaming system 100 according to the technical concept of the present invention has an effect of significantly reducing the bandwidth required for streaming as compared to the conventional method of receiving all individual view video streams included in the multi-view video.

The recognition module 140 may recognize a view movement command while a predetermined first individual view video stream is displayed on the user terminal 200. The view movement command may be input through a predetermined input device (not shown) included in the user terminal 200 or the multi-view video streaming system 100.

The input device may vary from a keyboard, a keypad, a touch pad, a touch screen, and the like. The viewpoint movement command may include information about a viewpoint movement direction. The movable point of time may be vertical, bi-directional, horizontal bi-directional, diagonal bi-directional, and the like.

FIG. 5 is a diagram for one example of inputting a viewpoint moving command through a touch screen.

As shown in FIG. 5, when there is a movement of an object such as a finger or a stylus fan on the touch screen 210 provided in the user terminal 200, the recognition module 140 detects the movement of the object. When the movement of the object is detected, it may be determined that a viewpoint movement command is input. For example, the recognition module 140 may recognize that the view movement command to the right view is input when the object moves to the left, and the view movement command to the left view is input when the object moves to the right. I can recognize it. On the contrary, there may be embodiments in which the object is recognized as a view movement command in the direction in which the object moves.

When the recognition module 140 recognizes the viewpoint movement command, the display module 130 responds to the viewpoint movement command and replaces the first individual viewpoint video stream being displayed by the user terminal 200. The viewpoint movement command may be performed by displaying a second individual viewpoint video stream adjacent to the viewpoint video stream on the user terminal. In this case, when the view shift command is a view shift command in a first direction, the second individual view video stream is adjacent to the first individual view video stream in the first direction, and the view shift command is in the first direction. In the case of a view shift command in a second direction opposite to the direction, the second individual view video stream may be adjacent to the first individual view video stream in the second direction.

The control module 150 includes a bulk stream (first bulk stream) adjacent to a bulk stream (first bulk stream) including the individual view video stream being displayed based on the order of the individual view video streams being displayed on the user terminal 200. Bulk stream), and when the control module 150 determines that the second bulk stream needs to be requested, the communication module 110 sends the multi-view video streaming server 300 to the multiview video streaming server 300. A second bulk stream may be requested to further receive the second bulk stream from the multi-view video streaming server 300.

In one embodiment, the control module 150 may determine that the second bulk stream should be requested if the sequence number of the individual view video stream being displayed on the user terminal 200 falls within a predetermined limit range. Here, the sequence number of the individual view video stream may be the sequence number within the first bulk stream including the individual view video stream, or may be the sequence number within the entire multi-view video.

To this end, the control module 150 is the number of bulk streams constituting a multi-view video to be streamed from the multi-view video streaming server 300 via the communication module 110 or the individual view video included in each bulk stream. Information on the number of streams and / or the total number of individual view video streams constituting the multiview video may be obtained.

The limit range is a first side limit range (e.g., left limit range) that is a range from the smallest sequence in the first bulk stream and a second side limit range that is a range from the highest sequence in the first bulk stream. For example, the right limit range may be included. In this case, the control module 150 may display the first view limit range (for example, the sequence number of the individual view video stream being displayed on the user terminal 200). , Within the left limit range), it may be determined that the bulk stream adjacent to the first direction (eg, the left direction) should be further received, and the sequence number of the individual view video stream being displayed on the user terminal 200 may be determined. If within the second side limit range (e.g., right limit range), the adjacent bulk stream should be further received in a second direction (e.g., right direction) opposite to the first direction. You can judge what you do.

6 is a diagram for explaining an example in which a multi-view video streaming system 100 receives a bulk stream according to an embodiment of the present invention. 6 shows the left limit range from the lowest order (ie 1) to two (ie 1, 2) and the right limit range from the highest order (ie 6) to two (ie 5, 6). The case where it is set is shown. 6 (a) to 6 (h) show the case in which the rightward viewpoint shift instruction is continuously input in chronological order. Meanwhile, in FIG. 6, a thick arrow indicates an individual view video stream displayed on the user terminal, and a thin arrow indicates an individual view video stream that has been streamed but is not displayed. Also, one dotted box represents one bulk stream.

First, as shown in FIG. 6 (a), the multi-view video streaming system 100 displays v (i, 3) of individual view video streams included in the bulk stream F _i on the user terminal 200. If there is, the sequence number within F ₁ of v (i, 3) is 3, which is outside the limit range, so that the control module 150 may determine that it is not necessary to further receive the adjacent bulk stream. Therefore, in 6 (a), the multiview video streaming system 100 may receive only the bulk stream F _i .

When a rightward view movement command is input in the situation as shown in FIG. 6 (a), as shown in FIG. 6 (b), the multiview video streaming system 100 moves a viewpoint to display an individual view stream v (i , 4) is displayed on the user terminal 200, and since the sequence number in F _i of v (i, 4) is outside the limit range as 4, the control module 150 needs to further receive an adjacent bulk stream. You can judge that there is no. Therefore, even in 6 (b), the multi-view video streaming system 100 may receive only the bulk stream F _i .

When the rightward view movement command is input again in the situation as shown in FIG. 6 (b), as shown in FIG. 6 (c), the multiview video streaming system 100 moves the viewpoint to display an individual view stream v ( i, 5) is displayed on the user terminal 200, and since the sequence number within F _i of v (i, 5) is within the right limit range as 5, the control module 150 should further receive an adjacent bulk stream. You can judge that. Therefore, at 6 (c), the multi-view video streaming system 100 may further receive not only the bulk stream F _i but also the bulk stream F _{i + 1} adjacent to the right.

When the rightward view-movement command is input again in the situation as shown in FIG. 6C, as shown in FIG. 6D, the multi-view video streaming system 100 moves a viewpoint to provide an individual view stream v ( i, 6) is displayed on the user terminal 200, and the order in F _i of v (i, 5) is 6, which is within the right limit range, so that the control module 150 adds the adjacent bulk stream to the right. It can be determined that it should be received. Therefore, even at 6 (d), the multi-view video streaming system 100 may receive the bulk stream F _i and the bulk stream F _{i + 1} .

On the other hand, when the rightward view movement command is input again in the situation as shown in FIG. 6 (d), as shown in FIG. 6 (e), the multiview video streaming system 100 moves the bulk stream to move the viewpoint. The first individual view video stream v (i + 1, 1) of F _{i + 1} may be displayed on the user terminal 200. If, Fig. 6 (d) in the bulk stream, F _{i +} If you were ₁ without further receives a receive only the bulk stream F _i, because of receiving the bulk stream F _{i + 1} after the rightward time movement command is input network A disconnection may occur due to delay or buffering. However, according to the embodiment of the present invention, since the adjacent bulk stream F _{i + 1} is further received from before, there is an effect that no break occurs.

On the other hand, since the sequence number within F _{i + 1} of stream v (i + 1, 1) being displayed on the user terminal 200 is within the left limit range as 1, the control module 150 further adds the adjacent bulk stream to the left. It can be determined that it should be received. Therefore, in 6 (d), the multi-view video streaming system 100 may further receive not only the bulk stream F _{i + 1} but also the bulk stream F _i adjacent to the left, so that a leftward view shift command may be prepared. .

When the rightward view-movement command is input again in the situation as shown in FIG. 6 (e), as shown in FIG. 6 (f), the multiview video streaming system 100 moves the viewpoint to display the individual view stream v ( i + 1, 2) is displayed on the user terminal 200, and the order in F ₁ of v (i + 1, 2) is 2, which is within the left limit range, so that the control module 150 has an adjacent bulk stream. It may be determined that further reception should be performed. Therefore, at 6 (f), the multiview video streaming system 100 may further receive not only the bulk stream F _{i + 1} but also the bulk stream F _{i + 1} adjacent to the right.

When the rightward view-movement command is input again in the situation as shown in FIG. 6 (f), as shown in FIG. 6 (g), the multiview video streaming system 100 moves a viewpoint to display an individual view stream v ( i + 1, 3) is displayed on the user terminal 200, and the order within F _{i + 1} of v (i + 3, 3) is 3, which is outside the limit range, so that the control module 150 is adjacent to the bulk. It may be determined that there is no need to receive more streams. Therefore, at 6 (g), the multiview video streaming system 100 may receive only bulk stream F _{i + 1} .

Subsequently, a rightward view movement command is continuously input, and as shown in FIG. 6 (h), the multiview video streaming system 100 transmits individual view streams v (i + 1, 5) to the user terminal 200. ), The order in F _{i + 1} of v (i + 1, 5) is 5, which is within the limit of the right side, so that the control module 150 should further receive an adjacent bulk stream to the right. You can judge. Thus, at 6 (h) the multiview video streaming system 100 may further receive not only the bulk stream F _{i + 1} but also the bulk stream Fi + 2 adjacent to the right.

On the other hand, the limit range may be a predetermined numerical range as in the above-described example, but according to an embodiment, based on the movement speed of the object on the touch screen provided in the user terminal 200, for example, the movement speed of the contact point. It may be a numerical range determined by. To this end, the recognition module 140 may further determine the movement speed of the object. In some embodiments, the speed may be a time average of values determined over several time intervals (eg, the inverse of the frame rate of the display). Preferably, the limit range may be determined as a wider range as the speed of movement of the object increases. This is because the period from the bulk stream containing the individual viewpoint video stream being displayed to the adjacent bulk stream is shortened. In other words, when the movement of the object inputting the viewpoint movement command is slow, the limit range is narrowly determined to efficiently use the bandwidth for transmitting the bulk stream.In the case where the object movement is fast, the viewpoint range is determined by making the limit range wider. It is possible to prevent interruptions that may occur when switching to adjacent bulk streams.

For the same reason, the control module 150 may further determine whether to request at least one additional bulk stream adjacent to the second bulk stream based on the movement speed of the object, and the communication module 110 If it is determined that the control module 150 needs to request the additional bulk stream, the control module 150 may further receive the additional bulk stream from the multiview video streaming server by requesting the additional bulk stream to the multiview video streaming server. In this case, the number of additional bulk streams requested may be determined based on the speed of movement of the object. Preferably, the faster the movement speed of the object, the larger the number of additional bulk streams to be additionally received.

According to an embodiment, the limit range and / or the number of additional bulk streams may not be influenced only by the movement speed of the object, and in addition to the movement speed of the object, the number of individual view video streams included in the bulk stream or Various factors such as the number of bulk streams may be further considered and determined.

Meanwhile, in one embodiment, the control module 150 may store all individual view video streams included in the bulk stream received by the communication module 110 in a cache memory provided by the multiview video streaming system. Thereafter, the control module 150 determines whether an individual view video corresponding to the moved view is stored in the cache memory when there is a view movement command, and when the result is determined, the multiview video streaming Instead of requesting the bulk stream from the server, the individual view video stored in the cache memory may be controlled to be displayed on the user terminal 200.

7 is a flowchart illustrating a method of operating a multi-view video streaming system 100 according to an embodiment of the present invention shown in FIG. 2. The multi-view video streaming system 100 may continuously perform the method shown in FIG. 7.

Referring to FIG. 7, the multi-view video streaming system 100 configures a multi-view video, stores a plurality of individual view videos photographed at different points of time in a plurality of bulk files, and streams them in bulk file units. A multi-view video streaming server 300 may receive a first bulk stream corresponding to the first bulk file of the plurality of bulk files (S100).

In addition, the multi-view video streaming system 100 decodes a plurality of individual view video streams included in the received first bulk stream (S110), and displays the first individual view video stream on the user terminal 200. It may be (S120).

On the other hand, the multi-view video streaming system 100 based on the sequence number of the individual view video stream (that is, the first individual view video stream) being displayed on the user terminal 200, the second bulk adjacent to the first bulk stream. It may be determined whether the stream is requested (S130).

If it is determined that the second bulk stream should be requested, the multi-view video streaming system 100 requests the second bulk stream to the multi-view video streaming server 300 to request the multi-view video streaming server 300. ) Can further receive the second bulk stream and decode it (S140, S150).

On the other hand, the multi-view video streaming system 100 may recognize a view movement command (S160).

If the view movement command is recognized, the multi-view video streaming system 100 may display a second individual view video stream adjacent to the first individual view video stream (S170), and display on the user terminal 200. It may be determined whether a request for a second bulk stream adjacent to the first bulk stream is made based on the order of the individual view video streams (that is, the second individual view video streams) in operation (S180).

If it is determined that the second bulk stream should be requested, the multi-view video streaming system 100 requests the second bulk stream to the multi-view video streaming server 300 to request the multi-view video streaming server 300. ) May further receive the second bulk stream and decode it (S190, S200).

On the other hand, according to another embodiment of the present invention, the multi-view video streaming system 100 may be implemented to stream a multi-view video to the user terminal 200, Figure 8 is a multi-view according to such an embodiment A block diagram illustrating a video streaming system.

Referring to FIG. 8, the multiview video streaming system 100 may include a storage module 160, a streaming module 170, a command receiving module 180, and a control module 190. According to an embodiment of the present invention, some of the above-described components may not necessarily correspond to components necessary for the implementation of the present invention, and according to the embodiment, the multi-view video streaming system 100 Of course, may include more components than this. In the description of FIG. 8, detailed descriptions of the same or easily derived contents as described above will be omitted.

The storage module 160 constitutes a multi-view video and can divide a plurality of individual viewpoint videos photographed at different viewpoints into a plurality of bulk files and store them in a predetermined DB 400.

The streaming module 170 may stream a first bulk stream corresponding to a first bulk file of the plurality of bulk files to the user terminal 200. In this case, the first bulk stream may include an individual view video stream displayed on the user terminal 200.

Meanwhile, when the user instructs the viewpoint movement, the user terminal 200 may transmit a viewpoint movement command to the multi-view video streaming system 100. Then, the command receiving module 180 may receive a viewpoint movement command from the user terminal 200 while streaming the first bulk stream to the user terminal 200.

The control module 190 may determine the order of the individual view video stream being displayed on the user terminal 200. In one embodiment, the control module 190 may be monitoring the sequence number of the bulk stream streamed to the user terminal 200 and the sequence number of the individual bulk stream being displayed on the user terminal 200, the viewpoint movement command If is received, it is possible to update the sequence number of the individual view video stream being displayed on the user terminal. For example, the control module 190 decreases the sequence number of the individual view video stream displayed on the user terminal 200 when the view shift command is a left view shift command, and the view shift command is leftward. In the case of the view movement command, the sequence number of the individual view video stream being displayed on the user terminal 200 may be increased by one.

In addition, the control module 150 may determine whether to transmit the second bulk stream adjacent to the first bulk stream based on the determined order of the individual view video streams being displayed on the user terminal.

If it is determined that the control module 190 should transmit the second bulk stream, the streaming module 170 may further stream the second bulk stream to the user terminal 200.

9 is a flowchart illustrating a method of operating the multi-view video streaming system 100 illustrated in FIG. 8. The multi-view video streaming system 100 may continuously perform the method shown in FIG. 9.

Referring to FIG. 9, the multi-view video streaming system 100 configures a multi-view video, and divides and stores a plurality of individual view videos photographed at different views in a plurality of bulk files (S210).

In addition, the multi-view video streaming system 100 may stream a first bulk stream corresponding to a first bulk file of the plurality of bulk files to the user terminal (S220).

When the multi-view video streaming system 100 receives the view movement command while streaming the first bulk stream, the multiview video streaming system 100 displays the sequence number of the individual view video stream being displayed on the user terminal 200 in response to the view movement command. It may be determined (S230).

Meanwhile, the multi-view video streaming system 100 may determine whether to transmit the second bulk stream adjacent to the first bulk stream based on the determined order of the individual view video streams displayed on the user terminal (S240). If it is determined that the second bulk stream should be transmitted, the second bulk stream may be further streamed to the user terminal 200 (S250).

In some implementations, the multi-view video streaming system 100 may include a processor and a memory for storing a program executed by the processor. The processor may include a single-core CPU or a multi-core CPU. The memory may include high speed random access memory and may include non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to the memory by the processor and other components can be controlled by the memory controller. Here, when the program is executed by the processor, the multi-view video streaming system 100 according to the present embodiment may enable the multi-view video streaming system providing method described above.

Meanwhile, a method of providing a multi-view video streaming system according to an exemplary embodiment of the present invention may be implemented as a computer-readable program command and stored in a computer-readable recording medium. And the target program may also be stored in a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.

Program instructions to be recorded on a recording medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of software.

Examples of the computer-readable recording medium include magnetic media such as a hard disk, a floppy disk and a magnetic tape, optical media such as CD-ROM and DVD, a floptical disk, And hardware devices that are specially configured to store and execute program instructions such as magneto-optical media and ROM, RAM, flash memory, and the like. In addition, the above-described medium may be a transmission medium such as an optical or metal wire, a waveguide, or the like including a carrier wave for transmitting a signal specifying a program command, a data structure, and the like. The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner.

Examples of program instructions include machine language code such as those produced by a compiler, as well as devices for processing information electronically using an interpreter or the like, for example, a high-level language code that can be executed by a computer.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

Claims (23)

(a) The multi-view video streaming system configures a multi-view video, divides and stores a plurality of individual view videos captured at different viewpoints into a plurality of bulk data, and stores the bulk data. Receiving a first bulk stream corresponding to a first bulk data of the plurality of bulk data from a multi-view video streaming server streaming in units, wherein one bulk data includes a plurality of adjacent individual viewpoint video, The first bulk stream includes a first individual view video stream that the multiview video streaming system displays on a user terminal; And
(b) the multi-view video streaming system displaying the first individual view video stream included in the first bulk stream on the user terminal.
The method of claim 1, wherein the multi-view video streaming system is provided.
(c) recognizing, by the multiview video streaming system, a view movement command while displaying the first individual view video stream;
(d) displaying, by the multiview video streaming system, a second individual view video stream adjacent to the first individual view video stream to the user terminal in response to the view shift command;
(e) determining, by the multiview video streaming system, whether to request a second bulk stream adjacent to the first bulk stream based on the sequence number of the individual view video stream being displayed on the user terminal; And
(f) if the multi-view video streaming system determines that the second bulk stream should be requested, requesting the second bulk stream to the multi-view video streaming server to request the second bulk stream from the multi-view video streaming server. A multi-view video streaming system providing method further comprising the step of receiving a stream.
3. The method of claim 2,
Each of the plurality of bulk data stored in the multiview video streaming server includes a plurality of individual view videos encoded by multi-view coding (MVC),
A method for providing a multi-view video streaming system,
Decoding, by the multiview video streaming system, a plurality of individual view video streams included in the first bulk stream when the first bulk stream is received; And
And if the multiview video streaming system receives the second bulk stream, decoding the plurality of individual view video streams included in the second bulk stream.
3. The method of claim 2,
The step (c)
Detecting a movement of an object on a touch screen provided in the user terminal; And
And determining that the viewpoint movement command is input when the movement of the object is detected.
5. The method of claim 4,
A method for providing a multi-view video streaming system,
Determining the movement speed of the object;
The step (e)
And determining, by the multi-view video streaming system, if the sequence number of the individual view video stream being displayed on the user terminal falls within a predetermined limit range, the second bulk stream should be requested.
And the limit range is determined based on a movement speed of the object.
The method of claim 5,
A method for providing a multi-view video streaming system,
Determining, by the multi-view video streaming system, whether to request at least one additional bulk stream adjacent to the second bulk stream based on a movement speed of the object; And
If the multi-view video streaming system determines that the additional bulk stream should be requested, requesting the additional bulk stream to the multi-view video streaming server to further receive the additional bulk stream from the multi-view video streaming server. Including but not limited to:
The number of additional bulk streams requested is determined based on the movement speed of the object.
3. The method of claim 2,
When the view shift command is a view shift command in a first direction, the second individual view video stream is adjacent to the first individual view video stream in the first direction, and the second bulk stream is the first bulk. Adjacent to the stream in the first direction,
The second individual view video stream is adjacent to the first individual view video stream in the second direction when the view shift command is a view shift command in a second direction opposite to the first direction. And a two bulk stream are adjacent to the first bulk stream in the second direction.
The method of claim 1,
Each of the bulk data includes a series of bulk images arranged in chronological order,
In the bulk image,
And a video corresponding to a time corresponding to the bulk video among the images included in the plurality of individual view videos included in the bulk data.
9. The method of claim 8,
In the bulk image,
When the horizontal size of the image corresponding to the time corresponding to the bulk image is greater than the vertical size among the images included in the plurality of individual view videos included in the bulk data, the image is included in the plurality of individual view videos included in the bulk data. The image corresponding to the time corresponding to the bulk image among the image is a vertically connected image,
When the vertical size of an image corresponding to the time corresponding to the bulk image among the images included in the plurality of individual view videos included in the bulk data is larger than the horizontal size, the image is included in the plurality of individual view videos included in the bulk data. Method of providing a multi-view video streaming system is a video of the image corresponding to the time corresponding to the bulk image of the image is connected horizontally.
The method of claim 1,
Each of the bulk data includes a series of bulk images arranged in chronological order,
In the bulk image,
Method for providing a multi-view video streaming system in which the divided images in which the image corresponding to the time corresponding to the bulk image is divided into a predetermined number among the images included in the plurality of individual view videos included in the bulk data are sequentially arranged .
The method of claim 1,
And storing, by the multiview video streaming system, all individual view video streams included in the received bulk stream in a cache memory included in the multiview video streaming system.
The multi-view video streaming system is configured to divide and store a plurality of individual viewpoint video images captured at different viewpoints in a plurality of bulk data, wherein the bulk data is a plurality of adjacent individual viewpoint video. Comprising; And
The multi-view video streaming system streaming a first bulk stream corresponding to a first bulk data of the divided plurality of bulk data to a user terminal, wherein the first bulk stream is an individual to be displayed by the user terminal. A method for providing a multi-view video streaming system comprising a viewpoint video stream.
The method of claim 12, wherein the multi-view video streaming system is provided.
The multi-view video streaming system comprising: receiving a viewpoint movement command while streaming the first bulk stream;
Determining, by the multi-view video streaming system, the sequence number of the individual view video stream being displayed on the user terminal in response to the view movement command;
Determining, by the multi-view video streaming system, whether to transmit a second bulk stream adjacent to the first bulk stream based on the determined order of the individual view video streams being displayed on the user terminal; And
Further comprising streaming the second bulk stream to the user terminal if the multi-view video streaming system determines that the second bulk stream should be transmitted.
A computer-readable recording medium having recorded thereon a program for performing the method according to any one of claims 1 to 13.
A multi-view video streaming system,
A processor; And
A memory for storing a computer program executed by the processor,
14. The multi-view video streaming system, when executed by the processor, causes the multi-view video streaming system to perform the method of any one of claims 1 to 13.
A multi-view video streaming system,
A multi-view video streaming server constituting a multi-view video and dividing and storing a plurality of individual view videos photographed at different points of time into a plurality of bulk data and streaming the data in bulk data units to a first bulk data of the plurality of bulk data. A communication module for receiving a corresponding first bulk stream, wherein one bulk data includes a plurality of adjacent individual viewpoint video, wherein the first bulk stream is a first that the multiview video streaming system displays on a user terminal; Including an individual view video stream; And
And a display module configured to display the first individual view video stream included in the first bulk stream on the user terminal.
17. The method of claim 16,
A recognition module for recognizing a view movement command while displaying the first individual view video stream; And
The control module may further include determining whether to request the second bulk stream adjacent to the first bulk stream based on the sequence number of the individual view video stream being displayed on the user terminal.
The display module,
In response to the view movement command, display a second individual view video stream adjacent to the first individual view video stream to the user terminal,
The communication module includes:
When the control module determines that the second bulk stream needs to be requested, the control module requests the second bulk stream to the multiview video streaming server to further receive the second bulk stream from the multiview video streaming server. Video streaming system.
18. The method of claim 17,
Each of the plurality of bulk data stored in the multi-view video streaming server includes a plurality of individual view videos encoded by MVC,
The multi-view video streaming system comprises:
When receiving the first bulk stream, decode a plurality of individual view video streams included in the first bulk stream,
And a decoding module for decoding the plurality of individual view video streams included in the second bulk stream when the second bulk stream is received.
18. The method of claim 17,
The recognition module,
A multi-view video streaming system for detecting the movement of the object on the touch screen provided in the user terminal, and determines that the viewpoint movement command is input when the movement of the object is detected.
20. The method of claim 19,
The recognition module,
Further determine the movement speed of the object,
The control module includes:
If the sequence number of the individual view video stream being displayed on the user terminal falls within a predetermined limit range, it is determined that the second bulk stream should be requested.
And the limit range is determined based on the speed of movement of the object.
21. The method of claim 20,
The control module includes:
Further determining whether to request at least one additional bulk stream adjacent to the second bulk stream based on a movement speed of the object,
The communication module includes:
When the control module determines that the additional bulk stream needs to be requested, the additional bulk stream is requested to the multiview video streaming server to further receive the additional bulk stream from the multiview video streaming server.
The number of additional bulk streams requested is determined based on the speed of movement of the object.
A storage module constituting a multi-view video and dividing and storing a plurality of individual viewpoint videos photographed at different viewpoints into a plurality of bulk data, wherein one bulk data includes a plurality of adjacent viewpoint images; And
A streaming module for streaming a first bulk stream corresponding to first bulk data among the plurality of divided bulk data to a user terminal, wherein the first bulk stream includes an individual view video stream to be displayed by the user terminal. Multiview video streaming system comprising a.
The system of claim 22, wherein the multi-view video streaming system comprises:
A command receiving module for receiving a move-to-start command during streaming of the first bulk stream; And
In response to the view movement command, the sequence number of the individual view video streams displayed on the user terminal is determined, and the second bulk stream adjacent to the first bulk stream is based on the determined sequence number of the individual view video streams displayed on the user terminal. Further comprising a control module for determining whether the transmission of,
The streaming module,
And if the control module determines that the second bulk stream is to be transmitted, further streaming the second bulk stream to the user terminal.

Images