KR101823377B1 - Media server for providing videos according to predicted view point - Google Patents

Abstract

A media server providing a video by predicting a change of a viewpoint comprises: a reception part receiving a plurality of first images photographed by a plurality of cameras; a reconstruction part reconstructing a plurality of first images to generate a plurality of second images; a transmission part transmitting at least one among the plurality of first images and the plurality of second images, as a reference viewpoint image, to a media playback device; a signaling part providing signaling information including at least one of output position information and network identification information on the reference viewpoint image to the media playback device; and a viewpoint prediction part providing an expected viewpoint image, of which a viewpoint is expected to be moved from a viewpoint of the reference viewpoint image, to the media playback device. The reference viewpoint image and the predicted viewpoint image are distributed and transmitted through a heterogeneous network.

Description

[0001] MEDIA SERVER FOR PROVIDING VIDEOS ACCORDING TO PREDICTED VIEW POINT [

The present invention relates to a media server that provides a moving picture according to a viewpoint prediction.

A 360 degree camera is a camera that can capture all directions of front / rear / left / right, and is mainly used for generating video contents rather than photographs. Conventional 360-degree cameras have been used as an auxiliary tool for capturing dynamic sports scenes. Recently, VR (Virtual Reality) has been rapidly used to produce contents for VR devices.

Korean Patent No. 10-1648673 discloses a method for reconstructing and converting lost images for 360 degree VR image content production in relation to a technique for producing VR content using such a 360 degree camera.

If the VR content is to be changed to a desired point of time, the user terminal must receive segments of all view-point images, resulting in an increase in transmission data. Accordingly, there is a need for a method for providing VR contents without delay and seamlessly while ensuring image quality at a desired point of time.

And a media server for providing a moving picture without delay and interruption by predicting a time point when a media playback apparatus wants to change a time point of an image being played back. A media server that does not receive a segment of all viewpoint images and predicts a viewpoint change of a user and provides corresponding segments is provided. And to provide a media server that provides a moving picture so that a user can receive images at a desired point without interruption by transmitting a large amount of data based on a heterogeneous distributed network. The present invention is to provide a media server that provides moving pictures so that highly efficient transmission and reception can be achieved by minimizing network allocation in terms of network. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided a video processing apparatus including a receiving unit that receives a plurality of first images captured by a plurality of cameras, a reconstructing unit that reconstructs the plurality of first images to generate a plurality of second images, A transmitting unit transmitting at least one of the plurality of first images and the plurality of second images as reference view images, signaling information including at least one of output position information and network identification information of the reference view image, And a predictor for providing a predictive viewpoint image predicted to be moved from a viewpoint of the reference viewpoint image to the media playback apparatus, wherein the reference viewpoint image and the predicted viewpoint image are transmitted to a heterogeneous network Lt; RTI ID = 0.0 > and / or < / RTI >

According to an embodiment, the plurality of cameras are positioned adjacent to each other to photograph a reference object at each viewpoint, and the reconstructing unit reconstructs an image photographed from at least two cameras having a viewpoint adjacent to each other among the plurality of cameras And generate the plurality of second images.

According to one embodiment, the signaling information includes a service list table and a service layer signaling, and the signaling unit uses the service list table to transmit a transmission session established in a plurality of physical channels corresponding to the heterogeneous network, And the service layer signaling includes a User Service Bundle Description (USBD) and a Service-based Transport Session Instance (S-TSID) for the plurality of first images and the plurality of second images, Description, media description (MPD), and meta data (MD).

According to one embodiment, the signaling unit may signal adaptation set information corresponding to the prediction view image using an adaptation set included in the media information.

According to an embodiment, the transmitting unit transmits the reference view image to the media reproduction apparatus using a first adaptation set corresponding to the reference viewpoint image, and the view prediction unit notifies the first adaptation set to the prediction The information of the second adaptation set corresponding to the viewpoint image may be set as link information and the image corresponding to the second adaptation set may be transmitted to the media reproduction apparatus in advance using the link information.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-described objects of the present invention, it is possible to provide a media server for providing a moving picture without delay or interruption by predicting a time point when a media playback apparatus wants to change the viewpoint of the video being played back . It is possible to provide a media server that does not receive a segment of all view-point images but provides a segment corresponding thereto by predicting the viewpoint change of the user. It is possible to provide a media server that provides a moving picture so that a user can receive a video at a desired time point seamlessly by transmitting high capacity data based on a heterogeneous distributed network. It is possible to provide a media server that provides moving pictures so as to enable highly efficient transmission and reception by minimizing network allocation in terms of network.

1 is a configuration diagram of a moving image providing system according to an embodiment of the present invention.
2 is a configuration diagram of a media server according to an embodiment of the present invention.
3 is an exemplary diagram illustrating a process of establishing a transmission session to a physical channel corresponding to a heterogeneous network according to an embodiment of the present invention.
4A and 4B are exemplary diagrams illustrating signaling information according to an embodiment of the present invention.
5 is an exemplary diagram for explaining a process of predicting a predicted viewpoint image predicted to be moved from a viewpoint of a reference viewpoint image according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating a method of providing a moving image by predicting a viewpoint change in a media server according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a moving image providing system according to an embodiment of the present invention. Referring to FIG. 1, the moving picture providing system 1 may include a plurality of cameras 110, a media server 120, and a media player 130. The plurality of cameras 110, the media server 120, and the media player 130 illustrate components that can be controlled by the video providing system 1.

Each component of the moving picture providing system 1 of FIG. 1 is generally connected via a network. For example, as shown in FIG. 1, the media server 120 may be connected to the plurality of cameras 110 or the media player 130 at the same time or at intervals.

The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. The network includes a local area network (LAN), a wide area network (WAN), a wide area network (WWW) Wide Web, wired / wireless data communication network, telephone network, wired / wireless television communication network, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3GPP, LTE, WIMAX, Wi-Fi, Bluetooth, infrared, Communications, Visible Light Communication (VLC), LiFi, and the like.

The plurality of cameras 110 may be positioned adjacent to each other to photograph the reference object at each viewpoint. For example, when the plurality of cameras 110 are N, the first camera 111 is located adjacent to the second camera 112, and the second camera 112 is located adjacent to the first camera 111 and the third And the third camera 113 may be positioned adjacent to the second camera 112 and the Nth camera 114. The third camera 113 may be located adjacent to the camera 113, That is, the Nth camera may be positioned adjacent to the (N-1) th camera and the (Nth) camera.

The plurality of cameras 110 may transmit images photographed by the respective cameras to the media server 120. For example, when the plurality of cameras 110 are N, the 'VIEW 1' image photographed at the first viewpoint at the first camera 111, the 'VIEW 1' image photographed at the second viewpoint at the second camera 112, View image captured at the third viewpoint in the third camera 113 and the 'VIEW N' image captured at the N viewpoint in the N-th camera 114 can be transmitted to the media server 120 have.

The media server 120 may receive a plurality of first images photographed from the plurality of cameras 110. [ For example, the media server 120 receives a first image including 'VIEW 1', 'VIEW 2', 'VIEW 3', ..., VIEW N 'images from a plurality of cameras 110 .

The media server 120 may reconstruct a plurality of first images to generate a plurality of second images. The media server 120 may reconstruct each of the plurality of cameras 110 corresponding to at least two cameras having views adjacent to each other to generate a plurality of second images. For example, the media server 120 reconstructs the 'VIEW 1' image taken by the first camera 111 and the 'VIEW 2' image taken by the second camera 112 to generate a 'VIEW 1-2' image VIEW 2 'image taken by the second camera 112 and the' VIEW 3 'image taken by the third camera 113 to generate a' VIEW 2-3 'image.

The media server 120 may transmit at least one of the first image and the plurality of second images to the media playback apparatus 130 as a reference view image. For example, the media server 120 may transmit the reference view image to the media playback apparatus 130 using the first adaptation set corresponding to the reference view image.

The media server 120 may provide the media playback apparatus 130 with signaling information including at least one of output location information and network identification information of the reference view image. At this time, the media server 120 may signal the information of the adaptation set corresponding to the predicted viewpoint image using an adaptation set included in the media information. The signaling information may include, for example, a service list table and service layer signaling. For example, the media server 120 may connect the service layer signaling with the transport session set in the plurality of physical channels corresponding to the heterogeneous network using the service list table. The service layer signaling includes a User Service Bundle Description (USBD), Service-based Transport Session Instance Description (S-TSID), and Media Information (MPD) information for a plurality of first images and a plurality of second images, : Media Presentation Description) and metadata (MD: Meta Data).

The media server 120 may provide the media playback apparatus 130 with an expected viewpoint image in which a viewpoint movement is expected from the viewpoint of the reference viewpoint image. For example, the media server 120 sets the information of the second adaptation set corresponding to the expected viewpoint image as the link information in the first adaptation set, and uses the link information as the video corresponding to the second adaptation set To the media playback apparatus 130 in advance. In this case, the media server 120 may transmit the reference view image and the predicted view image to the homogeneous network, or may transmit the reference view image and the predicted view image to the first network 140, the second network 141, Lt; RTI ID = 0.0 > 142 < / RTI >

The media playback apparatus 130 may receive one or more of the plurality of first images and the plurality of second images from the media server 120 as reference view images.

The media playback apparatus 130 may receive from the media server 120 signaling information including at least one of output position information and network identification information of a video at a reference time point.

The media playback apparatus 130 can receive from the media server 120 an anticipated viewpoint image in which a viewpoint movement is expected from the viewpoint of the reference viewpoint image. For example, when the media playback apparatus 130 receives the 'view 1' video 131 as the reference view image, the media playback apparatus 130 receives the 'view 1 - 2' video 132 as the predicted view image from the media server 120 can do.

The media playback apparatus 130 is a wireless communication apparatus capable of playing media contents and includes not only a smartphone, a tablet PC, a wearable device, but also Bluetooth (BLE), NFC, RFID, Infrared, WiFi, LiFi, and the like.

2 is a configuration diagram of a media server according to an embodiment of the present invention. Referring to FIG. 2, the media server 120 may include a receiving unit 210, a reconstructing unit 220, a transmitting unit 230, a signaling unit 240, and a view prediction unit 250.

The receiving unit 210 may receive a plurality of first images photographed by the plurality of cameras 110. [ For example, when the plurality of cameras 110 are composed of N, the receiving unit 210 may receive a plurality of first images photographed from the first point of view to the Nth point of view from the plurality of cameras 110.

The reconstructing unit 220 may reconstruct a plurality of first images to generate a plurality of second images. Specifically, the reconstructing unit 220 may reconstruct an image photographed from at least two cameras having a viewpoint adjacent to each other among the plurality of cameras 110 to generate a plurality of second images.

The transmission unit 230 may transmit at least one of the first image and the plurality of second images to the media playback apparatus 130 as a reference view image. For example, the transmitting unit 230 may transmit the reference time point to the media playback apparatus 130 using the first adaptation set corresponding to the reference viewpoint image. The transmission unit 230 may packetize data of the reference view image into segments based on MPEG-DASH (Dynamic Adaptive Streaming over HPPT), and then may distribute the data through the heterogeneous network. The transmitting unit 230 may transmit the segments in consideration of broadcasting, cellular, WLAN, broadband network, and the like. For example, if the reference viewpoint image is a segment corresponding to the 'VIEW 1' image, the transmitting unit 230 transmits the reference viewpoint image to the cellular network. If the reference viewpoint image is a segment corresponding to the 'VIEW 1-2' WLAN network, and when the reference view image is a segment corresponding to the 'VIEW 2' image, it can be transmitted to the broadband network.

For this purpose, the transmission unit 230 transmits a DASH-based transmission method (hereinafter referred to as a DASH-based transmission method) in which a volume and quality of a DASH segment are adaptively streamed according to a reception environment of the media playback apparatus 130 through a Hyper Text Transfer Protocol Can be used. DASH can be classified into, for example, an HTTP transmission protocol based on TCP / IP (Transmission Control Protocol / Internet Protocol) and a ROUTE (Real-time Object delivery over Unidirectional Trnasport) based on UDP / IP have. Here, HTTP is a protocol for real-time and non-real-time services, and ROUTE can be a protocol for real-time services.

The transmitting unit 230 may dispersively transmit the reference view image and the predicted view image through the heterogeneous network. The transmitting unit 230 may allocate at least one virtual channel to each of the plurality of physical channels corresponding to the heterogeneous network and may set a transmission session to the allocated virtual channel to dispersively transmit the reference view image and the expected view image. Here, the virtual channel may mean a logical channel. A process of allocating a virtual channel to each of a plurality of physical channels in the transmitter 230 and setting a transmission session will be described in detail with reference to FIG.

3 is an exemplary diagram illustrating a process of establishing a transmission session to a physical channel corresponding to a heterogeneous network according to an embodiment of the present invention. Referring to FIG. 3, the transmitter 230 may allocate a virtual channel to each of a plurality of physical channels corresponding to the heterogeneous network.

For example, the transmission unit 230 transmits 'virtual channel # 0 (303)' to the 'physical channel 1' 301 corresponding to one of the cellular network, the WLAN network and the broadband network. # M (310) '.

The transmission unit 230 may allocate a 'virtual channel # 0' 303 to connect to the 'physical channel 1' 301 with the TCP / IP or UDP / IP 302. At this time, the transmission unit 230 can transmit the service list table (SLT) 304 to the media playback apparatus 130 through the allocated virtual channel # 0 (303).

Also, the transmitter may allocate 'virtual channel # 1' 306 and 'virtual channel # 2' 307 to connect to the 'physical channel 1' 301 with the HTTP or ROUTE protocol 305. At this time, the allocated virtual channels 306 and 307 can set up a plurality of transmission sessions 'SLS' 308 and 'v1' 309, respectively, by HTTP or ROUTE protocol 305, Service layer signaling and image segments at each view point.

Referring back to FIG. 2, the signaling unit 240 may provide the media playback apparatus 130 with signaling information including at least one of output position information and network identification information of the reference view image. The signaling information may include, for example, a service list table, service layer signaling, and the like.

For example, the signaling unit 240 may connect the transmission session and the service layer signaling set in the plurality of physical channels corresponding to the heterogeneous network using the service list table. The service layer signaling includes, for example, a User Service Bundle Description / User Service Description (USBD / USD) for a plurality of first images and a plurality of second images, a Service-based Transport Session Instance Description, Media Presentation Description (MPD), and Meta Data (MD). In this case, the signaling unit 240 may signal the information of the adaptation set corresponding to the predicted viewpoint image using an adaptation set included in the media information.

The signaling information will be described in detail with reference to FIGS. 4A and 4B.

4A and 4B are exemplary diagrams illustrating signaling information according to an embodiment of the present invention.

4A is an exemplary diagram illustrating a service list table according to an embodiment of the present invention. Referring to FIG. 4A, after receiving the transmission signal from the media server 120, the media playback apparatus 130 may obtain the service list table 400 from the signaling signal of the physical layer. The service list table 400 may serve to link the media playback apparatus 130 with the service layer signaling. For example, the media playback apparatus 130 can acquire the service list table 400 from the 'virtual channel # 0' and acquire the service list table 400 through the acquired service list table 400, which is a physical channel corresponding to the heterogeneous network, Virtual channel # 1 'and a' transmission session (SLS) 'to service layer signaling.

4B is an exemplary diagram illustrating service layer signaling in accordance with an embodiment of the present invention. Referring to FIG. 4B, a service layer signaling (SLS) 410 includes a USBD / USD (User Service Bundle Description / User Service Description) 420, a MPD (Media Presentation Description) 430, Session Instance Description, 440).

The media playback apparatus 130 may refer to the MPD 430 and the S-TSID 440 using the USBD / USD 420. The USBD / USD 420 may include '@ServiceID' 421, '@ fullMPDUri = xxx.mpd' 422, and '@STSDIUri = xxx.stsid' 423. '@ FullDDUri = xxx.mpd' 422 represents information for referring to the MPD 430, '@STSDIUri = xxx.stsid' 423 represents information for referring to the MPD 430, Lt; RTI ID = 0.0 > S-TSID 440 < / RTI >

The media playback apparatus 130 includes a period 431 corresponding to a segment to be transmitted using the MPD 430, an Adaptation Set 432, a segment URL 433, and a Representation 434 And the link information 435 can be confirmed. Here, the MPD 430 may include its own information related to the content to be a service. The period 431 represents an object divided by the time unit to which the segment belongs. The adaptation set 432 represents a type (for example, a video component) of the component to which the segment belongs, and the segment URL 433 represents a transmission The presentation 434 indicates a service quality to which the segment belongs or an image corresponding to a certain point in time. The link information 435 indicates information about an adaptation set corresponding to the expected viewpoint image Can be described. For example, the 'presentation v1' 434 represents an image at the time when the 'v1' identifier is assigned, and the 'presentation v1-2' 435 represents the image at the time when the 'v1-2' It is possible to display an image at an allocated time point.

The media playback apparatus 130 can confirm which physical channel, virtual channel, and transmission session the segment corresponding to each viewpoint is transmitted through using the S-TSID 440. [ The S-TSID 440 includes an IP address of '@ PHY_ID' 441, '@PLP_ID' 442, '@ tsi-v1-2' 443, 'SourceFlow' 444, 'ContentInfo (445). , '@ PHY_ID (2)' 441, '@PLP_ID (# 3)' 442 and '@ tsi-v1-2' 443 are physical channel 2, virtual channel -2) indicates that the segment v1-2 corresponding to the 'viewpoint 1-2' is transmitted, and 'SourceFlow' 444 indicates the data to be transmitted. For example, 'ContentInfo (v1-2)' 445 may indicate that the data to be transmitted is a segment of video corresponding to the 'v1-2' identifier.

The media playback apparatus 130 may receive an expected viewpoint image from the media server 120 based on the service layer signaling 410 described above,

For example, if the viewpoint of the currently playing image is 'v1-2' in the media playback apparatus 130, the media playback apparatus 130 sets the viewpoint image of 'v1-2' 431 of the 'adaptation set 1-2' 432 in the segment 421 and the segment 445 corresponding to the 'v1-2' using the S-TSID 440, Can be obtained.

At this time, in order to acquire a segment corresponding to the predicted view image to be reproduced at the next time, the media playback apparatus 130 sets the ' (Adap.1 & Adap.2, 435) set for the 'adaptation set 1' 436 and the 'adaptation set 2' 438 corresponding to the 'viewpoint 1' and the 'viewpoint 2' can be used.

Accordingly, the media playback apparatus 130 acquires 'v1-2', which is the current playback point of the reference view image, and acquires 'v1-2' of the 'adaptation set 1' 436 using the link information 435 V1 'and' v2 'using' S-TSID '440 and' Presentation 'v2 and 439 of' Presentation v1 and 437 'and' Adaptation Set 2 '438, Segment (v1, 446) 'and segment (v2, 447)' corresponding to '

Referring back to FIG. 2, the view prediction unit 250 may provide the media playback apparatus 130 with an expected view image that is expected to move from the viewpoint of the reference viewpoint image. At this time, the reference view image and the predicted view image can be distributed over the heterogeneous network. For example, the viewpoint prediction unit 250 may transmit the reference viewpoint image to the media playback apparatus 130 using the first adaptation set corresponding to the reference viewpoint image, and may correspond to the predicted viewpoint image in the first adaptation set Information of the second adaptation set to the media playback apparatus 130 may be set as the link information and the video corresponding to the second adaptation set may be previously transmitted to the media playback apparatus 130 using the link information.

FIG. 5 is an exemplary diagram for explaining a process of predicting a predicted viewpoint image predicted to be moved from a viewpoint of a reference viewpoint image according to an embodiment of the present invention.

Referring to FIG. 5, an embodiment in which a reference view image and an expected view image are provided to a media playback apparatus based on a viewpoint movement of a user over time is described through the viewpoint information 500 and the segment information 540 can do.

When the media playback apparatus 130 receives the movement from the viewpoint of the reference viewpoint image to the neighboring viewpoint by the user, the media playback apparatus 130 can play the predicted viewpoint image based on the MPD 550 in the service layer signaling. At this time, the predicted viewpoint image may be acquired from the media server 120 in advance.

For example, suppose that the current playback point in the media player 130 is 'v1' (510). The media playback apparatus 130 may limit a time point at which the user is expected to be requested to move to an adjacent time point to a 'view 1' 511 or a 'view 1-2' 520. At this time, the segment required as the expected time may be the segment (v1-2, 541).

For example, assume that the current playback point in the media playback apparatus 130 is 'v1-2' (520). The media playback apparatus 130 restricts the time point at which the user is expected to be requested to move to the neighboring point to be 'view 1' 512, 'view 1-2' 521, and 'view 2' 530 . At this time, the segments required for the expected time may be segments v1 and 542, and segments v2 and 543.

When the media playback apparatus 130 receives a viewpoint change request from the user, the media playback apparatus 130 acquires a segment corresponding to an expected playback point to be reproduced next in order to provide an image with a delay and a seamless point in time through the MPD 550 in the service layer signaling can do. For example, when the currently playing point is the 'adaptation set 1-2' 551 of the MPD 550, the predicted viewpoint image can be obtained by referring to 'Adap 1 & 2' of the link information.

FIG. 6 is a flowchart illustrating a method of providing a moving image by predicting a viewpoint change in a media server according to an exemplary embodiment of the present invention. The method of predicting the viewpoint change performed by the media server 120 according to the embodiment shown in FIG. 6 and providing the moving picture is similar to that of the moving picture providing system 1 according to the embodiment shown in FIGS. Lt; / RTI > Accordingly, the present invention is also applied to a method of providing a moving image by predicting a viewpoint change performed by the media server 120 according to the embodiment shown in FIGS.

In step S610, the media server 120 may receive a plurality of first images photographed from the plurality of cameras 110. [

In step S620, the media server 120 may reconstruct a plurality of first images to generate a plurality of second images.

In step S630, the media server 120 may transmit one or more of the plurality of first images and the plurality of second images to the media playback apparatus 130 as a reference view image.

In step S640, the media server 120 may provide the media playback apparatus 130 with signaling information including at least one of output location information of the reference view image and network identification information.

In step S650, the media server 120 may provide the media playback apparatus 130 with an expected view image that is predicted to move from the viewpoint of the reference view image.

In the above description, steps S610 to S650 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some of the steps may be omitted as necessary, and the order between the steps may be switched.

The method of predicting the viewpoint change and providing the moving picture in the media server described with reference to Figs. 1 to 6 may also be implemented in the form of a recording medium including a computer program stored in a medium executed by the computer or instructions executable by the computer . In addition, the method for predicting the viewpoint change in the media server described with reference to FIGS. 1 to 6 and providing the moving picture may also be implemented in the form of a computer program stored in a medium executed by a computer.

Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. The computer-readable medium may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

110: Multiple cameras
120: Media server
130: Media playback device
140: first network
141: second network
142: Third network

Claims (5)

1. A media server for providing a moving picture by predicting a viewpoint change,
A receiving unit for receiving a plurality of first images photographed from a plurality of cameras;
A reconstructing unit reconstructing the plurality of first images to generate a plurality of second images;
A transmitting unit transmitting at least one of the plurality of first images and the plurality of second images as a reference view image to the media player;
A signaling unit for providing signaling information including at least one of output position information and network identification information of the reference viewpoint image to the media playback apparatus; And
And a viewpoint prediction unit for providing a predicted viewpoint image predicted to be moved from a viewpoint of the reference viewpoint image to the media playback apparatus,
The reference view image and the predicted view image are distributed and transmitted through a heterogeneous network,
Wherein the signaling information comprises a service list table and a service layer signaling,
Wherein the signaling unit connects the service layer signaling with a transmission session established in a plurality of physical channels corresponding to the heterogeneous network using the service list table.
The method according to claim 1,
Wherein the plurality of cameras are positioned adjacent to each other to photograph a reference object at each viewpoint,
Wherein the reconstructing unit reconstructs the images photographed from at least two cameras having a viewpoint adjacent to each other among the plurality of cameras to generate the plurality of second images.
The method according to claim 1,
The service layer signaling includes a User Service Bundle Description (USBD), a Service-based Transport Session Instance Description (S-TSID), and a Media Information Service (SID) for the plurality of first images and the plurality of second images. A media presentation description (MPD), and metadata (Meta Data).
The method of claim 3,
Wherein the signaling unit signals information of an adaptation set corresponding to the predicted viewpoint image using an AdaptationSet included in the media information.
5. The method of claim 4,
Wherein the transmitting unit transmits the reference view image to the media player using a first adaptation set corresponding to the reference view image,
Wherein the viewpoint prediction unit sets information of a second adaptation set corresponding to the expected viewpoint image as link information in the first adaptation set and uses the link information to display an image corresponding to the second adaptation set To the media playback apparatus in advance.

Images