KR20100046485A - A method and apparatus for an 3d broadcasting service by using region of interest depth information - Google Patents

Abstract

PURPOSE: A method and an apparatus for an 3D broadcasting service by using a region of interest depth information are provided to induce the interest from a viewer by displaying 3D depth information at a desirable region based on an interest region concept. CONSTITUTION: A content provider obtains a depth information image(512) and 2D image information. An encoder(514) performs masking operation for the depth image information, and encodes a masked depth information image. A decoder(421) decodes the depth information image and the 2D image, and a multi-view generator(522) adds the depth information to the 2D image information.

Description

3D broadcast service method and apparatus based on ROI depth information {A METHOD AND APPARATUS FOR AN 3D BROADCASTING SERVICE BY USING REGION OF INTEREST DEPTH INFORMATION}

The present invention relates to a method and apparatus for providing a broadcast service, and to a method and apparatus for providing a 3D broadcast service.

In general, a typical broadcast service includes an over-the-air broadcast service, and there are various broadcast services such as a satellite broadcast service using a satellite, a terrestrial broadcast service, a broadcast service using the Internet or a dedicated cable. Such a broadcast service has a broadcast such as news that emphasizes real time, and various contents such as drama, comedy, and documentary that provide pre-recorded contents are provided.

On the other hand, thanks to the development of modern technology, three-dimensional image services are provided in the movie and game industries. At present, such 3D video service technology is provided in industries such as special films or games. In addition, various attempts and studies are being made to provide 3D video services for broadcast contents.

In general, when providing a 3D image service, in order to provide 3D graphic information, 3D graphic information is provided using depth information between existing 2D image information and each object or object displayed on the 2D image. Here, the depth information means that the distance between the objects displayed on the two-dimensional image from the camera or the distance between the objects from a specific reference position is expressed as information.

Next, a case where the 3D method is used in broadcasting and an example of using depth information will be described. The three-dimensional broadcast, which was studied at the ATTEST project in Europe, simultaneously acquires and transmits image information and depth information in the initial acquisition stage. Then, in the playback step, a process of generating a stereoscopic or multi-view video using DIBR (Depth Image Based Rendering) based on the image and depth information, and then displaying it on the binocular / multi-view display device. Consists of The feature of this method, which was studied in the ATTEST project, uses an imaging device known as ZCam to acquire images for depth information. That is, depth information is acquired along with a general video image using ZCam, and both information are transmitted to a play end. The above-described method will be described in more detail with reference to FIG. 1.

1 is a conceptual diagram of a system for providing a 3D broadcast service.

Reference numeral 110 denotes an apparatus for acquiring an image, and reference numeral 120 denotes an apparatus for reproducing an image. The apparatus for acquiring the image may be implemented by ZCam as described above, and as shown in FIG. 1, the general image information 111 and the depth information image 112 are acquired together. The general image information 111 and the depth information image 112 thus obtained are encoded together or separately. Next, the configuration and operation of the apparatus for obtaining and encoding the image information 111 and the depth information image 112 will be described.

2 is a conceptual block diagram of an apparatus for acquiring image information and depth information image together.

As described above with reference to FIG. 1, the sensor unit 211 acquires the general image 111 and the depth information image 112 together. The general image 111 obtained as described above is input to the image processor 212, and the depth information image 112 is input to the depth information processor 214. The image processor 212 converts the image information acquired by the sensor unit 211 into a form that can be used in a broadcasting system or content provided. The depth information processor 214 also converts the depth information obtained by the sensor unit 211 into a form that can be used in a broadcast system or content provided. The information processed as described above is encoded by the video encoder 213, and the depth information encoder 215 encodes the depth information. The encoded information is multiplexed by the multiplexer 216 and outputs encoded 3D image information.

As described above, the encoded 3D image information may be transmitted through a wireless communication system, for example, over-the-air broadcasting, terrestrial broadcasting, or satellite broadcasting. Alternatively, the encoded image and depth information may be transmitted through a transmission method using a wire, for example, a transmission method such as the Internet or a dedicated cable. In this case, encoding required for each transmission scheme may be performed again.

When the image information is transmitted in the above manner, the image reproducing apparatus receives it in the corresponding manner. Since the image information may be transmitted by either a wireless or wired method, the reception process according to the transmission method is not illustrated in FIG. 1. Image information received in a predetermined manner is subjected to a decoding process for the image information and depth information, as shown by reference numeral 121. Then, the normal image and the depth information image are restored again. Thereafter, the DIBR multi-view generator 122 of the image reproducing apparatus restores the multi-view image, and displays the 3D image on the multi-view display 123. Then, the configuration and operation of the apparatus for displaying and transmitting the image information 111 and the depth information image 112 through the predetermined communication system will be described.

3 is a conceptual block diagram of an apparatus for displaying image information and depth information image.

The data received through the above method is input to the receiver 311. The receiver 311 receives a signal in a manner required by a wireless system or a wired system, and processes the signal into a signal of a predetermined band. For example, in a wireless system, a carrier signal is removed from an RF signal, converted into a signal of a desired band, and then decoded according to transmission of a wireless signal and output. The output of the receiver 311 is input to the demultiplexer 312. The demultiplexer 312 performs demultiplexing by the opposite method of multiplexing the image information and the depth information at the transmitting side. Therefore, the demultiplexer 312 distinguishes and outputs image information and depth information. The demultiplexed image information is input to the image decoder 313, and the demultiplexed depth information is input to the depth information decoder 314.

The video decoder 313 decodes and outputs the photographed two-dimensional? Video signal. The depth information decoder 314 decodes and outputs the depth information obtained together with the 2D information. As described above, the information decoded by the image decoder 313 and the depth information decoder 314 is input to the multiview image generator 315 to generate a multiview image. That is, a three-dimensional image is generated. The multiview image generated by the multiview image generator 315 is displayed as a 3D image by the multiview display 316. Through this, viewers can listen to the 3D image.

In general, there are various methods for obtaining depth information in addition to using a depth camera such as ZCam described above. Another suitable method for utilizing in 3D broadcasting is, for example, stereo matching technique. Next, a stereo image matching technique and a method of acquiring ZCam-based depth information will be briefly described.

(1) stereo image matching technique

Stereo image matching is a method of calculating corresponding points and depth values of each pixel based on pixel value information using two images as inputs. In general, it is difficult to find a corresponding point having a certain level or more of accuracy throughout the image, so that stereo image matching technique has an inaccurate depth value calculated in some regions. In particular, the calculation of the correspondence point of the textureless region in the image has a limit that is theoretically impossible.

(2) ZCam-based depth acquisition method

Using the ZCam has the advantage of obtaining a normal image and a corresponding depth image at the same time. However, due to the limitation of the depth acquisition range of the actual ZCam, there is a limitation that the depth information can be obtained only in a limited area corresponding to a part of the image, not the entire area of the image.

In addition to the above two methods, a device such as a range scanner exists as a method for obtaining reliable depth information over an entire image area, but only depth information about a static scene can be obtained. Therefore, it is not suitable for use in three-dimensional broadcasting that requires video playback.

In other words, the stereo image matching technique has an incorrect value in some image regions. And the ZCam method has a depth range limit of about 1.4m. Based on the stereo image matching technique and the depth information acquired by ZCam, a multiview image can be generated using the DIBR technique. When displaying an image generated in this way on a three-dimensional display monitor, it may be difficult to see the correct stereoscopic image due to inaccurate depth value and depth range limitation. In addition, regardless of the reliability of the depth information, since both the depth information corresponding to the normal image and the general image is sent, a transmission problem may also occur in a situation where the transmission band is not sufficiently secured.

On the other hand, three-dimensional image content may be interesting to the viewer, but fatigue is greatly increased in the visual aspect. Therefore, when exposed to 3D image content for a long time, fatigue is much greater than when 2D image is provided, and it may cause vision loss.

Accordingly, the present invention provides a method and apparatus capable of providing a 3D stereoscopic broadcast service with a reliable amount of information.

In addition, the present invention provides a method and apparatus that can provide a three-dimensional stereoscopic broadcast service by reducing the range limits.

In addition, the present invention provides a method and apparatus that can reduce the fatigue of the viewer in providing a three-dimensional image.

The broadcast service providing method according to an embodiment of the present invention is a transmission method for providing a 3D broadcast service, the process of obtaining a depth information image of the 2D image together with 2D image information, and the 2D image. Generating a mask value for removing an uninterested region of information, masking a depth information image using the mask value, and encoding and transmitting the 2D image information and the masked depth information image It includes.

An apparatus for providing a broadcast service according to an embodiment of the present invention is a transmission apparatus for providing a 3D broadcast service, and includes a sensor unit which acquires a depth information image of the 2D image together with 2D image information, A mask value generator for removing depth information of an uninterested region of the image information, a combiner for masking the depth information image using the mask value, the two-dimensional image information and the masked depth information And a transmitter for encoding and transmitting an image.

The broadcast service receiving method according to an embodiment of the present invention is a broadcast service receiving method for receiving a 3D broadcast service, and separates 2D image information and depth image information and mask information corresponding to the ROI from the received data. And generating a 3D multiview image in the ROI of the 2D image information by using the mask information and the ROI information, and displaying the multiview image.

The broadcast service receiving apparatus according to an embodiment of the present invention is a broadcast service receiving apparatus for receiving a 3D broadcast service, and includes a demultiplexer that separates 2D image information, ROI information, and mask information from received data; And an image providing unit generating a 3D multiview image in the ROI of the 2D image information using the mask information and the ROI information, and a display unit displaying the multiview image.

In the 3D stereoscopic broadcasting according to the present invention, the 3D depth information may be expressed in a desired area only based on the concept of the area of interest so that the viewer can focus attention and interest, and does not need the depth information of the entire image and transmits it. This can reduce the amount of information that is generated. In addition, it is possible to escape from the difficulty of acquiring three-dimensional depth information, and to reduce eye fatigue due to unnecessary three-dimensional images.

Hereinafter, the present invention will be described with reference to the accompanying drawings. In the following description of the present invention, a part obvious to those skilled in the art will be omitted so as not to disturb the gist of the present invention. In addition, it is to be noted that each of the terms described below are only used to help the understanding of the present invention, and may be used in different terms despite the same purpose in each manufacturing company or research group.

First, the overall concept of the present invention will be described, and specific configurations and operations will be described.

In the present invention, a region of interest (ROI) is provided to provide a 3D image, and the 3D display is performed only on the ROI. In the region of interest referred to in the present invention, the region of interest is a region of interest that includes a content provider or an object that wants to receive a 3D image from a viewer who receives the content. In more detail, when one image is provided, a main object exists among the provided images. For example, in the region of interest and the region of indifferent interest, assuming a video of two people talking, two faces or two bodies are the main objects, and the other backgrounds are excluded. In addition, in the case of news or audacity pro among broadcast contents, the presenter and some debaters are mainly interested, so it may be possible to sufficiently broadcast a 3D image by expressing a 3D effect on a region of interest such as a person or a desk rather than a background. Also, in advertisements, when an actor advertises an object, for example, when Hong Gil-dong is holding a cell phone, he is interested in an actor's face or a specific body part, an object that the actor is holding, and the like. Therefore, in such a case, a 3D feeling may be felt for the above-mentioned ROI, and the remaining part may show a conventional 2D image. That is, the present invention is to provide a three-dimensional image for the region of interest, which is the main object, and a two-dimensional image for the uninterested region, which is the remaining region. If the 3D image is selectively provided in this way, the amount of data to be provided is reduced. In addition, since the 3D image may be provided to the main object, the viewer may be interested. In addition, by providing a three-dimensional image only in the necessary portion, it is possible to significantly reduce the fatigue phenomenon when viewing the stereoscopic view of the viewer.

4 is a conceptual diagram for generating and providing broadcast content in 3D only for a region of interest according to an embodiment of the present invention.

First, the process performed at the service provider or content provider will be described. In the present invention, as described in the prior art, the general image 411 is acquired as two-dimensional information. The depth information image 512 including the ROI or the depth information image 512 of only the ROI is obtained. In general, since it is easier to acquire the overall depth information image than to acquire the depth information image only for the ROI, the following description will be based on the assumption that the entire depth information image is acquired. However, when the depth information image may be acquired only for a specific region, that is, the ROI, the depth information image may be acquired only for the ROI. In addition, in the present invention, a masking technique is used for a portion excluding the ROI in order to provide a 3D image only for the ROI. That is, the depth image information is masked on the portion that is not the region of interest, that is, the uninterested region. Therefore, mask information for masking a portion except for the ROI is generated. All of the above information is inputted into an encoder and encoded. In this case, when the mask information does not need to be transmitted, the mask information may be configured not to be encoded. In addition, it is assumed that the 2D image and the depth information image are objectized for each object. Many papers have already been published on how to objectize images, so we will look at one simple example. For example, in the case of MPEG4, a method for describing an image of one frame for each object is already standardized. In addition, it is assumed that the image information is composed of a binary image. In this case, since the generated mask information may indicate the ROI, the generated mask information may be transmitted together with the 2D image information and the depth image information, or may not be transmitted when a special appointment is made.

Such a broadcast service is provided to viewers after being converted into a format corresponding to a service system. Here, the broadcasting system may include a broadcasting system using a wireless network, a broadcasting system using a wired network, or a broadcasting system using a complex method. For example, a broadcasting system using a wireless network may include air broadcasting, terrestrial broadcasting, satellite broadcasting, and the like, and a broadcasting system using a wired network may include broadcasting or cable broadcasting using the Internet. It is also possible to have a broadcasting system in which wired and wireless are mixed. In addition, the broadcast systems include two-way broadcast as well as one-way broadcast.

In the broadcast information transmitted in this manner, the decoder 421 decodes the 2D image information, the depth information of the ROI, and the mask value, and generates a multiview image from the multiview generator 422 using the decoded information. do. The multiview image is provided to the viewer as a multiview image in the multiview display 423. That is, the 3D image is provided to the viewer.

5 is a conceptual diagram for providing a 3D broadcast by setting a region of interest of broadcast content according to another embodiment of the present invention.

FIG. 5 is similar to FIG. 4 described above. Accordingly, the content provider or service provider acquires the 2D general image information 511 and the depth information image 512 including the ROI. In this case, the mask information of the region of interest is not selectively provided by the content provider or the service provider, and the portion except for the region selected using the information selected by the viewer is masked. This will be further discussed below.

The information obtained as described above is input to the encoder 514 to perform a masking operation on the depth image information according to the obtained mask information, and to encode the normal image and the masked depth information image. The broadcast content or broadcast service generated in this way is delivered through a bidirectional transmission medium. In this case, the method of providing a broadcast service in FIG. 5 is provided by one of the methods described in FIG. 4. However, the method of FIG. 5 is different from that of FIG. 4 in that a method for feeding back mask information for a broadcast service is newly added to a service provider that provides a broadcast service. That is, FIG. 5 has a big difference in that interaction between a viewer who receives a broadcast service and a provider that provides a broadcast service is performed in comparison with FIG. 4.

This will be described with respect to the process performed in the terminal 520 of the viewer. The decoder 521 of the listener's terminal decodes the 2D image and the masked depth information image, converts the 2D image and the depth information image of the region of interest, and provides the same to the multiview generator 522. Then, the multi-view generator 522 adds depth information to the 2D image information to generate 3D information only for the ROI. Therefore, we create partial three-dimensional graphics. The partial three-dimensional graphic information generated in this way is provided to the user through the multi-view display 523. In the method as shown in FIG. 5, since the viewer can select a region of interest, if the mask value of the depth information image is stored in advance, it may not be transmitted.

When the above service is initially provided, 3D information may be provided only for the ROI selected by the content provider. In this case, the user can select a new part as the region of interest. This may be implemented by allowing the multi-view display 523 to detect the viewer's selection information. The detected and detected information is provided by the transmitter 525 to determine a selection object, and generates the ROI depth mask information, and then transfer the information to the content provider or broadcast service provider to provide a mask value of the ROI requested by the viewer. can do.

As an example, the viewer selects a specific area or a specific object on a current screen on which a broadcast service is provided. Then, the multi-view display 523 obtains the viewer's selection information from the terminal 520 in the form of a touch screen or a form in which the viewer's request can be received. In more detail, since the image transmitted through the object-based encoding method is already objectized for each object, the area of interest required for the initial transmission is selected based on the object information selected by the user selecting the desired object on the display. You can create a depth mask and a mask of the region of interest. As a specific example, the user selects the desired object on the display using depth information of the ROI composed of N objects and corresponding ROI mask information. When the selected object selects at least one desired object from among all, that is, N objects, a mask value for the selected object is generated and provided to the broadcast transmitter to acquire a stereoscopic image of a desired area.

The mask information distinguishes a region of interest from an uninterested region and becomes an uninterested region for the remaining regions except for the portion selected by the viewer. Therefore, the mask value can be generated by setting the mask value to "0" in the unselected portion and selecting "1" only in the selected portion. As described above, in the case of MPEG4 that provides a video file, a plurality of objects exist in one image frame, and a value of "0" is selected in an area of an object that is not selected by the viewer among the corresponding objects, and the area selected by the viewer. It is possible to obtain a mask value by generating a value of "1". As assumed above, since the video is implemented as a binary image, multiplying the depth information by the mask value causes all the depth information of the uninterested region to disappear. The mask value generated as described above is fed back according to the feedback method provided by the broadcasting system. For example, in case of IPTV, a region of interest mask value may be transmitted over a wire by using its own IP information. In the case of a mobile communication terminal, a unique phone number of a corresponding mobile communication terminal may be used. In addition, even when using satellite broadcasting, a feedback method may be used when a feedback method is determined through a wired telephone or a wireless terminal for an interactive service.

Next, the block configuration and operation of devices according to the above-described method will be described.

6 is a conceptual block diagram of an apparatus for providing selective three-dimensional information according to the present invention.

As described above with reference to FIGS. 1, 4, and 5, the sensor unit 611 acquires a two-dimensional general image and a depth information image. The general image thus obtained is input to the image processor 612, and the depth information image is input to the depth information processor 614. The image processor 612 converts the image information acquired by the sensor unit 611 into a form that can be used in a broadcast system or content provided. In addition, the depth information and / or image information acquired by the sensor unit 611 may be input to the mask information generation unit 615. The mask information generation unit 615 means mask information determined by an operator, a content producer, or a viewer. Accordingly, the mask information generator 615 may generate mask information according to the size of the 2D image and the depth information image.

The process for acquiring the mask information will be described in more detail. The mask information is obtained by selecting the operator or the user or the viewer. In the case of the embodiment of FIG. 4, the service provider or the content producer may selectively generate mask information in advance. In addition, in the case of FIG. 5, basically, a broadcast service is provided as a mask value for providing an optional 3D image as a value set by the operator of the broadcasting system and a mask selected by the viewer when a new mask value is received from the viewer. Create and provide a value as a mask value.

When the mask value is generated in this manner, the depth information processor 614 combines the depth information and the generated mask information in the combiner 616. Therefore, the depth information is marked using a mask value generated by the ROI information selected by the operator, the content provider, or the viewer of the system. In the masked depth information, the depth information masked by the depth information encoder 617 is encoded. When the mask information needs to be transmitted, the mask information may be encoded together by the depth information encoder 613. Also, the 2D image processed by the image processor 612 is subjected to image encoding by the image encoder 613. The masked and encoded depth information image and the encoded two-dimensional image are input to the multiplexer 618 and multiplexed. In this case, when the mask values are transmitted together, the mask information is multiplexed together by the multiplexer 618. The multiplexed image is an encoded 3D image, and the 3D image generates a 3D image only in an optional part. The information generated in this way is actually composed of a smaller amount of data than the 3D image information for the entire area.

Image information generated by the above-described method is transmitted through a transmitter (not shown). Here, the method of transmitting image information is transmitted through one of the methods described above.

7 is a conceptual block diagram of an apparatus for displaying selective 3D image information according to an embodiment of the present invention.

The receiver 311 receives data transmitted through a predetermined broadcast system. Then, the receiver 311 receives a signal according to a transmission method of the broadcasting system, that is, a method required by a wireless system or a wired system, and processes the signal into a signal of a predetermined band. For example, in a wireless system, a carrier signal is removed from an RF signal, converted into a signal of a desired band, and then decoded according to transmission of a wireless signal and output. In the case of a wired system, the data is converted according to the data transmitted through the wired transmission line. The data converted by the receiver 311 is input to the demultiplexer 312.

The demultiplexer 312 performs demultiplexing by an opposite method of multiplexing the image information transmitted from the transmitter and the masked depth information. Accordingly, the demultiplexer 312 distinguishes and outputs image information and masked depth information. Here, the demultiplexer 312 demultiplexes the mask information when the mask information is transmitted together. The demultiplexed image information is input to the image decoder 313, and the demultiplexed depth image information or the depth image information and the mask information are input to the depth information decoder 314.

The image decoder 313 decodes and outputs the photographed two-dimensional image signal. The depth information decoder 314 then decodes the masked depth information. In this case, when the mask information is transmitted together, the masked position may be determined using the mask information. That is, the masked depth information is depth image information that is output by masking a depth information image by determining a mask value by an operator or a viewer from depth information acquired together with 2D information as described above. In this way, the information decoded by the image decoder 313 and the depth information decoder 314 is input to the multiview image generator 315 to generate a multiview image only for the selected portion, and the rest of the image reproduces the 2D image. do. That is, the selective three-dimensional image according to the present invention is generated. The multiview image generated by the multiview image generator 315 is displayed as a 3D image for the portion selected by the multiview display 316 and as a 2D image for the portion not selected. This allows viewers to listen to the optional 3D image. The image decoder 713, the depth information decoder 714, and the multiview image providing unit 715 described above are called image providing units.

1 is a conceptual diagram of a system for providing a 3D broadcast service;

2 is a conceptual block diagram of an apparatus for acquiring image information and depth information image together;

3 is a conceptual block diagram of an apparatus for displaying image information and depth information image;

4 is a conceptual diagram for generating and providing broadcast content in three dimensions only for a region of interest according to an embodiment of the present invention;

5 is a conceptual diagram for providing a 3D broadcast by setting a region of interest of broadcast content according to another embodiment of the present invention;

6 is a conceptual block diagram of an apparatus for providing selective three-dimensional information according to the present invention;

7 is a conceptual block diagram of an apparatus for displaying selective 3D image information according to an embodiment of the present invention.

Claims (16)

In the transmission method for providing a three-dimensional broadcast service, Acquiring a depth information image of the 2D image together with 2D image information; Generating a mask value for removing an uninterested region of the 2D image information; Masking a depth information image using the mask value; And encoding and transmitting the 2D image information and the masked depth information image. The method of claim 1, And transmitting the mask information by encoding the mask information and transmitting the mask information together with the 2D image information and the masked depth information image. The method according to claim 1 or 2, 3D broadcast service method based on ROI depth information, wherein the 2D image information and the depth information image are each composed of objectized information. The method of claim 3, wherein the mask value, 3D broadcast service method based on ROI depth information generated based on a ROI selected by an operator of the broadcast service. The method of claim 3, wherein the mask value, 3D broadcast service method based on ROI depth information generated based on a ROI selected by a viewer. In the transmitting device for providing a three-dimensional broadcast service, A sensor unit which acquires a depth information image of the 2D image together with 2D image information; A mask information generator for removing a depth information of an uninterested region of the 2D image information; A coupling unit for masking the depth information image using the mask value; And a transmitter for encoding and transmitting the 2D image information and the masked depth information image. The method of claim 6, The coupling unit outputs the mask information together, 3. The apparatus of claim 3, wherein the mask information is transmitted together with the 2D image information and the masked depth information image. The method according to claim 6 or 7, 3D broadcast service apparatus based on ROI depth information, wherein the 2D image information and the depth information image are each composed of objectized information. The method of claim 8, wherein the mask value, 3D broadcast service apparatus based on ROI depth information generated based on a ROI selected by an operator of the broadcast service. The method of claim 8, wherein the mask value, 3D broadcast service apparatus based on ROI depth information generated based on ROI received from a viewer's terminal. In the broadcast service receiving method for receiving a 3D broadcast service, Dividing the 2D image information and the depth image information and the mask information corresponding to the ROI from the received data; Generating a 3D multi-view image in the ROI of the 2D image information by using the mask information and ROI information; And a region of interest depth information based on the multiview image. The method of claim 11, 3. The method of claim 3, wherein the 2D image information and the depth image information are each composed of objectized information. The method of claim 12, Obtaining, by the viewer, the ROI by selecting at least one object from among the objectized images in the displayed multi-view image; And transmitting the acquired ROI information to a service provider for providing a broadcast service. In the broadcast service receiving apparatus for receiving a 3D broadcast service, A demultiplexer which separates 2D image information, ROI information, and mask information from the received data; An image providing unit generating a 3D multi-view image in the ROI of the 2D image information by using the mask information and ROI information; 3. The apparatus for 3D broadcasting service based on the ROI depth information, including a display unit configured to display the multiview image. The method of claim 14, And 3D broadcast service apparatus based on ROI depth information, wherein the 2D image information and the depth image information are each composed of objectified information. The method of claim 15, An object selection unit for obtaining a region of interest information by selecting at least one or more objects of the objectized image from the displayed multi-view image; 3. The method of claim 3, further comprising a transmitter configured to transmit the acquired ROI information to a service provider providing a broadcast service.

Images