KR20100061278A - Method for providing multi angle digital broadcating service - Google Patents

Abstract

PURPOSE: A method for providing a multi angle digital broadcasting service is provided to implement a multi angle service in an IPTV by providing a photographed image of selected angle in 3D stereo image type. CONSTITUTION: A plurality of cameras(10-1 to 10-5) each generates right/left stereo images. A multi angle broadcasting service providing device(20) encodes the photographed images recording from a plurality of cameras in transport stream type. The multi angle broadcast service providing device performs inter-stream synchronization. A user terminal(30) outputs the transport stream through screen. If user requests the multi angle screen, the user terminal outputs the transport stream about the corresponding multi angle screen.

Description

Method for providing multi angle digital broadcasting service {Method for providing multi angle digital broadcating service}

The present invention relates to a digital broadcast service, and more particularly, to a method for providing a multi-angle digital broadcast service.

This study is derived from the research conducted as part of the original technology development project of the Ministry of Knowledge Economy and ICT. [Project Name: Optical Subscriber Network (FTTH) Service Development Experiment Project]

In addition to sports broadcasts such as soccer and basketball, viewers often want to focus on the players they want when watching programs that involve multiple people, such as game broadcasts. Through the channel.

In order to improve such a point, a multi-angle broadcasting service has recently been implemented in which a plurality of cameras are arranged in a stadium and the like, and images recorded by cameras having different angles are transmitted through different channels. By changing the channel, the user can watch the image photographed from the desired angle.

The present invention is derived from such a background, and an object of the present invention is to provide a multi-angle digital broadcasting service providing method for providing a captured image of the selected angle in the form of a three-dimensional stereoscopic image.

In addition, an object of the present invention is to provide a method for providing a multi-angle digital broadcasting service that enables viewers to more easily access a desired multi-angle channel.

The technical problem is a step of receiving a three-dimensional stereoscopic image captured image including a left and right stereo image taken by a plurality of cameras; Encoding the input photographed images into a transport stream for providing a multi-angle digital broadcasting service; And transmitting the encoded transport stream to a terminal device.

The encoding may include encoding one of the captured images into a main transport stream, encoding the remaining captured images into a sub transport stream, and transmitting the meta data for the main transport stream and the sub transport stream. Transmitting data; And transmitting a sub transport stream when a request for transmission of at least some of the sub transport streams is input from the terminal device.

The encoding may include encoding images captured by the plurality of cameras into separate transport streams.

The encoding may include encoding images captured by the plurality of cameras into a single transport stream.

On the other hand, the technical problem is a step of receiving a transport stream of the captured image in the form of a three-dimensional stereoscopic image including a left and right stereo image taken by a plurality of cameras to provide a multi-angle service; Outputting at least some of the received transport streams and notifying a channel capable of providing a multi-angle service on a screen; And outputting a multi-angle screen according to the request when the multi-angle service request is input. The multi-angle broadcast service providing method implemented in the user terminal may be achieved.

The outputting may include providing a thumbnail screen for each of the multi-angle screens on the screen; And if one of the provided thumbnails is selected, extracting and outputting a multi-angle transport stream for the selected thumbnail from among the received transport streams.

The receiving of the transport stream may include receiving a transport stream for a main screen and metadata for a multi-angle screen, and outputting the input signal, including receiving a selection signal for a partial region on the screen; Identifying a corresponding multi-angle screen based on coordinate information of the selected area and the received metadata; Requesting a sub transport stream for the identified multi-angle screen; And outputting a multi-angle screen for the sub transport stream received by the request.

According to the present invention, it is possible to implement a 3D-based multi-angle service, it is possible to provide a more lively broadcast service and to implement a multi-angle service in IPTV.

In addition, a user can change a multi-angle channel more simply, and thus provide convenience.

The foregoing and further aspects of the present invention will become more apparent through the preferred embodiments described with reference to the accompanying drawings. Hereinafter, the present invention will be described in detail so that those skilled in the art can easily understand and reproduce the present invention through these embodiments.

1 is a block diagram of a multi-angle digital broadcasting system according to an embodiment of the present invention.

As shown, the multi-angle digital broadcasting system includes the cameras 10-1, 10-2, ... 10-5 as many as the number of multi-angles, the multi-angle broadcasting service providing apparatus 20, and the user terminal 30. It includes.

Each of the cameras 10-1, 10-2, ... 10-5 is a 3D camera that produces left and right stereo images. Left. The stereo image may be processed in the form of each separate stream or may be processed in the form of one stream.

The multi-angle broadcast service providing apparatus 20 encodes captured images from a plurality of cameras 10-1, 10-2,... 10-5 in a transport stream form, and performs synchronization between streams. In this case, a method of configuring an output stream in the multi-angle broadcast service providing apparatus 20 may be classified into three types. The first method is to configure all multi-angle images in one stream. In the second method, a main transport stream including one captured image and a sub transport stream including the remaining captured images are configured. Another method is to configure each of the captured images as a transport stream.

In addition, the multi-angle broadcast service providing apparatus 20 transmits a transport stream in a unicast method or a multicast method. First, when the multicast scheme is used, the number of group IDs varies according to the three output stream configuration schemes described above. When all the captured images are composed of one transport stream, one multicast group ID is used. In the case of a main transport stream and a sub transport stream, two group IDs are used. When each captured image is composed of a transport stream, as many group IDs as the number of transport streams are required.

On the other hand, when transmitting through an IP system, each transport stream can be distinguished by using one IP address for both the unicast method and the multicast method and using different port numbers for each transmission frame.

The user terminal 30 outputs a transport stream received from the multi-angle broadcast service providing apparatus 20 through a screen. In the present embodiment, the user terminal 30 first outputs the main screen when the multi-angle stream is received as one transport stream, and according to the user's selection, the multi-angle screen selected by the user from the received transport stream. Select to display the screen.

In addition, when metadata for the main transport stream and the sub transport stream are received, the main transport stream is output on the screen. When a request for a multi-angle screen is requested from the user, the corresponding multi-angle screen is based on the metadata information. It may also receive a transport stream for the screen and output it.

2 is a flowchart illustrating a multi-angle broadcast service providing method in a multi-angle digital broadcast service providing apparatus according to an embodiment of the present invention.

First, a plurality of 3D cameras receive a captured image (S200). In this case, the captured image is a 3D stereoscopic image including left and right stereo images.

First, in one embodiment, the plurality of stereoscopic images may be encoded in the form of one transport stream (S210). The encoded transport stream is transmitted in a multicast or unicast manner (S220).

Meanwhile, the plurality of stereoscopic images may be encoded in the form of separate transport streams (S230). When each is encoded into a separate transport stream, the transport stream for the image taken by the representative camera among the plurality of cameras is selected as the main transport stream (S240). For example, the photographed video selected as the main transport stream may be an image photographing an overall stadium situation or an image simultaneously photographing game screens of a plurality of players. The main transport stream is transmitted to at least one user terminal in a multicast or unicast manner (S250).

Then, all the captured images of the remaining cameras are encoded in one sub transport stream or in separate transport streams.

In addition, when transmitting the main transport stream (S250), it is preferable to transmit metadata about another captured video associated with the captured video of the main transport stream. In the present embodiment, the metadata may include angle, distance or person, and object information about the multi-angle screen. In addition, the metadata for the sub multi-angle screen may be multiplexed and transmitted together with the main transport stream or may be received in the form of a separate data stream.

Thereafter, when a sub transport stream request for a specific angle screen is received from the user terminal (S260), the corresponding sub transport stream is transmitted to the user terminal (S270).

3 to 5 are exemplary diagrams for describing an embodiment of a form output to a transport stream.

As shown in FIG. 3, the apparatus for providing a multi-angle digital broadcast service according to an embodiment of the present invention may encode a plurality of captured images into a single transport stream. In addition, as shown in FIG. 4, one main transport stream and one sub transport stream may be configured. At this time, the main transport stream is a video output when the channel is initialized, the sub transport stream is a transport stream for the other video except the video included in the main transport stream. In addition, as shown in FIG. 5, images captured by a plurality of cameras may be encoded in separate transport streams.

6 is a flowchart of a method for providing a multi-angle broadcast service implemented in a user terminal according to an embodiment of the present invention.

When a channel change request is input from the user (S600), first, a main video screen of the changed channel is output (S610). Then, whether the corresponding channel is supported by the multi-angle service is checked (S620), and when the multi-angle service is supported, the screen notifies that the corresponding channel is a channel capable of providing the multi-angle service (S630). In one embodiment, if a channel capable of providing a multi-angle service, the channel may be notified by displaying a blinking dot or text message on a part of the output screen.

In the present embodiment, all images captured by a plurality of 3D cameras as a transport stream of a specific channel may be collected in one transport stream.

After that, when an operation command for receiving a multi-angle service is input from the user, the multi-angle images are displayed on the screen in thumbnail form (S640). For example, an operation command for receiving a multi-angle service may be input through an operation in which a user clicks a blinking dot shape or inputs a specific key of a remote controller. The multi-angle image may be displayed in a thumbnail form for a plurality of multi-angle images on a portion of the screen on which the main screen is output.

Thereafter, when a selection signal for one of the thumbnails for the multi-angle image is input from the user (S650), the selected multi-angle image is output to the main screen (S660). In this case, the multi-angle image is an angle screen for a specific player or an image captured at a specific angle.

At this time, if there is a selection of the multi-angle video, streams corresponding to the multi-angle video should be extracted from the transport stream including all of the multi-angle video of the corresponding channel. In this case, extracting the stream corresponding to the multi-angle image may be performed by metadata transmitted together with the transport stream. In the present embodiment, the meta data may include angle, distance or person and object information about the sub multi-angle broadcast stream. In addition, the metadata for the sub multi-angle broadcast stream may be multiplexed and transmitted together with the transport stream or may be received in the form of a separate data stream.

7 and 8 illustrate exemplary screen output states when a multi-angle broadcast service is provided. For example, as shown in FIG. 7, the notification button 70 capable of providing the multi-angle broadcast service may be implemented to blink on a part of the screen. In addition, when the user wants to receive the multi-angle broadcasting service, as shown in FIG. 8, the multi-angle screens 85a and 85b corresponding to the sub-angle screen other than the main screen 80 are overlapped on the main screen in thumbnail form. You can print

9 is a flowchart of a method for providing a multi-angle broadcast service implemented in a user terminal according to another embodiment of the present invention.

When a channel change request is input from the user (S900), first, a main video screen of the changed channel is output (S910). In addition, by checking whether the corresponding channel supports the multi angle service (S920), and if the multi angle service is supported, the screen notifies that the corresponding channel is a channel capable of providing the multi angle service (S930). In one embodiment, if a channel capable of providing a multi-angle service, the channel may be notified by displaying a blinking dot or text message on a part of the output screen.

Afterwards, the viewer selects a direction or a person or object such as a specific soccer player who wants to see in detail on the screen (S940). At this time, the sub transmission frame of the multi-angle screen for the user-selected part is selected based on the selected coordinate information and the metadata of the multi-angle screens transmitted together with the main transport stream for the main video screen of the corresponding channel. S950).

In the present embodiment, the meta data may include angle, distance or person and object information about the sub multi-angle broadcast stream. In addition, the meta data of the sub multi-angle broadcast stream may be multiplexed and transmitted together with the main transport stream or may be received in a separate data stream.

The selected sub transport stream is requested to the multi-angle digital broadcast service providing apparatus in operation S960. At this time, in one embodiment, the request for the sub transport stream may be explicitly requested using the Internet Group Management Protocol (IGMP) which is a multicast protocol. IGMP is an Internet protocol that provides a means for Internet computers to advertise multicast groups to nearby routers. In operation S970, the selected sub transport stream is received and the corresponding multi-angle screen is displayed.

On the other hand, the above-described multi-angle broadcast service providing method can be created by a computer program. The program may also be embodied by being stored in a computer readable media and being read and executed by a computer. The storage medium includes a magnetic recording medium, an optical recording medium and the like.

So far I looked at the preferred embodiments of the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

1 is a block diagram of a multi-angle digital broadcasting system according to an embodiment of the present invention;

2 is a flowchart of a method for providing a multi angle broadcast service in an apparatus for providing a multi angle digital broadcast service according to an embodiment of the present invention;

3 to 5 are exemplary diagrams for describing an embodiment of a form output to a transport stream;

6 is a flowchart of a method for providing a multi-angle broadcast service implemented in a user terminal according to an embodiment of the present invention;

7 and 8 are views illustrating a screen output state when the multi-angle broadcast service is provided;

9 is a flowchart of a method for providing a multi-angle broadcast service implemented in a user terminal according to another embodiment of the present invention.

Claims (10)

Receiving a captured image having a 3D stereoscopic image including left and right stereo images captured by a plurality of cameras; Encoding the input photographed images into a transport stream for providing a multi-angle digital broadcasting service; And And transmitting the encoded transport stream to a terminal device. The method of claim 1, The encoding may include encoding one of the captured images into a main transport stream, encoding the remaining captured images into a sub transport stream, The transmitting step, Transmitting metadata for the main transport stream and the sub transport stream; And And transmitting the sub transport stream when a request for transmission of at least some of the sub transport streams is input from the terminal device. The method of claim 2, wherein the transmitting step, Allocating a first multicast group ID to the main transport stream and allocating a second multicast group ID to the sub transport stream. The method of claim 1, The encoding may include encoding images captured by the plurality of cameras into separate transport streams, respectively. The method of claim 4, wherein The transmitting may include transmitting the separate transport stream to different port numbers of the same IP address. The method of claim 1, The encoding may include encoding images captured by the plurality of cameras in a single transport stream. Receiving a transport stream of a captured image in a 3D stereoscopic image including left and right stereo images captured by a plurality of cameras to provide a multi-angle service; Outputting at least some of the received transport streams and notifying a channel capable of providing a multi-angle service on a screen; And And outputting a multi-angle screen according to the request when the multi-angle service request is input. The method of claim 7, wherein the outputting step Providing a thumbnail screen for each of the multi-angle screens on the screen; And Extracting and outputting a multi-angle transport stream for the selected thumbnail from among the received transport streams, if one of the provided thumbnails is selected; multi-angle broadcast service implemented in a user terminal How to Provide. The method of claim 7, wherein The receiving of the transport stream may include receiving a transport stream for a main screen and metadata for a multi-angle screen, The outputting step, Receiving a selection signal for a partial region on the screen; Identifying a corresponding multi-angle screen based on coordinate information of the selected area and the received metadata; Requesting a sub transport stream for the identified multi-angle screen; And And outputting a multi-angle screen for the sub transport stream received by the request. The method of claim 9, The requesting of the sub transport streams is a multi-angle broadcast service providing method implemented in a user terminal, characterized in that requesting through the Internet Group Management Protocol (IGMP).

Images