KR100740922B1 - Video adaptation conversion system for multiview 3d video based on mpeg-21 - Google Patents

Abstract

The present invention relates to a video adaptive conversion system for MPEG-21 based multi-view three-dimensional image required for adaptive conversion of the video content to meet the user environment and consumer preferences of the user terminal consuming multi-view three-dimensional video content. . That is, in the present invention, the camera information and the multi-view video information for the multi-view three-dimensional video content is described in advance, and the consumers are provided with sufficient information on the corresponding content in advance, and based on this, the consumer uses the user characteristics and the user terminal characteristics. It may require the adaptation of multi-view video content to match the environment, and consequently the producer provides a single content to consumers in various environments. Accordingly, a service that can adapt and transform one multi-view 3D video content to suit different usage environments and various user characteristics and tastes by using user taste and preference information and user terminal characteristic information. To provide an environment. In addition, the single-source multi-use environment provided according to the present invention reprocesses a single multi-view video content to meet the performance and range of functions, different use environments, and various user characteristics of various use terminals, so as to meet different environments and user requirements. By being able to quickly provide a variety of multi-view video content that has been adapted to the conversion, can reduce unnecessary costs incurred in the production and transmission of a plurality of multi-view video content, the user is located and environment It is possible to provide optimal multi-view video contents service that overcomes the spatial constraints and satisfies the user's taste as much as possible.

Multiview, 3D, Video, MPEG-21, Conversion

Description

VIDEO ADAPTATION CONVERSION SYSTEM FOR MULTIVIEW 3D VIDEO BASED ON MPEG-21

1 is a block diagram of a video adaptive conversion system for a multiview 3D image according to an embodiment of the present invention;

2 is a detailed block diagram of the video adaptive conversion system of FIG. 1;

3 is a block diagram of a camera for a multi-view three-dimensional image according to an embodiment of the present invention.

The present invention relates to MPEG-21 for adapting a multi-view three-dimensional video signal to meet various usage environments, i.e., user characteristics and user terminal characteristics, in particular a user terminal that consumes multi-view three-dimensional video content The present invention relates to a video adaptive conversion system for MPEG-21 based multi-view three-dimensional image which is required for adaptive conversion of video content to meet the user's usage environment and consumer preference.

Moving Picture Experts Group (MPEG) proposed Digital Item Adaptation (DIA), a new standard working item of MPEG-21. Digital Item (DI) means Structured Digital Object with a Standard Representation, Identification and Meta-Data, and DIA is a resource adaptation engine of DI. It refers to a process of generating an Adapted DI processed by a Resource Adaptation Engine or a Descriptor Adaptation Engine.

Here, resource refers to an individually identifiable item such as a video or audio clip, an image, or a text item, and may also mean a physical object. Descriptor means information related to an item or component in DI. The user also includes all the producers, owners, distributors and consumers of DI. Media resource refers to content that can be directly digitally represented. In the present specification, the term content is used in the same meaning as DI, media resource, and resource.

According to the prior art, there is a problem in that even in a universal multimedia access (UMA) environment capable of supporting a single source multiuse environment, the advantage of a single source multiuse environment may not be utilized.

That is, the multimedia source uniformly transmits multi-view video contents without considering the user environment and user terminal characteristics, and the user terminal equipped with the video player application consumes the multi-view video contents in the format received from the multimedia source. Because of this, there was a problem that does not correspond to a single source multi-use environment.

Accordingly, an object of the present invention is to use a user terminal that consumes multiview 3D video content and to use a user terminal that consumes multiview 3D video content necessary for adapting and converting the video content to meet consumer preferences. The present invention provides a video adaptive conversion system for MPEG-21 based multi-view three-dimensional image which is required for adaptive conversion of video content to meet the preferences of consumers and consumers.

The present invention for achieving the above object is a video adaptive conversion system for MPEG-21-based multi-view three-dimensional image, and receives video data including multi-view video metadata and multi-view video content generated from a multimedia source A multi-view video adaptive conversion device for adaptively converting a multi-view video content applied from the multi-view video data source means to conform to user characteristic information and terminal characteristics, and the multi-view video adaptive conversion device And a multi-view video data output unit for outputting the adaptively converted video data from the multi-view video adaptive conversion apparatus, which collects information from the user and the user terminal to describe and manage the usage environment information in advance. Information management department, the above That is characterized in that it includes a multi-view video adaptation to adapt the multi-view video data converted again using the previously-described information to user characteristics and user terminal characteristics which is supplied from the video usage environment information managing unit so as to meet the use environment.

Hereinafter, with reference to the accompanying drawings will be described in detail the operation of the preferred embodiment according to the present invention.

1 schematically illustrates a video adaptive conversion system for a multi-view 3D image based on MPEG-21 according to an embodiment of the present invention.

As shown in FIG. 1, the apparatus 100 for multiview video adaptation according to an embodiment of the present invention includes a multiview video adaptive converter 103 and a multiview video usage environment information manager 107. do. Each of the multi-view video adaptive conversion unit 103 and the multi-view video usage environment information management unit 107 may be mounted on a video processing system independently of each other.

When the multi-view video adaptive conversion apparatus 100 is mounted and operated in a multimedia source node system, the video content is adapted to match the use environment by using information previously describing the use environment that consumes the multi-view video content. In order to adaptively convert video contents, information about a usage environment is received from an end user terminal, and the adaptively converted content is transmitted to the end user terminal based on the received usage environment.

The multi-view video data source unit 101 receives video data generated from a multimedia source. The multi-view video data source unit 101 may be included in the multimedia source node system, or may be included in the multimedia relay node system or the end user terminal that receives the multi-view video data transmitted through the wired / wireless network from the multimedia source node system. have.

The multi-view video adaptive conversion unit 103 receives the video data from the multi-view video data source unit 101, and the multi-view video usage environment information management unit 107 previously describes the usage environment, that is, the user characteristics and the user terminal characteristics. The information is used to adaptively transform the multiview video data to match the usage environment.

The multi-view video usage environment information manager 107 collects information from the user and the user terminal to describe and manage the usage environment information in advance. The multi-view video data output unit 105 outputs video data adaptively transformed by the multi-view video adaptive converter 103. The output multiview video data may be transmitted to a multiview video player of an end user terminal, or may be transmitted to a multimedia relay node system or an end user terminal through a wired / wireless network.

FIG. 2 is a block diagram schematically illustrating an embodiment that may be implemented as the multi-view video adaptive transform apparatus of FIG. 1. As illustrated in FIG. 2, the multiview video data source unit 101 may include a multiview video metadata 201 and a multiview video content 203.

The multi-view video data source unit 101 collects and stores multi-view video content and metadata generated from a multimedia source. That is, various video contents and metadata obtained through terrestrial, satellite and cable TV signals, networks such as the Internet, and recording media such as VCRs, CDs, and DVDs are collected and stored.

In this case, the multi-view video content to be delivered includes a multi-view three-dimensional video format of various forms transmitted in a storage or broadcast and streaming form. The multi-view video adaptive converter 103 may include a multi-view video metadata adaptive transform processor 213 and a multi-view video content adaptive transform processor 215.

The multi-view video content adaptive conversion processing unit 215 parses the user characteristic information and the multi-view video terminal characteristic information managed by the user characteristic information management unit 217 and the multi-view video terminal characteristic information management unit 209 and then again. The video signal is adaptively transformed so that the point video contents match the user characteristics and the terminal characteristics.

The multi-view video metadata adaptive conversion processor 213 provides metadata required for the multi-view video content adaptive conversion process to the multi-view video content adaptive conversion processing unit 215, and corresponds to the multi-view video content adaptive conversion processing result. Adaptively transform the content of multi-view video metadata information.

The multi-view video content / metadata output unit 105 outputs content and metadata that are adaptively converted according to user taste information and user terminal feature information of user taste and preference. The metadata 201 may have a multiview 3D camera description and a multiview 3D video description.

The multi-view 3D camera description may define camera arrangements of one of Parallel (1D, 2D), Arc, and Convergent as information of cameras for obtaining multiview 3D video. For each array, the number of cameras (NoOfCameras), camera number (CameraNo), start camera number (StartCamNo), last camera number (EndCamNo), distance between neighboring cameras (CamerDistance) as shown in [Table 1] below. To support stereo images, the left and right eye camera numbers (LeftCameraNumber and RightCameraNumber) are additionally defined.

TABLE 1

Multiview Camera Description (MultiviewCameraDS) Name Define Camera Arrangement Parallel (1D, 2D), Arc, Convergent Camera Number (CameraNo: StartCamNo, EndCamNo) Describes the range of the camera view (StrartCamNo: number of the first camera, EndCamNo: number of the last camera) Number of cameras (NoOfCameras) Describe the number of cameras used Camera Distance Distance from neighboring camera (cm) Left Eye Camera Number (LeftCameraNumber) Describe the number of the camera generating the video to be shown to the left eye Right Eye Camera Number (RightCameraNumber) Describe the number of the camera that generates the video to be shown to the right eye

At this time, the multi-view 3D video description provides information about video content, and as shown in [Table 2], the type of coding scheme (VideoType), transmission order (TransmissionOrder), interleaving order (Bit-Rate) ), And information such as dense spacing between cameras. It also defines whether the image supports stereo (StereoMono) and stereo video multiplexing method (MuxingType). All descriptions can be described by an XML (eXtensible Markup Language) schema.

TABLE 2

Multiview Video Description (MultiviewVideoDS) Name Define Video Type Describe video format (e.g., H.264, MPEG-2) Transmission Order (TransmissionOrder) Order of frames in encoder order (currently various methods are proposed in MPEG-3DAV) Interleaving Order (OrderOfInterleaving) Describe how to form a Basic Unit Bitrate 128Kbps, 256Kbsp, 512Kbs, etc Camera Density (DenseSparse) Describe the density of distance between cameras (Dense or Sparse) Stereo or not (StereoMono) Stereo image support (Stereo or Mono) Multiplexing method (MuxingType) Describe multiplexing of stereo images (side by side, top down, interaced)

The multiview video usage environment information management unit 107 includes a user characteristic information management unit 207, a user characteristic information input unit 217, a multiview video terminal characteristic information management unit 209, and a multiview video terminal characteristic information input unit 219. can do. The user characteristic information management unit 207 receives and manages user's taste and preference information from the user terminal through the user characteristic information input unit 217. The input user characteristic information is managed in a machine readable language of XML format, for example. The multi-view video terminal characteristic information manager 209 receives and manages the terminal characteristic information through the multi-view video terminal characteristic information input unit 219. The input terminal capability information is managed in a machine readable language of XML format, for example.

Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the invention should be determined by the claims rather than by the described embodiments.

As described above, in the present invention, the camera information and the multi-view video information for the multi-view 3D video content are described in advance to provide the consumer with sufficient information about the corresponding content in advance. Based on this, the consumer can request to adapt the multi-view video contents to suit the usage environment of the user characteristics and user terminal characteristics. As a result, the producer provides a single content to consumers in various environments.

Accordingly, a service that can adapt and transform one multi-view 3D video content to suit different usage environments and various user characteristics and tastes by using user taste and preference information and user terminal characteristic information. There is an advantage to provide an environment.

In addition, the single-source multi-use environment provided according to the present invention reprocesses a single multi-view video content to meet the performance and range of functions, different use environments, and various user characteristics of various use terminals, so as to meet different environments and user requirements. By being able to quickly provide a variety of multi-view video content that has been adapted to the conversion, can reduce unnecessary costs incurred in the production and transmission of a plurality of multi-view video content, the user is located and environment There is an advantage that the service of the optimal multi-view video content that can overcome the spatial constraints of the user and at the same time satisfy the user's own taste as possible.

Claims (6)

delete A video adaptive conversion system for MPEG-21 based multiview 3D video, A multi-view video data source unit for receiving video data including multi-view video metadata and multi-view video content generated from a multimedia source; A multi-view video adaptive converter for adaptively converting multi-view video contents applied from the multi-view video data source means to conform to user characteristic information and terminal characteristics; A multiview video data output unit for outputting video data adaptively converted from the multiview video adaptive converter Video adaptive conversion system for a multi-view three-dimensional image comprising a. The method of claim 2, The multi-view video content, A video adaptive conversion system for multi-view three-dimensional video, characterized in that it comprises a multi-view three-dimensional video format of various types stored in a recording medium or transmitted in the form of broadcast and streaming. The method of claim 2, The multi-view video adaptive conversion device, A multi-view video usage environment information management unit which collects information from users and user terminals to describe and manage usage environment information in advance; A multi-view video adaptive conversion unit for adaptively converting multi-view video data to match the usage environment by using information previously describing user characteristics and user terminal characteristics applied from the multi-view video usage environment information management unit. The video adaptive conversion system for a multi-view three-dimensional image comprising a. The method of claim 4, wherein The multi-view video adaptive conversion unit, A multi-view video content adaptive conversion processor for parsing the user characteristic information and the multi-view video terminal characteristic information, and then adaptively converting the video signal so that the multi-view video content conforms to the user characteristic and the terminal characteristic; The multi-view video content adaptive conversion process provides metadata necessary for the multi-view video content adaptive conversion process, and adapts and converts the content of the multi-view video metadata information corresponding to the multi-view video content adaptive conversion processing result. Video metadata adaptive conversion processor The video adaptive conversion system for a multi-view three-dimensional image comprising a. The method of claim 4, wherein The multi-view video usage environment information management unit, A user property information input unit for inputting user property information; A video terminal characteristic information input unit for inputting video terminal characteristic information; A user characteristic information manager configured to manage user characteristic information inputted from the user characteristic information input unit; Video terminal characteristic information management unit input from the video terminal characteristic information input unit The video adaptive conversion system for a multi-view three-dimensional image comprising a.

Images