KR20060058607A - Method for authoring majority view contents or panorama contents, system and apparatus and method for interactive multi-view contents using its - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a multi-view or panoramic content generation method, and an interactive multi-view content authoring apparatus, system and method using the same.

2. The technical problem to be solved by the invention

The present invention provides a multi-view or panoramic content generation method for generating a multi-view content or a panorama content that supports a multi-view service (a panorama service and a multi-view service) using a multi-view image (multi-view image, panoramic image). In addition, by using the multi-view image, the user can select and view an image of a desired view according to the user's request, and additionally related to the multi-view content (multi-view content, panorama content) or independent of it. An object of the present invention is to provide an interactive multi-view content authoring apparatus, a system, and a method for providing a function of authoring / editing interactive multi-view content so that an additional content can be provided to a user.

3. Summary of Solution to Invention

According to an aspect of the present invention, there is provided an interactive multi-view content authoring system, comprising: media input means for receiving various media objects to be edited / manipulated, including a multi-view video and a panoramic video; Interactive multi-view for editing layout and property information between spaces and using the multi-view image (multi-view image, panoramic image) and various media objects received through the media input means, and giving interactive functions to each object. Viewpoint content authoring means; Media encoding / decoding means for performing encoding and decoding on the media object including the multi-view content used in the interactive multi-view content authoring means; And file generating means for generating information edited / written by the interactive multi-view content authoring means in a file form.

4. Important uses of the invention

The present invention is used for editing / writing media content for providing a multi-view service for increasing the degree of freedom of a user's viewpoint using interactive multi-view content.

Multi-view, multi-view, panoramic, interactive, content, authoring, creation

Description

Method for authoring majority view contents or panorama contents, system and apparatus and method for interactive multi-view contents using its}             

1 is a block diagram of an embodiment of an interactive multi-view content authoring system according to the present invention;

FIG. 2 is a detailed configuration diagram of an interactive multi-view content authoring unit shown in FIG. 1;

3 is a flowchart illustrating an embodiment of an interactive multi-view content authoring method according to the present invention;

FIG. 4 is a detailed flowchart illustrating an embodiment of a method for generating multi-view contents, in which a user manipulation illustrated in FIG. 3 is possible;

FIG. 5 is a detailed flowchart illustrating an embodiment of a method for generating panorama content that can be manipulated by users illustrated in FIG. 3;

6 is a structural diagram of an embodiment of a user interface of an interactive multi-view content authoring system for authoring interactive multi-view content;

7 is a structural diagram of an embodiment of a user interface of an interactive multi-view content authoring system for authoring interactive panoramic content.

* Explanation of symbols for the main parts of the drawings

11: Media input unit 12: Interactive multi-view content authoring unit

13: media encoding / decoding unit 14: file generation unit

21: multi-view content generator 22: multi-view content generator

23: panorama content generation unit 24: interactive content authoring / editing unit

The present invention relates to a multi-view or panorama content generating method, and an interactive multi-view content authoring apparatus, a system and a method using the same. A method for generating multi-view or panoramic content for generating panoramic content, editing multi-view content (multi-view content, panoramic content) and space-time arrangement and attribute information between various media objects, and composing a scene The present invention relates to an interactive multi-view content authoring apparatus, a system, and a method for generating the authoring / edited information in a file form after granting an interactive function to each object.

Conventionally, various products using multiple view images have been released. However, most conventional products deal only with still images.

For example, in the case of a panorama image, a technique of acquiring a corresponding panorama image more efficiently, stitching the acquired image, and forming the still image file is mainly dealt with. At this time, metadata information such as the mapping type of the still image file is added to generate the file. The generated file can be viewed in a three-dimensional way with a dedicated viewer.

However, in the conventional technology as described above, it is only possible to compose a panorama content through a single still image, and if the panorama content is composed of a moving picture, the amount of data becomes very large, which may cause a problem in transmission.

In addition, since the prior art considers only the user's viewpoint range and mapping type degree of the stitched panoramic image, it cannot reflect the scene arrangement or resizing of the corresponding content and the provision of additional information related to the corresponding content. . Therefore, it is difficult to meet various user needs, and it is impossible to re-edit a file once created.

Meanwhile, even in the case of a multi-view image, conventional products deal with only still images, and the multi-view content to be input should have the same number of columns in each row in constructing a layout. That is, if there are five images (columns) acquired at 72-degree intervals in a circular form at the same height (row A) as the specific object, the images acquired at a height 1 m above the specific object height (row A ') also have a specific angle. Five images (columns) acquired at intervals must exist to generate multi-view content.

However, the number of images acquired for each photographing height in the input image may vary depending on the camera arrangement. If the number of images acquired for each shooting height of a specific object is different, the relationship between the images is not arranged, and thus a multi-view content cannot be generated properly. Therefore, in this case, it is necessary to define a relationship between the top, bottom, left, and right images of the input image. However, conventional products do not support this part.

In addition, in the conventional authoring apparatus, the multi-view video is only listed in the layout and the corresponding content can be executed through a dedicated viewer, so as in the case of generating panorama content, the scene arrangement or resizing of the multi-view content is related to the corresponding content. Since it cannot reflect additional information, it is difficult to meet various user needs.

In other words, existing products can only author multi-view content and panorama content in a standardized minimal form, and have a disadvantage in that they cannot properly reflect user's demands when authoring. Therefore, the authored content can support only one service of at least a multi-view service or a panoramic service, and it is also impossible to author content that simultaneously provides a panoramic service and a multi-view service.

 The present invention has been proposed to solve the above problems, and to generate a multi-view content or a panorama content supporting a multi-view service (panorama service and multi-view service) using a multi-view image (multi-view image, panoramic image). It is an object of the present invention to provide a multi-view or panorama content generation method.

In addition, the present invention can select and view the image of the desired view according to the user's request by using the multi-view image (multi-view image, panoramic image), and other multi-view content (multi-view content, panorama content) To provide an interactive multi-view content authoring device, system and method for providing a function for authoring / editing interactive multi-view content to additionally provide additional content related to the user or independent content separate from the user. There is another purpose.

That is, the present invention generates multi-view content, edits the space-time arrangement and attribute information between the multi-view content and various media objects, provides interactive functions to each object, and then stores the authored / edited information file. It is another object of the present invention to provide an interactive multi-view content authoring apparatus, a system, and a method for generating the same.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. Also, it will be readily appreciated that the objects and advantages of the present invention may be realized by the means and combinations thereof indicated in the claims.

According to another aspect of the present invention, there is provided an interactive multi-view content authoring system, comprising: media input means for receiving input of various media objects to be edited / manipulated, including a multi-view image and a panoramic image; Interactive multi-view for editing space-time layout and attribute information and giving interactive functions to each object by using the multi-view image (multi-view image, panoramic image) and various media objects received through the media input means. Content authoring means; Media encoding / decoding means for performing encoding and decoding on the media object including the multi-view content used in the interactive multi-view content authoring means; And file generating means for generating information edited / written by the interactive multi-view content authoring means in a file form.

In addition, the apparatus of the present invention for achieving the above another object is, in the interactive multi-view content authoring apparatus, using the multi-view video (multi-view video, panoramic image) received from an external device (interaction operation) Multi-view content generating means for generating multi-view content capable of the above; And editing the space-time arrangement and attribute information between the multi-view content generated by the multi-view content generating means and various media objects, and giving an interactive function to each object constituting the scene, and editing the edited / edited information. Interactive content authoring / editing means for storing in an internal data structure.

In addition, the method of the present invention for achieving the above object, in the interactive multi-view content authoring method, receiving a variety of media objects to be edited / authored, including a multi-view image (multi-view image, panoramic image) step; A multi-view content generation step of generating a multi-view content capable of an interactive operation (user operation) using the input multi-view image; Arranging the generated multi-view content in a scene to be composed; Editing the spatio-temporal layout and attribute information between the generated multi-view content and various media objects, granting an interactive function to each object constituting the scene, and storing the authored / edited information as an internal data structure ; And generating the stored edited / authored information in the form of a file.

On the other hand, the method of the present invention for achieving the above object, in the multi-view content generation method, the step of receiving a multi-view image of n (n is a natural number); Changing a background after extracting a desired specific object by applying an object extraction technique to the input multiview image; Setting up, down, left, and right spatial relationships between multi-view images; Adding a control panel to adjust the multiview image switching; And generating an authoring / editing information by setting an event between the control panel and the corresponding multi-view image.

On the other hand, another method of the present invention for achieving the above object, in the panorama content generation method, comprising: receiving a panorama image for generating the panorama content; Generating a panorama image by applying a panorama stitching technique as panorama stitching is necessary for the received panorama image; A panorama image separation step of separating the panorama image into a plurality of patches as the separation of the panorama image is necessary for transmission; Establishing a spatial relationship between the separated plurality of patches; And a mapping type determining step of determining a mapping type for performing texture mapping.

As described above, the present invention generates multi-view content such as multi-view content and panorama content, edits space-time arrangement and attribute information between the generated multi-view content and various media objects, and provides interactive functions for each object. The author then creates the authored / edited information in a file format to author the interactive multi-view content.

Accordingly, the present invention increases the degree of freedom of the viewpoint by using the multi-view image, so that the user can select and view the image of the desired view according to the user's request, and additional content related to the multi-view content according to the user's request or Provides the ability to author / edit interactive multi-view content to provide users with additional, independent content.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, whereby those skilled in the art may easily implement the technical idea of the present invention. There will be. In addition, in describing the present invention, when it is determined that the detailed description of the known technology related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of an interactive multi-view content authoring system according to the present invention.

As illustrated in FIG. 1, the interactive multi-view content authoring system according to the present invention includes various media objects (audio, image, video, text, and geometric objects) to be edited / written, including a multi-view image and a panoramic image. Space-time arrangement and attribute information using a media input unit 11 to receive (Geometry), etc. from the outside, a multi-view image (multi-view image, a panoramic image) and various media objects received through the media input unit 11 Encoding of a media object including an interactive multi-view content authoring unit 12 and a multi-view content used in the interactive multi-view content authoring unit 12 for editing the data and giving an interactive function to each object. And information edited / written by the media encoding / decoding unit 13 and the interactive multi-view content authoring unit 12 for decoding. It includes a file generation unit 14 for generating in the form of a text or binary file.

Here, the media input unit 11 may receive not only multi-view and panorama-related still images and videos through a mouse, a keyboard, etc., but also various kinds of still images, videos, texts, and geometric objects. The interactive multi-view content authoring unit 12 will be described later in detail with reference to FIG. 2.

The media encoding / decoding unit 13 performs a function of encoding / decoding a video, an audio, a still image, etc. in accordance with an encoding / decoding standard in order to compose a scene using various media objects.

In addition, the file generator 14 may generate a file in the text form of the information authored / edited by the interactive multi-view content authoring unit 12 or may include a media object used for composing authoring / editing information and a scene. To create a binary file. Here, the text format of the generated file structure is, for example, XMT (eXtensible MPEG-4 Textual format: ISO / IEC 14496-1 Amd 3) file standard of the MPEG-4 system, and the binary format is MP4 (ISO / IEC 14496). -14) You can use a format that supports file specifications.

FIG. 2 is a detailed block diagram of an embodiment of an interactive multi-view content authoring unit shown in FIG. 1.

As illustrated in FIG. 2, the interactive multi-view content authoring unit 12 uses the multi-view video (multi-view video, panoramic video) input through the media input unit 11 to perform interactive manipulation (user operation). Edits the space-time arrangement and attribute information between the multi-view content generator 21 for generating multi-view content, and the multi-view content generated by the multi-view content generator 21 and various media objects, It includes an interactive content authoring / editing unit 24 for storing the authoring / editing information as an internal data structure after giving an interactive function to each object constituting the scene.

In addition, the multi-view content generating unit 21 uses a multi-view image received through the media input unit 11 to generate a multi-view content that can be manipulated by a user. It includes a panorama content generating unit 23 for generating a user-operated panorama content using the panorama image received through the input unit 11.

As described above, in the present invention, after generating the multi-view content for the multi-view service or panorama service through the multi-view content generation unit 21, the multi-view content through the interactive content authoring / editing unit 24 And arranging various media objects in space and time, editing property information and the like, and giving interactive functions. Through this, the user may not only receive the multi-view video service, but may also obtain additional content related to the multi-view video, and may also receive additional content separate from the multi-view content.

3 is a flowchart illustrating an embodiment of an interactive multi-view content authoring method according to the present invention.

First, various media objects to be edited / written including multi-view images and panoramic images are received.

Thereafter, the user is asked to select whether to generate multi-view content or to author general interactive content, and receive the result thereof to determine the result (301). In case of authoring general interactive content, the process proceeds directly to “306” process. In case of generating multi-view content, it is determined whether to generate multi-view content or panorama content and input the result. Received and judged (302). Thereafter, multi-view content or panorama content is generated according to the determination result of the user (303, 304). A method of generating the multi-view content or the panorama content will be described in detail later with reference to FIGS. 4 and 5.

Thereafter, the generated multi-view content (multi-view content, panorama content) is placed in a scene to be constructed (305). In operation 306, a user may select whether to add another media object such as an image, an audio, a video, etc. in addition to the multi-view content. In this case, the added media may be additional content related to the multi-view content or additional content to be additionally provided to the user regardless of the multi-view content.

As a result of the determination 306, when no other media object is added, the process proceeds directly to step 308, and when adding another media object, multi-view content and various media objects are placed in space and time and attribute information is added. After editing, the interactive function is provided as necessary (307).

Thereafter, after selecting and storing the authored / edited information, the result is determined and received (308). If not, the process proceeds directly to " 310 ". The stored authoring / editing information is generated in the form of a file (309). Thereafter, it is determined whether to continue or end the authoring, and receives the result of the determination (310). As a result of the determination 310, if it is to be terminated, the procedure is terminated immediately.

For example, when an interactive multi-view content is authored to provide a concert image of a specific singer through the interactive multi-view content authoring method illustrated in FIG. 3, the user combines a panoramic video service and a multi-view video service, The panoramic video can be used to look around the concert space, and the multi-view video can be used to observe the singer at the concert from various angles in 360 degrees. It can be viewed from various angles.

FIG. 4 is a detailed flowchart of a method of generating multi-viewpoint content capable of user manipulation illustrated in FIG. 3.

As illustrated in FIG. 4, when generating multiview content, first, n multiview images (n is a natural number) are received (41). Thereafter, if only the specific object is to be shown in the input image, the object extraction technique is applied to extract only the specific object and then the background is changed (42, 43). Proceed.

In addition, the upper, lower, left, and right spatial relationships between the multi-view images acquired at various viewpoints are defined (44). In this case, for example, the spatial relation definition may use a method of arranging a plurality of multi-view images and then connecting lines of multi-view images by lines using an input device such as a mouse.

After defining the spatial relationship, a control panel for adjusting the multi-view image transition is added (45) so that the object can be viewed at various points in time according to the defined spatial relationship (45). Here, examples of the control panel include play, stop, pause, forward, backward, zoom in / out, and the like. have.

Subsequently, an event between a control panel and a corresponding multi-view image is set for natural view switching, and related author / edit information is generated in the internal data structure (46). The generated interactive multi-view content is placed in a scene to be constructed (305).

FIG. 5 is a detailed flowchart illustrating an exemplary embodiment of a method for generating panorama content of FIG. 3.

As shown in FIG. 5, when a panorama content is to be generated, a panorama image for generating panorama content is first input (501), and then it is determined whether panorama stitching of the received image needs to be performed (502).

As a result of the determination (502), when panorama stitching is required, the stitching technique is applied to the corresponding panorama input image to generate one panorama image (503), and then proceeds to step “504”, or immediately proceeds to step “504”. .

Then, check whether the panorama image prepared for scene composition is composed of one still image / movie (504) or proceed directly to “508”, and if it is composed of one still image / movie, N x M It is determined whether or not to separate into patches of (N, M is a natural number) (505). In this case, since the amount of data in the panorama video is large, if the data is transmitted as it is, the data may not be properly transmitted. Therefore, if the panoramic image is spatially separated into a plurality of patches and transmitted, the content can be shown to the user based on the data successfully transmitted according to the transmission condition.

Therefore, it is determined whether the panorama image needs to be separated into patches (505). If the separation is not necessary, such as when the input image itself is divided into a patch, panorama content is entered, the process "509" is immediately performed. In step 510, when the separate transmission is performed, the number of N x M patches to be separated is input (506), and the panorama image is separated into patches as many as the number of received N x M patches (507).

Subsequently, the spatial relationship between the separated N × M patches is defined (508). In addition, texture mapping is performed to three-dimensionally display a panorama image divided into a plurality of patches or a panorama image composed of one file through a renderer, and a type to be mapped is determined at step 509. That is, the mapping type is determined to perform texture mapping for the three-dimensional representation of the panorama content. Here, as the mapping type, a cube, a cylinder, a sphere, or the like may be selected. The edited / created information is generated in an internal data structure, and the generated multi-view content is placed in a scene to be constructed (505).

6 is an exemplary structural diagram of a user interface of an interactive multi-view content authoring system for authoring interactive multi-view content.

As shown in FIG. 6, the user interface for authoring interactive multi-view content is configured by separating the main window 601 for interactive content authoring and the sub-window 609 for generating multi-view content. Sub-window 609 may be called through menu 608 of the window.

In this case, the sub-window 609 may designate the layout number (N, M) of the multi-view content to be input (611) and define the vertical, horizontal, left-right relationship between each multi-view image (612), and add a multi-view image Upon insertion, when a position to be inserted is previously selected in the layout 612 and a multiview image is inserted, the added images are sequentially inserted into the selected position (613). That is, when additionally inserting a multiview image, an additional input image is sequentially inserted into the selection area by preselecting an area to be inserted in the layout.

For example, in the horizontal direction at the same height as the object, five cameras are installed at 72 degree intervals in a circular shape with a radius of 2 m, and three cameras in a circular shape with a radius of 1 m around a height of 1 m from the object are 120 degrees. If the multi-view content is authored using the images acquired through the cameras after installing at intervals, the number of images acquired for each shooting height of a specific object will be different. In this case, in order to author content that can be transformed naturally using a multi-view image, the spatial relationship between each multi-view image should be defined.

In addition, the selected content in the sub-window 609 is linked to display on the canvas of the main window 601 (605, 610). In addition, the main window 601 provides a user interface for editing / creating various media objects in addition to the generated multi-view content (602, 603, 604) and giving an interactive function to each media object (607).

7 is a structural diagram of an embodiment of a user interface of an interactive multi-view content authoring system for authoring interactive panoramic content.

As shown in FIG. 7, the user interface for authoring interactive panoramic content is configured by separating the main window 701 for interactive content authoring and the sub-window 708 for generating panoramic content, and the menu of the main window. Subwindow 708 may be invoked via lights 707.

At this time, the sub-window 708 shows a plurality of input panorama images (710) and the result image of the stitching is performed (711). That is, in the sub-window 708, the stitching technique is applied to the panorama image which needs stitching. In addition, when the panorama image is divided into patches, the number of patches, the spatial relation definition between the patches, and the texture mapping type are set (operation 709).

In operation 705, the panorama content generated in the sub-window 708 is displayed on the canvas of the main window 701 in a 2D image form. In addition, the main window 701 provides an interface for editing / creating the generated panorama content and various media objects (702, 703, 704) and giving an interactive function to each media object (706).

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form. Since this process can be easily implemented by those skilled in the art will not be described in more detail.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the technical spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited by the drawings.

The present invention as described above, by providing the image of the various views through the multi-view image and the panoramic image to the user to increase the degree of freedom of the user's viewpoint and provide a wider range of views, rather than providing a conventional limited and narrow view Can be.

In addition, according to a user's request, the present invention may provide not only a multi-view image but also additional contents and independent media contents related thereto.

In addition, the present invention can satisfy the various needs of consumers that are increased day by day through the above functions, and can be used in various fields such as digital multimedia broadcasting (DMB) data service, digital broadcasting in the future.

Claims (17)

In an interactive multi-view content authoring system, Media input means for receiving various media objects to be edited / written including a multi-view image and a panoramic image from an external source; Interactive multi-view for editing space-time layout and attribute information and giving interactive functions to each object by using the multi-view image (multi-view image, panoramic image) and various media objects received through the media input means. Content authoring means; Media encoding / decoding means for performing encoding and decoding on the media object including the multi-view content used in the interactive multi-view content authoring means; And File generating means for generating edited / written information in a file form by the interactive multi-view content authoring means Interactive multi-view content authoring system comprising a. The method of claim 1, The interactive multi-view content authoring means, A multi-view content generating unit for generating a multi-view content capable of interactive operation (user operation) using the multi-view image (multi-view image, panorama image) input through the media input means; And Editing the space-time arrangement and attribute information between the multi-view content generated by the multi-view content generating unit and various media objects, granting an interactive function to each object constituting the scene, and then inserting the authored / edited information into the internal view. Interactive content authoring / editing unit for storing as data structures Interactive multi-view content authoring system comprising a. The method of claim 2, The multi-view content generation unit, A multi-view content generating unit for generating a multi-view content that can be manipulated by a user using a multi-view image received through the media input means; And Panorama content generation unit for generating a user-operated panorama content using the panorama image input through the media input means Interactive multi-view content authoring system comprising a. The method according to any one of claims 1 to 3, The file generating means, The information created / edited by the interactive multi-view content authoring means may be generated as a text file, or may be generated as a binary file including the author / edit information and a media object used to construct a scene. Interactive multi-view content authoring system. In the interactive multi-view content authoring device, Multi-view content generating means for generating multi-view content capable of interactive operation (user operation) using the multi-view image (multi-view image, panoramic image) input from an external device; And Editing the space-time arrangement and attribute information between the multi-view content generated by the multi-view content generating means and various media objects, granting an interactive function to each object constituting the scene, and then inserting the authored / edited information Interactive content authoring / editing means for storing as data structures Interactive multi-view content authoring apparatus comprising a. The method of claim 5, The multi-view content generating means, A multi-view content generation unit for generating a multi-view content capable of user manipulation using the multi-view image received from the external device; And Panorama content generation unit for generating a user-operated panorama content by using the panorama image input from the external device Interactive multi-view content authoring apparatus comprising a. In the interactive multi-view content authoring method, Receiving various media objects to be edited / manipulated, including a multi-view image (multi-view image and a panoramic image); A multi-view content generation step of generating a multi-view content capable of an interactive operation (user operation) using the input multi-view image; Arranging the generated multi-view content in a scene to be composed; Editing the spatio-temporal layout and attribute information between the generated multi-view content and various media objects, granting an interactive function to each object constituting the scene, and storing the authored / edited information as an internal data structure ; And Generating the stored edited / authored information in a file form Interactive multi-view content authoring method comprising a. The method of claim 7, wherein The multi-view content generation step, Determining generation of multi-view content; A decision step of determining whether to generate multi-view content or panorama content; A multi-view content generation step of generating a multi-view content according to the determination result of the determination step; And A panorama content generation step of generating panorama content according to the determination result of the determination step; Interactive multi-view content authoring method comprising a. The method of claim 8, The multi-view content generation step, receiving n multiview images (n is a natural number); Changing a background after extracting a desired specific object by applying an object extraction technique to the input multiview image; Setting up, down, left, and right spatial relationships between multi-view images; Adding a control panel to adjust the multiview image switching; And Generating an authoring / editing information by setting an event between the control panel and the corresponding multi-view image Interactive multi-view content authoring method comprising a. The method of claim 9, The interactive multi-view content authoring method, Separate main window for interactive content authoring and sub window for multi-view content creation. Specify the number of layouts (N, M) of the multi-view content to be input in the sub-window, and define the top, bottom, left and right relationships between each multi-view image, When additionally inserting a multiview image, the area to be inserted in the layout is selected in advance so that the additional input images are sequentially inserted into the selection area. The selected content of the sub window is linked to be displayed on the canvas of the main window, And a user interface for editing / creating various media objects in addition to the generated multi-view content and giving an interactive function to each media object. The method of claim 8, The panorama content generation step, Receiving a panorama image for generating panorama content; Generating a panorama image by applying a panorama stitching technique as panorama stitching is necessary for the received panorama image; A panorama image separation step of separating the panorama image into a plurality of patches as the separation of the panorama image is necessary for transmission; Establishing a spatial relationship between the separated plurality of patches; And Mapping type determination step to determine the mapping type for performing texture mapping Interactive multi-view content authoring method comprising a. The method of claim 11, The panoramic image separation step, Determining whether the panoramic image needs to be separated into patches; A step of determining the mapping type when the separation is not necessary because the panoramic image divided into the patch form is received as a result of the determination; And When the panorama image is to be transmitted separately, receiving the number of patches to be separated and separating the panorama image into as many patches as the number of patches. Interactive multi-view content authoring method comprising a. The method of claim 11, The interactive multi-view content authoring method, Separate main window for interactive content authoring and sub window for panorama content creation, The sub-window displays a plurality of input panorama images, and applies a stitching technique to the panorama images that require stitching, As you want to separate the panorama image into patches, define the number of patches, define the spatial relationship between patches, and set the texture mapping type. The panorama content generated in the sub window is linked to be displayed on the canvas of the main window, And the main window includes an interface for editing / creating the generated panorama content and various media objects and giving an interactive function to each media object. The method according to any one of claims 7 to 13, The media object, And additional content related to the multi-view content or additional content to be additionally provided to a user regardless of the multi-view content. In the multi-view content generation method, receiving n multiview images (n is a natural number); Changing a background after extracting a desired specific object by applying an object extraction technique to the input multiview image; Setting up, down, left, and right spatial relationships between multi-view images; Adding a control panel to adjust the multiview image switching; And Generating an authoring / editing information by setting an event between the control panel and the corresponding multi-view image Multi-view content generation method comprising a. In the panorama content generation method, Receiving a panorama image for generating panorama content; Generating a panorama image by applying a panorama stitching technique as panorama stitching is necessary for the received panorama image; A panorama image separation step of separating the panorama image into a plurality of patches as the separation of the panorama image is necessary for transmission; Establishing a spatial relationship between the separated plurality of patches; And Mapping type determination step to determine the mapping type for performing texture mapping Panorama content generation method comprising a. The method of claim 16, The panoramic image separation step, Determining whether the panoramic image needs to be separated into patches; A step of determining the mapping type when the separation is not necessary because the panoramic image divided into the patch form is received as a result of the determination; And When the panorama image is to be transmitted separately, receiving the number of patches to be separated and separating the panorama image into as many patches as the number of patches. Panorama content generation method comprising a.

Images