KR101952131B1 - Method and program for producing a virtual reality content - Google Patents

Abstract

The present invention relates to a method and a program for producing virtual reality content. According to an embodiment of the present invention, the method for producing virtual reality content comprises the steps of: determining a space arrangement and arranging 360-degree image data on the space arrangement; generating a moving tag representing a connection relation among the 360-degree image data arranged on the space arrangement; generating an information tag including additional information of a 360-degree image; and generating virtual reality content including the moving tag and the information tag.

Description

METHOD AND PROGRAM FOR PRODUCING A VIRTUAL REALITY CONTENT BACKGROUND OF THE INVENTION [0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and a program for creating a virtual reality content, and more particularly, to a method and a program for creating a virtual reality content that is convenient and intuitive for a user utilizing a mobile tag.

With the development of computer technology, virtual reality (VR) technology has also been developed dramatically and is being applied to various fields. In recent years, devices for shooting 360-degree images for generating virtual reality contents have increased in popularity, and the generated virtual reality contents have widened their application areas such as education and shopping over game areas and entertainment areas It is going. Therefore, there is a growing demand for virtual reality contents.

On the other hand, in order to generate and control the contents of such a complex virtual world, a considerable degree of skill is required for the virtual reality production tool. However, in the conventional virtual reality content production tool, the user interface is not intuitive and it is very difficult to produce the content until the user is skilled in the production tool. Also, because of its limited range of use, it was very difficult to produce high-level professional virtual reality contents.

The present invention provides a method for easily creating a virtual reality content for a 360-degree image or a newly-captured 360-degree image according to an embodiment of the present invention.

Particularly, in the mobile environment, it is desired to shorten the time for producing various virtual reality contents and to provide a method for a plurality of users to jointly produce virtual reality contents.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a method of generating virtual reality contents, the method comprising: determining a spatial layout diagram and arranging the 360-degree image data on the spatial layout diagram; Generating a movement tag indicating a connection relationship between the 360-degree image data arranged on the spatial arrangement diagram; Generating an information tag including additional information of the 360-degree image; And generating virtual reality contents including the mobile tag and the information tag.

The step of generating the movement tag according to an exemplary embodiment includes the steps of: determining a reference 360-degree image on a screen and arranging a plurality of 360-degree images based on the degree of proximity to the reference 360-degree image; And receiving a selection of an image corresponding to the movement tag point from among the listed 360 degrees images.

The mobile tag according to an exemplary embodiment may include a step of automatically generating based on the arrangement of predetermined 360 degree images.

An information tag according to an embodiment may include at least one of text, pictures, moving pictures, and links.

The method for generating a virtual reality content according to an exemplary embodiment may include a step of automatically reproducing the generated virtual reality content based on a movement tag position.

The method may further include separating and storing the virtual reality content including only the mobile tag and the virtual reality content including both the mobile tag and the information tag.

The generating of the virtual reality contents according to an exemplary embodiment may include adjusting a size of the information tag and the movement tag by reflecting a perspective based on a user's viewpoint.

The method for generating a virtual reality content according to an exemplary embodiment may include generating a spatial change tag for moving an image to a virtual reality content based on the spatial layout and the spatial layout.

According to an embodiment of the present invention, there is provided a method for creating virtual reality contents, comprising: sharing production information about a point and a time point at which a first user is producing the virtual reality contents; And providing an environment in which the second user can perform the creation of the virtual reality contents in the same state as that shared by the first user based on the production information.

According to the present invention as described above, the following various effects are obtained.

First, users can easily create interactive virtual reality contents by selecting buttons and dragging them.

Secondly, users can create various virtual reality contents based on mobile tags and information tags in a mobile environment, and can produce virtual reality contents for a short time or can create virtual reality contents jointly by several users.

1 is a conceptual diagram for explaining an embodiment of the present invention.
2 is a flowchart illustrating a method of producing a virtual reality content according to an exemplary embodiment.
FIG. 3 illustrates an example of inserting a 360 degree image according to one embodiment.
FIG. 4 illustrates an example of arranging a 360-degree image on a spatial arrangement according to an embodiment.
FIG. 5 shows an example of generating a movement tag in a 360-degree image.
FIG. 6 is a diagram illustrating an algorithm in which a neighboring place is listed at a top according to an embodiment.
7 is a diagram for explaining an example of manufacturing an information tag according to an embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element.

1 is a conceptual diagram for explaining an embodiment of the present invention.

Referring to FIG. 1, a virtual reality contents production apparatus 100 according to an exemplary embodiment may provide a user interface 105 capable of arranging a 360-degree image 102 on a spatial layout 101. Here, the 360-degree image 102 may be a still image or 360-degree moving image data, and the 360-degree image 102 located on the spatial arrangement 101 may be input by user selection or by program selection.

1 shows the structure of the house, the space layout 101 is not limited to this structure and can be applied to various contents such as a sightseeing, a shopping, an entertainment and a sports based on a space.

The content production apparatus 100 receives the user input 103 and can arrange the 360 degree image 102 at a specific point. (A spot image 104) when a 360-degree image 102 is dragged on the spatial arrangement 101. [ On the other hand, the 360-degree image added through the user's input can receive the candidate group of the 360-degree image to form the connection relationship in the next step, and determine the order of listing the plurality of 360-degree images based on the degree of proximity between the points . This connection relationship can be stored through the mobile tag. That is, after the virtual reality contents are generated, the mobile tag can perform a role of switching an image to a 360-degree image connected to the corresponding mobile tag when selected by a content user. Accordingly, the mobile tag can be positioned in the form of a spot image on the spatial arrangement diagram, and can exist in a predetermined form in the virtual reality contents.

On the other hand, the virtual reality contents production apparatus 100 can determine a reference 360 degree image on the spatial arrangement diagram and arrange a plurality of 360 degree images based on the degree of proximity to the reference 360 degree image.

Next, the virtual reality contents providing apparatus 100 may generate a movement tag corresponding to one of the plurality of spot images 104 arranged on the spatial arrangement diagram 101, after reproducing the reference 360-degree image. At this time, the spot images 104 adjacent to the reference 360-degree image are provided on the screen, and a mobile tag is generated by receiving a signal from the user to select a spot image corresponding to the movement tag point. After generating one or more movement tags within the reference 360-degree image, the process of moving to another image through the movement tag and adding the movement tag may be repeated.

On the other hand, the movement tags may be automatically arranged and generated based on the placement relationship inputted as the spot images on the spatial arrangement diagram (101).

Accordingly, the apparatus for generating virtual reality contents 100 according to an exemplary embodiment can generate virtual reality contents supporting movement between spaces by completing generation and input of movement tags for each 360 degree image.

Meanwhile, the 360 degree image 102 constituting the above-described virtual reality contents has been described as a method of inputting all of the 360 degree images 102 on the spatial map at one time after being photographed. However, the spatial map 101 is firstly selected, After the selection, a 360 degree image 102 may be photographed for each spot and added.

Also, an information tag can be added to a desired point in each 360 degree image. Here, the information tag may include at least one of a text, a photograph, a moving image, and a link.

In the embodiment shown in FIG. 1, the content production apparatus 100 according to one embodiment is shown as a mobile terminal, but this is for convenience of description and is not necessarily limited to such a configuration.

Hereinafter, a method for producing virtual reality contents according to an embodiment will be described with reference to FIG. 2 to FIG.

2 is a flowchart illustrating a method of producing a virtual reality content according to an exemplary embodiment.

Referring to FIG. 2, in step S200, the apparatus for generating virtual reality contents 100 according to an exemplary embodiment acquires 360-degree image data. Here, the 360-degree image data may be a still image or a moving image.

In step S210, the virtual reality contents production apparatus 100 according to the embodiment determines the spatial arrangement diagram and arranges the 360-degree image data on the spatial arrangement diagram.

In step S220, the virtual reality contents production apparatus 100 according to an exemplary embodiment generates a movement tag indicating a connection relationship between 360 degree image data arranged on the spatial arrangement diagram.

For example, a reference 360 degree image is determined on a spatial map and a plurality of 360 degree images are listed based on the degree of proximity to the reference 360 degree image. Then, the user can receive a selection of an image corresponding to the movement tag point from among the listed 360 degrees images from the user. In addition, the movement tag can be automatically generated based on the arrangement of the predetermined 360 degree image.

In step S230, the apparatus for generating virtual reality contents 100 according to an exemplary embodiment generates an information tag including additional information of a 360-degree image.

Herein, the information tag may include at least one of text, a photograph, a moving image, and a link, and may be superimposed on a 360-degree image. For example, the TV commercial image may be input to an information tag disposed on a television of a house.

Specifically, in the method for producing a virtual reality content, a new information tag is arranged at a desired point in a 360-degree image, and the title, content (photograph or video), content (text) And can be selectively input.

Furthermore, the reproduction scheme of the information tag can be separately set. If the 360-degree video is a moving picture and the information tag is a caption, the playback section in which the information tag is exposed may be set so that the caption text is exposed to a desired position at a specific position (for example, a position where the speaking partner is located) .

In step S240, the apparatus for generating virtual reality contents 100 according to an embodiment generates virtual reality contents including a mobile tag and an information tag. At this time, the size of the movement tag and the information tag can be adjusted to reflect the perspective. For example, the center of the viewing direction of the user may be determined as the farthest point, and the size of the tag display image may be reduced as approaching the center.

The apparatus for generating virtual reality contents 100 according to an embodiment can automatically reproduce based on the movement tag position. For example, a 360-degree image selected from a start bottom point by a user can be sequentially reproduced in the order of adjacent movement tags. Also, since the 360-degree image is 2D, the 360-degree image can be sequentially reproduced according to the adjacent order of the matching spot images.

As another example, a 360 degree image that is started for one content may be set differently. For example, when there are a plurality of products in one virtual reality content, the automatic tour start point and the playback order of the virtual reality content may be changed according to the type of the goods that the seller intends to promote using the virtual reality content.

According to another embodiment, the virtual reality contents production apparatus 100 may separately store the virtual reality contents including only the mobile tags, and the virtual reality contents including both the mobile tags and the information tags. For example, the content including the 360-degree image and the moving tag may be regarded as original contents, and the information tag may correspond to the combined data. Multiple users can load one original content, but each information tag can be generated individually. The data on the order of the automatic reproduction may also be combined data. Also, in order to solve the problem that an information tag inputted in a specific 360 degree image is not displayed in another 360 degree image, only an information tag can be copied and pasted to another 360 degree image. In addition, when the first user creates the original content and sells the original content in the platform, the second user purchasing the original content can add the combined data to the original content to generate and sell the final virtual reality content.

According to another embodiment, the virtual reality contents production apparatus 100 may generate a space change tag that allows moving images in the virtual reality contents generated by the virtual reality contents based on the space layout diagram and the other space layout diagram . For example, a space change tag can be attached to the same position as a doorway, and the same effect as moving the door to another space after leaving the door can be realized.

According to still another embodiment, the step of generating virtual reality contents includes the steps of: sharing production information about a point and a time point at which a first user is producing the virtual reality contents; and, And providing an environment capable of performing virtual reality content creation in the same state as a state shared by a user. In addition, when the second user requests the sharing of the original content generated by the first user, the second user shares data about the point and the viewing angle of the sharing request to the second user, May experience the virtual reality contents in the same state as the shared state.

Hereinafter, with reference to FIG. 3 to FIG. 7, an example of a method for producing a virtual reality content according to an embodiment will be described in detail.

FIG. 3 illustrates an example of inserting a 360 degree image according to one embodiment.

Referring to FIG. 3, the 360-degree image inserted into the virtual reality content may be a still image (for example, JPEG) and a moving image (for example, MPEG-4, MKV, etc.) in the existing format. For user convenience, content authoring can be supported by simply importing a 360 degree video link uploaded to an Internet server.

Meanwhile, when the virtual reality image production method according to one embodiment is applied to mobile, it can be called up and edited immediately after image capturing by interlocking with an API of a separate virtual reality image camera (360 degree image taking camera) application.

FIG. 4 illustrates an example of arranging a 360-degree image on a spatial arrangement according to an embodiment.

Referring to FIG. 4, in a method of producing a virtual reality contents according to an embodiment, a moving tag 401 of a 360-degree image can be arranged at a specific point on the spatial arrangement diagram 400 through dragging according to a scenario desired by an author. In particular, when a circular movement tag 402 arranged in a space layout is selected, a teleport function in which the virtual reality contents image is reproduced is driven . On the other hand, the 360-degree image added through the user's input can receive the candidate group of the 360-degree image to form the connection relationship in the next step, and determine the order of listing the plurality of 360-degree images based on the degree of proximity between the points . This connection relationship can be displayed through a plurality of mobile tags (a plurality of circular thumbnail images displayed in the spatial arrangement). That is, after the virtual reality contents are generated, the mobile tag can perform a role of switching an image to a 360-degree image connected to the corresponding mobile tag when selected by a content user.

On the other hand, the virtual reality contents production apparatus 100 may determine a reference 360-degree image on the spatial arrangement diagram 400 and list a plurality of 360-degree images based on the degree of proximity to the reference 360-degree image. For example, when viewing the virtual reality contents at the A point (center), the basic direction indication (← ↑ →) is displayed in the virtual space near the B (living room window), C (home), D (kitchen) ) Is designated and the arrangement of the mobile tags for the teleport function can be automatically implemented.

FIG. 5 shows an example of generating a movement tag in a 360-degree image.

FIG. 4 shows an example of displaying the moving tag 402 on the spatial arrangement 400. FIG. 5 shows an example in which a plurality of moving tags 501 are displayed in the 360-degree image 500. FIG. Even if the mobile tag 501 is not displayed in the 360-degree image, it can be moved to another place through the basic direction display 502. [ In addition, the mobile tag 501 can be automatically placed through an algorithm for identifying adjacent images, and the user can then modify the placement of the mobile tag 502 through dragging for more accurate placement.

That is, as described above, the mobile tag can be located on the space layout diagram, and can also exist in the virtual reality contents.

FIG. 6 is a diagram illustrating an algorithm in which neighboring places are listed at a higher level according to an embodiment.

Referring to FIG. 6, when a mobile tag is placed in a predetermined 360-degree image and then the mobile tag is placed in the next 360-degree image, the neighboring location may be listed.

For example, if the current position is the living room window, the living room, the kitchen, the dining room, the couple bedroom, and the like may be listed in order in the order of proximity.

7 is a diagram for explaining an example of manufacturing an information tag according to an embodiment.

Referring to FIG. 7, additional information such as a text, a photograph, and a moving picture link, which the creator wants to express in the virtual space, can be arranged in the virtual space in the form of an information tag 700. The information tag 700 of FIG. 7 is displayed in a pop-up form superimposed on a 360-degree image, but is not limited to this configuration. For example, the TV commercial image may be input to an information tag disposed on a television of a house.

When the mobile tag and the information tag are completed as described above with reference to FIGS. 3 to 7, the virtual reality contents production apparatus can generate the final virtual reality contents. The generated virtual reality contents can be distributed as cross platform such as PC software, web VR viewer, mobile app VR viewer, card board viewer, Gear VR viewer, and no separate building process is required. Therefore, even though only one character is modified by most virtual reality contents production tools, a long build process is required. In contrast, the virtual reality contents production method according to the present embodiment separately creates and combines mobile tags and information tags, There is a merit that can be reflected.

As described above, the method for generating virtual reality contents according to an embodiment of the present invention may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium.

The above-described program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, or the like that can be read by the processor (CPU) of the computer through the device interface of the computer, And may include a code encoded in a computer language of the computer. Such code may include a functional code related to a function or the like that defines necessary functions for executing the above methods, and includes a control code related to an execution procedure necessary for the processor of the computer to execute the functions in a predetermined procedure can do. Further, such code may further include memory reference related code as to whether the additional information or media needed to cause the processor of the computer to execute the functions should be referred to at any location (address) of the internal or external memory of the computer have. Also, when the processor of the computer needs to communicate with any other computer or server that is remote to execute the functions, the code may be communicated to any other computer or server remotely using the communication module of the computer A communication-related code for determining whether to communicate, what information or media should be transmitted or received during communication, and the like.

The medium to be stored is not a medium for storing data for a short time such as a register, a cache, a memory, etc., but means a medium that semi-permanently stores data and is capable of being read by a device. Specifically, examples of the medium to be stored include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, but are not limited thereto. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. In addition, the medium may be distributed to a network-connected computer system so that computer-readable codes may be stored in a distributed manner.

According to the present invention as described above, the following various effects are obtained.

First, users can easily create interactive virtual reality contents by selecting buttons and dragging them.

Second, users can create virtual reality contents in various fields based on mobile tags and information tags in a mobile environment, and can produce virtual reality contents for a short time or can create virtual reality contents jointly by several users. For example, virtual reality contents to be utilized in real estate / interior, shopping center, shopping center, travel / sightseeing, live performance relay, drones, entertainment, sports, etc. can be produced intuitively and easily using a virtual reality production method and program according to an embodiment have.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims (10)

A method for allowing a plurality of users to jointly produce virtual reality contents, which is performed by a virtual reality content production apparatus,
Obtaining 360-degree image data;
Arranging the 360-degree image data at a specific point in the space map, and setting a thumbnail image of the 360-degree image at a point where the 360-degree image data is arranged in the space map;
Generating a movement tag indicating a connection relationship between the 360-degree image data arranged on the spatial arrangement diagram;
Generating an information tag including additional information of the 360-degree image;
Generating virtual reality contents including the mobile tag and the information tag;
Wherein the virtual reality contents production device shares production information about a point and a time point at which a first user is producing the virtual reality contents; And
Providing the virtual reality content production apparatus with an environment in which the second user can perform the production of the virtual reality content in the same state as that shared by the first user based on the production information, How to make realistic contents. The method of claim 1, wherein generating the movement tag comprises:
Determining a reference 360 degree image on the spatial map and listing a plurality of 360 degree images based on the degree of proximity to the reference 360 degree image; And
And receiving a selection for an image corresponding to a mobile tag point from among the listed 360 degrees images. 3. The method of claim 2, wherein the movement tag is automatically generated based on a placement of a predetermined 360 degree image. The method of claim 1, wherein the information tag comprises at least one of text, pictures, moving pictures, and links. 2. The method according to claim 1,
And automatically reproducing the generated virtual reality contents based on the movement tag position. 2. The method according to claim 1,
Further comprising separately storing virtual reality content including only the mobile tag and virtual reality content including both the mobile tag and the information tag. The method of claim 1, wherein the generating of the virtual reality content comprises:
And adjusting the size of the information tag and the moving tag by reflecting a perspective based on a user's viewpoint. 2. The method according to claim 1,
Generating a space change tag for moving an image to virtual reality content based on the space layout and the other space layout diagram. delete 8. A virtual reality content creation program stored in a medium for executing the method of any one of claims 1 to 8 in combination with a computer which is hardware.

Images