KR101868758B1 - Method for authoring 360°video-based virtual reality content and Terminal device for performing the method - Google Patents

Method for authoring 360°video-based virtual reality content and Terminal device for performing the method Download PDF

Info

Publication number
KR101868758B1
KR101868758B1 KR1020170181047A KR20170181047A KR101868758B1 KR 101868758 B1 KR101868758 B1 KR 101868758B1 KR 1020170181047 A KR1020170181047 A KR 1020170181047A KR 20170181047 A KR20170181047 A KR 20170181047A KR 101868758 B1 KR101868758 B1 KR 101868758B1
Authority
KR
South Korea
Prior art keywords
virtual reality
reality content
frame
transmission element
content
Prior art date
Application number
KR1020170181047A
Other languages
Korean (ko)
Inventor
이종원
Original Assignee
세종대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 세종대학교산학협력단 filed Critical 세종대학교산학협력단
Priority to KR1020170181047A priority Critical patent/KR101868758B1/en
Application granted granted Critical
Publication of KR101868758B1 publication Critical patent/KR101868758B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A method of authoring a 360 ° video-based virtual reality content and a terminal device for performing the method are disclosed. A method of authoring a 360 ° image-based virtual reality content includes: generating a first virtual reality content by tracking a first passing element in a section between a first key frame and a second key frame of an original virtual reality content ); (B) generating a second virtual reality content by tracking a second forwarding element in a section between the second key frame and the third key frame of the original virtual reality content; Calculating a distance between the first transmitting element and the second transmitting element in the second key frame and using the distance to calculate a position of the first transmitting element in the first virtual reality content and a position of the second virtual reality (C) adjusting the position of the second transmission element in the content, and creating a new virtual reality content by integrating the first virtual reality content and the second virtual reality content whose position is adjusted .

Description

TECHNICAL FIELD [0001] The present invention relates to a method for authoring a 360 ° video-based virtual reality content and a terminal device for performing the method.

Embodiments of the present invention relate to a method for authoring a 360 ° image-based virtual reality content capable of providing various experiences to a user and a terminal device for performing the method.

The size of the virtual reality content market is expected to continue to explode. Despite these predictions, the quantity and quality of virtual reality contents are not enough to become popular. At present, the development of a 360 ° video-based virtual reality content capable of freely changing a viewpoint and experiencing a virtual reality based on a realistic image of 360 ° is being actively developed.

FIG. 1 shows an example of the 360 ° image-based virtual reality content.

Referring to FIG. 1, the 360 ° image-based virtual reality content has an advantage of providing an enhanced immersion feeling to a user as compared with existing video content showing only a limited area. However, because the 360 ° image-based virtual reality contents represent all 360 ° viewpoints, the content creator has difficulty in conveying the intention to speak through the content. In other words, the existing video contents are transmitted to the user through the limitation of the area displayed to the user. However, since the 360 ° image-based virtual reality contents represent all the 360 ° viewpoints, the content creator can force the user to view the desired portion none.

In order to solve this problem, a method has been developed in which a user is guided to view a specific region of 360 ° image-based virtual reality contents. For example, in the prior art of FIG. 2, an arrow indicates the area that the user should watch. In another example, in the case of the prior art shown in Fig. 3, the user's point of view is automatically changed to guide the area that the user should watch.

However, there is still a lack of research on content guidance methods optimized for features of 360 ° video-based virtual reality contents and methods for generating various 360 ° content experiences from one 360 ° video-based virtual reality content.

In order to solve the problems of the related art as described above, the present invention proposes a method of authoring a 360 ° image-based virtual reality content that can provide various experiences to a user and a terminal device for performing the method.

Other objects of the invention will be apparent to those skilled in the art from the following examples.

According to another aspect of the present invention, there is provided a method of authoring a 360 ° image-based virtual reality content in an apparatus including a processor, (A) tracking a first forwarding element in an interval between two key frames to generate a first virtual reality content; (B) generating a second virtual reality content by tracking a second forwarding element in a section between the second key frame and the third key frame of the original virtual reality content; Calculating a distance between the first transmitting element and the second transmitting element in the second key frame and using the distance to calculate a position of the first transmitting element in the first virtual reality content and a position of the second virtual reality (C) adjusting the position of the second transmission element in the content, and combining the first virtual reality content and the second virtual reality content that are adjusted in position to generate a new virtual reality content Wherein the virtual reality content is a virtual reality content.

Wherein in the first virtual reality content, the second transfer element in the first transfer element and the second virtual reality content is displayed in a specific area set by the user, and step (c) Adjust the position of the first transmission element on the area of the first transmission element in a predetermined number of frames of the second key frame; The position of the transmitting element on the area can be adjusted.

Wherein the first transmission element of the first content before being merged and the second transmission element of the second content before being merged are located at a central portion of the region, and wherein the step (c) The first transmission element being located at a central portion of the region and gradually shifting the first transmission element away from the peripheral portion of the region, May be adjusted to be located at the periphery of the area, and then the second transmission element may be adjusted to position the second transmission element so as to gradually enter the center of the area. Wherein the virtual reality content includes a plurality of virtual reality contents.

The distance between the first transmission element and the second transmission element may be an Euclidean distance projected on the same plane or an angle difference on a spherical coordinate system.

According to another embodiment of the present invention, there is provided a method of authoring a 360 ° image-based virtual reality content to be performed in a device including a processor, the method comprising: generating a first frame in a first virtual reality content and a second frame in a second virtual reality content (A) calculating a distance between a center of the central region of the first frame and a center of the central region of the second frame when the two frames represent the same situation; (B) generating a new virtual reality content by integrating a first virtual reality content before the third frame and a second virtual reality content after the third frame using the distance, b) sets a central region of the third frame using the distance, and calculates a position of a center region of a predetermined number of the immediately preceding frames of the third frame in the first virtual reality content, And adjusting the position of a central region of a frame immediately after a specific number of the third frames in the second virtual reality content and generating the new virtual reality content using the adjusted immediately preceding frame and the immediately following frame, A method of authoring the real contents is provided.

According to another aspect of the present invention, there is provided a terminal device for authoring 360 ° image-based virtual reality contents, the terminal device comprising: a memory unit for storing a command readable by a computer; And a processor unit configured to execute the command, wherein the processor unit tracks the first forwarding element in a period between a first key frame and a second key frame of the original virtual reality content to generate a first content A second virtual reality content is generated by tracing a second transfer element in a section between the second key frame and the third key frame of the original virtual reality content to generate a second virtual reality content, Calculate the distance of the second transmission element, adjust the position of the first transmission element in the first content and the position of the second transmission element in the second virtual reality content using the distance, And a new virtual reality content is generated by integrating the first content and the second virtual reality content whose position is adjusted.

According to the present invention, it is possible to provide a variety of experiences to a user in a 360 ° image-based virtual reality content.

It should be understood that the effects of the present invention are not limited to the above effects and include all effects that can be deduced from the detailed description of the present invention or the configuration of the invention described in the claims.

FIG. 1 is a diagram illustrating an example of a conventional 360 ° image-based virtual reality content.
FIG. 2 and FIG. 3 are views showing an example of a method for guiding viewing a specific area of a conventional 360 ° image-based virtual reality content.
4 is a diagram showing a schematic configuration of a terminal device according to an embodiment of the present invention
FIG. 5 is a flowchart illustrating a method of authoring a 360 ° image-based virtual reality content according to the first embodiment of the present invention.
6 is a diagram for explaining the concept of the method of FIG.
FIG. 7 is a flowchart illustrating a method of authoring a 360 ° image-based virtual reality content according to a second embodiment of the present invention.
8 is a diagram for explaining the concept of the method of Fig.
FIGS. 9 and 10 are views showing another example of a method for guiding viewing a specific area of a conventional 360 ° image-based virtual reality content.

As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. In this specification, the terms "comprising ", or" comprising "and the like should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Various embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

4 is a diagram illustrating a schematic configuration of a terminal device according to an embodiment of the present invention.

4, a terminal 400 according to an exemplary embodiment of the present invention is an apparatus for generating or authoring a 360 ° image-based virtual reality content, and includes a memory unit 410, a processor unit 420, Lt; / RTI > Hereinafter, the function of each component will be described in detail.

The memory unit 410 may be configured to include both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data And stores instructions or data related to at least one other component of the terminal device 400. [ Particularly, the memory unit 112 may store a computer program or an application for authoring a 360 ° image-based virtual reality content, and for convenience of explanation, it is described that "a computer program or an application is stored in the memory unit 410" Respectively.

The processor portion 420 may include one or more of a central processing unit, an application processor, or a communications processor. For example, the processor unit 420 may perform operations and data processing related to control and / or communication of at least one other component of the terminal device 400. In particular, processor portion 420 may execute instructions related to the execution of a computer program or application.

The display unit 430 may include a liquid crystal display (LCD), a light emitting diode display (LED), an organic light emitting diode display (OLED), and the like. to be. At this time, the display unit 114 may include a head mount.

According to an embodiment of the present invention, when a user wearing a head mount views a 360 ° image-based virtual reality content (i.e., a 360 ° image-based original virtual reality content) A new 360 ° image-based virtual reality content that reflects the experience of the user can be generated.

At this time, for convenience of explanation, the "virtual reality content based on 360 degrees image" will be referred to as "virtual reality content ".

For example, when a user views a specific person, which is one of a plurality of forwarding elements included in the original virtual reality content, as a center, the terminal device 400 displays a new virtual reality And generates content. At this time, the movement of the head mount worn by the user is recorded during the viewing time, and new virtual reality contents can be generated based on the recorded motion information.

This "generation of a new virtual reality content according to the transfer element" may be performed by recording the movement of the head mount, but may also be performed by previously selecting the transfer element.

Also, it is possible to create a virtual reality content reflecting a new experience by creating and integrating different virtual reality contents centering on a plurality of transfer elements in one original virtual reality content.

Hereinafter, description will be made mainly on the contents of integrating different virtual reality contents, but the present invention is not necessarily limited thereto.

5 is a flowchart showing a method of authoring a virtual reality content which is an operation of the terminal device 400 according to the first embodiment of the present invention. At this time, as mentioned above, the virtual reality content is "360 degree image-based virtual reality content ". Hereinafter, a process performed in each step will be described.

First, in step 510, the processor unit 420 generates a first virtual reality content by tracking a first transfer element in a first interval between a first key frame and a second key frame of the original virtual reality contents . At this time, CAMShift, Kalman Filter, etc. can be used for tracking.

Here, the original virtual reality content can be stored in the memory unit 410 as a virtual reality content that can freely change a viewpoint based on a 360 ° image and experience a virtual reality, as described above. The original virtual reality content includes a plurality of delivery elements, and the delivery element means elements (i.e., singular or plural persons, animals, automobiles, etc.) that are subject to story transmission in the virtual reality contents. At this time, the forwarding element is set by the user's selection.

The key frame is a frame that distinguishes a frame or a section at a time when an important transformation occurs in the virtual reality contents. Therefore, there are a plurality of frames between two key frames.

That is, at step 510, the processor unit 420 sets a first one of the plurality of forwarding elements at the user's selection, and transmits the first forwarding element in the first section between the first and second key frames Element, thereby generating a first virtual reality content. At this time, one experience is generated through the first virtual reality contents.

Then, the first transmission element is displayed in a specific area within the first virtual reality content set by the user. In one example, the specific region may be a region located at the center of the first virtual reality content. 6 (a) shows an example of a first virtual reality content in which a first transmission element is displayed in a specific area.

Next, at step 520, the processor unit 420 tracks the second forwarding element in the second interval between the second key frame and the third key frame of the original virtual reality content to generate the second virtual reality content do.

That is, in step 520, the processor unit 420 sets a second transfer element of the plurality of transfer elements by the user's selection, and sets the second transfer element in the second section between the second key frame and the third key frame, Element, thereby generating a second virtual reality content. At this time, another experience is generated through the second virtual reality content. At this time, CAMShift, Kalman Filter, etc. can be used for tracking.

The second transmission element is also displayed in a specific area (for example, the center area) within the second virtual reality content set by the user. This is as shown in Fig. 6 (b). FIG. 6B shows an example of a second virtual reality content in which a second transmission element is displayed in a specific area.

Subsequently, in step 530, the processor unit 420 combines the first virtual reality content and the second virtual reality content to generate one new virtual reality content. At this time, the integration may be performed based on the distance between the first transmission element and the second transmission element on the original virtual reality content. In this case, the distance may be an Euclidean distance projected on the same plane or an angle difference on a spherical coordinate system.

More specifically, the processor unit 420 calculates the distance between the first transmitting element and the second transmitting element in the second key frame from the distance between the first transmitting element and the second transmitting element, To integrate the contents without adjusting or adjusting the location of the first delivery element in the first virtual reality content and the location of the second delivery element in the second virtual reality content.

According to an embodiment of the present invention, the processor unit 420 may simply integrate the first virtual reality content and the second virtual reality content when the distance is less than or equal to a preset threshold value. That is, when there is a short distance between the first transmission element and the second transmission element, there is no abrupt change between the first virtual reality content and the second virtual reality content, The first virtual reality content and the second virtual reality content can be simply connected to each other without adjusting the position of the first virtual reality content.

Further, according to another embodiment of the present invention, the processor unit 420 may use the distance to determine the position of the first transmitting element in the first virtual reality content and the position of the second transmitting element in the second virtual reality content, It is possible to adjust the position of the second transmission element in the virtual reality content, and to integrate the first virtual reality content and the second virtual reality content that are adjusted in position. That is, when the first transmitting element and the second transmitting element are far away, the abrupt change occurs between the first virtual reality content and the second virtual reality content, 1 transfer element and the second transfer element of the second virtual reality content, and then create a new virtual reality content by connecting the first virtual reality content and the second virtual reality content that are positionally adjusted.

At this time, as mentioned above, the first transferring element in the first virtual reality content and the second transferring element in the second virtual reality content are displayed in the specific area set by the user, and the processor unit 420 displays the first Adjusts the position on the area of the first forwarding element in the immediately preceding frame of a certain number of the second key frames in the virtual reality content and adjusts the position of the second forwarding element in the frame immediately after the specific number of second key frames in the second virtual reality content Can be adjusted. The specific number of immediately preceding and following frames before the second key frame are as shown in Fig. 6 (c).

As an example, the processor unit 420 may determine the position of the first transmitting element so that the first transmitting element located at the center of the specific region gradually deviates to the periphery of the specific region, in a certain number of immediately preceding frames in the first virtual reality content Can be adjusted. Then, in the frame immediately after the specific number of the second virtual reality contents, the processor unit 420 changes the second transfer element located at the center of the specific area to be located at the periphery of the specific area, The position of the second transmitting element can be adjusted so as to gradually enter the center of the specific region.

At this time, the adjustment position of the first transmission element of each of the immediately preceding frames can be determined based on the frame interval of each of the first key frame and the immediately preceding frame, and based on the frame interval of each of the third key frame and the immediately following frame, The adjustment position of the second transmission element of the second transmission element can be determined.

Meanwhile, the method according to the first embodiment of the present invention may combine three or more virtual reality contents to create a new virtual reality content, and the method described above may be used to integrate two virtual reality contents.

In short, the present invention is characterized in that, in the original virtual reality content, after the first virtual reality content, which is the primary transfer element, and the second virtual reality content, which is the main transfer element, are generated, It is possible to generate real contents. At this time, when the first transmitting element and the second transmitting element are far away, a predetermined number of previous frames and a frame immediately after the first virtual reality contents are centered around the second key frame, which is the last frame of the first virtual reality contents and the start frame of the second virtual reality contents, The position of the first transmission element and the second transmission element in the first transmission element can be adjusted to smoothly connect the contents without a large visual change.

FIG. 7 is a flowchart illustrating a method of authoring a virtual reality content, which is an operation of the terminal device 400 according to the second embodiment of the present invention. At this time, as mentioned above, the virtual reality content is "360 degree image-based virtual reality content ". Hereinafter, a process performed in each step will be described.

First, in step 710, the processor unit 420 determines whether there is a portion where the first virtual reality content overlaps with the second virtual reality content. That is, the processor unit 420 determines whether or not the first frame in the first virtual reality content and the second frame in the second virtual reality content are frames including the same situation or situation time, that is, a frame indicating the same situation do. Hereinafter, for convenience of explanation, the "frame indicating the same situation" will be referred to as a "third frame ".

At this time, the first virtual reality content may be an experience recording / storing the virtual reality content viewed by the first user, and the second virtual reality content may be recorded / stored in the virtual reality content viewed by the second user .

Next, at step 720, if there is an overlapped portion (i.e., the third frame is present), the processor unit 420 determines whether there is an overlap between the center portion of the central region of the first frame and the central portion of the central region of the second frame Is calculated. In this case, the distance may be an Euclidean distance projected on the same plane or an angle difference on a spherical coordinate system.

Subsequently, in step 730, the processor unit 420 integrates the first virtual reality content before the third frame and the second virtual reality content after the third frame using the distance to generate a new virtual reality content do.

In more detail, the processor unit 420 sets the central area of the third frame using the distance. This is as shown in FIG. Then, the processor unit 420 uses the central region of the third frame to determine the position of the central region of the predetermined number of the immediately preceding frames of the third frame in the first virtual reality content, and the specific number of the third frames in the second virtual reality content And a new virtual reality content can be generated using the adjusted immediately preceding frame and the immediately following frame.

According to an embodiment of the present invention, the processor 420 adjusts the position of a central region of a predetermined number of previous frames such that a central region of a predetermined number of immediately preceding frames gradually comes into a central region of a third frame, The position of the central region of the frame immediately after the specific number can be adjusted so that the central region of the frame immediately after the predetermined number of frames comes gradually into the central region of the third frame.

On the other hand, when the third frame does not exist, that is, when there is no overlapping portion between the first virtual reality content and the second virtual reality content, the processor unit 420 outputs the first virtual reality content and the second virtual reality content Or the first virtual reality content and the second virtual reality content may be included in a predetermined ratio to form an overlapping portion, and then may be integrated by the method described above.

The method according to the first embodiment of the present invention can be combined with the method according to the second embodiment of the present invention to generate new virtual reality contents. That is, a new experience can be generated by integrating the first virtual reality content based on the user experience record and the second virtual reality content based on the tracking of the specific delivery component.

An embodiment according to the methods of the present invention will be described based on 360 ° virtual reality contents including a male character and a female character.

In the case of the method according to the first embodiment of the present invention, the male protagonist can be selected as the first transmission element, and the male protagonist can be automatically tracked in successive moving images. Accordingly, the first virtual reality content, which is the resultant content, becomes a 360-degree virtual reality content that can be experienced mainly by the motion of the male protagonist. Then, if the female main character is selected as the second transmission element and tracked, the second virtual reality content based on the 360 ° based on the movement of the female main character is generated. Then, the first virtual reality content and the second virtual reality content can be integrated, and a new virtual reality content can be authored in which the male character is the forwarding element in the front part and the female element is the forwarding element in the rear part.

In the case of the method according to the second embodiment of the present invention, when the user follows the male protagonist and experiences the movement, the movement of the head mount used by the user is recorded, so that the same virtual reality contents can be experienced by the other user. A plurality of experience-based virtual reality contents can be integrated by the above-described method to author one virtual reality content.

Meanwhile, there is a need for a viewing apparatus for providing virtual reality contents to a user according to the above-described method. The viewing device should guide the user to experience a specific target area of the 360 ° area in order to provide a suitable experience for the user. In the conventional case, an arrow (see FIG. 2), a PIP (see FIG. 9), and an area highlight (see FIG. 10) are used for the latest target area (or direction) guidance. The present invention provides a user with one or more arrows or PIPs to select one of a plurality of virtual reality contents by utilizing an existing target area guide, and allows the user to select one target area while experiencing the virtual reality contents . The present invention provides a method of adjusting the transparency, the size, and the like of the guide display or the direct time in order to display the temporal distance between the current frame and the target area frame.

In addition, embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Examples of program instructions, such as magneto-optical and ROM, RAM, flash memory and the like, can be executed by a computer using an interpreter or the like, as well as machine code, Includes a high-level language code. The hardware devices described above may be configured to operate as one or more software modules to perform operations of one embodiment of the present invention, and vice versa.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and limited embodiments and drawings. However, it should be understood that the present invention is not limited to the above- Various modifications and variations may be made thereto by those skilled in the art to which the present invention pertains. Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

Claims (8)

A method for authoring a 360 ° image-based virtual reality content performed in a device including a processor,
(A) generating a first virtual reality content by tracking a first transmission element displayed in a specific area set by a user in a first section, which is a section between a first key frame and a second key frame of the original virtual reality contents );
A second transmission element displayed in the area is tracked in a second section that is a section between the second key frame and the third key frame of the original virtual reality content and is continuous with the first section, (B) generating content;
Based on a distance between the first transmission element and the second transmission element in the second key frame, a predetermined number of second key frames included in the first virtual reality content are displayed on the area in the immediately preceding frame Adjusting the position of the first transmitting element and adjusting the position of the second transmitting element displayed on the area in a frame immediately after a specific number of second key frames included in the second virtual reality content, (C) generating a new virtual reality content by linking the first virtual reality content including the immediately preceding frame and the second virtual reality content including the frame immediately after the position adjustment, A method of authoring a virtual reality content. delete The method according to claim 1,
Wherein the first transmission element of the first virtual reality content before being merged and the second transmission element of the second virtual reality content before being merged are located at a central portion of the region,
The step (c)
Adjusting the position of the first transmission element so that the first transmission element located at the center of the area in the specific number of previous frames gradually deviates to the periphery of the area,
The second transmission element being located at a central portion of the region in the frame immediately after the specific number to be located at a peripheral portion of the region, And adjusting the position of the virtual reality contents. The method according to claim 1,
Wherein the distance between the first transmitting element and the second transmitting element is an Euclidean distance projected on the same plane or an angle difference on a spherical coordinate system. A method for authoring a 360 ° image-based virtual reality content performed in a device including a processor,
When the first frame of the first virtual reality content stored by the first user and the second frame of the second virtual reality content stored by the second user are the third frame indicating the same situation, (A) calculating a distance between a center of the central region of the first frame and a center of the central region of the second frame; And
The central region of the third frame included in the first virtual reality content and the third region of the third virtual reality content included in the second virtual reality content, Adjusting a position of each of the central region of the immediately preceding frame and the central region of the immediately following frame such that each of the central regions of the frames immediately after the predetermined number of frames enters the central region of the third frame gradually, (B) generating a new virtual reality content by connecting a first virtual reality content before the third frame and a second virtual reality content after the third frame including the adjusted immediately subsequent frame A method of authoring a virtual reality content. delete A computer-readable recording medium storing a program for performing the method according to any one of claims 1 to 5. A terminal device for authoring a 360 ° video-based virtual reality content,
A memory unit for storing instructions readable by a computer; And
And a processor unit configured to execute the instruction,
The processor comprising:
Generating a first virtual reality content by tracking a first transfer element displayed in a specific area set by a user in a first section, which is a section between a first key frame and a second key frame of the original virtual reality contents,
A second transmission element displayed in the area is tracked in a second section that is a section between the second key frame and the third key frame of the original virtual reality content and is continuous with the first section, Create content,
Based on a distance between the first transmission element and the second transmission element in the second key frame, a predetermined number of second key frames included in the first virtual reality content are displayed on the area in the immediately preceding frame Adjusting the position of the first transmitting element and adjusting the position of the second transmitting element displayed on the area in a frame immediately after a specific number of second key frames included in the second virtual reality content, Wherein the second virtual reality content is generated by connecting the first virtual reality content including the immediately preceding frame and the second virtual reality content including the frame immediately after the position is adjusted.
KR1020170181047A 2017-12-27 2017-12-27 Method for authoring 360°video-based virtual reality content and Terminal device for performing the method KR101868758B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020170181047A KR101868758B1 (en) 2017-12-27 2017-12-27 Method for authoring 360°video-based virtual reality content and Terminal device for performing the method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020170181047A KR101868758B1 (en) 2017-12-27 2017-12-27 Method for authoring 360°video-based virtual reality content and Terminal device for performing the method

Publications (1)

Publication Number Publication Date
KR101868758B1 true KR101868758B1 (en) 2018-06-18

Family

ID=62765420

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170181047A KR101868758B1 (en) 2017-12-27 2017-12-27 Method for authoring 360°video-based virtual reality content and Terminal device for performing the method

Country Status (1)

Country Link
KR (1) KR101868758B1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008167092A (en) * 2006-12-28 2008-07-17 Casio Comput Co Ltd Image synthesizer, image synthesis program and image synthesizing method
JP2011108000A (en) * 2009-11-18 2011-06-02 Som Japan:Kk Highly accurate data classification apparatus based on tree diagram creation utilizing spherical self-organization map and program for creating the highly accurate data classification apparatus
JP5254505B1 (en) * 2012-07-20 2013-08-07 楽天株式会社 Movie processing apparatus, movie processing method, and information recording medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008167092A (en) * 2006-12-28 2008-07-17 Casio Comput Co Ltd Image synthesizer, image synthesis program and image synthesizing method
JP2011108000A (en) * 2009-11-18 2011-06-02 Som Japan:Kk Highly accurate data classification apparatus based on tree diagram creation utilizing spherical self-organization map and program for creating the highly accurate data classification apparatus
JP5254505B1 (en) * 2012-07-20 2013-08-07 楽天株式会社 Movie processing apparatus, movie processing method, and information recording medium

Similar Documents

Publication Publication Date Title
US10937391B2 (en) Systems, methods, and media for displaying interactive augmented reality presentations
US10020025B2 (en) Methods and systems for customizing immersive media content
US10629107B2 (en) Information processing apparatus and image generation method
TWI571130B (en) Volumetric video presentation
US9779538B2 (en) Real-time content immersion system
EP3291536B1 (en) Methods, devices and systems for automatic zoom when playing an augmented reality scene
JP2020123962A (en) Apparatus and method for gaze tracking
US20120200667A1 (en) Systems and methods to facilitate interactions with virtual content
US12022357B1 (en) Content presentation and layering across multiple devices
CN111684393A (en) Method and system for generating and displaying 3D video in virtual, augmented or mixed reality environment
US10770113B2 (en) Methods and system for customizing immersive media content
JP2018113616A (en) Information processing unit, information processing method, and program
US10139901B2 (en) Virtual reality distraction monitor
US10403048B2 (en) Storage medium, content providing apparatus, and control method for providing stereoscopic content based on viewing progression
JP7252236B2 (en) Automatic image production device, automatic image production method, and image recording medium used therefor
US20230260235A1 (en) Information processing apparatus, information processing method, and information processing system
KR101868758B1 (en) Method for authoring 360°video-based virtual reality content and Terminal device for performing the method
KR102440089B1 (en) Method and device for presenting synthetic reality companion content
CN115150555B (en) Video recording method, device, equipment and medium
US11710284B2 (en) Augmented reality collaboration system
US10692286B2 (en) Device and method of creating an augmented interactive virtual reality system
CN115623149A (en) Video recording and playback system and method
KR20180042094A (en) Method and apparatus for displaying caption based on location of speaker and apparatus for performing the same
US20230396874A1 (en) Virtual indicator for capturing a sequence of images
KR102372323B1 (en) Electronic device, method, computer program for processing image

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant