KR20220063419A - METHOD, APPARATUS AND COMPUTER-READABLE MEDIUM OF Applying an object to VR content - Google Patents

Abstract

The present invention relates to a method and apparatus for applying objects to virtual reality (VR) content, and a computer-readable recording medium to provide convenience when images for VR content are generated. According to one embodiment of the present invention, the method for applying objects to VR content is implemented by a computing device including one or more processors and one or more memories storing commands executable by the processors. The method comprises: a first content generation step of converting acquired plurality of images into one VR content image to generate first content when the plurality of images are acquired through at least one camera module; an image input step of determining a call of an object image and a size and insertion area of the object image according to a first user input and second user input when receiving the first user input for adding the object image to the first content and the second user input for the size and insertion area of the object image after the first content is generated; a second content conversion step of converting, upon completion of the image input step, the object image whose size and insertion area are determined into second content, wherein the object image is converted into second content by reflecting the curved shape of the first content, which is VR content; and a third content generation step of displaying the second content on the first content to generate third content. In addition to this, various embodiments understood through this document are possible.

Description

Object application method, device and computer-readable recording medium of VR content

The present invention relates to a method of applying an object of VR content, and specifically, it is possible to automatically reflect the curved shape of 360VR content being displayed on a separate object, and automatically insert or synthesize the 360VR content as an image for VR content. Accordingly, it is possible to prevent bending of the object, and thus it is possible to obtain 360VR content with a high degree of completion. In addition, by automatically generating 360VR content, it can have the effect of supporting various and unique production ideas of 360VR content not only for experts but also for the general public, and improving the spread of related content.

VR (virtual reality), that is, virtual reality refers to the reality experienced in cyberspace. In this case, cyberspace is a virtual space created through an electronic device, a space that provides reality through three-dimensional visual effects. say In order to provide a realistic and immersive feeling to the user, VR technology may not only simulate an existing object, but may also allow the user to experience an object or situation that does not actually exist. In particular, in recent years, as single-person content has emerged, VR content using VR technology is actively increasing. As an example, Korean Patent Laid-Open Publication No. 10-2020-0101583 (VR video content production method, apparatus, and program) includes the steps of: acquiring one or more 360-degree images and setting a playback order among the 360-degree images; selecting a specific point or object in the 360-degree image as an object, and setting an information tag on the selected object; and setting the playback order of the selected two or more objects, wherein the information tag includes additional information about the corresponding object, and is displayed at a specific location in the VR image when each object is played back, A technique for sequentially reproducing the 360-degree image according to the set object reproduction order of the produced VR image content is disclosed.

However, in the prior art described above, although a technology for producing VR content is disclosed, a technology for preventing bending or separation of an object synthesized in a 360 curved VR content is not disclosed. In the case where the general public who is not adept at creating VR contents through the prior art, there is a problem in that VR contents that are not of high degree of completion are produced.

Accordingly, in the present invention, in the object application method of VR content, specifically, by automatically synthesizing a separate object that reflects the unique attribute value of the 360VR providing device to the 360VR content, various and individual 360VR content can be applied not only to experts but also to the general public. It aims to support production ideas that exist and to provide technology to spread related contents.

In order to achieve the above object, according to an embodiment of the present invention there is provided a method for applying an object of VR content implemented in a computing device including one or more processors and one or more memories for storing instructions executable by the processor, at least one a first content creation step of generating a first content by converting the plurality of acquired images into one VR content image when acquiring a plurality of images through the camera module of the ; When receiving a first user input for adding an object image to the first content and a second user input for a size and insertion area of the object image in a state in which the first content is generated, the received first content an image input step of calling the object image and determining a size and an insertion area of the object image according to a user input and the second user input; Upon completion of the image input step, a second content conversion step of converting the object image having the size and the insertion area determined into second content, and converting it into second content by reflecting the curved shape of the first content, which is VR content ; and a third content generation step of generating the third content by displaying the second content on the first content.

The user editing step may include editing the object image based on the second user input so as to automatically synthesize and display the second content in a preset area of the first content.

The preset area may include a background area of the first content. In the second content conversion step, it is possible to convert the object image having the size and the insertion area determined into the second content based on preset attribute information.

The preset attribute information may be determined based on a curvature, an F value, and an angle of view of the first content.

In the first content creation step, it is preferable to connect the plurality of images obtained through a stitching technique to generate the single image for VR content.

The object image may include at least one of a 3D image, a 2D image, and text.

The third content may be transmitted to another electronic device through a communication module.

According to an embodiment of the present invention, a method for applying an object of VR content implemented in a computing device including one or more processors and one or more memories for storing instructions executable by the processor includes adding a curved shape of a first content to an object image. Since the third content is automatically generated by reflecting the conversion into the second content and inserting or synthesizing the second content on the first content, it is possible to provide convenience when producing an image for VR content.

In addition, according to an embodiment of the present invention, in order to automatically synthesize and display the second content in a preset area of the first content, an object image can be edited based on a second user input, so that various types of It has the effect of creating an image for VR content.

In addition, according to an embodiment of the present invention, it is possible to convert an object image whose size and insertion area are determined based on preset attribute information into the second content, so that bending of the components included in the third content can be prevented. This has the effect of creating an image for VR content with a high degree of completion.

In addition, according to an embodiment of the present invention, a plurality of images acquired through a stitching technique can be stitched together to generate the single VR content image, so that even in an electronic device having a limited number of cameras It has the effect of creating an image for VR content.

In addition, according to an embodiment of the present invention, the third content can be transmitted to another electronic device through a communication module, thereby improving the content diffusion speed.

1 is a flowchart illustrating a method of applying an object of VR content implemented according to an embodiment of the present invention.
2 is a block diagram of an apparatus for applying an object of VR content implemented according to an embodiment of the present invention.
3 is a diagram for explaining an example of erroneous VR content according to an embodiment of the present invention.
4 is a view for explaining third content generated through the object application method of VR content according to an embodiment of the present invention.
5 is another diagram for explaining third content generated through the object application method of VR content according to an embodiment of the present invention.
6 is a diagram for explaining a method of sharing a third content generated through an object application method of VR content implemented according to an embodiment of the present invention with another electronic device.
7 is a diagram for explaining a method of connecting to a link linked to a third content based on a user's field of view according to an embodiment of the present invention.
8 is a diagram for explaining an example of an internal configuration of a computing device according to an embodiment of the present invention.

Hereinafter, various embodiments and/or aspects are disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be recognized by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of various methods may be employed in the principles of the various aspects, and the descriptions set forth are intended to include all such aspects and their equivalents.

As used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. may not be construed as an advantage or advantage in any aspect or design described above over other aspects or designs. .

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. should be understood as not

Also, terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are those commonly understood by those of ordinary skill in the art to which the present invention belongs. have the same meaning. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in an embodiment of the present invention, an ideal or excessively formal meaning is not interpreted as

1 is a flowchart illustrating a method for applying an object of VR content implemented according to an embodiment of the present invention.

Referring to FIG. 1 , in the method for applying an object of VR content implemented with a computing device including one or more processors and one or more memories for storing instructions executable by the processor, step S101 (first content creation step) is performed. can The computing device may include a smartphone, a desktop, a tablet, and the like, and is not limited thereto as long as it is a device capable of automatically applying an object to VR content.

In step S101, the one or more processors (hereinafter referred to as a processor) may acquire a plurality of images through at least one camera module (hereinafter referred to as a camera module). When acquiring a plurality of images through the camera module, the processor may convert the plurality of acquired images to generate a first content image for one VR content.

According to an embodiment, the image for VR content may be a three-dimensional image supporting a 360-degree omnidirectional angle generated through a stitching technique that overlaps or connects the plurality of acquired images. In addition, the plurality of images may include an image, a photo, and a moving picture, and is not limited thereto as long as it is a source file capable of generating the first content.

According to an embodiment, the first content, which is an image for the VR content, may be generated based on a plurality of images pre-stored in the memory as well as an image acquired through the camera. For example, the processor may generate the first content, which is an image for VR content, by attaching the first image and the second image acquired through the camera module. As another example, the processor may generate the first content by connecting the third image and the fourth image previously stored in the memory through a stitching technique.

When the generation of the first content is completed, the processor may perform step S103 (an image input step).

In step S103, the processor may receive a first user input for displaying an object image on the first content while the first content is generated. When receiving the first user input, the processor may call the object image, and receive the second user input in a state where the call of the object image is completed. When receiving the second user input, the processor may determine the size and insertion area of the called object image based on the second user input.

According to an embodiment, the processor may receive the first user input through a display or a touch screen included in the computing device, and may receive the first user input from a separate device connected to the computing device. there is. The first user input may be an input for calling an object image pre-stored in the memory or an object image stored in another electronic device connected to the computing device through a wired network and/or wireless network. The object image may be at least one of a 2D image and a 3D image before being converted into the image for VR content in order to display the image for VR content on the first content.

According to another embodiment, the object image may include text input based on a text input instead of a second user input. According to another embodiment, the processor may display text on the first content based on the text input. That is, the processor may distinguish the first user input from the text input, and may recognize the text input based on the received text input as an object image for converting into an image for VR content.

According to an embodiment, when the object image is called through the first user input, the processor may display the called object image on the first content being displayed through the display or the touch screen. The processor may receive a second user input for determining at least one of a size and an insertion area of the object image while the object image is being displayed on the first content. For example, when receiving the second user input, the processor may change the size of the object image displayed on the first content to a minimum size based on the second user input. As another example, when receiving the second user input, the processor may determine to insert the object image into a left region of the first content.

According to another embodiment, when receiving the second user input while text is being displayed on the first content, the processor determines the size and insertion area of the text based on the received second user input. can decide As described above, according to the present invention, various effects can be applied to an object image through a separate user input (eg, a second user input), thereby providing VR contents to which various effects are applied.

When the processor determines at least one of the size of the object image being displayed on the first content and the insertion area, the processor may perform step S105 (a second content conversion step).

In step S105 , when the image input step is completed, the processor may convert the object image into second content by reflecting the curved shape of the first content, which is a VR content image.

According to an embodiment, when the size and insertion area of the object image being displayed on the first content are determined, the processor may automatically convert the object image into the second content. The processor may reflect the curved shape of the first content to the object image in order to synthesize the object image with the curved first content without bending. The object image to which the curved shape of the first content is reflected may be converted into the second content. In more detail, the processor may convert the object image into the second content based on preset attribute information. The preset attribute information may be information including at least one of a curvature, a focus (F) value, and an angle of view of the first content, and may be information that determines a curved shape of the first content.

According to an embodiment, the processor may automatically convert the object image into second content based on the preset attribute information. Since the second content is converted through the preset attribute information (information including at least one of a curvature of the first content, an F (focus) value, and an angle of view), the second content may have the same curved shape as the first content. . That is, the second content conversion step may be a step performed to convert an object image including a 2D image, a 3D image, and text into a second content image for VR content. As described above, the present invention has the effect of providing high-quality VR content to the user by synthesizing a separate object in the VR content image without bending.

When step S105 is completed, the processor may perform step S107 (a third content creation step).

In step S107, the processor may generate the third content by displaying the second content on the first content.

According to an embodiment, the processor may display the second content converted based on preset attribute information in any one of preset areas on the first content. The preset area may be an insertion area of the object image set based on a second user input in step S103 (image input step). Also, the preset area may be any one of the background areas of the first content. For example, the processor may automatically synthesize or insert the second content into an upper left region that is a background region of the first content.

That is, the processor displays the second content converted from the object image in step S107 in a preset area of the first content, and displays the second content synthesized or inserted in the preset area. It is possible to automatically create a third content that is an image for one completed VR content. As described above, according to the present invention, as VR contents are automatically created, even the general public can produce VR contents without difficulty, thereby providing convenience to users.

2 is a block diagram of an apparatus for applying an object of VR content implemented according to an embodiment of the present invention.

Referring to FIG. 2 , a computing device including one or more processors and one or more memories for storing instructions executable by the processor includes a first content generating unit 201 , an image input unit 203 , and a second content converting unit 205 . ) and a third content generator 207 .

According to an embodiment, the first content generator 201 may acquire a plurality of images 211 . When the plurality of images 211 are acquired through the camera module, the first content generating unit 201 may convert the acquired plurality of images and generate the first content as one image for VR content. .

According to an embodiment, the first content generating unit 201 is the VR, which is a stereoscopic image supporting an omnidirectional angle of 360 degrees generated through a stitching technique that overlaps or connects the plurality of acquired images. You can create images for content.

According to an embodiment, the first content that is an image for VR content generated by the first content generator 201 includes not only the image acquired through the camera, but also a plurality of images 211 pre-stored in the memory. can be created based on For example, the first content generating unit 201 may generate the first content, which is an image for VR content, by attaching the first image and the second image acquired through at least one camera module. As another example, the first content generator 201 may generate the first content by connecting the third image and the fourth image previously stored in the memory through a stitching technique.

According to an embodiment, when the generation of the first content by the first content generating unit 201 is completed, the image input unit 203 displays the image on the first content while the first content is generated. A first user input for displaying the object image 213 may be received. When receiving the first user input, the image input unit 203 may call the object image 213 pre-stored in the memory, and receive the second user input after the object image 213 is called. can receive When receiving the second user input, the image input unit 203 may determine the size and insertion area of the called object image 213 based on the second user input.

According to an embodiment, the image input unit 203 may receive the first user input through a display or a touch screen included in the computing device, and the first user input from a separate device connected to the computing device. can receive The first user input is for calling the object image 213 stored in the memory or for calling the object image 213 stored in another electronic device connected to the computing device through a wired network and/or a wireless network. It can be an input. The object image 213 may be at least one of a 2D image and a 3D image before being converted into an image for VR content to be displayed on the first content as the first content, which is an image for VR content.

According to another embodiment, the object image 213 may include a text input based on a text input instead of a 2D image or a 3D image called by the first user input. The image input unit 203 may display text input based on the text input on the first content. That is, the image input unit 203 may distinguish the first user input from the text input, and may recognize the inputted text as the object image 213 based on the received text input.

According to an embodiment, when the object image 213 is called through the first user input, the image input unit 203 may display the called object image 213 on the first content. . The image input unit 203 receives a second user input for determining at least one of a size and an insertion area of the object image 213 while the object image 213 is being displayed on the first content can do. For example, when receiving the second user input, the image input unit 203 may change the size of the object image 213 displayed on the first content to a minimum size based on the second user input. there is. As another example, when receiving the second user input, the image input unit 203 may determine to insert the object image 213 into a left region of the first content.

According to an embodiment, when at least one of the size and the insertion area of the object image 213 being displayed on the first content is determined by the image input unit 203 , the second content conversion unit 205 may The image 213 may be converted into second content, which is an image for VR content, by reflecting the curved shape of the first content.

According to an embodiment, the second content conversion unit 205 reflects the curved shape of the first content to the object image 213 in order to synthesize the object image 213 into the first content without bending. to convert to the second content. The second content conversion unit 205 may convert the object image 213 into the second content based on preset attribute information. The preset attribute information may be information including at least one of a curvature, an F (focus) value, and an angle of view of the first content, and information for determining a curved shape of at least one of the first content and the second content can be

According to an embodiment, the second content conversion unit 205 may automatically convert the object image 213 into second content based on the preset attribute information. The second content is the object image 213 converted based on the preset attribute information, and may have the same curved shape as that of the first content. That is, the second content conversion unit 205 may be configured to convert the object image 213 including at least one of a 2D image, a 3D image, and text into second content that is an image for VR content.

According to an embodiment, when the object image 213 is converted into the second content by the second content converter 205 , the third content generator 207 converts the second content onto the first content. displayed, the third content 215 may be generated.

According to an embodiment, the third content generating unit 207 may display the second content in any one of a preset area on the first content. The preset area may be an insertion area of the object image 213 determined by the image input unit 203 based on the second user input. Also, the preset area may be any one of the background areas of the first content. For example, the third content generating unit 207 automatically synthesizes or inserts the second content into the upper left region, which is the background region of the first content, to form a third content that is a completed image for VR content. (215) can be created. That is, the third content generator 207 automatically displays the second content in a preset area of the first content, and converts the first content including the second content into one completed VR content. The image may be automatically generated as the third content 215 .

3 is a diagram for explaining an example of erroneous VR content according to an embodiment of the present invention.

Referring to FIGS. 3A and 3B , the universal VR content generating apparatus 300 may display the first content ( 301 in FIG. 3A or 305 in FIG. 3B ) through a display. there is. According to an embodiment, the processor overlaps or concatenates a plurality of images acquired through at least one camera included in the application device 300 through a stitching technique to form a first content image as one VR content image. (301 in FIG. 3(a) or 305 in FIG. 3(b)).

According to an embodiment, while the first content is displayed through the display, the processor may generate the third content by synthesizing or inserting the second content on the first content. However, when the object image is converted to the second content without reflecting the curved shape of the first content ( 301 in FIG. 3A or 305 in FIG. 3B ), a bending phenomenon may occur. Accordingly, the universal VR content generating apparatus 300 has a problem in that the aesthetics and completeness of the third content are deteriorated due to the second content in which the bending phenomenon has occurred. On the other hand, the device for applying an object of VR content based on the present invention prevents bending of the second content and automatically performs VR content production at the same time, thereby improving the completeness of VR content and improving the aesthetics of VR content. It may have an effect of providing convenience in effect and VR content creation.

4 is a view for explaining third content generated through the object application method of VR content according to an embodiment of the present invention.

Referring to FIG. 4A , an apparatus 400 for applying an object to VR content (hereinafter, referred to as an “electronic device”) including one or more processors and one or more memories for storing instructions executable by the processors is a display The first content 401 may be displayed through .

According to an embodiment, the processor may receive a text input through a display or a touch screen included in the electronic device 400 . According to another embodiment, the processor may receive the text input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 400 . According to another embodiment, the processor may receive a text input input from another electronic device connected to the electronic device 400 through a wired network and/or a wireless network.

According to an embodiment, the processor may display text on the first content 401 being displayed through the display based on the received text input. When receiving a second user input while displaying the text input, the processor may determine at least one of a size of the text and an input area based on the second user input.

According to an embodiment, the processor may convert the text displayed on the first content 401 into the second content 403 that is a VR content image in response to the completion of the second user input. The processor may convert the text into the second content 403 , which is a VR content image configured in the 3D or 2D form, based on the curved shape of the first content 401 . In more detail, the processor may convert the text into the second content 403 through preset attribute information including at least one of a curvature, a focus (F) value, and an angle of view of the first content 401 . there is. That is, the processor may determine the curved shape of the text to be converted into the second content 403 based on the preset attribute information.

According to an embodiment, as the processor converts the text into the second content 403 based on the preset attribute information, the curved shape of the second content 403 is the first content 401 . may have the same curved shape as

According to an embodiment, the processor may insert or synthesize the second content 403 in a preset area on the first content 401 . The preset area may be a background area of the first content 401 or an insertion area of text determined by the second user input.

According to an embodiment, the processor may display the second content 403 in a preset area of the first content 401 to generate a third content that is an image for one completed VR content. That is, the processor may display the second content 403 on a preset area of the first content 401 without bending, thereby generating a third content that is an image for one completed VR content.

Referring to FIG. 4(b) , an apparatus 400 for applying an object to VR content (hereinafter, referred to as “electronic device”) including one or more processors and one or more memories for storing instructions executable by the processors is a display. The first content 401 may be displayed through .

According to an embodiment, the processor may receive a first user input through a display or a touch screen included in the electronic device 400 . According to another embodiment, the processor may receive the first user input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 400 .

According to an embodiment, the processor may display a 2D image or a 3D image (eg, a character) on the first content 405 based on the received first user input. The 2D image or the 3D image displayed based on the first user input may be an object image and may be an image before being converted into the second content 407 which is an image for VR content.

According to an embodiment, the processor may receive the second user input. The processor may determine at least one of a size and an insertion area of an object image (eg, a character) being displayed on the first content 405 based on the received second user input.

According to an embodiment, in response to the completion of the second user input, the processor may convert the object image displayed on the first content 405 into the second content 407 that is a VR content image. The processor may convert the object image into the second content 407 that is a VR content image based on the curved shape of the first content 405 . In more detail, the processor converts the object image to the second content (image for VR content) through preset attribute information including at least one of a curvature, a focus (F) value, and an angle of view of the first content 405 . 407) can be converted to That is, the processor may determine the curved shape of the object image to be converted into the second content 407 based on the preset attribute information.

According to an embodiment, as the processor converts the object image into the second content 407 based on the preset attribute information, the curved shape of the second content 407 changes to the first content ( 405) and may have the same curved shape.

According to an embodiment, the processor may insert or synthesize the second content 407 in a preset area on the first content 405 . The preset area may be a background area of the first content 405 or an insertion area of an object image determined by the second user input.

According to an embodiment, the processor may display the second content 407 in a preset area of the first content 405 to generate a third content that is an image for one completed VR content. That is, the processor may display the second content 407 on a preset area of the first content 405 without bending, thereby generating a third content that is an image for one completed VR content. As described above, the present invention can convert text and object images into images for VR content, and thus can have the effect of providing VR content to various work environments.

5 is another diagram for explaining third content generated through the object application method of VR content according to an embodiment of the present invention.

Referring to FIG. 5 , an apparatus 400 for applying an object to VR content (hereinafter, referred to as “electronic device”) including one or more processors and one or more memories for storing instructions executable by the processors is provided through a display. 1 content 501 may be displayed.

According to an embodiment, the processor may acquire a plurality of images through at least one camera module included in the electronic device 400 . The processor may convert the plurality of acquired images into a first content 501 that is an image for one VR content through a stitching technique. The processor may receive at least one of a text input and a first user input while displaying the first content 501 through the display.

According to an embodiment, the processor may receive a text input through a display or a touch screen included in the electronic device 500 . According to another embodiment, the processor may receive the text input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 500 .

According to an embodiment, the processor may display the text 503 on the display based on the received text input. According to another embodiment, the processor may display the text 503 on the display of the electronic device 500 based on a text input input through another electronic device connected to the electronic device 500 .

According to an embodiment, the processor may receive a first user input. In response to receiving the first user input, the processor may display an object image previously stored in the memory of the electronic device 500 through the display. According to another embodiment, the processor may call the object image from another electronic device connected to the electronic device 500 through a wired network and/or a wireless network and display it on the display of the electronic device 500 . .

According to an embodiment, the processor may receive a third user input through the display or the touch screen. According to another embodiment, the processor may receive a third user input from another electronic device connected to the electronic device 500 . The third user input may be an input for calling the work box 505 to edit the text or object image input on the first content 501 based on the text input or the first user input. The processor may display the task box 505 in one area of the first content 501 in response to receiving the third user input.

According to an embodiment, the work box 505 may include a function for changing a visual effect of the text 503 or an object image. For example, the work box 505 may include functions such as contrast adjustment, size adjustment, font change, effect application, and position change. The functions of the task box 505 may be partially deleted or added, and is not limited to the above-described functions. As described above, the present invention can apply various visual effects to an object image through a separate work box 505 , thereby improving the aesthetics and completeness of the completed VR content.

6 is a diagram for explaining a method of sharing a third content generated through an object application method of VR content implemented according to an embodiment of the present invention with another electronic device.

Referring to FIG. 6 , the apparatus 400 for applying an object to VR content including one or more processors and one or more memories for storing instructions executable by the processors (hereinafter, referred to as “electronic device”) includes a communication module (not shown). city) may be included.

According to an embodiment, the processor may be communicatively connected to another electronic device 610 through the communication module. The other electronic device 610 may be a smart phone, a desktop device, a tablet, or a wearable device, and is not limited thereto as long as it can transmit/receive an image for VR content from the electronic device 600 .

According to an embodiment, the processor transmits third content including the first content 601 and the second content 603 being displayed through the display of the electronic device 600 to the other electronic device through the communication module. 610 may be transmitted.

According to an embodiment, the other electronic device 610 that has received the third content from the electronic device 600 may display the same sixth content as the third content. The sixth content may be content including a fourth content 611 identical to the first content 601 and a fifth content 613 identical to the second content 603 . That is, when the electronic device 600 and the other electronic device 610 are communicatively connected, an image for VR content may be shared.

According to an embodiment, when a part of the configuration (eg, the second content 603) included in the third content is changed, the processor provides information on the changed configuration to the other electronic device 610 (hereinafter, referred to as "change information") may be transmitted in real time. The change information may be information related to a changed configuration.

For example, when the size of the second content 603 is changed to “10”, the change information may include information indicating that the size of the second content 603 is changed to “10”. When receiving the change information, the other electronic device 610 may change the size of the fifth content 613 corresponding to the second content 603 to “10”. That is, as the electronic device 600 and the other electronic device 610 share one and the same image for VR content, at least one of the components included in the image for VR content is the same based on the change information. can be changed to As described above, according to the present invention, VR content can be shared with a plurality of other electronic devices, and thus the diffusion speed of VR content can be improved.

7 is a view for explaining a method of connecting to a link linked to a second content based on a field of view (FOV) according to an embodiment of the present invention.

Referring to FIG. 7( a ), an apparatus 700 for applying an object to VR content (hereinafter, referred to as “electronic device”) including one or more processors and one or more memories for storing instructions executable by the processors is a first Third content including the first content 701 and the second content 703 may be displayed through the display.

According to an embodiment, the processor may acquire a plurality of images through at least one camera module included in the electronic device 700 . The processor may generate the first content 701 as one image for VR content through a stitching technique in which the plurality of acquired images are overlapped or connected. The processor may display a second content 703 in a preset area of the first content 701 to output a third content that is an image for one completed VR content.

According to an embodiment, the second content 703 may include link information related to the second content 703 . For example, referring to FIG. (a) , the second content 703 may be an image for VR content in the form of “Treasure No. 322”. The second content 703 may include link information including information related to the treasure 322 . That is, the link information may be changed during the design process of the present invention.

According to an embodiment, when one of the areas of the third content is displayed on the display, the processor may recognize whether the one area is displayed through the display for a specified time. That is, the processor may analyze a region of interest (ROI), which is the user's region of interest, based on the specified time.

According to an embodiment, the processor may display the second content 703 in one area of the third content. The second content 703 may be located in the vicinity of a place, a building, a person, and an article included in the third content. For example, the processor may display the second content 703 that is an image for VR content in the form of a 3D image called “Treasure No. 322” near a building that is a component included in the third content.

According to an embodiment, when the second content 703 is located in one region of the third content, the processor is configured to display a region of the third content including the second content 703 through the display. It can be measured whether it is displayed for a specified time. When a region of the third content including the second content 703 is displayed for more than the specified time through the display, the processor determines that the region of the third content is the user's region of interest (ROI). can judge

According to an embodiment, the processor that determines that the one area of the third content is the user's interest area may check whether the second content 703 includes link information. When the second content 703 includes the link information, a screen 705 related to the second content 703 may be output based on the link information as shown in FIG. (b).

For example, when the one region of the third content is displayed for 10 seconds or longer, which is a specified time, the processor may determine that the one region is the user's region of interest (ROI). When the one region determines the user's ROI, the processor may determine whether the second content 703 in the form of a 3D image of "treasure No. 322" is located in the user's ROI. When the second content 703 is located in the one area, the processor may check whether there is link information linked to the second content 703 . When the link information linked to the second content 703 exists, the processor accesses the link included in the link information and displays the information of the “Treasure No. 322” through the display screen 705 ) can be printed. As described above, since the present invention can provide more effective information while providing VR content, an improved educational effect can be provided. In addition, the confirmed user's region of interest (ROI) information may have an effect that can be utilized in various data research fields.

8 illustrates an example of an internal configuration of a computing device according to an embodiment of the present invention, and in the following description, descriptions of unnecessary embodiments that overlap with those of FIGS. 1 to 7 will be omitted. do it with

8, the computing device 10000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, an input/output subsystem ( It may include at least an I/O subsystem) 11400 , a power circuit 11500 , and a communication circuit 11600 . In this case, the computing device 10000 may correspond to a user terminal connected to the tactile interface device (A) or the aforementioned computing device (B).

The memory 11200 may include, for example, a high-speed random access memory, a magnetic disk, an SRAM, a DRAM, a ROM, a flash memory, or a non-volatile memory. there is. The memory 11200 may include a software module, an instruction set, or other various data required for the operation of the computing device 10000 .

In this case, access to the memory 11200 from other components such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100 .

Peripheral interface 11300 may couple input and/or output peripherals of computing device 10000 to processor 11100 and memory 11200 . The processor 11100 may execute a software module or an instruction set stored in the memory 11200 to perform various functions for the computing device 10000 and process data.

The input/output subsystem 11400 may couple various input/output peripherals to the peripheral interface 11300 . For example, the input/output subsystem 11400 may include a controller for coupling a peripheral device such as a monitor, keyboard, mouse, printer, or a touch screen or sensor as needed to the peripheral interface 11300 . According to another aspect, input/output peripherals may be coupled to peripheral interface 11300 without going through input/output subsystem 11400 .

The power circuit 11500 may supply power to all or some of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may include any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may include an RF circuit to transmit and receive an RF signal, also known as an electromagnetic signal, to enable communication with other computing devices.

This embodiment of FIG. 8 is only an example of the computing device 10000, and the computing device 11000 may omit some components shown in FIG. 8, or further include additional components not shown in FIG. 8, or 2 It may have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 8 , and may include various communication methods (WiFi, 3G, LTE) in the communication circuit 1160 , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that may be included in the computing device 10000 may be implemented in hardware including an integrated circuit specialized for one or more signal processing or applications, software, or a combination of both hardware and software.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. The application to which the present invention is applied may be installed in the user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file in response to a request from the user terminal.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. may be permanently or temporarily embody in The software may be distributed over networked computing devices, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible for those skilled in the art from the above description. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result. Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the following claims.

Claims (10)

In the object application method of VR content implemented by a computing device including one or more processors and one or more memories for storing instructions executable by the processor,
a first content creation step of generating a first content by converting the plurality of acquired images into one VR content image when acquiring a plurality of images through at least one camera module;
When receiving a first user input for adding an object image to the first content and a second user input for a size and insertion area of the object image in a state in which the first content is generated, the received first content an image input step of calling the object image and determining a size and an insertion area of the object image according to a user input and the second user input;
Upon completion of the image input step, a second content conversion step of converting the object image of which the size and the insertion area are determined into second content, and reflecting the curved shape of the first content, which is VR content, into second content ; and
and a third content generation step of generating the third content by displaying the second content on the first content.
According to claim 1,
The user editing step is
In order to automatically synthesize and display the second content in a preset area of the first content, the object image is edited based on the second user input.
3. The method of claim 2,
The preset area is
The object application method of VR content, characterized in that it includes a background area of the first content.
According to claim 1,
The second content conversion step is,
The object application method of VR content, characterized in that, based on preset attribute information, converting the object image having the size and the insertion area determined into the second content.
5. The method of claim 4,
The preset attribute information is
The object application method of VR content, characterized in that it is determined based on the curvature, F value, and angle of view of the first content.
According to claim 1,
The first content creation step is,
An object application method of VR content, characterized in that by attaching the plurality of images obtained through a stitching technique to generate the single image for VR content.
According to claim 1,
The object image is
An object application method of VR content, comprising at least one of a 3D image, a 2D image, and text.
According to claim 1,
The third content is
An object application method of VR content, characterized in that it can be transmitted to another electronic device through a communication module.
In the object application device for VR content implemented as a computing device including one or more processors and one or more memories for storing instructions executable by the processor,
a first content generating unit that, when acquiring a plurality of images through a plurality of camera modules, converts the plurality of acquired images into one image and generates a first content;
When receiving a first user input for adding an object image to the first content and a second user input for a size and insertion area of the object image in a state in which the first content is generated, the received first content an image input unit configured to call the object image and determine a size and insertion area of the object image according to a user input and the second user input;
When the operation of the image input unit is completed, the object image having the size and the insertion area determined is converted into second content, and the second content is converted into second content by reflecting the curved shape of the first content, which is VR content conversion unit; and
and a third content generator configured to generate third content by displaying the second content on the first content.
A computer-readable recording medium comprising:
The computer-readable recording medium stores instructions for causing a computing device to perform the following steps;
a first content creation step of generating a first content by converting the plurality of acquired images into one VR content image when acquiring a plurality of images through a plurality of camera modules;
When receiving a first user input for adding an object image to the first content and a second user input for a size and insertion area of the object image in a state in which the first content is generated, the received first content an image input step of calling the object image and determining a size and an insertion area of the object image according to a user input and the second user input;
Upon completion of the image input step, a second content conversion step of converting the object image of which the size and the insertion area are determined into second content, and reflecting the curved shape of the first content, which is VR content, into second content ; and
and a third content generating step of generating third content by displaying the second content on the first content.

Images