KR102541262B1 - METHOD, APPARATUS AND COMPUTER-READABLE MEDIUM OF Applying an object to VR content - Google Patents

Abstract

The present invention relates to a method, apparatus, and computer-readable recording medium for applying VR contents to objects, and includes one or more processors and one or more memories storing instructions executable by the processors according to an embodiment of the present invention. A method of applying an object to VR contents implemented by a device includes a first method of generating first content by converting the acquired plurality of images into one VR contents image when acquiring a plurality of images through at least one camera module. Content creation step; When a first user input for adding an object image to the first content and a second user input for the size and insertion area of the object image are received in a state where the first content is created, the received first an image input step of calling the object image and determining a size and insertion area of the object image according to a user input and the second user input; Upon completion of the image input step, a second content conversion step of converting the object image whose size and the insertion area are determined into second content, and converting the object image into second content by reflecting the curved shape of the first content, which is VR content. ; and a third content generation step of generating third content by displaying the second content on the first content. In addition to this, various embodiments understood through this document are possible.

Description

METHOD, APPARATUS AND COMPUTER-READABLE MEDIUM OF Applying an object to VR content}

The present invention relates to a method for applying VR content to an object, and specifically, the curved shape of 360VR content being displayed can be automatically reflected in a separate object and automatically inserted or synthesized as an image for VR content in 360VR content. Accordingly, bending of the object can be prevented, and 360VR content with a high degree of completion can be obtained. In addition, by automatically generating 360VR content, it is possible to have an effect of supporting various and unique production ideas of 360VR content to the general public as well as experts and improving the spread of related content.

VR (virtual reality), that is, virtual reality, refers to the reality experienced in cyberspace. At this time, cyberspace is a virtual space created through electronic devices, a space that gives reality through three-dimensional visual effects. says VR technology not only simulates real objects to provide a realistic sense of immersion to users, but also allows users to experience objects or situations that do not actually exist. In particular, as single-person content has emerged recently, VR content using VR technology is actively increasing. As an example, Korean Patent Publication No. 10-2020-0101583 (VR video content production method, apparatus and program) includes obtaining one or more 360-degree videos and setting a playback order between the 360-degree videos; selecting a specific point or object in the 360 degree image as an object and setting an information tag to the selected object; and setting a reproduction order of the selected two or more objects, wherein the information tag includes additional information about the corresponding object, and is displayed at a specific location in the VR image when each object is reproduced. A technique for sequentially reproducing the 360-degree video according to the set object reproduction order of the produced VR video contents is disclosed.

However, in the above-mentioned prior art, although a technology for producing VR contents is disclosed, a technology for preventing bending or separation of an object synthesized in a 360-degree curved VR content is not disclosed, and thus, production of VR contents When an ordinary person who is not proficient in producing VR contents through the above prior art, there is a problem that VR contents that are not high in completion are produced.

Therefore, in the object application method of VR content, the present invention automatically synthesizes a separate object reflecting the unique attribute value of the 360VR providing device to 360VR content, thereby providing a variety and personality of 360VR content not only to experts but also to the general public. Its purpose is to support existing production ideas and to provide technology for dissemination of related contents.

In order to achieve the above object, in the object application method of VR content implemented by a computing device including one or more processors and one or more memories for storing commands executable by the processors according to an embodiment of the present invention, at least one When acquiring a plurality of images through the camera module of the first content generation step of converting the acquired plurality of images into one image for VR content and generating first content; When a first user input for adding an object image to the first content and a second user input for the size and insertion area of the object image are received in a state where the first content is created, the received first an image input step of calling the object image and determining a size and insertion area of the object image according to a user input and the second user input; Upon completion of the image input step, a second content conversion step of converting the object image whose size and the insertion area are determined into second content, and converting the object image into second content by reflecting the curved shape of the first content, which is VR content. ; and a third content generation step of generating third content by displaying the second content on the first content.

In the user editing step, it is preferable to edit the object image based on the second user input in order to automatically synthesize and display the second content in a preset area of the first content.

The predetermined area may include a background area of the first content. In the second content conversion step, based on preset attribute information, it is possible to convert the object image whose size and insertion area are determined into the second content.

The predetermined attribute information may be determined based on the curvature, F value, and angle of view of the first content.

In the first content generating step, it is preferable to create the single VR content image by attaching the obtained plurality of images through a stitching technique.

Preferably, the object image includes at least one of a 3D image, a 2D image, and text.

Preferably, the third content can be transmitted to other electronic devices through a communication module.

According to an embodiment of the present invention, a method for applying a VR content to an object implemented by a computing device including one or more processors and one or more memories storing commands executable by the processors includes applying a curved shape of first content to an object image. Since the second content is reflected and converted into the second content, and the third content is automatically generated by inserting or synthesizing the second content on the first content, convenience can be provided when creating an image for VR content.

In addition, according to one embodiment of the present invention, in order to automatically synthesize and display the second content in a preset area of the first content, the object image can be edited based on the second user input, so that various forms of There is an effect of generating an image for VR content.

In addition, according to an embodiment of the present invention, an object image having a size and an insertion area determined based on predetermined attribute information may be converted into second content, thereby preventing bending of elements included in the third content. There is an effect of generating an image for VR content with a high degree of completion by preventing

In addition, according to an embodiment of the present invention, a plurality of images acquired through a stitching technique can be joined to create one image for VR content, so that even in an electronic device with a limited number of cameras, There is an effect of generating an image for VR content.

In addition, according to an embodiment of the present invention, the third content can be transmitted to other electronic devices through a communication module, thereby improving the content spreading speed.

1 is a flowchart illustrating a method of applying an object to VR content implemented according to an embodiment of the present invention.
2 is a block diagram of an object application device for VR content implemented according to an embodiment of the present invention.
3 is a diagram for explaining an example of erroneous VR content according to an embodiment of the present invention.
4 is a diagram for explaining third content generated through a method of applying an object to VR content according to an embodiment of the present invention.
5 is another diagram for explaining third content generated through a method of applying an object to VR content according to an embodiment of the present invention.
6 is a diagram for explaining a method of sharing third content generated through an object application method of implemented VR content according to an embodiment of the present invention with another electronic device.
7 is a diagram for explaining a method of being connected to a link associated with third content based on a user's field of view according to an embodiment of the present invention.
8 is a diagram for explaining an example of an internal configuration of a computing device according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are disclosed with reference now to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings describe in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in principle of the various aspects may be used, and the described descriptions are intended to include all such aspects and their equivalents.

References to “embodiment,” “example,” “aspect,” “example,” etc., used in this specification should not be construed as indicating that any aspect or design described is preferable to or advantageous over other aspects or designs. .

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements and/or groups thereof. It should be understood that it does not.

In addition, terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are those commonly understood by those of ordinary skill in the art to which the present invention belongs. have the same meaning. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning not be interpreted as

1 is a flowchart illustrating a method of applying an object to VR content implemented according to an embodiment of the present invention.

Referring to FIG. 1 , a method for applying a VR content to an object implemented by a computing device including one or more processors and one or more memories storing commands executable by the processors may perform step S101 (first content creation step). can The computing device may include a smart phone, a desktop, a tablet, and the like, and is not limited thereto as long as it is a device capable of automatically applying an object to VR content.

In step S101, the one or more processors (hereinafter referred to as processors) may obtain a plurality of images through at least one camera module (hereinafter referred to as camera modules). When acquiring a plurality of images through the camera module, the processor may convert the obtained plurality of images to generate first content, which is an image for VR content.

According to an embodiment, the image for VR content may be a stereoscopic image supporting omnidirectional angles of 360 degrees generated through a stitching technique of overlapping or attaching a plurality of acquired images. In addition, the plurality of images may include images, photos, and videos, and are not limited thereto as long as they are source files capable of generating the first content.

According to an embodiment, the first content, which is the image for the VR content, may be generated based on a plurality of images pre-stored in the memory as well as an image acquired through the camera. For example, the processor may generate first content, which is an image for VR content, by attaching a first image and a second image acquired through the camera module. For another example, the processor may generate the first content by attaching the third image and the fourth image pre-stored in the memory through a stitching technique.

When the generation of the first content is completed, the processor may perform step S103 (image input step).

In step S103, the processor may receive a first user input for displaying an object image on the first content in a state in which the first content is generated. When the first user input is received, the processor may call the object image, and may receive a second user input in a state in which the calling of the object image is completed. When receiving the second user input, the processor may determine the size and insertion area of the called object image based on the second user input.

According to an embodiment, the processor may receive the first user input through a display or a touch screen included in the computing device, and may receive the first user input from a separate device connected to the computing device. there is. The first user input may be an input for calling an object image previously stored in the memory or an object image stored in another electronic device connected to the computing device through a wired network and/or a wireless network. The object image may be at least one of a 2D image and a 3D image before being converted into an image for VR content in order to display the image for VR content on the first content.

According to another embodiment, the object image may include text input based on a text input other than the second user input. According to another embodiment, the processor may display text on the first content based on text input. That is, the processor may distinguish between a first user input and a text input, and may recognize the input text as an object image for converting an image for VR content based on the received text input.

According to an embodiment, when the object image is called through the first user input, the processor may display the called object image on the first content being displayed through the display or the touch screen. The processor may receive a second user input for determining at least one of a size and an insertion area of the object image while the object image is being displayed on the first content. For example, when receiving the second user input, the processor may change the size of the object image being displayed on the first content to a minimum size based on the second user input. For another example, when receiving the second user input, the processor may determine to insert the object image into a left region of the first content.

According to another embodiment, when receiving the second user input while text is being displayed on the first content, the processor determines the size and insertion area of the text based on the received second user input. can decide As described above, the present invention can apply various effects to an object image through a separate user input (eg, a second user input), and thus has an effect of providing VR content to which various effects are applied.

When determining at least one of the size and insertion area of the object image being displayed on the first content, the processor may perform step S105 (second content conversion step).

In step S105, when the image input step is completed, the processor may convert the object image into second content by reflecting the curved shape of the first content, which is a VR content image.

According to an embodiment, the processor may automatically convert the object image into the second content when the size and insertion area of the object image being displayed on the first content are determined. The processor may reflect the curved shape of the first content to the object image in order to combine the object image with the curved first content without bending. The object image in which the curved shape of the first content is reflected may be converted into second content. More specifically, the processor may convert the object image into the second content based on preset attribute information. The predetermined attribute information may be information including at least one of a curvature, an F (focus) value, and an angle of view of the first content, and may be information for determining a curved surface shape of the first content.

According to an embodiment, the processor may automatically convert the object image into second content based on the preset attribute information. Since the second content is converted through the predetermined attribute information (information including at least one of a curvature, an F (focus) value, and an angle of view of the first content), it may have the same curved surface shape as the first content. . That is, the second content conversion step may be a step performed to convert an object image including a 2D image, a 3D image, and text into a second content image for VR content. As described above, the present invention can synthesize a separate object to a VR content image without bending, and thus has an effect of providing users with VR content with a high degree of completion.

When the step S105 is completed, the processor may perform step S107 (third content creation step).

In step S107, the processor may display the second content on the first content to generate third content.

According to an embodiment, the processor may display the converted second content based on preset attribute information in one of preset areas on the first content. The preset area may be an insertion area of the object image set based on the second user input in step S103 (image input step). Also, the predetermined area may be any one of background areas of the first content. For example, the processor may automatically synthesize or insert the second content into an upper left area that is a background area of the first content.

That is, the processor displays the second content converted from the object image in step S107 in a preset area of the first content, and displays the first content synthesized or inserted second content in the preset area. Third content, which is an image for one completed VR content, can be automatically generated. As described above, according to the present invention, as VR contents are automatically produced, ordinary people can produce VR contents without difficulty, thereby providing convenience to users.

2 is a block diagram of an object application device for VR content implemented according to an embodiment of the present invention.

Referring to FIG. 2 , a computing device including one or more processors and one or more memories storing instructions executable by the processors includes a first content generator 201, an image input unit 203, and a second content converter 205. ) and a third content generator 207.

According to one embodiment, the first content generator 201 may acquire a plurality of images 211 . When the first content generator 201 acquires the plurality of images 211 through the camera module, the first content creation unit 201 converts the obtained plurality of images to generate first content, which is an image for VR content. .

According to an embodiment, the VR, which is a three-dimensional image supporting omnidirectional angles of 360 degrees, generated by the first content generator 201 through a stitching technique in which a plurality of acquired images are overlapped or joined together. You can create images for content.

According to an embodiment, the first content, which is an image for VR content generated by the first content generator 201, includes a plurality of images 211 pre-stored in the memory as well as an image acquired through the camera. can be created based on For example, the first content generator 201 may generate first content, which is an image for VR content, by attaching a first image and a second image acquired through at least one camera module. For another example, the first content generator 201 may generate the first content by attaching a third image and a fourth image pre-stored in the memory through a stitching technique.

According to an embodiment, when the generation of the first content by the first content creation unit 201 is completed, the image input unit 203 is placed on the first content in a state in which the first content is created. A first user input for displaying the object image 213 may be received. When receiving the first user input, the image input unit 203 may call an object image 213 pre-stored in the memory, and in a state in which the calling of the object image 213 is completed, a second user input may be received. can receive When receiving the second user input, the image input unit 203 may determine the size and insertion area of the called object image 213 based on the second user input.

According to an embodiment, the image input unit 203 may receive the first user input through a display or touch screen included in the computing device, and the first user input from a separate device connected to the computing device. can receive The first user input is for calling an object image 213 pre-stored in the memory or an object image 213 stored in another electronic device connected to the computing device through a wired network and/or a wireless network. can be an input. The object image 213 may be at least one of a 2D image and a 3D image before being converted into an image for VR content to be displayed as first content, which is an image for VR content, on the first content.

According to another embodiment, the object image 213 may include text input based on a text input rather than a 2D image or a 3D image called by the first user input. The image input unit 203 may display text input on the first content based on text input. That is, the image input unit 203 can distinguish a first user input from a text input, and can recognize input text as an object image 213 based on the received text input.

According to an embodiment, when calling the object image 213 through the first user input, the image input unit 203 may display the called object image 213 on the first content. . The image input unit 203 receives a second user input for determining at least one of a size and an insertion area of the object image 213 while the object image 213 is being displayed on the first content. can do. For example, when receiving the second user input, the image input unit 203 may change the size of the object image 213 displayed on the first content to a minimum size based on the second user input. there is. For another example, when receiving the second user input, the image input unit 203 may determine to insert the object image 213 into a left region of the first content.

According to an embodiment, when at least one of the size and insertion area of the object image 213 being displayed on the first content is determined by the image input unit 203, the second content conversion unit 205 converts the object image 213 to the object image 213. The image 213 may be converted into second content, which is an image for VR content, by reflecting the curved shape of the first content.

According to an embodiment, the second content converter 205 reflects the curved shape of the first content on the object image 213 in order to combine the object image 213 with the first content without bending. and can be converted into the second content. The second content conversion unit 205 may convert the object image 213 into the second content based on preset attribute information. The preset attribute information may be information including at least one of a curvature, an F (focus) value, and an angle of view of the first content, and information for determining a curved shape of at least one of the first content and the second content. can be

According to an embodiment, the second content conversion unit 205 may automatically convert the object image 213 into second content based on the preset attribute information. The second content is obtained by converting the object image 213 based on the preset attribute information, and may have the same curved shape as the first content. That is, the second content conversion unit 205 may be a component that converts the object image 213 including at least one of a 2D image, a 3D image, and text into second content that is an image for VR content.

According to an embodiment, when the object image 213 is converted into second content by the second content converting unit 205, the third content generating unit 207 converts the second content onto the first content. By displaying, third content 215 can be created.

According to an embodiment, the third content generator 207 may display the second content in one of preset areas on the first content. The predetermined area may be an insertion area of the object image 213 determined by the image input unit 203 based on the second user input. Also, the predetermined area may be any one of background areas of the first content. For example, the third content creation unit 207 automatically synthesizes or inserts the second content into the upper left area, which is the background area of the first content, so that the third content is a completed VR content image. (215) can be produced. That is, the third content generator 207 automatically displays the second content in a predetermined area of the first content, and converts the first content including the second content into one completed VR content. It can be automatically generated as the third content 215 that is an image.

3 is a diagram for explaining an example of erroneous VR content according to an embodiment of the present invention.

Referring to FIGS. 3(a) and (b), a universal VR content creation device 300 may display first content (301 in FIG. 3(a) or 305 in FIG. 3(b)) through a display. there is. According to an embodiment, the processor duplicates or connects a plurality of images acquired through at least one camera included in the application device 300 through a stitching technique to form a single VR content image, the first content. (301 in FIG. 3(a) or 305 in FIG. 3(b)).

According to an embodiment, the processor may create third content by synthesizing or inserting second content onto the first content while displaying the first content through the display. However, when the object image is converted into the second content without reflecting the curved shape of the first content (301 in FIG. 3(a) or 305 in FIG. 3(b)), bending may occur. Accordingly, the universal VR content creation device 300 has a problem in that aesthetics and completeness of the third content are deteriorated due to the second content in which the bending phenomenon has occurred. On the other hand, the object application device for VR content based on the present invention prevents the bending of the second content and automatically produces the VR content, thereby improving the completeness of the VR content and improving the aesthetics of the VR content. It may have an effect of providing convenience in creating effects and VR contents.

4 is a diagram for explaining third content generated through a method of applying an object to VR content according to an embodiment of the present invention.

Referring to FIG. 4(a) , an object application device 400 (hereinafter referred to as “electronic device”) for VR content including one or more processors and one or more memories storing commands executable by the processors displays The first content 401 can be displayed through.

According to an embodiment, the processor may receive text input through a display or touch screen included in the electronic device 400 . According to another embodiment, the processor may receive the text input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 400 . According to another embodiment, the processor may receive text input from another electronic device connected to the electronic device 400 through a wired network and/or a wireless network.

According to an embodiment, the processor may display text on the first content 401 displayed through the display based on the received text input. When receiving a second user input while displaying the text input, the processor may determine at least one of a size of the text and an input area based on the second user input.

According to an embodiment, the processor may convert text displayed on the first content 401 into second content 403 that is a VR content image in response to completion of the second user input. The processor may convert the text into second content 403 that is a VR content image configured in the 3D or 2D form based on the curved shape of the first content 401 . More specifically, the processor may convert the text into the second content 403 through predetermined attribute information including at least one of a curvature, an F (focus) value, and an angle of view of the first content 401 . there is. That is, the processor may determine the curved shape of the text to be converted into the second content 403 based on the preset attribute information.

According to an embodiment, as the processor converts the text into the second content 403 based on the preset attribute information, the curved shape of the second content 403 is the first content 401 It may have the same curved shape as

According to an embodiment, the processor may insert or combine the second content 403 into a predetermined area on the first content 401 . The predetermined area may be a background area of the first content 401, or may be a text insertion area determined by the second user input.

According to an embodiment, the processor may display the second content 403 in a preset area of the first content 401 to generate third content, which is a completed VR content image. That is, the processor may display the second content 403 on a predetermined area of the first content 401 without bending, and generate third content, which is a completed VR content image.

Referring to FIG. 4(b) , an object application device 400 (hereinafter referred to as “electronic device”) for VR content including one or more processors and one or more memories storing instructions executable by the processors displays The first content 401 can be displayed through.

According to an embodiment, the processor may receive a first user input through a display or a touch screen included in the electronic device 400 . According to another embodiment, the processor may receive the first user input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 400 .

According to an embodiment, the processor may display a 2D image or a 3D image (eg, a character) on the first content 405 based on the received first user input. The 2D image or the 3D image displayed based on the first user input may be an object image before being converted into the second content 407, which is an image for VR content.

According to an embodiment, the processor may receive the second user input. The processor may determine at least one of a size and an insertion area of an object image (eg, character) being displayed on the first content 405 based on the received second user input.

According to an embodiment, the processor may convert an object image being displayed on the first content 405 into second content 407 that is a VR content image in response to completion of the second user input. The processor may convert the object image into second content 407 as a VR content image based on the curved shape of the first content 405 . In more detail, the processor converts the object image through predetermined attribute information including at least one of a curvature, an F (focus) value, and an angle of view of the first content 405 to the second content (which is an image for the VR content) 407) can be converted to That is, the processor may determine the curved shape of the object image to be converted into the second content 407 based on the preset attribute information.

According to an embodiment, as the processor converts the object image into the second content 407 based on the preset attribute information, the curved shape of the second content 407 is the first content ( 405) may have the same curved shape.

According to one embodiment, the processor may insert or combine the second content 407 into a predetermined area on the first content 405 . The predetermined area may be a background area of the first content 405 or an insertion area of an object image determined by the second user input.

According to an embodiment, the processor may display the second content 407 in a preset area of the first content 405 to generate third content, which is a completed image for VR content. That is, the processor may display the second content 407 on a predetermined area of the first content 405 without bending, and generate third content, which is a completed VR content image. As described above, the present invention can convert text and object images into images for VR content, and thus can have an effect of providing VR content to various working environments.

5 is another diagram for explaining third content generated through a method of applying an object to VR content according to an embodiment of the present invention.

Referring to FIG. 5 , an object application device 400 (hereinafter, referred to as “electronic device”) for VR content including one or more processors and one or more memories storing commands executable by the processors is provided through a display. 1 content 501 can be displayed.

According to an embodiment, the processor may acquire a plurality of images through at least one camera module included in the electronic device 400 . The processor may convert the obtained plurality of images into first content 501, which is an image for VR content, through a stitching technique. The processor may receive at least one of a text input and a first user input while displaying the first content 501 through the display.

According to an embodiment, the processor may receive text input through a display or touch screen included in the electronic device 500 . According to another embodiment, the processor may receive the text input through a peripheral device (eg, a keyboard and a mouse) connected to the electronic device 500 .

According to an embodiment, the processor may display text 503 on the display based on the received text input. According to another embodiment, the processor may display text 503 on the display of the electronic device 500 based on a text input input through another electronic device connected to the electronic device 500 .

According to an embodiment, the processor may receive a first user input. In response to receiving the first user input, the processor may display an object image pre-stored in the memory of the electronic device 500 through the display. According to another embodiment, the processor may display the object image on the display of the electronic device 500 by calling the object image from another electronic device connected to the electronic device 500 through a wired network and/or a wireless network. .

According to an embodiment, the processor may receive a third user input through the display or the touch screen. According to another embodiment, the processor may receive a third user input from another electronic device connected to the electronic device 500 . The third user input may be an input that calls an action box 505 to edit text or an object image input on the first content 501 based on the text input or the first user input. The processor may display the task box 505 in one area of the first content 501 in response to receiving the third user input.

According to an embodiment, the task box 505 may include a function for changing the visual effect of the text 503 or object image. For example, the task box 505 may include functions such as contrast adjustment, size adjustment, font change, effect application, and location change. Some of the functions of the task box 505 may be deleted or added, and are not limited to the functions disclosed above. As described above, the present invention can apply various visual effects to object images through a separate task box 505, and thus can have an effect of improving aesthetics and completeness of completed VR contents.

6 is a diagram for explaining a method of sharing third content generated through an object application method of implemented VR content according to an embodiment of the present invention with another electronic device.

Referring to FIG. 6 , an object application device 400 for VR content (hereinafter referred to as “electronic device”) including one or more processors and one or more memories storing commands executable by the processors includes a communication module (not shown). city) may be included.

According to an embodiment, the processor may be communicatively connected to another electronic device 610 through the communication module. The other electronic device 610 may be a smart phone, desktop, tablet, or wearable device, and is not limited thereto as long as it can transmit/receive images for VR content from the electronic device 600 .

According to an embodiment, the processor transmits third content including the first content 601 and the second content 603 being displayed through the display of the electronic device 600 to the other electronic device through the communication module. (610).

According to an embodiment, another electronic device 610 receiving the third content from the electronic device 600 may display the same sixth content as the third content. The sixth content may be content including a fourth content 611 identical to the first content 601 and a fifth content 613 identical to the second content 603 . That is, when the electronic device 600 and the other electronic device 610 are communicatively connected, images for VR content may be shared.

According to an embodiment, when a part of the configuration (eg, the second content 603) included in the third content is changed, the processor sends information about the changed configuration to the other electronic device 610 (hereinafter, referred to as "change information") can be transmitted in real time. The change information may be information related to a changed configuration.

For example, when the size of the second content 603 is changed to "10", the change information may include information notifying that the size of the second content 603 is changed to "10". When receiving the change information, the other electronic device 610 may change the size of the fifth content 613 corresponding to the second content 603 to "10". That is, as the electronic device 600 and the other electronic device 610 share one and the same VR content image, based on the change information, at least one of components included in the VR content image is identical. can be changed to As described above, the present invention can share VR contents with a plurality of other electronic devices, and thus can have an effect of improving the diffusion speed of VR contents.

7 is a diagram for explaining a method of being connected to a link associated with second content based on a field of view (FOV) according to an embodiment of the present invention.

Referring to FIG. 7(a) , an object application device 700 for VR contents (hereinafter referred to as an "electronic device") including one or more processors and one or more memories storing instructions executable by the processors includes a first The third content including the first content 701 and the second content 703 may be displayed on the display.

According to an embodiment, the processor may acquire a plurality of images through at least one camera module included in the electronic device 700 . The processor may generate first content 701, which is an image for VR content, through a stitching technique of overlapping or attaching the obtained plurality of images. The processor may display the second content 703 in a preset area of the first content 701 to output third content, which is a completed VR content image.

According to one embodiment, the second content 703 may include link information related to the second content 703 . For example, referring to (a), the second content 703 may be an image for VR content in the form of "Treasure No. 322". The second content 703 may include link information including information related to treasure No. 322. That is, the link information may be changed during the design process of the present invention.

According to an embodiment, when one of the regions of the third content is displayed on the display, the processor may recognize whether the one region is displayed for a specified time through the display. That is, the processor may analyze a region of interest (ROI), which is a region of interest of the user, based on the designated time.

According to an embodiment, the processor may display the second content 703 in one area of the third content. The second content 703 may be located near structures included in the third content, such as places, buildings, people, and articles. For example, the processor may display the second content 703, which is an image for VR content in the form of a 3D image called “Treasure No. 322,” near a building included in the third content.

According to an embodiment, when the second content 703 is located in one area of the third content, the processor is configured to display one area of the third content including the second content 703. can be measured for a specified amount of time. When a region of the third content including the second content 703 is displayed on the display for more than the specified time, the processor regards a region of the third content as a user's region of interest (ROI). can judge

According to an embodiment, upon determining that one region of the third content is the user's region of interest, the processor may determine whether the second content 703 includes link information. When the second content 703 includes the link information, a screen 705 related to the second content 703 may be displayed based on the link information as shown in FIG. (b).

For example, when one region of the third content is displayed for 10 seconds or more, which is a designated time, the processor may determine that the one region is the user's region of interest (ROI). When determining that the one region is the user's region of interest, the processor may determine whether the second content 703 in the form of a 3D image called "Treasure No. 322" is located in the user's region of interest. When the second content 703 is located in the one area, the processor may check whether there is link information associated with the second content 703 . When link information associated with the second content 703 exists, the processor accesses the link included in the link information and displays the information of "Treasure No. 322" through the display (705). ) can be output. As described above, since the present invention can provide more effective information while providing VR content, it can provide improved educational effects. In addition, the identified user's region of interest (ROI) information may have effects that can be utilized in various data research fields.

8 illustrates an example of an internal configuration of a computing device according to an embodiment of the present invention, and in the following description, descriptions of unnecessary embodiments overlapping with those of FIGS. 1 to 7 will be omitted. do it with

As shown in FIG. 8, a computing device 10000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, an input/output subsystem ( It may include at least an I/O subsystem (11400), a power circuit (11500), and a communication circuit (11600). In this case, the computing device 10000 may correspond to a user terminal connected to the tactile interface device (A) or the aforementioned computing device (B).

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. there is. The memory 11200 may include a software module, a command set, or other various data necessary for the operation of the computing device 10000.

In this case, access to the memory 11200 from other components, such as the processor 11100 or the peripheral device interface 11300, may be controlled by the processor 11100.

Peripheral interface 11300 may couple input and/or output peripherals of computing device 10000 to processor 11100 and memory 11200 . The processor 11100 may execute various functions for the computing device 10000 and process data by executing software modules or command sets stored in the memory 11200 .

Input/output subsystem 11400 can couple various input/output peripherals to peripheral interface 11300. For example, the input/output subsystem 11400 may include a controller for coupling a peripheral device such as a monitor, keyboard, mouse, printer, or touch screen or sensor to the peripheral interface 11300 as needed. According to another aspect, input/output peripherals may be coupled to the peripheral interface 11300 without going through the input/output subsystem 11400.

The power circuit 11500 may supply power to all or some of the terminal's components. For example, power circuit 11500 may include a power management system, one or more power sources such as a battery or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator or power It may contain any other components for creation, management and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, the communication circuit 11600 may include an RF circuit and transmit/receive an RF signal, also known as an electromagnetic signal, to enable communication with another computing device.

The embodiment of FIG. 8 is only an example of the computing device 10000, and the computing device 11000 may omit some of the components shown in FIG. 8, further include additional components not shown in FIG. It may have a configuration or arrangement combining two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that may be included in the computing device 10000 may be implemented as hardware including one or more signal processing or application-specific integrated circuits, software, or a combination of both hardware and software.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in computer readable media. In particular, the program according to the present embodiment may be configured as a PC-based program or a mobile terminal-only application. An application to which the present invention is applied may be installed in a user terminal through a file provided by a file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to a request of a user terminal.

The device described above may be implemented as a hardware component, a software component, and/or a combination of hardware components and software components. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. You can command the device. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or to provide instructions or data to a processing device. may be permanently or temporarily embodied in Software may be distributed on networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved. Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (10)

A method for applying objects to VR content implemented by a computing device including one or more processors and one or more memories storing instructions executable by the processors,
When a plurality of images are acquired through at least one camera module, a first content generation step of converting the acquired plurality of images into one VR content image and generating first content;
When a first user input for adding an object image to the first content and a second user input for the size and insertion area of the object image are received in a state where the first content is created, the received first an image input step of calling the object image and determining a size and insertion area of the object image according to a user input and the second user input;
Upon completion of the image input step, a second content conversion step of converting the object image whose size and the insertion area are determined into second content, and converting the object image into second content by reflecting the curved shape of the first content, which is VR content. ; and
A third content generation step of generating third content by displaying the second content on the first content; including,
The image input step,
In order to automatically synthesize and display the second content in a preset area of the first content, edit the object image based on the second user input,
The preset area is
Including a background area of the first content,
In the second content conversion step,
Based on preset attribute information, converting the object image having the size and the insertion area determined into the second content,
The preset attribute information,
It is determined based on the curvature, F value, and angle of view of the first content.
The first content creation step,
A plurality of images acquired through a stitching technique are connected and attached to create the one image for VR content,
The object image,
Including at least one of 3D images, 2D images and text,
The third content,
Can be transmitted to other electronic devices through the communication module,
The object application method of the VR content,
When a third user input is received from the other electronic device through the communication module, an action box for editing text or an object image input on the first content is called based on the received third user input, Outputting the called operation box through one area of the first content,
The working box,
An object of VR content, characterized in that the interface provides a function including at least one of contrast adjustment, size adjustment, font change, effect application, and position change of at least one of text or object image input on the first content. method of application.
delete delete delete delete delete delete delete An object application device for VR content implemented as a computing device including one or more processors and one or more memories storing instructions executable by the processors,
When acquiring a plurality of images through a plurality of camera modules, a first content generator for generating first content by converting the obtained plurality of images into a single image;
When a first user input for adding an object image to the first content and a second user input for the size and insertion area of the object image are received in a state where the first content is created, the received first an image input unit configured to call the object image and determine a size and insertion area of the object image according to a user input and the second user input;
When the operation of the image input unit is completed, the object image of which the size and the insertion area are determined is converted into the second content, and the second content is converted into the second content by reflecting the curved shape of the first content, which is VR content. conversion unit; and
A third content generator configured to display the second content on the first content and generate third content;
The image input unit,
In order to automatically synthesize and display the second content in a preset area of the first content, edit the object image based on the second user input,
The preset area is
Including a background area of the first content,
The second content conversion unit,
Based on predetermined attribute information, converting the object image having the size and the insertion area determined into the second content,
The preset attribute information,
It is determined based on the curvature, F value, and angle of view of the first content.
The first content generator,
The plurality of acquired images are connected and pasted through a stitching technique to create the one VR content image,
The object image,
Including at least one of 3D images, 2D images and text,
The third content,
Can be transmitted to other electronic devices through the communication module,
The object application device of the VR content,
When a third user input is received from the other electronic device through the communication module, an action box for editing text or an object image input on the first content is called based on the received third user input, Outputting the called operation box through one area of the first content,
The working box,
An interface that provides a function including at least one of contrast adjustment, size adjustment, font change, effect application, and position change of at least one of text or object image input on the first content. object application device.
As a computer-readable recording medium,
The computer-readable recording medium stores instructions for causing a computing device to perform the following steps, which include;
When a plurality of images are acquired through a plurality of camera modules, a first content generation step of converting the acquired plurality of images into one VR content image and generating first content;
When a first user input for adding an object image to the first content and a second user input for the size and insertion area of the object image are received in a state where the first content is created, the received first an image input step of calling the object image and determining a size and insertion area of the object image according to a user input and the second user input;
Upon completion of the image input step, a second content conversion step of converting the object image whose size and the insertion area are determined into second content, and converting the object image into second content by reflecting the curved shape of the first content, which is VR content. ; and
A third content generation step of generating third content by displaying the second content on the first content; including,
The image input step,
In order to automatically synthesize and display the second content in a preset area of the first content, edit the object image based on the second user input,
The preset area is
Including a background area of the first content,
In the second content conversion step,
Based on preset attribute information, converting the object image having the size and the insertion area determined into the second content,
The preset attribute information,
It is determined based on the curvature, F value, and angle of view of the first content.
The first content creation step,
A plurality of images acquired through a stitching technique are connected and attached to create the one image for VR content,
The object image,
Including at least one of 3D images, 2D images and text,
The third content,
Can be transmitted to other electronic devices through the communication module,
How to apply objects to VR content,
When a third user input is received from the other electronic device through the communication module, an action box for editing text or an object image input on the first content is called based on the received third user input, Outputting the called operation box through one area of the first content,
The working box,
Characterized in that the interface provides a function including at least one of contrast adjustment, size adjustment, font change, effect application, and position change of at least one of text or object image input on the first content. A computer-readable recording medium.

Images