KR101652594B1 - Apparatus and method for providingaugmented reality contentents - Google Patents

Abstract

An apparatus and method for providing an augmented reality content are disclosed. The augmented reality reproduction apparatus according to an exemplary embodiment extracts feature points from an input image including a two-dimensional image painted by a user, compares the extracted feature points with feature information of a previously stored two-dimensional image to identify a two-dimensional image , And maps the colored two-dimensional image to the texture of the three-dimensional object corresponding to the identified two-dimensional image.

Description

[0001] APPARATUS AND METHOD FOR PROVIDING AUGMENTED REALITY CONTENTS [0002]

And an apparatus and method for providing the augmented reality contents.

Augmented Reality is one of the virtual reality that combines the real world that the user sees with the virtual world which has additional information and displays it as one image.

The marker-based Augmented Reality is a method of augmenting a virtual three-dimensional object on a marker added to an input image.

However, the marker-based augmented reality has a drawback that the color and texture of the three-dimensional object displayed on the display screen are fixed due to the enhancement of the virtual three-dimensional object using the three-dimensional object to which the pre-fabricated texture is mapped .

In order to solve the above-described problems, embodiments of the present invention provide an augmented reality image providing augmented reality contents including a three-dimensional object representing a texture of a material painted by a user using a two- Reproducing apparatus and method.

The apparatus for providing augmented reality contents according to one side includes model information of a three-dimensional object to which a texture is not mapped, feature information of a two-dimensional image corresponding to the three-dimensional object, mapping information between the three- An object information storage unit for storing the object information; An identification unit for extracting a feature point from an input image including a two-dimensional image painted by a user, comparing the extracted feature point with the feature information, and identifying a two-dimensional image corresponding to the two-dimensional image painted by the user; A texture mapping unit for mapping the colored two-dimensional image to a texture of a three-dimensional object corresponding to the identified two-dimensional image using the mapping information; And a content playback unit for displaying the augmented reality content including the texture-mapped 3D object.

The two-dimensional image may include two projections that project the three-dimensional object based on two directions opposite to each other in a three-dimensional space.

The feature information may include position information of feature points of the two-dimensional image corresponding to the three-dimensional object.

The identification unit may determine a relative coordinate of the extracted feature point from the input image, and compare the determined relative coordinate and the feature information to identify a two-dimensional image corresponding to the two-dimensional image colored by the user.

The texture mapping unit may match the two-dimensional image included in the input image with the two-dimensional image corresponding to the three-dimensional object, based on the comparison result.

The texture mapping unit may match the two-dimensional image included in the input image with the two-dimensional image corresponding to the three-dimensional object, using at least four reference points set based on the extracted feature points.

The content reproducing unit may display the augmented reality contents including the texture-mapped three-dimensional object together with the image input through the camera.

A method of providing augmented reality contents according to one side includes: receiving an input image including a two-dimensional image painted by a user; Extracting feature points from the input image; Comparing the extracted feature points with feature information of a previously stored two-dimensional image to identify a two-dimensional image corresponding to the colored two-dimensional image among the previously stored two-dimensional images; Mapping the colored two-dimensional image to a texture of the three-dimensional object using the identified two-dimensional image and mapping information between the three-dimensional object; And displaying the augmented reality contents including the texture-mapped three-dimensional object.

Wherein the identifying step comprises: determining relative coordinates of the minutiae extracted from the input image; And identifying the two-dimensional image corresponding to the two-dimensional image painted by the user by comparing the determined relative coordinates and the feature information.

The mapping may include matching the two-dimensional image included in the input image to a two-dimensional image corresponding to the three-dimensional object, based on the comparison result.

Wherein the mapping comprises: setting at least four reference points based on the feature points extracted from the input image; And matching the two-dimensional image included in the input image with the two-dimensional image corresponding to the three-dimensional object using the set at least four reference points.

By using a two-dimensional image directly painted by a user as a texture of a three-dimensional object, it is possible to apply a texture of the material painted by the user to the three-dimensional object or to easily change the texture of the three- And the reality of the augmented reality contents can be improved.

1 is a block diagram illustrating an apparatus for providing augmented reality contents according to an embodiment;
FIG. 2 illustrates a three-dimensional object according to an embodiment; FIG.
3 illustrates a two-dimensional image corresponding to a three-dimensional object according to one embodiment;
4 illustrates a two-dimensional image that is colored by a user according to an embodiment;
5 is a view illustrating an input image including a two-dimensional image painted by a user according to an exemplary embodiment.
6 is a diagram illustrating a reference point setting for determining relative coordinates of feature points according to an embodiment;
FIG. 7 illustrates a three-dimensional object represented on a display screen according to an exemplary embodiment; FIG.
8 is an operational flowchart illustrating a method of providing augmented reality contents according to an embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The forgery used throughout the specification of the present invention is defined in consideration of the functions of the embodiments of the present invention and is a matter that can be sufficiently modified according to the intentions and customs of the user or the operator. It should be based on the contents of. Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the term " part "in the specification means a unit for processing at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. The present invention is construed to cover such cases.

1 is a block diagram illustrating an apparatus for providing augmented reality contents according to an exemplary embodiment of the present invention.

The augmented reality contents providing apparatus 100 is for reproducing an image of a real world inputted through a camera on a display screen together with augmented reality contents and can be implemented as a configuration of a portable terminal having a camera and a display screen . At this time, the portable terminal may include, for example, a smart phone, a cellular phone, a PDA, a laptop computer, a tablet computer, and the like.

1, an apparatus for providing augmented reality contents 100 according to an exemplary embodiment includes an object information storage unit 110, an identification unit 120, a texture mapping unit 130, and a content playback unit 140 .

The object information storage unit 110 may store model information of a three-dimensional object, feature information of a two-dimensional image corresponding to the three-dimensional object, and mapping information between the three-dimensional object and the two-dimensional image.

According to one embodiment, the model information of the three-dimensional object can represent various objects such as an avatar, a person, an animal, a character, a structure, a tool, and a mount. The model information may include information representing the outline structure of the corresponding three-dimensional object stereoscopically. In this case, the model information may not include the texture information mapped on the external structure of the corresponding three-dimensional object. For example, a three-dimensional object may be an object to which the texture is not mapped.

For example, referring to FIG. 2, the model information may include stereoscopic information on the external structure of the cat character 210. At this time, the model information may not include texture information mapped on the external structure of the cat character 210.

The two-dimensional image corresponding to the three-dimensional object may include two projections based on two directions opposite to each other in the three-dimensional space. The first projection of the two projections may include contour lines that are visible when the three-dimensional object is viewed in the first direction on the three-dimensional space. In addition, the second projection of the two projections may include contour lines that are visible when the three-dimensional object is viewed in the second direction on the three-dimensional space. Here, the first direction and the second direction may be opposite to each other.

The two-dimensional image corresponding to the three-dimensional object may include a front view and a back view of the three-dimensional object. For example, referring to FIG. 3, a two-dimensional image 300 corresponding to a three-dimensional object may include a front view 310 and a back view 320 of the cat character 210 of FIG.

However, the projections included in the two-dimensional image are not necessarily limited to the front view and the rear view, but may include various projections generated based on directions opposite to each other in the three-dimensional space, such as the left shade and the right side.

In some cases, the two-dimensional image may include two or more projections. For example, a two-dimensional image may include a front view, a back view, a left view, and a right view.

The feature information may include information about feature points of the two-dimensional image corresponding to the three-dimensional object. In one example, the feature information may be information on the coordinates of the feature points of the two-dimensional image on the XY plane. As another example, the feature information may be information on the relative coordinates between the feature points of the two-dimensional image on the XY plane. The relative coordinates between the feature points of the two-dimensional image on the XY plane can be expressed in the UV coordinate system.

According to an exemplary embodiment, the feature points of the two-dimensional image corresponding to the three-dimensional object may be set in a process of projecting the three-dimensional object into the two-dimensional image. For example, the model information of the three-dimensional object may include three-dimensional feature points of the three-dimensional object. In this case, the points where the corresponding three-dimensional minutiae are projected in the two-dimensional image may be set as minutiae.

Alternatively, the feature points of the two-dimensional image corresponding to the three-dimensional object can be set by analyzing the two-dimensional image. For example, feature points can be set along the edges of a two-dimensional image.

On the other hand, the mapping information between the three-dimensional object and the corresponding two-dimensional image is information for mapping the two-dimensional image corresponding to the three-dimensional object. For example, the mapping information may be information that maps points included in the three-dimensional object and points included in the two-dimensional image. The points included in the three-dimensional object are located on the surface of the three-dimensional object, and the points included in the two-dimensional image can be positioned on the edge of the two-dimensional image.

Alternatively, the mapping information may be a line included in the three-dimensional object and information for mapping a line included in the two-dimensional image. The lines contained in the three-dimensional object are located on the surface of the object, and the lines included in the two-dimensional image may be at least a part of the edges of the two-dimensional image.

Alternatively, the mapping information may be information that maps an area included in the three-dimensional object and an area included in the two-dimensional image. The area included in the 3D object is located on the surface of the object, and the area included in the 2D image can be located inside the edges of the 2D image.

For example, the mapping information may be information for mapping the coordinates on the three-dimensional space of the vertices of the polygon constituting the three-dimensional object and the coordinates of the plane of the minutiae points of the two-dimensional image.

The feature points of the two-dimensional image may have relative coordinate values using the UV coordinate plane. Each of the vertices of the three-dimensional object may have a coordinate value in the three-dimensional space and a UV coordinate value of the feature point on the two- Lt; / RTI >

The identification unit 120 receives an input image including a two-dimensional image colored by a user. The input image can be generated by various vision sensors such as cameras. The identification unit 120 may receive an input image generated by various vision sensors such as a camera.

The two-dimensional image painted by the user may be an image directly painted by the user in a figure corresponding to the two-dimensional image stored in the object information storage unit 110. [ For example, referring to FIG. 4, a user may directly paint the same image as the two-dimensional image 300 of FIG. Then, when a picture painted by the user is photographed by the camera, the input image includes a two-dimensional image 400 colored by the user.

The identification unit 120 extracts feature points from the input image. The identification unit 120 may extract the feature point based on the pixel value of the input image. For example, the identifying unit 120 may recognize a pixel having a significant saturation change in an input image and extract the pixel as a minutia. The saturation change can be calculated using a monochrome image. When the feature points are extracted according to the chroma change, the identification unit 120 extracts the feature points using the monochrome image, so that the computational complexity can be reduced.

However, the method of extracting minutiae points is not necessarily limited thereto. For example, the identifying unit 120 may extract the feature point using the color change of the pixel instead of the saturation change of the pixel. Alternatively, the identification unit 120 may extract the feature point using the brightness change of the pixel. Alternatively, the identification unit 120 may extract feature points using at least two combinations of saturation change, hue change, and brightness change.

The identification unit 120 may compare the extracted feature points with the feature information stored in the object information storage unit 110 to identify a two-dimensional image corresponding to the two-dimensional image painted by the user.

For example, the object information storage unit 110 may store feature information of two-dimensional images corresponding to a plurality of three-dimensional objects. The identifying unit 120 can identify the two-dimensional image corresponding to the two-dimensional image painted by the user by detecting the feature information that best matches the extracted feature points.

At this time, since the colorized two-dimensional image of the input image has the same outline as any two-dimensional image stored in the object information storage unit 110, the feature point of the two-dimensional image stored in the object information storage unit 110 The same or similar feature points can be extracted. Thus, the identification unit 120 can identify a two-dimensional image corresponding to a two-dimensional image that is colored by the user.

According to one embodiment, the identification unit 120 determines whether the relative position values of the feature points extracted from the input image are the same as the relative position values of the feature points of the two-dimensional image stored in the object information storage unit 110, Dimensional image corresponding to the two-dimensional image.

For example, referring to FIG. 5, a user can take a two-dimensional image, which is painted using the augmented reality contents providing apparatus 100, such as the tablet computer 510. As will be described in detail below, the identification unit 120 can determine whether the image entering the field of view of the camera satisfies a predetermined condition. The predetermined condition may be a criterion for judging whether or not a sufficient input image has been received to texture the three-dimensional object. For example, when a two-dimensional image painted by a user is photographed within a predetermined angular range and within a predetermined distance range, it can be determined that an input image sufficient to texture the three-dimensional object has been received.

When the predetermined condition is satisfied, the augmented reality contents providing apparatus 100 can notify the user that it is possible to take a picture. For example, the augmented reality content providing apparatus 100 may display an area including a colored two-dimensional image displayed on the screen in blue. Alternatively, the augmented reality content providing apparatus 100 may vibrate or output a sound effect. Alternatively, when the predetermined condition is satisfied, the augmented reality contents providing apparatus 100 may automatically perform the shooting.

At this time, the user may not photograph the colored two-dimensional image from the front. For example, the two-dimensional image 400 painted by the user of FIG. 4 may be taken obliquely and even taken upside down. In addition, the two-dimensional image 400 painted by the user may be photographed from a distance, and may be photographed close.

The two-dimensional image included in the input image is changed according to the conditions under which the two-dimensional image 400 painted by the user is photographed. Accordingly, the identification unit 120 compares the relative position values of the feature points extracted from the input image with the relative position values of the feature points of the two-dimensional image stored in the object information storage unit 110, thereby obtaining a two- 400) corresponding to the two-dimensional image.

For example, the discrimination unit 120 may fix the feature points extracted from the input image and determine the coincidence between the two contours while rotating the feature points of the two-dimensional image stored in the object information storage unit 110. In contrast, the discrimination unit 120 can fix the feature points of the two-dimensional image stored in the object information storage unit 110 and determine whether the two contours are coincident by rotating the feature points extracted from the input image.

The texture mapping unit 130 maps the colored two-dimensional image to a texture of a three-dimensional object corresponding to the two-dimensional image identified by the identification unit 120 using the mapping information stored in the object information storage unit 110 can do.

According to one embodiment, the texture mapping unit 130 may convert the two-dimensional image included in the input image into a two-dimensional image corresponding to the three-dimensional object based on the comparison result of the identification unit 120 Can be matched. For example, the texture mapping unit 130 may classify a two-dimensional image included in an input image into a three-dimensional object based on a correspondence between feature points extracted from the input image and feature information of the two- Dimensional image corresponding to the two-dimensional image.

Referring to FIG. 6, the texture mapping unit 130 may set four reference points 610, 620, 630, and 640 on the outline of a two-dimensional image that is colored in the input image. In some cases, the texture mapping unit 130 may further configure four reference points 615, 625, 635, and 645 between the four reference points 610, 620, 630, and 640.

For example, the texture mapping unit 130 may set a rectangular area including feature points extracted from the input image, and set four vertexes of the set area as four reference points. The texture mapping unit 130 may detect the outermost feature points among the feature points extracted from the input image. The outermost feature points may be feature points located at the outermost out of the extracted feature points. The texture mapping unit 130 can set a rectangular region so that each side of the rectangle is located at a position spaced apart from the outermost feature points by a predetermined distance and direction.

At this time, the four reference points can be set reflecting the environment in which the colored two-dimensional image is captured. For example, when a colored two-dimensional image is photographed from the front, four reference points may be set at positions corresponding to vertices of a square or a rectangle. On the other hand, when the colored two-dimensional image is obliquely photographed, the four reference points can be set to positions corresponding to the vertices of the twisted rectangle.

The texture mapping unit 130 may match the two-dimensional image included in the input image to the two-dimensional image corresponding to the three-dimensional object using at least four reference points set.

For example, the texture mapping unit 130 can obtain relative coordinates on the UV coordinate plane for each extracted feature point using the set reference points. 6, the coordinate of the first reference point 610 in the UV coordinate plane is (0.0,0.0), the coordinate of the second reference point 620 is (1.0,0.0), and the coordinates of the third reference point 630 (0.0, 1.0), and the coordinates of the fourth reference point 640 may be (1.0, 1.0).

6, the first reference point 610, the second reference point 620, the third reference point 630, and the fourth reference point 640 are set at positions corresponding to the vertices of the rectangle. However, The first reference point 610, the second reference point 620, the third reference point 630, and the fourth reference point 640 are positioned at positions corresponding to the vertices of the squared rectangle depending on the environment in which the two- Can be set.

According to the UV coordinate plane, the first reference point 610, the second reference point 620, the third reference point 630, and the fourth reference point 640 are set at positions corresponding to the vertices of the rectangle, The coordinates of the first reference point 610, the second reference point 620, the third reference point 630, and the fourth reference point 640 are set to (0.0, 0.0), (1.0, 0.0), (0.0, 1.0), and (1.0, 1.0).

Accordingly, the coordinates of each of the minutiae extracted from the input image are determined according to the relative positions from the first reference point 610, the second reference point 620, the third reference point 630, and the fourth reference point 640.

The texture mapping unit 130 calculates the coordinates of each of the minutiae points in the UV coordinate plane and then outputs the first reference point 610, the second reference point 620, the third reference point 630, The fourth reference point 640 may be adjusted to match the two-dimensional image corresponding to the three-dimensional object. As described above, the texture mapping unit 130 may match the two-dimensional image included in the input image with the two-dimensional image corresponding to the three-dimensional object.

The texture mapping unit 130 may map the colored two-dimensional image to a texture of the three-dimensional object using the mapping information. Since the mapping information is information for mapping the two-dimensional image corresponding to the three-dimensional object, and the two-dimensional image is matched with the two-dimensional image, the texture mapping unit 130 converts the color information of the two- Can be applied to the mapping position of the three-dimensional object.

Accordingly, the texture mapping unit 130 can perform texture mapping of a three-dimensional object without performing a rendering operation.

Meanwhile, in the example shown in FIG. 6, eight reference points are set, but the number of reference points is not limited to the illustrated example, and a plurality of reference points may be set to obtain the relative coordinates of the feature points.

The content reproducing unit 140 may display the augmented reality contents including the three-dimensional object to which the texture is mapped by the texture mapping unit 130. At this time, the content reproduction unit 140 may display the augmented reality contents including the texture-mapped three-dimensional object together with the image input through the camera.

7, the content reproducing unit 140 may display the augmented reality contents such that the three-dimensional object is changed according to the distance and direction between the two-dimensional image, which is colored based on the coordinate system of the minutiae points extracted from the input image, can do. In addition, according to an exemplary embodiment, the three-dimensional object displayed by the content playback unit 140 may be implemented as a moving animation, or may be implemented with sound or the like.

The content reproducing unit 140 may position the three-dimensional object at (0, 0, 0) in the world coordinate system. For example, the content reproduction unit 140 may make the center of at least four reference points be located at (0, 0, 0) in the world coordinate system.

The content reproduction unit 140 may display a three-dimensional object using a screen coordinate system. For example, the screen coordinate system changes when the position of the camera that shoots a colored two-dimensional image moves. The content reproducing unit 140 may generate an image representing a three-dimensional object positioned at (0, 0, 0) in the world coordinate system at the time of the screen coordinate system, and may apply the image as a texture of the three-dimensional object.

8 is an operation flowchart illustrating a method of providing an augmented reality contents according to an embodiment. Referring to FIG. 8, the augmented reality contents providing apparatus 100 receives an input image including a two-dimensional image painted by a user through a vision sensor such as a camera (operation 810). Then, the augmented reality contents providing apparatus 100 extracts feature points from the input image (820).

After that, the augmented reality contents providing apparatus 100 compares the extracted feature points with feature information of a previously stored two-dimensional image to identify a two-dimensional image corresponding to the two-dimensional image, which has been stored in advance.

According to an exemplary embodiment, the feature information may be position information of feature points of a previously stored two-dimensional image, and the augmented reality content providing apparatus 100 may compare position information of feature points extracted from the input image with feature information, Dimensional image corresponding to the colored two-dimensional image can be identified.

The augmented reality contents providing apparatus 100 can determine the relative coordinates of the minutiae extracted from the input image and compare the determined relative coordinates and the feature information to identify the two-dimensional image corresponding to the two-dimensional image painted by the user .

When the two-dimensional image corresponding to the two-dimensional image is identified, the augmented reality contents providing apparatus 100 uses the mapping information between the identified two-dimensional image and the three-dimensional object, The colored two-dimensional image is mapped to a texture of the three-dimensional object (840).

According to an exemplary embodiment, the augmented reality contents providing apparatus 100 may set at least four reference points based on the extracted feature points, and generate a two-dimensional image Dimensional image corresponding to the three-dimensional object.

After that, the augmented reality contents providing apparatus 100 can display the augmented reality contents including the three-dimensional objects mapped with the texture together with the images input through the camera (operation 850).

According to embodiments, by using a two-dimensional image directly painted by a user as a texture of a three-dimensional object, it is possible to apply a texture of a material painted by a user to a three-dimensional object or to easily change the texture of the three- It is possible to provide a variety of augmented reality contents desired by the user and improve the real feeling of the augmented reality contents.

The embodiments described above may be implemented in hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, such as an array, a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the preferred embodiments of the present invention have been disclosed for illustrative purposes, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced. Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: augmented reality contents providing device
110: Object information storage unit
120: Identification unit
130: texture mapping unit
140:

Claims (12)

An object information storage unit for storing model information of a three-dimensional object to which a texture is not mapped, feature information of a two-dimensional image corresponding to the three-dimensional object, and mapping information between the three-dimensional object and the two-dimensional image;
An identification unit for extracting a feature point from an input image including a two-dimensional image painted by a user, comparing the extracted feature point with the feature information, and identifying a two-dimensional image corresponding to the two-dimensional image painted by the user;
A texture mapping unit for mapping the colored two-dimensional image to a texture of a three-dimensional object corresponding to the identified two-dimensional image using the mapping information; And
A content reproduction unit for displaying the augmented reality contents including the 3D object mapped with the texture,
Including the
The identification unit
Dimensional image corresponding to the two-dimensional image painted by the user by determining the relative coordinates of the minutiae extracted from the input image, and comparing the determined relative coordinates and the feature information, .
The method according to claim 1,
The corresponding two-dimensional image
And two projections that project the three-dimensional object based on two directions opposite to each other in a three-dimensional space.
The method according to claim 1,
The feature information
Dimensional object, and position information of the feature points of the two-dimensional image corresponding to the three-dimensional object.
delete The method according to claim 1,
The texture mapping unit
And matches the two-dimensional image included in the input image to a two-dimensional image corresponding to the three-dimensional object, based on the comparison result.
The method according to claim 1,
The texture mapping unit
Dimensional image corresponding to the three-dimensional object by using at least four reference points set based on the feature points extracted from the input image, the two-dimensional image included in the input image.
The method according to claim 1,
The content reproducing unit
And displays the augmented reality contents including the texture-mapped three-dimensional objects together with the images input through the camera.
Receiving an input image including a two-dimensional image painted by a user;
Extracting feature points from the input image;
Comparing the extracted feature points with feature information of a previously stored two-dimensional image to identify a two-dimensional image corresponding to the colored two-dimensional image among the previously stored two-dimensional images;
Mapping the colored two-dimensional image to a texture of the three-dimensional object using the identified two-dimensional image and mapping information between the three-dimensional object; And
Displaying the augmented reality contents including the texture-mapped three-dimensional object
Lt; / RTI >
The step of identifying
Determining relative coordinates of the minutiae extracted from the input image; And
Identifying the two-dimensional image corresponding to the two-dimensional image painted by the user by comparing the determined relative coordinates and the feature information
And a second step of generating the augmented reality contents.
delete 9. The method of claim 8,
The mapping step
Matching the two-dimensional image included in the input image with a two-dimensional image corresponding to the three-dimensional object based on the comparison result
And generating the augmented reality contents.
9. The method of claim 8,
The mapping step
Setting at least four reference points based on the feature points extracted from the input image; And
Matching the two-dimensional image included in the input image with the two-dimensional image corresponding to the three-dimensional object using the set at least four reference points
And generating the augmented reality contents.
11. A computer program stored in a medium for executing the method of any one of claims 8, 10 and 11 in combination with hardware.

Images