KR20190051779A - Augmented Reality System And Method Of The Same - Google Patents

Abstract

The present invention relates to an augmented reality system and a realizing method thereof which can promote an education effect and an interest development effect by realizing a 3D image to realize augmented reality on a display unit as well as recognizing a puzzle piece in which a specific image is displayed with a terminal having a photographing unit and displaying an image photographed by the photographing unit through the display unit.

Description

Augmented Reality System And Method Of The Same < RTI ID = 0.0 >

The present invention relates to an augmented reality system and an implementation method. More specifically, the present invention recognizes a puzzle piece having a specific image as a terminal having a photographing unit, displays an image photographed through the photographing unit through a display unit, and implements a 3D image for displaying an augmented reality on a display unit, An educational effect, an interest enhancement effect, and an implementation method thereof.

In recent years, a variety of books or puzzle cards were used to educate users by visualizing objects or using various displayed images. In addition, among the materials such as the book or the puzzle card, puzzles are used, and an educational method in which infants and children can actively participate in learning based on their imagination, reasoning and logic can be found.

As a result, infants and children were able to learn naturally while experiencing interest through various books or puzzle cards, as well as being able to acquire amusement, creativity, profitability and observation ability simultaneously in the learning process.

However, since the objects are displayed on materials such as books or puzzle cards, there is a problem that the users can not recognize accurate 3D shapes and sounds of the objects. In addition, since objects displayed on materials such as books or puzzle cards do not move, users who have not actually touched the objects have a limitation in accurately recognizing the characteristics of the objects.

In addition, there is a limit in that users need to be guided by a protector or an educator in order to learn from materials such as books or puzzle cards.

On the other hand, Augmented Reality technology has appeared in recent years. Augmented Reality is a field of Virtual Reality that is a computer graphics technique that creates virtual objects in real environments and makes them look like objects in the original environment. The augmented reality has a characteristic that it can reinforce and provide additional information that is difficult to obtain only in the real world by synthesizing a virtual object on the basis of the real world, unlike the existing virtual reality which only deals with a virtual space and objects.

For example, a virtual reality technology generally allows a user to immerse in a virtual environment, so that a user can not see a real environment. On the other hand, augmented reality technology allows a user to view a real environment, .

In other words, although virtual reality replaces the real world and shows it to the user, the augmented reality differs from the real world by superimposing the virtual world by superimposing it on the real world and displaying it to the user. . Because of this feature, unlike existing virtual reality, which can be applied only to fields such as games, it can be applied to various real environments. Especially, it is attracting attention as next generation display technology suitable for ubiquitous environment.

Despite the emergence of Augmented Reality technology, no technology or idea has been introduced to link the augmented reality with the data of a child or child's book or puzzle card.

The present invention recognizes a puzzle piece in which a specific image is displayed as a terminal having a photographing unit, displays an image photographed through the photographing unit through a display unit, and implements a 3D image for representing an augmented reality on a display unit, And a method of implementing the same.

According to an aspect of the present invention, there is provided an image processing apparatus including a memory unit capable of storing an image, a photographing unit capable of photographing an image, a display unit capable of displaying an image, and a controller for controlling the photographing unit, The method comprising the steps of: photographing an image through the photographing unit; and checking whether the image photographed in the photographing step matches an identification image stored in the memory unit, And displaying the augmented reality image, which is matched with the identification image and stored in the memory unit, through the display unit when the identification image matches the photographed image in the identification image comparison step, ; ≪ / RTI >

In order to solve the above-described problems, the present invention provides a method of implementing an augmented reality, wherein the augmented reality image displayed in the augmenting reality implementation step is a 3D video.

In order to solve the above-described problems, the present invention provides a method for implementing an augmented reality, wherein the augmented reality image displayed in the augmenting reality implementation step includes sound.

In order to solve the above-described problems, the present invention provides a method of implementing an augmented reality, wherein an object to be imaged in the imaging step is an image or an image displayed on an image plate.

According to the present invention, in order to solve the above-described problems, the memory unit stores a plurality of identification images and an augmented reality image matching each of the identification images, and the identification image comparison step displays the augmented reality images And comparing the image with a plurality of identification images.

In order to solve the above-described problems, the present invention provides a method for implementing an augmented reality, wherein an augmented reality image displayed at the augmenting reality implementation step includes an indication of an object name displayed as an augmented reality image.

In order to solve the above-described problems, the present invention provides a method for implementing an augmented reality, wherein the sound included in the augmented reality image displayed in the augmented reality implementation step includes a pronunciation of the name of the augmented reality.

In order to solve the above-described problems, the present invention provides an augmented reality realizing method, wherein the augmented reality image is displayed for a predetermined period of time on the display unit and then moved to the outside of the display unit.

According to the present invention, in order to solve the above-mentioned problems, the display unit is provided with a touch panel, and the movement direction of the augmented reality image matches with the direction of the slide touch input inputted through the display unit while the augmented reality image is displayed To provide a method for realizing an augmented reality.

According to the present invention, in order to solve the above-described problems, an image taken in the image taking step is displayed on the display unit in real time, and the identification image comparing step is performed simultaneously with the image taking step. ≪ / RTI >

In order to solve the above-described problems, the present invention provides an augmented reality method, wherein an image photographed in the image photographing step is displayed in real time on the display unit, and the augmenting reality implementing step is performed simultaneously with the image photographing step ≪ / RTI >

In order to solve the above-described problems, the present invention provides a method for realizing an augmented reality in which the augmented reality image is superimposed on an upper part of an image photographed in the image taking step displayed on the display unit, .

In order to solve the above-described problems, the present invention provides a method for implementing an augmented reality, wherein the identification image compared in the identification image comparison step is a still image (still image).

In order to solve the above-described problems, the identification image comparison step determines whether a still image at a specific moment of an image photographed in the image photographing step is the same as the identification image, .

In order to solve the above-described problems, the present invention is characterized in that the step of implementing the augmented reality is subdivided into a plurality of steps, and a step excluding a first step of the plurality of steps is implemented by touch input on the display unit .

In order to solve the above problems, the present invention includes a terminal equipped with an app for an augmented reality implementation method, and a card or a puzzle card for an education or game in which an image photographed by a photographing part of the terminal is displayed An augmented reality system can be provided.

According to the augmented reality system and its implementation method of the present invention, a puzzle piece having a specific image is recognized as a terminal having a photographing unit, an image photographed through the photographing unit is displayed through a display unit, The 3D image can be implemented, and the education effect and the interest enhancement effect can be achieved.

According to the augmented reality system and its implementation method according to the present invention, an augmented reality implementation method capable of learning information and characteristics of an accurate object to a user by linking augmented reality with data such as a book or a puzzle card Can be provided.

The present invention provides an augmented reality implementation method that extends learning contents described in materials such as a book or a puzzle card to augmented reality technology so that the user can transmit sound and image information in various ways in addition to the still image.

The present invention can provide an augmented reality implementation method that can accurately learn the name and basic shape of objects displayed on materials such as books or puzzle cards using the augmented reality.

The present invention has an effect of providing an augmented reality realizing method for educational purpose which can recognize a 3D shape, texture, and motion characteristics of an object using an augmented reality.

The present invention can provide an augmented reality realizing method that enables a user to become an active learning subject himself / herself without the help of a third person by using an augmented reality, thereby improving independence and subjectivity.

The present invention has an effect of providing an augmented reality system capable of continuously updating learning contents by updating contents of materials such as books or puzzle cards to the augmented reality technology.

1 shows a configuration of an augmented reality system according to the present invention.
2 shows a configuration of a terminal of an augmented reality system according to the present invention.
FIG. 3 shows an embodiment of a method for implementing an augmented reality in the AR system of the present invention.
4 shows a further embodiment of a method of implementing an augmented reality according to the present invention.
FIG. 5 illustrates a structure in which augmented reality system of the present invention realizes a plurality of augmented reality systems.
6 shows an embodiment in which the augmented reality system of the present invention realizes a plurality of augmented reality systems.
FIG. 7 illustrates an embodiment in which an augmented reality system according to the present invention realizes an augmented reality that can be varied in size.
FIG. 8 shows an algorithm of a method for implementing an augmented reality in the AR system of the present invention.
FIG. 9 illustrates an example of a process of implementing an augmented reality according to an augmented reality implementation method of the augmented reality system of the present invention.
10 shows an example of a puzzle card package constituting an augmented reality system according to the present invention.

Hereinafter, embodiments disclosed in this specification will be described in detail with reference to the accompanying drawings. In this specification, the same or similar reference numerals are given to the same or similar components in different embodiments, and the description thereof is replaced with the first explanation. As used herein, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.

FIG. 1 shows a basic configuration of an AR system 1 according to the present invention, and FIG. 2 shows a basic structure of a terminal 200 capable of implementing the AR.

An image enhancement system 1 according to the present invention includes an image plate 100 on which an object or an object is displayed, an image of the image plate 100 to display an image of the image plate 100, And a terminal 200 capable of reproducing a real image. In the example shown in Fig. 1, the image recognizable in the terminal 200 is described in the form displayed on the image plate 100, but is not limited thereto.

That is, the image that can be recognized by the terminal 200 may be an image displayed on a separate display device, an object or object itself having a three-dimensional shape (3D shape), or an encrypted image such as a QR code or a barcode It may be an image.

The image recognizable by the terminal 200 of the augmented reality system according to the present invention and the method of implementing the present invention may be used as an image plate 100 (for example, a game card, a training card or a game or educational purpose puzzle card) As shown in FIG.

Particularly, when the image plate 100 is composed of a puzzle card and the user is a child or an infant, active efforts can be made to match puzzles in order to appreciate the augmented reality implemented through the terminal, And the like.

The image plate 100 may be a sheet of paper, plywood, film, or the like capable of displaying a 2D image. The image plate 100 may be formed of a set of puzzle pieces for active participation and enjoyment of users.

The image plate 100 includes an image 110 indicating a specific object, a frame 120 provided at an edge of the image 110 to set a boundary of the image plate 100, And a name display unit 130 that can display the name of the image display unit 110, the name of the image display unit 100, and the like.

The image plate 100 may include a plurality of images, and each image plate 100 may display another image 110.

1 comprises a first image plate 101, a second image plate 102, a third image plate 103, a fourth image plate 104, and a fifth image plate 105 And the first image 111, the second image 112, the third image 113, the fourth image 114, and the fifth image 115 may be displayed on the respective image plates.

The object of the image 110 may be an object that can move because of its inherent characteristics. That is, the image 110 may be identified as an object, and may be displayed as anything having a name.

For example, the objects of the first image 111 to the fifth image 115 may correspond to a police car, a tiger, a cat, a helicopter, and a crane, respectively.

The image displayed on the image plate 100 may be an object of implementation of the augmented reality through the terminal 200 described later but may be used as a book or a puzzle card for a user, It is not excluded.

The terminal 200 includes a body 210 constituting a main body, a photographing unit 230 photographing the image plate 100 by external photographing, A display unit 220 and an input unit 240 to which a control input necessary for the terminal 200 can be added.

The photographing unit 230 may include a front photographing unit 231 provided on the front surface of the terminal 200 and a rear photographing unit 232 disposed on the rear surface of the terminal 200, 100 are preferably photographed by the rear photographing unit 232 but not by the front photographing unit 231.

2, the terminal 200 includes a memory unit 260 storing an identification image related to an image displayed on the plurality of image plates 100 and a plurality of augmented reality images corresponding to respective identification images, And a control unit 250 for controlling the memory unit 260 and the display unit 220. The control unit 250 may update the augmented reality image or update an identification image, And a communication module 270 capable of connecting or communicating with the mobile communication terminal.

The terminal 200 including the controller 250 may be configured to be capable of implementing an augmented reality technology. The terminal 200 includes a technique for identifying or identifying an identification image or an identification image associated with the image 110 or the image displayed on the image plate 100 input to the mounted photographing unit 230, Dimensional position recognition (3D registration) technique for recognizing the three-dimensional position of the image plate 110 or the three-dimensional position of the image plate 110 can be realized.

For example, the memory unit 260 may store not only an augmented reality image but also an image displayed on the image plate 100 'photographed by the photographing unit 230 or a plurality of identification images or identification images for identifying the image .

The identification image may be an image displayed on the image plate 100 'and an image related to a still image or a 2D image of the image. When the photographing unit 230 photographs the image plate 100 ', the control unit 250 can determine whether the image photographed by the photographing unit 230 matches an identification image or an identification image. Here, the identification image may be a still image, and may be performed by a method of determining the identity of a still image at a specific moment of an image photographed through the photographing unit 230, but various comparison methods may be employed.

The control unit 250 may determine an augmented reality image corresponding to the identification image if the controller 230 determines an identical or corresponding image among the image captured by the photographing unit 230 and the plurality of identification images.

Whether the identification image matches with the image photographed by the photographing unit 230 or not can be determined by comparing the entire images but by determining the identity of an image at a specific moment of the photographed image, Or the feature values can be compared / collated.

The contour or feature value may correspond to an outline, a line width, a texture, a pattern, or the like, which can identify the image 110 displayed on the image plate 100 or the like even if only a part thereof is determined.

Accordingly, even if the photographing unit 230 photographs only a part of the image plate 100, it can be immediately compared with the corresponding identification image, and the corresponding augmented reality image can be determined.

In addition, the control unit 250 may include at least one calculation unit for recognizing the image 110 and matching the augmented reality image 300 corresponding thereto.

For example, in order to match the augmented reality image 300 with the image 110, the control unit 250 of the terminal of the present invention extracts an area 110 of the image 110 displayed on the image plate 100 or the like from the acquired image An image feature value extracting means for extracting a feature value corresponding to an important portion of the image 110 of the extracted region, an identification information calculation means for calculating identification information for searching for the feature value of the image, A matching video searching means for searching for a video file stored in the memory 260 in a matching manner with the searching identification information, and a display control means for playing back the searched video in place of the image in the image region and displaying the video .

As described above, the feature value of the image 110 may correspond to an outline, a line width, a texture, a pattern, or the like that can identify the image 110 displayed on the image plate 100 or the like even if only a part of the feature value is determined.

For example, the feature value may be an operation value that can be calculated by a formula such as an automobile wheel, a propeller of a helicopter, a hair pattern of a tiger, or the like, an outline of the image, an area of the image, have.

The control unit 250 may further include a three-dimensional posture calculation unit that calculates a three-dimensional posture of the image area from the image image 110 'acquired by the photographing unit 230. [ That is, when the augmented reality image is provided in 3D, the controller 250 can determine the angle and direction of the 3D image to be displayed on the display unit 220 by the 3D posture calculation unit.

 The display control means may be configured to display the determined augmented reality image on the display unit 220 by reflecting the three-dimensional posture calculated by the three-dimensional attitude calculation means.

The control unit 250 identifies the type of the image 110 through the pattern of the frame 120 and the QR code and barcode information of the image plate 110 to correspond to the augmented reality image 300 .

That is, the control unit 250 identifies the image 110 and searches for and reproduces the augmented reality image 300 corresponding to the identified image 110, The controller 250 and the calculation process may be configured in any configuration as long as it is possible to identify the augmented reality image 300 and to implement the augmented reality image 300 corresponding thereto.

The AR system 1 of the present invention uses the terminal 200 and can be implemented by combining identification technology and 3D location recognition technology.

Hereinafter, an augmented reality system 1 capable of realizing an augmented reality by linking the terminal 200 and the image plate 100 will be described with reference to Figs. 3 and 4. Fig.

The terminal 200 of the augmented reality system 1 of the present invention may include the controller 250 for matching the image 110 displayed on the image plate 100 with an identification image to determine the image 110, The identification image and the augmented reality image 300 matching the image 110 may be matched and stored.

The augmented reality image 300 may be a moving image including at least one of 3D video, name display, sound, and pronunciation corresponding to the photographed image 100 '.

That is, when the photographed image 100 'corresponds to the image 111' of the first image, the augmented reality image 300 includes the 3D shape, the name, the basic 3D motion, and the sound of the first image 300 can do. The memory unit 260 may store a plurality of the augmented reality images 300 corresponding to a plurality of the images 110 in a matching manner.

FIG. 3 shows the image of the first image plate 101 taken by the terminal 200. FIG.

3 (a), a user having the terminal 200 can photograph one or more image plates 100 of the plurality of image plates 100 with the photographing unit 230. When the first image 111 is photographed by the photographing unit 230, the photographed image or image 111 'is displayed on the display unit 220 as it is. When the first image 111 corresponds to a police car, the first image plate 101 and the first image 111 may be displayed in a state 101 'in which the first image 111 is photographed.

At this time, the control unit 250 calculates identification information by comparing the images of the first image with images of the first image (111 '), for example, Thereby identifying the image 111. The controller 250 then selects the augmented reality images 310 corresponding to the first image 111 among the plurality of augmented reality images stored in the memory unit 260.

3B, when the controller 250 selects the augmented reality image 310 corresponding to the first image 111, the selected augmented reality image 310 is displayed on the display unit 220 ).

The selected augmented reality image 310 includes a 3D image 311 of the first image 111, a subtitle 312 of the first image 111, and an object corresponding to the first image 111 Or the sound to be played.

The 3D image 311 includes an image in which an object corresponding to the first image 111 is moved. For example, if the first image 111 is a police car, the wheel of the police car may be moving, or the warning light may be repeatedly turned on / off.

The name 312 may be a national language, such as a police car, or may be a foreign language such as POLICE CAR. The sound may correspond to sirens, engine sounds, and the like of the police car.

As a result, the owner of the terminal 200 can obtain various information on how the first image 111 is actually formed, how it moves, and what kind of sound it can make.

The augmented reality image 310 corresponding to the first image 111 may be superimposed on the image 111 'displayed on the display unit 220. That is, the augmented reality image 310 can transmit a feeling that the displayed or reproduced image 111 'is momentarily converted into 3D on the display unit 220 to the owner of the terminal 200.

When the first image 111 displayed on the display unit 220 moves on the display unit 220, the 3D image 310 also moves on the display unit 220 along the first image 111 .

FIG. 4 illustrates a modified embodiment of the augmented reality image 300 implemented in the display unit 220. Referring to FIG.

The augmented reality image 300 displayed on the display unit 220 is continuously displayed on the display unit 220 when there is an input from the user or until the first image 111 disappears from the display unit 220 .

Referring to FIG. 4A, a holder of the terminal 200 can touch and input the display unit 220. For example, the holder can touch input the augmented reality image 300 displayed on the display unit 220.

Referring to FIG. 4B, when the area of the display unit 220 on which the augmented reality image 300 is displayed is touched, the augmented reality image 300 is moved from the display unit 220 to the outside May disappear from the display unit 220.

Thus, the owner can not only understand the way in which the object corresponding to the first image 111 moves but also can continuously feel the interest and can be guided to take the next image 110.

If the first image 111 disappears on the display unit 220 after the holder moves the photographing position of the terminal 200, the augmented reality image 310 is displayed on the outside of the display unit 220 The display unit 220 may be removed.

At this time, it is preferable that only the region in which the augmented reality image 300 is displayed disappears so that the augmented reality image 300 disappears. However, if the display unit 220 is touched for smooth reproduction and next learning, The augmented reality image may disappear.

Also, when a predetermined time has elapsed, the augmented reality image 300 may disappear from the display unit 220, and may move away from the display unit 220 and disappear.

At this time, the AR system 1 of the present invention allows a holder to perform a slide touch input on the display unit 220 in a slide manner, and the AR image 300 disappears or moves in the display unit 220 May be configured to coincide with the direction of the slide touch input.

FIG. 5 illustrates an embodiment of an augmented reality system according to the present invention in which an augmented reality image is reproduced when the terminal 200 photographs a plurality of image plates 100. FIG. A plurality of image plates 100 may be photographed and displayed on the display unit 220 according to an image capturing area when a plurality of image plates 100 are disposed on a floor or a desk.

The display unit 220 includes a language selection key 360 for a pronunciation included in the augmented reality 3D image, a display capture unit 360 for superimposing the augmented reality 3D image displayed on the display unit 220 and the image captured by the camera, Button 370 and a camera selection button 380 for selecting a plurality of cameras (front or rear cameras).

Also in this case, the AR system 1 of the present invention can systematically reproduce the augmented reality image, thereby preventing the holder from learning and matching images and images.

For example, the terminal 200 may photograph the second image plate 102, the fourth image plate 104, and the fifth image plate 105. The size of the image 104 'of the fourth transparent plate, the image 102' of the second image plate, and the image 105 'of the fifth transparent plate may be different from each other depending on the photographing angle of the display unit 220 .

As shown in the figure, the image 104 'of the fourth image plate can be displayed at the largest size on the display unit 220 and the image 102' of the second image plate and the image 105 ' ') Can be partially displayed.

6, when an image of the image plate 100 'is displayed on the display unit 220, the controller 250 identifies the image 110 displayed on the image plate 100, The augmented reality images 300 can be selected.

At this time, the controller 250 may preferentially identify the largest displayed image 110 and select the corresponding augmented reality image 300.

In addition, when the image 110 is simultaneously identified, the augmented reality image 300 corresponding to the image 100 'of the image plates 100 having the largest size among the image plates 100 is displayed on the display unit 220 Can be displayed.

6A, when the image 104 'of the fourth image plate is displayed in the largest size on the display unit 220, the augmented reality image 340 corresponding to the fourth image 114 is displayed on the display May be displayed on the display unit 220. When the fourth image 114 is a helicopter, the display unit 220 displays a 3D image 341 corresponding to the helicopter and a name of the helicopter 342), one or more of the sounds of the helicopter may be output.

At this time, the 3D image 341 may be displayed in a region of the image 114 'in which the fourth image is displayed, or may be displayed in a central region of the display unit 220.

 6B, when the control unit 250 recognizes the fifth image 115 at a later time, the augmented reality image 350 corresponding to the fifth image 115 may be displayed .

The augmented reality image 350 corresponding to the fifth image 115 may include at least one of a 3D image 351 corresponding to the fifth image and a name 352 of the fifth image and sound of the fifth image . ≪ / RTI >

At this time, since the fifth image 115 'displayed on the display unit 220 is displayed smaller than the image 114' of the fourth image, the 3D image 351 corresponding to the fifth image is displayed on the fifth The image plate can be displayed only inside the area 105 'displayed on the display unit 220. [ When only a part of the fifth image 115 'is displayed on the display unit 220, the 3D image 351 corresponding to the fifth image may be partially displayed in the region 105'.

Thus, the 3D image corresponding to the fourth image and the 3D image 351 corresponding to the fifth image can be displayed on the display unit 220 in an orderly manner without overlapping each other.

If the 3D image 351 corresponding to the fifth image is displayed small after the 3D image 341 corresponding to the fourth image is displayed on the display unit 220, The holder may not know whether the 3D image 351 corresponding to the fifth image is displayed. Thus, in order to prevent this, the name 352 corresponding to the fifth image may be displayed where the name 342 corresponding to the fourth image is displayed. That is, the name 342 corresponding to the fourth image may be replaced with the name 352 corresponding to the fifth image.

6 (c), when the terminal 200 moves, the image 112 'displayed on the display unit 220 is enlarged and the controller 250 displays the second image 112' The augmented reality image 320 corresponding to the second image may be displayed on the display unit.

The augmented reality image 320 corresponding to the second image includes a 3D image 321 corresponding to the second image, a name 322 corresponding to the second image, And may include one or more.

The 3D image 321 corresponding to the second image may be displayed in the area 102 'displayed on the display unit 220 of the second image plate.

Thus, even if the control unit 250 recognizes the plurality of images 110, the photographing unit 230 photographs the plurality of image plates 100 and displays them on the display unit 220 in an orderly manner, .

Even if a plurality of augmented reality images 300 are displayed on the display unit 220, if the touch input of the display unit 220 occurs or a predetermined time elapses as described above, Can be moved in a direction in which they sequentially disappear.

FIG. 7 illustrates an embodiment in which the size is enlarged or reduced when the 3D image 301 of the augmented reality image 300 is displayed on the display unit 220. FIG.

7, when a 3D image 341 corresponding to a fourth image is displayed on the display unit 200, the holder moves the terminal 200 close to the fourth image plate 104, It may happen that it moves away.

For example, as shown in FIG. 7 (a), the holder 200 may be spaced apart from the fourth image plate 104 by L1 and may be spaced apart from L2 by L1, as shown in FIG. 7 (b) Can be deployed.

In this case, as shown in FIGS. 7A and 7B, the 3D image 341 corresponding to the fourth image displayed on the display unit 220 may be enlarged and displayed.

In other words, the control unit 250 recognizes that the photographed image is enlarged or reduced, and the size of the 3D image displayed on the display unit 220 can be changed. As a result, the reality and the field of view of the augmented reality are maximized, so that the owner can sense the 3D image as if he or she actually possesses the 3D image.

Hereinafter, with reference to FIG. 8, a method of implementing the AR system 1 of the present invention will be described in detail.

The method for implementing the AR system 1 according to the present invention includes an image capturing step S1 for capturing an image through the capturing unit 230, a determination step of determining whether the image captured in the image capturing step is identical to the identification image stored in the memory unit (S2) of comparing the identification image and the photographed image in the identification image comparison step, and determining the augmented reality image stored in the memory unit on the display unit (Step S3).

That is, the image capturing step S1 corresponds to capturing at least one of the plurality of image plates 100 through the photographing unit 230. [

 The image identification step S2 may be performed by the control unit 250 to determine whether the image 110 in which the specific object described in the plurality of image plates 100 is displayed matches the identification images stored in the memory unit 260 And matches the corresponding augmented reality image among the augmented reality images stored in the memory unit 260 when the control unit 250 corresponds to a specific identification image or the like.

That is, the memory unit 260 may store a plurality of identification images for matching the augmented reality images 300 corresponding to the photographed images. That is, in the image identification step S2, the image or image 110 displayed on the image plate 100 'photographed in the image capturing step S1 is compared with the plurality of identification images, and a corresponding augmented reality image is selected do.

The identification image compared in the image identification step S2 may be a still image (still image). At this time, the control unit 250 can recognize the image 110 based on whether the still image and the actually photographed image coincide with each other. In other words, the image identification step S2 may be performed by the control unit 250 as to whether or not a still image at a specific moment of the image photographed in the image photographing step S1 is the same as the identification image, have.

The step of constructing an augmented reality step S3 is a step of displaying at least one or more augmented reality images 300 among the 3D video 301, the name 302 and the sound corresponding to the image 110 on the display unit 220 .

The sound included in the augmented reality image displayed in the augmented reality implementation step S3 may include at least one of pronunciation of the name of the object or pronunciation of a foreign language. The sound may be displayed on the display unit 220 in addition to sound, in addition to a right-of-sight or a right-of-sight character. In the augmented reality implementation step S3, the display unit 220 may provide a selection key for selecting the language of the object name.

As described above, the augmented reality image 300 may be displayed for a predetermined period of time after the augmented reality image 300 is moved out of the display unit, or displayed on the display unit 220 for a predetermined period of time When the display unit is touched, it may be displayed as moving outside the display unit.

In addition, the touch input corresponds to a slide touch input, and the movement direction of the augmented reality image 300 may coincide with the direction of the slide touch input.

Further, the augmented reality image 300 displayed on the display unit 220 can be further enlarged when the image capturing unit is close to the image.

As described above, the image photographed in the image photographing step S1 is displayed on the display unit 220 in real time. That is, each time the photographing unit 230 moves, the display unit 220 can display the image captured by the photographing unit 230 as it is. In this process, the image identification step S2 may be performed simultaneously with or sequentially with the imaging step S1. Furthermore, the image photographed in the image photographing step S1 may be displayed on the display unit in real time, and the augmenting reality realizing step S3 may be performed simultaneously or sequentially with the image photographing step. That is, the above steps can be performed almost simultaneously according to the performance of the controller 250.

The augmented reality realization step S3 may superimpose the augmented reality image 300 on the photographed image photographed in the image photographing step displayed on the display unit 220. [ Thereby, the image or image 110 displayed on the image plate 100 can be converted into a 3D image, and the shooting step S1 and the implementing step S3 can be continuously and continuously performed. have.

Meanwhile, unlike the above-described method, the step of constructing an augmented reality (S3) includes a reproducing step (S3-1) of reproducing an augmented reality image corresponding to the image, and a step of displaying a name of an object A name display step (S3-2), and a moving step (S3-3) in which the augmented reality image moves to the outside of the display unit, wherein the name display step, May be implemented by a sequential touch input of the display unit.

In other words, it is possible to maximize participation of learners by inducing repeated touch input of the owner. In addition, it is possible to induce the holder to recognize the name of the 3D image 301 appearing in the reproduction step S3-1 without misunderstanding.

Furthermore, it is possible to accurately reflect the intention of the holder who wishes to move the stage or annihilate the 3D image.

FIG. 9 illustrates an example of a process of implementing an augmented reality according to an augmented reality implementation method of the augmented reality system of the present invention.

As shown in FIG. 9A, a first image plate 101, a second image plate 102, and a third image plate 103 are provided, and each image plate has a first image 111, The second image 112 and the third image 113 can be displayed. If the second image 112 and the third image 113 are implemented through the augmented reality realizing method of the present invention, as shown in FIG. 9 (b) The augmented reality images 310, 320 and 330 corresponding to the augmented reality images 112 and 113 can be superimposed on the images displayed on the display unit 220 of the images 111, 112 and 113, respectively. That is, the augmented reality images 310, 320, and 330 may transmit a feeling that the display image is momentarily converted into 3D on the display unit 220 to the owner of the terminal 200.

9 (c), the augmented reality images 310, 320, 330, and 340 displayed on the display unit 220 are displayed on the display unit in response to a user's touch or a predetermined time, It can be configured to move and add fun and interest.

In addition, each of the augmented reality images 310, 320, 330, and 340 may be used as various educational materials by outputting unique sound effects of objects of the corresponding images.

10 shows an example of a puzzle card package as an image plate constituting an augmented reality system according to the present invention.

As shown in Figs. 10 (a) and 10 (b), the puzzle card package can be provided with a plurality of cards in a box, each image having a different image, And may be stored in a memory unit in which a plurality of augmented reality images corresponding to respective identification images and respective identification images are stored.

The augmented reality system according to the present invention includes an image form such as a puzzle card and the like installed in a mobile device such as a smart phone with a program in the form of an app with a step function of the method of implementing the augmented reality of the present invention .

That is, the present invention provides a method for realizing an augmented reality according to an embodiment of the present invention, including a memory unit capable of storing an image, a photographing unit capable of photographing an image, a display unit capable of displaying an image, Which is installed in the form of a user app in a terminal such as a smart phone including a controller, and realizes the augmented reality effect using each hardware.

However, since the present invention's augmented reality system can be implemented even when an image plate is copied by a copying machine or the like and only an app type program is provided free of charge, a unique key (product activation code) is given to a box for packaging the puzzle card, A limited number of devices or the number of activations can be limited to obtain an advantage of securing the merchantability in commercialization.

The present invention may be embodied in various forms without departing from the scope of the invention. Accordingly, it is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

100: Image plate
100 ': taken image
200: terminal
300: Augmented Reality Video

Claims (12)

A method for realizing an augmented reality through a terminal including a memory unit capable of storing an image, a photographing unit capable of photographing an image, a display unit capable of displaying an image, and a controller for controlling the photographing unit, the display unit, and the memory unit As a result,
A photographing step of photographing an image through the photographing unit;
An identification image comparing step of determining whether the image photographed in the image photographing step is identical to the identification image stored in the memory unit through the controller;
And displaying the augmented reality image matched with the identification image and stored in the memory unit through the display unit when the identification image matches the photographed image in the identification image comparison step. The method according to claim 1,
Wherein the augmented reality image displayed in the augmenting reality implementation step is a 3D video including a sound. The method according to claim 1,
Wherein the object to be imaged in the image shooting step is an image displayed on a card for a training or a game or on a puzzle card. The method according to claim 1,
Wherein the memory unit stores a plurality of identification images and an augmented reality image matching each of the identification images, and the identification image comparison step compares an image displayed on the card photographed in the image sensing step with a plurality of identification images Augmented reality. 3. The method of claim 2,
Wherein the augmented reality image displayed in the augmented reality implementation step includes an indication of the name of an object displayed as an augmented reality image. 3. The method of claim 2,
Wherein the sound included in the augmented reality image displayed in the augmented reality implementation step includes a pronunciation of at least one of the names of the selectable objects. The method according to claim 1,
Wherein the augmented reality image is displayed in a manner that the augmented reality image is displayed on the display unit for a predetermined time and then moved to the outside of the display unit. The method according to claim 1,
The display unit may include a touch panel,
Wherein the moving direction of the augmented reality image coincides with the direction of the slide touch input input through the display unit while the augmented reality image is displayed. The method according to claim 1,
The image picked up in the image taking step is displayed on the display unit in real time, and the comparing step is performed simultaneously with the image taking step and displaying the image on the display unit. Wherein the image is superimposed on the upper part of the photographed image photographed in the image photographing step displayed on the display unit. 5. The method of claim 4,
Wherein the identification image to be compared in the identification image comparison step is a still image (still image), and the identification image comparison step determines whether a still image at a specific moment of the image captured in the image shooting step is the same as the identification image Wherein the augmented reality realization method comprises: The method according to claim 1,
Wherein the step of implementing the augmented reality is subdivided into a plurality of steps, and the step excluding the first step of the plurality of steps is progressed sequentially by touch input to the display unit. 11. A method for implementing an augmented reality according to any one of claims 1 to 11, comprising the steps of: a terminal equipped with an app for an augmented reality implementation; and a card or a puzzle card for an education or a game Real system.

Images