KR100672288B1 - Method and apparatus of implementing an augmented reality by merging markers - Google Patents

Abstract

A method and a device for implementing augmented reality by merging markers are provided to easily and intuitively output efficient/diverse 3D(Dimensional) virtual images with a few of markers by merging the markers. A marker registering module registers the markers for displaying a character, a number, a symbol, a picture, or a combination to a space allocated in a storing part as an image file format. A 3D image registering module registers the 3D images represented by computer graphics to the space allocated in the storing part by matching with the markers. A merging determining module determines to merge the markers having the same ID by an operation and processing of a computer processor if the markers placed on an ID are present among the markers recognized by an image recognizer. An outputting module outputs the 3D image matched with the merged markers to an image output part when the marker merged by the merging determining module is present.

Description

Method and apparatus for implementing augmented reality using inter-marker fusion {Method and Apparatus of Implementing an Augmented Reality by Merging Markers}

1 is a schematic diagram showing a conventional technique for implementing AR using a marker.

2 is a block diagram showing an apparatus for implementing an AR according to the present invention.

3 is a diagram illustrating an inter-marker fusion and a three-dimensional virtual image according to the present invention.

4 is an embodiment illustrating various markers in accordance with the present invention.

5 is an embodiment illustrating the movement of a marker and a camera according to the present invention.

Brief description of the main symbols in the drawings

31: identifier inside the marker 32: selector of the detail marker

Field of invention

The present invention relates to a method and apparatus for implementing augmented reality (AR). More specifically, the present invention relates to a method and apparatus for implementing an AR for easily and intuitively outputting an efficient and various 3D virtual image even with a small number of markers.

Background of the Invention

AR (Augmented Reality, AR) is one of the virtual reality that combines the real world that the user sees with the virtual world with additional information. AR, which complements the real world with the virtual world, uses a virtual environment made of computer graphics , but the main role is the real environment. Computer graphics play a role in providing additional information necessary for the real environment. This means that the distinction between the real environment and the virtual screen is obscured by overlapping the 3D virtual image with the live image that the user sees. Virtual reality technology immerses the user in the virtual environment and cannot see the real environment. However, AR mixed with real environment and virtual objects provides better realism by allowing the user to see the real environment. It is a wearable computer (wearable computer) to realize the augmented reality outdoors. Especially, the head display type of computer display device is a computer graphic image in the real environment that users see Augmented reality is enabled by showing the real time superimposed on the back.

As a method of implementing such an AR, a computer recognizes a specific marker and draws a three-dimensional graphic model connected to the marker on a monitor. These markers and three-dimensional graphical models appear in various ways depending on the user's choice. For example, a user can create a marker for a cat at random and connect a cat marker with a three-dimensional image of a cat as a three-dimensional graphic image. When the marker is recognized by an image recognition means such as a camera connected to a computer, a three-dimensional image of a cat appears on the computer monitor. Alternatively, as shown in the schematic diagram of FIG. 1, when a viewer looks at a marker through a display device of a wearable computer, a three-dimensional image of a human shape may appear on the marker.

As described above, conventionally, since there is one three-dimensional virtual image corresponding to one marker, there is a problem in that markers corresponding to the number of three-dimensional virtual images to be expressed should exist. For example, when there are three-dimensional images of a man, a woman, and a cat, and each of them has a three-dimensional image having a running state, a total of six markers are required. A male marker, a female marker, a cat marker, a running male marker, a running female marker, and a running cat marker are respectively required. However, the running behavior is the same for the three characters, and it is too inefficient to have a 'character marker' for each character. In addition, as these types of characters and actions become more and more, exponential numbers of markers are required to express characters with various shapes.

Therefore, there is a need for an apparatus or method for implementing an AR that easily and intuitively outputs an efficient and various 3D virtual image with a small number of markers.

An object of the present invention is to provide an apparatus for implementing an AR that outputs an efficient and various three-dimensional virtual image even with a small number of markers by using fusion between markers.

Another object of the present invention relates to an apparatus for implementing an AR for easily and intuitively outputting a 3D virtual image by using a fusion between markers.

Still another object of the present invention is to provide a method for implementing an AR that easily and intuitively outputs various and efficient 3D virtual images with a small number of markers by using fusion between markers.

The above and other objects of the present invention can be achieved by the present invention described in detail.

Summary of the Invention

The present invention provides an apparatus for implementing an AR comprising a memory in which a plurality of modules are stored and a processor connected to the memory and responsive to the plurality of modules, wherein the plurality of modules are (1) letters, numbers, symbols, figures Or a marker registration module for registering a plurality of markers indicating a combination thereof in an image file format in an allocated space of a storage means, and (2) a plurality of three-dimensional images represented by computer graphics corresponding to the plurality of markers, respectively. A three-dimensional image registration module for registering in an image file format in the allocated space of the storage means, and (3) if there are markers in the marker among the plurality of markers recognized by the image recognition means, Determining by the computation and processing of the computer processor that the identifiers should fuse the same markers together. A sum determination module, and (4) an output module for outputting a three-dimensional image corresponding to the markers to be fused to the image output means when there are markers fused by the fusion determination module. Device.

Hereinafter, with reference to the accompanying drawings will be described in detail the contents of the present invention.

Detailed Description of the Invention

An embodiment of an apparatus for implementing AR using inter-marker fusion according to the present invention may be a computer system. Generally speaking, a computer is a programmable electrical device that accepts and processes input data, stores and retrieves the processed information, and outputs the results. The processor, memory, image recognition means and output means shown in FIG. 2 are basic devices for operating a computer. Interaction between these devices can be easily carried out by those skilled in the art.

Image recognition means of the present invention includes a camera, a cam (Cam), a scanner, any type of device that can recognize the image and transmit it to a computer, the output means of the present invention is a computer monitor, a display device of a wearable computer, such as a computer It includes all types of devices for displaying images received from.

The plurality of modules according to the present invention includes a marker registration module, a 3D image registration module, a fusion determination module, and an output module. A module of the present invention is stored in a memory of a computer and is arithmetic, processed, etc. by a processor of the computer, and means a logical part of a program that performs a specific function in the computer.

3 is one embodiment showing an AR embodying a fused marker by the device of the present invention. The markers shown in FIG. 3 are largely classified into 'human-1', 'actions' and 'facial expressions', and 'human-1' has four detailed markers of man, woman, child and elderly, actions' has four detailed markers: sit, run, climb, and avoid. 'facial expressions' have four detailed markers: laugh, sad, angry, and expressionless. In the above four detailed markers, one detail marker is selected by the selector 32 made of one magnet, and the image recognizing means recognizes only one detail marker selected by the selector. Accordingly, in the case of FIG. 3, 'man', 'sit' and 'laugh' are selected and recognized. A total of 12 designed markers are stored in an image file format in a specific space of the storage means of the computer.

In the apparatus for implementing the AR according to the present invention, the number of detailed markers falling into one marker is not limited to four, may be less than four, or may be many.

The twelve markers shown in FIG. 3 may be fused to each other, as shown, may be a fusion of a man, sitting and laughter, may be a fusion of an elderly, avoiding and angry, or may be a fusion of a child and sadness. . Therefore, a great many kinds of fusion can occur, and three-dimensional images corresponding to all the fusions can be output to the output means of the computer.

As shown in FIG. 3, the 3D image corresponding to the marker may be represented by computer graphics and stored in a specific space of the storage means of the computer in a state connected to the marker. Representation of the three-dimensional image can be easily performed by those skilled in the art.

12 markers (three markers acting as 12 markers by the selector) of FIG. 3 may result in 64 (4 * 4 * 4) fusions, and three-dimensional images corresponding to the respective fusion results. It is stored in advance in this storage means. In the prior art, since one 3D image corresponds one to one to one marker, the markers are required by the numbers of the 3D images. Therefore, in the prior art, 64 corresponding markers are required to output 64 three-dimensional images. However, according to an embodiment of the apparatus for implementing the AR according to the present invention, since 64 three-dimensional images are represented by twelve markers, various three-dimensional images are efficiently output even with a small number of markers. . In addition, since the number of markers is small and the markers are appropriately classified, the apparatus for implementing AR according to the present invention outputs a 3D image by combining markers more easily and intuitively.

When the marker is recognized by the image recognition means according to the present invention, several markers can be recognized at the same time. Since some of the recognized markers are fused and some are not fused, the fused markers output a fused three-dimensional image, and the unfused markers display a three-dimensional image corresponding to each marker. Output In addition, several of these 3D images may be simultaneously output on one screen where the marker is located. For example, a crying man (fused), an angry woman (fused) and a cat (not fused) may be simultaneously output on one screen.

The fusion determination module according to the present invention determines whether fusion between markers is made through an identifier in the marker. As shown in FIG. 3, the identifier 31 is a specific indication to fuse the marker and the marker, and may be represented by various types of symbols such as letters, numbers or symbols. Because fusion occurs between markers with the same identifier, fusion does not occur if the identifiers are different in the markers.

As shown in FIG. 3, 'human-1' is selected by the selector 32 to recognize 'man' by image recognition means, 'action' is selected to recognize 'sit', facial expressions' is selected to recognize 'laughs'. When the three markers are simultaneously recognized by the image recognition means, since the same identifier 31 is present, the three markers are determined by computation and processing of the computer processor as markers to be fused. The output module according to the present invention retrieves the 3D image of the 'smiling man' from the storage means and outputs it to the image output means such as a monitor.

The marker of the present invention may be displayed in letters, numbers, symbols, drawings or a combination thereof, and the shape thereof is not particularly limited as long as it can be expressed on two dimensions. 4 shows an embodiment of a marker that can be used in an apparatus implementing an AR in accordance with the present invention. Detail markers for stages markers include forests, building walls, rooms, and rooftops. Detailed markers for actions, facial expressions, and human-1 are detailed above. Dogs, cats, trees, and flower pots. 'Detailed markers of property-2 markers include bookshelves, tables, chairs and hangers.' Detailed markers of property-3 markers include cars, buses, bicycles and boats. ' Detail markers on property-4 'markers include flags, birds, bullets and crowds.

After the 3D image is output by the apparatus implementing the AR according to the present invention, when the marker or the image recognition means is moved, the 3D image is moved or changed in shape according to the movement. As shown in FIG. 5, the marker may be moved in the x-axis, y-axis and z-axis directions, or the marker may be rotated, and the output 3D image may also move according to the movement of the marker. In addition, when the position of the image recognition means is changed in a situation where the 3D image is already output, the 3D image is output at different angles. If the image recognition means is brought closer to the marker, the enlarged three-dimensional image may be output. If the image recognition means is brought far, the reduced three-dimensional image may be output.

A method for implementing an AR according to the present invention registers a plurality of markers representing letters, numbers, symbols, pictures or a combination thereof in an image file format in an allocated space of a storage means, and displays a plurality of three represented by computer graphics. A marker in which an dimensional image is registered in an image file format in an allocated space of a storage means so as to correspond to each of the plurality of markers, and an identifier is located in the marker among the plurality of markers recognized by the image recognition means. If present, it is determined by the computation and processing of the computer processor that the identifiers of the same markers should be fused to each other, and a three-dimensional image corresponding to the markers fused when there are markers fused by the fusion determination module. And outputting to an image output means. The above step can be easily understood by the description of the apparatus for implementing the above-described AR.

The method according to the invention can be embodied as computer readable code on a computer readable recording medium. The computer-readable recording medium is a recording device that stores data that can be read by a computer system. For example, ROM, RAM, Cache, hard disk, optical disk, floppy disk, magnetic tape and the like. In addition, the carrier wave may be implemented in the form of a carrier wave, for example, transmission through the Internet. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

The present invention has an effect of providing an apparatus and method for implementing an AR for easily and intuitively outputting an efficient and various 3D virtual image even with a small number of markers.

Simple modifications or changes of the present invention can be easily carried out by those skilled in the art, and all such modifications or changes can be seen to be included in the scope of the present invention.

Claims (5)

An apparatus for implementing Augmented Reality (AR) including a memory in which a plurality of modules are stored and a processor connected to the memory and responsive to the plurality of modules, The plurality of modules, A marker registration module for registering a plurality of markers representing letters, numbers, symbols, pictures, or a combination thereof in an image file format in an allocated space of the storage means; A three-dimensional image registration module for registering a plurality of three-dimensional images represented by computer graphics in an image file format in an allocated space of the storage means so as to correspond to the plurality of markers, respectively; If there are markers in the marker among the plurality of markers recognized by the image recognizing means, the fusion determination module for determining by the computation and processing of the computer processor that the markers having the same identifier should be fused to each other ; And An output module for outputting a 3D image corresponding to the markers to be fused to the image output means when there are markers fused by the fusion determination module; Apparatus for implementing an AR comprising a. The apparatus of claim 1, wherein the output module outputs a 3D image corresponding to the marker at the changed position when the position of the marker is changed in the 3D real space. The AR module of claim 1, wherein the output module enlarges, reduces, or rotates the 3D image corresponding to the recognized marker when the image recognition means moves in the 3D real space. Device. Register a plurality of markers representing letters, numbers, symbols, pictures or a combination thereof in an image file format in the allocated space of the storage means; Registering a plurality of three-dimensional images represented by computer graphics in an image file format in an allocated space of the storage means so as to respectively correspond to the plurality of markers; If there are markers in which the identifier is located in the marker among the plurality of markers recognized by the image recognition means, it is determined by the computation and processing of the computer processor that the markers having the same identifier should be fused together; And Outputting, to the image output means, a 3D image corresponding to the markers to be fused when the markers are fused by the fusion determination module; And implementing an AR. A computer-readable recording medium having recorded thereon a program for executing the method of claim 4 on a computer.

Images