KR20160043198A - AR marker having boundary code, and system, and method for providing augmented reality using the same - Google Patents

Abstract

A method for providing AR according to the present invention, which is a method for providing AR for a virtual world to be augmented on an AR marker by an identification code detecting the AR marker provided in an edge area in a marker frame, includes: a step of registering the AR marker in an AR-providing server and an AR text; a step of downloading an AR application from the AR-providing server and and installing the same to an AR-providing device; a step of imaging the AR text and outputting a pattern image of the AR marker to the AR-providing device; a step of extracting marker identification information from the pattern image of the AR marker and checking whether the extracted marker identification information is present in an AR code DB; a step of checking whether AR content information matching the marker identification information is present in an AR content DB in a case where the presence is confirmed; and a step of outputting the AR content on the pattern image of the AR marker in a case where the presence is confirmed. This AR-providing method facilitates code design and has a high level of reliability.

Description

[0001] The present invention relates to an AR marker including a boundary code, an AR marker providing method and a method for providing the same,

The present invention relates to an AR marker and a method and an AR system using the same, and more particularly, to a vision-based AR code recognition method in which boundary codes are provided in an inner edge of a marker frame or a marker frame, It is necessary to design a new code for each piece of information when the AR marker is designed with a code design such as a logo or a graphic form by judging only the presence / absence of the pattern, the length, the thickness, The arrangement of the line pattern on the inner edge region of the marker frame minimizes the ground allocation for code placement. By processing the line pattern as a block, the identification information of the AR marker can be obtained easily An AR marker, an AR providing system, and an AR providing method.

In general, augmented reality (AR) is a virtual world in which real-world images and virtual graphic objects are synthesized by a computer to provide realistic reality through user interaction. And it is a weak virtual environment rather than a virtual reality level that implements a complete immersive environment.

These AR technologies have recently become the latest technology trends in various fields such as broadcasting, education, medical, manufacturing, publishing, and games. Among them, there are many books that implement AR.

In order to realize the existing augmented reality, a technique based on image recognition (marker-less) or recognition marker (Artificial Marker) is used.

For example, a method based on image recognition (Marker-less) is a method of using an actual object (object) as a marker instead of using a virtual physical marker and using it as a virtual marker. It has a disadvantage that it needs to be kept separately and uses a lot of system resources to compare and track markers. In particular, it is not suitable for low-priced terminals in which system resources are insufficient, such as mobile phones and PDAs.

A method based on an artificial marker is a method of receiving a physical marker having the same shape and size from a real image, recognizing the marker, and calculating the position and direction of the marker according to the relative data from the image input device In order to recognize a physical marker, a pattern matching method is used. In this method, there is a disadvantage that one or more physical markers must be registered in advance have.

Since the image recognition technology is costly to implement in the related arts, while the technology based on the recognition mark is advantageous in that it is cost-effective, the latter will be described.

Hereinafter, problems with conventional marker or tag based AR technology will be described in more detail with reference to the drawings.

Referring to FIG. 1, when a marker has only one piece of information such as an existing code design (for example, a logo, a figure or a character), a new code design differentiating from the existing code design must be designed every time. Therefore, it is troublesome to learn and register each time.

It is virtually impossible to store and manage information on a large number of markers in an AR device such as a mobile. In order to do this, content information related to markers and markers is stored in the remote AR server DB, and it is necessary to selectively fetch the content information from the AR device, which causes a decrease in the retrieval speed and the data transmission speed. Especially, in the case of the pattern code, there is a lot of similarity between the codes, which makes it difficult to recognize the code.

To solve this problem, BAR code or QR code can be used instead of the pattern code, but there is a problem that a separate space is allocated for the code. For example, the QR code may be displayed on any one of the pages of the paper, thus violating the user's view.

(Patent number 001) Public practical use 20-2012-0001967

SUMMARY OF THE INVENTION Accordingly, the present invention has been made to solve the above-mentioned problems occurring in the prior art, and it is an object of the present invention to provide an AR marker, an AR Providing system and method.

Another object of the present invention is to provide an AR marker and an AR providing system which can expand codes according to the presence / absence of a pattern, a length, a thickness, a type, or an icon and display a lot of information corresponding to an actual object.

Another object of the present invention is to provide an AR marker and AR providing system and method for easily obtaining AR code identification information through a server such as a chip without using a remote server, .

According to an aspect of the present invention for achieving the above object, an AR providing system of the present invention drives an AR marker, AR APP, provided with a boundary code in an edge area of a marker frame, to recognize the boundary code, An AR providing device for displaying the AR content on the marker frame, and an AR providing server for distributing the AR APP and providing the AR content to the AR providing device.

According to another aspect of the present invention, the AR marker of the present invention includes a square frame marker frame having a void space inside, and an identification code disposed in an edge area of the void space.

According to another aspect of the present invention, there is provided an AR providing method for an AR providing method for detecting an AR marker provided with an identification code in an edge area of a marker frame to augment a virtual world on the AR marker, Registering an AR marker in an AR text with an AR providing server; downloading and loading an AR APP from an AR providing server to an AR providing device; capturing the AR text and outputting a pattern image of the AR marker to the AR providing device Extracting marker identification information from the pattern image of the AR marker and checking whether the extracted marker identification information is present in the AR code DB; if the marker identification information is matched with the marker identification information, DB, and if so, outputting the AR content on the pattern image of the AR marker.

As described above, according to the configuration of the present invention, the following effects can be expected.

First, it is economical because it does not require code design every time.

Second, since the boundary code is easy to recognize the code by adjusting the length or thickness of the pattern, the probability of failing to recognize the pattern is small.

Third, it is possible to combine a large number of codes depending on whether there is a pattern, a length, a thickness, a type, and a combination of icons.

FIG. 1 shows an AR providing case according to the prior art.
2 is a conceptual diagram of an AR providing system according to the present invention;
3A and 3B are front views of an AR marker according to the present invention.
4 is a block diagram of an AR providing apparatus according to the present invention;
5 is a block diagram of a marker recognition module according to the present invention;
6 to 8 are front views showing various embodiments of an AR marker according to the present invention.
9 is a flowchart showing an AR providing method according to the present invention.

Brief Description of the Drawings The advantages and features of the present invention, and how to achieve them, will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. The dimensions and relative sizes of layers and regions in the figures may be exaggerated for clarity of illustration. Like reference numerals refer to like elements throughout the specification.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a preferred embodiment of an AR providing system using an AR marker in which a boundary code according to the present invention is provided at the inner edge of a marker frame will be described in detail with reference to the accompanying drawings.

2, an AR providing system 1000 according to the present invention includes an AR marker M provided with an identification code 102 in an edge area inside a marker frame 104, an AR marker 102 driven by AR APP And an AR providing server S for recognizing the AR contents W and displaying the AR contents W and an AR providing server S for distributing the AR APP and providing the AR contents W to the AR providing apparatus T.

Alternatively, the AR providing device T captures an image of the AR marker M without directly recognizing the AR marker M, and transmits the captured image to the AR providing server S, (AR) content (W), and display it on the AR providing apparatus (T).

The AR marker (M) of the present invention is registered on the AR providing server (S) and the AR text (P). Here, the AR text P includes a book or an e-book as an object that a user can view in the real world. In addition, it can include a brochure, a menu board, and a billboard that can transmit a message through the ground in an offline manner. The AR content (W) includes educational or promotional videos.

3A, the AR marker M includes a marker frame 104 indicating that it is an AR marker and performing a reference point function of the AR marker, and an identification code 102 disposed inside the marker frame 104. Here, the marker frame 104 has a rectangular frame shape having a void space inside, and the identification code 102 can be disposed around the void space edge.

The marker frame 104 can easily recognize the identification code 102 of the AR marker M and can provide various parameters of the AR marker M through the thickness or the length of the frame. In addition, the marker frame 104 may be a reference point indicating the position of the virtual object to be augmented.

The void space may be provided with a middle area M1 irrespective of the recognition of the AR marker. For example, in the void space, various menus related to the AR contents (W) are described without being related to the markers, and the like can be used for various purposes.

Although the marker frame of the present invention is a square frame for the sake of convenience, it does not exclude a circular frame. When the marker frame 104 is a triangular frame, the identification code 102 may be located at each corner of the frame. Also, in the case of the marker frame 104 circular frame, the identification code 102 may be formed by drawing a circle at a predetermined interval on the edge of the frame.

Referring to FIG. 3B, the identification code 102 may be formed in the marker frame 104 itself at an engraved angle. For example, the boundary code may be formed directly on the corner of the marker frame. Or the identification code 102 may be formed on the marker frame 104 by different colors.

4, the AR providing apparatus T recognizes the AR marker 102 in the AR text P through the camera module 110 and the camera module 110 that collect images of the AR text P, An AR implementation module 130 for determining whether the two markers are identical to each other in comparison with the AR marker M recognized through the camera module 110 and the marker stored in the AR code DB 120a, And a display module 140 for displaying the AR contents W stored in the AR contents DB 130a, if they match.

The AR code DB 120a stores the AR code data as described in the AR text (P). The AR content DB 130a acquires a virtual image of a virtual object to collect and store the AR content W.

The camera module 110 includes a lens for receiving an optical signal for an image of the AR text (P) not shown in the drawing, and an image sensor for generating an image data by changing an optical signal to an electrical image signal necessary for image processing . The color filter array may further include an RGB filter when the identification code 102 includes a color pattern. In addition to a CCD image sensor and a CMOS image sensor, the image sensor may include an image, a web, or various digital cameras.

The marker recognition module 120 recognizes the marker frame 104. A method of recognizing the marker frame 104 may be a method of extracting a boundary line of the marker frame 104 and extracting a straight line from the extracted boundary lines. Alternatively, a method of recognizing and tracking four vertexes of the outermost corner of the marker frame 104 as feature points can be used.

Referring to FIG. 4, the marker recognition module 120 recognizes the identification code 102 to obtain marker identification information. The marker recognition module 120 obtains a pattern image of the identification code 102 in the edge area M2 and acquires a pattern image of the identification code 102 in the obtained identification code 102. The edge recognition section 122 detects the edge area M2 of the void space, An image extracting unit 124 for extracting an image and an image processing unit 126 for generating AR marker identification information from the pattern image using the AR code DB 120a previously stored with the AR code data corresponding to the pattern image described above do. Here, the AR code data stored in the DB is a code for converting the pattern image into the AR marker identification information.

The image extracting section 124 includes an area dividing section 124a for dividing the edge area M2 into code blocks (for example, four corner blocks) and a block processing section 124b for processing the identification codes for each code block . Thus, the edge area includes four corner blocks, and the code block corresponds to four corner blocks, so that the block processing section 124b processes the identification code 102 for every four corner blocks.

4, the AR implementation module 130 matches the AR contents W stored in the AR contents DB 130a using the generated marker identification information, and enhances the AR contents W on the AR marker M . For example, if it is determined that the marker identification information is matched with the AR content W stored in the AR content DB 130a, the marker ID is outputted to the display module 140.

The display module 140 includes both video means and audio means for displaying or telling the AR contents W. [

The AR providing device T may be defined as a smart device on which the AR application AR APP is installed. Here, AR APP is an application that an AR service provider distributes for the purpose of providing AR service, and can be distributed through an application store or a web space. For example, AR APP is an application program that is operated only by the corresponding smart device using the development language provided by the smart device OS manufacturer, and various functions can be implemented by supporting the hardware functions provided by the smart device.

For example, a smart device may include a mobile terminal such as a smart phone, a mobile phone, an iPhone, and a notebook computer. Accordingly, if at least a camera or a scanner is provided, a terminal capable of having various communication functions such as communication via a network or near field wireless communication can be included in all of them.

The AR providing server S stores AR code data information about the AR marker M and AR content information about video information of a virtual object matched with the AR code data information and transmits the AR content data to the AR providing apparatus T Communication can be performed.

In the present invention, the identification code 102 includes a pattern image. Here, the pattern image can be designed in the form of a boundary code that can be placed in the edge area M2 of the void space.

The boundary code may be located in the edge of the void space, more specifically in the corner block, so as not to violate the user's view with the pattern image, as shown in Figures 6-8. Thus, the code block that is divided as described above may be four corner blocks.

Referring to FIG. 6, if a code block having a predetermined area is divided into four corner blocks, the boundary code is located at the corner of the void space, and the boundary code is an "L" Can be designed. At this time, the boundary code may be a line pattern.

Thus, each corner block has a "━" pattern, no, and a "┃" pattern, and is composed of a combination of none and nothing. If there are both "━" patterns and "┃" patterns, there are only "━" patterns, there are only "┃" patterns, and there are no "━" patterns and "┃" , Each corner block can have 2 bits (the square of 2) of information. 4 corner blocks can have 8 bits (2 to 8 squared) of information. Thus, one AR marker M having four corner blocks can basically express 255 information.

11 " 11 "and becomes" 255 "when there are all the " L" patterns in the four corner blocks, Quot; L "pattern exists in only the first first corner block, it becomes" 11 00 00 00 ", so that it has a value of "2 ".

Some of them can be used as a reference point for dividing the AR marker (M) up, down, left, and right. As described above, there is at least a line pattern at each corner of the AR marker M. Since there is only a recognition that there is no line pattern, the probability of pattern recognition failing is almost zero. The above line pattern is expandable through pattern transformation.

Referring to FIG. 7, there is a line, and there is a line, a thickness, a color, a type (for example, solid line / dotted line or straight line / ridge line) Can be more.

For example, the first corner block is coded by a combination of (a), (b) and (c), and the second corner block is coded by a combination of a long line (c) and a short line (d) 3 Corner blocks are coded by a combination of a solid line (ⓔ) and a dashed line (ⓕ), and the fourth corner block is coded by a combination of (ⓖ) and ((아이콘). Other combinations of bold lines and thin lines, and combinations of various color lines can be considered.

For example, in addition to the presence or absence of a line (with or without a line), the length of the line (long and short lines), the type of line (solid and dashed lines) When included, all 32 bits (32 squared of 2 = up to 4,294,967,296) can be distinguished. The above line pattern can be further expanded by duplicating the pattern line.

Referring to FIG. 8, if the line pattern of the above-described embodiment is extended to two lines again, the AR marker M information can be obtained up to 32 bits X 32 bits (32 squared X 2 of 32). As described above, it is possible to combine a large number of codes according to the presence / absence of a pattern, the length, the thickness, the type, and the combination of the icons, so that detailed AR content information can be provided without any particular limitation.

Hereinafter, an AR providing method using an AR marker provided with a boundary code in an edge area inside the marker frame will be described.

First, the AR marker identification information is encoded into a boundary code in the AR marker (M). The AR server S can design the boundary code as described above. And decodes the AR marker identification information using the next AR providing device (T).

Hereinafter, the process of decoding the boundary code and enhancing the AR content W will be described in detail with reference to FIG.

The AR marker M is registered in the AR providing server S and AR text P (S110)

AR APP is downloaded and loaded into the AR providing apparatus T (S120)

The AR text P is photographed to output a pattern image of the AR marker M to the AR providing apparatus T. (S130)

The AR marker identification information is extracted from the pattern image of the AR marker M and the extracted information is checked in the AR code DB 120a (S140)

At this time, in extracting the pattern image of the identification code 102 in the edge area M2 using the image extracting unit 124, the edge area is divided into four code blocks, and the divided identification code 102 is analyzed . Thus, the identification code 102 can be converted into the AR marker identification information.

If it is confirmed, it is checked whether the AR content information matching with the AR marker identification information exists in the AR content DB 130a (S150)

If it is confirmed, the AR content W is outputted on the pattern image of the AR marker M. (S160)

As described above, according to the present invention, when a single code such as a logo or a graphic design has only one piece of information, it is necessary to design a new code design that is differentiated from the existing code design. In order to recognize the new code design, In order to alleviate the hassle of having to do this, it can be seen that it is technically possible to use the code once, but to place it on the edge of the marker frame for space allocation. Many other modifications will be possible to those skilled in the art, within the scope of the basic technical idea of the present invention.

1000: AR system T: AR providing apparatus
M: AR marker M1: middle area
M2: edge region 102: identification code
104: marker frame 110: camera module
120: marker recognition module 120a: AR code DB
122: edge detection unit 124:
124a: area dividing unit 124b: block processing unit
126: image processing unit 130: AR implementation module
130a: AR content DB 140: Display module
P: AR text S: AR providing server
W: AR content

Claims (10)

An AR marker in which a boundary code is provided in an edge area inside the marker frame;
An AR providing device for driving the AR APP to recognize the boundary code and displaying the AR content on the marker frame; And
And an AR providing server for distributing the AR APP and serving AR contents to the AR providing apparatus. The method according to claim 1,
The AR providing apparatus includes:
A camera module for collecting images of the AR marker;
An AR marker recognition module for acquiring AR marker identification information through the camera module;
An AR implementing module for outputting AR content information matched with the AR marker identification information; And
And a display module for displaying the AR contents. 3. The method of claim 2,
Wherein the AR marker recognition module comprises:
An edge detection unit detecting the edge region;
An image extracting unit for acquiring and extracting a pattern image of the identification code in the edge region; And
And an image processing unit for generating the AR marker identification information from the pattern image. The method of claim 3,
Wherein the image extracting unit comprises:
An area dividing unit dividing the edge area into a plurality of code blocks; And
And a block processor for processing the boundary code for each code block,
Wherein the edge area includes four corner blocks, and the code block corresponds to the four corner blocks, so that the block processing unit processes the boundary code for each of the four corner blocks. A square frame marker frame having a void space inside; And
And an identification code disposed in an edge area of the void space. 6. The method of claim 5,
Wherein the identification code is a boundary code,
Wherein the boundary code is located in four corner blocks of the edge region,
An "L" type line pattern having directionality according to the block position,
An AR marker having at least one of a presence, a shape, a thickness, and a length of the line pattern. The method according to claim 6,
The boundary code,
By including a line pattern designed as an "L" type having a directionality according to the position of the four corner blocks, there is a "-" pattern located in the four corner blocks, Of the AR marker. 8. The method of claim 7,
The boundary code,
Combinations of icons combined with long and short combinations of "━" patterns and "┃" patterns, solid lines of "━" patterns and "┃" patterns, combinations of dotted lines, "━" patterns and "≪ / RTI > further comprising a combination of at least one of: An AR providing method for detecting an AR marker provided in an edge area of an inside of a marker frame to enhance a virtual world on the AR marker,
Registering the AR marker in an AR text with an AR providing server;
Downloading and loading the AR APP from the AR providing server to the AR providing apparatus;
Capturing the AR text and outputting a pattern image of the AR marker to the AR providing apparatus;
Extracting marker identification information from the pattern image of the AR marker and checking whether the extracted marker identification information is in the AR code DB;
Confirming whether the corresponding AR content information matched with the marker identification information exists in the AR content DB; And
And outputting the AR content on the pattern image of the AR marker if it is confirmed. 10. The method of claim 9,
The step of extracting the marker identification information includes:
Detecting the edge region;
Dividing the edge region into code blocks;
Extracting the identification code for each of the divided edge areas; And
And analyzing the identification code to extract the marker identification information.

Images