KR101847108B1 - System and method for augumented reality system using 3-dimension pattern recognition - Google Patents

Abstract

The present invention relates to an augmented reality system using a three-dimensional pattern recognition which comprises: a three-dimensional pattern providing unit for providing a member for realizing augmented reality as a three-dimensional marker for realizing augmented reality by forming a three-dimensional pattern by cutting or breaking or bending; an augmented reality service realizing unit for recognizing a marker of the three-dimensional pattern for realizing augmented reality, and driving and executing augmented reality content corresponding to a unique pattern of the recognized marker; and a content providing unit for storing augmented reality content related to the marker of the three-dimensional pattern for realizing augmented reality requested through a communication network from the augmented reality service realizing unit, and providing the augmented reality content to the augmented reality service realizing unit by searching according to the request.

Description

 Technical Field [0001] The present invention relates to an augmented reality system using three-dimensional pattern recognition,

The present invention relates to an augmented reality system and an implementation method using three-dimensional pattern recognition, and more particularly, to a method and apparatus for generating a three-dimensional image pattern by cutting or processing a portion forming a marker for realizing an augmented reality, The present invention relates to an augmented reality system and method for realizing an augmented reality including various contents by analyzing an image pattern implementing the augmented reality.

Augmented Reality is a field of Virtual Reality that is a computer graphics technique that creates virtual objects in real environments and makes them look like objects in the original environment.

The augmented reality has a characteristic that it can reinforce and provide additional information that is difficult to obtain only in the real world by synthesizing a virtual object on the basis of the real world, unlike the existing virtual reality which only deals with a virtual space and objects.

In other words, the virtual reality technology generally allows the user to immerse in the virtual environment, so that the user can not see the actual environment, whereas the augmented reality technology allows the user to see the real environment, .

In other words, although virtual reality replaces the real world and shows it to the user, the augmented reality has a differentiating feature that it replicates the real world by superimposing a virtual object on the real world and shows it to the user. . Because of this feature, unlike existing virtual reality, which can be applied only to fields such as games, it can be applied to various real environments, and is attracting attention as a next generation display technology suitable for the Internet environment of objects.

In order to realize augmented reality, it is common to recognize an object based on a marker or a markerless basis. Augmented reality based on marker recognition is spreading rapidly in advertising field. The augmented reality, which is as interesting and curious as the basic direction of the advertisement is attracted by the consumer, doubles its efficiency through a suitable medium. Such a marker as an intermediary is usually provided by printing an image downloaded through the Internet onto A4 paper or printed on a product package.

However, a limitation of this approach is that it can only be executed when it has printed or printed markers. In other words, in order to realize an augmented reality through the marker, restrictions are imposed only when the marker is carried.

In addition, since the existing marker itself is a two-dimensional medium, the augmented reality that is executed thereby must be applied in order to implement various contents beyond a limited marker area. Therefore, a simple two-dimensional augmented reality marker is augmented In the real system, there are many limitations on the implementation of the augmented reality, and some parts are insufficient.

Korean Patent Registration No. 10-0868732

The present invention has been made to solve the conventional problems as described above, and it is an object of the present invention to provide an augmented reality system and method for realizing an augmented reality, Dimensional image pattern by cutting or processing the image data to analyze the image pattern that implements the dynamic change and to realize the augmented reality including the various contents by recognizing the data, And an implementation method.

The augmented reality system using three-dimensional pattern recognition according to the present invention is a three-dimensional (3D) marker that provides a three-dimensional marker for realizing augmented reality by cutting a member for realizing an augmented reality or forming a three- Pattern remover; An augmented reality service implementation unit for recognizing a marker of a three-dimensional pattern for implementing the augmented reality and driving and executing an augmented reality content corresponding to a unique pattern of the recognized marker; And a contents providing unit for storing the augmented reality contents associated with the three-dimensional pattern marker for implementing the augmented reality requested from the augmenting reality service implementing unit through the communication network, and searching the augmented reality contents according to the request, .

In the augmented reality system using three-dimensional pattern recognition according to the present invention, the three-dimensional pattern providing unit may include general information providing unit for visually providing information printed on the planar member; A three-dimensional pattern image forming unit for forming a three-dimensional pattern for realizing an augmented reality; An edge pattern portion formed by bending the edges of the planar member or bending by the three-dimensional pattern image forming portion; And a three-dimensional pattern image forming unit or a three-dimensional marker providing unit according to a three-dimensional pattern through the edge bending or folding.

In the augmented reality system using three-dimensional pattern recognition according to the present invention, the three-dimensional marker providing unit may include a reference information providing unit for providing a reference point for providing reference information of a three-dimensional pattern; A three-dimensional marker space providing unit for providing spatial information of the three-dimensional pattern marker; A vector pattern providing unit for presenting information in accordance with a change in shape according to a degree of bending or bending of a three-dimensional pattern representation in a vector format; And a multi-dimensional pattern providing unit for providing multi-dimensional pattern image information according to a direction of recognizing the three-dimensional pattern.

In the augmented reality system using the three-dimensional pattern recognition according to the present invention, the augmented reality service implementer may include an image identification module in which the camera image of the augmented reality implementing terminal recognizes reference information of the three- Implementation of augmented reality 3D image recognition module recognizing 3 - D pattern through camera of terminal; An augmented reality engine module that extracts information corresponding to the three-dimensional pattern image through an augmented reality engine; A content linking module for providing the augmented reality content information in association with the augmented reality server through the extracted information; An augmented reality driving module for acquiring the augmented reality content information to drive an augmented reality; And an augmented reality display module for displaying the three-dimensional image information of the driven augmented reality.

In the augmented reality system using three-dimensional pattern recognition according to the present invention, the three-dimensional image recognition module may include a three-dimensional marker spatial information acquisition unit for acquiring spatial information of a three-dimensional marker; A vector data extracting unit for extracting spatial information of the three-dimensional marker by vector-based data; A three-dimensional marker decoding unit decoding the information obtained by the vector data extracting unit to reconstruct a space with a three-dimensional marker image; And a three-dimensional information providing unit for defining information recognized from the three-dimensional image as an index and providing the information to the augmented reality engine module.

In the augmented reality system using three-dimensional pattern recognition according to the present invention, when the camera recognizes and extracts vector data according to the angle of warp or bend formed on the plane of the member on which the augmented reality marker is printed, Is determined.

In the augmented reality system using three-dimensional pattern recognition according to the present invention, the content providing unit may include a central processing module for performing processing control of data of a server linked to the augmented reality service implementing unit and the outside; A database module for storing the augmented reality contents corresponding to the markers of the three-dimensional pattern for realizing the augmented reality; An application server module for interworking with an external app server for realizing an augmented reality; A communication module for communicating with the augmented reality service implementing unit and transmitting marker data corresponding to the requested three-dimensional pattern; And an application program module for processing the augmented reality contents by combining the augmented reality contents with the service contents information including the enterprise information and the advertisement information and providing the augmented reality contents to the augmented reality service implementer.

In the augmented reality system using three-dimensional pattern recognition according to the present invention, a three-dimensional marker for realizing an augmented reality by cutting a plane member for realizing an augmented reality, or forming a three-dimensional pattern by bending or bending, Is provided.

According to another aspect of the present invention, there is provided a method for realizing an augmented reality using three-dimensional pattern recognition, comprising: acquiring a reference information acquisition point; Dimensional image recognition module extracts a three-dimensional marker space image as vector data, determines whether the three-dimensional marker recognition is performed through the three-dimensional marker decoding, and transmits an index of three-dimensional information; Determining whether the object pattern defined by the index of the three-dimensional information is recognized; If the defined object pattern is recognized, extracting data by analyzing the pattern of the augmented reality engine; Providing a content corresponding to the extracted pattern analysis and extracted data to an augmented reality service implementing unit; The service implementation unit receiving the contents may implement an augmented reality corresponding to the content information; And displaying predefined simple information when the content is not received.

In the method for realizing an augmented reality using three-dimensional pattern recognition according to the present invention, a three-dimensional image recognition module includes: acquiring a three-dimensional marker space image; Extracting vector data of x, y and z axes based on positional coordinates of reference information of a plane member for realizing an augmented reality; And reconstructing the space with the 3D marker image by correcting the vector data and decoding it with the 3D marker to define the information recognized from the 3D image as an index.

The present invention relates to a method and apparatus for generating a three-dimensional image pattern by cutting or machining a portion forming a marker for realizing an augmented reality, analyzing an image pattern for realizing a dynamic change, There is an effect that can be implemented.

In addition, the augmented reality can implement contents corresponding to a more various and multidimensional pattern image through bending or bending processing in a two-dimensional augmented reality marker so as to implement various contents beyond a limited marker area.

1 is an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.
2 is a detailed block diagram of a 3D pattern providing unit in an overall configuration diagram of an augmented reality system using 3D pattern recognition according to the present invention.
FIG. 3A is a detailed block diagram of a three-dimensional marker providing unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention, FIG. 3B is an embodiment for three- to be.
FIG. 4 is a detailed block diagram of an augmented reality service implementation unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.
5 is a detailed block diagram of a 3D image recognition module in the augmented reality service implementation unit shown in FIG.
FIG. 6 is a detailed block diagram of a content providing unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.
FIG. 7 is an embodiment of applying a three-dimensional pattern to a business card in an augmented reality system using three-dimensional pattern recognition according to the present invention.
FIG. 8 shows an embodiment of a three-dimensional marker-based spatial recognition of a three-dimensional image applied to a business card including a three-dimensional pattern according to the present invention.
9 is a flowchart of a method of recognizing an augmented reality according to the present invention.
FIG. 10 is a processing flowchart of the three-dimensional image recognition module in FIG.

Hereinafter, an augmented reality system and an implementation method using three-dimensional pattern recognition according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.

Referring to FIG. 1, an augmented reality system using three-dimensional pattern recognition according to an embodiment of the present invention includes a three-dimensional pattern supplier 100 for expressing a unique pattern, An augmented reality service implementing unit 200 for recognizing a pattern, and a content providing unit 300 for storing and providing service information contents.

The three-dimensional pattern supplier 100 provides a three-dimensional marker for realizing an augmented reality by cutting a member for implementing an augmented reality, or forming a three-dimensional pattern by bending or bending.

The three-dimensional pattern providing unit expresses a unique pattern and provides a unique pattern image with a three-dimensional image.

The augmented reality service implementing unit 200 recognizes the three-dimensional pattern markers for implementing the augmented reality and drives and executes the augmented reality contents corresponding to the unique pattern of the recognized markers.

The augmented reality service implementer 200 includes two parts: a part for recognizing the augmented reality three-dimensional pattern image and an augmented reality service presentation part for a pattern of the recognized pattern.

In addition, the content provider 300 stores the augmented reality contents related to the marker of the three-dimensional pattern for implementing the augmented reality requested through the communication network from the augmented reality service implementer 200, searches the augmented reality contents according to the request, And provides it to the Augmented Reality Service Implementation Department.

The content stores service content information such as company information or advertisement and provides content corresponding to the service implementation unit.

2 is a detailed block diagram of a 3D pattern providing unit in an overall configuration diagram of an augmented reality system using 3D pattern recognition according to the present invention.

2, the three-dimensional pattern supplier 100 includes a general information providing unit 110, a three-dimensional pattern image forming unit 120, a three-dimensional marker providing unit 130, and an edge pattern unit 140 .

The general information providing unit 110 visually provides information printed on the planar member, and visually provides general information on business card information and product information.

The three-dimensional pattern image forming unit 120 forms a three-dimensional pattern for realizing an augmented reality to realize a three-dimensional image.

The three-dimensional marker providing unit 130 provides three-dimensional marker information according to the three-dimensional pattern image forming unit 120 or the three-dimensional pattern through the warping or bending.

The edge pattern unit 140 is formed by bending the edge of the plane member or by bending by the three-dimensional pattern image forming unit. The edge pattern unit 140 expresses the navigation function of the augmented reality recognition through bending or bending of the edge.

FIG. 3A is a detailed block diagram of a three-dimensional marker providing unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention, FIG. 3B is an embodiment for three- to be.

Referring to FIG. 3A, the reference information providing unit 131 provides a reference point for providing reference information of a three-dimensional pattern.

Referring to FIG. 3B, the reference information providing unit 131 of the 3D pattern providing unit 100 identifies the point of entry by recognizing the slope of the slope 131-1 when the camera approaches the four sides of the upper, lower, left, and right sides, , It is possible to provide separate reference information according to the confirmation direction of the point of entry.

The three-dimensional marker space providing unit 132 provides spatial information of the three-dimensional pattern marker. For example, the three-dimensional marker space providing unit 132 may be formed by cutting, Lt; / RTI >

The three-dimensional vector pattern providing unit 133 exposes the information in a vector format according to a change in shape according to the degree of bending or bending in the three-dimensional pattern display.

In addition, the multi-dimensional pattern providing unit 134 provides the multi-dimensional pattern image information according to the direction of recognizing the three-dimensional pattern.

FIG. 4 is a detailed block diagram of an augmented reality service implementation unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.

The augmented reality service implementing unit 200 includes an image identification module 210, a three dimensional image recognition module 220, an augmented reality engine module 230, a content interworking module 240, an augmented reality driving module 250, And a real-life display 260.

The image identification module 210 recognizes the reference information of the 3D pattern providing unit by the camera image of the augmented reality implementing terminal.

Usually, the augmented reality terminal has a camera function such as a smartphone or a tap product, and when the point of entry is extracted and the reference information is acquired, the reference information is recognized.

The three-dimensional image recognition module 220 recognizes a three-dimensional pattern through a camera of the augmented reality terminal, and recognizes a three-dimensional pattern through a camera of a smartphone or a tap product.

The augmented reality engine module 230 extracts information corresponding to the three-dimensional pattern image through an augmented reality engine.

At this time, the content linking module 240 provides the augmented reality content information corresponding to the augmented reality server through the extracted information.

The augmented reality driving module 250 acquires the augmented reality content information and drives the augmented reality.

As a result, the augmented reality display 260 displays the driven augmented reality as three-dimensional image information.

5 is a detailed block diagram of a 3D image recognition module in the augmented reality service implementation unit shown in FIG.

The three-dimensional image recognition module 220 includes a three-dimensional marker spatial information obtaining unit 221, a vector data extracting unit 222, a three-dimensional marker decoding unit 223, and a three-dimensional information providing unit 224.

The three-dimensional marker spatial information obtaining unit 221 obtains information such as a shape formed by the three-dimensional pattern image as spatial information of the three-dimensional marker.

At this time, the vector data extracting unit 222 extracts the spatial information of the three-dimensional marker by recognizing the elements of the three axes of the x-axis, the y-axis, and the z-axis and extracting the spatial information of the three-

The three-dimensional marker decoding unit 223 decodes the information obtained by the vector data extracting unit 222 to reconstruct a space with a three-dimensional marker image.

The three-dimensional information providing unit 224 defines the information recognized from the three-dimensional image as an index and provides it to the augmented reality engine module.

Here, the recognition range of the index is determined when the camera recognizes and extracts the vector data according to the angle of warp or bend formed on the plane of the member on which the augmented reality marker is printed.

FIG. 6 is a detailed block diagram of a content providing unit in an overall configuration diagram of an augmented reality system using three-dimensional pattern recognition according to the present invention.

6, the content providing unit 300 corresponds to a PC, a server or an application program and includes a central processing module 310, a database module 320, an application server module 330, a communication module 340, And an application module 350.

The central processing module 310 performs processing control of the data of the augmented reality service implementing unit and the server linked to the outside.

The database module 320 stores the augmented reality contents corresponding to the markers of the three-dimensional pattern for realizing the augmented reality.

The application server module 330 is for interworking with an external app server for realizing an augmented reality.

The communication module 340 communicates with the augmented reality service implementing unit and transmits marker data corresponding to the requested three-dimensional pattern.

The application program module 350 processes the augmented reality contents by combining the augmented reality contents with the service contents information including the enterprise information and the advertisement information, and provides the augmented reality contents to the augmented reality service implementer.

FIG. 7 is an embodiment of applying a three-dimensional pattern to a business card in an augmented reality system using three-dimensional pattern recognition according to the present invention.

Referring to FIG. 7, a three-dimensional marker for realizing an augmented reality is provided in a business card by cutting a flat member for realizing an augmented reality, or forming a three-dimensional pattern by bending or bending.

In the case of the planar state, ordinary business card information is provided as a normal business card. However, as shown in Fig. 7, a three-dimensional pattern is formed by cutting a flat member or by bending or bending, (A, B), which is recognized as a three-dimensional marker for realizing an augmented reality by a three-dimensional recognition unit through a sheath shape for a three-dimensional pattern image (A, B) (C) It provides the navigation function of reality recognition.

FIG. 8 shows an embodiment of a three-dimensional marker-based spatial recognition of a three-dimensional image applied to a business card including a three-dimensional pattern according to the present invention.

The vector data extraction method-1 of FIG. 8 classifies the index according to the change of the vector amount recognized according to the degree of warp or bending when extracting the image of FIG. 7 according to the camera direction of 131-1 shown in FIG. It is used as information of contents.

The vector data extraction method-2 of FIG. 8 extracts vector data according to viewing angles of a three-dimensional image of a rectangle, classifies the index, and utilizes the vector data as information of the corresponding content.

Therefore, multi-indexing is possible through extraction of vector data of vector data extraction method-1 and vector data extraction method-2, and various contents information through multi-index is displayed.

9 is a flowchart of a method of recognizing an augmented reality according to the present invention.

The augmented reality recognition processing method by the augmented reality recognition algorithm first obtains the reference information acquisition point 131-1 (S200).

Next, the three-dimensional image recognition module extracts the three-dimensional marker space image as vector data, determines whether the three-dimensional marker is recognized through the three-dimensional marker decoding, and transmits an index of the three-dimensional information (S210).

At this time, whether or not the object pattern of the three-dimensional information index is recognized for the object pattern defined by the index of the three-dimensional information is determined. If the object pattern is recognized, the process proceeds to the next step.

Next, when the defined object pattern is recognized, the index information recognized by the augmented reality engine is transmitted, and the augmented reality engine analyzes the object pattern according to the transmitted index information to extract data (S230).

The content providing unit provides the content corresponding to the extracted pattern analysis and extracted data to the augmented reality service implementing unit (S240).

In operation S250, the content providing unit determines whether the content corresponding to the extracted data exists. If there is content, the content providing unit displays the content corresponding to the content information as an augmented reality in operation S260.

If it is determined that the corresponding content is not held in the step S250 of determining whether the content corresponding to the extracted data is held, the content providing unit displays the preset simple information (S270).

FIG. 10 is a detailed processing flowchart of the three-dimensional image recognition module in FIG.

When the pattern acquisition algorithm is started in the three-dimensional image recognition module, a three-dimensional marker space image is obtained (S221).

Accordingly, the vector data of the x, y, and z axes are extracted by the vector data extraction engine based on the positional coordinates of the reference information of the plane member for realizing the augmented reality (S222).

Next, the data is corrected by a vector data noise reduction algorithm and decoded by a three-dimensional marker to expose the index (S223).

At this time, if there is a recognition, the presence of the 3D marker is determined, and the information recognized from the 3D image is expressed as an index, and index information is provided to reconfigure the space with the 3D marker image (S224).

Here, if there is no three-dimensional marker recognition for three times by determining whether the 3D marker is recognized three times, the pattern acquisition algorithm is terminated.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. .

100: Three-dimensional pattern providing unit 110: General information providing unit
120: 3D pattern image forming unit 130: 3D marker providing unit
131: standard information providing unit 132: three-dimensional marker space providing unit
133: Three-dimensional vector pattern providing unit 134: Multidimensional pattern providing unit
140: edge pattern unit 200: augmented reality service implementation unit
210: image identification module 220: three-dimensional image recognition module
221: 3D marker spatial information obtaining unit 222: Vector data extracting unit
223: Three-dimensional marker decoding unit 224: Three-dimensional information providing unit
230: augmented reality engine module 240: contents linking module
250: Augmented Reality Drive Module 260: Augmented Reality Display
300: Content providing unit 310: Central processing module
320: Database module 330: Application server module
340: communication module 350: application module

Claims (10)

A three-dimensional pattern providing unit for providing a three-dimensional marker for realizing an augmented reality by cutting a member for realizing an augmented reality or forming a three-dimensional pattern by bending or bending;
An augmented reality service implementation unit for recognizing a marker of a three-dimensional pattern for implementing the augmented reality and driving and executing an augmented reality content corresponding to a unique pattern of the recognized marker; And
And a contents providing unit for storing the augmented reality contents associated with the three-dimensional pattern marker for implementing the augmented reality requested by the augmented reality service implementing unit through the communication network, and searching the augmented reality contents according to the request,
Wherein the three-
A general information provision unit for visually providing information printed on the planar member;
A three-dimensional pattern image forming unit for forming a three-dimensional pattern by cutting, bending or bending of the planar member for realizing an augmented reality;
An edge pattern portion formed by the cutting of the flat member, the warping of the edge, or the folding by the three-dimensional pattern image forming portion; And
Dimensional pattern image forming unit or a three-dimensional marker providing unit according to a three-dimensional pattern through cutting, warping or bending of the plane member,
Wherein the three-dimensional marker providing unit comprises:
Providing a reference point for providing reference information of a three-dimensional pattern and providing separate reference information in accordance with a confirming direction of the point of introduction;
A three-dimensional marker space providing unit for providing spatial information of the three-dimensional pattern marker;
A vector pattern providing unit for presenting information in accordance with a change in shape according to a degree of cutting, bending, or bending of a three-dimensional pattern expression in a vector format; And
Dimensional pattern, and provides a multi-dimensional pattern image information according to a direction in which the three-dimensional pattern is recognized. delete delete The method according to claim 1,
The augmented reality service implementing unit,
An image identification module for recognizing reference information of the 3D pattern providing unit by the camera image of the augmented reality realization terminal;
Implementation of augmented reality 3D image recognition module recognizing 3 - D pattern through camera of terminal;
An augmented reality engine module that extracts information corresponding to the three-dimensional pattern image through an augmented reality engine;
A content linking module for providing the augmented reality content information in association with the augmented reality server through the extracted information;
An augmented reality driving module for acquiring the augmented reality content information to drive an augmented reality; And
And an augmented reality display module for displaying the driven augmented reality as three-dimensional image information. 5. The method of claim 4,
Wherein the three-dimensional image recognition module comprises:
A three-dimensional marker spatial information obtaining unit for obtaining spatial information of the three-dimensional marker;
A vector data extracting unit for extracting spatial information of the three-dimensional marker by vector-based data;
A three-dimensional marker decoding unit decoding the information obtained by the vector data extracting unit to reconstruct a space with a three-dimensional marker image; And
Dimensional information; and a three-dimensional information providing unit for defining information recognized from the three-dimensional image as an index and providing the information to the augmented reality engine module. 6. The method of claim 5,
Wherein the recognition range of the index is determined when the camera recognizes and extracts vector data according to an angle of bending or bending formed on the plane of the member on which the augmented reality marker is printed. The method according to claim 1,
The content providing apparatus,
A central processing module for processing and controlling data of the augmented reality service implementing unit and a server linked to the outside;
A database module for storing the augmented reality contents corresponding to the markers of the three-dimensional pattern for realizing the augmented reality;
An application server module for interworking with an external app server for realizing an augmented reality;
A communication module for communicating with the augmented reality service implementing unit and transmitting marker data corresponding to the requested three-dimensional pattern; And
And an application program module for processing the augmented reality contents by combining the augmented reality contents with the service contents information including the business information and the advertisement information and for providing the augmented reality contents to the augmented reality service implementer. Augmented reality system using. 8. The method according to any one of claims 1 to 7,
A three-dimensional marker for realizing an augmented reality is provided in a business card by cutting a flat member for realizing an augmented reality or forming a three-dimensional pattern by bending or bending to provide an augmented reality system . delete delete

Images