KR20210111956A - Apparatus and method for providing augmented reality - Google Patents

Abstract

The present invention relates to an augmented reality providing device and method and relates to an augmented reality providing device and method for providing augmented reality to a user in different ways by classifying a case where spatial recognition is performed and a case where spatial recognition is not performed based on an augmented reality recognition reference point. To this end, disclosed is an augmented reality providing device comprising: a camera unit that acquires a real background image of the user's current location; an object of interest region setting unit that sets an object of interest region that requires augmented reality implementation among the real background images; a recognition reference point generation unit that generates an augmented reality recognition reference point; an augmented reality spatial recognition determination unit that determines whether the set object of interest region is spatially recognized based on the augmented reality recognition reference point; an augmented reality merging unit that merges an augmented reality display image on the object of interest region when spatial recognition is performed based on the augmented reality recognition reference point; and an augmented reality superimposition and transparency unit that transparentizes an augmented reality superimposed image corresponding to an object of interest extracted from the object of interest region while superimposing the augmented reality superimposed image on the object of interest when spatial recognition is not performed based on the augmented reality recognition reference point.

Description

Apparatus and method for providing augmented reality

The present invention relates to an apparatus and method for providing augmented reality, and more particularly, provides augmented reality to users in different ways by distinguishing between a case where space is recognized and a case where space is not recognized based on an augmented reality recognition reference point. It relates to an augmented reality providing apparatus and providing method.

The technology disclosed in the prior patent document is a technology for simply merging an augmented reality image with the surrounding environment image by scanning a specific room and superimposing the developed augmented reality image on the physical characteristics of the scanned room to provide augmented reality to the user. It is a technology that does (KR 10-2036545).

Another technology disclosed in the prior patent document is an augmented reality technology that simultaneously displays AR overlapping information of a store A and a store A based on the recognized location of the store A (refer to FIG. 12 of KR 10-1313922).

All of the augmented reality expression technologies of the preceding patent documents described above are only technologies that provide augmented reality to users only when spatial recognition is possible based on a recognition reference point, so that augmented reality is applied to distant objects where spatial recognition is difficult. The problem is that it cannot be provided.

Republic of Korea Patent Publication KR 10-2036545 (Title of the invention: digital camera with audio, visual and motion analysis functions) Republic of Korea Patent Publication No. KR 10-1313922 (Title of the invention: information display system, information display device, information providing device, and storage medium) Korean Patent Laid-Open Publication No. KR 10-2017-0042363 (Title of the invention: system and method for generating augmented and virtual reality images) Korean Patent Laid-Open Publication No. KR 10-2012-0032336 (Title of the invention: mobile terminal and method for displaying augmented reality information thereof)

Therefore, the present invention was created to solve the above-described problems, and provides augmented reality to users in different ways for each case where spatial recognition is performed based on an augmented reality recognition reference point and when space recognition is difficult. There is a purpose.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

The above-described object of the present invention is to generate a camera unit for obtaining a live-action background image of the user's current location, an object-of-interest region setting unit for setting an object region of interest that requires augmented reality implementation among the live-action background images, and an augmented reality recognition reference point. Recognition reference point generation unit, augmented reality spatial recognition determination unit for determining whether the set object area of interest is spatially recognized based on the augmented reality recognition reference point, on the object area of interest when spatial recognition is performed based on the augmented reality recognition reference point Augmented reality merging unit that merges augmented reality display images, augmented reality overlapping image corresponding to the object of interest extracted from the object of interest region when spatial recognition is not possible based on the augmented reality recognition reference point while superimposing the object of interest on the object of interest It can be achieved by providing an augmented reality providing device, characterized in that it includes a reality overlapping and transparent unit.

In addition, the augmented reality superimposition and transparency unit receives the object of interest recognition unit for recognizing the object of interest extracted from the object of interest extraction unit, the augmented reality superimposed image corresponding to the object of interest from the database unit, and superimposes the augmented reality superimposed image on the object of interest. It includes an augmented reality overlapping unit that makes the object transparent, and an augmented reality transparent unit that makes the object of interest transparent.

In addition, the object of interest recognition unit receives the coordinates of the current location of the terminal and recognizes the current location. The object information requester requests the object information stored in the first database unit based on the recognized location, and the extracted object of interest. and an object comparator for comparing the and object information with each other, and an object recognition unit for recognizing an object matching each other according to the comparison as an object of interest.

In addition, the augmented reality overlapping unit receives an augmented reality superimposed image including a virtual image of the object of interest corresponding to the recognized object of interest from the second database unit, the augmented reality superimposed image requesting unit, augmented reality including the virtual image of the object of interest and an overlapping unit for superimposing the overlapping image on the object of interest.

In addition, an augmented reality merging realization unit that merges and displays the merged augmented reality display image with a live-action background image, and an augmented reality overlay realization unit that merges and displays an augmented reality superimposed image including a virtual image of an object of interest with a live-action background image include

In addition, the augmented reality superimposed image including the virtual image of the object of interest includes the augmented reality display image to be merged with the virtual image of the object of interest.

On the other hand, another object of the present invention is to obtain a live-action background image of the user's current location by the camera unit, the object-of-interest region setting unit setting an object-of-interest region requiring augmented reality implementation among the live-action background images, the set object region of interest The augmented reality spatial recognition determining unit determines whether spatial recognition is performed based on the augmented reality recognition reference point generated by the recognition reference point generator, augmented reality in a plurality of different ways depending on whether the object area of interest is spatially recognized. It can be achieved by providing an augmented reality providing method, including providing to the user.

In addition, in the case of providing augmented reality with a plurality of different methods to the user, when the set object area of interest is spatially recognized, augmented reality is provided to the user according to the merging of the first augmented reality providing method, and the set object area of interest is provided to the user. If this space is not recognized, augmented reality is provided to the user according to the overlapping and transparency of the second augmented reality providing method.

In addition, in the case of the second augmented reality providing method, the step of extracting the object of interest in the object of interest region by the object of interest extraction unit of interest, the object of interest recognition unit based on the location of the user and the extracted object of interest, object information stored in the database unit and Recognizing the matched object as an object of interest through comparison of , A step of transparentizing the augmented reality transparent unit to the object of interest, the rendering unit rendering the augmented reality superimposed image, the augmented reality superimposition realizing unit comprises the step of merging and displaying the augmented reality superimposed image with the actual background image.

According to the present invention as described above, there is an effect that augmented reality can be provided to the user in different ways for the case where spatial recognition is performed based on the augmented reality recognition reference point and the case where spatial recognition is difficult.

The following drawings attached to the present specification illustrate a preferred embodiment of the present invention, and serve to further understand the technical idea of the present invention together with the detailed description of the present invention, so the present invention is limited to the matters described in those drawings It should not be construed as being limited.
1 is a view showing each building located around the crossroads of the road according to an embodiment of the present invention, and a building that is space-recognized according to the user's location and a building that is difficult to recognize the space,
2 to 3 are diagrams schematically showing the configuration of an augmented reality providing apparatus according to an embodiment of the present invention,
4 is a diagram illustrating providing augmented reality to a user through a first augmented reality providing method when spatial recognition is possible according to an embodiment of the present invention;
5 is a diagram illustrating providing augmented reality to a user through a second augmented reality providing method when spatial recognition is difficult according to an embodiment of the present invention;
6 to 8 are views illustrating that the augmented reality display image is provided to the user through the second augmented reality providing method as another example of the augmented reality display image of FIG. 5,
9 to 11 are views sequentially illustrating a method of providing augmented reality to a user through the first and second augmented reality providing methods according to an embodiment of the present invention.

Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings. In addition, one embodiment described below does not unreasonably limit the content of the present invention described in the claims, and it cannot be said that the entire configuration described in the present embodiment is essential as a solution for the present invention. In addition, descriptions of the prior art and matters obvious to those skilled in the art may be omitted, and the description of the omitted components (methods) and functions may be sufficiently referenced within the scope not departing from the technical spirit of the present invention.

<Function and configuration of augmented reality providing device>

The augmented reality providing apparatus of the present invention divides an area where space is recognized and an area where space is not recognized based on the augmented reality recognition reference point. At this time, the augmented reality display image is merged with the existing live-action background image to be displayed in the area where the space is recognized. On the other hand, in an area where spatial recognition is not possible, augmented reality is implemented by superimposing and transparent the augmented reality display image and the augmented reality superimposed image including the virtual image of the object of interest with the object of interest. Hereinafter, an augmented reality providing apparatus according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

As shown in FIG. 1 , the terminal user 10 may walk a specific distance with his/her terminal. In this case, the terminal of the present invention includes, but is not limited to, a smartphone, tablet, or laptop including a GPS and a camera. However, in the present invention, an example of a smart phone will be described. As shown in FIG. 1, 'A' building 11, 'B' building 12, 'C' building 13, and 'D' building 14 are visible around the crossroad, and user 10 You are crossing the crosswalk in front of Building B (12).

Based on the current location of the user 10, it is assumed that the area near the building B 12 is an area where spatial recognition is possible based on the augmented reality recognition reference point, the area A building 11, the area C building 13, and the building D (14) The area is assumed to be an area where spatial recognition is impossible because the recognition distance is far based on the augmented reality recognition reference point. Hereinafter, the building A 11 in the area of the building A 11 where space recognition is impossible and the building B 12 in the area of the building B 12 where the space recognition is possible will be described as examples.

As shown in FIG. 2 , the terminal unit 100 includes a camera unit 111 . The camera unit 111 continuously displays the actual background image on the display unit of the terminal unit in real time by photographing the actual background in the camera shooting area of the user's current location. It is possible to provide augmented reality by merging the augmented reality display image with the actual background image taken by the camera unit 111, and continuously provide augmented reality while continuously tracking. At this time, in order to provide the augmented reality to the user, as described above, the space recognition area may be divided into a space recognition area area and the space recognition area impossible area may be provided in two ways.

The object-of-interest region setting unit 120 sets an object-of-interest region requiring augmented reality implementation among the live-action background images input from the camera unit 111 . As for the object of interest region, a specific region may be set by a user's manual setting, or the terminal unit 100 may automatically set a specific region included in the live-action background image according to a pre-programmed program. A plurality of objects may be included in the set object of interest region. In this case, the object may be an object from which features such as a commercial building, a street light, a road, a signboard, a traffic light, etc. can be extracted as an example.

The recognition reference point generator 130 generates an augmented reality recognition reference point. The augmented reality recognition reference point can be implemented with a mart or markless, and serves as the reference point for augmented reality spatial recognition.

The augmented reality spatial recognition determination unit 140 determines whether the set object region of interest is spatially recognized based on the augmented reality recognition reference point. At this time, the augmented reality is provided in two ways, which will be described later, depending on whether the space is recognized.

First, a case in which the set object region of interest is spatially recognized based on the augmented reality recognition reference point will be described.

The augmented reality merging unit 150 merges the augmented reality display image with the object of interest extracted by the object of interest extractor 160 on the object of interest region when spatial recognition is performed based on the augmented reality recognition reference point. That is, referring to FIG. 4 , in this example, building B 12 is an object of interest located on an area where augmented reality spatial recognition is possible, and the extracted object of interest is building B 12 of FIG. 1 . Therefore, the augmented reality merging unit 150 merges the augmented reality display image 12a "the building 'A'" into the building B 12, which is an object of interest. Of course, the augmented reality display image 12a may include various contents. For example, when building B 12 is a restaurant building, business hours and a lunch menu or a dinner menu may be changed and displayed according to time.

The augmented reality merge implementation unit 171 may provide the augmented reality to the user by displaying the augmented reality display image 12a together with the live-action background image.

Meanwhile, a case in which spatial recognition of the set object region of interest is not based on the augmented reality recognition reference point will be described below.

The augmented reality superimposition and transparency unit 170 makes the augmented reality superimposed image corresponding to the object of interest extracted from the object of interest region transparent while being superimposed on the object of interest when spatial recognition is not performed based on the augmented reality recognition reference point. The augmented reality overlapping and transparent unit 150 will be described in more detail as follows, and will be described with reference to FIGS. 1 and 5 .

The object-of-interest extractor 160 extracts the object of interest from the set object-of-interest region. There may be two or more objects of interest to be extracted at the same time. In this embodiment, the extracted object of interest is the building A 11 of FIG. 1 . Of course, multiple objects within the object-of-interest region may be selected simultaneously.

The object of interest recognition unit 171 recognizes the extracted object of interest. In this case, the object of interest recognition unit 171 includes a location recognition unit, an object information request unit, an object comparison unit, and an object recognition unit.

The location recognition unit receives the location coordinates of the current terminal from the GPS unit 112 and recognizes the current location of the terminal or the user. It is possible to extract some target object information from the database unit, which will be described later, only when the current location is known. If the current location is not known, data processing may be burdened because it is necessary to compare a number of arbitrary object information included in the database unit one-to-one.

The object information request unit requests object information pre-stored in the first database unit based on the recognized location. That is, referring to FIGS. 1 and 3 , the object information requesting unit requests the map/building information server unit 210 for building information within a preset coordinate distance based on the location coordinates of the terminal of the current user 10 . The map/building information server unit 210 receives building information within the requested coordinate distance from the first database unit and transmits it back to the object information request unit. As described above, when information is not requested based on the location information of the terminal, all of the information of an unspecified number of buildings must be received and compared, so that the burden of data processing may be increased. However, the object information requesting unit may request building information within a preset coordinate distance based on the location base of the terminal, or may request building information based on the reference point of the user or the terminal obtained in another way. Here, the requested building information may be information including a comparison image that can be compared with the extracted object of interest, building description information, building location coordinates, and the like.

The object comparison unit compares the extracted object of interest with the received building information. That is, the extracted object of interest is the building A 11 , and the received building information may be a plurality of building information within a preset coordinate distance located in the area near the building A 11 . The object comparison unit finds matching building information by comparing each other one-to-one. In the comparison, as an example, a matching object may be found by comparing the extracted image of the object of interest and the building image included in the building information to determine whether or not matching is performed. Alternatively, by comparing the extracted location coordinates of the object of interest with the location coordinates of the building included in the building information, it is possible to determine whether they match.

The object recognition unit recognizes an object matching each other as an object of interest according to the comparison result.

The augmented reality overlay unit 172 receives an augmented reality superimposed image including a virtual image of the object of interest corresponding to the extracted object of interest from the database unit, and applies the augmented reality superimposed image including the virtual image of the object of interest to the object of interest. overlap The augmented reality overlapping unit 172 includes an augmented reality overlapping image request unit and an overlapping unit.

The augmented reality superimposed image request unit requests the augmented reality superimposed image server unit 220 for an augmented reality superimposed image including a virtual image of an object of interest corresponding to the object of interest recognized by the object recognition unit. The augmented reality superimposed image server unit 220 transmits the requested augmented reality superimposed image received from the second database unit to the augmented reality superimposed image request unit. 1 and 3, the augmented reality superimposed image request unit receives the augmented reality superimposed image of building A corresponding to the building A 11 recognized by the object recognition unit as an augmented reality superimposed image server unit 220 ) to request The augmented reality superimposed image server unit 220 receives the augmented reality superimposed image of building A from the second database unit and transmits it back to the augmented reality superimposed image request unit. At this time, the augmented reality superimposed image of building A includes an augmented reality display image to be merged with the virtual image of building A.

The overlapping unit superimposes the augmented reality superimposed image including the virtual image of the object of interest on the object of interest. That is, the augmented reality display image tagged with the virtual image of building A and the virtual image of building A included in the augmented reality superimposed image is overlapped with the building A displayed on the actual background image. According to the overlap of the overlapping part, the virtual image of the building A and the augmented reality display image are superimposed on the building A 11 of the actual background image. The augmented reality display image may connect various augmented reality images according to the tagged building. As an example, in the case of a restaurant, food information may be tagged, and in the case of a movie theater, a running time and a preview of a movie (movie introduction video) may be tagged.

The augmented reality transparent unit 173 makes the A building 11 of the live-action background image transparent. Only the virtual image of the building A and the virtual image of the building A and the tagged augmented reality display image remain by the transparency of the building A 11 of the live-action background image.

Specifically, comparing FIGS. 1 and 5 , building A 11 of FIG. 1 is an image or image of building A 11 included in the live-action background image taken by the camera unit 111 . In contrast, FIG. 5 is an image or image showing that the augmented reality superimposed image 11a of the building A is merged with the live-action background image taken by the camera unit 111 and displayed. That is, the augmented reality superimposed image 11a of building A includes a virtual image of building A and first and second augmented reality display images 11a-2 and 11a-2). By being overlapped and transparent by the augmented reality overlapping unit and the transparent unit (172,173), the building A 11 is made transparent and the augmented reality superimposed image 11a of the building A is merged with the live-action background image taken by the camera unit 111 and augmented provides reality. At this time, assuming that building A is a movie theater, as an example, the augmented reality first displayed image 11a-2 may be an augmented reality preview video introducing a screened movie, and the augmented reality second displayed image 11a-3 is a movie It may be augmented reality information that provides a running time.

On the other hand, as a method of displaying the merged augmented reality display image differently, referring to FIGS. 6 to 8 , the augmented reality first display image 11a-2 is first displayed on the leftmost side (refer to FIG. 6 ) and sequentially illustrated one by one. 7 and 8 may be displayed. In this case, the virtual image of the building A and the three augmented reality first display images may be tagged, respectively. In the sequentially displayed augmented reality first display images 11a-2, the same image may be repeatedly displayed while moving positions, or different augmented reality display images may be sequentially displayed while changing positions. .

The 3D rendering unit 174 renders a virtual image of building A, a virtual image of building A, and a tagged augmented reality display image.

Augmented reality overlap implementation unit 182 merges the rendered virtual image of building A, the virtual image of building A, and the tagged augmented reality display image with the live-action background image so that the user can experience augmented reality on the display unit of the terminal. It tracks augmented reality while continuously updating the augmented reality recognition reference point.

(Augmented reality provision method)

The augmented reality providing method according to an embodiment of the present invention will be described step by step sequentially with reference to FIGS. 9 to 11 .

Referring to FIG. 9 , the camera unit 111 acquires a live-action background image of the user's current location (S10).

Next, the object-of-interest region setting unit 120 sets the region of the object of interest that needs to be implemented in augmented reality among the live-action background images (S20).

Next, the augmented reality spatial recognition determination unit 140 determines whether the area of interest set based on the augmented reality recognition reference point becomes spatial recognition (S30).

Next, in two different methods (a first augmented reality providing method when spatial recognition is achieved and a second augmented reality providing method when spatial recognition is not performed) depending on whether the object region of interest set in step S30 is spatially recognized. Augmented reality is provided to the user through a plurality of augmented reality providing methods (S40).

FIG. 10 sequentially shows a method of providing augmented reality to a user through the first augmented reality providing method when the object region of interest set in step S30 of FIG. 9 is spatially recognized. Steps S10 to S30 of FIG. 9 are the same, and the remaining first augmented reality providing method will be described.

When the object region of interest is spatially recognized, the augmented reality merge implementation unit 181 provides augmented reality together with the actual background image by merging the augmented reality display image with the selected object of interest extracted from the object of interest region as a first augmented reality providing method. do (S412).

When the object region of interest is not spatially recognized, the augmented reality superimposition implementation unit 182 provides the augmented reality to the user according to the procedure shown in FIG. 11 as a second augmented reality providing method. Steps S10 to S30 are the same as in FIG. 9 , and the remaining parts will be described.

The object-of-interest extracting unit 160 extracts the object of interest within the object-of-interest region, and the object-of-interest recognition unit 171 compares the user's location and the extracted object of interest with object information previously stored in the database unit. The matched object is recognized as the object of interest (S42).

Next, the augmented reality overlapping unit 172 calls the augmented reality overlapping image corresponding to the extracted and selected object of interest from the database unit (S43).

Next, the augmented reality overlapping unit 172 overlaps the extracted selected object of interest and the augmented reality superimposed image, and at the same time, the augmented reality transparent unit 173 makes the extracted and selected object of interest transparent (S44).

Next, the 3D rendering unit 174 renders the augmented reality superimposed image (S45).

Next, the augmented reality overlap implementation unit 182 provides the augmented reality to the user as a second augmented reality providing method by merging the augmented reality superimposed image with the live-action background image.

In the description of the present invention, the description may be omitted for matters obvious to those skilled in the art and those skilled in the art, and the description of these omitted components (methods) and functions will be sufficiently referenced within the scope not departing from the technical spirit of the present invention. will be able In addition, the above-described components of the present invention have been described for convenience of description of the present invention, and components not described herein may be added within a range that does not depart from the technical spirit of the present invention.

The description of the configuration and function of each part has been described separately for convenience of description, and if necessary, any configuration and function may be implemented by being integrated into other components, or may be implemented in more subdivision.

As mentioned above, although it has been described with reference to one embodiment of the present invention, the present invention is not limited thereto, and various modifications and applications are possible. That is, those skilled in the art will readily understand that many modifications are possible without departing from the gist of the present invention. In addition, if it is determined that the detailed description of the known functions related to the present invention and its configuration or the coupling relationship for each configuration of the present invention may unnecessarily obscure the gist of the present invention, it should be noted that the detailed description is omitted. something to do.

11a-1: Virtual Image of Building 'A'
11a-2: Augmented reality first display image: Screened movie preview
11a-3: Augmented reality second display image: Running time
12 : Building B
12a: augmented reality display image
13 : Building C
14 : D building
100: terminal unit
111: camera unit
112: GPS unit
120: object area of interest setting unit
130: recognition reference point generation unit
140: augmented reality spatial recognition judgment unit
150: augmented reality merging unit
160: interest object extraction unit
170: augmented reality superimposed and transparent
171: object of interest recognition unit
172: augmented reality overlap
173: augmented reality transparent
174: 3D rendering unit
180: implementation
181: Augmented Reality Merge Implementation Unit
182: Augmented reality superimposed realization unit
200: server unit
210: map and building information server unit
220: augmented reality superimposed image server unit

Claims (9)

A camera unit that acquires a live-action background image of the user's current location,
An object-of-interest region setting unit for setting an object-of-interest region requiring augmented reality implementation among the live-action background image;
A recognition reference point generating unit that generates an augmented reality recognition reference point,
Augmented reality spatial recognition determining unit for determining whether the set object region of interest is spatially recognized based on the augmented reality recognition reference point;
Augmented reality merging unit for merging the augmented reality display image on the object region of interest when spatial recognition is performed based on the augmented reality recognition reference point;
It comprises an augmented reality superimposition and transparency unit that transparently overlaps the augmented reality superimposed image corresponding to the object of interest extracted from the object of interest region when spatial recognition is not performed based on the augmented reality recognition reference point on the object of interest. Augmented reality providing device.
The method of claim 1,
The augmented reality overlapping and transparent unit,
an object of interest recognition unit for recognizing the object of interest extracted by the object of interest extraction unit;
An augmented reality overlapping unit that receives the augmented reality overlapping image corresponding to the object of interest from the database unit, and superimposes the augmented reality overlapping image on the object of interest;
Augmented reality providing device, characterized in that it comprises an augmented reality transparent unit for making the object of interest transparent.
3. The method of claim 2,
The object of interest recognition unit,
A location recognition unit for recognizing the current location by receiving the coordinates of the current location of the terminal;
an object information request unit for requesting object information pre-stored in the first database unit based on the recognized position;
an object comparison unit that compares the extracted object of interest and the object information with each other;
Augmented reality providing apparatus, characterized in that it comprises an object recognition unit for recognizing the object matching each other according to the comparison as the object of interest.
4. The method of claim 3,
The augmented reality overlapping unit,
an augmented reality superimposed image request unit that receives an augmented reality superimposed image including a virtual image of an object of interest corresponding to the recognized object of interest from a second database unit;
Augmented reality providing apparatus comprising an overlapping unit for superimposing the augmented reality superimposed image including the virtual image of the object of interest on the object of interest.
5. The method of claim 4,
Augmented reality merge realization unit that merges and displays the merged augmented reality display image with the live-action background image;
Augmented reality providing apparatus, characterized in that it further comprises an augmented reality superimposed realizing unit for merging and displaying the augmented reality superimposed image including the virtual image of the object of interest together with the actual background image.
6. The method of claim 5,
The augmented reality superimposed image including the virtual image of the object of interest is,
Augmented reality providing apparatus comprising an augmented reality display image to be merged with the virtual image of the object of interest.
step of the camera unit acquiring a live-action background image of the user's current location,
The step of setting an object of interest region setting unit of interest in which augmented reality implementation is required among the live-action background image,
The augmented reality spatial recognition determining unit determining whether the set object region of interest is spatially recognized based on the augmented reality recognition reference point generated by the recognition reference point generating unit;
Augmented reality providing method comprising providing augmented reality to a user in a plurality of different ways depending on whether the object region of interest is spatially recognized.

8. The method of claim 7,
In the case of providing augmented reality to the user by using the plurality of different methods,
When the set object area of interest is spatially recognized, augmented reality is provided to the user according to the merging of the first augmented reality providing method,
Augmented reality providing method, characterized in that the augmented reality is provided to the user according to the overlapping and transparency of the second augmented reality providing method when the set object region of interest is not spatially recognized.
9. The method of claim 8,
In the case of the second augmented reality providing method,
extracting an object of interest in the object of interest region by an object of interest extraction unit;
Recognizing, by the object of interest recognition unit, the matched object as the object of interest through comparison with object information pre-stored in the database unit based on the user's location and the extracted object of interest;
The augmented reality overlapping unit retrieving the augmented reality overlapping image corresponding to the object of interest from the database unit;
The augmented reality overlapping unit overlaps the object of interest and the augmented reality overlapping image, and the augmented reality transparent unit transparentizes the object of interest;
The rendering unit rendering the augmented reality superimposed image,
Augmented reality providing method, characterized in that it comprises the step of displaying the augmented reality superimposition realizing unit merged the augmented reality superimposed image with the actual background image.

Images