KR101912241B1 - Augmented reality service providing apparatus for providing an augmented image relating to three-dimensional shape of real estate and method for the same - Google Patents

Abstract

The present invention relates to an augmented reality service providing method executed by a user terminal. According to an embodiment of the present invention, the augmented reality service providing method includes the steps of: (a) receiving real estate information and two-dimensional polygon data corresponding to the location information of the user terminal from a server; (b) generating three-dimensional polygon data based on the two-dimensional polygon data and building height information included in the real estate information; (c) overlapping a rendered image of the three-dimensional polygon data and a real-time image obtained from a camera of the user terminal to provide the overlapped images onto the screen of the user terminal; and (d) providing the detailed real estate information corresponding to the three-dimensional polygon data. The two-dimensional polygon data are related to the shape of the real estate areas while the three-dimensional polygon data are three-dimensional shapes of the real estate.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an augmented reality service providing apparatus and a method for providing an augmented reality image related to a three-

The present invention relates to an augmented reality service providing apparatus and method for providing an augmented reality image related to a three-dimensional shape of a real estate, and more particularly, to a method and apparatus for providing augmented reality service image by providing a more intuitive ≪ / RTI >

2. Description of the Related Art Recently, with the rapid development of mobile communication technology and the popularization of communication terminals, most users possess and use communication terminals that perform multifunctional functions. Further, communication terminals include a smart phone As a trend in this field, an operating system (OS) for supporting various applications, voice / data communication, and PC interworking is mounted so that a user can freely use the Internet through a communication terminal.

Accordingly, the user moves without any restriction on the location, and the residential property information of the area is more resiliently confirmed using the communication terminal, and the information confirmation method using the communication terminal is increasing rapidly.

In the case of real estate information provided in the past, only the extremely limited information can be checked because the real estate sale information is transmitted or retrieved by simply connecting to the server through the Internet communication network. Therefore, the information information is insufficient, It is difficult to compare and select, and there is a problem that the reality and the effectiveness are remarkably deteriorated.

To solve this problem, it is possible to transmit more realistic real estate information by using Augmented Reality (AR) technology which combines virtual objects and information in real environment and looks like objects existing in original environment.

Korean Patent No. 10-1693631 (entitled " Real estate information providing system using augmented reality "

It is an object of the present invention to provide real estate information more intuitively and realistically by using the augmented reality technology.

According to another aspect of the present invention, there is provided a method for providing an augmented reality service, the method comprising the steps of: (a) receiving real-estate information corresponding to location information of a user terminal from a server, ; (b) generating three-dimensional polygon data based on building height information and two-dimensional polygon data included in the real estate information; (c) superimposing the rendered image of the real-time image and the 3D polygon data obtained from the camera of the user terminal on the screen of the user terminal; And (d) providing real estate detailed information corresponding to the three-dimensional polygon data, wherein the two-dimensional polygon data is data on the shape of the area of the real estate, and the three-dimensional polygon data is data on the three- Lt; / RTI >

According to another aspect of the present invention, there is provided a method of providing an augmented reality service, the method including: receiving location information from a user terminal; Providing real estate information and two-dimensional polygon data corresponding to the location information to the user terminal so that the three-dimensional polygon data is generated by the user terminal; And providing real estate detailed information corresponding to the three-dimensional polygon data to the user terminal when receiving a request to provide real estate detailed information on the three-dimensional polygon data determined as the display target among the plurality of three-dimensional polygon data from the user terminal Wherein the display object is three-dimensional polygon data having a display area including a center point of a real-time image provided by a user terminal among a plurality of three-dimensional polygon data, Dimensional polygon data is an area covering a real-time image when each rendered image of the three-dimensional polygon data is provided, the two-dimensional polygon data is data relating to the shape of the real estate area, and the three- Lt; / RTI >

According to another aspect of the present invention, there is provided an apparatus for providing an augmented reality service, which provides an augmented reality image relating to a three-dimensional shape of a real estate, including: a memory for storing a program for performing the augmented reality service providing method; And a processor for executing the program, wherein the processor receives the real estate information and the two-dimensional polygon data corresponding to the location information of the user terminal from the database server by executing the program, Dimensional polygon data based on the information and the two-dimensional polygon data, superimposes the rendered images of the real-time image and the three-dimensional polygon data obtained from the camera of the user terminal on the screen of the user terminal, Dimensional polygon data is data on the shape of the real estate area, and the three-dimensional polygon data is data on the three-dimensional shape of the real estate.

According to the ARP service providing apparatus and method according to an embodiment of the present invention, a real-time image obtained in real time through a camera, information on a specific building, and whether the building is on a real- Thereby providing a more intuitive augmented reality service.

According to another aspect of the present invention, there is provided an apparatus and method for providing an augmented reality service, wherein when a direction of a camera of a user terminal changes, a focus on a building located at the center of the camera screen is visually displayed, By providing information about the building, it is possible to provide a more realistic real estate augmented reality service.

In addition, according to the apparatus and method for providing an augmented reality service according to an embodiment of the present invention, by performing correction on remaining polygon data based on a result of performing optical recognition correction on one polygon data, It is possible to perform the optical recognition correction.

1 is a diagram illustrating a configuration of an augmented reality service providing system according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a server according to an embodiment of the present invention.
3 is a diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.
4 is a flowchart illustrating a method of providing an augmented reality service performed by a server according to an embodiment of the present invention.
5 is an operational flowchart illustrating a method of providing an augmented reality service performed by a user terminal according to an embodiment of the present invention.
6 is a diagram illustrating an augmented reality image according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating an embodiment of performing optical recognition correction on the augmented reality image generated in FIG.
8 to 10 are examples of an augmented reality service screen according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

In the entire description, the server 100 may denote an augmented reality service providing server, and the user terminal 200 may denote an augmented reality service providing apparatus.

The following examples are intended to further illustrate the present invention and are not intended to limit the scope of the present invention. Accordingly, the same scope of the invention performing the same function as the present invention will also fall within the scope of the present invention.

1 is a diagram illustrating a configuration of an augmented reality service providing system 1 according to an embodiment of the present invention.

Referring to FIG. 1, an augmented reality service providing system 1 according to an embodiment of the present invention includes a server 100 and a user terminal 200. And a communication network 300 interconnecting the server 100 and the plurality of user terminals 201 and 202.

The server 100 according to an embodiment of the present invention provides map data and real estate information to the user terminal 200 so that the real estate augmented reality service can be provided through the terminal application installed in the user terminal 200, The user terminal 200 displays the augmented reality image and the real estate information on the image obtained in real time through the camera of the user terminal 200 based on the information provided from the server 100. [

First, the server 100 may provide real estate information and map data to the user terminal 200.

Here, the real estate information may include information such as the name, kind, address, area, and additional facilities of the real estate.

In addition, the real estate information may further include information according to the type of the real estate. For example, if the type of the real estate is a building, it may further include the number of buildings. If the type of the real estate is land, Whether the vehicle is permitted or not, and whether or not there is an entry road.

Here, the map data is information used for displaying the map image by the user terminal 200, and may be raster map data or vector map data.

For example, when the map data is raster data in the form of a tile image, the map image may be an image formed by connecting the tile images. If the map data is vector data in the form of text or binary data, The image may be an image constructed by rendering the corresponding vector data.

Further, the map data may further include polygon data.

The polygon data is information used to render an image displayed as an upper layer than a map image in order to emphasize an object corresponding to a specific real estate in the map image when the map image is displayed by the user terminal 200 And may be coordinate information corresponding to a planar area of the real estate object or an outline of the real estate object.

In particular, the server 100 may provide the user terminal 200 with information for generating three-dimensional polygon data.

Here, the information for generating the 3D polygon data may include the location information of the real estate included in the real estate information, the height information of the real estate (e.g., building), and the two-dimensional polygon information included in the map data.

Here, the two-dimensional polygon data is data on the shape of the area of the real estate, and the three-dimensional polygon data may be data on the three-dimensional shape of the real estate.

The user terminal 200 can display the information provided from the server 100 through the augmented reality service application.

The AR service application may be an application embedded in the user terminal 200 or an application downloaded from the application distribution server and installed in the user terminal 200. [

The plurality of user terminals 200 refers to a communication terminal that can use a terminal application in a wired / wireless communication environment. Here, the user terminal 200 may be a user's portable terminal. 1, the user terminal 200 is a smart phone, which is a type of portable terminal. However, the present invention is not limited to this, and the terminal capable of loading the terminal application, as described above, Can be borrowed.

In more detail, the user terminal 200 may include any type of handheld computing device (e.g., PDA, email client, etc.), any form of mobile phone, or any other type of computing or communication platform However, the present invention is not limited thereto.

Meanwhile, the communication network 300 plays a role of connecting the server 100 and the user terminals 200. That is, the communication network 300 refers to a communication network that provides connection paths so that the user terminals 200 can access the server 100 and then send and receive data. The communication network 300 may be a wired network such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), ISDNs (Integrated Service Digital Networks), wireless LANs, CDMA, Bluetooth, But the scope of the present invention is not limited thereto.

2 is a diagram illustrating a configuration of a server 100 according to an embodiment of the present invention.

Referring to FIG. 2, a server 100 according to an exemplary embodiment of the present invention includes a communication module 110, a memory 120, a processor 130, and a database 140.

In detail, the communication module 110 provides a communication interface necessary for providing a transmission / reception signal between the server 100 and the user terminal 200 in the form of packet data in cooperation with the communication network 300. Further, the communication module 110 may perform a role of receiving a data request from the user terminal 200 and transmitting data as a response thereto.

Here, the communication module 110 may be a device including hardware and software necessary to transmit / receive a signal such as a control signal or a data signal through a wired / wireless connection with another network device.

The memory 120 stores a program for performing the augmented reality service providing method. In addition, the processor 130 performs a function of temporarily or permanently storing data to be processed. Here, the memory 120 may include magnetic storage media or flash storage media, but the scope of the present invention is not limited thereto.

The processor 130 controls the entire process of providing real estate augmented reality services as a kind of central processing unit. Each step performed by the processor 130 will be described later with reference to FIG.

Here, the processor 130 may include any kind of device capable of processing data, such as a processor. Herein, the term " processor " may refer to a data processing apparatus embedded in hardware, for example, having a circuit physically structured to perform a function represented by a code or an instruction contained in the program. As an example of the data processing apparatus built in hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated circuit (ASIC) circuit, and a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

The database 140 includes at least one of map data and real estate information for providing to the user terminal 200. [

The concrete contents of the map data and the real estate information are as described above with reference to Fig.

In addition, the database 140 may further include additional information for providing a separate page when the user terminal 200 requests total information on a specific real estate.

Here, the additional information may further include price information, store information, investment information, nearby transaction examples, and location information in addition to the above-mentioned real estate information.

Although not shown in FIG. 2, some of the map data and real estate information may be stored in a database (not shown) that is physically or conceptually separated from the database 140.

3 is a diagram illustrating a configuration of a user terminal 200 according to an embodiment of the present invention.

Referring to FIG. 3, a user terminal 200 according to an embodiment of the present invention includes a communication module 210, a memory 220, a processor 230, and a display device 240.

The description of the communication module 110, the memory 120 and the processor 130 described above with reference to FIG. 2 is omitted for the communication module 210, the memory 220 and the processor 230, .

In detail, the communication module 210 provides a communication interface necessary to provide a transmission / reception signal between the server 100 and the user terminal 200 in the form of packet data in cooperation with the communication network 300. Further, the communication module 210 may transmit a data request to the server 100 and receive data in response thereto.

The memory 220 stores a program for performing the augmented reality service providing method. In addition, the processor 230 performs a function of temporarily or permanently storing data to be processed.

At this time, the program for performing the augmented reality service providing method recorded in the memory 120 and the memory 220 may be different.

The processor 230 controls the entire process of providing real estate augmented reality services as a kind of central processing unit. Each step performed by the processor 230 will be described later with reference to FIG.

The display device 240 performs a function of displaying an execution screen of the augmented reality service application. Embodiments corresponding to the execution screen of the augmented reality service application will be described later with reference to Figs.

4 is an operational flowchart illustrating a method of providing an augmented reality service performed by the server 100 according to an embodiment of the present invention.

Here, a program for performing each step of FIG. 4 is recorded in the memory 120, and the program is executed by the processor 130, whereby the ARF service providing method can be performed.

Referring to FIG. 4, the server 100 receives location information of the user terminal 200 (S410).

At this time, the server 100 may periodically receive location information from the user terminal 200. [

Next, the server 100 provides the real estate location, height information, and two-dimensional polygon data corresponding to the location information to the user terminal 200 (S420).

At this time, the location, height information, and two-dimensional polygon data of a specific real estate may be converted by the user terminal 200 into an augmented reality image.

Here, the augmented reality image may be an image rendered of three-dimensional polygon data generated based on height information and two-dimensional polygon data.

Next, the server 100 is converted into an augmented reality image, and provides real estate detailed information on the real estate to be displayed to the user terminal 200 (S430).

In operation S430, when the server 100 is to display one of the augmented reality images, the server 100 may provide the user terminal 200 with detailed real estate information corresponding to the augmented reality image.

At this time, the request to provide the real estate detailed information is determined by the user terminal 200 to determine one of the plurality of augmented reality images to be displayed based on the position information and the camera direction information of the user terminal 200, When the augmented reality image is displayed on the screen of the user terminal 200, the server 100 may receive the real estate identification code corresponding to the augmented reality image from the user terminal 200. [

Although not shown in FIG. 4, when the server 100 receives a request for providing all-real-estate information by selecting and inputting the entire information request button included in the pop-up window, the server 100 provides the real- (Not shown).

In addition, when the server 100 receives a request for providing a map image by selecting and inputting a screen switching button included in a screen of the user terminal 200, in order to switch from a conventional augmented reality screen to a map screen, And providing the map data to the user terminal 200 (not shown).

5 is an operational flowchart illustrating a method of providing an augmented reality service performed by a user terminal 200 according to an embodiment of the present invention.

Here, a program for performing each step of FIG. 5 is recorded in the memory 220, and the program is executed by the processor 230, so that the augmented reality service providing method can be performed.

Referring to FIG. 5, the user terminal 200 receives real estate information and two-dimensional polygon data corresponding to the location information of the user terminal 200 from the server 100 (S510).

In operation S510, the user terminal 200 may receive information from the server 100, which is located within the download target area within a predetermined reference distance from the user terminal location included in the location information.

For example, when the reference distance is 200 m, the download target area corresponds to 0 to 200 m, and when the reference distance is 300 m, the download target area corresponds to 0 to 300 m.

Here, the reference distance may be 200 m or 300 m, but the present invention is not limited thereto, and the reference distance may be selected by the user.

As an alternative embodiment, the download subject area may be a specific distance section within a reference distance.

For example, when the distance is 100 m and the reference distance is 200 m, the download target area corresponds to 100 m to 200 m, and when the reference distance is 300 m, the download target area corresponds to 200 m to 300 m.

Here, the distance interval may be 100 m, but the present invention is not limited thereto, and the distance interval may be selected by the user.

If it is determined that the user terminal 200 has moved beyond the predetermined reference distance from the position of the existing user terminal 200 after the step S510, Real estate information and two-dimensional polygon data corresponding to the information can be received.

Here, the reference distance may be 10 m or 20 m, but the present invention is not limited thereto, and the reference distance may be selected by the user.

For example, in the case where the reference distance is 10 m, if the user terminal 200 determines that the user terminal 200 has moved to the second position away from the first position where the real estate information and the two-dimensional polygon data were acquired the previous time, It is possible to transmit a new second location to the server 100, and newly acquire real estate information and two-dimensional polygon data corresponding to the second location.

Next, the user terminal 200 generates three-dimensional polygon data based on the building height information and the two-dimensional polygon data included in the real estate information (S520).

In step S520, the user terminal 200 may generate the three-dimensional polygon data so as to correspond to the hexahedron having the floor surface and the building height corresponding to the two-dimensional polygon data.

In step S520, the user terminal 200 may generate a plurality of three-dimensional polygon data based on the real estate information and the two-dimensional polygon data corresponding to the plurality of real properties.

Although not shown in FIG. 5, after step S520, the user terminal 200 further includes a step (not shown) of correcting the three-dimensional polygon data based on the optical recognition result on the real-time image obtained from the camera can do.

Here, in the following embodiments, the step of correcting the three-dimensional polygon data (not shown) is performed in the background of the user terminal 200, so that the three-dimensional polygon data being corrected may not be displayed to the user.

Here, the step of correcting the three-dimensional polygon data (not shown) detects the building corners and vertices of the real-time image, corrects the three-dimensional polygon data so that the rendered image of the three- .

As an alternative embodiment, when a plurality of three-dimensional polygon data are generated in step S520, in the step of not correcting the three-dimensional polygon data (not shown), the user terminal 200 may calculate The calculated correction information may be stored while performing the correction, and other three-dimensional polygon data may be corrected based on the stored correction information.

That is, based on the result of the correction performed for one polygon data, correction for the entire polygon data can be performed.

Thus, according to an embodiment of the present invention, the correction for the remaining polygon data is performed based on the result of performing the optical recognition correction on one polygon data, so that the optical recognition correction can be performed with a smaller amount of calculation have.

As an alternative embodiment, in the step of correcting the three-dimensional polygon data (not shown), the user terminal 200 provides a guidance message for moving the camera up, down, left, and right, and, based on the changed real- Mapping can be performed.

In this case, the user terminal 200 may display a rendered image of the uncorrected three-dimensional polygon data at the center of the screen of the user terminal 200, and may provide a guidance message containing the name of the building contained in the real estate information have.

That is, by displaying the rendered image of the uncorrected three-dimensional polygon data (for example, the augmented reality image before correction) together with the real estate information for the image together, the user can be guided to what building the image is for .

Accordingly, even when the actual position and direction of the user are different from the values obtained through the GPS or the gyro sensor of the user terminal, the method of providing the augmented reality service according to an embodiment of the present invention allows the user to input polygon data So that it is possible to stably provide an augmented reality image.

5, if a plurality of three-dimensional polygon data is generated in step S520, the user terminal 200 may display three-dimensional polygon data having a display area including a center point of the real- (Not shown) for detecting the polygon data.

Here, the display area may refer to an area covering a real-time image when rendered images of each of a plurality of three-dimensional polygon data are provided.

In the step of detecting three-dimensional polygon data (not shown), if there are a plurality of three-dimensional polygon data having a display area including a center point of the real-time image, the user terminal 200 obtains the center point of the real- It is possible to detect the three-dimensional polygon data corresponding to the display area having the shortest distance between the three-dimensional polygon data.

In an alternative embodiment, the step of detecting three-dimensional polygon data (not shown) may be performed with the step of correcting the three-dimensional polygon data described above (not shown).

Here, the step of detecting the three-dimensional polygon data (not shown) may be performed before the step of correcting the three-dimensional polygon data (not shown) to determine the correction target among the three-dimensional polygon data, Dimensional polygon data may be performed after the step of correcting the three-dimensional polygon data (not shown) to determine the display target among the corrected three-dimensional polygon data.

Next, the user terminal 200 overlays and displays the rendered image (e.g., augmented reality image) of the real-time image and the three-dimensional polygon data (S530).

Here, the augmented reality image is overlaid on the real-time image, and can be viewed above the real-time image.

Here, the augmented reality image may have a color distinguished from the real-time image.

For example, the augmented reality image may be displayed in a uniform color such as red and yellow, or may be displayed in a form in which the hue value gradually changes with time.

Accordingly, the user can easily confirm which of the building objects on the real-time image is the focused building object.

Further, the augmented reality image can be displayed in a translucent manner with transparency set.

Accordingly, the user can easily confirm the actual contour of the focused building object.

In addition, the augmented reality image may be displayed with different transparency values between the corner portion and the face portion constituting the image.

For example, the corner portion may be set to a low transparency value so as to be close to opaque, and the surface portion may be set to a high transparency value and displayed close to transparency.

Accordingly, the user can recognize the stereoscopic shape of the augmented reality image, thereby easily confirming the stereoscopic size of the focused building object.

In addition, the thickness of the edge portion can be set so that the augmented reality image is covered with the building edge detected in the real-time image by the edge portion.

As an alternative embodiment, in step S530, the user terminal 200 may determine whether there is a building close to the front of the camera based on the location of the user terminal 200 and the direction information of the camera, If there is a nearby building, the rendering of the 3D polygon data can be skipped.

For example, when the distance between the user terminal and the specific building is within 5 m and the direction of the camera is determined to be toward the building, the user terminal 200 may skip the rendering of the three-dimensional polygon data corresponding to the building.

That is, when the user is brought close to a specific building to be less than a predetermined distance, the augmented reality image for the building may be skipped.

Accordingly, when a small number of building objects are displayed on the screen, it is possible to prevent a specific color from being overlaid on the entire screen by the augmented reality image.

If a plurality of three-dimensional polygon data is generated in step S520, the user terminal 200 may provide the rendered images of the corresponding three-dimensional polygon data in a superimposed manner on the screen in step S530.

In this case, the user terminal 200 may determine the display order based on the position information included in the real estate information, and may superimpose the rendered images according to the display order, with respect to the three-dimensional polygon data.

For example, the user terminal 200 may determine the display order of the three-dimensional polygon data so that the three-dimensional polygon data is displayed in order from the user's position in the closest order.

In this case, the rendered image for the real estate having the first distance to the user's location may be displayed before the rendered image for the real estate having the second distance and the first distance relative to the user's location.

Here, the rendered image displayed behind other rendered images can be processed so that the shaded portion is not displayed.

Accordingly, the user can easily confirm which building object is capable of interaction (e.g., selection input) on the screen.

Finally, the user terminal 200 provides real estate detailed information corresponding to the three-dimensional polygon data (S540).

In step S540, the user terminal 200 may display the property detail information in the form of a pop-up window.

Here, the pop-up window may include an information display area and an entire information request button.

The user terminal 200 may transmit the identification code of the real estate corresponding to the displayed AR image to the server 100 in step S540.

In this case, the user terminal 200 can receive real estate detailed information corresponding to the identification code from the server 100 and display it.

In an alternative embodiment, the user terminal 200 may receive property detail information corresponding to the location information from the server 100 in step S510 in advance. In this case, the user terminal 200 can directly display the real estate detailed information when the augmented reality image is displayed without receiving the real estate detailed information separately in step S540.

In addition, if there is a selection input for the real estate total information request button included in the pop-up window, the user terminal 200 can further provide the real estate total information.

In this case, the user terminal 200 can receive the real estate total information corresponding to the real estate detailed information from the server 100 and display it.

The user terminal 200 can convert the screen into a separate whole information page to provide the whole real estate information.

In an alternative embodiment, when there is a selection input for the screen switching button included in the screen of the user terminal 200, the user terminal 200 may switch the screen to the map screen in the existing augmented reality screen ).

In the step of switching the screen to the map screen (not shown), the user terminal 200 receives the map data from the server 100 and provides a map image instead of the existing real-time image, The rendered two-dimensional polygon image can be superimposed and displayed.

Accordingly, the user can receive real estate information alternately between the image image and the map image.

As an alternative embodiment, if a plurality of rendered images are displayed in step S530, then in step S540, the user terminal 200 receives a selection input for one of the rendered images, It is possible to provide real estate detailed information corresponding to the rendered image.

6 is a diagram illustrating an augmented reality image 630 according to an embodiment of the present invention.

6, the user terminal 200 generates three-dimensional polygon data 620 from the two-dimensional polygon data 610 and generates an augmented reality image 630 using the three-dimensional polygon data 620 .

First, the user terminal 200 receives the real estate information and the two-dimensional polygon data 610 for a specific real estate from the server 100.

Next, the user terminal 200 can generate the three-dimensional polygon data 620 in consideration of the building height included in the real estate information in the two-dimensional polygon data 610.

For example, the user terminal 200 may determine that the two-dimensional polygon data 610 of a particular real estate is (x ₀ , y ₀ ), (x ₁ , y ₁ ), ... , Made of coordinates, such as (x _n, y _n), if the height of the building of the property _{z1, (x 0, y 0} , 0), (x 1, y 1, 0), ... , (x _n , y _n , 0), (x ₀ , y ₀ , z ₁ ), (x ₁ , y ₁ , z ₁ ), ... , and (x _n , y _n , z ₁ ) of the three-dimensional polygon data 620.

As an alternative embodiment, the user terminal 200 may generate the three-dimensional polygon data 620 considering further the altitude information included in the real estate information.

For example, the user terminal 200 may determine that the two-dimensional polygon data 610 of a particular real estate is (x ₀ , y ₀ ), (x ₁ , y ₁ ), ... , Made of coordinates, such as (x _n, y _n), if the height of the property of z0, the building height _{z1, (x 0, y 0} , z 0), (x 1, y 1, z 0 ), ... _{, (X n, y n,} z 0), (x 0, y 0, z 0 + z 1), (x 1, y 1, z 0 + z 1), ... dimensional polygon data 620 including coordinates such as (x _n , y _n , z ₀ + z ₁ ).

Next, the user terminal 200 can generate the augmented reality image 630 by correcting the three-dimensional polygon data 620 in consideration of the eye level and the direction 612 of the user 611.

Here, the eye level of the user 611 may be a height value corresponding to an average key of the users.

In addition, the direction 612 of the user may be the vertical and horizontal values obtained by the gyro sensor included in the user terminal 200.

The user terminal 200 adjusts or rotates the size of the 3D polygon data 620 in consideration of the eye level and the direction 612 of the user 611 and applies the vanishing point to generate the perspective augmented reality image 630 .

FIG. 7 is a view illustrating an embodiment of performing optical recognition correction on the augmented reality image 630 generated in FIG.

Referring to FIG. 7, first, the user terminal 200 may generate an augmented reality image 630 according to the method shown in FIG. 6 for a building located closest to the user's view.

Here, the correction process for the augmented reality image 630 and the augmented reality image 630 to be described later is performed in the background of the user terminal 200, and may not be displayed to the user.

Next, the user terminal 200 may detect corners and vertices as optical recognition for the real-time image 710. [

For example, according to the optical recognition result of the user terminal 200, an edge 730 corresponding to the ceiling portion of the building objects 720 and 721 in the real-time image 710 can be detected.

Next, the user terminal 200 may perform a correction based on the detected edge 730 with the augmented reality image 630. [

The user terminal 200 can generate the correction information including the correction value of the magnitude adjustment value, the correction value of the rotation value, and the position correction value of the vanishing point in FIG. 6 while performing such correction.

Although not shown in FIG. 7, the user terminal 200 may use the correction information generated while performing the correction on one augmented reality image 630, and may use other real estate, other three-dimensional polygon data, Images can also be automatically corrected.

8 to 10 are examples of an augmented reality service screen according to the present invention.

Referring to FIG. 8, polygon data corresponding to a specific real estate may be corrected, determined as an object to be displayed, and overlaid on the building object 720 as an augmented reality image 640.

At this time, the detailed property information corresponding to the augmented reality image 640 may be provided through the pop-up window 810. [

Accordingly, according to an embodiment of the present invention, a real-time image obtained in real time through a camera, information on a specific building, and information on a real-time image of the building are provided on a screen to provide a more intuitive augmented reality Service can be provided.

Here, the correction of the polygon data can be performed by the method as shown in Fig. 7 described above.

The determination of the display object may be made such that polygon data including the center point of the real-time image 710 among the polygon data corresponding to the real estate is determined as the object to be displayed.

8, the display area of the polygon data corresponding to the building object 720 includes the center point of the real-time image 710, so that the polygon data corresponding to the building object 720 can be determined as the display object .

Here, when the camera direction is rotated by a predetermined angle in the clockwise direction (left to right direction) as shown in FIG. 9, the real time image 710 moves in the opposite direction (right to left direction) 711).

In this case, the display region of the polygon data corresponding to the building object 720 and the display region of the polygon data corresponding to the building object 721 may all include the center point of the real-time image 711. [

In this case, polygon data having a short distance between the center point of the display area of each of the polygon data and the center point of the real-time image 711 may be determined as a display object.

9, the first distance between the center point of the display area of the polygon data corresponding to the building object 720 and the center point of the real-time image 711 corresponds to the first distance of the polygon data corresponding to the building object 721 The polygon data corresponding to the building object 721 may be determined as the display object, which is longer than the second distance between the center point of the display area and the center point of the real-time image 711. [

According to an embodiment of the present invention, when the camera direction of the user terminal is changed, it is visually displayed that the building located in the center of the camera screen is focused, and at the same time, Realistic real estate augmented reality service can be provided.

10, a screen switching button (not shown) is included on the screen of the user terminal 200. When there is a selection input, the user terminal 200 displays an existing screen (For example, a map screen) on which a map image and a two-dimensional polygon image are displayed.

For example, if there is a selection input for a screen toggle button (not shown), the user terminal 200 may provide a map image 1010 instead of the real-time image 710.

In this case, it can be seen that the building objects 1020 and 1021, which are map images, correspond to the building objects 720 and 721, which are image images, respectively.

In this case, the user terminal 200 can overlay the two-dimensional polygon image 1040 rendered with the two-dimensional polygon data corresponding to the polygon data to be displayed on the map image, Information can be displayed in a pop-up window 810. [

At this time, the pop-up window 810 can be maintained as it is regardless of the above screen switching.

Accordingly, according to an embodiment of the present invention, a user can receive real estate information while alternating between an image image and a map image.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

1: Augmented reality service providing system
100: server 110: communication module of the server
120: memory of the server 130: processor of the server
140: Database 200: User terminal
210: Communication module 220 of the user terminal:
230: Processor 240 of the user terminal:
300: Network

Claims (20)

A method for providing an augmented reality service, which is performed by a user terminal,
(a) receiving real-estate information and two-dimensional polygon data corresponding to location information of the user terminal from a server;
(b) generating three-dimensional polygon data based on building height information included in the real estate information and the two-dimensional polygon data;
(c) superimposing a real-time image obtained from a camera of the user terminal and a rendered image of the three-dimensional polygon data on a screen of the user terminal; And
(d) providing real estate detailed information corresponding to the three-dimensional polygon data;
/ RTI >
Dimensional polygon data is data on a shape of an area of the real estate, the three-dimensional polygon data is data on a three-dimensional shape of the real estate,
After step (b), between step (c)
(e) detecting corners and vertices of the building image in the real-time image, and correcting corners and vertices of the three-dimensional polygon data so that the rendered image of the three-dimensional polygon data is mapped to the building image Augmented reality service providing method. delete delete The method according to claim 1,
The step (e)
Dimensional polygon data; and correcting the other three-dimensional polygon data based on the correction information while performing correction for any one of the plurality of three-dimensional polygon data generated in the step (b) Delivery method. The method according to claim 1,
The step (e)
Providing a guidance message for moving the camera up, down, left, and right, and performing the mapping based on a real-time image changed according to movement of the camera. 6. The method of claim 5,
The step (e)
And displaying the rendered image of the uncorrected three-dimensional polygon data at the center of the screen of the user terminal and providing the guide message including the name of the building included in the real estate information. The method according to claim 1,
After the step (b)
(f) detecting the three-dimensional polygon data corresponding to the center of the real-time image among the plurality of three-dimensional polygon data generated in the step (b);
Further comprising the steps of: 8. The method of claim 7,
The step (f)
Dimensional polygon data having a display area including a center point of the real-time image,
The display area
Dimensional polygon data is a region that covers the real-time image when a rendered image of each of the plurality of three-dimensional polygon data is provided. 9. The method of claim 8,
The step (f)
When the three-dimensional polygon data having a display area including a center point of the real-time image is a plurality of 3-dimensional polygon data, the center point of the real-time image and the center point distance of the display area, Dimensional polygon data is detected. The method according to claim 1,
The rendered image of the three-dimensional polygon data
And has a color distinguished from the real-time image. The method according to claim 1,
The rendered image of the three-dimensional polygon data
Wherein the edge portion and the surface portion constituting the rendered image have different transparency values. The method according to claim 1,
The rendered image of the three-dimensional polygon data
Wherein a thickness of the corner portion is set such that an edge of a building image detected in the real-time image is covered by an edge portion of the rendered image. The method according to claim 1,
The rendered image of the three-dimensional polygon data
Wherein the real-time image is overlaid on the real-time image and is viewed above the real-time image. The method according to claim 1,
A screen switching button is provided on a screen of the user terminal, and when there is a selection input for the screen switching button,
Receiving map data corresponding to the location information of the user terminal,
Wherein the screen of the user terminal is switched to another screen that provides the map data and the rendered image of the two-dimensional polygon data in a superimposed manner. The method according to claim 1,
The step (c)
Determining whether there is a building close to the front of the camera based on the position of the user terminal and the camera direction information of the user terminal,
And skipping the rendering of the 3D polygon data when a building close to the front of the camera exists. The method according to claim 1,
The step (c)
Dimensional polygon data generated in the step (b), a display order is determined based on the positional information included in the real estate information, and the rendered images of the plurality of three-dimensional polygon data are displayed in the display order Wherein the step of providing the augmented reality service comprises: The method according to claim 1,
The step (d)
Receiving a selection input for one of the rendered images, and providing the property detail information corresponding to the selected and input rendered image. A method for providing an augmented reality service, which is performed by a server,
Receiving location information from a user terminal;
Providing the user terminal with real estate information and two-dimensional polygon data corresponding to the location information so that the user terminal generates the three-dimensional polygon data; And
Dimensional polygon data to the user terminal when receiving the request for providing detailed information of real estate for the three-dimensional polygon data determined to be displayed among the plurality of three-dimensional polygon data from the user terminal ;
Lt; / RTI >
Wherein the display object is three-dimensional polygon data having a display area including a center point of a real-time image provided by the user terminal among the plurality of three-dimensional polygon data,
Wherein the display area is an area covering the real-time image when the rendered image of each of the plurality of three-dimensional polygon data is provided by the user terminal,
Wherein the two-dimensional polygon data is data on a shape of an area of the real estate,
Dimensional polygon data, wherein the three-dimensional polygon data is data relating to the three-dimensional shape of the real estate, and the corners and vertices of the three-dimensional polygon data are corrected so as to map the rendered image of the three-dimensional polygon data to corners and vertices of the building image Augmented reality service providing method. 1. An augmented reality service providing apparatus for providing an augmented reality image relating to a three-dimensional shape of a real estate,
A memory for storing a program for performing the augmented reality service providing method; And
And a processor for executing the program,
The processor, by executing the program,
Receiving property information and two-dimensional polygon data corresponding to the location information of the user terminal from the database server,
Dimensional polygon data based on the building height information included in the real estate information and the two-dimensional polygon data,
Real-time images obtained from a camera of the user terminal and rendered images of the three-dimensional polygon data are superimposed on the screen of the user terminal,
Providing real estate detailed information corresponding to the three-dimensional polygon data,
Dimensional polygon data is data relating to the shape of the area of the real estate, the three-dimensional polygon data is data relating to the three-dimensional shape of the real estate, and the corner and vertexes of the three- Wherein the corrected image is corrected so as to map to corners and vertices of a building image in the real-time image. 18. A computer-readable recording medium on which a program for performing the augmented reality service providing method according to any one of claims 1 to 18 is recorded.

Images