KR20210036212A - Server, device and method for providing augmented reality - Google Patents

Abstract

A server for providing an augmented reality service includes a receiving part that receives spatial data for real space from a user terminal; a virtual space generating part that generates a virtual space corresponding to the real space based on the spatial data; a tagging part for tagging the augmented reality message created by the user terminal to a specific location in the virtual space, a transmission part for transmitting the augmented reality message to at least one other user terminal based on exposure condition information on the augmented reality message set from the user terminal. The spatial data for the real space may include location information of the real space and information on the indoor plane area. The augmented reality message created by the user terminal can be tagged in the virtual space.

Description

Server, user terminal and method providing augmented reality service {SERVER, DEVICE AND METHOD FOR PROVIDING AUGMENTED REALITY}

The present invention relates to a server, a user terminal, and a method for providing an augmented reality service.

Augmented reality 　 technology is a technology that superimposes a virtual image on a visual 　 reality 　 image to show as a single image.

Augmented reality may be implemented by synthesizing virtual information with an image acquired through a camera. For example, when an application to which augmented reality technology is applied is executed and a real object (eg, a book cover) is projected or photographed on a camera screen, information related to the real object is synthesized with the image of the real object and displayed on the camera screen.

On the other hand, the existing 　messaging 　 service is a form of simple communication that simply displays conversation contents through text, images, and videos on a flat surface, and has a limitation in that it cannot reflect the realistic communication environment based on 5G network.

Therefore, there is a need for a messaging service technology that induces more interest to users and transcends time and space.

Korean Registered Patent Publication No. 10-1729012 (registered on April 17, 2017)

The present invention is to solve the problems of the prior art described above, and generates a virtual space corresponding to the real space based on spatial data about the real space received from a user terminal, and virtually creates an augmented reality message created by the user terminal. You want to tag the space. In addition, the present invention is to transmit the augmented reality message tagged in the virtual space to another user terminal according to the exposure condition information set by the user. However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, the server for providing an augmented reality service according to the first aspect of the present invention includes a receiving unit receiving spatial data for a real space from a user terminal based on the spatial data. A virtual space generation unit that generates a virtual space corresponding to; A tagging unit for tagging the augmented reality message created by the user terminal to a specific location in the virtual space; And a transmission unit for transmitting the augmented reality message to at least one other user terminal based on exposure condition information for the augmented reality message set from the user terminal, and the spatial data for the real space is a location of the real space Information and indoor flat area information may be included.

A user terminal receiving an augmented reality service according to a second aspect of the present invention includes: a generator for generating spatial data on the real space for generating a virtual space corresponding to the real space; A transmission unit for transmitting the spatial data to an augmented reality service providing server; A receiver configured to receive an augmented reality message tagged to a specific location in a virtual space corresponding to the real space from the augmented reality service providing server; And an output unit for outputting the augmented reality message to the screen of the user terminal, wherein the spatial data for the real space includes location information and indoor flat area information of the real space, and the augmented reality message is another user terminal The message is created by and may be transmitted to the user terminal based on exposure condition information for the augmented reality message set by the other user terminal.

A method of providing an augmented reality service by an augmented reality service providing server according to a third aspect of the present invention includes: receiving spatial data on a real space from a user terminal; Creating a virtual space corresponding to the real space based on the spatial data; Tagging the augmented reality message created by the user terminal at a specific location in the virtual space; And transmitting the augmented reality message to at least one other user terminal based on exposure condition information for the augmented reality message set from the user terminal, and the spatial data for the real space is a location of the real space. Information and indoor flat area information may be included.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, a virtual space corresponding to the real space is generated based on spatial data about the real space received from the user terminal, and an augmented reality message created by the user terminal is converted into a virtual space. Can be tagged on. In addition, the present invention may transmit the augmented reality message tagged in the virtual space to another user terminal according to the exposure condition information set by the user. Through this, the present invention can provide a service that allows users to receive augmented reality messages and share them across time and place.

1 is a block diagram of a system for providing an augmented reality service according to an embodiment of the present invention.
2 is a block diagram of the augmented reality service providing server shown in FIG. 1 according to an embodiment of the present invention.
3A to 3B are diagrams for explaining a method of creating and updating a virtual space corresponding to a real space according to an embodiment of the present invention.
4 is a diagram for explaining an image feature point according to an embodiment of the present invention.
5 is a block diagram of the user terminal shown in FIG. 1 according to an embodiment of the present invention.
6A to 6C are diagrams for explaining an example of an augmented reality service according to an embodiment of the present invention.
7 is a flowchart illustrating a method of providing an augmented reality service in an augmented reality service providing server according to an embodiment of the present invention.
8 is a flowchart illustrating a method of providing an augmented reality service in a user terminal according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware.

In this specification, some of the operations or functions described as being performed by the terminal or device may be performed instead in a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal or device connected to the server.

Hereinafter, with reference to the accompanying configuration diagram or processing flow chart, it will be described in detail for the implementation of the present invention.

1 is a block diagram of a system for providing an augmented reality service according to an embodiment of the present invention.

Referring to FIG. 1, the augmented reality service providing system may include an augmented reality service providing server 100, a user terminal 110, and another user terminal 120. However, since the augmented reality service providing system of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1, and may be configured differently from FIG. 1 according to various embodiments of the present invention. have.

In general, components of the augmented reality service providing system of FIG. 1 are connected through a network (not shown). A network refers to a connection structure that enables information exchange between nodes such as terminals and servers, and is a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, etc. Examples of wireless data networks include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, and ultrasound. Communication, Visible Light Communication (VLC), LiFi, and the like are included, but are not limited thereto.

When a user visiting the real space runs an augmented reality application to record his or her footsteps in the real space, the user terminal 110 uses the augmented reality application to create a virtual space corresponding to the real space. Spatial data can be created. Here, the spatial data for the real space may include location information of the real space and information on an indoor flat area (including floor plan information, wall surface information, and ceiling plan information).

In addition, the user terminal 110 may create an augmented reality message by a user through an augmented reality application and receive exposure condition information for the augmented reality message set by the user. Here, the exposure condition information may include at least one of exposure space information, exposure time information, and receiver information in which the augmented reality message is exposed.

The user terminal 110 may transmit an augmented reality message and exposure condition information for an augmented reality message together with spatial data for a real space to the augmented reality service providing server 100.

The augmented reality service providing server 100 may generate a virtual space corresponding to the real space based on spatial data about the real space received from the user terminal 110.

The augmented reality service providing server 100 may tag an augmented reality message created by the user terminal 110 to a specific location in a virtual space.

The augmented reality service providing server 100 may transmit an augmented reality message to at least one other user terminal 120 based on exposure condition information for the augmented reality message received from the user terminal 110.

For example, the user terminal 110 and the other user terminal 120 may include mobile terminals capable of wired or wireless communication. Mobile terminals are wireless communication devices that guarantee portability and mobility, as well as smartphones, tablet PCs, and wearable devices, as well as Bluetooth (BLE, Bluetooth Low Energy), NFC, RFID, Ultrasound (Ultrasonic), infrared, and Wi-Fi ( WiFi), LiFi, etc. may include various devices equipped with communication modules. However, the user terminal 110 and the other user terminal 120 are not limited to those exemplified above.

Hereinafter, the operation of each component of the augmented reality service providing system of FIG. 1 will be described in more detail.

2 is a block diagram of the augmented reality service providing server 100 shown in FIG. 1 according to an embodiment of the present invention.

Referring to FIG. 2, the augmented reality service providing server 100 may include a receiving unit 200, a virtual space generating unit 210, a tagging unit 220, and a transmitting unit 230. Here, the virtual space generation unit 210 may include an update unit 212. However, the augmented reality service providing server 100 shown in FIG. 2 is only an example of implementation of the present invention, and various modifications are possible based on the components shown in FIG. 2.

Hereinafter, FIG. 2 will be described with reference to FIG. 3A.

When the user who visits the real space 301 leaves a record of his or her footsteps in the real space 301, or if the user terminal 110 wishing to share the footsteps of another person runs an augmented reality application , Spatial data for the real space 301 may be received from the user terminal 110. Here, the spatial data for the real space 301 includes location information of the real space 301, indoor flat area information, indoor image information, and a virtual object corresponding to the real object 303 disposed in the real space 301. can do.

Specifically, the location information of the real space 301 may be, for example, location information immediately before the user terminal 110 enters the real space 301 (eg, GPS coordinate information of the user terminal 110). have. The indoor plan area information of the real space 301 includes, for example, floor plan information, wall information, and ceiling plan information inside the real space 301 recognized through an augmented reality application of the user terminal 110. It may include indoor flat area information. The indoor image information may be, for example, image information for each indoor flat area generated by scanning the real space 301 through an augmented reality application of the user terminal 110. The virtual object corresponding to the real object 303 is a real object 303 selected by the user terminal 110 from among a plurality of real objects arranged in the real space 301 (that is, a land representing the real space 301 ). Mark) may be a virtual object created by scanning.

The virtual space generator 210 may generate a virtual space 305 corresponding to the real space 301 based on spatial data on the real space 301.

The virtual space generator 210 may generate a virtual flat space based on floor plan information, wall surface information, and ceiling plan information included in the indoor plan area information of the real space 301. For example, the virtual space generation unit 210 may create a virtual flat space in the form of a rectangular parallelepiped by expanding each flat area based on floor plan information, wall information, and ceiling plan information included in the indoor plan area information. .

The virtual space generation unit 210 extracts image feature points from images for each of a plurality of indoor plane areas included in the indoor image information of the real space 301, maps the extracted image feature points to the generated virtual plane space, and provides a virtual space. (305) can be created. In this case, the virtual space generation unit 210 matches the image feature points corresponding to each flat area constituting the generated virtual flat space with the area of the virtual flat space to determine whether the virtual space 305 is the same. Can be generated.

Here, the image feature point may be used when tracking or recognizing an object or matching an image and an image. These video feature points should be easily identifiable even when the shape, size, and location of the object change, and should be easily found in the video even when the viewpoint and lighting of the camera change. For example, referring to FIG. 4, the image feature point in the first image 40 may be a first point 401 (ie, a corner point) of an object that is easily identifiable with a surrounding background. In this case, whether the first point 401 is a corner point or not is based on a pixel value of the circle having a radius r with the first point 401 as the center point, and the pixel value is greater than or equal to a preset threshold value than the first point 401. When N or more bright or dark pixels are consecutive, the first point 401 may be determined as a corner feature point.

The virtual space generator 210 may arrange a virtual object on the virtual space 305 generated based on the location information of the real object 303 disposed in the real space 301.

The tagging unit 220 may tag the augmented reality message created by the user terminal 110 to a specific location in the virtual space 305 (eg, an area around the point where the virtual object is placed). Here, the augmented reality message may be a message in which the footsteps of a user visiting the real space 301 are recorded in a digital format. The augmented reality message may include, for example, a voice message or text message using an avatar generated by the user terminal 110, a video message, 3D drawing graffiti information, and the like.

The tagging unit 220 may map an augmented reality message tagged in the virtual space 305 to a point corresponding to the location information of the real space 301 among map data provided through the map app.

The transmission unit 230 may transmit the augmented reality message to at least one other user terminal 120 based on exposure condition information for the augmented reality message set from the user terminal 110. Here, the exposure condition information may include at least one of exposure space information, exposure time information, and receiver information in which the augmented reality message is exposed. Here, the recipient information may be, for example, a group including a contact selected by the user from among a plurality of contacts stored in the user terminal 110. For example, when another user included in the recipient information is located on the exposure space set by the user terminal 110, or the current time reaches the exposure time set by the user terminal 110, the corresponding recipient information An augmented reality message may be transmitted to another user's terminal.

Specifically, when the other user terminal 120 of another user included in the receiver information is located in a real space corresponding to the exposure space information, the transmission unit 230 may transmit an augmented reality message to the other user terminal 120. have. For example, when the other user terminal 120 drives the app of the augmented reality camera in a real space corresponding to the exposure space information set by the user terminal 110, the field of view of the image captured by the other user terminal 120 The augmented reality message of the user terminal 110 may be exposed within.

When the point where the real space 301 is located is selected on the map displayed through the other user terminal 120 of another user included in the receiver information, the transmission unit 230 transmits the virtual space 305 through the virtual space 305. The augmented reality message tagged in) may be transmitted to the other user terminal 120. In this case, the augmented reality message tagged in the virtual space may be augmented and displayed on the screen of the other user terminal 120. For example, when the other user terminal 120 selects a point where the real space 301 in which the virtual space 305 is created is located on a map displayed on the screen of the other user terminal 120, the other user terminal 120 ) May check the augmented reality message tagged in the virtual space 305 through the avatar of the user terminal 110.

In this way, the other user terminal 120 receiving the augmented reality message of the user terminal 110 may visit the actual real space 301 to share and check the corresponding augmented reality message, and even if not visiting the real space 301 The same augmented reality message can be shared and checked by accessing a virtual space corresponding to the real space 301.

Hereinafter, FIG. 2 will be described with reference to FIGS. 3A to 3B together.

The receiving unit 200 allows other users who visited the real space 301 to leave their own footsteps in the real space 301, or a plurality of other user terminals 122 and 124 who wish to share the footsteps of others. When the augmented reality application is executed, similar spatial data for a real space located within a preset range may be received from the location information of the real space 301 from a plurality of other user terminals 122 and 124. Here, the similar spatial data is the location information of a real space located within a preset range from the location information of the real space 301 and information on the indoor plane area (floor plane information, wall surface information, and multiple indoor planes including information on the ceiling plane). Area information), indoor image information (indoor image information for each indoor flat area), and a virtual object corresponding to the real object 307 disposed in a certain real space.

The update unit 212 is para-generated based on similar spatial data for a certain real space (a space located within a preset range from the location information of the real space 301) received from a plurality of other user terminals 122, 124. The created virtual space 305 can be updated.

Specifically, the update unit 212 includes indoor plan area information included in spatial data for the real space 301 received from the user terminal 110 and similar spatial data received from a plurality of other user terminals 122 and 124. The virtual space 305 may be updated based on the comparison result between the indoor flat area information included in the.

The update unit 212 includes image feature points for each of a plurality of indoor flat areas of the indoor image information included in the spatial data for the real space 301 received from the user terminal 110 and from the plurality of other user terminals 122 and 124. The virtual space 305 may be updated based on a comparison result between image feature points for each of a plurality of indoor plan areas of indoor image information included in the received similar spatial data.

The update unit 212 includes a virtual object included in spatial data (similar spatial data) for the real space 301 received from the user terminal 110 and similar spatial data received from a plurality of other user terminals 122 and 124. The virtual space 305 may be updated based on a result of comparison between the virtual objects included in.

In this way, when a plurality of user terminals attempting to leave an augmented reality message in the real space 301 drive the augmented reality camera app, spatial data for the real space 301 is collected in the form of crowd sourcing and The virtual space 305 corresponding to 301 may be elaborated.

Meanwhile, for those skilled in the art, each of the receiving unit 200, the virtual space generation unit 210, the update unit 212, the tagging unit 220, and the transmission unit 230 are implemented separately, or one or more of them are integrated and implemented. I will fully understand that it can be.

5 is a block diagram of the user terminal 110 shown in FIG. 1 according to an embodiment of the present invention.

Referring to FIG. 5, the user terminal 110 may include a generating unit 500, a transmitting unit 510, a receiving unit 520, and an output unit 530. However, the user terminal 110 shown in FIG. 5 is only an example of implementation of the present invention, and various modifications are possible based on the components shown in FIG. 5.

When a user visiting the real space executes an augmented reality application to record his or her footsteps in the real space, the generation unit 500 generates spatial data for the real space to create a virtual space corresponding to the real space. I can. Here, the spatial data for the real space may include similar spatial data for a real space located within a preset range from the location information of the real space. Here, the spatial data for the real space may include location information of the real space, indoor flat area information, indoor image information, and a virtual object corresponding to a real object disposed in the real space.

Here, the location information of the real space may be, for example, location information immediately before the user terminal 110 enters the real space (eg, GPS coordinate information of the user terminal 110). The indoor plan area information of the real space includes, for example, multiple indoor plan area information including floor plan information, wall surface information, and ceiling plan information within the real space recognized through an augmented reality application of the user terminal 110. can do. The indoor image information may be, for example, image information for each indoor plane area generated by scanning a real space through an augmented reality application of the user terminal 110. The virtual object corresponding to the real object may be a virtual object generated by scanning a real object (ie, a landmark representing the real space) selected by the user terminal 110 among a plurality of real objects arranged in the real space. .

Here, the similar spatial data is the location information of a real space located within a preset range from the location information of the real space and information on the indoor plane area (multiple indoor plane area information including floor plan information, wall information, and ceiling plane information) , Indoor image information of a certain real space (indoor image information for each indoor flat area), and a virtual object corresponding to a real object disposed in a certain real space may be included.

The transmission unit 510 may transmit spatial data for a real space to the augmented reality service providing server 100. Thereafter, the augmented reality service providing server 100 may check whether a virtual space corresponding to the corresponding real space has been previously generated based on the received spatial data on the real space. When it is determined that a virtual space corresponding to the real space is not generated, the augmented reality service providing server 100 may generate a virtual space corresponding to the real space based on the received spatial data on the real space. If it is determined that a virtual space corresponding to the real space has already been created, the augmented reality service providing server 100 may update the para-generated virtual space based on the similar spatial data included in the spatial data.

The generation unit 500 may create an augmented reality message through an augmented reality application. For example, the generation unit 500 is based on the facial expression, behavior, and style of the avatar selected by the user from among the avatar embellishments list including avatar facial expression types, avatar behavior types, and avatar style types provided through an augmented reality application. An avatar may be created, and an augmented reality message may be generated using a message for recording the footsteps input from a user (eg, voice message, text message, video message, 3D drawing graffiti information, etc.) and the generated avatar.

The transmission unit 510 may transmit the augmented reality message and exposure condition information set in the augmented reality message together with spatial data for the real space to the augmented reality service providing server 100. Here, the exposure condition information may include at least one of exposure space information, exposure time information, and receiver information in which the augmented reality message is exposed. Thereafter, the augmented reality service providing server 100 may tag an augmented reality message in a virtual space corresponding to the real space. In addition, the augmented reality service providing server 100 may map an augmented reality message tagged to virtual information to a point corresponding to location information of a real space among map data provided through a map app. The augmented reality message may be transmitted to another user terminal based on exposure condition information set by the user terminal 110.

Meanwhile, the receiving unit 520 may receive another augmented reality message (message created by the other user terminal 120) tagged to a specific location in the virtual space corresponding to the real space from the augmented reality service providing server 100. . Here, the other augmented reality message may be transmitted to the user terminal 110 based on exposure condition information for the other augmented reality message set by the other user terminal 120 that created the other augmented reality message. For example, the receiving unit 520 is included in the recipient information set by the user of the user terminal 110 by the other user terminal 120, the user terminal 110 on the exposed space set by the other user terminal 120 When this location or the current time reaches the exposure time set by the other user terminal 120, another augmented reality message tagged in the virtual space corresponding to the real space may be received from the augmented reality service providing server 100 .

In another embodiment, the receiving unit 520 stores image feature points and para-generated virtual spaces for each of a plurality of indoor plane areas of indoor image information included in spatial data for a real space transmitted to the augmented reality service providing server 100. An augmented reality message may be received from the augmented reality service providing server 100 based on a result of comparison between image feature points for each of a plurality of configured indoor flat areas.

In another embodiment, the receiver 520 is based on a comparison result between the virtual object included in the spatial data for the real space transmitted to the augmented reality service providing server 100 and the virtual object disposed in the para-generated virtual space. An augmented reality message may be received from the augmented reality service providing server 100.

The output unit 530 may output the augmented reality message received from the augmented reality service providing server 100 on the screen of the user terminal 110.

When the user terminal 110 is located in a real space corresponding to the exposure space information (information included in the exposure condition information for another augmented reality message set by the other user terminal 120), the user terminal 110 Another augmented reality message within the field of view of the image captured by the terminal 110 may be augmented and output. For example, referring to FIG. 6A, when the user terminal 110 photographs a specific tourist spot space (eg, a space where Cheomseongdae is located), the output unit 530 is tagged in a virtual space corresponding to the tourist spot space. Another augmented reality message 601 of the other user terminal 120 may be augmented and output on the captured image screen.

The output unit 530 transmits an augmented reality message tagged to the virtual space through the virtual space when a point where the real space where the virtual space is created is selected from the map displayed through the user terminal 110. ) Can be printed on the screen. For example, referring to FIG. 6B, when the user selects a specific point 605 to which a virtual space is mapped among map data 603 provided through a map app, the virtual space 607 or The augmented reality message tagged in the virtual space 607 may be checked through the avatar of the other user terminal 120.

In another embodiment, referring to FIG. 6C, after the augmented reality service is synchronized between the user terminal 110 and the other user terminal 120 by the augmented reality service providing server 100, the user terminal 110 located in the real space ) Photographs a real object, a virtual object 611 corresponding to the photographed real object 609 may be augmented and displayed on the screen of the other user terminal 120. At this time, when the other user terminal 120 draws on the virtual object 611 corresponding to the real object 609 augmented and displayed on the other user terminal 120, the drawn mark 613 110) may be similarly augmented and displayed on the photographed screen image. Through this, even if users are not located in the same space, communication for sharing information through an augmented reality service can be performed.

On the other hand, those skilled in the art will fully understand that each of the generation unit 500, the transmission unit 510, the reception unit 520, and the output unit 530 may be implemented separately, or one or more of them may be integrated and implemented.

7 is a flowchart illustrating a method of providing an augmented reality service in the augmented reality service providing server 100 according to an embodiment of the present invention.

Referring to FIG. 7, in step S701, the augmented reality service providing server 100 may receive spatial data for a real space from the user terminal 110. Here, the spatial data on the real space may include location information on the real space and information on the indoor flat area.

In step S703, the augmented reality service providing server 100 may generate a virtual space corresponding to the real space based on spatial data on the real space.

In step S705, the augmented reality service providing server 100 may tag the augmented reality message created by the user terminal 110 to a specific location in the virtual space.

In step S707, the augmented reality service providing server 100 may transmit the augmented reality message to at least one other user terminal 120 based on exposure condition information for the augmented reality message set from the user terminal 110. Here, the exposure condition information may include at least one of exposure space information, exposure time information, and receiver information in which the augmented reality message is exposed.

In the above description, steps S701 to S707 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, or the order between steps may be changed.

8 is a flowchart illustrating a method of providing an augmented reality service in the user terminal 110 according to an embodiment of the present invention.

Referring to FIG. 8, in step S801, the user terminal 110 may generate spatial data for a real space for generating a virtual space corresponding to the real space. Here, the spatial data on the real space may include location information on the real space and information on the indoor flat area.

In step S803, the user terminal 110 may transmit spatial data for a real space to the augmented reality service providing server 100.

In step S805, the user terminal 110 may receive an augmented reality message tagged to a specific location in the virtual space corresponding to the real space from the augmented reality service providing server 100.

In step S807, the user terminal 110 may output an augmented reality message on the screen of the user terminal 110.

In the above description, steps S801 to S807 may be further divided into additional steps or may be combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, or the order between steps may be changed.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by a computer. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. .

100: augmented reality service providing server
110: user terminal
120: other user terminal
200: receiver
210: virtual space generation unit
212: update unit
220: tagging unit
230: transmission unit
500: generation unit
510: transmission unit
520: receiver
530: output

Claims (19)

In the server providing an augmented reality service,
A receiving unit for receiving spatial data for a real space from a user terminal;
A virtual space generator configured to generate a virtual space corresponding to the real space based on the spatial data;
A tagging unit for tagging the augmented reality message created by the user terminal to a specific location in the virtual space; And
A transmission unit for transmitting the augmented reality message to at least one other user terminal based on exposure condition information for the augmented reality message set from the user terminal,
The spatial data for the real space includes location information and indoor flat area information of the real space.
The method of claim 1,
The virtual space generation unit generates a virtual flat space based on floor plan information, wall surface information, and ceiling plan information included in the indoor plan area information.
The method of claim 2,
The spatial data for the real space further includes indoor image information generated by scanning the real space,
The virtual space generation unit extracts image feature points from images for each of a plurality of indoor plane areas included in the indoor image information,
The augmented reality service providing server for generating the virtual space by mapping the extracted image feature points to the generated virtual flat space.
The method of claim 3,
The spatial data for the real space further includes a virtual object generated by scanning a real object disposed in the real space,
The virtual space generation unit to arrange the virtual object on the generated virtual space based on the location information of the real object disposed in the real space, augmented reality service providing server.
The method of claim 1,
The receiving unit receives similar spatial data for a real space located within a preset range from the location information of the real space from a plurality of other user terminals,
The virtual space generation unit
The augmented reality service providing server comprising an update unit for updating the virtual space based on the similar space data.
The method of claim 5,
The update unit updates the virtual space based on a comparison result between the indoor flat area information included in the spatial data for the real space and the indoor flat area information included in the similar spatial data.
The method of claim 6,
The update unit is based on a comparison result between the image feature points for each of a plurality of indoor plane areas of the indoor image information included in the spatial data for the real space and the image feature points for each of the plurality of indoor plane areas of the indoor image information included in the similar spatial data. The augmented reality service providing server to update the virtual space.
The method of claim 7,
The update unit updates the virtual space based on a comparison result between the virtual object included in the spatial data for the real space and the virtual object included in the similar spatial data.
The method of claim 1,
The exposure condition information includes at least one of exposure space information, exposure time information, and receiver information to which the augmented reality message is exposed.
The method of claim 9,
When another user terminal of another user included in the recipient information is located in a real space corresponding to the exposure space information, the augmented reality message is augmented and exposed within the field of view of the image captured by the other user terminal. , Augmented reality service providing server.
The method of claim 9,
When a point where the real space is located on a map displayed through another user terminal of another user included in the recipient information is selected, the augmented reality message tagged to the virtual space through the virtual space is sent to the other user terminal. The augmented reality service providing server that is displayed.
In a user terminal receiving an augmented reality service,
A generator for generating spatial data on the real space for generating a virtual space corresponding to the real space;
A transmission unit for transmitting the spatial data to an augmented reality service providing server;
A receiver configured to receive an augmented reality message tagged to a specific location in a virtual space corresponding to the real space from the augmented reality service providing server; And
Including an output unit for outputting the augmented reality message on the screen of the user terminal,
The spatial data for the real space includes location information and indoor flat area information of the real space,
The augmented reality message is a message created by another user terminal, and is transmitted to the user terminal based on exposure condition information for the augmented reality message set by the other user terminal.
The method of claim 12,
The spatial data for the real space includes similar spatial data for a real space located within a preset range from the location information of the real space.
The method of claim 13,
The virtual space is updated by the augmented reality service providing server based on the spatial data and the similar spatial data.
The method of claim 12,
The exposure condition information includes at least one of exposure space information, exposure time information, and receiver information to which the augmented reality message is exposed.
The method of claim 15,
When the user terminal is located in the real space corresponding to the exposure space information, the output unit augments and outputs the augmented reality message within a viewing range of an image captured by the user terminal.
The method of claim 16,
The output unit outputs the augmented reality message tagged to the virtual space through the virtual space on the screen of the user terminal when a point where the real space is located is selected from the map displayed through the user terminal. , User terminal.
The method of claim 12,
The spatial data for the real space further includes indoor image information generated by scanning the real space,
The augmented reality based on a comparison result between the image feature points for each of a plurality of indoor plane regions of the indoor image information included in the spatial data for the real space and the image feature points for each of a plurality of indoor plane regions constituting the virtual space. To receive the augmented reality message from the service providing server, the user terminal.
In the method of providing an augmented reality service by an augmented reality service providing server,
Receiving spatial data for a real space from a user terminal;
Creating a virtual space corresponding to the real space based on the spatial data;
Tagging the augmented reality message created by the user terminal at a specific location in the virtual space;
Transmitting the augmented reality message to at least one other user terminal based on exposure condition information for the augmented reality message set from the user terminal,
The spatial data for the real space includes location information of the real space and information on an indoor flat area.

Images