KR102185924B1 - AR-Location based Exhibition Guide Method and System in a Showroom - Google Patents

Abstract

AR-location-based exhibition hall exhibits introduction method and system are provided. In the method for providing location-AR-based information according to an embodiment of the present invention, the location of the user's mobile terminal is determined, AR objects are selected based on the determined location, the selected AR objects are displayed on the mobile terminal, and the displayed It provides a linked description of the AR object selected by the user among AR objects. Accordingly, by determining the location of the user's mobile terminal and providing information on the exhibits at the corresponding location, visitors who visit the exhibition hall can be provided with explanations of the exhibits more conveniently and quickly.

Description

AR-Location based Exhibition Guide Method and System in a Showroom}

The present invention relates to information providing technology, and more particularly, to a method and system for introducing exhibits displayed in an exhibition hall.

Various attempts are being made to explain the exhibits in the exhibition hall. In general, it is introduced by attaching a description of the exhibit in front of the exhibit. Displaying the number in front of the exhibit and pressing the number introduces the exhibit by voice. Recently, a QR code is attached in front of an exhibit and a QR code is recognized with a smartphone to introduce exhibits.

However, all of the existing methods of guiding exhibits are methods in which visitors must approach the exhibits and access the information board to receive the introduction of the exhibits. Therefore, visitors may feel a little uncomfortable, which may be even more so for those with discomfort.

Accordingly, it is requested to find a plan to allow visitors to more comfortably receive an introduction to the exhibits.

The present invention has been conceived to solve the above problems, and an object of the present invention is to provide a more convenient explanation of exhibits to visitors who visit the exhibition hall. It is to provide a method and system for determining and providing information on exhibits at a corresponding location.

A method for providing location-AR-based information according to an embodiment of the present invention for achieving the above object includes: determining a location of a user's mobile terminal; Selecting AR (Augmented Reality) objects based on the determined location; Displaying the selected AR objects on the mobile terminal; And providing a linked description of the AR object selected by the user among the displayed AR objects.

In the determining step, it may be determined in which exhibition room the mobile terminal is located among a plurality of exhibition rooms constituting the exhibition hall.

In addition, in the determining step, an exhibition room in which the mobile terminal is located may be determined using a wireless LAN signal or a Bluetooth signal collected by the mobile terminal.

And if the option of fixing the position determined in the determination step is selected, the position determination may not be performed afterward.

Also, in the selection step, AR objects representing exhibits displayed in the determined exhibition room may be selected.

In addition, the related description of the AR object may be a description of an exhibition object represented by the AR object.

Also, in the display step, the selected AR objects may be displayed as a list.

In the display step, AR objects may be layered and displayed.

In addition, in the display step, the AR objects may be displayed at a corresponding position on the mobile terminal screen in consideration of the exhibition position and distance of the exhibits.

In addition, a method for providing location-AR-based information according to an embodiment of the present invention includes: adjusting directions of AR objects displayed in the display step; And fixing the direction of the adjusted AR objects.

In addition, in the display step, the mobile terminal may be facing a designated direction from a designated location of the exhibition room.

In addition, a method for providing location-AR-based information according to an embodiment of the present invention includes the steps of recognizing an exhibit displayed on a screen of a mobile terminal; It may further include providing a description of the recognized exhibit.

In addition, in the recognition step, the mobile terminal may be facing a designated direction from a designated location of the exhibition room.

In the recognition step, the exhibition object displayed on the screen of the mobile terminal may be recognized by using images taken from different angles of the exhibition object.

Meanwhile, according to another embodiment of the present invention, a system for providing location-AR-based information includes: a first server for determining a location of a user's mobile terminal; A second server that selects AR (Augmented Reality) objects based on the determined location; And a mobile terminal displaying the selected AR objects and receiving and displaying a linked description of the AR object selected by the user among the displayed AR objects from the second server.

As described above, according to the embodiments of the present invention, by determining the location of the user's mobile terminal and providing information on the exhibits at the corresponding location, visitors who visit the exhibition hall more conveniently provide a description of the exhibits. You will be able to receive it.

In addition, according to the embodiments of the present invention, it is possible to access the description of the exhibit even if it is located far away without being close to the exhibit. For example, visitors can see the introduction of the exhibit while taking a break while not in a chair. By allowing you to select the exhibits, you can view the exhibits faster and more effectively.

1 is a block diagram of an AR-location-based exhibition hall exhibit introduction system according to an embodiment of the present invention;
2 is a flow chart provided to explain a method for introducing an AR-location-based exhibition hall exhibit according to another embodiment of the present invention;
3 is a diagram schematically showing the process of introducing exhibits in an AR-location-based exhibition hall, and,
4 is a diagram illustrating a situation in which AR objects are arranged on a screen according to the location of an exhibit by inducing a smartphone to be lifted in a designated direction from a designated location.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

In an embodiment of the present invention, in order to more conveniently provide information on exhibition objects in an exhibition hall, a method for receiving an introduction of an exhibition object without being close to an exhibition object is proposed.

To this end, in an embodiment of the present invention, when a visitor enters the exhibition hall, the location of the visitor is determined, and AR (Augmented Reality) objects linked to the exhibit are displayed on the visitor's smartphone, and the visitor selects an AR object for the desired exhibition. If you do, suggest a way to provide a description of the exhibit.

1. Exhibit introduction system

1 is a block diagram of an'AR-location-based exhibition hall exhibit introduction system' (hereinafter, abbreviated as'exhibition introduction system') according to an embodiment of the present invention.

In the exhibit introduction system according to an embodiment of the present invention, as shown in FIG. 1, a location information providing server 100, a visitor's smartphone 200, an exhibit guide app 250, and an exhibit guide server 300 are networked. It is connected and built to enable communication with each other.

The location information providing server 100 determines the location information of the smartphone 200 of the visitors who visited the exhibition hall, and specifically, in which exhibition room the visitor smartphone 200 is located among the exhibition rooms constituting the exhibition hall. To this end, the location information providing server 100 uses a wireless LAN signal or a Bluetooth signal collected by the visitor's smartphone 200.

The exhibition guide app 250 installed & executed on the visitor's smart phone 200 is linked with the exhibition guide server 300 to provide the audience through the smart phone 200 about the exhibits currently displayed in the exhibition room where the visitor is located. Provide an explanation.

2. How to introduce exhibits

Hereinafter, a process of providing a description of exhibits in an exhibition hall by the exhibition object introduction system illustrated in FIG. 1 will be described in detail with reference to FIG. 2. 2 is a flow chart provided for explaining a method of introducing exhibits in an AR-location based exhibition hall according to another embodiment of the present invention.

In order to introduce an exhibit, as shown in FIG. 2, the location information providing server 100 first determines an exhibition room in which the visitor's smartphone 200 is located (S410).

To this end, the exhibit guide app 250 of the visitor's smartphone 200 includes wireless LAN signal information (AP ID, signal strength) collected from APs installed in the exhibition hall or Bluetooth signal information collected from Bluetooth beacons installed in the exhibition hall. (Beacon ID, signal strength) must be transmitted to the location information providing server 100.

Since the signal information is different for each exhibition room, the location information providing server 100, which is held as a DB containing the mapping relationship between the signal information and the exhibition room information, can identify the exhibition room in which the visitors' smartphone 200 is located based on the signal information. have.

The exhibition guide app 250 receives information on the exhibition room, which is location information determined by the location information providing server 100.

Next, the exhibit information server 300 transmits AR objects linked to the exhibits displayed in the exhibition room determined in step S410 to the exhibit guide app 250 (S420). To this end, the exhibition guide app 250 is premised to transmit the exhibition room information determined in step S410 to the exhibit guide server 300.

Thereafter, the exhibition guide app 250 displays the AR objects received in step S420 on the screen of the visitor's smartphone 200 (S430). The visitor may select a desired one of AR objects displayed on the screen (S440).

When the AR object is selected by the visitor (S440-Y), the exhibition guide app 250 provides a description of the exhibition object linked to the selected AR object to the visitor through the smartphone 200 (S450).

To this end, the exhibition guide app 250 delivers information on the AR object selected by the visitor to the exhibition guide server 300, and receives a description of the exhibit linked to the AR object from the exhibition guide server 300.

The AR-location-based exhibition hall exhibit introduction method described so far will be further described with reference to FIG. 3. 3 is a diagram schematically showing a process of introducing exhibits in an AR-location-based exhibition hall.

3(a) shows the process of recognizing the exhibition room in which the visitor's smartphone 200 is located using the wireless LAN signal collected by the visitor's smartphone 200, and FIG. 3(b) shows the process of recognizing the exhibition room in which the visitor's smartphone 200 is located. The results of displaying AR objects linked to exhibits displayed in the exhibition room where 200 is located are shown.

In addition, in (c) of FIG. 3, a process of selecting an AR object displayed on the screen is shown, and in (d) of FIG. 3, a description of an exhibit linked to the selected AR object is displayed on the smartphone 200. The results are shown.

Details of each step of configuring the AR-location-based exhibition hall exhibit introduction method will be described below.

3. Recognizing the location of the visitor's smartphone

The exhibition hall is usually organized in units of exhibition rooms. Therefore, it is relatively easy to classify the exhibits to be displayed for each exhibition room.

Accordingly, in the exemplary embodiment of the present invention, it is assumed that the exhibits of the exhibition hall are classified by exhibition room, and descriptions of each exhibition are also prepared for each exhibition room. Descriptions of exhibits may be prepared in the form of text, audio, video, or a combination thereof.

The method of determining the location of a visitor's smartphone in the location-AR-based exhibition guide system can vary greatly depending on the accuracy. The location of the smartphone can be identified for each exhibit or the location of the smartphone at the level of the exhibition room.

In an embodiment of the present invention, it is assumed that location recognition is provided at a level of recognizing an exhibition room in which a visitor's smartphone is located. In general, recognizing the location of a smartphone at the level of an exhibition room can be easily recognized by using a wireless LAN signal or a Bluetooth signal.

When a location is recognized using a wireless LAN signal, it varies depending on the platform. In the case of the Android platform, the location of the terminal can be recognized by scanning the wireless LAN signal without any problem. On the other hand, when using an iPhone, the terminal generally cannot scan the wireless LAN signal. To this end, it is possible to recognize the location by collecting the probe signal (Mac address) transmitted from the smartphone to the wireless LAN repeater in each exhibition room. In the exemplary embodiment of the present invention, since exhibition object information is provided for each exhibition room, it is possible to respond to the case of recognizing the exhibition room or location by recognizing a probe signal transmitted from a terminal to each exhibition room.

4. AR object display and selection

When the exhibition room in which the smartphone is located is specified, the exhibits displayed in the exhibition room are determined. The method of accessing the information of such exhibits is to display AR objects linked to each exhibit, and to provide related text, audio, and video guidance services when a user selects a specific AR object. A specific URL can also be associated with an AR object.

There are various ways to display AR objects. The simplest way is to list AR objects for each exhibition room. And the user chooses.

Another way is to arrange and show AR objects in the same proportions in consideration of the location and distance of the exhibits. It is more effective if the exhibits and AR objects can be matched and shown. However, to show that way, more accurate location recognition and object recognition technology are required. Even if an AR object related to an exhibit is shown using any technique, it belongs to the scope of the present invention as long as it is organized by room and shown.

AR object selection is relatively simple. The user can select by touching/clicking the AR object displayed on the screen. When an AR object is associated with a URL, simply follow the URL.

5. AR object layering

When there are many exhibits in one exhibition space, it may be difficult to display all AR objects in the exhibition room on one screen. In that case, AR objects can be layered and displayed.

In other words, many AR objects can be expressed simply by storing other AR objects in AR objects with the same concept as a directory. Even in the same exhibition room, the user selects an exhibition category and selects the final AR object to access the description.

6. Exhibition room fixed option

The method of recognizing the user's location and providing an explanation of exhibits by listing AR objects does not have a big problem when the location of the exhibition room is accurately recognized. However, the problem of location-based services is that location recognition is not accurate. In most cases, it is recognized correctly, but sometimes, even though it is located in exhibition room A, it is uncomfortable if it is recognized as being located in exhibition room B.

In response to this case, if it is recognized as a specific exhibition room, an option to fix the exhibition room can be selected. When the option to fix the exhibition room is selected by the user, location recognition is no longer performed.

When the user releases the option to fix the exhibition room, such as when the exhibition room is moved, the location is recognized again, the exhibition room is specified, and the AR list of the exhibits located in the exhibition room is displayed, thereby appropriately responding to incomplete location recognition.

7. Option to change the direction of the exhibition room

In the case of the exhibition room fixation option, it is a valid option whether AR objects are arranged in the form of a list or based on a physical location. However, when AR objects are arranged and displayed according to the physical location of the exhibits, the directions of the actual exhibits and the AR objects arranged on the display may not match.

In this case, the display direction of the arranged AR objects can be adjusted and fixed. For this, a separate user interface for direction adjustment may be provided. If the directions match, the user is fixed to the direction and receives the service, so that the user can use the service by matching the exhibits and AR objects in a more stable situation.

A more effective way to implement this is to designate a location and direction in the exhibition room in advance and receive services there. Specifically, as shown in FIG. 4, it is to induce visitors to hold the smartphone in a designated direction at a designated location. As illustrated, when a visitor faces the smartphone in a designated direction from a designated location, AR objects displayed on the screen may be arranged accordingly.

8. Recognition of exhibits

So far, we have described how to display AR objects on the screen and guide exhibits connected to AR objects. However, it is also possible to provide information on exhibits without using AR objects.

Specifically, it is possible to recognize the exhibits photographed by a smartphone and appear on the screen, find the corresponding exhibits, and provide explanations. For this, it is necessary to map the exhibits entered on the screen and the registered exhibits.

In this case, a problem arises that it is difficult to match the registered exhibits because the types of exhibits entering the screen vary greatly depending on the angle between the smartphone and the exhibits. In order to solve this problem, errors can be remarkably reduced by allowing the exhibition to be photographed with a smartphone in a designated direction in a designated place.

In another way, by providing the exhibition object images taken from various angles on the exhibition information server, even if the exhibition object is photographed from various angles on a smartphone, it is possible to recognize which exhibition object is.

9. Modification

So far, a method and system for introducing exhibits in an AR-location-based exhibition hall have been described in detail with reference to a preferred embodiment.

It goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing functions of the apparatus and method according to the present embodiment. Further, the technical idea according to various embodiments of the present disclosure may be implemented in the form of a computer-readable code recorded on a computer-readable recording medium. The computer-readable recording medium can be any data storage device that can be read by a computer and can store data. For example, a computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like. Also, a computer-readable code or program stored in a computer-readable recording medium may be transmitted through a network connected between computers.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

100: server providing location information
200: Visitor smartphone
250: exhibition guide app
300: exhibit information server

Claims (15)

Determining which one of the plurality of exhibition rooms constituting the exhibition hall is located in the user's mobile terminal;
Selecting AR (Augmented Reality) objects representing exhibits displayed in the determined exhibition room;
Displaying the selected AR objects on a corresponding location on a screen of a mobile terminal in consideration of the location and distance of exhibits;
Adjusting display directions of AR objects displayed in the display step according to user manipulation;
Fixing the display directions of the adjusted AR objects;
Providing a linked description of the AR object selected by the user among the displayed AR objects; Including,
At the display stage,
A method for providing location-AR-based information, characterized in that the mobile terminal is in a state in which the mobile terminal faces a designated direction from a designated location of an exhibition room.
delete The method according to claim 1,
The decision step is:
A method for providing location-AR-based information, comprising determining an exhibition room in which the mobile terminal is located using a wireless LAN signal or a Bluetooth signal collected by the mobile terminal.
The method according to claim 1,
Position-AR-based information providing method, characterized in that the position determination is not performed after the option of fixing the position determined in the determination step is selected.
delete The method according to claim 1,
The associated description of the AR object is,
Location-AR-based information providing method, characterized in that the description of the exhibit represented by the AR object.
The method according to claim 1,
The display steps are:
Location-AR-based information providing method, characterized in that displaying the selected AR objects in a list.
The method of claim 7,
The display steps are:
A method of providing location-AR-based information, characterized in that the AR objects are layered and displayed.
delete delete delete The method according to claim 1,
Recognizing the exhibits displayed on the screen of the mobile terminal;
Providing a description of the recognized exhibit; location-AR-based information providing method further comprising a.
The method of claim 12,
At the recognition stage,
The mobile terminal is a location-AR-based information providing method, characterized in that facing a designated direction from a designated location of the exhibition room.
The method of claim 12,
The recognition stage is,
A method for providing location-AR-based information, comprising recognizing an exhibition object displayed on a screen of a mobile terminal by using images taken from different angles of an exhibition object being prepared.
A first server for determining which of the plurality of exhibition rooms constituting the exhibition hall is located in which the user's mobile terminal is located;
A second server that selects AR (Augmented Reality) objects representing exhibits displayed in the determined exhibition room; And
Selected AR objects are displayed at a corresponding position on the screen in consideration of the exhibition location and distance of the exhibits, and the display direction of the displayed AR objects is adjusted according to user manipulation, and then the display direction of the adjusted AR objects is fixed, and AR objects Including; a mobile terminal for receiving and displaying a linked description of the AR object selected by the user from the second server,
The mobile terminal,
A location-AR-based information providing system, characterized in that when AR objects are displayed, they are facing a designated direction from a designated location of an exhibition room.

Images