KR102299464B1 - Apparatus and method for augmented reality based road guidance - Google Patents

Abstract

To an augmented reality-based road guidance device, the augmented reality-based road guidance device includes: a first route generator configured to generate a route from a starting point to a destination based on information about a starting point and a destination input from a user; When a request signal for requesting an internal route guidance for an internal movement section included in the generated route is received, a second route generator for generating an internal route guidance route corresponding to the internal movement section in response to the request signal ; and a controller for generating and providing internal route guidance information for guiding a user's movement on the internal route guidance route to a user terminal based on the generated internal route guidance route, wherein the controller includes: Guidance information may be provided based on augmented reality for an internal road belonging to the internal movement section.

Description

AR-based road guidance device and method {APPARATUS AND METHOD FOR AUGMENTED REALITY BASED ROAD GUIDANCE}

The present application relates to an augmented reality (AR)-based road guidance apparatus and method.

A navigation device, which is a device for guiding a route (road), is a type of automatic vehicle navigation device designed for use in vehicles (cars) in general. do it for a purpose The navigation system is recognized as an essential device for vehicle operation by providing various additional functions and convenience, such as a signal violation enforcement section, a speeding enforcement section, information about nearby gas stations, and real-time traffic situation guidance.

However, the conventional route guidance technology (navigation technology) is mainly focused on the vehicle and only supports the route guidance for the route that the vehicle can move (ie, the road on the ground, etc.), and a complex and crowded subway with a rather large scale For internal spaces such as the interior of a station or the interior (inside) of a large building, there is no support for directions to the interior space due to the absence of relevant data.

As such, most of the conventional route guidance technologies have difficulty in providing accurate route guidance to the internal space, so that the user can exemplarily use a walk to reach the destination via the aforementioned internal space (especially, the internal space on the first road). When moving, the user may get lost or get lost while moving in the corresponding internal space, which causes a delay in the travel time to the destination.

1 is a view showing an example of a sign for guiding a road in a subway station.

Referring to FIG. 1, in general, signs (signs guiding the moving direction or exit of a subway station, etc.) existing inside subway stations are simple and vague, such as internal trains, external trains, direction a, line b, etc. has been

Therefore, the user is connected to a crowded transfer station (for example, Express Bus Terminal Station, Samseong Station, Jamsil Station, etc.) where multiple subway lines intersect, large buildings (department stores, marts, etc.), underground shopping malls, bus terminals, many entrances, etc. There is a limit to accurately moving to a desired destination only by relying on a sign as shown in FIG.

That is, there is a difficulty in smoothly and accurately guiding the user to the desired destination with respect to the internal space only by using the conventional route guidance technology or signage, so that the direction the user wants to go in the subway station is different. It could happen that you go down to the platform in the opposite direction, or you get lost because you can't find an exit.

2 and 3 are diagrams showing an example of a route (road) guidance for a vehicle or a foot in the prior art.

Referring to FIG. 2, conventional portal sites (eg, Naver, Google, etc.) provide route guidance information based on a vehicle as shown in FIG. In providing route guidance information by using , when the origin and destination are input from the user, the route from the origin to the destination, the distance to the route, and the time required when the route is moved by car or on foot (estimated time required) ), etc., are provided.

However, such a conventional route guidance technology only provides a route to a destination based on a two-dimensional map only for a route (ie, a road on the ground) that a vehicle can mainly move, as described above, It is difficult to guide (guide) so that the user can move accurately without wandering through the interior space of a complex subway station or the interior (inside) of a large building.

In addition, referring to FIG. 3 , the conventional route guidance technology does not clearly distinguish and display the movement route of each floor with respect to the internal space in which a plurality of floors exist. When you want to visit the store, it is difficult to find it exactly.

4 is a diagram illustrating an example of a conventional application screen that provides subway-related information.

Referring to FIG. 4 , the conventional application providing subway-related information provides information on quick transfer information of the subway, facility information, station map, etc., and provides such information in text form or only schematically. . Therefore, when the user wants to use the toilet as an example, it may be difficult to use the toilet because the location of the toilet cannot be accurately known through such an application.

The technology that is the background of the present application is disclosed in Korean Patent Publication No. 10-0401640.

The present application is intended to solve the problems of the prior art described above, and with respect to an internal space such as a complex and crowded subway station having a rather large scale or the interior (inside) of a large building, the user goes through the internal space to the destination An object of the present invention is to provide an augmented reality-based navigation device and method that can support smoother and more accurate movement without getting lost when moving.

However, the technical problems to be achieved by the embodiments of the present application are not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, the augmented reality (Augmented Reality) based road guidance device according to an embodiment of the present application is based on the information about the starting point and the destination input from the user, from the starting point to the destination a first path generator for generating a path; When a request signal for requesting an internal route guidance for an internal movement section included in the generated route is received, a second route generator for generating an internal route guidance route corresponding to the internal movement section in response to the request signal ; and a controller for generating and providing internal route guidance information for guiding a user's movement on the internal route guidance route to a user terminal based on the generated internal route guidance route, wherein the controller includes: Guidance information may be provided based on augmented reality for an internal road belonging to the internal movement section.

In addition, the internal movement section may be a section corresponding to the internal space of a structure provided in the basement and/or the ground.

In addition, the second path generation unit may generate the internal path guide path in consideration of the structure of the internal space for each floor of the structure and convenience facilities existing in the internal space of the structure.

In addition, the second route generating unit may recognize the obtained internal road related image as the request signal when the internal road related image related to the internal road belonging to the internal movement section is obtained from the user terminal.

In addition, when the internal road-related image is obtained, the second route generating unit is configured to: a position of an exit that is closest to the location of the destination among exits belonging to the internal movement section from a position corresponding to the internal road-related image A route to . may be generated as the internal navigation route.

Also, the controller may generate and provide the internal route guidance information as at least one information type of screen display information, sound information, and vibration information.

In addition, the control unit, when a plurality of direction indication information is included in the obtained internal road related image, an icon of corresponding direction indication information corresponding to the inner road guide path among the plurality of direction indication information is displayed on the inside road The screen display information may be controlled to be displayed in a form that is easier to recognize or identify than an icon of the non-responsive direction indication information that does not correspond to the guide route.

In addition, the control unit, in consideration of the user location information obtained from the location acquisition sensor in the user terminal, the content of the screen display information, the sound information in response to the remaining distance to the direction change point to which the user needs to change the moving direction content and the vibration type of the vibration information can be changed.

On the other hand, the augmented reality (Augmented Reality)-based road guidance method according to an embodiment of the present application, (a) based on the information about the origin and destination received from the user in the first route generator, from the origin to the destination creating a path; (b) when a request signal for requesting an inner route guidance for an inner movement section included in the generated route is received in the second route generator, an inner road corresponding to the inner movement section in response to the request signal generating a guide route; and (c) generating, in the control unit, internal navigation information for guiding a user's movement on the internal route guidance route based on the generated internal route guidance route and providing the generated internal route guidance information to the user terminal, In step (c), the control unit may provide the internal route guidance information based on augmented reality for the internal road belonging to the internal movement section.

In addition, the internal movement section may be a section corresponding to the internal space of a structure provided in the basement and/or the ground.

In addition, in step (b), the internal path guide path may be generated in consideration of the structure of the internal space for each floor of the structure and convenience facilities existing in the internal space of the structure.

Also, in the step (b), when the internal road-related image related to the internal road belonging to the internal movement section is obtained from the user terminal, the acquired internal road-related image may be recognized as the request signal.

The above-described problem solving means are merely exemplary, and should not be construed as limiting the present application. In addition to the exemplary embodiments described above, additional embodiments may exist in the drawings and detailed description.

According to the above-described problem solving means of the present application, through the provision of an augmented reality-based road guidance device, the user moves to the destination on a rather large scale, via the inside of a complex and crowded subway station or the interior (inside) of a large building. Even when passing, it is possible to support (guide, guide, guide) the user's movement so that he or she can accurately move to the destination (or to the exit toward the destination) without getting lost in the interior space.

However, the effects obtainable herein are not limited to the above-described effects, and other effects may exist.

1 is a view showing an example of a sign for guiding a road in a subway station.
2 and 3 are diagrams showing an example of a route guidance for a vehicle or a foot in the prior art.
4 is a diagram illustrating an example of a conventional application screen that provides subway-related information.
5 is a view showing a schematic configuration of an augmented reality-based road guidance device according to an embodiment of the present application.
6 is a diagram illustrating an example of an internal road-related image obtained from a user terminal in the augmented reality-based road guidance device according to an embodiment of the present application.
7 is a diagram illustrating an example of controlling screen display information in the augmented reality-based road guidance device according to an embodiment of the present application.
8 is a diagram illustrating an example of providing internal route guidance information in the form of screen display information based on augmented reality in the augmented reality-based road guidance device according to an embodiment of the present application.
9 is a view for explaining the function of the augmented reality-based way guidance device according to an embodiment of the present application.
10 is a diagram illustrating an example of a screen display of a user terminal by an augmented reality-based road guidance device according to an embodiment of the present application.
11 is a diagram illustrating an example of a screen display of a general wayfinding function provided through an augmented reality-based wayfinding apparatus according to an embodiment of the present application.
12 is a diagram illustrating a screen display example of an AR-based wayfinding function provided through an augmented reality-based wayfinding device according to an embodiment of the present application.
13 is a flowchart illustrating an augmented reality-based way guidance method according to an embodiment of the present application.

Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present application pertains can easily implement them. However, the present application may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present application in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout this specification, when a part is "connected" with another part, it is not only "directly connected" but also "electrically connected" or "indirectly connected" with another element interposed therebetween. "Including cases where

Throughout this specification, when it is said that a member is positioned "on", "on", "on", "under", "under", or "under" another member, this means that a member is positioned on the other member. It includes not only the case where they are in contact, but also the case where another member exists between two members.

Throughout this specification, when a part "includes" a component, it means that other components may be further included, rather than excluding other components, unless otherwise stated.

In the present application, even when a user passes through an internal space such as a complex and crowded subway station with a rather large scale or the interior (inside) of a large building, the user does not get lost in such an internal space when moving to a destination. We propose an Augmented Reality-based road guide device that supports the user's movement (guide, guide, and guide) so that he or she can accurately move to a destination (or to an exit toward the destination).

5 is a diagram showing a schematic configuration of an augmented reality (AR)-based way guidance device 10 according to an embodiment of the present application.

Hereinafter, the augmented reality-based road guidance device 10 according to an embodiment of the present application will be referred to as the present device 10 for convenience of description.

Referring to FIG. 5 , the device 10 may be provided in the form of a device included in the user terminal 20 , for example. In this case, the device 10 may be a device that can be implemented in the form of a program or application installed in the user terminal 20 . In other words, the augmented reality-based road guidance method provided through the device 10 may be implemented in the form of a program or application, for example, and provided through the user terminal 20 .

However, the present invention is not limited thereto, and as another example, the device 10 may be provided in the form of a server capable of transmitting and receiving data with the user terminal 20 . Hereinafter, as an example, the present device 10 will be exemplified as a device included in the user terminal 20 .

The apparatus 10 may include a first path generating unit 11 , a second path generating unit 12 , and a control unit 13 .

The first route generator 11 may generate a route from the source to the destination based on information about the source and destination (ie, source information and destination information) received from the user. In this case, the first route generator 11 may receive information about the departure point and the destination from the user through the user terminal 20 carried by the user.

Hereinafter, for convenience of explanation, a path generated by the first path generator 11 will be referred to as a reference path.

Here, the user terminal 20 is a terminal capable of transmitting and receiving information through the device 10 and the network, for example, a Personal Communication System (PCS), a Global System for Mobile communication (GSM), a Personal Digital Cellular (PDC), and a PHS. (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (WCode Division Multiple Access), Wibro (Wireless Broadband Internet) terminal, It may include all types of wired/wireless communication devices such as a smartphone, a smartpad, a tablet PC, a notebook computer, a wearable device, and a desktop PC, but is not limited thereto.

Here, the wearable device is a device that can be worn on at least a part of the user's body, and may include, for example, a head mounted display (HMD), Google Glass, and the like, but is not limited thereto.

In addition, the network connectable between the device 10 and the user terminal 20 is, for example, a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, a World Interoperability for Microwave Access (WIMAX) network, and the Internet ( Internet), LAN (Local Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth (Bluetooth) network, NFC (Near Field Communication) network, satellite broadcasting network , an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, and the like, but is not limited thereto.

The user may input, for example, departure point information and destination information in the form of keywords (words) or in the form of addresses through the user terminal 20 . As another example, the user may touch or click a specific location on the map provided on the screen of the user terminal 20 , and based on the touch (click) input, the source information and the destination information are input to the user terminal 20 . can be

The first route generator 11 may receive source information and destination information from a user through the user terminal 20 , and based on this, generates a route from a location corresponding to the source information to a location corresponding to the destination information. can do.

In this case, there may be a plurality of routes from the location of the departure point information to the location of the destination information, and the first route generating unit 11 is a route (particularly, walking time) that minimizes travel time (particularly, walking time) among the plurality of routes ( That is, a minimum time path, a shortest path) can be generated. For example, the first route generator 11 may generate a route that minimizes walking time as a route from the location of the departure point information to the location of the destination information.

The path generated by the first path generating unit 11 may be displayed on the screen of the user terminal 20 in the form of FIG. This is only an example, and is not limited thereto.

The second route generator 12 is configured to receive a request signal for requesting internal route guidance for an inner movement section included in the route (reference route) generated by the first route generator 11 , when received. In response, an internal navigation route corresponding to the internal movement section may be generated.

That is, the path (reference path) generated by the first path generator 11 may or may not include at least a part of the internal movement section.

At this time, the second route generator 12 includes an internal movement section in the route (reference route) generated by the first route generator 11 , and requests a route guidance for this inner movement section (that is, When a request signal for requesting internal navigation) is received from the user (or user terminal), an internal navigation route corresponding to the internal movement section may be generated in response to the received request signal.

Here, the internal movement section may mean a section corresponding to the internal space of a structure provided underground and/or on the ground. In this case, the internal space of a structure provided underground and/or above the ground may mean an internal space (internal space) corresponding to a subway station, an underpass, an underground shopping mall, a building, or the like. In addition, the building may mean, for example, a department store, a hospital, a mart, a shopping mall, a bus terminal, and the like, but is not limited thereto.

The internal movement section considered herein may mean a section corresponding to a subway station (subway station), which is a structure that is preferably provided underground.

The second path generating unit 12 generates an internal route guidance path in consideration of the structure (internal structure) of the internal space for each floor of the structure provided in the basement and/or the ground and the convenience facilities existing in the internal space of the structure. can create Accordingly, the second path generating unit 12 may generate a path (internally cut path) so that the division of the movement path is clearly divided for each floor of the internal space.

Here, convenience facilities existing in the interior space include, for example, toilets, escalators, elevators, beverage vending machines, convenience stores, lockers, situation rooms, transportation card charging stations, shops (restaurants, clothing stores, etc.) in subway stations. It may be included, but is not limited thereto, and various convenience facilities in the subway station may be applied.

As such, the second route generator 12 moves to the destination in consideration of the internal structure of each floor of the structure or the location of convenience facilities in the inner movement section so that the user can more easily move to the destination within the inner movement section. An internal navigation route can be created to guide the route.

When a request signal for requesting internal navigation for an internal movement section is received, the second route generator 12 may generate an internal navigation route in response to the received request signal. In this case, the second route generating unit 12 recognizes the obtained internal road related image as a request signal when the internal road related image related to the internal road belonging to the internal moving section is obtained from the user terminal 20, An internal navigation route may be generated in response to the request signal.

6 is a diagram illustrating an example of an internal road-related image obtained from the user terminal 20 in the augmented reality-based road guidance device 10 according to an embodiment of the present application.

Referring to FIG. 6 , it is assumed that the user acquires the image shown in FIG. 6 as an image related to a road guide sign existing in a specific subway station through the user terminal 20 .

At this time, the second path generating unit 12 determines whether the image acquired through the user terminal 20 is an image captured for an internal movement section within the path (reference path) generated by the first path generating unit 11 . can do. That is, the second path generating unit 12 uses the image obtained through the user terminal 20 to capture an image (ie, internal movement) obtained by photographing any one of the inner roads belonging to the inner movement section within the reference route. It is possible to determine whether it is an image taken of an internal road belonging to the section).

As a result of the determination, when the image obtained through the user terminal 20 is an image obtained by photographing an inner road belonging to the inner movement section, the second route generating unit 12 generates the image obtained from the user terminal 20 as described above. It may be identified as an image related to an internal road related to an internal road belonging to an internal movement section within the reference route.

Here, in order to identify whether the image acquired from the user terminal 20 in the second path generator 12 is an image related to an internal road, the device 10, for example, is a structure (all structures) provided underground and/or on the ground. ) may include a database unit (not shown) that pre-stores a plurality of images of the internal space (that is, an image obtained by photographing an internal road belonging to the corresponding internal space).

In the database unit (not shown), each of these plurality of images is linked together with location information when the image is taken (that is, location information of the user terminal when the image is taken) and direction information when the image is taken. can be saved. Here, the direction information may mean azimuth information. In addition, the location information may include GPS information, altitude information, and the like.

The second path generating unit 12 compares (matching) the image obtained from the user terminal 20 with a plurality of images previously stored in the database unit (not shown), and the image obtained from the user terminal 20 is It may be identified whether the image is related to the internal road related to the internal road belonging to the internal movement section within the reference route.

Thereafter, when it is identified that the image obtained from the user terminal 20 is an internal road-related image, the second path generator 12 recognizes the identified internal road-related image as a request signal, and an internal path corresponding to the internal movement section You can create a navigation route.

Illustratively, when the user inputs information about a departure point and a destination through the user terminal 20 in order to receive a route guidance from the departure point to the destination, the first route generating unit 11 may display a route ( reference path) can be created. In this case, information about the path (reference path) generated by the first path generating unit 11 may be displayed on the screen of the user terminal 20 , for example.

Thereafter, the user may move to a destination based on (with reference to) a route (reference route) generated through the first route generator 11 . At this time, as an internal movement section within the route (reference route), a rather complicated and congested subway station (hereinafter referred to as the target subway station) is included, for example, a multi-story, connected multiple entrances, department stores, and bus terminals. let's say there is That is, it is assumed that the user must pass through such a target subway station when moving to a destination.

At this time, when the space corresponding to the target subway station is wide, and as mentioned above, a number of entrances, department stores, bus terminals, etc. are connected and consist of multiple floors, the user sees only the road guide sign as shown in FIG. 6 as an example You may get lost or get lost while traveling to your destination.

In this case, when the user moves to the destination based on (refer to) the route (reference route) generated through the first route generator 11 , the user receives internal route guidance for the internal movement section of the reference route. If you want to receive, for example, when you enter the corresponding internal movement section to be provided with internal route guidance or are located in the corresponding internal movement section, an image (eg, in FIG. 1 or An image as shown in FIG. 6 ) may be photographed using the user terminal 20 .

The second path generating unit 12 compares (matching) the images acquired through the user terminal 20 and the images previously stored in the database unit (not shown), so that the acquired image is internally related to the corresponding internal movement section. When it is identified as a road-related image, it may be recognized as a request signal for requesting an internal route guidance for an internal movement section.

When the request signal is received (that is, when an image related to an internal road is obtained from the user terminal), the second route generator 12 generates an internal route guidance route corresponding to the internal movement section in response to the request signal, The generated internal navigation route may be provided to be displayed on the screen of the user terminal 20 as an example.

When the internal road-related image is obtained, the second route generating unit 12 calculates a path from the position corresponding to the internal road-related image to the position of the nearest exit from the destination position among exits belonging to the internal movement section. Can be created as an internal navigation route.

When the location of the destination input from the user is the location of a building existing on the ground, the second route generator 12 is the closest to the location of the destination among the exits (ie, exits within the subway station) belonging to the internal movement section. A route to the location of the located exit may be generated as an internal navigation route, but is not limited thereto.

As another example, when the location of the destination input from the user is the location of a building on the ground, the second route generating unit 12 is a destination among a plurality of ticket gates belonging to an internal movement section (ie, an internal space within a subway station). A route from the location of the wicket to the location of the nearest ticket gate can be created as an internal navigation route.

Exemplarily, when the location of the destination is a location corresponding to a ground building existing on the ground, the second route generating unit 12 is the location of the destination among the exits belonging to the inner movement section from the location corresponding to the inner road related image. A route from the to the location of the nearest exit can be created as an internal navigation route. Here, the location corresponding to the internal road-related image is the location of the user terminal 20 that has acquired the internal road-related image, which may mean the current location of the user who has captured/obtained the internal road-related image.

On the other hand, the location of the destination corresponds to, for example, an underground building that is any one of a plurality of buildings belonging to the inner movement section (in other words, any one of a plurality of shopping malls belonging to the underground shopping mall belonging to the inner movement section) In the case of a location, the second route generating unit 12 calculates a path from a location corresponding to the internal road-related image to the location of the destination within the internal movement section (that is, a location corresponding to any one underground building in the internal movement section) Can be created as an internal navigation route.

At this time, there may be a plurality of routes from the location corresponding to the internal road-related image to the location of the destination information. A path (ie, a minimum time path, a shortest path) may be generated as an internal navigation path. That is, the second route generating unit 12 is a route from the location corresponding to the internal road-related image acquired from the user terminal 20 to the location of the destination information, and sets the route with the minimum walking time as the internal route guidance route. can be created as

The controller 13 generates internal navigation information for guiding the movement of the user on the internal route guidance route based on the internal route guidance route generated by the second route generator 12, and a user terminal possessed by the user. (20) can be provided. In this case, the controller 13 may provide the internal route guidance information to the user terminal 20 in consideration of the user's location information (user location information). In addition, the internal guidance information may include movement guidance information in consideration of the information on the internal guidance route generated by the second route generator 12 and the location information of the user that is changed according to the movement of the user.

Here, the user's location information is location information acquired through a location acquisition sensor included in the user terminal 20, and may be, for example, GPS information, but is not limited thereto. As another example, the user's location information can be obtained through a single image (photo) even in the basement or indoors where GPS does not pass, for example, by using a visual localization technology.

The controller 13 may provide the internal route guidance information based on augmented reality for the internal road belonging to the internal movement section. That is, the controller 13 may provide the internal route guidance information based on augmented reality.

The control unit 13 generates the internal route guidance information for the internal movement section as at least one information type of screen display information (direct display arrow display, U-turn display, remaining distance display, etc., display content), sound information, and vibration information. It may be provided to the user terminal 20 .

For example, when a plurality of direction indication information is included in the internal road-related image acquired from the user terminal 20 , the control unit 13 may control the corresponding direction indication information corresponding to the internal road guide path among the plurality of direction indication information. The screen display information provided to the user terminal 20 may be controlled so that the icon is displayed in a form that is easier to recognize or identify than an icon of non-responsive direction indication information that does not correspond to the internal navigation path.

In this case, displaying the icon in a form that is easy to recognize or identify may mean displaying at least one of a visually emphasized form, an expanded form, a form accompanying an auditory effect, and a dynamic animation form. This can be more easily understood with reference to FIG. 7 .

7 is a diagram illustrating an example of controlling screen display information in the augmented reality-based road guidance device 10 according to an embodiment of the present application.

Referring to FIG. 7 , as an example, it is assumed that a user is located in a subway station corresponding to 'Yeoksam Station' and moves to 'Kon University Station' by using the subway.

Illustratively, the user uses the user terminal 20 in 'Yeoksam Station' to receive a request for guidance on the internal route from 'Yeoksam Station' to 'Kon University Station' in FIG. 7 (a) and You can shoot the same image. In this case, the second route generator 12 may generate an internal route guidance route indicating a route (path) from the user's current location to the Konkuk University Station.

On the other hand, it is assumed that the first direction indication information for guiding the 'Gyodae/Sadang direction' and the second direction indication information for guiding the 'Seolleung/Jamsil direction' are included as a plurality of direction indication information in the obtained interior road-related image.

At this time, since the destination the user wants to go to is 'Konneung University Station', the user needs to move in the 'Seolleung/Jamsil direction' according to the second direction indication information among a plurality of direction indication information included in the acquired interior road related image. there is

The control unit 13, based on the internal path generated by the second path generating unit 12, sets the second direction indication information among a plurality of direction indication information included in the internal road related image to the internal way guide path. While recognition as corresponding corresponding direction indication information, the first direction indication information among a plurality of direction indication information may be recognized as non-corresponding direction indication information that does not correspond to an internal navigation route.

Accordingly, the corresponding direction indication information may refer to information (direction indication information) indicating a direction coincident with the direction to which the user should go among a plurality of direction indication information (information indicating a plurality of directions).

In this way, after recognizing the second direction indication information among the plurality of direction indication information as the corresponding direction indication information, the control unit 13 uses the internal way guide information generated based on the inner way guide route as screen display information as an example in FIG. 7 . It can be provided on the screen of the user terminal 20 as shown in (b).

That is, as shown in part A of FIG. 7B , the control unit 13 has a form in which the icon of the corresponding direction indication information among the plurality of direction indication information is easier to recognize or identify than the icon of the non-corresponding direction indication information. It is possible to provide screen display information to be displayed as .

In addition to the control of the screen display information for the corresponding direction indication information, the control unit 13 may control movement guide information (the user's change according to the movement of the user) among the internal road guide information displayed on the screen of the user terminal 20 , for example. As shown in part B in Fig. 7(b), as shown in part B of Fig. 7(b), [go straight 100m and turn right to go to 'Konik University Station'] and take the 'Seolleung/Jamsil direction' train] The screen display information may be controlled so that the same phrase is displayed on the screen of the user terminal 20 .

In this way, when the device 10 provides the internal road guidance information for the internal movement section based on augmented reality, the direction indication information matching the direction the user wants to go among the plurality of direction indication information included in the road guide sign is displayed. The screen of the user terminal 20 may be controlled to be displayed in a form that is easy to recognize or identify compared to the non-corresponding direction indication information. This device 10 provides the user to more intuitively recognize the direction he or she should go based on the information displayed on the screen, so that the user can move quickly without getting lost in moving to the destination. You can guide (guide, provide) the movement.

In addition, the control unit 13 considers real-time user location information obtained from a location acquisition sensor (eg, a GPS sensor, etc.) in the user terminal, and corresponds to the remaining distance to the direction change point to which the user needs to change the moving direction on the screen The content of the display information, the content of the sound information, and the vibration type of the vibration information can be changed.

At this time, the control unit 13 provides sound information through the speaker unit of the wearable sound input/output unit or user terminal 20 worn by the user in the case of sound information, and in the case of vibration information, the wearable vibration output unit or the user terminal 200 worn by the user can be provided through

For example, the controller 13 may generate and provide sound information so that the user can recognize the internal way guide information as sound (so that the inner way guide information can be provided as a sound output). Also, the controller 13 may generate and provide the vibration information so that the user can recognize the internal route guidance information as vibration (so that the internal route guidance information can be provided as vibration output).

In this case, the sound information generated by the controller 13 may be provided through a wearable sound input/output unit (not shown) worn by the user or a speaker unit of the user terminal 20 . Also, the vibration information generated by the controller 13 may be provided through a wearable vibration output unit (not shown) worn by the user or a vibration unit provided in the user terminal 20 . In other words, the controller 13 may control the wearable sound input/output unit or the speaker unit of the user terminal 20 so that the generated sound information can be provided to the user. Also, the controller 13 may control the wearable vibration output unit or the vibration unit of the user terminal 20 so that the generated vibration information may be provided to the user.

However, the present invention is not limited thereto, and when the device 10 itself includes a sound input/output unit and a vibration output unit, the generated sound information is provided through the device 10's own sound input/output unit, and generated Vibration information may be provided through a self-vibration output unit of the device 10 .

The device 10 may be connected to the user terminal as well as the wearable sound input/output unit and the wearable vibration output unit through a network. In this case, the network connected between the two units (that is, the wearable sound input/output unit and the wearable vibration output unit) and the present device 10 may be, for example, a wireless communication network, but is not limited thereto.

The wearable sound input/output unit may be, for example, a headset, earphones, etc. that can be worn on the user's head and neck, and can input/output voice. For example, when the wearable sound input/output unit is worn on the neck, it may be expressed differently as a necklace-type headset. For example, the wearable sound input/output unit may be expressed differently as a headphone device or the like.

For example, if the user is blind with visual information blocked, the wearable sound input/output unit is preferably a bone conduction headset or earphone worn around the user's ear so that sound information obtainable through the ear is not blocked more than a predetermined amount can do.

The wearable sound input/output unit may receive, for example, voice information spoken by the user (eg, utterance voice information related to source information and destination information), and may provide it to the device 10 . The first path generating unit 11 of the device 10 recognizes the source information and the destination information based on the voice analysis of the voice information provided from the wearable sound input/output unit, and based on the recognized information, the path (reference path) ) can be created. Also, the wearable sound input/output unit may output (express) sound information generated by the control unit 13 .

The control unit 13, based on the user's real-time location information and the internal navigation information (particularly, the internal road guidance route), corresponds to the remaining distance to the direction change point to which the user needs to change the moving direction, the vibration type of the vibration information Alternatively, the content of the sound information may be changed. In this case, the vibration type may include at least one of a vibration intensity and a vibration pattern.

The controller 13 may generate vibration information by varying the intensity of vibration according to a movement direction, such as forward movement, backward movement, left movement, or right movement, or by changing a vibration pattern. As another example, the controller 13 may generate the vibration information so that the vibration intensity or the vibration pattern is different depending on the movement direction, such as moving in the 1 o'clock direction, moving in the 2 o'clock direction, or moving in the 3 o'clock direction.

For example, when the internal navigation information (particularly, the internal navigation route) follows a path turning right after going straight 300 m from the current user location information, the control unit 13 transmits the sound information 'must go straight 300 m' to the wearable sound It may be provided to an input/output unit (or a speaker unit), through which the wearable sound input/output unit may output sound information. In this case, the control unit 13 may change the content of the sound information in response to the remaining distance to the direction change point (the point where the user needs to turn right) to change the movement, and provide the changed sound information to the wearable sound input/output unit. .

That is, as the user moves based on the sound information 'You must go straight 300m', the remaining distance to the turning point may gradually decrease. In this case, the controller 13 may control the sound information to be changed for each preset distance corresponding to the remaining distance (in consideration of the remaining distance). For example, the controller 13 may generate sound information so that the sound information is changed at intervals of 10 m from a point in time when the remaining distance is less than or equal to 100 m, and provide the generated sound information to the wearable sound input/output unit.

Specifically, the control unit 13 changes the sound information so that the sound information 'You must turn right after going straight for 100m' is provided to the user through the wearable sound input/output unit when the remaining distance to the direction change point is less than 100m. can Similarly, the control unit 13 changes the sound information so that the sound information 'must go straight after 90m' is provided at the time remaining below 90m, and sound information 'must turn right after going straight after 80m' at the time remaining below 80m. You can change the sound information to provide For example, when the remaining distance is less than 10 m, the controller 13 may generate sound information so that the sound information is changed and provided for every 1 m distance.

As another example, when the internal guidance information (particularly, the internal guidance route) follows a path turning right after going straight 300 m from the current user location information, the control unit 13 selects the weakest first vibration intensity among the 10 vibration strengths. The vibration information may be generated and provided to the wearable vibration output unit. Through this, the wearable vibration output unit may express the vibration information provided from the control unit 13 and provide it to the user.

At this time, the controller 13 changes the vibration type of the vibration information in response to the remaining distance to the direction change point (the point where the user needs to turn right) to change the movement, and provides the changed vibration information to the wearable vibration output unit. have. That is, as the user moves based on the vibration information of the first vibration intensity, the remaining distance to the direction change point may gradually decrease. In this case, the controller 13 may control the vibration type of the vibration information to be changed for each preset distance corresponding to the remaining distance (in consideration of the remaining distance).

For example, the controller 13 may change the vibration information in a direction in which the vibration intensity is gradually increased at intervals of 10 m from a time when the remaining distance remains less than or equal to 100 m, and may provide the changed vibration information to the wearable vibration output unit.

That is, the control unit 13 generates vibration information of the first vibration intensity when the remaining distance to the direction change point remains less than or equal to 100 m and provides it to the wearable vibration output unit, and when the remaining distance to the direction change point is less than or equal to 90 m, at the first vibration intensity By changing to the second vibration intensity, vibration information having the second vibration intensity may be provided to the wearable vibration output unit. In addition, the controller 13 changes the vibration intensity from the second vibration intensity to the third vibration intensity at a time point remaining below 80 m, generates vibration information having the changed third vibration intensity, and provides it to the user through the wearable vibration output unit can do.

Also, the controller 13 may change the vibration pattern as a vibration type of vibration information in response to the remaining distance to the direction change point (taking the remaining distance into consideration). For example, the controller 13 may change the vibration pattern every 1 m from the time when the remaining distance remains 10 m or less.

Specifically, when the remaining distance remains 10 m or less, the control unit 13 generates vibration information in a pattern (vibration pattern) in which the vibration of the first vibration intensity vibrates once every 2 seconds and provides it to the wearable vibration output unit. have. In addition, when the remaining distance is less than or equal to 9 m, the control unit 13 generates vibration information in a pattern (vibration pattern) in which the vibration of the second vibration intensity vibrates once per second and can be provided to the wearable vibration output unit. . Also, when the remaining distance remains less than or equal to 1 m, the controller 13 may control the wearable vibration output unit by generating vibration information in a pattern in which vibration having the tenth vibration intensity vibrates 5 times per second.

As such, the control unit 13 may change the vibration type of vibration information or the content of the sound information in response to the remaining distance to the direction change point (in consideration of the remaining distance), and through this, the changed information (that is, the vibration type is Changed vibration information and sound information with changed sound content) may be provided.

In addition, when it is determined that the user deviated from the route corresponding to the internal route guidance information (that is, the internal route guidance route) based on the internal route guidance information (particularly, the internal route guidance route), the controller 13 responds accordingly It is possible to change the vibration type of the vibration information or the content of the sound information.

For example, the control unit 13 may generate sound information 'you must turn right after going straight 100m' based on the internal route guidance path and provide it to the wearable sound input/output unit. At this time, if it is determined that the user deviated from the displayed path, the control unit 13 'deviates from the path' or 'deviates from the path. You can change it to the sound information of 'Please U-turn and go back', and provide sound information of the changed content.

As another example, when it is determined that the user deviated from the internal navigation path, the controller 13 converts the current vibration information (eg, vibration information having a first vibration intensity) to vibration information having a tenth vibration intensity. changed, and the changed vibration information may be provided to the wearable vibration output unit. Alternatively, when it is determined that the user deviated from the internal navigation path, the controller 13 vibrates the vibration information having a vibration pattern that vibrates once at the first vibration intensity per second at the tenth vibration intensity 5 times per second It is possible to change to vibration information having a vibration pattern, and provide the changed vibration information.

The wearable vibration output unit may be disposed (provided) in a wearable form on a part of the user's body. For example, the wearable vibration output unit may be disposed (provided) in a wearable form (eg, a bracelet, etc.) on a user's wrist. One or a plurality of wearable vibration output units may be disposed on a part of the user's body.

A plurality of wearable vibration output units may be disposed at different positions with respect to the user. For example, the wearable vibration output unit may be disposed on each of the user's wrists. That is, the wearable vibration output unit may be disposed at different positions on each of the user's wrists, and in this case, two wearable vibration output units may be disposed as a plurality.

In addition, the wearable vibration output unit may include a vibration generating unit that generates vibration, and at least one vibration generating unit may be disposed (provided).

Also, as another example, the wearable vibration output unit may be disposed (provided) in the form of a headband that can be worn on the user's head. In this case, in the wearable vibration output unit in the form of a headband, a plurality of vibration generating units may be disposed at different positions along the circumference inside the headband.

In addition, the wearable vibration output unit may be disposed (provided) in the form of a belt that can be worn on the user's waist. In this case, in the wearable vibration output unit in the form of a belt, a plurality of vibration generating units may be arranged at different positions along the circumference of the belt.

The control unit 13 determines the relationship between the position (placement position) of each of the plurality of wearable vibration output units arranged at different positions with respect to the user and the movement direction of the user based on the internal navigation information (particularly, the internal navigation route). In consideration of the relationship, the vibration types of the plurality of wearable vibration output units may be controlled (individually controlled, individually controlled differently).

For example, with respect to the plurality of wearable vibration output units disposed on both wrists of the user, the wearable vibration output unit disposed on the left wrist is a first wearable vibration output unit, and the wearable vibration output unit disposed on the right wrist is the second wearable Let's call it a vibration output unit. At this time, the control unit 13 controls the position of each of the plurality of wearable vibration output units (that is, considering that the first wearable vibration output unit is located on the left wrist and the second wearable vibration output unit is located on the right wrist) and the user's movement In consideration of the relationship with the direction, the vibration type of the plurality of wearable vibration output units based on the inner navigation path may be controlled.

Specifically, when the user has to turn left according to the internal road guidance route in a state in which the user is moving straight, the control unit 13 provides vibration information through the first wearable vibration output unit disposed on the user's left (left) wrist. Vibration information may be provided to the first wearable vibration output unit to be expressed (in other words, to generate vibration). As such, the control unit 13 may control the first wearable vibration output unit in consideration of the user's movement direction (left rotation), and through this, may provide the user with vibration indicating that the user should move to the left (refer to the left rotation). can).

As another example, when the user has to turn right according to the internal navigation route while the user is moving straight, the control unit 13 provides vibration information through the second wearable vibration output unit disposed on the user's right (right) wrist. Vibration information may be provided to the second wearable vibration output unit to express (in other words, to generate vibration). As such, the control unit 13 may control the second wearable vibration output unit in consideration of the user's moving direction (right turn), and through this, may provide the user with vibration indicating that the user should move to the right (refer to the right turn). can).

In addition, the following description will be made on the assumption that the wearable vibration output unit is a wearable vibration output unit in the form of a headband.

In the wearable vibration output unit in the form of a headband, a plurality of vibration generating units may be disposed along the circumference inside the headband. For example, the plurality of vibration generating units may include four vibration generating units. In this case, the first vibration generating unit is disposed at a position corresponding to the center of the user's forehead (front head) among the inner circumferences of the headband, and the second vibration generating unit is disposed at a position corresponding to the user's right head, and the third The vibration generating unit may be disposed at a position corresponding to the back of the head (rear head) of the user, and the fourth vibration generating unit may be disposed at a position corresponding to the user's left head.

At this time, when the user needs to turn right according to the movement path information while the user is moving straight, the control unit 13 provides the vibration information through the first vibration generating unit while guiding the user to go straight. It is possible to control a wearable vibration output unit in the form of The controller 13 may control the wearable vibration output unit in the form of a headband to provide vibration information through the second vibration generating unit when the user needs to turn right.

Also, when the user needs to turn left, the controller 13 may control the wearable vibration output unit in the form of a headband to provide vibration information through the fourth vibration generating unit. In addition, when the user needs to make a U-turn, the controller 13 may control the wearable vibration output unit in the form of a headband to provide vibration information through the third vibration generating unit.

As such, the control unit 13 determines the relationship between the position of each of the plurality of wearable vibration output units (placement position with respect to the user) (or the position of each of the plurality of vibration generating units included in the wearable vibration output unit) and the movement direction of the user. Taking this into account, it is possible to control the vibration type of the wearable vibration output unit.

The control unit 13 provides movement guide information generated based on the route guide information (in particular, the displayed route) as vibration through a wearable vibration output unit worn on the user's wrist as an example (that is, the vibration intensity or vibration pattern is different). vibration information) or, for example, through a wearable sound input/output unit worn on the user's head, may be provided by voice (ie, as voice guidance).

This device 10 provides not only the internal way guide information as voice information through the wearable sound input/output unit, but also vibration information through the wearable vibration output unit, so that not only general users (passengers) but also people with visual impairments, etc. Even for the visually impaired, it is possible to provide safer and more accurate movement guidance (guide) for the internal route guidance route, and it is possible to maximize the user's convenience and activity.

In addition, the device 10 provides the movement guide information as voice information and vibration information, so that when the user cannot continuously check the screen of the user terminal 20 on which the internal navigation information is displayed while walking (for example) For example, it is possible to provide a more accurate route guidance or movement guidance (guide) even for a case in which a visually impaired person walks or a general user performs a walking movement with both hands full).

FIG. 8 is a diagram illustrating an example in which the augmented reality-based path guidance device 10 according to an embodiment of the present application provides internal path guidance information in the form of screen display information based on augmented reality.

Referring to FIG. 8 , the controller 13 may provide internal route guidance information as screen display information on the screen of the user terminal 20 as shown in FIG. 8 . In this case, the screen display information may include, for example, an arrow display related to going straight, a right turn, a left turn, and a U-turn, and a residual distance display related to the remaining distance, but is not limited thereto.

This device 10 relates to an augmented reality (AR)-based way guidance device. The present device 10 may be expressed differently as an AR-based road guide device, AR navigation device, AR-based route guide device, and the like, in which AR subway direction notification can provide a service.

The device 10 provides AR-based internal route guidance information to users (eg, foreigners, tourists, subway users) who find it difficult to find a way like a maze in the subway due to conventionally crowded subways, unfriendly location descriptions, etc. etc.), so that the user can more easily move the internal movement section (support) can be provided.

The device 10 is illustratively for users who use the subway for the first time for reasons of tourism or movement, and users who suffer from inconvenience in using the subway due to unfriendly explanations (ie, road guide signs in conventional subway stations, etc.) , even on the first road, it can be provided to move more quickly and accurately without getting lost.

Hereinafter, a function provided by the device 10 and an example of a screen display of the user terminal 20 by the device 10 will be described.

9 is a view for explaining the function of the augmented reality-based way guidance device 10 according to an embodiment of the present application.

Referring to FIG. 9 , the device 10 may provide an AR route guidance function, a store guidance function, a station convenience facility guidance function, a character service function, and a relief service function.

The AR navigation function may include an entrance recognition function, a QR code scanning function, a direction guidance function, a required time guidance function, a station arrival notification function, a store guidance function, and a subway route map guidance function. The store guide function may include a detailed information function, a wish list function, and a review writing function. The in-station convenience facility guidance function may include a convenience facility presence guidance function, a location guidance function, and an AR directions function.

The character service function may include a cash collecting function, a mini-game provision function, an affiliate service guide function, an event guide function, a character decoration function, and a QR code character authentication shot function. The safety service function may include a subway etiquette guide function, a location sharing service function, a lost and found function, and a complaint report function.

The device 10 may provide a function corresponding to a function requested by the user among the various functions described above based on a user input (eg, a touch input, etc.).

10 is a diagram illustrating an example of a screen display of the user terminal 20 by the augmented reality-based way guidance device 10 according to an embodiment of the present application.

Referring to FIG. 10 , for example, the controller 13 of the device 10 may display a screen as shown in FIG. 10 (a) as a main screen on the screen of the user terminal 20 .

The controller 13 may control, for example, to display a main screen including a plurality of tab menus selectable by the user on the user terminal 20 . Here, the plurality of menus may include, for example, an AR scan tab 1 , a quick route finding tab 2 , and a character event (affiliation) tab 3 .

When a user input (for example, a touch input, etc.) for selecting any one of a plurality of menus displayed on the screen of the user terminal 20 is made, the controller 13 of the device 10 responds to the user input , it is possible to control the screen of the user terminal 20 so that the screen corresponding to the tap (selection tap) selected by the user input is expanded and displayed on the screen of the user terminal 20 .

For example, it is assumed that, on the screen as shown in FIG. 10(a), the user performs a user input for selecting the quick navigation tab 2 as shown in FIG. 10(b). In this case, the controller 13 responds to the user input for the quick route finding tab 2, so that the screen as shown in FIG. 10 (c) is expanded and displayed on the screen of the user terminal 20. You can control the screen of In this case, for example, a screen expanded in response to a user input for the quick directions tab 2 may be referred to as an extended screen for the quick directions tab 2 .

The expanded screen for the quick navigation tab 2 may include, for example, a plurality of menus such as a station search menu, a quick search menu, an underground shopping mall search menu, and a nearby station search menu, but is not limited thereto.

The quick navigation tab 2 included in the main screen may mean a tab (menu) for searching for a route from a starting point to a destination. In particular, the quick route finding tab 2 may refer to, for example, a menu for finding a route (route) from a departure station corresponding to a departure point to a destination station corresponding to a destination on a subway map.

The AR scan tab 1 included in the main screen requests a route guidance (ie, internal route guidance) for an internal movement section included in the route (reference route) generated by the first route generator 11 . It may mean a tap (menu) for inputting a request signal. In other words, the AR scan tab 1 may mean, for example, a tab menu for photographing an image related to an interior road, but is not limited thereto.

The character event (affiliation) tab 3 included in the main screen may mean a tab that provides event-related information that provides a reward to the user according to the user's participation level using the device 10 .

Meanwhile, the quick directions tab 2 is a plurality of types of menus, and may include, for example, a general directions menu and an AR-based directions menu. Here, the screen corresponding to general wayfinding may be more easily understood with reference to FIG. 11 as an example, and the screen corresponding to AR-based wayfinding may be more easily understood with reference to FIG. 12 .

11 is a view showing an example of a screen display of a general wayfinding function provided through the augmented reality-based way guidance device 10 according to an embodiment of the present application.

Referring to FIG. 11 , for example, when the user inputs 'Express Terminal Station' as departure information and 'Kon University Station' as destination information, the controller 13 of the device 10 controls departure information on the subway map. A route from a station corresponding to , to a station corresponding to destination information may be generated and displayed on the screen of the user terminal 20 .

12 is a diagram illustrating an example of a screen display of an AR-based wayfinding function provided through the augmented reality-based wayfinding device 10 according to an embodiment of the present application.

Referring to FIG. 12 , as an example, the user is currently located in the internal space of a specific station, and the user himself/herself is located in the internal space (ie, the internal space corresponding to the internal movement section) from the location to the destination location (ie, the internal road) Let's say you want to be provided with a guide route).

In this case, the user may select the AR scan tab 1 on the main screen as shown in FIG. 10 , and in response to a user input (selection) for the AR scan tab 1 , the control unit 13 controls the user terminal 20 . The image acquisition sensor (ie, the camera) can be controlled to an active ON state capable of image capturing/acquisition. In this case, the screen of the user terminal 20 in a state in which the image acquisition sensor is controlled to be active ON may be the same as that of the screen (a) of FIG. 12 , for example.

In this state, the user can use the user terminal 20 to take a picture of a road guide sign provided (existing) in the internal space where the user is located in order to be provided with a route to the desired destination location (internal route guide route). have.

For example, when the user photographs a road guide sign as shown in (a) of FIG. 12 , the second route generating unit 12 includes an image obtained by photographing from the user terminal 20 and a database unit (not shown). Through comparison (matching) between a plurality of images pre-stored in , it may be identified whether the image obtained from the user terminal 20 is an image related to an internal road related to an internal road belonging to an internal movement section within the reference route.

As a result of the identification, if it is identified that the image obtained from the user terminal 20 is an image related to the inner road, for example, the controller 13 provides the user who has obtained the image related to the inner road as shown in FIG. 12 ( b ) as an example. Compensation can be provided as well.

Here, the reward is a reward given to the user when a normal internal road-related image is obtained, and may be provided in the form of rubies, coins, points, etc. have. For example, the controller 13 may provide (pay) one ruby to the user as a reward whenever one normal internal road-related image is obtained.

When such a reward has been obtained enough to satisfy a preset condition (for example, when 50 rubies are obtained), the user may be provided to use it like cash at a store associated (affiliated) with the device 10. .

In this case, the compensated image is an image determined to be a normal internal road-related image related to an internal road belonging to an internal movement section, which may be additionally stored in a database unit (not shown) in connection with location information and direction information. have. In this way, when the images additionally stored in the database unit (not shown) are later acquired by another user, the reference is to determine whether the corresponding internal road-related image is a normal image (normal internal road-related image). data (comparative data).

Also, in the above description, it has been exemplified that whether to provide a reward is determined depending on whether a normal internal road-related image is obtained, but the present invention is not limited thereto. For example, when a QR code located in an area within each subway station is recognized through the user terminal 20 , the controller 13 may provide a reward (ruby) in response to the recognized QR code.

In addition, when an image including a road guide sign as shown in (a) of FIG. 12 is acquired, the second route generator 12 analyzes the acquired image, and the acquired image is located at the location of the user. It can be identified whether the image is related to an interior road belonging to the interior space (ie, an image related to the interior road). Here, when analyzing an image, various image recognition algorithms known in the prior art or developed in the future may be applied, but the present invention is not limited thereto. The second path generator 12 may identify whether the acquired image is an internal road-related image through comparison (matching) with a plurality of images previously stored in a database unit (not shown).

In addition, the second route generator 12 may determine the current location of the user based on the identified internal road related image. That is, since the plurality of images stored in the database unit (not shown) are stored in association with the above-mentioned location information and direction information at the time of photographing the corresponding image, the second path generating unit 12 based on this is stored in the database It is possible to identify a matching image matching the acquired image among images previously stored in the unit (not shown), and determine the user's current location based on the identified matching image. In this case, the second route generator 12 may determine the location information stored in association with the matching image as the user's current location.

As described above, the second path generator 12 may determine the user's location information (current location information) through the location acquisition sensor of the user terminal 20 as an example, but as another example, through the user terminal 20 Based on the matching result between the acquired image and images previously stored in the database unit (not shown), the user's location information (current location information) may be determined.

As a result of matching with images pre-stored in the database unit (not shown), as an example, the second path generator 12 selects the 'Dongincheon Line 1 platform' as the user's current location as shown in FIG. 12(c). Let us assume that Thereafter, the controller 13 may provide a destination (or destination) input menu for receiving destination information to the user on the screen of the user terminal 20 as shown in FIG. 12(c) .

In this case, the controller 13 may provide a destination input menu, for example, when a route (reference route) is not generated by the first route generator 11 . In other words, the control unit 13, for example, when a route (reference route) to the destination is not generated as information about the origin and destination is not input from the user in the first route generator 11 , the destination An input menu may be provided on the screen of the user terminal 20 .

As such, in response to the destination input menu displayed on the screen, the user may input destination information (destination information) by directly typing, for example, through the user terminal 20 . The second route generating unit 12 is the location of the destination information received from the user in response to the destination input menu from the location (the user's current location, the location of the departure point) corresponding to the internal road-related image obtained from the user terminal 20 path can be created as an internal navigation path. Accordingly, the first path generating unit 11 has been exemplified only as being included in the device 10 in the above description, but the present invention is not limited thereto, and as another example, the first path generating unit 11 is omitted if necessary. can be

The controller 13 may generate internal guidance information including the corresponding internal guidance route based on the internal guidance route generated by the second route generator 12 . The controller 13 may provide (control) the generated internal route guidance information to be displayed on the screen of the user terminal 20 based on augmented reality as shown in FIG. 12(d) as an example.

The controller 13 may provide movement guide information in consideration of the information on the internal route guide route and the location information of the user that is changed according to the movement of the user when the inner route guide information is provided.

In addition, in the above-described example of the present application, destination information (destination information) is exemplified by directly typing and receiving input from the user on the screen as shown in FIG. 12(c), but the present invention is not limited thereto. As another example, destination information (destination information) selects any one of a plurality of selection menus (eg, route map selection menu, underground shopping center selection menu, convenience facility selection menu) provided on the screen of the user terminal 20 After selection, the input may be made by selecting any one of the detailed menus included in the selected corresponding selection menu.

When the route map selection menu is selected, the controller 13 may provide list information on all subway stations existing on the subway route map as a detailed menu therefor. When the user selects any one subway station from the list information on all subway stations, the selected subway station may be input as destination information.

In addition, when the selection of the underground shopping mall selection menu is made, the control unit 13 may provide list information on a plurality of shopping malls included in the corresponding internal space as a detailed menu thereto on the screen of the user terminal 20 . . When the user selects any one of the list information on the plurality of shopping malls, the location of the selected shopping mall may be input as destination information.

Similarly, when a selection for the convenience facility selection menu is made, the controller 13 controls a plurality of convenience facilities (eg, a subway station) included in the corresponding internal space (the internal space where the user is currently located) as a detailed menu for the menu. List information on my toilet, escalator, elevator, convenience store, information desk, transportation card charging station, storage box, etc.) may be provided on the screen of the user terminal 20 . When the user selects any one of the list information on the plurality of convenience facilities, the location of the selected convenience facility may be input as destination information.

Illustratively, when a toilet in a subway station is input as destination information among list information of a plurality of convenience facilities, the second route generating unit 12 is a destination selected by the user from a location corresponding to an internal road-related image. The route to the location of the toilet in the subway station, which is information, can be created as an internal route guidance route. The controller 13 may provide, on the screen of the user terminal 20 , the internal navigation information generated based on the internal navigation route based on AR.

As another example, as the user selects a transportation card charging station (this means a transportation card charging station existing in a subway station that is an internal space where the user is located) among list information for a plurality of convenience facilities, the selected transportation card charging station is the destination Let's say the information is entered. In this case, the second route generator 12 guides the route from the location corresponding to the internal road-related image (that is, the user's current location) to the location of the transportation card charging station in the subway station, which is the destination information selected by the user. path can be created. The controller 13 may provide, on the screen of the user terminal 20 , the internal navigation information generated based on the internal navigation route based on AR.

At this time, when a convenient facility is selected as the destination information, the control unit 13 places an icon corresponding to the convenient facility at a location corresponding to the selected convenient facility on the user terminal 20 as shown in FIG. 8 as an example. can be displayed

In addition, as described above, the second route generating unit 12 is a path (shortest route) from the location corresponding to the internal road-related image to the location of the closest exit from the location of the destination among the exits belonging to the internal movement section. ) may be generated as an internal guidance route, and internal guidance information based on the generated internal guidance route may be provided to the user terminal 20 .

In this case, the internal route guidance information may include an estimated walking time. In this case, the estimated walking time may be calculated by a calculator (not shown), a walking data DB (not shown), a feature DB (not shown) and an analysis unit (not shown) included in the device 10 . .

That is, although not shown in the drawings, the apparatus 10 may include a calculation unit (not shown), a walking data DB (not shown), a feature DB (not shown), and an analysis unit (not shown).

The calculator (not shown) calculates the walking travel time (prediction) for the internal guidance path (ie, the internal guidance path generated by the second path generator) corresponding to the internal guidance information provided by the controller 13 . walking time) can be calculated. In this case, the calculator (not shown) may calculate the walking travel time in consideration of the user's walking characteristic information obtained by analyzing the user's walking sensing data pre-stored in the walking data DB (not shown).

To this end, the analysis unit (not shown) may analyze the user's walking characteristic information using the walking sensing data stored in the walking data DB (not shown).

Here, the walking sensing data may refer to data (sensing values, measured values) sensed through the walking sensor provided in the user terminal 20 as the user walks. The walk sensor is a sensor that can sense (measure) data related to the user's walk (step), and may include, for example, a gyro sensor, an acceleration sensor, a GPS sensor, etc., but is not limited thereto, and a pedometer, etc. may be included.

In addition, in an example of the present application, the walk sensing data is exemplified as data sensed (measured, acquired) using a walk sensor provided in the user terminal 20, but is not limited thereto, and the number of steps (steps) of the user; Various walking analysis techniques that can measure or calculate stride length, walking speed (walking speed, gait), walking distance, etc. (ie, various walking analysis techniques known in the prior art or developed in the future) may be applied.

In addition, the walking characteristic information may refer to information obtained by analyzing walking sensing data previously stored in the walking data DB (not shown) in association with the feature information stored in the feature DB (not shown). That is, the analysis unit (not shown) may acquire walking characteristic information through analysis using the walking sensing data stored in the walking data DB (not shown). In particular, the analysis unit (not shown) may acquire the walking characteristic information of the user by performing analysis by linking the walking sensing data and the feature information stored in the feature DB (not shown) with each other.

The walking characteristic information is information about the user's walking characteristics in consideration of the topographical information, and may mean, for example, walking speed (walking speed), but is not limited thereto. The walking characteristic information may refer to speed information in which topographic information is taken into consideration, not simply speed according to distance.

The walking data DB (not shown) may obtain and store the walking sensing data sensed (measured) through the walk sensor provided in the user terminal 20 possessed by the user from the walk sensor when the user performs walking. have. In the walking data DB (not shown), walking sensing data may be accumulated and stored.

The feature DB (not shown) may store feature information. A landmark can refer to the appearance (shape) of the land and all objects on the ground.

The feature information may include slope information (slope) of the terrain for a specific section. The slope information includes information such as whether it is a flat land with a slope of 0, an uphill terrain with a positive slope value (+x°), a downhill terrain with a negative slope (-x°), and whether the interior length is recessed. may be included. In addition, the feature information may include information such as whether the specific section is an escalator section or an elevator area as feature information for a specific section.

At this time, the feature information stored in the feature DB (not shown) may be information obtained using various feature surveying techniques that are known in the prior art or developed in the future, and a detailed description thereof will be omitted.

The analysis unit (not shown) links the walking sensing data stored in the walking data DB (not shown) and the feature information stored in the feature DB (not shown) with each other, and information about the user's walking characteristics (that is, walking characteristics) information) can be analyzed. That is, the analysis unit (not shown) may acquire the walking characteristic information of the user in consideration of the geographical feature information through analysis by linking the walking sensing data and the feature information.

Illustratively, in the walking characteristic information of the user in consideration of the topographical information, as information analyzed by the analysis unit (not shown), the walking speed when the user walks in a section of 100m with an inclination of +60° is 1.66m/ s, when the user walks a section of 100m with an inclination of +20°, the stride speed is 1.79m/s Analysis information such as 1.55m/s may be included in the stride rate when the user walks the stairs of 100m section formed in °.

The analysis unit (not shown) can perform analysis based on the deep learning model (ie, learning using the deep learning model) by linking the walking sensing data and the topographical information with each other, for example, and through this, Accordingly, as the number of walking sensing data increases, more accurate feature information is obtained, the user's walking characteristic information is acquired (that is, accurate user's walking characteristic information optimized for each feature type, taking into account various types of feature information) can be obtained).

The deep learning model may refer to, for example, an artificial intelligence (AI) algorithm model, a machine learning (machine learning) model, a neural network model (an artificial neural network model), a neurofuzzy model, and the like. In addition, the deep learning model is exemplarily a convolutional neural network (CNN, convolutional neural network), a recurrent neural network (RNN), a deep neural network, etc. that have been previously known or developed in the future. Various neural network models can be applied.

The calculation unit (not shown) considers the user's walking characteristic information obtained through analysis by the analysis unit (not shown) (that is, the user's walking characteristic information in which the topographical information is considered), from the location of the departure point information to the destination. It is possible to calculate the walking travel time for the internal navigation route to the location of the information. The walking time calculated by the calculator (not shown) may be expressed differently as a predicted walking time, a required walking time, an estimated walking (required) time, and the like.

In order to calculate the walking travel time (predicted walking travel time) for the internal guidance path corresponding to the internal guidance information provided by the controller 13 , the calculator (not shown) is configured to calculate the internal navigation time from the feature DB (not shown). Identifies information on features on the route corresponding to the route guidance route, and calculates the estimated walking time by considering the user's walking characteristic information analyzed (acquired) by the analysis unit (not shown) and the identified feature information on the route can do.

Here, the feature information stored in the feature DB (not shown) may include information related to the first factor affecting the gait speed when the user moves on foot. In this case, the information related to the first element may be information related to at least one of the slope of the terrain (flat, uphill, downhill), stairs, escalators, and elevators.

In one example of the present application, as information related to the first factor affecting the user's pace, at least one of the slope of the terrain, stairs, elevator, and escalator has been exemplified, but it is not limited thereto, and the user's pace is not limited thereto. Various terrain-related factors that can influence can be considered.

Specifically, the user's walking speed (i.e., walking speed) may differ depending on whether the user's moving terrain is flat, uphill, downhill, stairs, escalator, elevator, etc. The pacing rate may differ from user to user.

In the case of the prior art, in providing the walking time for a specific route, a standardized walking time determined only according to the distance without considering individual walking characteristics was provided. Illustratively, in the case of the prior art, a uniform walking time for a specific route is provided in proportion to the distance, such as 1 minute for 100 m, 2 minutes for 200 m, and the like.

On the other hand, the calculation unit (not shown) applies the walking characteristic information of the user (user individual) analyzed by the analysis unit (not shown) to the feature information on the path corresponding to the internal road guide path, which is calculated by As the walking travel time for the internal guidance path, the user's personalized walking time customized to the user's walking characteristics may be calculated by reflecting the characteristics of the features of the corresponding internal guidance path.

For example, as a result of identification of the feature information on the path by the calculator (not shown), the internal path guidance path corresponding to the identified feature information on the path is a first section corresponding to 200m with an inclination of +20° , a second section corresponding to 100 m in which there is a descending staircase, and a third section corresponding to 100 m, which is flat ground.

In this case, the calculation unit (not shown) considers the walking characteristic information of the user analyzed by the analysis unit (not shown), and applies the information to each section (each of the first section to the third section) included in the corresponding internal route guidance route. It is possible to calculate the walking time for each section customized to the user, and by summing the calculated walking time for each section, finally the walking time for the internal guidance route (that is, the estimated walking time based on the user’s walking characteristics) required time) can be calculated.

The calculator (not shown) calculates the walking travel time in consideration of the information related to the first factor, as the absolute value of the slope has a larger value (that is, the steeper the uphill slope, the steeper the downhill slope), By predicting that the walking travel time takes longer, the walking travel time can be calculated as a larger value. In other words, the walking travel time calculated by the calculator (not shown) may be calculated as, for example, a larger value as the absolute value of the inclination in the information related to the first element included in the feature information on the route increases.

In addition, the calculator (not shown) may calculate the estimated walking time for the internal navigation route in consideration of the wearable information previously obtained from the user.

Here, the wearable article information may mean information about a wearable article that the user is scheduled to wear or possess when the user walks along an internal navigation route. In this case, the calculator (not shown) may calculate the estimated walking travel time in consideration of walking characteristic information, information on features on a route for an internal route guidance route, and information on wearable items.

The wearing article information may be, for example, information directly input by the user through the user terminal 20 . However, the present invention is not limited thereto, and the wearable article information is provided by interlocking the wearable article information providing unit (peripheral device) capable of providing information on the wearable article worn by the user and the present device 10 with each other, thereby providing wearable article information It may be information obtained from the unit. Here, the wearing article information providing unit may be, for example, an image acquisition sensor (ie, a camera) provided in the user terminal 20 , but is not limited thereto.

For example, the user may acquire a wearable article-related image by photographing a wearable item (including belongings) that the user owns or is wearing through an image acquisition sensor of the user terminal 20 .

The calculator (not shown) may identify the wearable article included in the image by performing image analysis on the wearable article-related image, and information on the identified wearable article by performing a search for the identified wearable article (that is, information on wearing items) can be obtained. In this case, the wearable information may refer to information including information related to the second element.

Here, the wearable information may include information related to a second factor that affects the walking speed when the user walks. The information related to the second element may be information related to at least one of whether the user has luggage, the type of luggage, the type of shoes worn by the user, and the type of clothing worn by the user.

The calculator (not shown) may automatically search the Internet for the same wearable article as the wearable article identified by image analysis through connection with the Internet, for example, and based on this, information on the wearable article possessed or worn by the user ( That is, information on wearing items) may be obtained.

For example, it is assumed that high heels are included as shoes worn by the user in the image captured by the image acquisition sensor. The calculator (not shown) may identify the high heel as a wearable article included in the image by performing image analysis on the acquired wearable article-related image. Thereafter, the calculator (not shown) may search for high heels matching the high heels in the identified image (ie, the same wearing item that matches) using the Internet. Based on such an Internet search result, the calculator (not shown) may acquire information about high heels included in the identified image (ie, information on wearing items). In this case, the information about the high heel may include, for example, information about the heel height and weight of the high heel.

In this case, various image analysis algorithms (various image analysis algorithms for identifying objects in an image) that are conventionally existing or developed in the future may be applied to the analysis of the image acquired from the image acquisition sensor.

When the wearable information is not obtained, the calculator (not shown) may calculate the walking travel time for the inner path guidance path in consideration of the walking characteristic information and the feature information on the path. On the other hand, when the wearable information is obtained, the calculator (not shown) may calculate the walking moving time for the internal route guidance route by further considering the wearing information as well as the walking characteristic information and the information on the features on the route.

In the present device 10, in order to provide a more customized accurate walking time to the user, it may be preferable to calculate the walking time by considering not only the walking characteristic information and the information on the features on the path, but also the wearables information.

Here, the wearable information may include information related to a second factor that affects the gait speed when the user walks. The information related to the second element may be information related to at least one of whether the user has luggage, the type of luggage, the type of shoes worn by the user, and the type of clothing worn by the user.

In this case, the type of the load may include the weight of the load, the size of the load, the shape of the load, and the like. Here, the shape of the luggage means, for example, if the luggage is a bag, whether it is a wheeled carrier of a towable type, a bag that the user can carry on his or her back, a bag to be carried over one shoulder, or a bag that has only a handle and must be carried by hand. can mean etc. In addition, the shape of the luggage may include whether it is a box box or the like.

The type of shoe worn by the user may include a type of shoe, a heel height of the shoe, and the like. Here, the type of shoe may include, but is not limited to, whether it is sneakers or high heels.

The user's attire type may include, but is not limited to, whether it is a skirt, pants, a shirt, a sweatshirt, or a suit.

In one example of the present application, as information related to the second factor affecting the user's walking speed, it is exemplified that at least one of whether the user has luggage, the type of luggage, the type of shoes worn by the user, and the type of clothing of the user is considered However, the present invention is not limited thereto, and various belongings or wearables that may affect the user's perseverance may be considered.

Illustratively, if the user intends to move with a relatively heavy load when performing walking, the user's stride rate may be slower than that of the user without the load (basic stride rate). In addition, when the user walks, when he wears high heels having a heel of 7 cm, the pace may be slower than when he wears sneakers. Also, when the user walks, when he wears high heels having a heel of 7 cm, the pace may be slower than when he wears high heels having a heel of 3 cm.

As such, the user's walking speed (ie, pace) may vary depending on the type of wearable information that the user has or is wearing (specifically, according to the type of information related to the second element), This gait difference may appear differently for each user. Accordingly, the calculator (not shown) may calculate the predicted walking time customized to the user in consideration of the type of information about belongings.

In the present application, the information on wearables is preferably understood as a concept that includes not only wearables such as hats, clothes, pants, shoes, and accessories worn on the user's body, but also information about belongings such as carriers, boxes, and shopping bags. do.

When calculating the walking travel time in consideration of the information related to the second factor, the calculator (not shown) predicts that the walking time will take longer as the weight and size of the load are larger. Time can be calculated to a larger value. In other words, the walking travel time calculated by the calculator (not shown) is, for example, a larger value as the weight value and size value of the load in the information related to the second element included in the wearables information have larger values. can be calculated.

In this way, the calculator (not shown) provides the walking travel time for a specific route (internal route guidance route) from the origin to the destination (destination), unlike conventional techniques that generally provide a standardized walking travel time. In contrast, when the user moves on foot, it is optimal for each user in consideration of various factors that may affect gait speed (that is, first factors related to a feature, second factors related to wearables) and information about the user's walking characteristics can calculate the customized walking travel time.

The controller 13 may display the predicted walking travel time and the internal route guidance information calculated by the calculator (not shown) on the screen of the user terminal 20 . In other words, the control unit 13 may control (provide) the internal route guidance information including the estimated walking time to be displayed on the screen of the user terminal 20 .

That is, the internal navigation information displayed on the screen includes an internal navigation route and a predicted walking time estimated by the device 10 for a time required when the user moves the corresponding internal route guidance route on foot. can In addition, the internal navigation information may include distance information on the internal navigation route.

The device 10 may calculate the required walking time (expected walking travel time) for the internal navigation route based on personalized step information (ie, walking characteristic information). This device 10 may provide the user with an optimized walking time (walking travel time).

The device 10 may accumulate step data (walking sensing data) of a user (a pedestrian) and store it in a walking data DB (not shown). Considering the user's walking characteristic information analyzed using the walking sensing data stored in the walking data DB (not shown), the device 10 is not a uniform required time, but the user's individual accumulated step data (accumulated walking sensing data) It is possible to calculate and provide an accurate estimated walking travel time (estimated walking time required) for each individual user based on .

In addition, the apparatus 10 may calculate the walking time by further considering the information on the features on the route. That is, the device 10 may determine the features on the internal road guide path generated by using the feature information stored in the feature DB (not shown), and calculate the walking travel time in consideration of the identified features.

That is, the device 10 uses the feature information stored in the feature DB (not shown) to determine the factors (first elements) that affect the user's gait existing on the inner road guide path, By applying the user's walking characteristic information previously analyzed by the analysis unit (not shown) to the identified elements, the influence of the geographical feature information on the path (ie, the influence of the first elements) is given to the user in consideration. Customized walking travel times can be calculated.

In addition, the device 10 may calculate the walking travel time by further considering the user's walking characteristic information and topographical feature information, as well as information on items worn or possessed by the user. Here, the wearable article information relates to articles worn or possessed by the user, and may include information about luggage, articles, clothes, shoes being worn, and the like. This device 10 may provide the user with an estimated walking travel time from the origin to the destination customized to the user. That is, the device 10 may provide the estimated actual walking time customized to the user's walking as the walking travel time for the internal navigation route.

The device 10 may provide the walking travel time (walking time required) from the starting point to the destination in the form of a user interface (UI, User Interface) of the application in consideration of the user's individual walking speed (walking speed, walking speed) .

In the prior art, a uniform walking travel time (walking time required) to a starting point and a destination is simply provided. On the other hand, in providing the walking time, the device 10 stores the user's step data (walking sensing data), and then, walking characteristic information analyzed using the stored walking sensing data, and the route requested by the user (from the origin to the destination). walking time by comprehensively considering (reflecting) the environment of the terrain and information on the user's wearables (for example, luggage, objects, clothes, shoes, etc.) that can be obtained through interlocking with peripheral devices can be calculated.

In other words, the device 10 further considers features on the path (uphill, downhill, intersection, overpass, underpass, etc.) Thus, the estimated walking time from the origin to the destination can be calculated. In addition, the device 10 provides not only personalized walking characteristic information, topographical information, but also information about the user's wearables that may affect gait (ie, the user's luggage, objects, or the user's attire, the shoes he is wearing). etc.), it is possible to more accurately calculate the estimated walking time from the origin to the destination. Here, the device 10 may obtain the user's wearables information, for example, by interworking with a peripheral device or by receiving an input from the user.

As such, the device 10 may provide an estimated walking time according to each user, rather than a uniform travel time. That is, the device 10 may calculate (predict) and provide an accurate personalized walking time suitable for each user's situation.

The walking travel time calculated and provided through the device 10 is called the recalculated walking time by correcting the conventionally provided walking time in consideration of individual walking characteristics, topographical information, and wearables information. can

According to the above description, the present device 10 may provide a complex underground wayfinding function based on AR technology. The present device 10 may provide a guide map so that the user can easily receive a guide on an indoor road that normally requires a guide map. In addition, the device 10 can be used by anyone, regardless of age, and can be used regardless of a residential area. In addition, it can be said that the present device 10 has a high potential for future development due to the development of new technologies (AR, etc.).

The device 10 may provide a navigation function for finding a road on the ground as well as underground. The device 10 can display the number of floors of an underpass, a map, and even the location of a store (shop) in detail.

In addition, in the conventional subway station, while the notation is simple and vague, such as the direction a, the line b, etc., the present device 10, for example, determines the next station in the moving direction of the user terminal 20 of the user terminal 20. It can be provided on the screen.

In addition, the device 10 can guide the way to the inner space based on the AR service, for example, it can guide the detailed route from the exit of each station to the subway boarding point based on AR. The device 10 may obtain the ruby of each station through the recognition of the QR code of each station, and may provide the acquired ruby to be used in a store associated with the device 10 .

In addition, the device 10 provides the user with an intuitively easy-to-understand form based on AR-based road guidance to a destination (for example, a destination corresponding to a specific subway station selected on a subway line) or a road guidance to convenience facilities in the internal space. It may be provided to the terminal 20 .

In addition, in providing AR-based route guidance, the device 10 provides a customized walking travel time to the user as a predicted walking travel time for an internal route guidance route, so that more accurate route guidance is provided to the user can do.

The device 10 may provide route guidance information about the inside of a subway station, for example, as an internal movement section. The device 10 may use augmented reality to provide information such as an exit inside a subway station, a store, a guide for each floor, and the like.

The device 10 can provide routes (movement routes) to various convenience facilities in the subway station, such as toilets, shops, transportation card charging stations, situation rooms, and storage boxes, in various forms according to each destination based on AR.

When an external building (eg, a large shopping mall, a hospital, etc.) connected to a specific subway station exists for a specific internal movement section, the device 10 relates to internal route guidance information for a specific internal movement section, Comprehensive information on external buildings connected to subway stations, such as ticket gates, exits, and floor-by-floor guidance to external buildings can be provided as internal route guidance information based on augmented reality.

Also, when it is determined that the user gets off at a specific subway station, the device 10 may provide a list of destinations including convenience facilities or external buildings associated with the subway station to which the user got off on the user terminal 20 . At this time, when a user input (selection input) is made for a destination for any one of the provided destination lists, the control unit 13 of the device 10 includes a route (internal route guidance route) to the destination selected by the user. may be provided to the user terminal 20 with internal route guidance information. Here, the destination list may mean list information related to any one of the above-described plurality of selection menus (eg, route map selection menu, underground shopping mall selection menu, convenience facility selection menu), but is limited thereto. it is not

In addition, the device 10 provides internal route guidance information in various forms based on augmented reality according to personalization and destination by using personalized data for each user stored in the user terminal 20 or secured through an application. can do.

In addition, the device 10 may provide rewards (ruby, coin, etc.) that can be used in/out of the application according to the user's participation degree (participation level), and based on this, the device 10 and related application User can be encouraged to use it.

The device 10 may provide routes of various convenience facilities in the subway station in the form of augmented reality according to each destination. In addition, when the location of the destination is a location corresponding to an external building existing on the ground, the device 10 includes information related to the ticket gate (or exit) to the external building in the internal movement section and information on the floor plan of the external building. Comprehensive information on an external building associated with a subway station, including the like, may be provided based on augmented reality.

In addition, the present device 10 provides augmented reality in various forms according to destinations using personalized data stored in the user terminal 20 or secured through an application, so that more effective route guidance can be achieved.

Hereinafter, an operation flow of the present application will be briefly reviewed based on the details described above.

13 is a flowchart illustrating an augmented reality-based way guidance method according to an embodiment of the present application.

The augmented reality-based road guidance method shown in FIG. 13 may be performed by the augmented reality-based road guidance device (the present device, 10) described above. Therefore, even if omitted below, the description of the augmented reality-based way guidance device (the present device, 10) may be equally applied to the description of the augmented reality-based way guidance method.

Referring to FIG. 13 , in step S11 , the first route generator may generate a route from the origin to the destination based on information about the origin and destination received from the user.

Next, in step S12, when a request signal for requesting inner navigation for the inner movement section included in the route generated in step S11 is received, the second route generating unit responds to the request signal to provide a corresponding to the inner movement section. You can create internal navigation routes.

In this case, the internal movement section may mean a section corresponding to the internal space of a structure provided underground and/or on the ground.

In addition, in step S12 , the second path generator may generate an internal route guidance path in consideration of the structure (internal structure) of the internal space for each floor of the structure and convenience facilities existing in the internal space of the structure.

In addition, in step S12 , when the internal road related image related to the internal road belonging to the internal movement section is obtained from the user terminal, the second route generating unit may recognize the acquired internal road related image as a request signal.

In addition, in step S12, when the internal road-related image is obtained, the second route generating unit is configured to: A route (shortest route) can be created as an internal navigation route.

Next, in step S13, the control unit generates internal navigation information for guiding the movement of the user on the internal navigation route based on the internal navigation route generated in step S12, and provides it to the user terminal possessed by the user. can do.

In addition, in step S13 , the controller may generate the internal route guidance information as at least one information type of screen display information, sound information, and vibration information and provide it to the user terminal.

In addition, in step S13, if a plurality of direction indication information is included in the obtained internal road related image, the icon of the corresponding direction indication information corresponding to the internal road guide path among the plurality of direction indication information is displayed on the inner road guide path. The screen display information provided to the user terminal may be controlled to be displayed in a form that is easier to recognize or identify than an icon of non-responsive direction indication information that does not correspond to .

In addition, in step S13, the control unit, in consideration of the user location information obtained from the location acquisition sensor in the user terminal, the content of the screen display information, the sound information in response to the remaining distance to the direction change point to which the user needs to change the moving direction You can change the vibration type of the content and vibration information.

In the above description, steps S11 to S13 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present application. In addition, some steps may be omitted as necessary, and the order between steps may be changed.

The augmented reality-based way guidance method according to an embodiment of the present application may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

In addition, the augmented reality-based way guidance method described above may be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

The foregoing description of the present application is for illustration, and those of ordinary skill in the art to which the present application pertains will understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and likewise components described as distributed may be implemented in a combined form.

The scope of the present application is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present application.

10: Augmented reality-based navigation device
11: first path generator
12: second path generator
13: control

Claims (13)

As an augmented reality (Augmented Reality) based road guide device,
a first route generator configured to generate a route from the source to the destination based on the information about the source and destination received from the user;
When a request signal for requesting internal navigation for an internal movement section included in the generated route is received, a second route generator for generating an internal navigation route corresponding to the internal movement section in response to the request signal ;
a control unit for generating internal navigation information for guiding a user's movement on the internal route guidance route based on the generated internal route guidance route and providing the generated internal route guidance information to the user terminal; and
A plurality of images of the internal space of the structure provided in the basement and / or above the ground includes a database unit stored in association with the location information and direction information of the user terminal when each of the plurality of images is photographed,
The control unit provides the internal route guidance information based on augmented reality for the internal road belonging to the internal movement section,
The second path generator identifies a matching image by matching the image acquired through the user terminal with a plurality of images previously stored in the database unit, and considers the location information and the direction information for the matching image. to determine the current location of the terminal,
The second path generator identifies whether the acquired image is an image related to an internal path related to the internal movement section based on the matching image,
If the acquired image is identified as the interior road related image,
The database unit additionally stores the acquired image, and the control unit provides a reward according to the provision of an image related to an internal road for the internal movement section to the user terminal. According to claim 1,
The inner movement section,
An augmented reality-based road guidance device that is a section corresponding to the internal space of a structure provided underground and/or on the ground. 3. The method of claim 2,
The second path generating unit,
The augmented reality-based road guidance device that generates the internal navigation route in consideration of the structure of the internal space for each floor of the structure and convenience facilities existing in the internal space of the structure. 3. The method of claim 2,
The second path generating unit,
When the internal road-related image related to the internal road belonging to the internal movement section is acquired from the user terminal, the acquired internal road-related image is recognized as the request signal. 5. The method of claim 4,
The second path generating unit,
When the internal road-related image is obtained, a route from a location corresponding to the internal road-related image to the location of the nearest exit from the location of the destination among exits belonging to the internal movement section is defined as the internal road guidance path An augmented reality-based way guidance device that is generated by 5. The method of claim 4,
The control unit is
The augmented reality-based road guidance device that generates and provides the internal route guidance information as at least one information type of screen display information, sound information, and vibration information. 7. The method of claim 6,
The control unit is
When a plurality of direction indication information is included in the obtained internal road-related image, an icon of the corresponding direction indication information corresponding to the internal road guide path among the plurality of direction indication information does not correspond to the internal road guide path. The augmented reality-based road guidance device that controls the screen display information to be displayed in a form that is easier to recognize or identify than an icon of non-responsive direction indication information. 7. The method of claim 6,
The control unit is
In consideration of the user location information obtained from the location acquisition sensor in the user terminal, the content of the screen display information, the content of the sound information, and the vibration information corresponding to the remaining distance to the direction change point to which the user needs to change the moving direction An augmented reality-based navigation device that changes the vibration type of As an augmented reality (Augmented Reality) based road guidance method,
(a) generating, in the first route generating unit, a route from the source to the destination based on the information about the source and destination received from the user;
(b) when the second route generator receives a request signal for requesting an inner route guidance for an inner movement section included in the generated route, an inner road corresponding to the inner movement section in response to the request signal generating a guide route; and
(c) generating, in the control unit, internal navigation information for guiding a user's movement on the internal route guidance route based on the generated internal route guidance route and providing it to a user terminal,
In the step (c), the control unit provides the internal route guidance information based on augmented reality for the internal road belonging to the internal movement section,
Step (b) is,
A database unit stored in association with the location information and direction information of the user terminal when a plurality of images of the internal space of a structure provided in the basement and/or the ground of the image acquired through the user terminal are photographed, respectively, of the plurality of images identifying a matching image by matching with a plurality of images previously stored in the ;
determining the current location of the user terminal in consideration of the location information and the direction information for the matching image; and
identifying whether the acquired image is an image related to an internal road related to the internal movement section based on the matching image;
including,
If the acquired image is identified as the interior road related image,
The database unit additionally stores the acquired image, and the control unit provides a reward according to the provision of an image related to an internal road for the internal movement section to the user terminal. 10. The method of claim 9,
The inner movement section,
An augmented reality-based road guidance method that is a section corresponding to the internal space of a structure provided underground and/or on the ground. 11. The method of claim 10,
Step (b) is,
The augmented reality-based way guidance method, which generates the inner way guide route in consideration of the structure of the inner space for each floor of the structure and the convenience facilities existing in the inner space of the structure. 11. The method of claim 10,
Step (b) is,
When the internal road-related image related to the internal road belonging to the internal movement section is acquired from the user terminal, the acquired internal road-related image is recognized as the request signal. 13. A computer-readable recording medium recording a program for executing the method of any one of claims 9 to 12 in a computer.

Images