JP5473025B2 - Navigation system, navigation method, and navigation program - Google Patents

Description

  The present invention relates to a navigation system, a navigation method, and a navigation program for realizing in detail road guidance to a destination using augmented reality technology.

  In recent years, portable information terminals such as smartphones and tablet terminals are equipped with various sensors and devices such as GPS (Global Positioning System), acceleration sensors, Bluetooth (registered trademark), and WLan. By using these sensors and devices, it is possible to operate a high-functional application such as a navigation function.

  Among conventional navigation (road guidance) services, there are those that provide road guidance to a destination. Since these navigation services mainly provide planar map information, they are not suitable for navigation to destinations that are located three-dimensionally on complicated routes such as multipurpose commercial facilities and large-scale stations. Seem. FIG. 13A is a diagram showing a navigation display and a user usage state when a conventional navigation service is used. In this example, even if the navigation service is used, it cannot be determined whether the destination cafe is on the upper floor or the lower floor on the same floor plan, so the destination cannot be reached quickly. .

  When considering route guidance in a complex route such as a station premises or a building having multiple layers, it is considered that the following capability by navigation using a conventional GPS or electronic compass is not so high. In addition, although a method for reflecting personal preferences using digital signage has been devised, since there is only one display device, there seems to be a limit to simultaneous use by multiple people.

  As an example of a navigation system, a navigation service that provides navigation information based on optical data is known (see, for example, Patent Document 1). In Patent Document 1, for the purpose of providing a navigation method in which navigation information to a destination is provided without inputting the current location based on optical data, the navigation method of Patent Document 1 A first step of reading optical data displayed on a medium using a portable information device, and decoding the optical data using a portable information device to character data including at least information on a code acquisition position and a destination position A second stage of conversion, a third stage of transferring character data to the navigation server using a portable information device via a communication network, and a navigation path from the code acquisition position to the destination position by the navigation server. And transmitting to the portable information device via the communication network.

JP 2002-48586 A

  A conventional navigation service that provides only map information on a flat surface has a problem that it is difficult to provide accurate information to a user in a high-rise building or a city center.

  Further, in Patent Document 1, since it is not a navigation service using augmented reality technology, it has not been possible to obtain satisfaction with fine route guidance or visual route guidance using an existing advertising board.

  In the station premises, etc., information boards are installed at key points, which are originally considered so that you can reach the premises facility destination in order. However, these information boards exist for the purpose of public use on the premises and are not necessarily specialized for a specific company or store.

  Therefore, the present invention provides a navigation technology that displays route information using an application that allows the user to switch to the desired tenant's navigation application when the smart device camera is held over only the user. .

  A feature of the present invention lies in that the use of a smart device's augmented reality (AR) technology can rewrite a guide board stretched around the premises as a navigation application for a desired tenant.

  In view of the above-described problems, one aspect of the present invention is a portable information that obtains an image of a real space and displays it on a display unit in a navigation system that superimposes and displays a plurality of information using augmented reality technology. Optical data and destination information photographed by the photographing means of the terminal are transmitted as a guidance request to the service providing server via the communication network. Based on the guidance request from the portable information terminal, the service providing server The route information to the destination stored in advance in the storage means is acquired in association with the guide sign, and the service providing server transmits the acquired route information to the portable information terminal that is the transmission source of the guidance request, and is received by the portable information terminal. The present invention relates to a navigation system that superimposes the route information data superimposed on the image of the real space photographed by the photographing means on the display means.

  Another aspect of the present invention is an optical image captured by a portable information terminal that acquires and displays an image of real space in a navigation method in which a plurality of information is superimposed and route guidance is performed using augmented reality technology. Target data and destination information are transmitted as guidance requests to the service providing server via the communication network, and based on the guidance request from the portable information terminal, the service providing server is stored in advance in association with the guidance sign in the real space. The route information to the destination is acquired, the service providing server transmits the acquired route information to the portable information terminal that is the transmission source of the guidance request, and the received information of the route information is photographed by the photographing means in the portable information terminal. The present invention relates to a navigation method for superimposing and displaying on a real space image.

  Furthermore, another aspect of the present invention is an optical image taken by a portable information terminal that acquires and displays a real-space image in a navigation program that performs route guidance by superimposing a plurality of information using augmented reality technology. Based on the process of transmitting the target data and the destination information as a guidance request to the service providing server via the communication network and the guidance request from the portable information terminal, the service providing server associates with the guidance sign in the real space in advance. Processing for acquiring route information to the stored destination, and the service providing server transmits the acquired route information to the portable information terminal of the guidance request transmission source, and the portable information terminal captures the received route information data. The present invention relates to a navigation program that causes a computer to realize a process of superimposing and displaying on a real space image captured by the computer.

  According to the present invention, since each guide board stretched around the campus appropriately guides the user, the user can arrive at the desired tenant without hesitation even in a large-scale campus.

  Further advantages and embodiments of the present invention are described in detail below using the description and the drawings.

It is a figure for showing the system configuration of the navigation system by a 1st embodiment of the present invention. 1 is a block diagram for illustrating a schematic configuration of a navigation system according to a first embodiment of the present invention. 3 is a flowchart for explaining route information registration processing in response to a request in the navigation system shown in FIG. 1. It is a figure for showing the example of the guidance information list stored in the memory | storage part of a server in the navigation system shown in FIG. It is a flowchart for demonstrating the utilization process of the route information to a desired store in the navigation system shown in FIG. It is a figure for demonstrating the store / establishment selection menu of the guidance application displayed on the display screen of the portable information terminal shown in FIG. It is a figure for demonstrating the barcode acquisition screen of the guidance application displayed on the display screen of the portable information terminal shown in FIG. It is a figure for demonstrating the barcode which exists in the campus information board used with the navigation system by the 1st Embodiment of this invention. It is a figure for showing the example of the virtual guide board displayed by AR technology in the navigation system by a 1st embodiment of the present invention. It is a flowchart for demonstrating the process which transmits the user's step information in the navigation system by the 2nd Embodiment of this invention to an other party. It is a figure for demonstrating the transmission processing image of the present location information of a guidance application in the navigation system by the 2nd Embodiment of this invention. It is a figure for demonstrating the example of the notification mail which a service provider transmits to a utilization company in the 2nd Embodiment of this invention. (A) is a conventional navigation service, (b) is a figure for demonstrating the navigation service by each embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and drawings, the same components are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

(First embodiment)
First, a first embodiment of the present invention will be described with reference to the drawings.

  1 and 2 are diagrams for explaining the system configuration of the navigation system according to the first embodiment of the present invention. The navigation system according to the present embodiment uses the augmented reality technology of a portable information terminal to superimpose route information data on a general information board and visually displays virtual reality to the user, and from the current location to the desired tenant It is used for navigation applications that provide route information.

  The navigation system shown in FIGS. 1 and 2 includes a portable information terminal 100 and a management device (service providing server) 200. The portable information terminal 100 is a terminal having a network communication function, a camera photographing function, and an application execution function, and is, for example, a mobile phone, a PDA, a game machine, a personal computer, a portable navigation device, or the like. The camera photographing function described above may be configured such that the portable information terminal 100 incorporates photographing means such as a camera, or may be configured to be externally attached even if the camera is not incorporated. The same applies to the network communication function and the application execution function.

  The portable information terminal 100 includes a communication unit 101 that communicates with other devices and devices, a photographing unit 102 for photographing a subject such as a signboard or an advertising board, a storage unit 103 that stores various types of information, Various function realizing means such as a control means 104 for controlling means and information, a display means 105 for displaying moving images and images photographed by the photographing means 102, and an input / output means 106 for inputting and outputting user selection information are provided. Yes.

  When the portable information terminal 100 receives input information from the user by operating the photographing unit 102 and the input / output unit 106 by executing a predetermined application (application) preinstalled in the storage unit 103 by the control unit 104. Then, a route information request based on the received information is transmitted to the management apparatus 200 via the communication unit 101. When the route information or the like is received from the management device 200, a function of displaying on the display means 105 a guidance image based on augmented reality technology in which the route information is superimposed on the actual video is realized.

  The management apparatus 200 authenticates a communication company 201 and a user, a communication unit 201 that communicates with devices and devices such as a portable information terminal 100 and an input device of a user company, a storage unit 202 that stores guidance information from the user company, and a user company and a user. Authentication means 203, a control means 204 for controlling these means and various information, and various function realizing means such as an operation means 205. Although not shown, the management device 200 includes a CPU that controls processing and operations, a storage unit such as a ROM and a RAM that stores various types of information, an input / output interface, a communication interface, a camera, a GPS receiver, and a bus connecting them. A computer equipped can be applied. The management apparatus 200 may be configured by a CPU executing a predetermined program stored in a ROM or the like.

  The registration of the route information with respect to the management device 200 is registered for each guide board by an input device (not shown) of a user company, for example. Augmented reality (AR) technology used in the navigation system according to the present embodiment is optical when an image of a subject such as a guide board photographed by the photographing unit 102 built in the portable information terminal 100 is displayed on the display unit 105. In response to a guidance request such as target data or destination information, control is performed so that additional information is synthesized and displayed on the actual video. For example, the additional information is route information or store guidance information for each guide plate.

  In the navigation system according to the embodiment of the present invention, a service provider receives a registration request for navigation information and route information from the user company such as a tenant / store via the network environment. Furthermore, the service provider of this embodiment receives a navigation request such as bar code transmission of a guide board via a network environment by an application (application) executed by the user on the portable information terminal 100. The service provider responds to the navigation request via the network environment and provides a virtual guide board corresponding to the user (user) guidance request.

  A user possesses a portable information terminal 100 such as a smartphone. The portable information terminal 100 has at least a network communication function, a camera shooting function, and an application execution function. Optical data such as a dedicated bar code is attached to information boards in large commercial facilities and stations. At this time, the guide plate is kept in a minimum area so as not to impair the original public purpose.

  According to route guidance using AR technology, for example, it is possible to reduce the human resources spent in explaining the route to the target store at department stores and information stations in the station, and to deal with work in times of congestion and other work. It becomes.

  Next, the operation of the navigation system according to the embodiment of the present invention will be described in detail. FIG. 3 is a diagram for explaining a process of registering route information in the navigation system according to the present embodiment. Referring to FIG. 3, the user of this navigation service first submits the route information of his / her own store / business to be posted on the virtual guide board to the service provider (S10). As route information, a list of route guidance information corresponding to the route from the guide board to the company store is provided. As shown in FIG. 4, the route information is configured in a format corresponding to each local guide plate. The service provider registers the route information sent from the user company in the storage unit of the management device 200 for each store, for example (S20). In this example, three route information of the store A, the store B, and the business office C are managed in separate databases.

  FIG. 5 is a diagram for explaining processing for acquiring a virtual guide board in the navigation system according to the present embodiment. The user of this service activates the application of the smartphone, captures a barcode existing on the campus information board illustrated in FIG. 8 with a camera, and transmits it to the service provider using communication means. At that time, a store selection menu screen is displayed on the display screen of the smartphone (FIG. 6), and the operation of the application performed by the user is to select a destination store / business establishment. In addition, a camera shooting screen is displayed on the display screen of the smartphone (FIG. 7), and the user performs an operation of storing the barcode in the camera. If the said operation is performed, these information will be transmitted to a service provider as shop ID or guide board ID. In this manner, the route guidance information of the desired store / business office is requested using the smartphone application (S30).

  Based on the information received from the user, the service provider calculates the guide information to be displayed on the virtual guide board from the management database (DB) and transmits it to the guide application on the user's smartphone (S40). For example, when “X company: A store” is selected in the store selection menu image shown in FIG. 6, the guide information is acquired from the database of the store A shown in FIG. 4. The smartphone that has received this guidance information displays a virtual guidance board (FIG. 9) in which the guidance application is overwritten and displayed by superimposing the guidance information using augmented reality technology written on the actual video displayed on the guidance board (S50). ).

  The first embodiment of the present invention described above has the following effects.

  The first effect is that detailed route information can be visually provided for each user even in a complex premises. The reason is that a configuration is adopted in which route information is provided in accordance with each user's guidance request and displayed using augmented reality technology.

  The second effect is that navigation with a high system becomes possible as compared with a method using GPS or an electronic compass. The reason is that it is possible to divert and use the guide boards that are stretched around the premises such as stations.

  The third effect is that it is expected to avoid loss of customers for stores / businesses users and to improve the satisfaction level through application experience. This is because highly accurate route information is realized using augmented reality technology with a sense of reality.

(Second Embodiment)
Subsequently, a second embodiment of the present invention will be described. The second embodiment of the present invention is a modification of the above-described first embodiment. Hereinafter, in the present embodiment, parts having the same functions as those already described in the first embodiment are denoted by the same reference numerals, and description thereof is omitted.

  FIG. 10 is a diagram for explaining a process of transmitting user gait information to a user company in the navigation system according to the second embodiment of the present invention.

  Referring to FIG. 10, the user requests route guidance information of a desired store / office using a smartphone application (S30). In response to the received request, the service provider acquires target information from the route guidance information DB and transmits it to the user (S40). The user displays the received guidance information on the smartphone application (S50). In the present embodiment, using the information sent from the user, the service provider transmits the user's gait information to the user company (S60). Specifically, when the user activates the notification option on the current location transmission option screen shown in FIG. 11 displayed on the display unit of the smartphone by activating the application, the service provider uses, for example, email transmission shown in FIG. Send the user's local information and other information to the user company. Thus, in this embodiment, when a user requests a virtual guide board, it is possible to notify the user company of the gait information of the user.

  FIG. 13B is a diagram for explaining the navigation display and the usage state of the user when the navigation system according to the present invention is used. In this navigation system, the user can smoothly reach the destination cafe.

  The second embodiment of the present invention described above has the following effects.

  The first effect is that the user company can grasp the visitor situation in advance. The reason is that the service provider employs a system that transmits the user's gait information to the user company.

  The second effect is that it is no longer necessary to notify the other party of the visit situation such as earlier or later than scheduled. The reason is that a user company can obtain user's gait information from other than visitors.

  As mentioned above, although embodiment of this invention was described in detail, referring an accompanying drawing, this invention is not limited to this example. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  In the present specification, the steps described in the flowcharts are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes performed in time series in the order described. Including processing to be performed. Further, it goes without saying that the order can be appropriately changed even in the steps processed in time series.

100 portable information terminal 101 communication means 102 photographing means 103 storage means 104 control means 105 display means 106 input / output means 200 management device 201 communication means 202 storage means 203 authentication means 204 control means 205 operation means

Claims (7)

In a navigation system that performs route guidance by superimposing multiple information using augmented reality technology,
Guide the optical data and destination information added to the existing information sign taken by the photographing means of the portable information terminal that acquires the image of the existing information sign existing in the real space and displays it on the display means. The request is sent to the service providing server via the communication network,
Based on the guidance request from the portable information terminal, the service providing server correlates with the existing guidance sign existing in the real space , and the route information to the company using the navigation system that is the visit destination stored in the storage means in advance. Get
The service providing server transmits the acquired route information to the portable information terminal that is the transmission source of the guidance request,
In the portable information terminal, the received route information data is superimposed on the image of the existing guide sign existing in the real space photographed by the photographing means and displayed on the display means,
When receiving the guidance request from the portable information terminal, the service providing server notifies the navigation company using the navigation system that is the visited destination of the received portable information terminal to the user using the navigation system. A featured navigation system. The optical data corresponds to all companies using the navigation system in the same building, and the application can be executed to select a company using the navigation system as a desired destination from a plurality of destinations. The navigation system according to 1. In a navigation method for performing route guidance by superimposing a plurality of information using augmented reality technology,
The optical data and destination information added to the existing information sign photographed by the portable information terminal that acquires and displays the image of the existing information sign existing in the real space as a guidance request through the communication network. To the service provider server,
Based on the guidance request from the portable information terminal, the service providing server obtains the route information to the user of the navigation system that is the visited destination stored in advance in association with the existing guidance sign existing in the real space. ,
The service providing server transmits the acquired route information to the portable information terminal that is the transmission source of the guidance request,
In the portable information terminal, the received route information data is displayed superimposed on the image of the existing guide sign existing in the real space photographed by the photographing means,
When receiving the guidance request from the portable information terminal, the service providing server notifies the navigation company using the navigation system that is the visited destination of the received portable information terminal to the user using the navigation system. A featured navigation method. The optical data corresponds to all companies using the navigation system in the same building, and the application can be executed to select a company using the navigation system as a desired destination from a plurality of destinations. 4. The navigation method according to 3. In a navigation program that performs route guidance by superimposing multiple information using augmented reality technology,
The optical data and destination information added to the existing information sign photographed by the portable information terminal that acquires and displays the image of the existing information sign existing in the real space as a guidance request through the communication network. Processing to send to the service providing server,
Based on the guidance request from the portable information terminal, the service providing server obtains the route information to the company that uses the navigation system that is the visit destination stored in advance in association with the existing guidance sign existing in the real space. Processing,
The service providing server transmits the acquired route information to the portable information terminal that is the transmission source of the guidance request,
In the portable information terminal, a process of superimposing and displaying the received route information data on the image of the existing guide sign existing in the real space photographed by the photographing means;
When receiving the guidance request from the portable information terminal, the service providing server notifies the user of the navigation system of the gait information to the user of the navigation system that is the visited destination of the portable information terminal. A navigation program characterized in that a computer is realized. The optical data corresponds to all companies using the navigation system in the same building, and the application can be executed to select a company using the navigation system as a desired destination from a plurality of destinations. 5. The navigation program according to 5.   A computer-readable storage medium in which the program according to claim 5 or 6 is recorded.

Images