JP7294735B2 - Navigation device, navigation system, navigation method, program, and recording medium - Google Patents

Description

The present invention relates to a navigation device, a navigation system, a navigation method, a program, and a recording medium.

In recent years, technology has been proposed for advertising products and the like using AR (Augmented Reality) technology (for example, Patent Literature 1).

JP 2018-147137 A

Recently, exhibitions are held and products and the like are often advertised at the exhibition halls. For this reason, it is conceivable to advertise products and transmit information using AR at exhibition halls. On the other hand, since the exhibition hall is large and there are many exhibition booths, it is necessary for visitors to search for the desired exhibition booth while confirming their current position. However, in the current situation, it is necessary to check the current position by using a map (venue guide map, etc.) installed at the venue. It was inconvenient. This problem is not limited to exhibition halls, but also occurs in large-scale facilities such as event halls, department stores, schools such as universities, large hospitals, and shopping malls.

Accordingly, it is an object of the present invention to provide a navigation device and a navigation method that can transmit information using AR and can easily check the current position in a large-scale facility such as an exhibition hall. and

In order to achieve the above object, the navigation device of the present invention comprises:
including an imaging information acquisition unit, a virtual information generation unit, an image information output unit, and a map information management unit,
The imaging information acquisition unit acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating unit generates a virtual image regarding the specific area,
The image information output unit outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management unit associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaged image of the position code is acquired by the imaging information acquisition unit,
The map information management unit is a device that identifies the position of the terminal of the visitor from the image of the position code based on the map information.

The navigation method of the present invention comprises:
including an imaging information acquisition process, a virtual information generation process, an image information output process, and a map information management process,
The imaging information acquisition step acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating step generates a virtual image related to the specific area,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management step associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaging information acquisition step acquires an image of the imaged position code,
The map information management step is a method of specifying the position of the terminal of the visitor from the image of the position code based on the map information.

According to the present invention, it is possible to transmit information by AR and to easily check the current position of a visitor in a large-scale facility or the like. It should be noted that although the current position can be confirmed by using a GPS (Global Positioning System), for example, GPS uses radio waves, so there is a problem in confirming the position indoors. On the other hand, since the present invention uses the position code, it is possible to confirm the position without any problem even indoors. However, the present invention may be applied to outdoor position confirmation.

FIG. 1A is a block diagram showing an example configuration of an apparatus according to the first embodiment, and FIG. 1B is a schematic diagram showing an example configuration of a system according to a fourth embodiment. FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus according to the first embodiment; FIG. 3 is a flow chart showing an example of processing in the device according to the first embodiment. FIG. 4 is a schematic diagram showing an example of the relationship between the map of the exhibition hall and the position code. FIG. 5 is a schematic diagram showing an example in which a terminal captures an image of a position code. FIG. 6 is a schematic diagram showing an example of displaying the position of the terminal on the display of the visitor's terminal. FIG. 7 is a schematic diagram showing an example of a composite image obtained by superimposing a virtual image of a specific area on a captured image. FIG. 8 is a schematic diagram showing an example of a composite image obtained by superimposing a virtual image regarding a specific area on a captured image. FIG. 9 is a schematic diagram showing an example of the relationship between the map of the exhibition hall and the direction of the position code. FIG. 10 is a schematic diagram showing an example of the relationship between the direction of the map of the exhibition hall and the direction of the terminal. FIG. 11 is a schematic diagram showing an example of the relationship between the inclination of the terminal and the image displayed on the display of the terminal.

In the present invention, a "visitor" means a person who comes to a specific area, and is also called a user. Visitors can also be referred to as museum visitors, school visitors, and the like.

An embodiment of the present invention will be described with reference to the drawings. The invention is not limited to the following embodiments. In each figure below, the same reference numerals are given to the same parts. In addition, the description of each embodiment can be used with reference to each other's description unless otherwise specified, and the configurations of the respective embodiments can be combined unless otherwise specified.

[Embodiment 1]
FIG. 1A is a block diagram showing an example configuration of the navigation device 10 of this embodiment, and FIG. 1B is a schematic showing an example configuration of a navigation system including the navigation device 10 of this embodiment. It is a diagram. As shown in FIG. 1A, the apparatus 10 includes an imaging information acquisition unit 11, a virtual information generation unit 12, an image information output unit 13, a map information management unit 14, a specific area information acquisition unit 15, and a visitor information acquisition unit. including part 16; The specific area information acquisition unit 15 and the visitor information acquisition unit 16 are arbitrary configurations and do not have to be included in the device 10 . A navigation system device will be described in a fourth embodiment.

The device 10 may be, for example, a single device including each of the above units, or may be a device in which each of the above units can be connected via a communication network 30 . Further, the device 10 can be connected to an external device, which will be described later, via the communication network 30 . The communication network 30 is not particularly limited, and a known network can be used. For example, it may be wired or wireless. The communication line network 30 includes, for example, the Internet line, WWW (World Wide Web), telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Tolerant Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark), and the like. The wireless communication may be either a form in which each device communicates directly (Ad Hoc communication) or an indirect communication via an access point. The device 10 may be incorporated in a server as a system, for example. In addition, the present device 10 is, for example, a personal computer (PC, for example, desktop type, notebook type) in which the program of the present invention is installed, a terminal (for example, a smart phone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type, etc. ) and the like.

FIG. 2 illustrates a block diagram of the hardware configuration of the device 10. As shown in FIG. The device 10 has, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each unit of the device 10 is interconnected via a bus 103 by each interface (I/F).

A central processing unit (also referred to as a central processing unit or central processing unit) 101 is responsible for overall control of the apparatus 10 . In the apparatus 10, the central processing unit 101 executes, for example, the program of the present invention and other programs, and reads and writes various information. Specifically, for example, the central processing unit 101 includes an imaging information acquisition unit 11, a virtual information generation unit 12, an image information output unit 13, a map information management unit 14, a specific area information acquisition unit 15, and a visitor information acquisition unit. 16.

Bus 103 can also be connected to external devices, for example. Examples of the external device include an external storage device (external database, etc.), a printer, and the like. For example, the device 10 can be connected to an external network (communication line network) via a communication device 107 connected to the bus 103, and can also be connected to other devices via the external network.

The memory 102 is, for example, a main memory (main storage device). When the central processing unit 101 performs processing, for example, the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104, which will be described later. It receives data from 102 and executes a program. The main memory is, for example, RAM (random access memory). Also, the memory 102 may be, for example, a ROM (read only memory).

The storage device 104 is also called a so-called auxiliary storage device, for example, in contrast to the main memory (main storage device). As described above, the storage device 104 stores operating programs including the program of the present invention. Storage device 104 may be, for example, a combination of a recording medium and a drive that reads from and writes to the recording medium. The recording medium is not particularly limited, and may be, for example, a built-in type or an external type, and includes HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, memory card, and the like. be done. The storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and drive are integrated, and a solid state drive (SSD).

In the device 10, the memory 102 and the storage device 104 can also store user log information and information obtained from an external database (not shown).

The device 10 further includes an input device 105 and a display device 106, for example. The input device 105 is, for example, a touch panel, keyboard, mouse, or the like. Examples of the display device 106 include an LED display and a liquid crystal display.

Next, an example of the navigation method of this embodiment will be described based on the flowchart of FIG. The navigation method of this embodiment is implemented as follows, for example, using the navigation device 10 of FIG. It should be noted that the navigation method of this embodiment is not limited to the use of the navigation device 10 of FIG.

First, the imaging information acquisition unit 11 acquires a captured image captured by a visitor's terminal in a specific area (S1). The specific area is not particularly limited, and may be indoors or outdoors. Examples of indoor spaces include exhibition halls, event halls, department stores, and schools such as universities. The terminal of the visitor is not particularly limited, and may be, for example, a smart phone, a mobile phone, or a wearable terminal such as an eyeglass type or a wristwatch type. The captured image may be, for example, a still image or a moving image. Said acquisition is carried out, for example, via the communication network 30 .

Next, a virtual image relating to the specific area is generated by the virtual information generator 12 (S2). The virtual image related to the specific area is, for example, a pin image or the like indicating the booth position.

Next, the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image (S3). Said output may be performed, for example, via communication network 30 .

Next, the map information management unit 14 associates and manages the position code arranged in the specific area and the map information of the specific area (S4). The position code is, for example, a QR code (registered trademark), an AR marker, a bar code, a chameleon code (registered trademark), or the like. FIG. 4 shows an example of the relationship between the map of the exhibition hall and the position code. Although the exhibition hall 1 is used as the specific area hereinafter, it is an example and is not limited to this as described above. In an exhibition hall 1, a plurality of exhibition booths 2 are arranged. Further, in the exhibition hall 1, for example, position codes (QR codes (registered trademark)) 3 are arranged at regular intervals (for example, 15 m intervals). The arrangement of the exhibition booth 2 and the position code 3 is not particularly limited. Position code 3 is, for example, a marker for specifying a position in exhibition hall 1 . The number of position codes 3 is not particularly limited, and may be one or two or more. The place where the position code 3 is installed is not particularly limited. For example, it may be installed on the floor, the wall, or the ceiling. good. On the map information (map of the virtual space), as shown in FIG. 4, the positions of the position codes 3 installed in the exhibition hall 1 are linked. In addition, the map information management unit 14, for example, associates the positions of the exhibition booths 2 with the map information. The map information is, for example, coordinate information.

Next, when the position code is imaged by the visitor's terminal, the imaging information acquisition unit 11 acquires an image of the position code (also referred to as a position code image) (S5). FIG. 5 shows an example in which the terminal of the visitor captures the position code. As shown in FIG. 5, the visitor's terminal 20 captures an image of the position code 3 placed on the floor of the exhibition hall 1, for example.

Next, the map information management unit 14 specifies the position of the terminal of the visitor from the image of the position code based on the map information (S6), and ends (END). FIG. 6 shows an example of displaying the position (current position) of the identified terminal on the display of the visitor's terminal. The device 10 may transmit the identified position of the terminal 20 (that is, the current position) to the terminal 20 via the communication network 30, for example. Then, for example, as shown in FIG. 6, the terminal 20 displays the current position of the terminal 20 in the specific area superimposed on the map on the display of the terminal 20 . As shown in FIG. 6, the map displayed on the terminal 20 is, for example, the map of the exhibition hall 1, and is preferably modeled based on the coordinate information. Here, the "current position" refers to the position of the visitor's terminal at the time when the position code was captured.

The virtual information generation unit 12 may generate a virtual image related to the specific area based on the position of the terminal of the visitor identified by the map information management unit 14, for example. FIG. 7 shows an example of a synthesized image obtained by superimposing a virtual image related to the specific area on the captured image. As shown in FIG. 7, the terminal 20 to which the composite image is output displays a composite image in which the pins 4a and 4b of the exhibition booth, which are the virtual images, are superimposed on the captured image of the specific area captured by the terminal 20. Is displayed. In FIG. 7, the exhibition booth pin 4a is displayed larger than the exhibition booth pin 4b. In this way, for example, based on the position information of the specified terminal 20, the farther the position of the exhibition booth 2 is from the position information of the terminal 20, the more the pin 4 of the exhibition booth is set. The size of the pins 4 of other exhibition booths may be smaller than that of other exhibition booths. It may be larger than 4. On the other hand, for the exhibition booth pins 4 , for example, the outer edges of the exhibition booth pins 4 may be colored according to the distance from the location information of the terminal 20 to the location of the exhibition booth 2 . Identification information may be given to each of the pins 4 of the exhibition booth by the virtual information generation unit 12 . The identification information is, for example, numbers, letters, symbols, combinations of two or more thereof, and the like. As a result, the device 10 can generate a virtual image such as the pin 4 of the exhibition booth according to the specified position of the terminal 20, for example.

Further, information on the specific area may be obtained by the specific area information obtaining unit 15 (S7). The step (S7) may be processed in parallel with the step (S1), for example, as shown in FIG. The acquisition may be performed, for example, via the communication network 30, or may be acquired by input from the input device 105. FIG. The information related to the specific area is, for example, information related to exhibition booths, and more specifically, information such as company names, company introduction information, products and services, and the like. Then, the virtual information generation unit 12 may generate a virtual image regarding the specific area based on the information regarding the specific area, for example. As a result, as shown in FIG. 7, in addition to the pin 4 of the exhibition booth, the display of the terminal 20 displays information about the exhibition booth (company name (A Corp.), company introduction information, product and service information, etc.). ) is superimposed on the captured image. In the figure, columns for displaying company introduction information, product and service information, etc. are shown as "Window", but the positions of the columns are examples and are not limited to this.

Further, the visitor information acquisition unit 16 may acquire information about the visitor (S8). The step (S8) may be processed in parallel with the step (S1), for example, as shown in FIG. The acquisition may be performed, for example, via the communication network 30, or may be acquired by input from the input device 105. FIG. The information about the visitor includes, for example, attributes of the visitor (sex, age, occupation), purpose of visit (inspection, business negotiation, etc.), interesting exhibition booth (area), and the like. Then, the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor. Specifically, for example, the virtual image includes recommendation information, schedule information, exhibition booth information, and the like. The recommendation information is, for example, information recommended to the visitor based on the information about the visitor (for example, a recommended event, a recommended exhibition booth, etc.). The schedule information is, for example, information indicating a schedule of events to be held in the specific area. Examples of the event include demonstrations, seminars, and the like. The event may be an event run by an organizer or an event run by an exhibitor. The exhibit booth information is, for example, the same as the above-described exhibit booth information.

The device 10 may, for example, further include a route calculator. In this case, the map information further includes, for example, position information of obstacles existing within the specific area. The obstacle is not particularly limited, and is, for example, an object that blocks passage, such as a wall. For example, after the step (S6) shown in FIG. 3, the route calculation unit calculates a route from the terminal position of the visitor to the input position based on the map information. The input of the position may be input by acquiring from the terminal, or may be input by the input device 105, for example. The position is not particularly limited, and is, for example, the position of an exhibition booth. Then, the virtual information generating unit 12 generates a virtual image related to the specific area based on the calculated route, and the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image. (END). FIG. 8 shows an example of a synthesized image obtained by superimposing a virtual image related to the specific area on the captured image. In FIG. 8, for example, the visitor 6 taps the display of the terminal 20 to select an arbitrary exhibition booth pin 4 (pin 4b in FIG. 8). After that, the apparatus 10 acquires information indicating that the exhibition booth pin 4b has been selected, for example. The route calculation unit calculates a route from the position (Start) of the visitor 6 to the position (Goal) of the exhibition booth on the map information linked to the pin 4b of the selected exhibition booth. Then, the visitor 6 is guided to the exhibition booth position (Goal) corresponding to the selected exhibition booth pin 4b by using the composite image output from the apparatus 10. FIG. The composite image for guiding the visitor 6 is, for example, an image in which the guiding virtual object 5 such as an arrow and characters is superimposed on the captured image. As a result, for example, even a person who is not good at reading maps can reach the destination without stress. Further, the composite image may be an image in which a map (2D object) (not shown) of the specific area is superimposed on the captured image instead of or in addition to the guiding virtual object 5, for example. For example, the current position may be superimposed on the map as described above. In general, when the specific area is indoors or when the communication condition is not good, for example, GPS (Global Positioning System) cannot be used, so the self-position cannot be specified and the route cannot be calculated. However, according to this device 10, the position of the terminal can be specified by using the position code 3, so the position of the terminal can be determined depending on environmental conditions such as the specific area (indoors or poor communication conditions). route can be calculated.

[Embodiment 2]
A mode for specifying the direction of the visitor's terminal will be described with reference to FIGS. 9 and 10. FIG.

FIG. 9 is a schematic diagram showing the relationship between the map of the exhibition hall 3 and the direction of the position code 3. As shown in FIG. In the exhibition hall 1, for example, as shown in the lower part of FIG. 9, a direction mark for specifying the direction of the terminal 20 may be arranged. The direction mark may be, for example, an image with which the orientation (direction) can be confirmed on the map information, and may be a mark (code) different from the position code 3 . Moreover, the position code 3 may also serve as the direction mark. Specifically, for example, the shape of a marker in the position code 3 can be used to serve as said direction mark. The directions are, for example, north, south, east, and west. The map information management unit 14, for example, further associates and manages the map information of the direction mark and the specific area (exhibition hall 1). Specifically, for example, each direction of the direction mark and each direction of the map information of the specific area (exhibition hall 1) are matched and managed. When the terminal 20 captures an image of the direction mark, for example, the captured image of the direction mark (also referred to as a direction mark image) is acquired by the imaging information acquisition unit 11 . Then, for example, the map information management unit 14 further identifies the orientation of the terminal of the visitor, which is the orientation of the terminal of the visitor, from the image of the direction mark based on the map information.

FIG. 10 is a schematic diagram showing the relationship between the orientation of the map of the exhibition hall 3 and the orientation of the terminal 20. As shown in FIG. The virtual information generation unit 12 may generate a virtual image related to the specific area based on the direction of the terminal of the visitor identified by the map information management unit 14, for example. Then, the image information output unit 13 outputs, for example, a synthesized image in which the virtual image is superimposed on the captured image. In FIG. 10A, the display of the terminal 20 displays a composite image in which the company name (A Corp.), which is a virtual image, is superimposed on the captured image of the exhibition booth of the company A captured from an oblique direction. In FIG. 10B, the display of the terminal 20 displays a composite image in which the company name (virtual image) is superimposed on the captured image of the exhibition booth of the company A captured from the front direction.

[Embodiment 3]
With reference to FIG. 11, a form for identifying the tilt of the visitor's terminal will be described.

Further, when the visitor's terminal captures an image of the floor in the specific area, the imaging information acquisition unit 11 acquires the captured image of the floor (also referred to as a floor image). Then, the inclination of the visitor's terminal is specified from the floor image by the map information management unit 14 . The floor of the specific area is preferably flat. Specifically, for example, a planar panel spreads in the real space shown in the floor image, and the tilt of the terminal is specified from the tilt of the panel (also called planar scan). That is, the tilt of the terminal 20 can be identified from the tilt state of the floor image. The floor image may include, for example, at least one of the position code and the direction mark. The map information management unit 14 may specify the tilt of the terminal 20 from the tilt of at least one of the position code and the direction mark, for example. FIG. 11 is a schematic diagram showing an example of the relationship between the tilt of the terminal 20 and the image displayed on the display of the terminal 20. As shown in FIG. When the map information management unit 14 determines that the terminal 20 is not tilted, a composite image as shown in FIG. 11A is displayed on the display of the terminal 20. FIG. On the other hand, for example, when the map information management unit 14 identifies that the terminal 20 is tilted, as shown in FIG. A tilted (distorted) composite image is displayed on the display of the terminal 20 . Specifically, the image shown in FIG. 11A is a composite image obtained by superimposing the company name (A Corp.), which is a virtual image, on the captured image of the exhibition booth of Company A captured from the front direction. The image shown in b) is a composite image in which the company name (A Corp.), which is a virtual image, is superimposed on the captured image of the exhibition booth of company A captured from above.

Further, the device 10 may correct the captured image based on the specified tilt of the terminal 20, for example. Then, the image information output unit 13 outputs, for example, a composite image in which the virtual image is superimposed on the corrected captured image. That is, for example, even when it is specified that the terminal 20 is tilted, the device 10 is configured to generate the composite image shown in FIG. 11(a) instead of the composite image shown in FIG. 11(b). to correct.

[Embodiment 4]
FIG. 1B is a schematic diagram showing the configuration of an example of the navigation system of this embodiment. As shown in FIG. 1B, the navigation system of this embodiment includes the navigation device 10 according to any one of the first to third embodiments and a terminal 20. FIG. A terminal 20 is a terminal of a visitor in the specific area. The navigation device 10 and terminal 20 can communicate via a communication network 30 . A navigation system is also called a navigation system device.

Specifically, the flow of processing in the navigation system of this embodiment will be described. First, in the terminal 20, the imaging device is activated to prompt the user (for example, a visitor) to take an image of the position code. The user searches for the location code located within a specific area and images the location code with an imaging device. Then, the position code is read by the navigation device 10, and the position of the terminal 20 of the user is specified. Further, when the position code also serves as the orientation mark, for example, the orientation of the terminal 20 is also specified. Specifically, for example, after the orientation of the terminal 20 is identified, the position of the terminal 20 is identified.

[Embodiment 5]
The program of this embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure. In the present invention, "procedure" may be read as "processing". Moreover, the program of this embodiment may be recorded on a computer-readable recording medium, for example. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include read-only memory (ROM), hard disk (HD), optical disc, and the like.

Although the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes can be made to the configuration and details of the present invention within the scope of the present invention that can be understood by those skilled in the art.

This application claims priority based on Japanese Patent Application No. 2020-102758 filed on June 15, 2020, and the entire disclosure thereof is incorporated herein.

<Appendix>
Some or all of the above-described embodiments can be described as the following notes, but are not limited to the following.
(Appendix 1)
including an imaging information acquisition unit, a virtual information generation unit, an image information output unit, and a map information management unit,
The imaging information acquisition unit acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating unit generates a virtual image regarding the specific area,
The image information output unit outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management unit associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaged image of the position code is acquired by the imaging information acquisition unit,
The map information management unit identifies the position of the terminal of the visitor from the image of the position code based on the map information.
navigation device.
(Appendix 2)
The virtual information generation unit generates a virtual image related to the specific area based on the position of the terminal of the visitor identified by the map information management unit.
The navigation device according to appendix 1.
(Appendix 3)
A direction mark for specifying the orientation of the visitor's terminal is arranged in the specific area,
The map information management unit associates and manages the map information of the direction mark and the specific area,
when the terminal of the visitor captures an image of the direction mark, the captured image of the direction mark is acquired by the imaging information acquisition unit;
The map information management unit identifies the orientation of the terminal of the visitor from the image of the direction mark based on the map information.
A navigation device according to appendix 1 or 2.
(Appendix 4)
The virtual information generation unit generates a virtual image related to the specific area based on the orientation of the terminal of the visitor identified by the map information management unit.
A navigation device according to appendix 3.
(Appendix 5)
the position code also serves as the direction mark;
A navigation device according to appendix 3 or 4.
(Appendix 6)
When the floor of the specific area is imaged by the visitor's terminal, the imaged image of the floor is acquired by the imaging information acquisition unit,
The map information management unit identifies the inclination of the terminal of the visitor from the image of the floor.
6. A navigation device according to any one of appendices 1 to 5.
(Appendix 7)
the image of the floor is an image including at least one of the position code and the direction mark;
A navigation device according to appendix 6.
(Appendix 8)
Furthermore, including a specific area information acquisition unit,
The specific area information acquisition unit acquires information about the specific area,
The virtual information generation unit generates a virtual image regarding the specific area based on information regarding the specific area.
8. A navigation device according to any one of appendices 1 to 7.
(Appendix 9)
Furthermore, including a visitor information acquisition unit,
The visitor information acquisition unit acquires information about the visitor,
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
9. A navigation device according to any one of appendices 1 to 8.
(Appendix 10)
including a navigation device and a terminal,
The navigation device is the navigation device according to any one of Appendices 1 to 9,
The terminal is a terminal of a visitor in the specific area,
the navigation device and the terminal are capable of communicating via a communication network;
navigation system.
(Appendix 11)
including an imaging information acquisition process, a virtual information generation process, an image information output process, and a map information management process,
The imaging information acquisition step acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating step generates a virtual image related to the specific area,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management step associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaging information acquisition step acquires an image of the imaged position code,
The map information management step identifies the position of the terminal of the visitor from the image of the position code based on the map information.
navigation method.
(Appendix 12)
The virtual information generating step generates a virtual image related to the specific area based on the position of the terminal of the visitor identified by the map information managing step.
The navigation method according to appendix 11.
(Appendix 13)
A direction mark for specifying the orientation of the visitor's terminal is arranged in the specific area,
The map information management step associates and manages the map information of the direction mark and the specific area,
When the direction mark is imaged by the visitor's terminal, the imaging information obtaining step obtains an image of the direction mark that has been imaged,
The map information management step identifies the orientation of the visitor's terminal, i.e., which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
13. The navigation method according to appendix 11 or 12.
(Appendix 14)
The virtual information generating step generates a virtual image related to the specific area based on the orientation of the terminal of the visitor identified by the map information managing step.
The navigation method according to appendix 13.
(Appendix 15)
the position code also serves as the direction mark;
15. The navigation method according to appendix 13 or 14.
(Appendix 16)
When the floor of the specific area is imaged by the visitor's terminal, the imaging information acquisition step acquires the imaged image of the floor,
The map information management step identifies the inclination of the terminal of the visitor from the image of the floor.
16. A navigation method according to any one of appendices 11 to 15.
(Appendix 17)
the image of the floor is an image including at least one of the position code and the direction mark;
The navigation method according to appendix 16.
(Appendix 18)
Furthermore, including a specific area information acquisition step,
The specific area information obtaining step obtains information about the specific area,
The virtual information generating step generates a virtual image related to the specific area based on information related to the specific area.
18. A navigation method according to any one of appendices 11 to 17.
(Appendix 19)
Furthermore, including a visitor information acquisition process,
The visitor information acquisition step acquires information about the visitor,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image according to the information about the visitor.
19. A navigation method according to any one of appendices 11 to 18.
(Appendix 20)
A program for causing a computer to execute procedures including an imaging information acquisition procedure, a virtual information generation procedure, an image information output procedure, and a map information management procedure;
The imaging information acquisition procedure acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating procedure generates a virtual image for the specific area,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management procedure associates and manages the location code arranged in the specific area and the map information of the specific area,
When the location code is imaged by the visitor's terminal, the imaging information acquisition step acquires an image of the imaged location code,
The map information management procedure identifies the position of the terminal of the visitor from the image of the position code based on the map information.
(Appendix 21)
The virtual information generation procedure generates a virtual image related to the specific area based on the position of the visitor's terminal identified by the map information management procedure.
20. The program according to appendix 20.
(Appendix 22)
A direction mark for specifying the orientation of the visitor's terminal is arranged in the specific area,
The map information management procedure associates and manages the map information of the direction mark and the specific area,
when the direction mark is imaged by the visitor's terminal, the imaged direction mark image is acquired by the imaging information acquisition procedure;
The map information management procedure identifies the orientation of the visitor's terminal, i.e., which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
22. The program according to appendix 20 or 21.
(Appendix 23)
The virtual information generating procedure generates a virtual image related to the specific area based on the orientation of the terminal of the visitor identified by the map information managing procedure.
22. The program according to appendix 22.
(Appendix 24)
the position code also serves as the direction mark;
24. The program according to appendix 22 or 23.
(Appendix 25)
When the floor of the specific area is imaged by the visitor's terminal, the imaged image of the floor is acquired by the imaging information acquisition procedure,
The map information management procedure identifies the inclination of the terminal of the visitor from the image of the floor.
25. A program according to any one of appendices 20-24.
(Appendix 26)
the image of the floor is an image including at least one of the position code and the direction mark;
The program according to appendix 25.
(Appendix 27)
Furthermore, including a specific area information acquisition procedure,
The specific area information obtaining procedure obtains information about the specific area,
The virtual information generating procedure generates a virtual image related to the specific area based on information related to the specific area.
27. A program according to any one of appendices 20-26.
(Appendix 28)
Furthermore, including the visitor information acquisition procedure,
The visitor information acquisition procedure acquires information about the visitor,
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
28. A program according to any one of appendices 20-27.
(Appendix 29)
A computer-readable recording medium recording the program according to any one of appendices 20 to 28.

According to the present invention, it is possible to transmit information using AR in a large-scale facility such as an exhibition hall, and to easily check the current position. Therefore, the present invention is useful in various fields to which AR technology can be applied.

1 Exhibition hall 2 Exhibition booth 3 Position code 4 Exhibition booth pin 5 Guidance virtual object 6 Visitor 10 Navigation device 11 Imaging information acquisition unit 12 Virtual information generation unit 13 Image information output unit 14 Map information management unit 15 Specific area information acquisition Part 16 Visitor Information Acquisition Part 20 Terminal 30 Communication Network 101 Central Processing Unit 102 Memory 103 Bus 104 Storage Device 105 Input Device 106 Display Device 107 Communication Device

Claims (9)

including an imaging information acquisition unit, a virtual information generation unit, an image information output unit, and a map information management unit,
The imaging information acquisition unit acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating unit generates a virtual image regarding the specific area,
The image information output unit outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management unit associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaged image of the position code is acquired by the imaging information acquisition unit,
The map information management unit identifies the position of the terminal of the visitor from the image of the position code based on the map information,
Furthermore, including a visitor information acquisition unit,
The visitor information acquisition unit acquires information about the visitor,
The information about the visitor includes at least one information selected from the group consisting of the visitor's attribute, the visitor's purpose, and the visitor's interest,
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor,
The virtual image includes at least one selected from the group consisting of recommendation information, schedule information, and exhibition booth information ,
navigation device. The virtual information generation unit generates a virtual image related to the specific area based on the position of the terminal of the visitor identified by the map information management unit.
2. Navigation device according to claim 1. A direction mark for specifying the orientation of the visitor's terminal is arranged in the specific area,
The map information management unit associates and manages the map information of the direction mark and the specific area,
when the terminal of the visitor captures an image of the direction mark, the captured image of the direction mark is acquired by the imaging information acquisition unit;
The map information management unit identifies the orientation of the terminal of the visitor from the image of the direction mark based on the map information.
3. A navigation device according to claim 1 or 2. The virtual information generation unit generates a virtual image related to the specific area based on the orientation of the terminal of the visitor identified by the map information management unit.
4. Navigation device according to claim 3. When the floor of the specific area is imaged by the visitor's terminal, the imaged image of the floor is acquired by the imaging information acquisition unit,
The map information management unit identifies the inclination of the terminal of the visitor from the image of the floor.
Navigation device according to any one of claims 1 to 4. Furthermore, including a specific area information acquisition unit,
The specific area information acquisition unit acquires information about the specific area,
The virtual information generation unit generates a virtual image regarding the specific area based on information regarding the specific area.
Navigation device according to any one of claims 1 to 5. including a navigation device and a terminal,
The navigation device is the navigation device according to any one of claims 1 to 6 ,
The terminal is a terminal of a visitor in the specific area,
the navigation device and the terminal are capable of communicating via a communication network;
navigation system. including an imaging information acquisition process, a virtual information generation process, an image information output process, and a map information management process,
The imaging information acquisition step acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating step generates a virtual image related to the specific area,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management step associates and manages the location code arranged in the specific area and the map information of the specific area,
When the position code is imaged by the visitor's terminal, the imaging information acquisition step acquires an image of the imaged position code,
The map information management step identifies the position of the terminal of the visitor from the image of the position code based on the map information ,
Furthermore, including a visitor information acquisition process,
The visitor information acquisition step acquires information about the visitor,
The information about the visitor includes at least one information selected from the group consisting of the visitor's attribute, the visitor's purpose, and the visitor's interest,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image according to the information about the visitor,
the virtual image includes at least one selected from the group consisting of recommendation information, schedule information, and exhibition booth information;
each of the steps is performed by a computer ,
navigation method. A program for causing a computer to execute procedures including an imaging information acquisition procedure, a virtual information generation procedure, an image information output procedure , a map information management procedure , and a visitor information acquisition procedure ;
The imaging information acquisition procedure acquires a captured image captured by a terminal of a visitor in a specific area,
The virtual information generating procedure generates a virtual image for the specific area,
The image information output step outputs a composite image obtained by superimposing the virtual image on the captured image,
The map information management procedure associates and manages the location code arranged in the specific area and the map information of the specific area,
When the location code is imaged by the visitor's terminal, the imaging information acquisition step acquires an image of the imaged location code,
The map information management procedure identifies the position of the terminal of the visitor from the image of the position code based on the map information ,
The visitor information acquisition procedure acquires information about the visitor,
The information about the visitor includes at least one information selected from the group consisting of the visitor's attribute, the visitor's purpose, and the visitor's interest,
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor,
The virtual image includes at least one selected from the group consisting of recommendation information, schedule information, and exhibition booth information .

Images