WO2021256239A1

WO2021256239A1 - Navigation device, navigation system, navigation method, program, and storage medium

Info

Publication number: WO2021256239A1
Application number: PCT/JP2021/020829
Authority: WO
Inventors: 浩平金澤; 雄也木元; 陽平水谷
Original assignee: Ｎｅｃソリューションイノベータ株式会社
Priority date: 2020-06-15
Filing date: 2021-06-01
Publication date: 2021-12-23
Also published as: JPWO2021256239A1; JP7294735B2

Abstract

Provided is a navigation device which can use AR to provide information and which makes it possible to easily confirm one's present location in large-scale facilities at an exhibition site or the like.　In a navigation device (10) according to the present invention, a captured image information acquisition unit (11) acquires an image captured by a terminal of a visitor in a specific area, a virtual information generation unit (12) generates a virtual image related to the specific area, an image information output unit (13) outputs a composite image in which the virtual image is superimposed on the captured image, and a map information management unit (14) manages a location code provided to the specific area and map information pertaining to the specific area while associating the location code with the map information. When an image of the location code is captured by the terminal, the captured location code image is acquired by the captured image information acquisition unit (11), and the map information management unit (14) identifies the location of the visitor's terminal from the location code image on the basis of the map information.

Description

Navigation devices, navigation systems, navigation methods, programs, and recording media

The present invention relates to a navigation device, a navigation system, a navigation method, a program, and a recording medium.

In recent years, a technique for promoting a product or the like using AR (Augmented Reality) technology has been proposed (for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2018-147137

Recently, exhibitions have been held, and products are often advertised at the exhibition hall. For this reason, it is conceivable to promote products and the like using AR and to disseminate information at the exhibition hall. On the other hand, since the exhibition hall is large and there are many exhibition booths, visitors need to find the desired exhibition booth while checking the current location. However, under the present circumstances, it is necessary to confirm the current position by using the map installed at the venue (venue guide map, etc.), and it is necessary to go to the place where the map is installed every time the current position is confirmed. It was inconvenient. This problem is not limited to exhibition venues, but also affects large facilities such as event venues, department stores, schools such as universities, large hospitals, and shopping malls.

Therefore, an object of the present invention is to provide a navigation device and a navigation method capable of transmitting information using AR in a large facility or the like of an exhibition hall and easily confirming the current position. And.

In order to achieve the above object, the navigation device of the present invention is used.
Includes image capture information acquisition unit, virtual information generation unit, image information output unit, and map information management unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The map information management unit manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the captured image of the position code is acquired by the image pickup information acquisition unit.
The map information management unit is a device that identifies the position of the terminal of the visitor from the image of the position code based on the map information.

The navigation method of the present invention
Includes imaging information acquisition process, virtual information generation process, image information output process, and map information management process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The map information management process manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged position code.
The map information management step is a method of specifying the position of the terminal of the visitor from the image of the position code based on the map information.

According to the present invention, information can be transmitted by AR, and the current position of a visitor in a large facility or the like can be easily confirmed. The current position can be confirmed by, for example, GPS (Global Positioning System), but since GPS uses radio waves, there is a problem in confirming the position indoors. On the other hand, since the present invention uses the position code, the position can be confirmed without any problem even indoors. However, the present invention may be applied to outdoor position confirmation.

FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment, and FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment. FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus of the first embodiment. FIG. 3 is a flowchart showing an example of processing in the apparatus of the first embodiment. FIG. 4 is a schematic diagram showing an example of the relationship between the map of the exhibition hall and the position code. FIG. 5 is a schematic diagram showing an example in which a terminal captures a position code. FIG. 6 is a schematic diagram showing an example of displaying the position of the terminal on the display of the terminal of the visitor. FIG. 7 is a schematic diagram showing an example of a composite image in which a virtual image relating to a specific area is superimposed on a captured image. FIG. 8 is a schematic diagram showing an example of a composite image in which a virtual image relating to a specific area is superimposed on a captured image. FIG. 9 is a schematic diagram showing an example of the relationship between the map of the exhibition hall and the direction of the position code. FIG. 10 is a schematic diagram showing an example of the relationship between the orientation of the map of the exhibition hall and the orientation of the terminal. FIG. 11 is a schematic diagram showing an example of the relationship between the tilt of the terminal and the image displayed on the display of the terminal.

In the present invention, the "visitor" means a person who comes within a specific area, and is also referred to as a user. Visitors can also be rephrased as visitors, visitors, and the like.

An embodiment of the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments. In each of the following figures, the same parts are designated by the same reference numerals. Further, the explanations of the respective embodiments can be referred to each other unless otherwise specified, and the configurations of the respective embodiments can be combined unless otherwise specified.

[Embodiment 1]
FIG. 1A is a block diagram showing a configuration of an example of the navigation device 10 of the present embodiment, and FIG. 1B is a schematic showing a configuration of an example of a navigation system including the navigation device 10 of the present embodiment. It is a figure. As shown in FIG. 1A, the apparatus 10 includes an image pickup information acquisition unit 11, a virtual information generation unit 12, an image information output unit 13, a map information management unit 14, a specific area information acquisition unit 15, and a visitor information acquisition. Including part 16. The specific area information acquisition unit 15 and the visitor information acquisition unit 16 have an arbitrary configuration and may not be included in the present device 10. The navigation system device will be described in the fourth embodiment.

The device 10 may be, for example, one device including the above-mentioned parts, or may be a device in which the above-mentioned parts can be connected via the communication network 30. Further, the present device 10 can be connected to an external device described later via the communication line network 30. The communication network 30 is not particularly limited, and a known network can be used, and may be wired or wireless, for example. Examples of the communication line network 30 include an Internet line, WWW (World Wide Web), a telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Traveler Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark) and the like. The wireless communication may be either a form in which each device directly communicates (Ad Hoc communication) or an indirect communication via an access point. The apparatus 10 may be incorporated in the server as a system, for example. Further, the apparatus 10 is, for example, a personal computer (PC, for example, a desktop type, a notebook type), a terminal (for example, a smartphone, a mobile phone, a glasses type, a watch type, or the like) wearable terminal on which the program of the present invention is installed. ) Etc. may be used.

FIG. 2 illustrates a block diagram of the hardware configuration of the present device 10. The apparatus 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each part of the apparatus 10 is connected to each other via a bus 103 by each interface (I / F).

The central processing unit (also referred to as a central processing unit or a central processing unit) 101 is responsible for controlling the entire device 10. In the present device 10, for example, the program of the present invention and other programs are executed by the central processing unit 101, and various information is read and written. Specifically, for example, the central processing unit 101 includes an imaging information acquisition unit 11, a virtual information generation unit 12, an image information output unit 13, a map information management unit 14, a specific area information acquisition unit 15, and a visitor information acquisition unit. Functions as 16.

The bus 103 can also be connected to, for example, an external device. Examples of the external device include an external storage device (external database, etc.), a printer, and the like. The device 10 can be connected to an external network (communication network) by, for example, a communication device 107 connected to the bus 103, and can also be connected to another device via the external network.

The memory 102 may be, for example, a main memory (main storage device). When the central processing unit 101 performs processing, for example, the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 reads the memory. Receives data from 102 and executes the program. The main memory is, for example, a RAM (random access memory). Further, the memory 102 may be, for example, a ROM (read-only memory).

The storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (main storage device), for example. As described above, the storage device 104 stores an operation program including the program of the present invention. The storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium. The recording medium is not particularly limited, and may be an internal type or an external type, and examples thereof include HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, and memory card. Be done. The storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).

In the device 10, the memory 102 and the storage device 104 can also store user log information and information acquired from an external database (not shown).

The device 10 further includes, for example, an input device 105 and a display device 106. The input device 105 is, for example, a touch panel, a keyboard, a mouse, or the like. Examples of the display device 106 include an LED display, a liquid crystal display, and the like.

Next, an example of the navigation method of the present embodiment will be described based on the flowchart of FIG. The navigation method of the present embodiment is carried out as follows, for example, by using the navigation device 10 of FIG. The navigation method of the present embodiment is not limited to the use of the navigation device 10 of FIG.

First, the image pickup information acquisition unit 11 acquires an image captured by a terminal of a visitor in a specific area (S1). The specific area is not particularly limited and may be indoors or outdoors. The indoors include, for example, exhibition halls, event halls, department stores, schools such as universities, and the like. The terminal of the visitor is not particularly limited, and is, for example, a wearable terminal such as a smartphone, a mobile phone, a spectacle type, and a wristwatch type. The captured image may be, for example, a still image or a moving image. The acquisition is performed, for example, via the communication network 30.

Next, the virtual information generation unit 12 generates a virtual image related to the specific area (S2). The virtual image relating to the specific area is, for example, a pin image showing a booth position or the like.

Next, the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image (S3). The output may be executed, for example, via the communication network 30.

Next, the map information management unit 14 manages the position code arranged in the specific area and the map information of the specific area in association with each other (S4). The position code includes, for example, a QR code (registered trademark), an AR marker, a barcode, a chameleon code (registered trademark), and the like. FIG. 4 shows an example of the relationship between the map of the exhibition hall and the location code. Hereinafter, the exhibition hall 1 will be used as the specific area, but it is an example and is not limited to this as described above. A plurality of exhibition booths 2 are arranged in the exhibition hall 1. Further, in the exhibition hall 1, for example, position codes (QR code (registered trademark)) 3 are arranged at regular intervals (for example, 15 m intervals). The arrangement of the exhibition booth 2 and the position code 3 is not particularly limited. The position code 3 is, for example, a marker for specifying a position in the exhibition hall 1. The number of position codes 3 is not particularly limited, and may be one or two or more. The installation location of the position code 3 is not particularly limited, and may be, for example, a floor, a wall, a ceiling, or a panel having the position code 3 may be installed by hanging it from the ceiling to the air. good. As shown in FIG. 4, the position of the position code 3 installed in the exhibition hall 1 is associated with the map information (map of the virtual space). Further, the location of the exhibition booth 2 is also linked to the map information by, for example, the map information management unit 14. The map information is, for example, coordinate information.

Next, when the position code is imaged by the terminal of the visitor by the image pickup information acquisition unit 11, an image of the imaged position code (also referred to as a position code image) is acquired (S5). FIG. 5 shows an example in which the terminal of the visitor captures the position code. As shown in FIG. 5, the visitor's terminal 20 captures, for example, a position code 3 arranged on the floor of the exhibition hall 1.

Next, the map information management unit 14 identifies the position of the visitor's terminal from the image of the position code based on the map information (S6), and ends (END). FIG. 6 shows an example of displaying the position (current position) of the specified terminal on the display of the visitor's terminal. The apparatus 10 may transmit the position (that is, the current position) of the specified terminal 20 to the terminal 20 via, for example, the communication network 30. Then, for example, as shown in FIG. 6, the terminal 20 displays the current position of the terminal 20 in the specific area superimposed on the map on the display of the terminal 20. As shown in FIG. 6, the map displayed on the terminal 20 is, for example, a map of the exhibition hall 1, and is preferably schematically based on the coordinate information. Here, the "current position" means the position of the terminal of the visitor at the time when the position code is imaged.

The virtual information generation unit 12 may generate a virtual image related to the specific area based on the position of the terminal of the visitor specified by the map information management unit 14, for example. FIG. 7 shows an example of a composite image in which a virtual image relating to the specific area is superimposed on the captured image. As shown in FIG. 7, on the terminal 20 to which the composite image is output, a composite image in which the

pins

4a and 4b of the exhibition booth, which are virtual images, are superimposed on the captured image of the specific area captured by the terminal 20 is displayed. Is displayed. In FIG. 7, the pin 4a of the exhibition booth is displayed larger than the pin 4b of the exhibition booth. As described above, the pin 4 of the exhibition booth is, for example, based on the position information of the specified terminal 20, the farther the position of the exhibition booth 2 is from the position information of the terminal 20, the more the pin 4 of the exhibition booth is located. The size may be smaller than the pin 4 of the other exhibition booth, and the closer the position of the exhibition booth 2 is from the position information of the terminal 20, the larger the size of the pin 4 of the exhibition booth will be. It may be larger than 4. On the other hand, the pin 4 of the exhibition booth may color the outer edge of the pin 4 of the exhibition booth according to the distance from the position information of the terminal 20 to the position of the exhibition booth 2, for example. Identification information may be assigned to each of the pins 4 of the exhibition booth by the virtual information generation unit 12. The identification information is, for example, a number, a character, a symbol, or a combination of two or more thereof. As a result, the present device 10 can generate a virtual image such as a pin 4 of the exhibition booth according to the position of the specified terminal 20, for example.

Further, the specific area information acquisition unit 15 may acquire information regarding the specific area (S7). The step (S7) may be processed in parallel with the step (S1), for example, as shown in FIG. The acquisition may be executed, for example, via the communication network 30, or may be acquired by input by the input device 105. The information regarding the specific area is, for example, information about an exhibition booth or the like, and more specifically, information about a company name, company introduction information, products, services, or the like. Then, the virtual information generation unit 12 may generate a virtual image regarding the specific area based on the information regarding the specific area, for example. As a result, as shown in FIG. 7, on the display of the terminal 20, in addition to the pin 4 of the exhibition booth, information about the exhibition booth (company name (A Corp.), company introduction information, information on products, services, etc., etc. ) Is superimposed on the captured image, and a composite image is displayed. In the figure, a column for displaying company introduction information, information such as products and services, etc. is shown as "Windows", but the position of the column is an example and is not limited thereto.

Further, the visitor information acquisition unit 16 may acquire information about the visitor (S8). The step (S8) may be processed in parallel with the step (S1), for example, as shown in FIG. The acquisition may be executed, for example, via the communication network 30, or may be acquired by input by the input device 105. The information about the visitors is, for example, the attributes of the visitors (gender, age, occupation), the purpose of the visit (inspection, business negotiations, etc.), the exhibition booth (area) of interest, and the like. Then, the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor. Specifically, for example, the virtual image includes recommendation information, schedule information, exhibition booth information, and the like. The recommendation information is, for example, information recommended to the visitor based on the information about the visitor (for example, a recommended event, a recommended exhibition booth, etc.). The schedule information is, for example, information indicating the schedule of an event to be held in the specific area. Examples of the event include demonstrations and seminars. The event may be an event promoted by the organizer or an event promoted by the exhibitor. The exhibition booth information is, for example, the same as the above-mentioned information regarding the exhibition booth.

The apparatus 10 may further include, for example, a route calculation unit. In this case, the map information further includes, for example, the position information of an obstacle existing in the specific area. The obstacle is not particularly limited, and is, for example, an object that obstructs passage such as a wall. For example, after the step (S6) shown in FIG. 3, the route calculation unit calculates a route from the position of the terminal of the visitor to the input position based on the map information. The input of the position may be input by, for example, acquiring from the terminal, or may be input by the input device 105. The position is not particularly limited, and is, for example, the position of an exhibition booth or the like. Then, the virtual information generation unit 12 generates a virtual image relating to the specific area based on the calculated path, and the image information output unit 13 outputs a composite image in which the virtual image is superimposed on the captured image, and ends. (END). FIG. 8 shows an example of a composite image in which a virtual image relating to the specific area is superimposed on the captured image. In FIG. 8, for example, the visitor 6 selects a pin 4 (pin 4b in FIG. 8) of an arbitrary exhibition booth by tapping the display of the terminal 20. After that, the apparatus 10 acquires, for example, information indicating that the pin 4b of the exhibition booth is selected. The route calculation unit calculates a route from the position (Start) of the visitor 6 to the position (Goal) of the exhibition booth on the map information associated with the pin 4b of the selected exhibition booth. Then, using the composite image output from the present device 10, the visitor 6 is guided to the position (Goal) of the exhibition booth corresponding to the pin 4b of the selected exhibition booth. The composite image for guiding the visitor 6 is, for example, an image in which a guidance virtual object 5 such as an arrow and a character is superimposed on the captured image. As a result, for example, even a person who is not good at reading a map can go to a destination without stress. Further, the composite image may be, for example, an image in which a map (2D object) (not shown) of the specific area is superimposed on the captured image in place of or in addition to the guidance virtual object 5. For example, as described above, the current position may be superimposed on the map. Generally, when the specific area is indoors or the communication state is not good, for example, GPS (Global Positioning System) or the like cannot be used, so that the self-position cannot be specified or the route can be calculated. However, according to the present device 10, since the position of the terminal can be specified by using the position code 3, it depends on the environmental conditions such as the specific area (when it is indoors or when the communication state is not good). It is not possible to calculate the route.

[Embodiment 2]
A mode for specifying the direction of the terminal of the visitor will be described with reference to FIGS. 9 and 10.

FIG. 9 is a schematic diagram showing the relationship between the map of the exhibition hall 3 and the direction of the position code 3. In the exhibition hall 1, for example, as shown in the lower part of FIG. 9, a direction mark for specifying the orientation of the terminal 20 may be arranged. The direction mark may be, for example, an image whose direction (direction) can be confirmed on the map information, and may be a mark (code) different from the position code 3. Further, the position code 3 may also serve as the direction mark. Specifically, for example, the shape of the marker in the position code 3 can be used to function as the direction mark. The direction is, for example, north, south, east, and west. For example, the map information management unit 14 further manages the direction mark and the map information of the specific area (exhibition hall 1) in association with each other. Specifically, for example, each direction of the direction mark and each direction of the map information of the specific area (exhibition hall 1) are matched and managed. When the direction mark is imaged by the terminal 20, for example, the captured image of the direction mark (also referred to as a direction mark image) is acquired by the image pickup information acquisition unit 11. Then, for example, the map information management unit 14 further specifies the direction of the visitor's terminal, which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.

FIG. 10 is a schematic diagram showing the relationship between the direction of the map of the exhibition hall 3 and the direction of the terminal 20. The virtual information generation unit 12 may generate a virtual image relating to the specific area, for example, based on the orientation of the visitor's terminal specified by the map information management unit 14. Then, the image information output unit 13 outputs, for example, a composite image in which the virtual image is superimposed on the captured image. In FIG. 10A, the display of the terminal 20 displays a composite image in which the company name (A Corp.), which is a virtual image, is superimposed on the captured image obtained by capturing the exhibition booth of the company A from an oblique direction. In FIG. 10B, the display of the terminal 20 displays a composite image in which the company name (virtual image) is superimposed on the captured image obtained by capturing the exhibition booth of the company A from the front direction.

[Embodiment 3]
A mode for specifying the inclination of the terminal of the visitor will be described with reference to FIG.

Further, when the floor of the specific area is imaged by the terminal of the visitor, the image pickup information acquisition unit 11 acquires the image of the image of the floor (also referred to as a floor image). Then, the map information management unit 14 identifies the inclination of the visitor's terminal from the floor image. The floor in the specific area is preferably flat. Specifically, for example, a flat panel expands with respect to the real space shown in the floor image, and the tilt of the terminal is specified from the tilt of the panel (also referred to as a flat scan). That is, the inclination of the terminal 20 can be specified from the inclination state of the floor image. The floor image may include, for example, at least one of the position code and the direction mark. The map information management unit 14 may specify the inclination of the terminal 20 from, for example, the inclination of at least one of the position code and the direction mark. FIG. 11 is a schematic diagram showing an example of the relationship between the tilt of the terminal 20 and the image displayed on the display of the terminal 20. When the map information management unit 14 identifies that the terminal 20 is not tilted, a composite image as shown in FIG. 11A is displayed on the display of the terminal 20. On the other hand, for example, when the map information management unit 14 identifies that the terminal 20 is tilted, as shown in FIG. 11B, the composite image of FIG. 11A is based on the tilt of the terminal 20. The tilted (distorted) composite image is displayed on the display of the terminal 20. Specifically, the image shown in FIG. 11A is a composite image in which the company name (A Corp.), which is a virtual image, is superimposed on the captured image obtained by capturing the exhibition booth of company A from the front direction. The image shown in b) is a composite image in which the company name (A Corp.), which is a virtual image, is superimposed on the captured image obtained by capturing the exhibition booth of company A from above.

Further, the apparatus 10 may correct the captured image from the inclination of the specified terminal 20, for example. Then, the image information output unit 13 outputs, for example, a composite image in which the virtual image is superimposed on the corrected captured image. That is, for example, even when the terminal 20 is specified to be tilted, the present device 10 is not a composite image shown in FIG. 11 (b) but a composite image shown in FIG. 11 (a). to correct.

[Embodiment 4]
FIG. 1B is a schematic diagram showing a configuration of an example of the navigation system of the present embodiment. As shown in FIG. 1 (B), the navigation system of the present embodiment includes the navigation device 10 according to any one of the first to third embodiments, and the terminal 20. The terminal 20 is a terminal of a visitor in the specific area. The navigation device 10 and the terminal 20 can communicate with each other via the communication network 30. The navigation system is also referred to as a navigation system device.

Specifically, the flow of processing in the navigation system of this embodiment will be described. First, the terminal 20 activates the image pickup device and prompts the user (for example, a visitor) to take a picture of the position code. The user searches for the position code arranged in the specific area, and captures the position code on the image pickup device. Then, the position code is read by the navigation device 10, and the position of the user's terminal 20 is specified. Further, when the position code also serves as the direction mark, the orientation of the terminal 20 is also specified, for example. Specifically, for example, after the orientation of the terminal 20 is specified, the position of the terminal 20 is specified.

[Embodiment 5]
The program of the present embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure. In the present invention, "procedure" may be read as "processing". Further, the program of the present embodiment may be recorded on a computer-readable recording medium, for example. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include a read-only memory (ROM), a hard disk (HD), and an optical disk.

Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

This application claims priority on the basis of Japanese application Japanese Patent Application No. 2020-102758 filed on June 15, 2020, and incorporates all of its disclosures herein.

<Additional Notes>
Some or all of the above embodiments may be described as, but not limited to, the following appendixes.
(Appendix 1)
Includes image capture information acquisition unit, virtual information generation unit, image information output unit, and map information management unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The map information management unit manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the captured image of the position code is acquired by the image pickup information acquisition unit.
The map information management unit identifies the position of the visitor's terminal from the image of the position code based on the map information.
Navigation device.
(Appendix 2)
The virtual information generation unit generates a virtual image regarding the specific area based on the position of the terminal of the visitor specified by the map information management unit.
The navigation device according to Appendix 1.
(Appendix 3)
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management unit manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the captured image of the direction mark is acquired by the image pickup information acquisition unit.
The map information management unit identifies the direction of the visitor's terminal from the image of the direction mark based on the map information.
The navigation device according to Appendix 1 or 2.
(Appendix 4)
The virtual information generation unit generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management unit.
The navigation device according to Appendix 3.
(Appendix 5)
The position code also serves as the direction mark.
The navigation device according to Appendix 3 or 4.
(Appendix 6)
When the floor of the specific area is imaged by the terminal of the visitor, the image of the imaged floor is acquired by the image pickup information acquisition unit.
The map information management unit identifies the inclination of the visitor's terminal from the image of the floor.
The navigation device according to any one of Supplementary Notes 1 to 5.
(Appendix 7)
The image of the floor is an image including at least one of the position code and the direction mark.
The navigation device according to Appendix 6.
(Appendix 8)
In addition, it includes a specific area information acquisition section.
The specific area information acquisition unit acquires information about the specific area and obtains information about the specific area.
The virtual information generation unit generates a virtual image related to the specific area based on the information about the specific area.
The navigation device according to any one of Supplementary Provisions 1 to 7.
(Appendix 9)
In addition, including the visitor information acquisition department,
The visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The navigation device according to any one of Supplementary Provisions 1 to 8.
(Appendix 10)
Including navigation devices and terminals
The navigation device is the navigation device according to any one of Supplementary Provisions 1 to 9.
The terminal is a terminal of a visitor in the specific area.
The navigation device and the terminal can communicate with each other via a communication network.
Navigation system.
(Appendix 11)
Includes imaging information acquisition process, virtual information generation process, image information output process, and map information management process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The map information management process manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged position code.
The map information management step identifies the position of the visitor's terminal from the image of the position code based on the map information.
Navigation method.
(Appendix 12)
The virtual information generation step generates a virtual image relating to the specific area based on the position of the terminal of the visitor specified by the map information management step.
The navigation method according to Appendix 11.
(Appendix 13)
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management process manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged direction mark.
The map information management step identifies the direction of the visitor's terminal, which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
The navigation method according to

Appendix

11 or 12.
(Appendix 14)
The virtual information generation step generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management step.
The navigation method according to Appendix 13.
(Appendix 15)
The position code also serves as the direction mark.
The navigation method according to

Appendix

13 or 14.
(Appendix 16)
When the floor of the specific area is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged floor.
The map information management step identifies the inclination of the visitor's terminal from the image of the floor.
The navigation method according to any one of Supplementary note 11 to 15.
(Appendix 17)
The image of the floor is an image including at least one of the position code and the direction mark.
The navigation method according to Appendix 16.
(Appendix 18)
In addition, it includes a specific area information acquisition process.
The specific area information acquisition process acquires information about the specific area and obtains information.
The virtual information generation step generates a virtual image related to the specific area based on the information about the specific area.
The navigation method according to any one of Supplementary note 11 to 17.
(Appendix 19)
In addition, it includes a visitor information acquisition process.
The visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The navigation method according to any one of Supplementary note 11 to 18.
(Appendix 20)
A program for causing a computer to perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, an image information output procedure, and a map information management procedure;
In the image pickup information acquisition procedure, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
In the image information output procedure, a composite image in which the virtual image is superimposed on the captured image is output.
The map information management procedure manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the image pickup information acquisition procedure acquires the image of the imaged position code.
The map information management procedure identifies the position of the visitor's terminal from the image of the position code based on the map information.
(Appendix 21)
The virtual information generation procedure generates a virtual image relating to the specific area based on the position of the visitor's terminal specified by the map information management procedure.
The program described in Appendix 20.
(Appendix 22)
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management procedure manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the imaged direction mark image is acquired by the image pickup information acquisition procedure.
The map information management procedure specifies the direction of the visitor's terminal, which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
The program described in Appendix 20 or 21.
(Appendix 23)
The virtual information generation procedure generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management procedure.
The program described in Appendix 22.
(Appendix 24)
The position code also serves as the direction mark.
The program described in Appendix 22 or 23.
(Appendix 25)
When the floor of the specific area is imaged by the terminal of the visitor, the image of the imaged floor is acquired by the image pickup information acquisition procedure.
The map information management procedure identifies the inclination of the visitor's terminal from the image of the floor.
The program described in any of the appendices 20 to 24.
(Appendix 26)
The image of the floor is an image including at least one of the position code and the direction mark.
The program described in Appendix 25.
(Appendix 27)
In addition, including the procedure for acquiring specific area information,
The specific area information acquisition procedure acquires information about the specific area and obtains information.
The virtual information generation procedure generates a virtual image related to the specific area based on the information about the specific area.
The program described in any of Appendix 20-26.
(Appendix 28)
In addition, including the procedure for acquiring visitor information,
The visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
The image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The program described in any of the appendices 20 to 27.
(Appendix 29)
A computer-readable recording medium recording the program according to any one of the appendices 20 to 28.

According to the present invention, it is possible to transmit information using AR in a large facility or the like of an exhibition hall, and it is possible to easily confirm the current position. Therefore, according to the present invention, it is useful in various fields to which AR technology can be applied.

1 Exhibition hall 2 Exhibition booth 3 Position code 4 Exhibition booth pin 5 Guidance virtual object 6 Visitors 10 Navigation device 11 Imaging information acquisition unit 12 Virtual information generation unit 13 Image information output unit 14 Map information management unit 15 Specific area information acquisition Part 16 Visitor information acquisition part 20 Terminal 30 Communication line network 101 Central arithmetic processing device 102 Memory 103 Bus 104 Storage device 105 Input device 106 Display device 107 Communication device

Claims

Includes image capture information acquisition unit, virtual information generation unit, image information output unit, and map information management unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The map information management unit manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the captured image of the position code is acquired by the image pickup information acquisition unit.
The map information management unit identifies the position of the visitor's terminal from the image of the position code based on the map information.
Navigation device.
The virtual information generation unit generates a virtual image regarding the specific area based on the position of the terminal of the visitor specified by the map information management unit.
The navigation device according to claim 1.
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management unit manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the captured image of the direction mark is acquired by the image pickup information acquisition unit.
The map information management unit identifies the direction of the visitor's terminal from the image of the direction mark based on the map information.
The navigation device according to claim 1 or 2.
The virtual information generation unit generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management unit.
The navigation device according to claim 3.
The position code also serves as the direction mark.
The navigation device according to claim 3 or 4.
When the floor of the specific area is imaged by the terminal of the visitor, the image of the imaged floor is acquired by the image pickup information acquisition unit.
The map information management unit identifies the inclination of the visitor's terminal from the image of the floor.
The navigation device according to any one of claims 1 to 5.
The image of the floor is an image including at least one of the position code and the direction mark.
The navigation device according to claim 6.
In addition, it includes a specific area information acquisition section.
The specific area information acquisition unit acquires information about the specific area and obtains information about the specific area.
The virtual information generation unit generates a virtual image related to the specific area based on the information about the specific area.
The navigation device according to any one of claims 1 to 7.
In addition, including the visitor information acquisition department,
The visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The navigation device according to any one of claims 1 to 8.
Including navigation devices and terminals
The navigation device is the navigation device according to any one of claims 1 to 9.
The terminal is a terminal of a visitor in the specific area.
The navigation device and the terminal can communicate with each other via a communication network.
Navigation system.
Includes imaging information acquisition process, virtual information generation process, image information output process, and map information management process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The map information management process manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged position code.
The map information management step identifies the position of the visitor's terminal from the image of the position code based on the map information.
Navigation method.
The virtual information generation step generates a virtual image relating to the specific area based on the position of the terminal of the visitor specified by the map information management step.
The navigation method according to claim 11.
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management process manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged direction mark.
The map information management step identifies the direction of the visitor's terminal, which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
The navigation method according to claim 11 or 12.
The virtual information generation step generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management step.
13. The navigation method according to claim 13.
The position code also serves as the direction mark.
The navigation method according to claim 13 or 14.
When the floor of the specific area is imaged by the terminal of the visitor, the image pickup information acquisition step acquires the image of the imaged floor.
The map information management step identifies the inclination of the visitor's terminal from the image of the floor.
The navigation method according to any one of claims 11 to 15.
The image of the floor is an image including at least one of the position code and the direction mark.
The navigation method according to claim 16.
In addition, it includes a specific area information acquisition process.
The specific area information acquisition process acquires information about the specific area and obtains information.
The virtual information generation step generates a virtual image related to the specific area based on the information about the specific area.
The navigation method according to any one of claims 11 to 17.
In addition, it includes a visitor information acquisition process.
The visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The navigation method according to any one of claims 11 to 18.
A program for causing a computer to perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, an image information output procedure, and a map information management procedure;
In the image pickup information acquisition procedure, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
In the image information output procedure, a composite image in which the virtual image is superimposed on the captured image is output.
The map information management procedure manages the position code arranged in the specific area and the map information of the specific area in association with each other.
When the position code is imaged by the terminal of the visitor, the image pickup information acquisition procedure acquires the image of the imaged position code.
The map information management procedure identifies the position of the visitor's terminal from the image of the position code based on the map information.
The virtual information generation procedure generates a virtual image relating to the specific area based on the position of the visitor's terminal specified by the map information management procedure.
The program according to claim 20.
In the specific area, a direction mark for specifying the orientation of the visitor's terminal is arranged.
The map information management procedure manages the direction mark and the map information of the specific area in association with each other.
When the direction mark is imaged by the terminal of the visitor, the imaged direction mark image is acquired by the image pickup information acquisition procedure.
The map information management procedure specifies the direction of the visitor's terminal, which direction the visitor's terminal is facing, from the image of the direction mark based on the map information.
The program according to claim 20 or 21.
The virtual information generation procedure generates a virtual image relating to the specific area based on the orientation of the visitor's terminal specified by the map information management procedure.
22. The program of claim 22.
The position code also serves as the direction mark.
The program according to claim 22 or 23.
When the floor of the specific area is imaged by the terminal of the visitor, the image of the imaged floor is acquired by the image pickup information acquisition procedure.
The map information management procedure identifies the inclination of the visitor's terminal from the image of the floor.
The program according to any one of claims 20 to 24.
The image of the floor is an image including at least one of the position code and the direction mark.
25. The program of claim 25.
In addition, including the procedure for acquiring specific area information,
The specific area information acquisition procedure acquires information about the specific area and obtains information.
The virtual information generation procedure generates a virtual image related to the specific area based on the information about the specific area.
The program according to any one of claims 20 to 26.
In addition, including the procedure for acquiring visitor information,
The visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
The image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The program according to any one of claims 20 to 27.
A computer-readable recording medium recording the program according to any one of claims 20 to 28.