WO2021256241A1

WO2021256241A1 - Guide device, guide system, guide method, program, and recording medium

Info

Publication number: WO2021256241A1
Application number: PCT/JP2021/020831
Authority: WO
Inventors: 浩平金澤; 陽平水谷; 雄也木元
Original assignee: Ｎｅｃソリューションイノベータ株式会社
Priority date: 2020-06-15
Filing date: 2021-06-01
Publication date: 2021-12-23
Also published as: JP7376191B2; JPWO2021256241A1

Abstract

Provided is a guide device that makes it possible to display information on a terminal screen of a visitor in an easy-to-understand way using AR and makes it easy to use an AR image.　In this guide device (10), a virtual information generation unit (12) generates virtual images relating to a specific area. The virtual images include a facility position image and detailed facility information image for the specific area. A map information management unit (13) associatively manages facility position information on a map of the specific area. An image information output unit (15) outputs a combined image in which the facility position image is superimposed within a captured image and the detailed facility information image is displayed in a window part. A terminal selection information acquisition unit (16) acquires selection information. The window part displays the detailed facility information image associated with a facility position image selected on the basis of the selection information. A terminal screen control unit (17) determines whether the selected facility position image is within a terminal screen and controls the display of a virtual position if the selected facility position image is not within the terminal screen.

Description

Guide device, guide system, guide method, program, and recording medium

The present invention relates to a navigation device, a navigation system, a navigation method, a program, and a recording medium.

In recent years, a technique for promoting a product or the like using AR (Augmented Reality) technology has been proposed (for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2018-147137

Recently, exhibitions have been held, and products are often advertised at the exhibition hall. For this reason, it is conceivable to promote products and the like using AR and to disseminate information at the exhibition hall. On the other hand, since the exhibition hall is large and there are many exhibition booths, when information using AR is displayed on the terminal (smartphone, tablet, etc.) of the visitor, a large number of AR images are displayed on the terminal screen and the orientation of the terminal. Depending on the situation, the AR image selected by the visitor may disappear from the terminal screen. When the selected AR image disappears from the screen, the visitor needs to change the direction of the terminal to find where the selected AR image went, and as a result, there is a problem that it is difficult to use the AR image. This problem is not limited to exhibition venues, but also affects large facilities such as event venues, department stores, schools such as universities, large hospitals, and shopping malls.

Therefore, according to the present invention, in a large facility or the like of an exhibition hall, a guide device capable of displaying information by AR on the screen of a user (visitor) terminal in an easy-to-understand manner and easily using an AR image and a guide device. The purpose is to provide a guide method.

In order to achieve the above object, the guide device of the present invention is used.
Includes an imaging information acquisition unit, a virtual information generation unit, a map information management unit, a visitor terminal information acquisition unit, an image information output unit, a terminal selection information acquisition unit, and a terminal screen control unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The map information management unit manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the captured image, the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays the facility detailed information image on the window unit. Is output to the visitor's terminal
The terminal selection information acquisition unit acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control unit determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. It is a device that controls to display the position.

The guide method of the present invention
Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, terminal selection information acquisition process, and terminal screen control process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
The map information management process manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the image information output step, in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
The terminal selection information acquisition step acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control step determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. It is a method of controlling to display the position.

According to the present invention, information by AR can be displayed on the terminal of a user (visitor) in an easy-to-understand manner, and the AR image can be easily used.

FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment, and FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment. FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus of the first embodiment. FIG. 3 is a flowchart showing an example of processing in the apparatus of the first embodiment. FIG. 4 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal. FIG. 5A is a schematic diagram showing an example in which the selected pin exists in the screen of the terminal 20, and FIG. 5B shows an example in which the selected pin does not exist in the image of the terminal 20. It is a schematic diagram. FIG. 6 (A) is a schematic diagram showing an example in which the selected pin exists in the screen of the terminal 20, and FIG. 6 (B) shows the selected pin after the state shown in FIG. 6 (A). Is a schematic diagram showing an example displayed in the screen of the terminal 20, and FIG. 6C is a schematic diagram showing an example in which the selected pin moves. FIG. 7 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal. FIG. 8 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal. FIG. 9 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal. FIG. 10 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal. FIG. 11 is a schematic diagram showing an example of the hierarchical structure of the facility detailed information image. FIG. 12 is a schematic diagram showing an example of a single swipe and a multi-swipe.

In the present invention, the "visitor" means a person who comes within a specific area, and is also referred to as a user. Visitors can also be rephrased as visitors, visitors, and the like.

An embodiment of the present invention will be described with reference to the drawings. The present invention is not limited to the following embodiments. In each of the following figures, the same parts are designated by the same reference numerals. Further, the explanations of the respective embodiments can be referred to each other unless otherwise specified, and the configurations of the respective embodiments can be combined unless otherwise specified.

[Embodiment 1]
FIG. 1A is a block diagram showing the configuration of an example of the guide device 10 of the present embodiment, and FIG. 1B is a schematic showing the configuration of an example of a navigation system including the guide device 10 of the present embodiment. It is a figure. As shown in FIG. 1A, the apparatus 10 has an imaging information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and terminal selection information. It includes an acquisition unit 16, a terminal screen control unit 17, a terminal screen operation information acquisition unit 18, a specific area information acquisition unit 19, and a visitor information acquisition unit 21. The terminal screen operation information acquisition unit 18, the specific area information acquisition unit 19, and the visitor information acquisition unit 21 have an arbitrary configuration and may not be included in the present device 10. The navigation system will be described later.

The device 10 may be, for example, one device including the above-mentioned parts, or may be a device in which the above-mentioned parts can be connected via the communication network 30. Further, the present device 10 can be connected to an external device described later via the communication line network 30. The communication network 30 is not particularly limited, and a known network can be used, and may be wired or wireless, for example. Examples of the communication line network 30 include an Internet line, WWW (World Wide Web), a telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Traveler Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark) and the like. The wireless communication may be either a form in which each device directly communicates (Ad Hoc communication) or an indirect communication via an access point. The apparatus 10 may be incorporated in the server as a system, for example. Further, the apparatus 10 is, for example, a personal computer (PC, for example, a desktop type, a notebook type), a terminal (for example, a smartphone, a mobile phone, a glasses type, a watch type, or the like) wearable terminal on which the program of the present invention is installed. ) Etc. may be used.

FIG. 2 illustrates a block diagram of the hardware configuration of the present device 10. The apparatus 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each part of the apparatus 10 is connected to each other via a bus 103 by each interface (I / F).

The central processing unit (also referred to as a central processing unit or a central processing unit) 101 is responsible for overall control of the device 10. In the present device 10, for example, the program of the present invention and other programs are executed by the central processing unit 101, and various information is read and written. Specifically, for example, the central arithmetic processing device 101 has an imaging information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and a terminal selection information acquisition. It functions as a unit 16, a terminal screen control unit 17, a terminal screen operation information acquisition unit 18, a specific area information acquisition unit 19, and a visitor information acquisition unit 21.

The bus 103 can also be connected to, for example, an external device. Examples of the external device include an external storage device (external database, etc.), a printer, and the like. The device 10 can be connected to an external network (communication network) by, for example, a communication device 107 connected to the bus 103, and can also be connected to another device via the external network.

The memory 102 may be, for example, a main memory (main storage device). When the central processing unit 101 performs processing, for example, the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 reads the memory. Receives data from 102 and executes the program. The main memory is, for example, a RAM (random access memory). Further, the memory 102 may be, for example, a ROM (read-only memory).

The storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (main storage device), for example. As described above, the storage device 104 stores an operation program including the program of the present invention. The storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium. The recording medium is not particularly limited, and may be an internal type or an external type, and examples thereof include HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, and memory card. Be done. The storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).

In the device 10, the memory 102 and the storage device 104 can also store user log information and information acquired from an external database (not shown).

The device 10 further includes, for example, an input device 105 and a display device 106. The input device 105 is, for example, a touch panel, a keyboard, a mouse, or the like. Examples of the display device 106 include an LED display, a liquid crystal display, and the like.

Next, an example of the guide method of the present embodiment will be described based on the flowchart of FIG. The guide method of the present embodiment is carried out as follows, for example, by using the guide device 10 of FIG. The guide method of the present embodiment is not limited to the use of the guide device 10 of FIG.

First, the image pickup information acquisition unit 11 acquires an image captured by a terminal of a visitor in a specific area (S1). The specific area is not particularly limited and may be indoors or outdoors. The indoors include, for example, exhibition halls, event halls, department stores, schools such as universities, and the like. The terminal of the visitor is not particularly limited, and is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type, and the like. The captured image may be, for example, a still image or a moving image. The acquisition is performed, for example, via the communication network 30.

Next, the virtual information generation unit 12 generates a virtual image related to the specific area (S2). In addition, the generated virtual image includes a virtual image for each facility in the specific area. The virtual image for each facility includes a position image of the facility and a detailed information image of the facility, and the position image of the facility and the detailed information image of the facility are associated with each other for each facility. Hereinafter, the location image of the facility is also referred to as a facility location image, and the detailed information image of the facility is also referred to as a facility detailed information image. The facility detailed information image is, for example, an image having a hierarchical structure of one layer or two or more layers. The position image is, for example, an image based on the facility position information. The detailed information image is, for example, an image based on the detailed information of the facility. One facility detailed information image may be associated with one facility position image, or two facility detailed information images may be associated with one. The facility position image and the facility detailed information image may be stored in the memory 102 or the storage device 104 in advance, or may be acquired from an external database via the communication network 30. Further, as will be described later, the facility position image and the facility detailed information image may be generated by the virtual information generation unit 12.

The facility is not particularly limited as long as it is installed in the specific area. Specifically, for example, there are exhibition booths, shops, tenants, classrooms, examination rooms, and the like.

Next, the map information management unit 13 manages the facility location information in association with the map of the specific area (S3). The facility location information is, for example, information indicating a location within the facility, and specifically, the location of an exhibition booth, a tenant, a classroom, or the like is indicated.

Next, the visitor terminal information acquisition unit 14 acquires the position information of the terminal and the orientation information of the terminal (S4). The position information and orientation information of the terminal are, for example, information in which the position and orientation (direction) of the terminal are specified by a position code or a direction mark arranged in the specific area. The position code may also serve as, for example, the direction mark. The position code and the direction mark include, for example, a QR code (registered trademark), an AR marker, a barcode, a chameleon code (registered trademark), and the like. Not limited to these, the position information of the terminal and the orientation information of the terminal may be information specified by using a known technique.

Next, the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image (S5). The output may be executed, for example, via the communication network 30. Further, the image information output unit 15 superimposes the facility position image on the position corresponding to the image of the facility in the captured image based on the acquired position information and orientation information, and provides a window unit. A composite image that displays the facility detailed information image on the window unit is output to the visitor's terminal (also referred to as a visitor's terminal). The window unit can display, for example, a plurality of the facility detailed information images on a transitionable screen. When the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers, the window unit can display, for example, the facility detailed information image on a screen in which an image for each layer can be transitioned.

Next, the terminal selection information acquisition unit 16 acquires selection information regarding the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities (S6). Based on the selection information, the facility detailed information image associated with the selected facility position image is displayed in the window unit.

Then, the terminal screen control unit 17 determines whether or not the selected facility position image exists in the screen of the terminal (S7), and if it does not exist (NO), the facility position image exists. Control to display the virtual position outside the screen of the terminal (S8), and end (END). On the other hand, when the selected facility position image exists in the screen of the terminal (YES), for example, the process of displaying the virtual position is not executed and the process ends as it is (END). The virtual position is displayed, for example, as an arrow. The virtual image is not limited to this, and may be displayed by using symbols, characters, or the like other than the arrows, for example. Specifically, it will be described in Embodiment 2 and FIG.

In the terminal screen control unit 17, for example, after the selected facility position image did not exist in the screen of the terminal (NO), the selected facility position image existed in the screen of the terminal. When (that is, the facility position image appears in the screen of the terminal), a sign indicating the existence of the facility position image may be displayed. The sign may be, for example, a moving image of the facility position image or the like. Specifically, it is described in Embodiment 2 and FIG.

Further, the map information management unit 13 may, for example, manage the position information of the terminal and the orientation information of the terminal on the map after the step (S5). In this case, the image information output unit 15 continues after the linking process, based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map, the window. It is possible to control the order of the screens to be displayed by transitioning in the section. The image information output unit 15 may specify the front direction of the visitor based on, for example, the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. In this case, the order may be, for example, the order of the facilities arranged in the left-right direction in the front direction. Specifically, it will be described in the third embodiment.

Further, the terminal screen operation information acquisition unit 18 may acquire operation information for the screen of the visitor's terminal after the step (S5), for example (S9). The operation information is, for example, information related to the operation of the visitor, specifically, a swipe operation on the screen (terminal screen) of the terminal, line-of-sight detection, blink detection, voice instruction, and the screen of the terminal. It may be a tap operation for, a combination of two or more of these, and the like. Then, the image information output unit 15 transitions the screen of the window unit according to the operation information. As shown in FIG. 3, the step (S9) may be processed in parallel with the step (S6) after the step (S5).

Further, the specific area information acquisition unit 19 may acquire detailed facility information regarding the facility in the specific area (S10). The step (S10) may be processed in parallel with the step (S1), for example, as shown in FIG. The acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105. The facility detailed information is, for example, information about an exhibition booth or the like, and more specifically, information such as a company name, company introduction information, products and services, and the like. Then, the virtual information generation unit 12 generates, for example, the facility detailed information image based on the facility detailed information. Further, the virtual information generation unit 12 may generate the facility position image based on the facility position information.

Further, the visitor information acquisition unit 21 may acquire information about the visitor (S101. The step (S11) is processed in parallel with the step (S1), for example, as shown in FIG. 3). The acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105. The information about the visitor may be, for example, a visitor. The attributes (gender, age, occupation) of the visitor, the purpose of the visit (inspection, business negotiations, etc.), the exhibition booth (area) of interest, etc. A composite image in which the virtual image is superimposed on the captured image is output. Specifically, for example, the virtual image includes recommendation information, schedule information, exhibition booth information, and the like. The recommendation information is, for example, the visit. Information recommended to the visitors based on the information about the person (for example, recommended event, recommended exhibition booth, etc.). Schedule information is, for example, information indicating the schedule of an event to be held in the specific area. Examples of the event include demonstrations, seminars, and the like. The event may be an event promoted by the organizer or an exhibitor. The exhibition booth information may be, for example, a company name. Company introduction information, information on products and services, etc.

[Embodiment 2]
An example in which the present invention is applied to an exhibition hall will be described with reference to FIGS. 4 to 6.

FIG. 4 shows an example in which a pin and a window portion are displayed on the screen of the terminal. As shown in FIG. 4, on the terminal 20 to which the composite image is output, the pin 4a indicating the position of the exhibition booth (the facility position information), which is the virtual image, on the captured image of the specific area captured by the terminal 20. A composite image in which ~ 4c (the facility position image) and the company name (the facility detailed information image, A Corp.) are superimposed is displayed. Specifically, the facility detailed information image is displayed in the window unit (Window). In the figure, the window portion is displayed at the lower part of the terminal 20, but is an example and is not limited thereto. The pin 4a is displayed larger than the

pins

4b and 4c, and the pin 4b is displayed larger than the pin 4c. In this way, the pin 4 is, for example, based on the position information of the terminal 20, the farther the position of the exhibition booth is from the position information of the terminal 20, the larger the size of the pin 4 is, the pin of another exhibition booth. It may be smaller than 4, and the closer the position of the exhibition booth is from the position information of the terminal 20, the larger the size of the pin 4 may be than the pin 4 of the other exhibition booth. On the other hand, the pin 4 may color the outer edge of the pin 4 according to the distance from the position information of the terminal 20 to the position of the exhibition booth, for example. Identification information may be assigned to each of the pins 4 by the virtual information generation unit 12. The identification information is, for example, a number, a character, a symbol, and a combination of two or more thereof. As a result, the present device 10 can generate a virtual image such as a pin 4 of the exhibition booth according to the position of the specified terminal 20, for example. Further, the pin 4a of the exhibition booth is in a state of being selected by the user (also referred to as a selected state). The terminal selection information acquisition unit 16 acquires, for example, selection information regarding the pin 4a of the exhibition booth in the selected state. The selection information regarding the pin 4a of the exhibition booth is, for example, the location information of the facility, the information in the facility detailed information image linked to the pin 4a of the exhibition booth, and the like.

FIG. 5A shows an example in which the selected pin exists in the screen of the terminal 20, and FIG. 5B shows an example in which the selected pin does not exist in the screen of the terminal 20. As shown in FIG. 5A, when the selected pin 4a is present in the screen of the terminal 20, the terminal screen control unit 17 is different from the unselected pins 4b and c with respect to the pin 4a, for example. It may be controlled so that it is displayed in color. On the other hand, as shown in FIG. 5B, when the selected pin 4a exists outside the screen of the terminal 20, the terminal screen control unit 17 presents the selected pin 4a, for example, by using an arrow. The virtual position outside the screen of the terminal, that is, the direction in which the selected pin 4a is displayed on the screen of the terminal 20 is shown.

FIG. 6A shows an example in which the selected pin exists in the screen of the terminal 20, and FIG. 6B shows the selected pin in the screen of the terminal 20 after the state shown in FIG. 6A. 6 (C) shows an example in which the selected pin moves. FIG. 6 (A) is the same as FIG. 5 (B). Then, after the state shown in FIG. 6A, the selected pin 4a is displayed in the screen of the terminal 20 as shown in FIG. 6B. At this time, the terminal screen control unit 17 displays a sign indicating that the pin 4a is present. The sign is, for example, as shown in FIG. 6C, an animation (moving image) in which the pin 4a moves back and forth or left and right and returns to the original position.

[Embodiment 3]
An example in which the pin and the window portion are displayed on the screen of the terminal will be described with reference to FIGS. 7 to 10. Hereinafter, the explanation will be made assuming an exhibition hall as a specific area, but as described above, the present invention is not limited to this.

The order of the screens to be transitioned and displayed in the window section will be explained. The upper part of FIG. 7 shows the front direction 2 of each facility (booth) in the specific area and the user 1 (terminal 20). The lower part of FIG. 7 shows an example of a group of terminals 20 and facility detailed information images. In FIG. 7, the facility detailed information image B is displayed on the terminal 20. First, the order of the screens to be transitioned and displayed in the window section is as follows: user 1 uses facility detailed information images A to C corresponding to exhibition booths (pin images) A to C, which are the group closest to the position of the terminal 20. The order of the facilities (booths) lined up in the left-right direction in the front direction 2 of. Next, following the facility detailed information images A to C, the exhibition booths (pin images) "near G1" and "near G2", which are the group "near G" that is the second closest to the position of the terminal 20, are supported. Detailed facility information image "Near G1" and "Near G2" are arranged in the order of facilities (booths) arranged in the left-right direction in the front direction 2 of the user 1. Further, the facility detailed information images "far G1" and "far G2" corresponding to the exhibition booths (pin images) "far G1" and "far G2", which are the group "far G" farthest from the position of the terminal 20. Is the order of the facilities (booths) lined up in the left-right direction in the front direction 2 of the user 1.

The order of the screens to be transitioned and displayed in the window section will be further described. When the user 1 is located at the position shown on the left side of FIG. 8 and the exhibition booths (pin images) B, A, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booths B and A are in the window portion. , C, the facility detailed information image is displayed in this order. Further, when the user 1 is located at the position shown on the lower side of FIG. 8 and the exhibition booths (pin images) A, B, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth is in the window portion. The facility detailed information image is displayed in the order of A, B, and C. Further, when the user 1 is located at the position shown on the right side of FIG. 8 and the exhibition booths (pin images) C, A, and B are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth C is in the window portion. , A, B, and the facility detailed information image is displayed in this order. In this way, the front-back and left-right directions of the exhibition booth change depending on the position and direction of the user 1 (terminal 20). In other words, the image information output unit 15 identifies the front direction 2 of the user 1 based on the position information of the terminal 20 and the orientation information of the terminal 20, and displays the facility details according to the front direction 2 of the specified user 1. The order of the information images changes. Further, as shown in FIG. 9, when there is an exhibition booth (pin) around the user 1 (360 degrees around the user), the facility is rotated according to the rotation of the user 1 (rotation to the right or rotation to the left). The order of (the above-mentioned facility detailed information image to be displayed) may change.

Further, as shown in FIG. 10, when the facility detailed information image is displayed in the window portion on the screen of the terminal 20, the pin image (facility position image) corresponding to the facility detailed information image is linked and selected. It may be in a state. The selected state is, for example, a state indicating that the user has selected a pin image. Specifically, in FIG. 10A, the pin image (A) is in the selected state, in FIG. 10B, the pin image (B) is in the selected state, and in FIG. 10C, the pin is in the selected state. An example is shown in which the image (C) is in the selected state.

Next, the hierarchical structure of the facility detailed information image will be described with reference to FIGS. 11 and 12.

FIG. 11 shows an example of the hierarchical structure of the facility detailed information image. As shown in FIG. 11, the facility detailed information image has facility detailed information images (a1) to (a3) in the lower layer of the facility detailed information image (a), and the facility is in the lower layer of the facility detailed information image (a3). There are detailed information images (a3-1) to (a3-3). The facility detailed information image (a) is an image based on the facility detailed information indicating the company name. The facility detailed information image (a1) is an image based on the facility detailed information showing the company introduction, and the facility detailed information image (a2) is an image based on the facility detailed information showing the greetings of the representative and the like, and the facility detailed information. The image (a3) is an image based on detailed facility information showing products, services, and the like. The facility detailed information images (a3-1) to (a3-3) are images based on the facility detailed information showing each of the product A, the product B, and the product C.

FIG. 12 shows an example of a single swipe and a multi-swipe. As shown in FIG. 12A, when the user swipes the screen of the terminal 20 from left to right (also referred to as a single swipe) with one finger, for example, the displayed facility detailed information image (a). The facility detailed information image (a1), which is the lower layer, is displayed on the terminal 20. The order of the facility detailed information images (a1) to (a2) is not particularly limited, and can be arbitrarily set by the exhibitor, for example. On the other hand, as shown in FIG. 12B, when the user swipes the screen of the terminal 20 from left to right (also referred to as multi-swipe) with two or more fingers, for example, the displayed facility detailed information is displayed. The other facility detailed information image (b) that is not the lower layer of the image (a) is displayed on the terminal 20. That is, the terminal 20 skips (does not display) the facility detailed information images (a1) to (a3) and the facility detailed information images (a3-1) to (a3-3), and displays the facility detailed information image (b). indicate. The direction of the swipe is an example and is not limited thereto. The swipe direction may be, for example, swiped from right to left, from top to bottom, from bottom to top, and the like.

[Embodiment 4]
FIG. 1B is a schematic diagram showing a configuration of an example of the navigation system of the present embodiment. As shown in FIG. 1 (B), the navigation system of the present embodiment includes the guide device 10 and the terminal 20 according to any one of the first to third embodiments. The terminal 20 is the terminal of a visitor in the specific area. The guide device 10 and the terminal 20 can communicate with each other via the communication network 30. The navigation system is also referred to as a navigation system device.

The navigation system of the present embodiment may further include the exhibitor's terminal, for example. The exhibitor's terminal is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type. The guide device 10 and the exhibitor's terminal can communicate with each other via, for example, a communication network 30.

[Embodiment 5]
The program of the present embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure. In the present invention, "procedure" may be read as "processing". Further, the program of the present embodiment may be recorded on a computer-readable recording medium, for example. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include a read-only memory (ROM), a hard disk (HD), and an optical disk.

Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

This application claims priority on the basis of Japanese application Japanese Patent Application No. 2020-102760 filed on June 15, 2020, and incorporates all of its disclosures herein.

<Additional Notes>
Some or all of the above embodiments may be described as, but not limited to, the following appendixes.
(Appendix 1)
Includes an imaging information acquisition unit, a virtual information generation unit, a map information management unit, a visitor terminal information acquisition unit, an image information output unit, a terminal selection information acquisition unit, and a terminal screen control unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The map information management unit manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the captured image, the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays the facility detailed information image on the window unit. Is output to the visitor's terminal
The terminal selection information acquisition unit acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control unit determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position,
Guide device.
(Appendix 2)
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
The guide device according to Appendix 1.
(Appendix 3)
The terminal screen control unit displays the facility position image when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal. The guide device according to

Appendix

1 or 2, which displays a sign indicating that it exists.
(Appendix 4)
The sign indicating the existence of the facility position image is a moving image of the facility position image.
The guide device according to Appendix 3.
(Appendix 5)
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management unit manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output unit can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The guide device according to any one of Supplementary Provisions 1 to 4.
(Appendix 6)
The image information output unit identifies the front direction of the exiter based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The guide device according to Appendix 5, wherein the order of the screens displayed by transitioning in the window unit in the image information output unit is the order of the facilities arranged in the left-right direction in the front direction.
(Appendix 7)
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The guide device according to Appendix 5 or 6, wherein the window unit can display the facility detailed information image on a screen in which an image for each layer can be changed.
(Appendix 8)
In addition, it includes a terminal screen operation information acquisition unit.
The terminal screen operation information acquisition unit acquires operation information for the screen of the visitor's terminal, and obtains operation information.
The guide device according to any one of Supplementary note 5 to 7, wherein the image information output unit transitions the screen of the window unit according to the operation information.
(Appendix 9)
In addition, it includes a specific area information acquisition section.
The specific area information acquisition unit acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The guide device according to any one of Supplementary Provisions 1 to 8.
(Appendix 10)
In addition, including the visitor information acquisition department,
The visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The guide device according to any one of Supplementary note 1 to 9.
(Appendix 11)
Including guide device and terminal
The guide device is the guide device according to any one of Supplementary note 1 to 10.
The terminal is the terminal of the visitor,
The guide device and the terminal can communicate with each other via a communication network.
Guide system.
(Appendix 12)
Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, terminal selection information acquisition process, and terminal screen control process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
The map information management process manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the image information output step, in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
The terminal selection information acquisition step acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control step determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position,
Guide method.
(Appendix 13)
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
The guide method described in Appendix 12.
(Appendix 14)
In the terminal screen control step, when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal, the facility position image is displayed. The guide method according to

Appendix

12 or 13, which displays a sign indicating the existence.
(Appendix 15)
The sign indicating the existence of the facility position image is a moving image of the facility position image.
The guide method described in Appendix 14.
(Appendix 16)
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management process manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output process can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The guide method according to any one of Supplementary Provisions 12 to 15.
(Appendix 17)
The image information output process identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The guide method according to Appendix 16, wherein the order of the screens transitioned and displayed in the window portion in the image information output step is the order of the facilities arranged in the left-right direction in the front direction.
(Appendix 18)
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The guide method according to

Appendix

16 or 17, wherein the window portion can display the facility detailed information image on a screen in which an image for each layer can be changed.
(Appendix 19)
In addition, it includes a terminal screen operation information acquisition process.
In the terminal screen operation information acquisition process, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
The guide method according to any one of Supplementary Provisions 16 to 18, wherein the image information output step is a transition of the screen of the window portion by the operation information.
(Appendix 20)
In addition, it includes a specific area information acquisition process.
The specific area information acquisition step acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The guide method according to any one of Supplementary Provisions 12 to 19.
(Appendix 21)
In addition, it includes a visitor information acquisition process.
The visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The guide method according to any one of Supplementary Provisions 12 to 20.
(Appendix 22)
To make a computer perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, a terminal selection information acquisition procedure, and a terminal screen control procedure. program;
In the image pickup information acquisition procedure, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
The map information management procedure manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition procedure acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
In the image information output procedure, a composite image in which the virtual image is superimposed on the captured image is output.
The virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
The image information output procedure is a composite image in which the facility position image is superimposed on a position corresponding to the image of the facility in the captured image, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
In the terminal selection information acquisition procedure, selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities is acquired.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control procedure determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position.
(Appendix 23)
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
The program described in Appendix 22.
(Appendix 24)
In the terminal screen control procedure, when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal, the facility position image is displayed. The program according to Appendix 22 or 23, which displays a sign indicating that it exists.
(Appendix 25)
The sign indicating the existence of the facility position image is a moving image of the facility position image.
The program described in Appendix 24.
(Appendix 26)
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management procedure manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output procedure can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The program according to any one of Supplementary Provisions 22 to 25.
(Appendix 27)
The image information output procedure identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The program according to Appendix 26, wherein the order of the screens transitioned and displayed in the window portion in the image information output procedure is the order of the facilities arranged in the left-right direction in the front direction.
(Appendix 28)
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The program according to Appendix 26 or 27, wherein the window unit can display the facility detailed information image on a screen in which images for each layer can be transitioned.
(Appendix 29)
In addition, including the terminal screen operation information acquisition procedure,
In the terminal screen operation information acquisition procedure, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
The program according to any one of Supplementary Provisions 26 to 28, wherein the image information output procedure changes the screen of the window unit according to the operation information.
(Appendix 30)
In addition, including the procedure for acquiring specific area information,
The specific area information acquisition procedure acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The program according to any one of Supplementary note 22 to 29.
(Appendix 31)
In addition, including the procedure for acquiring visitor information,
The visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
The image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The program according to any one of Supplementary note 22 to 30.
(Appendix 32)
A computer-readable recording medium recording the program according to any one of Supplementary note 22 to 31.

According to the present invention, it is possible to display information by AR on the terminal screen of a visitor in an easy-to-understand manner in a large facility or the like of an exhibition hall, and it is easy to use an AR image. Therefore, according to the present invention, it is useful in various fields to which AR technology can be applied.

10 Guide device 11 Imaging information acquisition unit 12 Virtual information generation unit 13 Map information management unit 14 Visitor terminal information acquisition unit 15 Image information output unit 16 Terminal selection information acquisition unit 17 Terminal screen control unit 18 Terminal screen operation information acquisition unit 19 Specific Area information acquisition unit 21 Visitor information acquisition unit 20 Visitor terminal 30 Communication network

Claims

Includes an imaging information acquisition unit, a virtual information generation unit, a map information management unit, a visitor terminal information acquisition unit, an image information output unit, a terminal selection information acquisition unit, and a terminal screen control unit.
The image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
The virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
The map information management unit manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
The virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the captured image, the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays the facility detailed information image on the window unit. Is output to the visitor's terminal
The terminal selection information acquisition unit acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control unit determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position,
Guide device.
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
The guide device according to claim 1.
The terminal screen control unit displays the facility position image when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal. The guide device according to claim 1 or 2, which displays a sign indicating that it exists.
The sign indicating the existence of the facility position image is a moving image of the facility position image.
The guide device according to claim 3.
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management unit manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output unit can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The guide device according to any one of claims 1 to 4.
The image information output unit identifies the front direction of the exiter based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The guide device according to claim 5, wherein the order of the screens displayed by transitioning in the window unit in the image information output unit is the order of the facilities arranged in the left-right direction in the front direction.
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The guide device according to claim 5 or 6, wherein the window unit can display the facility detailed information image on a screen capable of transitioning an image for each layer.
In addition, it includes a terminal screen operation information acquisition unit.
The terminal screen operation information acquisition unit acquires operation information for the screen of the visitor's terminal, and obtains operation information.
The guide device according to any one of claims 5 to 7, wherein the image information output unit transitions the screen of the window unit according to the operation information.
In addition, it includes a specific area information acquisition section.
The specific area information acquisition unit acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The guide device according to any one of claims 1 to 8.
In addition, including the visitor information acquisition department,
The visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
The image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The guide device according to any one of claims 1 to 9.
Including guide device and terminal
The guide device is the guide device according to any one of claims 1 to 10.
The terminal is the terminal of the visitor,
The guide device and the terminal can communicate with each other via a communication network.
Guide system.
Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, terminal selection information acquisition process, and terminal screen control process.
In the image pickup information acquisition step, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
The map information management process manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
In the image information output step, a composite image in which the virtual image is superimposed on the captured image is output.
The virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
In the image information output step, in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
The terminal selection information acquisition step acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control step determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position,
Guide method.
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
The guide method according to claim 12.
In the terminal screen control step, when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal, the facility position image is displayed. The guide method according to claim 12 or 13, which displays a sign indicating that it exists.
The sign indicating the existence of the facility position image is a moving image of the facility position image.
The guide method according to claim 14.
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management process manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output process can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The guide method according to any one of claims 12 to 15.
The image information output process identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The guide method according to claim 16, wherein the order of the screens transitioned and displayed in the window portion in the image information output step is the order of the facilities arranged in the left-right direction in the front direction.
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The guide method according to claim 16 or 17, wherein the window unit can display the facility detailed information image on a screen in which an image for each layer can be transitioned.
In addition, it includes a terminal screen operation information acquisition process.
In the terminal screen operation information acquisition process, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
The guide method according to any one of claims 16 to 18, wherein the image information output step changes the screen of the window portion by the operation information.
In addition, it includes a specific area information acquisition process.
The specific area information acquisition step acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The guide method according to any one of claims 12 to 19.
In addition, it includes a visitor information acquisition process.
The visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
The image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The guide method according to any one of claims 12 to 20.
To make a computer perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, a terminal selection information acquisition procedure, and a terminal screen control procedure. program;
In the image pickup information acquisition procedure, an image captured by a terminal of a visitor in a specific area is acquired.
The virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
The map information management procedure manages the facility location information in association with the map of the specific area.
The visitor terminal information acquisition procedure acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
In the image information output procedure, a composite image in which the virtual image is superimposed on the captured image is output.
The virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
The virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
The image information output procedure is a composite image in which the facility position image is superimposed on a position corresponding to the image of the facility in the captured image, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
In the terminal selection information acquisition procedure, selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities is acquired.
The window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
The terminal screen control procedure determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position.
The display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
22. The program of claim 22.
In the terminal screen control procedure, when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal, the facility position image is displayed. 22 or 23. The program of claim 22 or 23, which displays a sign indicating that it exists.
The sign indicating the existence of the facility position image is a moving image of the facility position image.
24. The program of claim 24.
The window unit can display a plurality of the facility detailed information images on a transitionable screen.
The map information management procedure manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
The image information output procedure can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map. The program according to any one of claims 22 to 25.
The image information output procedure identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
The program according to claim 26, wherein the order of the screens transitioned and displayed in the window portion in the image information output procedure is the order of the facilities arranged in the left-right direction in the front direction.
The facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
The program according to claim 26 or 27, wherein the window unit can display the facility detailed information image on a screen in which an image for each layer can be changed.
In addition, including the terminal screen operation information acquisition procedure,
In the terminal screen operation information acquisition procedure, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
The program according to any one of claims 26 to 28, wherein the image information output procedure changes the screen of the window unit according to the operation information.
In addition, including the procedure for acquiring specific area information,
The specific area information acquisition procedure acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
The virtual information generation means generates the facility detailed information image based on the facility detailed information.
The program according to any one of claims 22 to 29.
In addition, including the procedure for acquiring visitor information,
The visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor.
The image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
The program according to any one of claims 22 to 30.
A computer-readable recording medium on which the program according to any one of claims 22 to 31 is recorded.