WO2021256241A1 - ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 - Google Patents

ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Download PDF

Info

Publication number
WO2021256241A1
WO2021256241A1 PCT/JP2021/020831 JP2021020831W WO2021256241A1 WO 2021256241 A1 WO2021256241 A1 WO 2021256241A1 JP 2021020831 W JP2021020831 W JP 2021020831W WO 2021256241 A1 WO2021256241 A1 WO 2021256241A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
information
facility
terminal
visitor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/020831
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
浩平 金澤
陽平 水谷
雄也 木元
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Solution Innovators Ltd
Original Assignee
NEC Solution Innovators Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Solution Innovators Ltd filed Critical NEC Solution Innovators Ltd
Priority to JP2022532474A priority Critical patent/JP7376191B2/ja
Publication of WO2021256241A1 publication Critical patent/WO2021256241A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to a navigation device, a navigation system, a navigation method, a program, and a recording medium.
  • Patent Document 1 a technique for promoting a product or the like using AR (Augmented Reality) technology has been proposed (for example, Patent Document 1).
  • a guide device capable of displaying information by AR on the screen of a user (visitor) terminal in an easy-to-understand manner and easily using an AR image and a guide device.
  • the purpose is to provide a guide method.
  • the guide device of the present invention is used. Includes an imaging information acquisition unit, a virtual information generation unit, a map information management unit, a visitor terminal information acquisition unit, an image information output unit, a terminal selection information acquisition unit, and a terminal screen control unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays the facility detailed information image on the window unit. Is output to the visitor's terminal
  • the terminal selection information acquisition unit acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the terminal screen control unit determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. It is a device that controls to display the position.
  • the guide method of the present invention Includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, terminal selection information acquisition process, and terminal screen control process.
  • image pickup information acquisition step an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
  • the terminal selection information acquisition step acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the terminal screen control step determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. It is a method of controlling to display the position.
  • information by AR can be displayed on the terminal of a user (visitor) in an easy-to-understand manner, and the AR image can be easily used.
  • FIG. 1A is a block diagram showing a configuration of an example of the apparatus of the first embodiment
  • FIG. 1B is a schematic diagram showing a configuration of an example of the system of the fourth embodiment
  • FIG. 2 is a block diagram showing an example of the hardware configuration of the apparatus of the first embodiment.
  • FIG. 3 is a flowchart showing an example of processing in the apparatus of the first embodiment.
  • FIG. 4 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 5A is a schematic diagram showing an example in which the selected pin exists in the screen of the terminal 20, and FIG. 5B shows an example in which the selected pin does not exist in the image of the terminal 20. It is a schematic diagram.
  • FIG. 5A is a schematic diagram showing an example in which the selected pin exists in the screen of the terminal 20
  • FIG. 5B shows an example in which the selected pin does not exist in the image of the terminal 20. It is a schematic diagram.
  • FIG. 5A is
  • FIG. 6 (A) is a schematic diagram showing an example in which the selected pin exists in the screen of the terminal 20, and FIG. 6 (B) shows the selected pin after the state shown in FIG. 6 (A).
  • FIG. 6C is a schematic diagram showing an example in which the selected pin moves.
  • FIG. 7 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 8 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 9 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 10 is a schematic diagram showing an example in which a pin and a window portion are displayed on the screen of the terminal.
  • FIG. 11 is a schematic diagram showing an example of the hierarchical structure of the facility detailed information image.
  • FIG. 12 is a schematic diagram showing an example of a single swipe and a multi-swipe.
  • the "visitor” means a person who comes within a specific area, and is also referred to as a user. Visitors can also be rephrased as visitors, visitors, and the like.
  • FIG. 1A is a block diagram showing the configuration of an example of the guide device 10 of the present embodiment
  • FIG. 1B is a schematic showing the configuration of an example of a navigation system including the guide device 10 of the present embodiment. It is a figure.
  • the apparatus 10 has an imaging information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and terminal selection information. It includes an acquisition unit 16, a terminal screen control unit 17, a terminal screen operation information acquisition unit 18, a specific area information acquisition unit 19, and a visitor information acquisition unit 21.
  • the terminal screen operation information acquisition unit 18, the specific area information acquisition unit 19, and the visitor information acquisition unit 21 have an arbitrary configuration and may not be included in the present device 10. The navigation system will be described later.
  • the device 10 may be, for example, one device including the above-mentioned parts, or may be a device in which the above-mentioned parts can be connected via the communication network 30. Further, the present device 10 can be connected to an external device described later via the communication line network 30.
  • the communication network 30 is not particularly limited, and a known network can be used, and may be wired or wireless, for example. Examples of the communication line network 30 include an Internet line, WWW (World Wide Web), a telephone line, LAN (Local Area Network), SAN (Storage Area Network), DTN (Delay Traveler Network), and the like. Examples of wireless communication include WiFi (Wireless Fidelity), Bluetooth (registered trademark) and the like.
  • the wireless communication may be either a form in which each device directly communicates (Ad Hoc communication) or an indirect communication via an access point.
  • the apparatus 10 may be incorporated in the server as a system, for example. Further, the apparatus 10 is, for example, a personal computer (PC, for example, a desktop type, a notebook type), a terminal (for example, a smartphone, a mobile phone, a glasses type, a watch type, or the like) wearable terminal on which the program of the present invention is installed. ) Etc. may be used.
  • FIG. 2 illustrates a block diagram of the hardware configuration of the present device 10.
  • the apparatus 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, a display device 106, a communication device 107, and the like. Each part of the apparatus 10 is connected to each other via a bus 103 by each interface (I / F).
  • I / F interface
  • the central processing unit (also referred to as a central processing unit or a central processing unit) 101 is responsible for overall control of the device 10.
  • the program of the present invention and other programs are executed by the central processing unit 101, and various information is read and written.
  • the central arithmetic processing device 101 has an imaging information acquisition unit 11, a virtual information generation unit 12, a map information management unit 13, a visitor terminal information acquisition unit 14, an image information output unit 15, and a terminal selection information acquisition. It functions as a unit 16, a terminal screen control unit 17, a terminal screen operation information acquisition unit 18, a specific area information acquisition unit 19, and a visitor information acquisition unit 21.
  • the bus 103 can also be connected to, for example, an external device.
  • the external device include an external storage device (external database, etc.), a printer, and the like.
  • the device 10 can be connected to an external network (communication network) by, for example, a communication device 107 connected to the bus 103, and can also be connected to another device via the external network.
  • the memory 102 may be, for example, a main memory (main storage device).
  • main memory main storage device
  • the memory 102 reads various operation programs such as the program of the present invention stored in the storage device 104 described later, and the central processing unit 101 reads the memory. Receives data from 102 and executes the program.
  • the main memory is, for example, a RAM (random access memory).
  • the memory 102 may be, for example, a ROM (read-only memory).
  • the storage device 104 is also referred to as a so-called auxiliary storage device with respect to the main memory (main storage device), for example.
  • the storage device 104 stores an operation program including the program of the present invention.
  • the storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing to the recording medium.
  • the recording medium is not particularly limited, and may be an internal type or an external type, and examples thereof include HD (hard disk), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, and memory card. Be done.
  • the storage device 104 may be, for example, a hard disk drive (HDD) in which a recording medium and a drive are integrated, and a solid state drive (SSD).
  • HDD hard disk drive
  • SSD solid state drive
  • the memory 102 and the storage device 104 can also store user log information and information acquired from an external database (not shown).
  • the device 10 further includes, for example, an input device 105 and a display device 106.
  • the input device 105 is, for example, a touch panel, a keyboard, a mouse, or the like.
  • Examples of the display device 106 include an LED display, a liquid crystal display, and the like.
  • the guide method of the present embodiment is carried out as follows, for example, by using the guide device 10 of FIG.
  • the guide method of the present embodiment is not limited to the use of the guide device 10 of FIG.
  • the image pickup information acquisition unit 11 acquires an image captured by a terminal of a visitor in a specific area (S1).
  • the specific area is not particularly limited and may be indoors or outdoors.
  • the indoors include, for example, exhibition halls, event halls, department stores, schools such as universities, and the like.
  • the terminal of the visitor is not particularly limited, and is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type, and the like.
  • the captured image may be, for example, a still image or a moving image.
  • the acquisition is performed, for example, via the communication network 30.
  • the virtual information generation unit 12 generates a virtual image related to the specific area (S2).
  • the generated virtual image includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a position image of the facility and a detailed information image of the facility, and the position image of the facility and the detailed information image of the facility are associated with each other for each facility.
  • the location image of the facility is also referred to as a facility location image
  • the detailed information image of the facility is also referred to as a facility detailed information image.
  • the facility detailed information image is, for example, an image having a hierarchical structure of one layer or two or more layers.
  • the position image is, for example, an image based on the facility position information.
  • the detailed information image is, for example, an image based on the detailed information of the facility.
  • One facility detailed information image may be associated with one facility position image, or two facility detailed information images may be associated with one.
  • the facility position image and the facility detailed information image may be stored in the memory 102 or the storage device 104 in advance, or may be acquired from an external database via the communication network 30. Further, as will be described later, the facility position image and the facility detailed information image may be generated by the virtual information generation unit 12.
  • the facility is not particularly limited as long as it is installed in the specific area. Specifically, for example, there are exhibition booths, shops, tenants, classrooms, examination rooms, and the like.
  • the map information management unit 13 manages the facility location information in association with the map of the specific area (S3).
  • the facility location information is, for example, information indicating a location within the facility, and specifically, the location of an exhibition booth, a tenant, a classroom, or the like is indicated.
  • the visitor terminal information acquisition unit 14 acquires the position information of the terminal and the orientation information of the terminal (S4).
  • the position information and orientation information of the terminal are, for example, information in which the position and orientation (direction) of the terminal are specified by a position code or a direction mark arranged in the specific area.
  • the position code may also serve as, for example, the direction mark.
  • the position code and the direction mark include, for example, a QR code (registered trademark), an AR marker, a barcode, a chameleon code (registered trademark), and the like.
  • the position information of the terminal and the orientation information of the terminal may be information specified by using a known technique.
  • the image information output unit 15 outputs a composite image in which the virtual image is superimposed on the captured image (S5).
  • the output may be executed, for example, via the communication network 30.
  • the image information output unit 15 superimposes the facility position image on the position corresponding to the image of the facility in the captured image based on the acquired position information and orientation information, and provides a window unit.
  • a composite image that displays the facility detailed information image on the window unit is output to the visitor's terminal (also referred to as a visitor's terminal).
  • the window unit can display, for example, a plurality of the facility detailed information images on a transitionable screen.
  • the window unit can display, for example, the facility detailed information image on a screen in which an image for each layer can be transitioned.
  • the terminal selection information acquisition unit 16 acquires selection information regarding the facility position image selected from the plurality of facility position images corresponding to the plurality of facilities (S6). Based on the selection information, the facility detailed information image associated with the selected facility position image is displayed in the window unit.
  • the terminal screen control unit 17 determines whether or not the selected facility position image exists in the screen of the terminal (S7), and if it does not exist (NO), the facility position image exists. Control to display the virtual position outside the screen of the terminal (S8), and end (END). On the other hand, when the selected facility position image exists in the screen of the terminal (YES), for example, the process of displaying the virtual position is not executed and the process ends as it is (END).
  • the virtual position is displayed, for example, as an arrow.
  • the virtual image is not limited to this, and may be displayed by using symbols, characters, or the like other than the arrows, for example. Specifically, it will be described in Embodiment 2 and FIG.
  • the selected facility position image existed in the screen of the terminal.
  • a sign indicating the existence of the facility position image may be displayed.
  • the sign may be, for example, a moving image of the facility position image or the like. Specifically, it is described in Embodiment 2 and FIG.
  • the map information management unit 13 may, for example, manage the position information of the terminal and the orientation information of the terminal on the map after the step (S5).
  • the image information output unit 15 continues after the linking process, based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map, the window. It is possible to control the order of the screens to be displayed by transitioning in the section.
  • the image information output unit 15 may specify the front direction of the visitor based on, for example, the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the order may be, for example, the order of the facilities arranged in the left-right direction in the front direction. Specifically, it will be described in the third embodiment.
  • the terminal screen operation information acquisition unit 18 may acquire operation information for the screen of the visitor's terminal after the step (S5), for example (S9).
  • the operation information is, for example, information related to the operation of the visitor, specifically, a swipe operation on the screen (terminal screen) of the terminal, line-of-sight detection, blink detection, voice instruction, and the screen of the terminal. It may be a tap operation for, a combination of two or more of these, and the like.
  • the image information output unit 15 transitions the screen of the window unit according to the operation information.
  • the step (S9) may be processed in parallel with the step (S6) after the step (S5).
  • the specific area information acquisition unit 19 may acquire detailed facility information regarding the facility in the specific area (S10).
  • the step (S10) may be processed in parallel with the step (S1), for example, as shown in FIG.
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the facility detailed information is, for example, information about an exhibition booth or the like, and more specifically, information such as a company name, company introduction information, products and services, and the like.
  • the virtual information generation unit 12 generates, for example, the facility detailed information image based on the facility detailed information. Further, the virtual information generation unit 12 may generate the facility position image based on the facility position information.
  • the visitor information acquisition unit 21 may acquire information about the visitor (S101.
  • the step (S11) is processed in parallel with the step (S1), for example, as shown in FIG. 3).
  • the acquisition may be executed, for example, via the communication network 30, or may be executed by input by the input device 105.
  • the information about the visitor may be, for example, a visitor.
  • a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image includes recommendation information, schedule information, exhibition booth information, and the like.
  • the recommendation information is, for example, the visit.
  • Schedule information is, for example, information indicating the schedule of an event to be held in the specific area. Examples of the event include demonstrations, seminars, and the like.
  • the event may be an event promoted by the organizer or an exhibitor.
  • the exhibition booth information may be, for example, a company name. Company introduction information, information on products and services, etc.
  • FIG. 4 shows an example in which a pin and a window portion are displayed on the screen of the terminal.
  • the pin 4a indicating the position of the exhibition booth (the facility position information), which is the virtual image, on the captured image of the specific area captured by the terminal 20.
  • a composite image in which ⁇ 4c (the facility position image) and the company name (the facility detailed information image, A Corp.) are superimposed is displayed.
  • the facility detailed information image is displayed in the window unit (Window).
  • the window portion is displayed at the lower part of the terminal 20, but is an example and is not limited thereto.
  • the pin 4a is displayed larger than the pins 4b and 4c, and the pin 4b is displayed larger than the pin 4c.
  • the pin 4 is, for example, based on the position information of the terminal 20, the farther the position of the exhibition booth is from the position information of the terminal 20, the larger the size of the pin 4 is, the pin of another exhibition booth. It may be smaller than 4, and the closer the position of the exhibition booth is from the position information of the terminal 20, the larger the size of the pin 4 may be than the pin 4 of the other exhibition booth.
  • the pin 4 may color the outer edge of the pin 4 according to the distance from the position information of the terminal 20 to the position of the exhibition booth, for example. Identification information may be assigned to each of the pins 4 by the virtual information generation unit 12.
  • the identification information is, for example, a number, a character, a symbol, and a combination of two or more thereof.
  • the present device 10 can generate a virtual image such as a pin 4 of the exhibition booth according to the position of the specified terminal 20, for example.
  • the pin 4a of the exhibition booth is in a state of being selected by the user (also referred to as a selected state).
  • the terminal selection information acquisition unit 16 acquires, for example, selection information regarding the pin 4a of the exhibition booth in the selected state.
  • the selection information regarding the pin 4a of the exhibition booth is, for example, the location information of the facility, the information in the facility detailed information image linked to the pin 4a of the exhibition booth, and the like.
  • FIG. 5A shows an example in which the selected pin exists in the screen of the terminal 20
  • FIG. 5B shows an example in which the selected pin does not exist in the screen of the terminal 20.
  • the terminal screen control unit 17 is different from the unselected pins 4b and c with respect to the pin 4a, for example. It may be controlled so that it is displayed in color.
  • the terminal screen control unit 17 presents the selected pin 4a, for example, by using an arrow.
  • the virtual position outside the screen of the terminal that is, the direction in which the selected pin 4a is displayed on the screen of the terminal 20 is shown.
  • FIG. 6A shows an example in which the selected pin exists in the screen of the terminal 20
  • FIG. 6B shows the selected pin in the screen of the terminal 20 after the state shown in FIG. 6A
  • 6 (C) shows an example in which the selected pin moves.
  • FIG. 6 (A) is the same as FIG. 5 (B).
  • the selected pin 4a is displayed in the screen of the terminal 20 as shown in FIG. 6B.
  • the terminal screen control unit 17 displays a sign indicating that the pin 4a is present.
  • the sign is, for example, as shown in FIG. 6C, an animation (moving image) in which the pin 4a moves back and forth or left and right and returns to the original position.
  • the order of the screens to be transitioned and displayed in the window section will be explained.
  • the upper part of FIG. 7 shows the front direction 2 of each facility (booth) in the specific area and the user 1 (terminal 20).
  • the lower part of FIG. 7 shows an example of a group of terminals 20 and facility detailed information images.
  • the facility detailed information image B is displayed on the terminal 20.
  • the order of the screens to be transitioned and displayed in the window section is as follows: user 1 uses facility detailed information images A to C corresponding to exhibition booths (pin images) A to C, which are the group closest to the position of the terminal 20.
  • the exhibition booths (pin images) "near G1" and “near G2”, which are the group “near G” that is the second closest to the position of the terminal 20, are supported.
  • Detailed facility information image “Near G1” and “Near G2” are arranged in the order of facilities (booths) arranged in the left-right direction in the front direction 2 of the user 1.
  • the order of the screens to be transitioned and displayed in the window section will be further described.
  • the exhibition booths (pin images) B, A, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booths B and A are in the window portion.
  • the facility detailed information image is displayed in this order.
  • the exhibition booths (pin images) A, B, and C are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth is in the window portion.
  • the facility detailed information image is displayed in the order of A, B, and C.
  • the exhibition booths (pin images) C, A, and B are arranged in order from the left when viewed from the front direction 2 of the user 1, the exhibition booth C is in the window portion. , A, B, and the facility detailed information image is displayed in this order.
  • the front-back and left-right directions of the exhibition booth change depending on the position and direction of the user 1 (terminal 20).
  • the image information output unit 15 identifies the front direction 2 of the user 1 based on the position information of the terminal 20 and the orientation information of the terminal 20, and displays the facility details according to the front direction 2 of the specified user 1.
  • the order of the information images changes. Further, as shown in FIG.
  • the pin image (facility position image) corresponding to the facility detailed information image is linked and selected. It may be in a state.
  • the selected state is, for example, a state indicating that the user has selected a pin image.
  • FIG. 10A the pin image (A) is in the selected state
  • FIG. 10B the pin image (B) is in the selected state
  • FIG. 10C the pin is in the selected state.
  • An example is shown in which the image (C) is in the selected state.
  • FIG. 11 shows an example of the hierarchical structure of the facility detailed information image.
  • the facility detailed information image has facility detailed information images (a1) to (a3) in the lower layer of the facility detailed information image (a), and the facility is in the lower layer of the facility detailed information image (a3).
  • the facility detailed information image (a) is an image based on the facility detailed information indicating the company name.
  • the facility detailed information image (a1) is an image based on the facility detailed information showing the company introduction
  • the facility detailed information image (a2) is an image based on the facility detailed information showing the greetings of the representative and the like, and the facility detailed information.
  • the image (a3) is an image based on detailed facility information showing products, services, and the like.
  • the facility detailed information images (a3-1) to (a3-3) are images based on the facility detailed information showing each of the product A, the product B, and the product C.
  • FIG. 12 shows an example of a single swipe and a multi-swipe.
  • FIG. 12A when the user swipes the screen of the terminal 20 from left to right (also referred to as a single swipe) with one finger, for example, the displayed facility detailed information image (a).
  • the facility detailed information image (a1) which is the lower layer, is displayed on the terminal 20.
  • the order of the facility detailed information images (a1) to (a2) is not particularly limited, and can be arbitrarily set by the exhibitor, for example.
  • FIG. 12B when the user swipes the screen of the terminal 20 from left to right (also referred to as multi-swipe) with two or more fingers, for example, the displayed facility detailed information is displayed.
  • the other facility detailed information image (b) that is not the lower layer of the image (a) is displayed on the terminal 20. That is, the terminal 20 skips (does not display) the facility detailed information images (a1) to (a3) and the facility detailed information images (a3-1) to (a3-3), and displays the facility detailed information image (b). indicate.
  • the direction of the swipe is an example and is not limited thereto. The swipe direction may be, for example, swiped from right to left, from top to bottom, from bottom to top, and the like.
  • FIG. 1B is a schematic diagram showing a configuration of an example of the navigation system of the present embodiment.
  • the navigation system of the present embodiment includes the guide device 10 and the terminal 20 according to any one of the first to third embodiments.
  • the terminal 20 is the terminal of a visitor in the specific area.
  • the guide device 10 and the terminal 20 can communicate with each other via the communication network 30.
  • the navigation system is also referred to as a navigation system device.
  • the navigation system of the present embodiment may further include the exhibitor's terminal, for example.
  • the exhibitor's terminal is, for example, a personal computer, a smartphone, a mobile phone, a wearable terminal such as a glasses type and a wristwatch type.
  • the guide device 10 and the exhibitor's terminal can communicate with each other via, for example, a communication network 30.
  • the program of the present embodiment is a program for causing a computer to execute each step of the method of the present invention as a procedure.
  • "procedure” may be read as "processing”.
  • the program of the present embodiment may be recorded on a computer-readable recording medium, for example.
  • the recording medium is, for example, a non-transitory computer-readable storage medium.
  • the recording medium is not particularly limited, and examples thereof include a read-only memory (ROM), a hard disk (HD), and an optical disk.
  • Appendix 1 Includes an imaging information acquisition unit, a virtual information generation unit, a map information management unit, a visitor terminal information acquisition unit, an image information output unit, a terminal selection information acquisition unit, and a terminal screen control unit.
  • the image pickup information acquisition unit acquires an image captured by a terminal of a visitor in a specific area, and obtains an image captured.
  • the virtual information generation unit generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management unit manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition unit acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image.
  • the virtual image generated by the virtual information generation unit includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output unit superimposes the facility position image on a position corresponding to the image of the facility, provides a window unit, and displays the facility detailed information image on the window unit.
  • the terminal selection information acquisition unit acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the terminal screen control unit determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position, Guide device. (Appendix 2)
  • the display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
  • the guide device according to Appendix 1.
  • the terminal screen control unit displays the facility position image when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal.
  • the sign indicating the existence of the facility position image is a moving image of the facility position image.
  • the guide device according to Appendix 3. (Appendix 5)
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management unit manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
  • the image information output unit can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide device according to any one of Supplementary Provisions 1 to 4.
  • the image information output unit identifies the front direction of the exiter based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide device according to Appendix 5, wherein the order of the screens displayed by transitioning in the window unit in the image information output unit is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • the guide device can display the facility detailed information image on a screen in which an image for each layer can be changed.
  • Appendix 8 includes a terminal screen operation information acquisition unit.
  • the terminal screen operation information acquisition unit acquires operation information for the screen of the visitor's terminal, and obtains operation information.
  • the guide device according to any one of Supplementary note 5 to 7, wherein the image information output unit transitions the screen of the window unit according to the operation information.
  • Appendix 9 In addition, it includes a specific area information acquisition section.
  • the specific area information acquisition unit acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the virtual information generation means generates the facility detailed information image based on the facility detailed information.
  • the guide device according to any one of Supplementary Provisions 1 to 8.
  • the visitor information acquisition unit acquires information about the visitor and obtains information about the visitor.
  • the image information output unit outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide device according to any one of Supplementary note 1 to 9.
  • (Appendix 11) Including guide device and terminal The guide device is the guide device according to any one of Supplementary note 1 to 10.
  • the terminal is the terminal of the visitor, The guide device and the terminal can communicate with each other via a communication network. Guide system.
  • Imaging information acquisition process includes imaging information acquisition process, virtual information generation process, map information management process, visitor terminal information acquisition process, image information output process, terminal selection information acquisition process, and terminal screen control process.
  • image pickup information acquisition step an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation step generates a virtual image relating to the specific area, and generates a virtual image.
  • the map information management process manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition step acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • image information output step a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation step includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output step in the captured image, the facility position image is superimposed on the position corresponding to the image of the facility, a window portion is provided, and the facility detailed information image is displayed on the window portion. Is output to the visitor's terminal
  • the terminal selection information acquisition step acquires selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the terminal screen control step determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position, Guide method.
  • the display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
  • Appendix 14 In the terminal screen control step, when the selected facility position image is present in the screen of the terminal after the selected facility position image is not present in the screen of the terminal, the facility position image is displayed.
  • the sign indicating the existence of the facility position image is a moving image of the facility position image.
  • the guide method described in Appendix 14. (Appendix 16)
  • the window unit can display a plurality of the facility detailed information images on a transitionable screen.
  • the map information management process manages the position information of the visitor's terminal and the orientation information of the visitor's terminal on the map.
  • the image information output process can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide method according to any one of Supplementary Provisions 12 to 15.
  • the image information output process identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the guide method according to Appendix 16 wherein the order of the screens transitioned and displayed in the window portion in the image information output step is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • the guide method according to Appendix 16 or 17, wherein the window portion can display the facility detailed information image on a screen in which an image for each layer can be changed.
  • it includes a terminal screen operation information acquisition process.
  • the terminal screen operation information acquisition process operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
  • Appendix 20 includes a specific area information acquisition process.
  • the specific area information acquisition step acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the virtual information generation means generates the facility detailed information image based on the facility detailed information.
  • it includes a visitor information acquisition process The visitor information acquisition process acquires information about the visitor and obtains information about the visitor.
  • the image information output step outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the guide method according to any one of Supplementary Provisions 12 to 20.
  • Appendix 22 To make a computer perform a procedure including an imaging information acquisition procedure, a virtual information generation procedure, a map information management procedure, a visitor terminal information acquisition procedure, an image information output procedure, a terminal selection information acquisition procedure, and a terminal screen control procedure. program;
  • the image pickup information acquisition procedure an image captured by a terminal of a visitor in a specific area is acquired.
  • the virtual information generation procedure generates a virtual image relating to the specific area and generates a virtual image.
  • the map information management procedure manages the facility location information in association with the map of the specific area.
  • the visitor terminal information acquisition procedure acquires the position information of the visitor's terminal and the orientation information of the visitor's terminal.
  • a composite image in which the virtual image is superimposed on the captured image is output.
  • the virtual image generated in the virtual information generation procedure includes a virtual image for each facility in the specific area.
  • the virtual image for each facility includes a facility position image and a facility detailed information image, and the facility position image and the facility detailed information image are associated with each other for each facility.
  • the image information output procedure is a composite image in which the facility position image is superimposed on a position corresponding to the image of the facility in the captured image, a window portion is provided, and the facility detailed information image is displayed on the window portion.
  • the terminal selection information acquisition procedure selection information regarding the facility position image selected from a plurality of the facility position images corresponding to the plurality of the facilities is acquired.
  • the window unit displays the facility detailed information image associated with the selected facility position image based on the selection information.
  • the terminal screen control procedure determines whether or not the selected facility position image exists in the screen of the terminal, and if not, a virtual outside the screen of the terminal in which the facility position image exists. Control to display the position. (Appendix 23)
  • the display displaying the virtual position outside the screen of the terminal in which the facility position image is present is an arrow indicating the virtual position.
  • the image information output procedure can control the order of screens to be transitioned and displayed in the window unit based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the program according to any one of Supplementary Provisions 22 to 25. (Appendix 27)
  • the image information output procedure identifies the front direction of the visitor based on the position information of the visitor's terminal and the orientation information of the visitor's terminal managed on the map.
  • the program according to Appendix 26, wherein the order of the screens transitioned and displayed in the window portion in the image information output procedure is the order of the facilities arranged in the left-right direction in the front direction.
  • the facility detailed information image is an image having a hierarchical structure of one layer or two or more layers.
  • Appendix 29 In addition, including the terminal screen operation information acquisition procedure, In the terminal screen operation information acquisition procedure, operation information for the terminal screen of the visitor is acquired, and the operation information is acquired.
  • Appendix 30 In addition, including the procedure for acquiring specific area information, The specific area information acquisition procedure acquires facility detailed information regarding the facility in the specific area, and obtains the facility detailed information.
  • the virtual information generation means generates the facility detailed information image based on the facility detailed information.
  • the program according to any one of Supplementary note 22 to 29. (Appendix 31) In addition, including the procedure for acquiring visitor information, The visitor information acquisition procedure acquires information about the visitor and obtains information about the visitor. The image information output procedure outputs a composite image in which the virtual image is superimposed on the captured image according to the information about the visitor.
  • the program according to any one of Supplementary note 22 to 30. (Appendix 32) A computer-readable recording medium recording the program according to any one of Supplementary note 22 to 31.
  • the present invention it is possible to display information by AR on the terminal screen of a visitor in an easy-to-understand manner in a large facility or the like of an exhibition hall, and it is easy to use an AR image. Therefore, according to the present invention, it is useful in various fields to which AR technology can be applied.

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Navigation (AREA)
PCT/JP2021/020831 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体 Ceased WO2021256241A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022532474A JP7376191B2 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-102760 2020-06-15
JP2020102760 2020-06-15

Publications (1)

Publication Number Publication Date
WO2021256241A1 true WO2021256241A1 (ja) 2021-12-23

Family

ID=79267911

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/020831 Ceased WO2021256241A1 (ja) 2020-06-15 2021-06-01 ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体

Country Status (2)

Country Link
JP (1) JP7376191B2 (https=)
WO (1) WO2021256241A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023223750A1 (https=) * 2022-05-18 2023-11-23

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012086052A1 (ja) * 2010-12-24 2012-06-28 パイオニア株式会社 画像制御装置、制御方法、プログラム、及び記憶媒体
JP2012242202A (ja) * 2011-05-18 2012-12-10 Alpine Electronics Inc 車載システム
WO2016017253A1 (ja) * 2014-08-01 2016-02-04 ソニー株式会社 情報処理装置、および情報処理方法、並びにプログラム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012086052A1 (ja) * 2010-12-24 2012-06-28 パイオニア株式会社 画像制御装置、制御方法、プログラム、及び記憶媒体
JP2012242202A (ja) * 2011-05-18 2012-12-10 Alpine Electronics Inc 車載システム
WO2016017253A1 (ja) * 2014-08-01 2016-02-04 ソニー株式会社 情報処理装置、および情報処理方法、並びにプログラム

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023223750A1 (https=) * 2022-05-18 2023-11-23
WO2023223750A1 (ja) * 2022-05-18 2023-11-23 株式会社Ｎｔｔドコモ 表示装置
JP7829680B2 (ja) 2022-05-18 2026-03-13 株式会社Ｎｔｔドコモ 表示装置

Also Published As

Publication number Publication date
JP7376191B2 (ja) 2023-11-08
JPWO2021256241A1 (https=) 2021-12-23

Similar Documents

Publication Publication Date Title
Krase et al. On the spatial semiotics of vernacular landscapes in global cities
Garcia-Lopez et al. An experiment to discover usability guidelines for designing mobile tourist apps
JP2015230512A (ja) ユーザインタフェース画面作成支援システム
Izadi Spatial engagement in Persian ethnic shops in Sydney
Stähli et al. Evaluation of pedestrian navigation in smart cities
JP7376191B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
JP7294735B2 (ja) ナビゲーション装置、ナビゲーションシステム、ナビゲーション方法、プログラム、及び、記録媒体
JP7332197B2 (ja) 情報共有装置、イベント支援システム、情報共有方法、及びイベント支援システムの生産方法
Tredinnick Augmented reality in the business world
JP7393054B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
JP7355467B2 (ja) ガイド装置、ガイドシステム、ガイド方法、プログラム、及び、記録媒体
Jewell et al. Enabling technology
Huang et al. The markings of Argentine Chinatown: stereotypes, hybridisation and ‘invasion’
JP7483995B1 (ja) 通信ネットワークを介したサービスの提供を支援する方法、プログラム及びサーバ
Schmalfuß-Schwarz et al. Supporting independent travelling for people with visual impairments in buildings by harmonizing maps on embossed paper and pin-matrix devices for accessible info-points
JP7368048B2 (ja) 表示装置、イベント支援システム、表示方法、及びイベント支援システムの生産方法
Bin Noon et al. Concerns regarding the accessibility of self-service interactive devices for people with disabilities
US20240127270A1 (en) Demand level calculation apparatus, event support system, demand level calculation method, and event support system production method
US20240127294A1 (en) Advertisement information generation apparatus, event support system, advertisement information generation method, and event support system production method
Schefer Ruy Duarte de Carvalho’s Nelisita: shifting the boundaries of art and science in Angolan Revolutionary Cinema
Yamini Krishna The neo-liberal city and cinema: Deccani films
Drucker Information visualizations and the interpellation of a social subject
Gupta et al. Digital Development of Tourism Events in India
Mansueto et al. Evaluating Hospitality: Tourist Perceptions of Servicescape in Siquijor’s Accommodations through the Lens of Bitner’s Servicescape Model
JP7459020B2 (ja) 情報処理装置、情報処理方法及び情報処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21826325

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022532474

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21826325

Country of ref document: EP

Kind code of ref document: A1